2024-04-26T23:25:57.256 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T23:25:57.256 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675320 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/sessionmap} --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675320/orig.config.yaml 2024-04-26T23:25:57.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T23:25:57.396 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675320 branch: wip-rishabh-testing-20240426.111959 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/sessionmap} email: null first_in_suite: false job_id: '7675320' kernel: flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-testing-20240426.111959 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - client session with non-allowable root sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240426.111959 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 816 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 sleep_before_teardown: 0 subset: 166/512 suite: fs suite_branch: wip-rishabh-testing-20240426.111959 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi137.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIHNbNMXt9RcIZmJG2VcLv075LWZCe3nmIPXJpkY9tilmXW5o7JB6QwrSYD28Ecz5MtItiEgX0K6p15TFi4egsQ= smithi170.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCekY1twoglNRLendcsrWI0NZUuvy57BUZ+r0FTVkzKnuAA/UN5Aq/ai/nJ+KlJldhm+eK4FM3vBlZ2iQUtv9tc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_sessionmap teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_19:30:57 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T23:25:57.397 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa; will attempt to use it 2024-04-26T23:25:57.397 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks 2024-04-26T23:25:57.398 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T23:25:57.399 INFO:teuthology.task.internal:Checking packages... 2024-04-26T23:25:57.427 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'bc612ffb9c1d5bc27536bc917a705262a36d4387' 2024-04-26T23:25:57.427 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T23:25:57.427 INFO:teuthology.packaging:ref: None 2024-04-26T23:25:57.427 INFO:teuthology.packaging:tag: None 2024-04-26T23:25:57.427 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240426.111959 2024-04-26T23:25:57.427 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:25:57.427 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-testing-20240426.111959 2024-04-26T23:25:57.640 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:25:57.642 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T23:25:57.649 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T23:25:57.649 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T23:25:57.655 INFO:teuthology.task.internal:Saving configuration 2024-04-26T23:25:57.672 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T23:25:57.679 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T23:25:57.699 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675320', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 23:20:18.695249', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICeEVdZJ26BBc8u5SVO65DTbZ8xUHDW9K4Y8EBWZtSkQ'} 2024-04-26T23:25:57.719 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675320', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 23:20:18.696757', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPFkflZfhFgqlgqYsIyPbA1ULSvK0vNqQReFcAb9HuRC'} 2024-04-26T23:25:57.719 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T23:25:57.725 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-26T23:25:57.725 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-26T23:25:57.725 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T23:25:57.795 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efd55c9e4c0>, signals=[15]) 2024-04-26T23:25:57.795 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T23:25:57.846 INFO:teuthology.task.internal:Opening connections... 2024-04-26T23:25:57.846 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T23:25:57.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:25:57.926 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T23:25:57.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:25:58.006 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T23:25:58.013 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-04-26T23:25:58.019 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-04-26T23:25:58.019 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-04-26T23:25:58.064 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T23:25:58.064 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Ubuntu" 2024-04-26T23:25:58.064 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="22.04" 2024-04-26T23:25:58.064 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T23:25:58.064 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_CODENAME=jammy 2024-04-26T23:25:58.064 INFO:teuthology.orchestra.run.smithi137.stdout:ID=ubuntu 2024-04-26T23:25:58.064 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE=debian 2024-04-26T23:25:58.064 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T23:25:58.064 INFO:teuthology.orchestra.run.smithi137.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T23:25:58.064 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T23:25:58.065 INFO:teuthology.orchestra.run.smithi137.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T23:25:58.065 INFO:teuthology.orchestra.run.smithi137.stdout:UBUNTU_CODENAME=jammy 2024-04-26T23:25:58.065 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-04-26T23:25:58.087 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2024-04-26T23:25:58.092 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2024-04-26T23:25:58.092 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-04-26T23:25:58.137 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T23:25:58.137 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Ubuntu" 2024-04-26T23:25:58.137 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="22.04" 2024-04-26T23:25:58.137 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T23:25:58.137 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_CODENAME=jammy 2024-04-26T23:25:58.137 INFO:teuthology.orchestra.run.smithi170.stdout:ID=ubuntu 2024-04-26T23:25:58.137 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE=debian 2024-04-26T23:25:58.137 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T23:25:58.137 INFO:teuthology.orchestra.run.smithi170.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T23:25:58.137 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T23:25:58.137 INFO:teuthology.orchestra.run.smithi170.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T23:25:58.138 INFO:teuthology.orchestra.run.smithi170.stdout:UBUNTU_CODENAME=jammy 2024-04-26T23:25:58.138 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-04-26T23:25:58.162 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T23:25:58.171 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T23:25:58.219 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T23:25:58.219 DEBUG:teuthology.orchestra.run.smithi137:> test '!' -e /home/ubuntu/cephtest 2024-04-26T23:25:58.222 DEBUG:teuthology.orchestra.run.smithi170:> test '!' -e /home/ubuntu/cephtest 2024-04-26T23:25:58.226 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T23:25:58.314 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T23:25:58.314 DEBUG:teuthology.orchestra.run.smithi137:> test -z $(ls -A /var/lib/ceph) 2024-04-26T23:25:58.316 DEBUG:teuthology.orchestra.run.smithi170:> test -z $(ls -A /var/lib/ceph) 2024-04-26T23:25:58.331 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T23:25:58.375 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T23:25:58.390 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-26T23:25:58.390 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, timeout 300 2024-04-26T23:25:58.391 DEBUG:teuthology.orchestra.run.smithi137:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T23:25:58.391 DEBUG:teuthology.orchestra.run.smithi170:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T23:25:58.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:25:58.398 DEBUG:teuthology.task.kernel:sha1 for mon.b is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:25:58.398 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T23:25:58.398 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2024-04-26T23:25:58.399 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:25:58.399 DEBUG:teuthology.task.kernel:sha1 for mon.a is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:25:58.399 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T23:25:58.399 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-04-26T23:25:58.446 INFO:teuthology.orchestra.run.smithi170.stdout:5.15.0-56-generic 2024-04-26T23:25:58.446 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:25:58.446 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T23:25:58.447 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:25:58.450 INFO:teuthology.orchestra.run.smithi137.stdout:5.15.0-56-generic 2024-04-26T23:25:58.450 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:25:58.450 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T23:25:58.451 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:25:58.590 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2024-04-26T23:25:58.590 DEBUG:teuthology.orchestra.run.smithi137:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-26T23:25:58.606 INFO:teuthology.orchestra.run.smithi137.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-26T23:25:58.667 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2024-04-26T23:25:58.668 DEBUG:teuthology.orchestra.run.smithi170:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-26T23:25:58.696 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-26T23:25:58.727 INFO:teuthology.orchestra.run.smithi137.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-26T23:25:58.727 INFO:teuthology.orchestra.run.smithi137.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-26T23:25:58.728 INFO:teuthology.orchestra.run.smithi137.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-26T23:25:58.728 INFO:teuthology.orchestra.run.smithi137.stderr:hint: 2024-04-26T23:25:58.728 INFO:teuthology.orchestra.run.smithi137.stderr:hint: git config --global init.defaultBranch 2024-04-26T23:25:58.728 INFO:teuthology.orchestra.run.smithi137.stderr:hint: 2024-04-26T23:25:58.728 INFO:teuthology.orchestra.run.smithi137.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-26T23:25:58.728 INFO:teuthology.orchestra.run.smithi137.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-26T23:25:58.728 INFO:teuthology.orchestra.run.smithi137.stderr:hint: 2024-04-26T23:25:58.728 INFO:teuthology.orchestra.run.smithi137.stderr:hint: git branch -m 2024-04-26T23:25:58.729 INFO:teuthology.orchestra.run.smithi137.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-26T23:25:58.731 DEBUG:teuthology.orchestra.run.smithi137:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-26T23:25:58.798 DEBUG:teuthology.orchestra.run.smithi137:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-26T23:25:58.848 INFO:teuthology.orchestra.run.smithi170.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-26T23:25:58.848 INFO:teuthology.orchestra.run.smithi170.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-26T23:25:58.848 INFO:teuthology.orchestra.run.smithi170.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-26T23:25:58.849 INFO:teuthology.orchestra.run.smithi170.stderr:hint: 2024-04-26T23:25:58.849 INFO:teuthology.orchestra.run.smithi170.stderr:hint: git config --global init.defaultBranch 2024-04-26T23:25:58.849 INFO:teuthology.orchestra.run.smithi170.stderr:hint: 2024-04-26T23:25:58.849 INFO:teuthology.orchestra.run.smithi170.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-26T23:25:58.849 INFO:teuthology.orchestra.run.smithi170.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-26T23:25:58.849 INFO:teuthology.orchestra.run.smithi170.stderr:hint: 2024-04-26T23:25:58.849 INFO:teuthology.orchestra.run.smithi170.stderr:hint: git branch -m 2024-04-26T23:25:58.850 INFO:teuthology.orchestra.run.smithi170.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-26T23:25:58.852 DEBUG:teuthology.orchestra.run.smithi170:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-26T23:25:58.853 DEBUG:teuthology.orchestra.run.smithi137:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-26T23:25:58.924 DEBUG:teuthology.orchestra.run.smithi170:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-26T23:25:58.979 DEBUG:teuthology.orchestra.run.smithi170:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-26T23:27:06.251 INFO:teuthology.orchestra.run.smithi137.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-26T23:27:06.252 INFO:teuthology.orchestra.run.smithi137.stderr: * [new branch] main -> origin/main 2024-04-26T23:27:06.283 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20190312 -> 20190312 2024-04-26T23:27:06.283 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20190416 -> 20190416 2024-04-26T23:27:06.283 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20190514 -> 20190514 2024-04-26T23:27:06.283 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20190618 -> 20190618 2024-04-26T23:27:06.283 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20190717 -> 20190717 2024-04-26T23:27:06.283 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20190815 -> 20190815 2024-04-26T23:27:06.283 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20190923 -> 20190923 2024-04-26T23:27:06.283 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20191022 -> 20191022 2024-04-26T23:27:06.283 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20191215 -> 20191215 2024-04-26T23:27:06.287 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20200122 -> 20200122 2024-04-26T23:27:06.287 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20200316 -> 20200316 2024-04-26T23:27:06.288 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20200421 -> 20200421 2024-04-26T23:27:06.288 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20200519 -> 20200519 2024-04-26T23:27:06.288 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20200619 -> 20200619 2024-04-26T23:27:06.288 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20200721 -> 20200721 2024-04-26T23:27:06.288 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20200817 -> 20200817 2024-04-26T23:27:06.288 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20200918 -> 20200918 2024-04-26T23:27:06.288 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20201022 -> 20201022 2024-04-26T23:27:06.288 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20201118 -> 20201118 2024-04-26T23:27:06.288 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20201218 -> 20201218 2024-04-26T23:27:06.288 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20210208 -> 20210208 2024-04-26T23:27:06.288 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20210315 -> 20210315 2024-04-26T23:27:06.288 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20210511 -> 20210511 2024-04-26T23:27:06.288 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20210716 -> 20210716 2024-04-26T23:27:06.288 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20210818 -> 20210818 2024-04-26T23:27:06.289 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20210919 -> 20210919 2024-04-26T23:27:06.289 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20211027 -> 20211027 2024-04-26T23:27:06.289 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20211216 -> 20211216 2024-04-26T23:27:06.289 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20220209 -> 20220209 2024-04-26T23:27:06.289 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20220310 -> 20220310 2024-04-26T23:27:06.289 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20220411 -> 20220411 2024-04-26T23:27:06.289 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20220509 -> 20220509 2024-04-26T23:27:06.289 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20220610 -> 20220610 2024-04-26T23:27:06.289 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20220708 -> 20220708 2024-04-26T23:27:06.289 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20220815 -> 20220815 2024-04-26T23:27:06.289 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20220913 -> 20220913 2024-04-26T23:27:06.289 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20221012 -> 20221012 2024-04-26T23:27:06.289 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20221109 -> 20221109 2024-04-26T23:27:06.289 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20221214 -> 20221214 2024-04-26T23:27:06.289 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20230117 -> 20230117 2024-04-26T23:27:06.290 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20230210 -> 20230210 2024-04-26T23:27:06.290 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20230310 -> 20230310 2024-04-26T23:27:06.290 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20230404 -> 20230404 2024-04-26T23:27:06.290 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20230515 -> 20230515 2024-04-26T23:27:06.290 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20230625 -> 20230625 2024-04-26T23:27:06.290 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20230804 -> 20230804 2024-04-26T23:27:06.290 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20230919 -> 20230919 2024-04-26T23:27:06.290 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20231030 -> 20231030 2024-04-26T23:27:06.290 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20231111 -> 20231111 2024-04-26T23:27:06.291 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20231211 -> 20231211 2024-04-26T23:27:06.291 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20240115 -> 20240115 2024-04-26T23:27:06.291 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20240220 -> 20240220 2024-04-26T23:27:06.291 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20240312 -> 20240312 2024-04-26T23:27:06.291 INFO:teuthology.orchestra.run.smithi137.stderr: * [new tag] 20240410 -> 20240410 2024-04-26T23:27:07.110 INFO:teuthology.orchestra.run.smithi170.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-26T23:27:07.110 INFO:teuthology.orchestra.run.smithi170.stderr: * [new branch] main -> origin/main 2024-04-26T23:27:07.144 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20190312 -> 20190312 2024-04-26T23:27:07.144 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20190416 -> 20190416 2024-04-26T23:27:07.144 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20190514 -> 20190514 2024-04-26T23:27:07.145 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20190618 -> 20190618 2024-04-26T23:27:07.145 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20190717 -> 20190717 2024-04-26T23:27:07.145 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20190815 -> 20190815 2024-04-26T23:27:07.145 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20190923 -> 20190923 2024-04-26T23:27:07.145 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20191022 -> 20191022 2024-04-26T23:27:07.145 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20191215 -> 20191215 2024-04-26T23:27:07.147 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20200122 -> 20200122 2024-04-26T23:27:07.147 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20200316 -> 20200316 2024-04-26T23:27:07.147 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20200421 -> 20200421 2024-04-26T23:27:07.147 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20200519 -> 20200519 2024-04-26T23:27:07.147 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20200619 -> 20200619 2024-04-26T23:27:07.147 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20200721 -> 20200721 2024-04-26T23:27:07.147 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20200817 -> 20200817 2024-04-26T23:27:07.148 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20200918 -> 20200918 2024-04-26T23:27:07.148 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20201022 -> 20201022 2024-04-26T23:27:07.148 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20201118 -> 20201118 2024-04-26T23:27:07.148 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20201218 -> 20201218 2024-04-26T23:27:07.148 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20210208 -> 20210208 2024-04-26T23:27:07.148 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20210315 -> 20210315 2024-04-26T23:27:07.148 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20210511 -> 20210511 2024-04-26T23:27:07.148 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20210716 -> 20210716 2024-04-26T23:27:07.148 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20210818 -> 20210818 2024-04-26T23:27:07.148 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20210919 -> 20210919 2024-04-26T23:27:07.148 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20211027 -> 20211027 2024-04-26T23:27:07.148 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20211216 -> 20211216 2024-04-26T23:27:07.152 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20220209 -> 20220209 2024-04-26T23:27:07.152 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20220310 -> 20220310 2024-04-26T23:27:07.152 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20220411 -> 20220411 2024-04-26T23:27:07.152 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20220509 -> 20220509 2024-04-26T23:27:07.152 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20220610 -> 20220610 2024-04-26T23:27:07.152 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20220708 -> 20220708 2024-04-26T23:27:07.152 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20220815 -> 20220815 2024-04-26T23:27:07.153 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20220913 -> 20220913 2024-04-26T23:27:07.153 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20221012 -> 20221012 2024-04-26T23:27:07.153 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20221109 -> 20221109 2024-04-26T23:27:07.153 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20221214 -> 20221214 2024-04-26T23:27:07.153 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20230117 -> 20230117 2024-04-26T23:27:07.153 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20230210 -> 20230210 2024-04-26T23:27:07.153 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20230310 -> 20230310 2024-04-26T23:27:07.153 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20230404 -> 20230404 2024-04-26T23:27:07.153 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20230515 -> 20230515 2024-04-26T23:27:07.153 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20230625 -> 20230625 2024-04-26T23:27:07.153 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20230804 -> 20230804 2024-04-26T23:27:07.153 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20230919 -> 20230919 2024-04-26T23:27:07.153 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20231030 -> 20231030 2024-04-26T23:27:07.153 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20231111 -> 20231111 2024-04-26T23:27:07.154 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20231211 -> 20231211 2024-04-26T23:27:07.154 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20240115 -> 20240115 2024-04-26T23:27:07.154 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20240220 -> 20240220 2024-04-26T23:27:07.154 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20240312 -> 20240312 2024-04-26T23:27:07.154 INFO:teuthology.orchestra.run.smithi170.stderr: * [new tag] 20240410 -> 20240410 2024-04-26T23:27:10.555 INFO:teuthology.orchestra.run.smithi137.stderr:Updating files: 45% (1537/3390) Updating files: 46% (1560/3390) Updating files: 47% (1594/3390) Updating files: 48% (1628/3390) Updating files: 49% (1662/3390) Updating files: 50% (1695/3390) Updating files: 51% (1729/3390) Updating files: 52% (1763/3390) Updating files: 53% (1797/3390) Updating files: 54% (1831/3390) Updating files: 55% (1865/3390) Updating files: 56% (1899/3390) Updating files: 57% (1933/3390) Updating files: 58% (1967/3390) Updating files: 59% (2001/3390) Updating files: 59% (2018/3390) Updating files: 60% (2034/3390) Updating files: 61% (2068/3390) Updating files: 62% (2102/3390) Updating files: 63% (2136/3390) Updating files: 64% (2170/3390) Updating files: 65% (2204/3390) Updating files: 66% (2238/3390) Updating files: 67% (2272/3390) Updating files: 68% (2306/3390) Updating files: 69% (2340/3390) Updating files: 69% (2371/3390) Updating files: 70% (2373/3390) Updating files: 71% (2407/3390) Updating files: 72% (2441/3390) Updating files: 73% (2475/3390) Updating files: 74% (2509/3390) Updating files: 75% (2543/3390) Updating files: 76% (2577/3390) Updating files: 77% (2611/3390) Updating files: 78% (2645/3390) Updating files: 79% (2679/3390) Updating files: 80% (2712/3390) Updating files: 81% (2746/3390) Updating files: 82% (2780/3390) Updating files: 83% (2814/3390) Updating files: 83% (2820/3390) Updating files: 84% (2848/3390) Updating files: 85% (2882/3390) Updating files: 86% (2916/3390) Updating files: 87% (2950/3390) Updating files: 88% (2984/3390) Updating files: 89% (3018/3390) Updating files: 90% (3051/3390) Updating files: 91% (3085/3390) Updating files: 92% (3119/3390) Updating files: 93% (3153/3390) Updating files: 94% (3187/3390) Updating files: 95% (3221/3390) Updating files: 96% (3255/3390) Updating files: 97% (3289/3390) Updating files: 98% (3323/3390) Updating files: 99% (3357/3390) Updating files: 100% (3390/3390) Updating files: 100% (3390/3390), done. 2024-04-26T23:27:10.560 INFO:teuthology.orchestra.run.smithi137.stdout:HEAD is now at fc21f475 Merge branch 'robot/pr-0-1714105941' into 'main' 2024-04-26T23:27:10.582 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-04-26T23:27:10.582 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:27:10.733 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-26T23:27:10.733 DEBUG:teuthology.orchestra.run.smithi137:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-26T23:27:10.736 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi137.front.sepia.ceph.com to complete... 2024-04-26T23:27:11.428 INFO:teuthology.orchestra.run.smithi170.stderr:Updating files: 45% (1526/3390) Updating files: 46% (1560/3390) Updating files: 47% (1594/3390) Updating files: 48% (1628/3390) Updating files: 49% (1662/3390) Updating files: 50% (1695/3390) Updating files: 51% (1729/3390) Updating files: 52% (1763/3390) Updating files: 53% (1797/3390) Updating files: 54% (1831/3390) Updating files: 55% (1865/3390) Updating files: 56% (1899/3390) Updating files: 57% (1933/3390) Updating files: 58% (1967/3390) Updating files: 59% (2001/3390) Updating files: 59% (2014/3390) Updating files: 60% (2034/3390) Updating files: 61% (2068/3390) Updating files: 62% (2102/3390) Updating files: 63% (2136/3390) Updating files: 64% (2170/3390) Updating files: 65% (2204/3390) Updating files: 66% (2238/3390) Updating files: 67% (2272/3390) Updating files: 68% (2306/3390) Updating files: 69% (2340/3390) Updating files: 69% (2371/3390) Updating files: 70% (2373/3390) Updating files: 71% (2407/3390) Updating files: 72% (2441/3390) Updating files: 73% (2475/3390) Updating files: 74% (2509/3390) Updating files: 75% (2543/3390) Updating files: 76% (2577/3390) Updating files: 77% (2611/3390) Updating files: 78% (2645/3390) Updating files: 79% (2679/3390) Updating files: 80% (2712/3390) Updating files: 81% (2746/3390) Updating files: 82% (2780/3390) Updating files: 83% (2814/3390) Updating files: 83% (2818/3390) Updating files: 84% (2848/3390) Updating files: 85% (2882/3390) Updating files: 86% (2916/3390) Updating files: 87% (2950/3390) Updating files: 88% (2984/3390) Updating files: 89% (3018/3390) Updating files: 90% (3051/3390) Updating files: 91% (3085/3390) Updating files: 92% (3119/3390) Updating files: 93% (3153/3390) Updating files: 94% (3187/3390) Updating files: 95% (3221/3390) Updating files: 96% (3255/3390) Updating files: 97% (3289/3390) Updating files: 98% (3323/3390) Updating files: 99% (3357/3390) Updating files: 100% (3390/3390) Updating files: 100% (3390/3390), done. 2024-04-26T23:27:11.433 INFO:teuthology.orchestra.run.smithi170.stdout:HEAD is now at fc21f475 Merge branch 'robot/pr-0-1714105941' into 'main' 2024-04-26T23:27:11.454 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-04-26T23:27:11.455 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:27:11.673 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-26T23:27:11.673 DEBUG:teuthology.orchestra.run.smithi170:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-26T23:27:11.676 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi170.front.sepia.ceph.com to complete... 2024-04-26T23:27:12.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26 23:27:12 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-26T23:27:12.805 INFO:teuthology.orchestra.run.smithi137.stderr:FINISHED --2024-04-26 23:27:12-- 2024-04-26T23:27:12.805 INFO:teuthology.orchestra.run.smithi137.stderr:Total wall clock time: 1.9s 2024-04-26T23:27:12.805 INFO:teuthology.orchestra.run.smithi137.stderr:Downloaded: 1 files, 43M in 1.7s (25.6 MB/s) 2024-04-26T23:27:12.809 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-04-26T23:27:12.809 DEBUG:teuthology.orchestra.run.smithi137:> sudo dpkg -i /tmp/linux-image.deb 2024-04-26T23:27:13.051 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-26T23:27:15.033 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-26T23:27:15.037 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-26T23:27:15.141 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T23:27:15.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26 23:27:15 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-26T23:27:15.343 INFO:teuthology.orchestra.run.smithi170.stderr:FINISHED --2024-04-26 23:27:15-- 2024-04-26T23:27:15.343 INFO:teuthology.orchestra.run.smithi170.stderr:Total wall clock time: 3.6s 2024-04-26T23:27:15.343 INFO:teuthology.orchestra.run.smithi170.stderr:Downloaded: 1 files, 43M in 3.2s (13.3 MB/s) 2024-04-26T23:27:15.347 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-04-26T23:27:15.348 DEBUG:teuthology.orchestra.run.smithi170:> sudo dpkg -i /tmp/linux-image.deb 2024-04-26T23:27:15.618 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-26T23:27:17.637 INFO:teuthology.orchestra.run.smithi170.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-26T23:27:17.641 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-26T23:27:17.731 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T23:27:19.118 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T23:27:19.231 INFO:teuthology.orchestra.run.smithi137.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T23:27:21.509 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T23:27:21.618 INFO:teuthology.orchestra.run.smithi170.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T23:27:41.237 INFO:teuthology.orchestra.run.smithi137.stderr:Sourcing file `/etc/default/grub' 2024-04-26T23:27:41.250 INFO:teuthology.orchestra.run.smithi137.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T23:27:41.268 INFO:teuthology.orchestra.run.smithi137.stderr:Generating grub configuration file ... 2024-04-26T23:27:41.635 INFO:teuthology.orchestra.run.smithi137.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T23:27:41.651 INFO:teuthology.orchestra.run.smithi137.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T23:27:41.974 INFO:teuthology.orchestra.run.smithi137.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T23:27:41.982 INFO:teuthology.orchestra.run.smithi137.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T23:27:42.045 INFO:teuthology.orchestra.run.smithi137.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T23:27:42.050 INFO:teuthology.orchestra.run.smithi137.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T23:27:42.202 INFO:teuthology.orchestra.run.smithi137.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T23:27:42.202 INFO:teuthology.orchestra.run.smithi137.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T23:27:42.202 INFO:teuthology.orchestra.run.smithi137.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T23:27:42.241 INFO:teuthology.orchestra.run.smithi137.stderr:done 2024-04-26T23:27:42.317 INFO:teuthology.orchestra.run.smithi170.stderr:Sourcing file `/etc/default/grub' 2024-04-26T23:27:42.327 INFO:teuthology.orchestra.run.smithi170.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T23:27:42.352 INFO:teuthology.orchestra.run.smithi170.stderr:Generating grub configuration file ... 2024-04-26T23:27:42.424 DEBUG:teuthology.orchestra.run.smithi137:> dpkg-deb -c /tmp/linux-image.deb 2024-04-26T23:27:42.432 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-26T23:27:42.432 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-26T23:27:42.432 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T23:27:42.449 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T23:27:42.450 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T23:27:42.472 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-26T23:27:42.473 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-26T23:27:42.473 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-26T23:27:42.473 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-26T23:27:42.473 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-26T23:27:42.473 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-26T23:27:42.473 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-26T23:27:42.473 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-26T23:27:42.473 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-26T23:27:42.473 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-26T23:27:42.473 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-26T23:27:42.473 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-26T23:27:42.473 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-26T23:27:42.473 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-26T23:27:42.474 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T23:27:42.474 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T23:27:42.474 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T23:27:42.474 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T23:27:42.474 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T23:27:42.474 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T23:27:42.474 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T23:27:42.474 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T23:27:42.474 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T23:27:42.474 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T23:27:42.474 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T23:27:42.474 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T23:27:42.474 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T23:27:42.475 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T23:27:42.475 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T23:27:42.475 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T23:27:42.475 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T23:27:42.475 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T23:27:42.475 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T23:27:42.475 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-26T23:27:42.475 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-26T23:27:42.475 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-26T23:27:42.475 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T23:27:42.476 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-26T23:27:42.476 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-26T23:27:42.476 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-26T23:27:42.476 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T23:27:42.476 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T23:27:42.477 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T23:27:42.493 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-26T23:27:42.494 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-26T23:27:42.494 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-26T23:27:42.494 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-26T23:27:42.494 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T23:27:42.494 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T23:27:42.494 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T23:27:42.494 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-26T23:27:42.494 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-26T23:27:42.494 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-26T23:27:42.494 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T23:27:42.494 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T23:27:42.495 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T23:27:42.495 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T23:27:42.495 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T23:27:42.495 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T23:27:42.495 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T23:27:42.495 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T23:27:42.495 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T23:27:42.495 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T23:27:42.495 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T23:27:42.495 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T23:27:42.495 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T23:27:42.495 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T23:27:42.495 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T23:27:42.496 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T23:27:42.496 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T23:27:42.496 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T23:27:42.496 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-26T23:27:42.496 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T23:27:42.496 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-26T23:27:42.496 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T23:27:42.496 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T23:27:42.496 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T23:27:42.496 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T23:27:42.496 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T23:27:42.496 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T23:27:42.496 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T23:27:42.497 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T23:27:42.497 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-26T23:27:42.497 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T23:27:42.497 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T23:27:42.497 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T23:27:42.497 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T23:27:42.497 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T23:27:42.497 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T23:27:42.497 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T23:27:42.497 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T23:27:42.497 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T23:27:42.497 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T23:27:42.497 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T23:27:42.497 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T23:27:42.498 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T23:27:42.498 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T23:27:42.498 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T23:27:42.498 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T23:27:42.498 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T23:27:42.498 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-26T23:27:42.498 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T23:27:42.498 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-26T23:27:42.498 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-26T23:27:42.498 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-26T23:27:42.498 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T23:27:42.498 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T23:27:42.498 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-26T23:27:42.498 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-26T23:27:42.499 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T23:27:42.499 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T23:27:42.499 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T23:27:42.499 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T23:27:42.499 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T23:27:42.499 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-26T23:27:42.499 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T23:27:42.499 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-26T23:27:42.499 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T23:27:42.499 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-26T23:27:42.499 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T23:27:42.499 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T23:27:42.499 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T23:27:42.499 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T23:27:42.500 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T23:27:42.500 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T23:27:42.500 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T23:27:42.500 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T23:27:42.500 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T23:27:42.500 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T23:27:42.500 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T23:27:42.500 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T23:27:42.500 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T23:27:42.500 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T23:27:42.500 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T23:27:42.500 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T23:27:42.500 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T23:27:42.501 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T23:27:42.501 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-26T23:27:42.501 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T23:27:42.501 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T23:27:42.501 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T23:27:42.501 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T23:27:42.501 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T23:27:42.501 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T23:27:42.501 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T23:27:42.501 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T23:27:42.501 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T23:27:42.501 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T23:27:42.501 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T23:27:42.501 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T23:27:42.501 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T23:27:42.502 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-26T23:27:42.502 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T23:27:42.502 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-26T23:27:42.502 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T23:27:42.502 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T23:27:42.502 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T23:27:42.502 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T23:27:42.502 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T23:27:42.502 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T23:27:42.502 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T23:27:42.502 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T23:27:42.502 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T23:27:42.502 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T23:27:42.502 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T23:27:42.503 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T23:27:42.503 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T23:27:42.503 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T23:27:42.503 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T23:27:42.503 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T23:27:42.503 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T23:27:42.503 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T23:27:42.503 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T23:27:42.503 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T23:27:42.503 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-26T23:27:42.503 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T23:27:42.503 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-26T23:27:42.503 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T23:27:42.503 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-26T23:27:42.504 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-26T23:27:42.504 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T23:27:42.504 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-26T23:27:42.504 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T23:27:42.504 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T23:27:42.504 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-26T23:27:42.504 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T23:27:42.504 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T23:27:42.504 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-26T23:27:42.504 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T23:27:42.504 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T23:27:42.504 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T23:27:42.504 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-26T23:27:42.504 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T23:27:42.505 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-26T23:27:42.505 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T23:27:42.505 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-26T23:27:42.505 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-26T23:27:42.505 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T23:27:42.505 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-26T23:27:42.505 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T23:27:42.505 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T23:27:42.505 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T23:27:42.505 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T23:27:42.505 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T23:27:42.505 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-26T23:27:42.506 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T23:27:42.506 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T23:27:42.506 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T23:27:42.506 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T23:27:42.506 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T23:27:42.509 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T23:27:42.509 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T23:27:42.509 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-26T23:27:42.509 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T23:27:42.509 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-26T23:27:42.575 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T23:27:42.575 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T23:27:42.575 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-26T23:27:42.575 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T23:27:42.575 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-26T23:27:42.575 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-26T23:27:42.575 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-26T23:27:42.575 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T23:27:42.575 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T23:27:42.575 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-26T23:27:42.575 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-26T23:27:42.576 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-26T23:27:42.576 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-26T23:27:42.576 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-26T23:27:42.576 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-26T23:27:42.576 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-26T23:27:42.576 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-26T23:27:42.576 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-26T23:27:42.576 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-26T23:27:42.576 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-26T23:27:42.576 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T23:27:42.576 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T23:27:42.576 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T23:27:42.576 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-26T23:27:42.576 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-26T23:27:42.577 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T23:27:42.577 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T23:27:42.577 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-26T23:27:42.577 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-26T23:27:42.577 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-26T23:27:42.577 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T23:27:42.577 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-26T23:27:42.577 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T23:27:42.577 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T23:27:42.577 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T23:27:42.577 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-26T23:27:42.577 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T23:27:42.577 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-26T23:27:42.577 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T23:27:42.578 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-26T23:27:42.578 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-26T23:27:42.578 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T23:27:42.578 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-26T23:27:42.578 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T23:27:42.578 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-26T23:27:42.578 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T23:27:42.578 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T23:27:42.578 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T23:27:42.578 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T23:27:42.578 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T23:27:42.578 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T23:27:42.578 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T23:27:42.579 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T23:27:42.579 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T23:27:42.579 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T23:27:42.579 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T23:27:42.579 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T23:27:42.579 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T23:27:42.579 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-26T23:27:42.579 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-26T23:27:42.579 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-26T23:27:42.579 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-26T23:27:42.579 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-26T23:27:42.579 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-26T23:27:42.579 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-26T23:27:42.579 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-26T23:27:42.580 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-26T23:27:42.580 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-26T23:27:42.580 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-26T23:27:42.580 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-26T23:27:42.580 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T23:27:42.580 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-26T23:27:42.580 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-26T23:27:42.580 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-26T23:27:42.580 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-26T23:27:42.580 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-26T23:27:42.580 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-26T23:27:42.580 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-26T23:27:42.580 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-26T23:27:42.581 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-26T23:27:42.581 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T23:27:42.581 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-26T23:27:42.581 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-26T23:27:42.581 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-26T23:27:42.581 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-26T23:27:42.581 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-26T23:27:42.581 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-26T23:27:42.581 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-26T23:27:42.581 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-26T23:27:42.581 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-26T23:27:42.581 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-26T23:27:42.581 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-26T23:27:42.581 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-26T23:27:42.581 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-26T23:27:42.582 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-26T23:27:42.582 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-26T23:27:42.582 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T23:27:42.582 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-26T23:27:42.582 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-26T23:27:42.582 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-26T23:27:42.582 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-26T23:27:42.582 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-26T23:27:42.582 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-26T23:27:42.582 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-26T23:27:42.582 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T23:27:42.582 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T23:27:42.582 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T23:27:42.582 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-26T23:27:42.583 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-26T23:27:42.583 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-26T23:27:42.583 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-26T23:27:42.583 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-26T23:27:42.583 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T23:27:42.583 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T23:27:42.583 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T23:27:42.583 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T23:27:42.583 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-26T23:27:42.583 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T23:27:42.583 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-26T23:27:42.583 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T23:27:42.583 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T23:27:42.583 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T23:27:42.584 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T23:27:42.584 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T23:27:42.584 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T23:27:42.584 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T23:27:42.584 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-26T23:27:42.584 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T23:27:42.584 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T23:27:42.584 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T23:27:42.584 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T23:27:42.584 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T23:27:42.584 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-26T23:27:42.584 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T23:27:42.584 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T23:27:42.584 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-26T23:27:42.585 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-26T23:27:42.585 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-26T23:27:42.585 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-26T23:27:42.585 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T23:27:42.585 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-26T23:27:42.585 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T23:27:42.585 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T23:27:42.585 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T23:27:42.585 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T23:27:42.585 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T23:27:42.585 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T23:27:42.585 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T23:27:42.585 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T23:27:42.585 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T23:27:42.586 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T23:27:42.586 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T23:27:42.586 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T23:27:42.586 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T23:27:42.586 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T23:27:42.586 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T23:27:42.586 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T23:27:42.586 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T23:27:42.586 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T23:27:42.586 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T23:27:42.586 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T23:27:42.586 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T23:27:42.586 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T23:27:42.586 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T23:27:42.587 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T23:27:42.587 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T23:27:42.587 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T23:27:42.587 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T23:27:42.587 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T23:27:42.587 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T23:27:42.587 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T23:27:42.587 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T23:27:42.587 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T23:27:42.587 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T23:27:42.587 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T23:27:42.587 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T23:27:42.587 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T23:27:42.587 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T23:27:42.588 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T23:27:42.588 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T23:27:42.588 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-26T23:27:42.588 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T23:27:42.588 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-26T23:27:42.588 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-26T23:27:42.588 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-26T23:27:42.588 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-26T23:27:42.588 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T23:27:42.588 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-26T23:27:42.588 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T23:27:42.588 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T23:27:42.588 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T23:27:42.588 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-26T23:27:42.589 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T23:27:42.589 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T23:27:42.589 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T23:27:42.589 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T23:27:42.589 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T23:27:42.589 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T23:27:42.589 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T23:27:42.589 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T23:27:42.589 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T23:27:42.589 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T23:27:42.589 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T23:27:42.589 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T23:27:42.589 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T23:27:42.589 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T23:27:42.590 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T23:27:42.590 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T23:27:42.590 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T23:27:42.590 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T23:27:42.590 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T23:27:42.590 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T23:27:42.590 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T23:27:42.590 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T23:27:42.590 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T23:27:42.590 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T23:27:42.590 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T23:27:42.590 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-26T23:27:42.590 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-26T23:27:42.590 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T23:27:42.591 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T23:27:42.591 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T23:27:42.591 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T23:27:42.591 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T23:27:42.591 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-26T23:27:42.591 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T23:27:42.591 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T23:27:42.591 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T23:27:42.591 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T23:27:42.591 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T23:27:42.591 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T23:27:42.591 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T23:27:42.591 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T23:27:42.591 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T23:27:42.592 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T23:27:42.592 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-26T23:27:42.592 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T23:27:42.592 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T23:27:42.592 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T23:27:42.592 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T23:27:42.592 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T23:27:42.592 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T23:27:42.592 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T23:27:42.592 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T23:27:42.592 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-26T23:27:42.592 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T23:27:42.592 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T23:27:42.592 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T23:27:42.593 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T23:27:42.593 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T23:27:42.593 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T23:27:42.593 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T23:27:42.593 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T23:27:42.593 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T23:27:42.593 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T23:27:42.593 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T23:27:42.593 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T23:27:42.593 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T23:27:42.593 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T23:27:42.593 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T23:27:42.593 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T23:27:42.593 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T23:27:42.594 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T23:27:42.594 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T23:27:42.594 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T23:27:42.594 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T23:27:42.594 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T23:27:42.594 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T23:27:42.594 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T23:27:42.594 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T23:27:42.594 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T23:27:42.594 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T23:27:42.594 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T23:27:42.594 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T23:27:42.594 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T23:27:42.594 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T23:27:42.595 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T23:27:42.595 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-26T23:27:42.595 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T23:27:42.595 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-26T23:27:42.595 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T23:27:42.595 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T23:27:42.595 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T23:27:42.595 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T23:27:42.595 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T23:27:42.595 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T23:27:42.595 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T23:27:42.595 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-26T23:27:42.595 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T23:27:42.595 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T23:27:42.596 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T23:27:42.596 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T23:27:42.596 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T23:27:42.596 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T23:27:42.596 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T23:27:42.596 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T23:27:42.596 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T23:27:42.596 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T23:27:42.596 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T23:27:42.596 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T23:27:42.596 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T23:27:42.596 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T23:27:42.596 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T23:27:42.596 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T23:27:42.597 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T23:27:42.597 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T23:27:42.597 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T23:27:42.597 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T23:27:42.597 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T23:27:42.597 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T23:27:42.597 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T23:27:42.597 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T23:27:42.597 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T23:27:42.597 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T23:27:42.597 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T23:27:42.597 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T23:27:42.597 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T23:27:42.597 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T23:27:42.598 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T23:27:42.598 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T23:27:42.598 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T23:27:42.598 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T23:27:42.598 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T23:27:42.598 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T23:27:42.598 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T23:27:42.598 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T23:27:42.598 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T23:27:42.598 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T23:27:42.598 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T23:27:42.598 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-26T23:27:42.598 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-26T23:27:42.598 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-26T23:27:42.599 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-26T23:27:42.599 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T23:27:42.599 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T23:27:42.599 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-26T23:27:42.599 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-26T23:27:42.599 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-26T23:27:42.599 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-26T23:27:42.599 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T23:27:42.599 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T23:27:42.599 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T23:27:42.599 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-26T23:27:42.599 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T23:27:42.599 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-26T23:27:42.599 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T23:27:42.600 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T23:27:42.600 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T23:27:42.600 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T23:27:42.600 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-26T23:27:42.600 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-26T23:27:42.600 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T23:27:42.600 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T23:27:42.600 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T23:27:42.600 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-26T23:27:42.600 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T23:27:42.600 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T23:27:42.600 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-26T23:27:42.600 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T23:27:42.600 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T23:27:42.601 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T23:27:42.601 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-26T23:27:42.601 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T23:27:42.601 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T23:27:42.601 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-26T23:27:42.601 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-26T23:27:42.601 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T23:27:42.601 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-26T23:27:42.601 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T23:27:42.601 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T23:27:42.601 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T23:27:42.601 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T23:27:42.601 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-26T23:27:42.601 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T23:27:42.601 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T23:27:42.602 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T23:27:42.602 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-26T23:27:42.602 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-26T23:27:42.602 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-26T23:27:42.602 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-26T23:27:42.602 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-26T23:27:42.602 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-26T23:27:42.602 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T23:27:42.602 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T23:27:42.602 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T23:27:42.602 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T23:27:42.602 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T23:27:42.602 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T23:27:42.602 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T23:27:42.603 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-26T23:27:42.603 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-26T23:27:42.603 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T23:27:42.603 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-26T23:27:42.603 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T23:27:42.603 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-26T23:27:42.603 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T23:27:42.603 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-26T23:27:42.603 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T23:27:42.603 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-26T23:27:42.603 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-26T23:27:42.603 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-26T23:27:42.603 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-26T23:27:42.603 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-26T23:27:42.604 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-26T23:27:42.604 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T23:27:42.604 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-26T23:27:42.604 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T23:27:42.604 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-26T23:27:42.604 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T23:27:42.604 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-26T23:27:42.604 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T23:27:42.604 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-26T23:27:42.604 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T23:27:42.604 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-26T23:27:42.604 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-26T23:27:42.604 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-26T23:27:42.604 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-26T23:27:42.605 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T23:27:42.605 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T23:27:42.605 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T23:27:42.605 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T23:27:42.605 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-26T23:27:42.605 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-26T23:27:42.605 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-26T23:27:42.605 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-26T23:27:42.605 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-26T23:27:42.605 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T23:27:42.605 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-26T23:27:42.605 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-26T23:27:42.605 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-26T23:27:42.605 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-26T23:27:42.605 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-26T23:27:42.606 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-26T23:27:42.606 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-26T23:27:42.606 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-26T23:27:42.606 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-26T23:27:42.606 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-26T23:27:42.606 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-26T23:27:42.606 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-26T23:27:42.606 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-26T23:27:42.606 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-26T23:27:42.606 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-26T23:27:42.606 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-26T23:27:42.607 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-26T23:27:42.607 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-26T23:27:42.607 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-26T23:27:42.607 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-26T23:27:42.607 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-26T23:27:42.607 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T23:27:42.607 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T23:27:42.607 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T23:27:42.607 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T23:27:42.607 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-26T23:27:42.607 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-26T23:27:42.607 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T23:27:42.607 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T23:27:42.607 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T23:27:42.607 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T23:27:42.608 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-26T23:27:42.608 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T23:27:42.608 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-26T23:27:42.608 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T23:27:42.608 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T23:27:42.608 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-26T23:27:42.608 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T23:27:42.608 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-26T23:27:42.608 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-26T23:27:42.608 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-26T23:27:42.608 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T23:27:42.608 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-26T23:27:42.608 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T23:27:42.608 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-26T23:27:42.609 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-26T23:27:42.609 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-26T23:27:42.609 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-26T23:27:42.609 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T23:27:42.609 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-26T23:27:42.609 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-26T23:27:42.609 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-26T23:27:42.609 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T23:27:42.609 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-26T23:27:42.609 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-26T23:27:42.609 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-26T23:27:42.609 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T23:27:42.609 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-26T23:27:42.610 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-26T23:27:42.610 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-26T23:27:42.610 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-26T23:27:42.610 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-26T23:27:42.610 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-26T23:27:42.610 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-26T23:27:42.610 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T23:27:42.610 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-26T23:27:42.610 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-26T23:27:42.610 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-26T23:27:42.610 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-26T23:27:42.610 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T23:27:42.610 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T23:27:42.610 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T23:27:42.611 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T23:27:42.611 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T23:27:42.611 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T23:27:42.611 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T23:27:42.611 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T23:27:42.611 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T23:27:42.611 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-26T23:27:42.611 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-26T23:27:42.611 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T23:27:42.611 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T23:27:42.611 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-26T23:27:42.611 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T23:27:42.611 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T23:27:42.611 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T23:27:42.612 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T23:27:42.612 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-26T23:27:42.612 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T23:27:42.612 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T23:27:42.612 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-26T23:27:42.612 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-26T23:27:42.612 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T23:27:42.612 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T23:27:42.612 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T23:27:42.612 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-26T23:27:42.612 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T23:27:42.612 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T23:27:42.612 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-26T23:27:42.612 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T23:27:42.613 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T23:27:42.613 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T23:27:42.613 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-26T23:27:42.613 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-26T23:27:42.613 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T23:27:42.613 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T23:27:42.613 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T23:27:42.613 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T23:27:42.613 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T23:27:42.613 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-26T23:27:42.613 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-26T23:27:42.613 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T23:27:42.613 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T23:27:42.613 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T23:27:42.614 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T23:27:42.614 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T23:27:42.614 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T23:27:42.614 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T23:27:42.614 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-26T23:27:42.614 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-26T23:27:42.614 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-26T23:27:42.614 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-26T23:27:42.614 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-26T23:27:42.614 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-26T23:27:42.614 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-26T23:27:42.614 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-26T23:27:42.614 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-26T23:27:42.614 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-26T23:27:42.615 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-26T23:27:42.615 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-26T23:27:42.615 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-26T23:27:42.615 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-26T23:27:42.615 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T23:27:42.615 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T23:27:42.615 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-26T23:27:42.615 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-26T23:27:42.615 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-26T23:27:42.615 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-26T23:27:42.615 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-26T23:27:42.615 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-26T23:27:42.615 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-26T23:27:42.615 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-26T23:27:42.616 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-26T23:27:42.616 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-26T23:27:42.616 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T23:27:42.616 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-26T23:27:42.616 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-26T23:27:42.616 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T23:27:42.616 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T23:27:42.616 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T23:27:42.616 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-26T23:27:42.616 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-26T23:27:42.616 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-26T23:27:42.616 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-26T23:27:42.616 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-26T23:27:42.616 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T23:27:42.616 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T23:27:42.617 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T23:27:42.617 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T23:27:42.617 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-26T23:27:42.617 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-26T23:27:42.617 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-26T23:27:42.617 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-26T23:27:42.617 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T23:27:42.617 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-26T23:27:42.617 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-26T23:27:42.617 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-26T23:27:42.617 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-26T23:27:42.617 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-26T23:27:42.617 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T23:27:42.617 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T23:27:42.618 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T23:27:42.618 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T23:27:42.618 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-26T23:27:42.618 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-26T23:27:42.618 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-26T23:27:42.618 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T23:27:42.618 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-26T23:27:42.618 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-26T23:27:42.618 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-26T23:27:42.618 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T23:27:42.618 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T23:27:42.618 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-26T23:27:42.618 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T23:27:42.618 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T23:27:42.619 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-26T23:27:42.619 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T23:27:42.619 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T23:27:42.619 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T23:27:42.619 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-26T23:27:42.619 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-26T23:27:42.619 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-26T23:27:42.619 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T23:27:42.619 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T23:27:42.619 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T23:27:42.619 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T23:27:42.619 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-26T23:27:42.619 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T23:27:42.619 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-26T23:27:42.620 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-26T23:27:42.620 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T23:27:42.620 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-26T23:27:42.620 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-26T23:27:42.620 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T23:27:42.620 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T23:27:42.620 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T23:27:42.620 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-26T23:27:42.620 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T23:27:42.620 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T23:27:42.620 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T23:27:42.620 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-26T23:27:42.620 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-26T23:27:42.620 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T23:27:42.621 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T23:27:42.621 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T23:27:42.621 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T23:27:42.621 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-26T23:27:42.621 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T23:27:42.621 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T23:27:42.621 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T23:27:42.621 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T23:27:42.621 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-26T23:27:42.621 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T23:27:42.621 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-26T23:27:42.621 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T23:27:42.621 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-26T23:27:42.621 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T23:27:42.622 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-26T23:27:42.622 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T23:27:42.622 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-26T23:27:42.622 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T23:27:42.622 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T23:27:42.622 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T23:27:42.622 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-26T23:27:42.622 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-26T23:27:42.622 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T23:27:42.622 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-26T23:27:42.622 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T23:27:42.622 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-26T23:27:42.622 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T23:27:42.623 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-26T23:27:42.623 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T23:27:42.623 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T23:27:42.623 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-26T23:27:42.623 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T23:27:42.623 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T23:27:42.623 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-26T23:27:42.623 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T23:27:42.623 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T23:27:42.623 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-26T23:27:42.623 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T23:27:42.623 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T23:27:42.623 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-26T23:27:42.625 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-26T23:27:42.625 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T23:27:42.625 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-26T23:27:42.625 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-26T23:27:42.625 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T23:27:42.625 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-26T23:27:42.625 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T23:27:42.625 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-26T23:27:42.625 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T23:27:42.625 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-26T23:27:42.625 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T23:27:42.625 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-26T23:27:42.626 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T23:27:42.626 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-26T23:27:42.626 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-26T23:27:42.626 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T23:27:42.626 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-26T23:27:42.626 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-26T23:27:42.626 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T23:27:42.626 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T23:27:42.626 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T23:27:42.626 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T23:27:42.626 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T23:27:42.626 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T23:27:42.626 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-26T23:27:42.626 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T23:27:42.627 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T23:27:42.627 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T23:27:42.627 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-26T23:27:42.627 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-26T23:27:42.627 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-26T23:27:42.627 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T23:27:42.627 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T23:27:42.627 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T23:27:42.627 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-26T23:27:42.627 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-26T23:27:42.627 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-26T23:27:42.627 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T23:27:42.627 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-26T23:27:42.627 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T23:27:42.628 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-26T23:27:42.628 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T23:27:42.628 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-26T23:27:42.628 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T23:27:42.628 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-26T23:27:42.628 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T23:27:42.655 INFO:teuthology.orchestra.run.smithi170.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T23:27:42.666 INFO:teuthology.orchestra.run.smithi170.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T23:27:42.705 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-26T23:27:42.705 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T23:27:42.705 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-26T23:27:42.706 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T23:27:42.706 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-26T23:27:42.706 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T23:27:42.706 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-26T23:27:42.706 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T23:27:42.706 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-26T23:27:42.706 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T23:27:42.706 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T23:27:42.706 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-26T23:27:42.706 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T23:27:42.706 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T23:27:42.706 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T23:27:42.706 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-26T23:27:42.707 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-26T23:27:42.707 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T23:27:42.707 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T23:27:42.707 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-26T23:27:42.707 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-26T23:27:42.707 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T23:27:42.707 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-26T23:27:42.707 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-26T23:27:42.707 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-26T23:27:42.707 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-26T23:27:42.707 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T23:27:42.707 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-26T23:27:42.707 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-26T23:27:42.707 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T23:27:42.708 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-26T23:27:42.708 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T23:27:42.708 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T23:27:42.708 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-26T23:27:42.708 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T23:27:42.708 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-26T23:27:42.708 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T23:27:42.708 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-26T23:27:42.708 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T23:27:42.708 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T23:27:42.708 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-26T23:27:42.708 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-26T23:27:42.708 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T23:27:42.708 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T23:27:42.708 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-26T23:27:42.709 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T23:27:42.709 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-26T23:27:42.709 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T23:27:42.709 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-26T23:27:42.709 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T23:27:42.709 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T23:27:42.709 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T23:27:42.709 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T23:27:42.709 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-26T23:27:42.709 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-26T23:27:42.709 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-26T23:27:42.709 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-26T23:27:42.709 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T23:27:42.709 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-26T23:27:42.710 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T23:27:42.710 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-26T23:27:42.710 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T23:27:42.710 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T23:27:42.710 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-26T23:27:42.710 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T23:27:42.710 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T23:27:42.710 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T23:27:42.710 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T23:27:42.710 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-26T23:27:42.710 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-26T23:27:42.710 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-26T23:27:42.710 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T23:27:42.711 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-26T23:27:42.711 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T23:27:42.711 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-26T23:27:42.711 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T23:27:42.711 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T23:27:42.711 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T23:27:42.711 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T23:27:42.711 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-26T23:27:42.711 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T23:27:42.711 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-26T23:27:42.711 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T23:27:42.711 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-26T23:27:42.711 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T23:27:42.711 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T23:27:42.712 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-26T23:27:42.712 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T23:27:42.712 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T23:27:42.712 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-26T23:27:42.712 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T23:27:42.712 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-26T23:27:42.712 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-26T23:27:42.712 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-26T23:27:42.712 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-26T23:27:42.712 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T23:27:42.712 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-26T23:27:42.712 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T23:27:42.712 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-26T23:27:42.713 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T23:27:42.713 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T23:27:42.713 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-26T23:27:42.713 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T23:27:42.713 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T23:27:42.713 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T23:27:42.713 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-26T23:27:42.713 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T23:27:42.713 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T23:27:42.713 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-26T23:27:42.713 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T23:27:42.713 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T23:27:42.713 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T23:27:42.713 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T23:27:42.713 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T23:27:42.714 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-26T23:27:42.714 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T23:27:42.714 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T23:27:42.714 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-26T23:27:42.714 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T23:27:42.714 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T23:27:42.714 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T23:27:42.714 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T23:27:42.714 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T23:27:42.714 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T23:27:42.714 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T23:27:42.714 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T23:27:42.714 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T23:27:42.714 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T23:27:42.715 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T23:27:42.715 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T23:27:42.715 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T23:27:42.715 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T23:27:42.715 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T23:27:42.715 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T23:27:42.715 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T23:27:42.715 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T23:27:42.715 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T23:27:42.715 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-26T23:27:42.715 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-26T23:27:42.715 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-26T23:27:42.715 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T23:27:42.715 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T23:27:42.716 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T23:27:42.716 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T23:27:42.716 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T23:27:42.716 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T23:27:42.716 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T23:27:42.716 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T23:27:42.716 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-26T23:27:42.716 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-26T23:27:42.716 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T23:27:42.716 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T23:27:42.716 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T23:27:42.716 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-26T23:27:42.716 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T23:27:42.716 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T23:27:42.717 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T23:27:42.717 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T23:27:42.717 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T23:27:42.717 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T23:27:42.717 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T23:27:42.717 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-26T23:27:42.717 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T23:27:42.717 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-26T23:27:42.717 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T23:27:42.717 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-26T23:27:42.717 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T23:27:42.717 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-26T23:27:42.717 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T23:27:42.717 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-26T23:27:42.717 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-26T23:27:42.718 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T23:27:42.718 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T23:27:42.718 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-26T23:27:42.718 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T23:27:42.718 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T23:27:42.718 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T23:27:42.718 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T23:27:42.718 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-26T23:27:42.718 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-26T23:27:42.718 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T23:27:42.718 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-26T23:27:42.718 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-26T23:27:42.718 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-26T23:27:42.718 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T23:27:42.719 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-26T23:27:42.719 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T23:27:42.719 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-26T23:27:42.719 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-26T23:27:42.719 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-26T23:27:42.719 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T23:27:42.719 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T23:27:42.719 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-26T23:27:42.719 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-26T23:27:42.719 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-26T23:27:42.719 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-26T23:27:42.719 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-26T23:27:42.719 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-26T23:27:42.719 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-26T23:27:42.720 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T23:27:42.720 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-26T23:27:42.720 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-26T23:27:42.720 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-26T23:27:42.720 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-26T23:27:42.720 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-26T23:27:42.720 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-26T23:27:42.720 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-26T23:27:42.720 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-26T23:27:42.720 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-26T23:27:42.720 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-26T23:27:42.720 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T23:27:42.720 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T23:27:42.720 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T23:27:42.721 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T23:27:42.721 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T23:27:42.721 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T23:27:42.721 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T23:27:42.721 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T23:27:42.721 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T23:27:42.721 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T23:27:42.721 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T23:27:42.721 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T23:27:42.721 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-26T23:27:42.721 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-26T23:27:42.721 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T23:27:42.721 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-26T23:27:42.721 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T23:27:42.721 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T23:27:42.722 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T23:27:42.722 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T23:27:42.722 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T23:27:42.722 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T23:27:42.722 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T23:27:42.722 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T23:27:42.722 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T23:27:42.722 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T23:27:42.722 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T23:27:42.722 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-26T23:27:42.722 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-26T23:27:42.722 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-26T23:27:42.722 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-26T23:27:42.723 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-26T23:27:42.723 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-26T23:27:42.723 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-26T23:27:42.723 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-26T23:27:42.723 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-26T23:27:42.723 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-26T23:27:42.723 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-26T23:27:42.723 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-26T23:27:42.723 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-26T23:27:42.723 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-26T23:27:42.723 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-26T23:27:42.723 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-26T23:27:42.723 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-26T23:27:42.723 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-26T23:27:42.724 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-26T23:27:42.724 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-26T23:27:42.724 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-26T23:27:42.724 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-26T23:27:42.724 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-26T23:27:42.724 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-26T23:27:42.724 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-26T23:27:42.724 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-26T23:27:42.724 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-26T23:27:42.724 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-26T23:27:42.724 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-26T23:27:42.724 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T23:27:42.724 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T23:27:42.725 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-26T23:27:42.725 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-26T23:27:42.725 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T23:27:42.725 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T23:27:42.725 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T23:27:42.725 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T23:27:42.725 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-26T23:27:42.725 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T23:27:42.725 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T23:27:42.725 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-26T23:27:42.725 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-26T23:27:42.725 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-26T23:27:42.725 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T23:27:42.725 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T23:27:42.726 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-26T23:27:42.726 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-26T23:27:42.726 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-26T23:27:42.726 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T23:27:42.726 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-26T23:27:42.726 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-26T23:27:42.726 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-26T23:27:42.726 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T23:27:42.726 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T23:27:42.726 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T23:27:42.726 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T23:27:42.726 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T23:27:42.726 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T23:27:42.726 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T23:27:42.727 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T23:27:42.727 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T23:27:42.727 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T23:27:42.727 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T23:27:42.727 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T23:27:42.727 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T23:27:42.727 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-26T23:27:42.727 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T23:27:42.727 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T23:27:42.727 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T23:27:42.727 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-26T23:27:42.727 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T23:27:42.727 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-26T23:27:42.727 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-26T23:27:42.728 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-26T23:27:42.728 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-26T23:27:42.728 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-26T23:27:42.728 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T23:27:42.728 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-26T23:27:42.728 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T23:27:42.728 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-26T23:27:42.728 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T23:27:42.728 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T23:27:42.728 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T23:27:42.728 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T23:27:42.728 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-26T23:27:42.728 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T23:27:42.728 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T23:27:42.729 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T23:27:42.729 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T23:27:42.729 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T23:27:42.729 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-26T23:27:42.729 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T23:27:42.729 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-26T23:27:42.729 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-26T23:27:42.729 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-26T23:27:42.729 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-26T23:27:42.729 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T23:27:42.729 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-26T23:27:42.729 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T23:27:42.729 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T23:27:42.730 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T23:27:42.730 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T23:27:42.730 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T23:27:42.730 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-26T23:27:42.730 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T23:27:42.730 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T23:27:42.730 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-26T23:27:42.730 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T23:27:42.730 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T23:27:42.730 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-26T23:27:42.730 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-26T23:27:42.730 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T23:27:42.730 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-26T23:27:42.730 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T23:27:42.731 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T23:27:42.731 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-26T23:27:42.731 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T23:27:42.731 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-26T23:27:42.731 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T23:27:42.731 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-26T23:27:42.731 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T23:27:42.731 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-26T23:27:42.731 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T23:27:42.731 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T23:27:42.731 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-26T23:27:42.731 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T23:27:42.731 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-26T23:27:42.731 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-26T23:27:42.732 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T23:27:42.732 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-26T23:27:42.732 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T23:27:42.732 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T23:27:42.732 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T23:27:42.732 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T23:27:42.732 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-26T23:27:42.732 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T23:27:42.732 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T23:27:42.732 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-26T23:27:42.732 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T23:27:42.732 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T23:27:42.732 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-26T23:27:42.732 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-26T23:27:42.733 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T23:27:42.733 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T23:27:42.733 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T23:27:42.733 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T23:27:42.733 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-26T23:27:42.733 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T23:27:42.733 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T23:27:42.733 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T23:27:42.733 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-26T23:27:42.733 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T23:27:42.733 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T23:27:42.733 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T23:27:42.733 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-26T23:27:42.734 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T23:27:42.734 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T23:27:42.734 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T23:27:42.734 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-26T23:27:42.734 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T23:27:42.734 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-26T23:27:42.734 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T23:27:42.734 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-26T23:27:42.734 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T23:27:42.734 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T23:27:42.734 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T23:27:42.734 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T23:27:42.734 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-26T23:27:42.734 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T23:27:42.735 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-26T23:27:42.735 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T23:27:42.735 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T23:27:42.735 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-26T23:27:42.735 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-26T23:27:42.735 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-26T23:27:42.735 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-26T23:27:42.735 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-26T23:27:42.735 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-26T23:27:42.735 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T23:27:42.735 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T23:27:42.735 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-26T23:27:42.735 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T23:27:42.735 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-26T23:27:42.736 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T23:27:42.736 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T23:27:42.736 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-26T23:27:42.736 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T23:27:42.736 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-26T23:27:42.736 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T23:27:42.736 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T23:27:42.736 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T23:27:42.736 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T23:27:42.736 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T23:27:42.736 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T23:27:42.736 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T23:27:42.736 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T23:27:42.736 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T23:27:42.737 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T23:27:42.737 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-26T23:27:42.737 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T23:27:42.737 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T23:27:42.737 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T23:27:42.737 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T23:27:42.737 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-26T23:27:42.737 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-26T23:27:42.737 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T23:27:42.737 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-26T23:27:42.737 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-26T23:27:42.737 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T23:27:42.738 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-26T23:27:42.738 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T23:27:42.738 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T23:27:42.738 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T23:27:42.738 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T23:27:42.738 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T23:27:42.738 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T23:27:42.738 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-26T23:27:42.738 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T23:27:42.738 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-26T23:27:42.738 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-26T23:27:42.738 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-26T23:27:42.738 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T23:27:42.738 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T23:27:42.739 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T23:27:42.739 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T23:27:42.739 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T23:27:42.739 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T23:27:42.739 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T23:27:42.739 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T23:27:42.739 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T23:27:42.739 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T23:27:42.739 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T23:27:42.739 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T23:27:42.739 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T23:27:42.739 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T23:27:42.739 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T23:27:42.740 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-26T23:27:42.740 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T23:27:42.740 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T23:27:42.740 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T23:27:42.740 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-26T23:27:42.740 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-26T23:27:42.740 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T23:27:42.740 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-26T23:27:42.740 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-26T23:27:42.740 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T23:27:42.740 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T23:27:42.740 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T23:27:42.740 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-26T23:27:42.740 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-26T23:27:42.741 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-26T23:27:42.741 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T23:27:42.741 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-26T23:27:42.741 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-26T23:27:42.741 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T23:27:42.741 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-26T23:27:42.741 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-26T23:27:42.741 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T23:27:42.741 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-26T23:27:42.741 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-26T23:27:42.741 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-26T23:27:42.741 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-26T23:27:42.741 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T23:27:42.741 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-26T23:27:42.741 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T23:27:42.742 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-26T23:27:42.742 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-26T23:27:42.742 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T23:27:42.742 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T23:27:42.742 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T23:27:42.742 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-26T23:27:42.742 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-26T23:27:42.742 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-26T23:27:42.742 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T23:27:42.742 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-26T23:27:42.742 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T23:27:42.742 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-26T23:27:42.742 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-26T23:27:42.742 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-26T23:27:42.743 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-26T23:27:42.743 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-26T23:27:42.743 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-26T23:27:42.743 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-26T23:27:42.743 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-26T23:27:42.743 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-26T23:27:42.743 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-26T23:27:42.743 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T23:27:42.743 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T23:27:42.743 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T23:27:42.743 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T23:27:42.743 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-26T23:27:42.743 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-26T23:27:42.743 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-26T23:27:42.744 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-26T23:27:42.744 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-26T23:27:42.744 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-26T23:27:42.744 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-26T23:27:42.744 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-26T23:27:42.744 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-26T23:27:42.744 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-26T23:27:42.744 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-26T23:27:42.744 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-26T23:27:42.744 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-26T23:27:42.744 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-26T23:27:42.744 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-26T23:27:42.744 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-26T23:27:42.744 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-26T23:27:42.745 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-26T23:27:42.745 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-26T23:27:42.745 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-26T23:27:42.745 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-26T23:27:42.745 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-26T23:27:42.745 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-26T23:27:42.745 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-26T23:27:42.745 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-26T23:27:42.745 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-26T23:27:42.745 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-26T23:27:42.745 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-26T23:27:42.745 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-26T23:27:42.745 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-26T23:27:42.745 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-26T23:27:42.745 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-26T23:27:42.746 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-26T23:27:42.746 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-26T23:27:42.746 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-26T23:27:42.746 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-26T23:27:42.746 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-26T23:27:42.746 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-26T23:27:42.746 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-26T23:27:42.746 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-26T23:27:42.746 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-26T23:27:42.746 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-26T23:27:42.746 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-26T23:27:42.746 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-26T23:27:42.746 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-26T23:27:42.747 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-26T23:27:42.747 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-26T23:27:42.747 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-26T23:27:42.747 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-26T23:27:42.747 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-26T23:27:42.747 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-26T23:27:42.747 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-26T23:27:42.747 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-26T23:27:42.747 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-26T23:27:42.747 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-26T23:27:42.747 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-26T23:27:42.747 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-26T23:27:42.747 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-26T23:27:42.747 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-26T23:27:42.748 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-26T23:27:42.748 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-26T23:27:42.748 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-26T23:27:42.748 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-26T23:27:42.748 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T23:27:42.748 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-26T23:27:42.748 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-26T23:27:42.748 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-26T23:27:42.748 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-26T23:27:42.748 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T23:27:42.748 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T23:27:42.748 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-26T23:27:42.748 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T23:27:42.748 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T23:27:42.749 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-26T23:27:42.749 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-26T23:27:42.749 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-26T23:27:42.749 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T23:27:42.749 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T23:27:42.749 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T23:27:42.749 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T23:27:42.749 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T23:27:42.749 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T23:27:42.749 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T23:27:42.749 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T23:27:42.749 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-26T23:27:42.749 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-26T23:27:42.749 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T23:27:42.749 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T23:27:42.750 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T23:27:42.750 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T23:27:42.750 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T23:27:42.750 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-26T23:27:42.750 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T23:27:42.750 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T23:27:42.750 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-26T23:27:42.750 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-26T23:27:42.750 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-26T23:27:42.750 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-26T23:27:42.750 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-26T23:27:42.750 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T23:27:42.750 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-26T23:27:42.751 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-26T23:27:42.751 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-26T23:27:42.751 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-26T23:27:42.751 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T23:27:42.751 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T23:27:42.751 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T23:27:42.751 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T23:27:42.751 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T23:27:42.751 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T23:27:42.751 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T23:27:42.751 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T23:27:42.751 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T23:27:42.751 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-26T23:27:42.751 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T23:27:42.751 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T23:27:42.752 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T23:27:42.752 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T23:27:42.752 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T23:27:42.752 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T23:27:42.752 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T23:27:42.752 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T23:27:42.752 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T23:27:42.752 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T23:27:42.752 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T23:27:42.752 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T23:27:42.752 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T23:27:42.752 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-26T23:27:42.752 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T23:27:42.753 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T23:27:42.753 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-26T23:27:42.753 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T23:27:42.753 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T23:27:42.753 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T23:27:42.753 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T23:27:42.753 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T23:27:42.753 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T23:27:42.753 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T23:27:42.753 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T23:27:42.753 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T23:27:42.753 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T23:27:42.753 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T23:27:42.753 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T23:27:42.754 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T23:27:42.754 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T23:27:42.754 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T23:27:42.754 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T23:27:42.754 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T23:27:42.754 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T23:27:42.754 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-26T23:27:42.754 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T23:27:42.754 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T23:27:42.754 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-26T23:27:42.754 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T23:27:42.754 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-26T23:27:42.754 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T23:27:42.754 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T23:27:42.755 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T23:27:42.755 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T23:27:42.755 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T23:27:42.755 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T23:27:42.755 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T23:27:42.755 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T23:27:42.755 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T23:27:42.755 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T23:27:42.755 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T23:27:42.755 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T23:27:42.755 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T23:27:42.755 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T23:27:42.755 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T23:27:42.755 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-26T23:27:42.756 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T23:27:42.756 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T23:27:42.756 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T23:27:42.756 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-26T23:27:42.756 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-26T23:27:42.756 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T23:27:42.756 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T23:27:42.756 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T23:27:42.756 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T23:27:42.756 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-26T23:27:42.756 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T23:27:42.756 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T23:27:42.756 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T23:27:42.756 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T23:27:42.757 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-26T23:27:42.757 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-26T23:27:42.757 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-26T23:27:42.757 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-26T23:27:42.757 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-26T23:27:42.757 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-26T23:27:42.757 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-26T23:27:42.757 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T23:27:42.757 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-26T23:27:42.757 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-26T23:27:42.757 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-26T23:27:42.757 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-26T23:27:42.757 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-26T23:27:42.757 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-26T23:27:42.758 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T23:27:42.758 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-26T23:27:42.758 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-26T23:27:42.758 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-26T23:27:42.758 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-26T23:27:42.758 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-26T23:27:42.758 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-26T23:27:42.758 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T23:27:42.758 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-26T23:27:42.758 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-26T23:27:42.758 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-26T23:27:42.759 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T23:27:42.759 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T23:27:42.759 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-26T23:27:42.759 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-26T23:27:42.759 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-26T23:27:42.759 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T23:27:42.759 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T23:27:42.759 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T23:27:42.759 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T23:27:42.759 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T23:27:42.759 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T23:27:42.759 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T23:27:42.759 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T23:27:42.759 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T23:27:42.760 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T23:27:42.760 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T23:27:42.760 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T23:27:42.760 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-26T23:27:42.760 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-26T23:27:42.760 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-26T23:27:42.760 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T23:27:42.760 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T23:27:42.760 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-26T23:27:42.760 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-26T23:27:42.760 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-26T23:27:42.760 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-26T23:27:42.760 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-26T23:27:42.760 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-26T23:27:42.761 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T23:27:42.761 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T23:27:42.761 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T23:27:42.761 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T23:27:42.761 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T23:27:42.761 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T23:27:42.761 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T23:27:42.761 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T23:27:42.761 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T23:27:42.761 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T23:27:42.761 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-26T23:27:42.761 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T23:27:42.761 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-26T23:27:42.761 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-26T23:27:42.762 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T23:27:42.762 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-26T23:27:42.762 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-26T23:27:42.762 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T23:27:42.762 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T23:27:42.762 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-26T23:27:42.762 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-26T23:27:42.762 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-26T23:27:42.762 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T23:27:42.762 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-26T23:27:42.762 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T23:27:42.762 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-26T23:27:42.762 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T23:27:42.762 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T23:27:42.763 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-26T23:27:42.763 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T23:27:42.763 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T23:27:42.763 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T23:27:42.763 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T23:27:42.763 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-26T23:27:42.763 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T23:27:42.763 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-26T23:27:42.763 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-26T23:27:42.763 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T23:27:42.763 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-26T23:27:42.763 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T23:27:42.763 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T23:27:42.763 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T23:27:42.764 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-26T23:27:42.764 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T23:27:42.764 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T23:27:42.764 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-26T23:27:42.764 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-26T23:27:42.764 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T23:27:42.764 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-26T23:27:42.764 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-26T23:27:42.764 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T23:27:42.764 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-26T23:27:42.764 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-26T23:27:42.764 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-26T23:27:42.764 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T23:27:42.764 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-26T23:27:42.765 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-26T23:27:42.765 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-26T23:27:42.765 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-26T23:27:42.765 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-26T23:27:42.765 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T23:27:42.765 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-26T23:27:42.765 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-26T23:27:42.765 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T23:27:42.765 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-26T23:27:42.765 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T23:27:42.765 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-26T23:27:42.765 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T23:27:42.765 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-26T23:27:42.765 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T23:27:42.765 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-26T23:27:42.766 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T23:27:42.766 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-26T23:27:42.766 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-26T23:27:42.766 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-26T23:27:42.766 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T23:27:42.766 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-26T23:27:42.766 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T23:27:42.766 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-26T23:27:42.766 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-26T23:27:42.766 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-26T23:27:42.766 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T23:27:42.766 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-26T23:27:42.766 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T23:27:42.767 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-26T23:27:42.767 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-26T23:27:42.767 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-26T23:27:42.767 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T23:27:42.767 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-26T23:27:42.767 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T23:27:42.767 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-26T23:27:42.767 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T23:27:42.767 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-26T23:27:42.767 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T23:27:42.767 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-26T23:27:42.767 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-26T23:27:42.767 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-26T23:27:42.767 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T23:27:42.768 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-26T23:27:42.768 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T23:27:42.768 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-26T23:27:42.768 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T23:27:42.768 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-26T23:27:42.768 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T23:27:42.768 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-26T23:27:42.768 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T23:27:42.823 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-26T23:27:42.823 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-26T23:27:42.823 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T23:27:42.823 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-26T23:27:42.823 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T23:27:42.823 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-26T23:27:42.823 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T23:27:42.823 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T23:27:42.823 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-26T23:27:42.824 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T23:27:42.824 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T23:27:42.824 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-26T23:27:42.824 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T23:27:42.824 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T23:27:42.824 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-26T23:27:42.824 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T23:27:42.824 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-26T23:27:42.824 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T23:27:42.824 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-26T23:27:42.824 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T23:27:42.824 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T23:27:42.824 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T23:27:42.825 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T23:27:42.825 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T23:27:42.825 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T23:27:42.825 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T23:27:42.825 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T23:27:42.825 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T23:27:42.825 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T23:27:42.825 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T23:27:42.825 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-26T23:27:42.825 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T23:27:42.825 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T23:27:42.825 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T23:27:42.825 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T23:27:42.825 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T23:27:42.826 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T23:27:42.826 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T23:27:42.826 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T23:27:42.826 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T23:27:42.826 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T23:27:42.826 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T23:27:42.826 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T23:27:42.826 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T23:27:42.826 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T23:27:42.826 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T23:27:42.826 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T23:27:42.826 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T23:27:42.826 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T23:27:42.827 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T23:27:42.827 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T23:27:42.827 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T23:27:42.827 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T23:27:42.827 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T23:27:42.827 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T23:27:42.827 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T23:27:42.827 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T23:27:42.827 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T23:27:42.827 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T23:27:42.827 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T23:27:42.827 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T23:27:42.827 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T23:27:42.827 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T23:27:42.828 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T23:27:42.828 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T23:27:42.828 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T23:27:42.828 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T23:27:42.828 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T23:27:42.828 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T23:27:42.828 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T23:27:42.828 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-26T23:27:42.828 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-26T23:27:42.828 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T23:27:42.828 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-26T23:27:42.828 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T23:27:42.828 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-26T23:27:42.829 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T23:27:42.829 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T23:27:42.829 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T23:27:42.829 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T23:27:42.829 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T23:27:42.829 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-26T23:27:42.829 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-26T23:27:42.829 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-26T23:27:42.829 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T23:27:42.829 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-26T23:27:42.829 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T23:27:42.829 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-26T23:27:42.829 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-26T23:27:42.829 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-26T23:27:42.830 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-26T23:27:42.830 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-26T23:27:42.830 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-26T23:27:42.830 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-26T23:27:42.830 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-26T23:27:42.830 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-26T23:27:42.830 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T23:27:42.830 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-26T23:27:42.830 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T23:27:42.830 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-26T23:27:42.830 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-26T23:27:42.830 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T23:27:42.830 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-26T23:27:42.831 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T23:27:42.831 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T23:27:42.831 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-26T23:27:42.831 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T23:27:42.831 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-26T23:27:42.831 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T23:27:42.831 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-26T23:27:42.831 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T23:27:42.831 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-26T23:27:42.831 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T23:27:42.831 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-26T23:27:42.831 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T23:27:42.831 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-26T23:27:42.831 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-26T23:27:42.832 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-26T23:27:42.832 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-26T23:27:42.832 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-26T23:27:42.832 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T23:27:42.832 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-26T23:27:42.832 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T23:27:42.832 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-26T23:27:42.832 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T23:27:42.832 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-26T23:27:42.832 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T23:27:42.832 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T23:27:42.832 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-26T23:27:42.832 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T23:27:42.832 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T23:27:42.832 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-26T23:27:42.833 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T23:27:42.833 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T23:27:42.833 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-26T23:27:42.833 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T23:27:42.833 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-26T23:27:42.833 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-26T23:27:42.833 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-26T23:27:42.833 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-26T23:27:42.833 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-26T23:27:42.833 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T23:27:42.833 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-26T23:27:42.833 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-26T23:27:42.833 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T23:27:42.834 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-26T23:27:42.834 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-26T23:27:42.834 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-26T23:27:42.834 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-26T23:27:42.834 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-26T23:27:42.834 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T23:27:42.834 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T23:27:42.834 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T23:27:42.834 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-26T23:27:42.834 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-26T23:27:42.834 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-26T23:27:42.834 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T23:27:42.834 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-26T23:27:42.834 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-26T23:27:42.835 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T23:27:42.835 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T23:27:42.835 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T23:27:42.835 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T23:27:42.835 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T23:27:42.835 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T23:27:42.835 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T23:27:42.835 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T23:27:42.835 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-26T23:27:42.835 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T23:27:42.835 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T23:27:42.835 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T23:27:42.835 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T23:27:42.835 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T23:27:42.836 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-26T23:27:42.836 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T23:27:42.836 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-26T23:27:42.836 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T23:27:42.836 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T23:27:42.836 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T23:27:42.836 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T23:27:42.836 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-26T23:27:42.836 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T23:27:42.836 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-26T23:27:42.836 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T23:27:42.836 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T23:27:42.836 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-26T23:27:42.836 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T23:27:42.837 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T23:27:42.837 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T23:27:42.837 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T23:27:42.837 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T23:27:42.837 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T23:27:42.837 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T23:27:42.837 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T23:27:42.837 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T23:27:42.837 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T23:27:42.837 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T23:27:42.837 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T23:27:42.837 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T23:27:42.837 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T23:27:42.837 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T23:27:42.837 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T23:27:42.838 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T23:27:42.838 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T23:27:42.838 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T23:27:42.838 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T23:27:42.838 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T23:27:42.838 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T23:27:42.838 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T23:27:42.838 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-26T23:27:42.838 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T23:27:42.838 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-26T23:27:42.838 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T23:27:42.838 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-26T23:27:42.838 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T23:27:42.839 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T23:27:42.839 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T23:27:42.839 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T23:27:42.839 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-26T23:27:42.839 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T23:27:42.839 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T23:27:42.839 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T23:27:42.839 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T23:27:42.839 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T23:27:42.839 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-26T23:27:42.839 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-26T23:27:42.839 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-26T23:27:42.839 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-26T23:27:42.839 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T23:27:42.840 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T23:27:42.840 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T23:27:42.840 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-26T23:27:42.840 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T23:27:42.840 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T23:27:42.840 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T23:27:42.840 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T23:27:42.840 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T23:27:42.840 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T23:27:42.840 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T23:27:42.840 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T23:27:42.840 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T23:27:42.840 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T23:27:42.840 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-26T23:27:42.841 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T23:27:42.841 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T23:27:42.841 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T23:27:42.841 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-26T23:27:42.841 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T23:27:42.841 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-26T23:27:42.841 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T23:27:42.841 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T23:27:42.841 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T23:27:42.841 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-26T23:27:42.841 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T23:27:42.841 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T23:27:42.841 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T23:27:42.841 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T23:27:42.842 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T23:27:42.842 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T23:27:42.842 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T23:27:42.842 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T23:27:42.842 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T23:27:42.842 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-26T23:27:42.842 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T23:27:42.842 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T23:27:42.842 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T23:27:42.842 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T23:27:42.842 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T23:27:42.842 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T23:27:42.842 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T23:27:42.842 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T23:27:42.842 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T23:27:42.843 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T23:27:42.843 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T23:27:42.843 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T23:27:42.843 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T23:27:42.843 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T23:27:42.843 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T23:27:42.843 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T23:27:42.843 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T23:27:42.843 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T23:27:42.843 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T23:27:42.843 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T23:27:42.843 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T23:27:42.843 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T23:27:42.843 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-26T23:27:42.844 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T23:27:42.844 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T23:27:42.844 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T23:27:42.844 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-26T23:27:42.844 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T23:27:42.844 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T23:27:42.844 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T23:27:42.844 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T23:27:42.844 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-26T23:27:42.844 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-26T23:27:42.844 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T23:27:42.844 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-26T23:27:42.844 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T23:27:42.844 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T23:27:42.845 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T23:27:42.845 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T23:27:42.845 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T23:27:42.845 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T23:27:42.845 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T23:27:42.845 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T23:27:42.845 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T23:27:42.845 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T23:27:42.845 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T23:27:42.845 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T23:27:42.845 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T23:27:42.845 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T23:27:42.845 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T23:27:42.845 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T23:27:42.846 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T23:27:42.846 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T23:27:42.846 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T23:27:42.846 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T23:27:42.846 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T23:27:42.846 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T23:27:42.846 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T23:27:42.846 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T23:27:42.846 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T23:27:42.846 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T23:27:42.846 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-26T23:27:42.846 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T23:27:42.846 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-26T23:27:42.846 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T23:27:42.847 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T23:27:42.847 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T23:27:42.847 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T23:27:42.847 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T23:27:42.847 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T23:27:42.847 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T23:27:42.847 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-26T23:27:42.847 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-26T23:27:42.847 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-26T23:27:42.847 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T23:27:42.847 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-26T23:27:42.847 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-26T23:27:42.847 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T23:27:42.847 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-26T23:27:42.847 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T23:27:42.848 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-26T23:27:42.848 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-26T23:27:42.848 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T23:27:42.848 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T23:27:42.848 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T23:27:42.848 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T23:27:42.848 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T23:27:42.848 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T23:27:42.848 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T23:27:42.848 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T23:27:42.848 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T23:27:42.848 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T23:27:42.848 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T23:27:42.848 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T23:27:42.849 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T23:27:42.849 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T23:27:42.849 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T23:27:42.849 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T23:27:42.849 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-26T23:27:42.849 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T23:27:42.849 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T23:27:42.849 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T23:27:42.849 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T23:27:42.849 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T23:27:42.849 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T23:27:42.849 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T23:27:42.849 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T23:27:42.849 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T23:27:42.850 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T23:27:42.850 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T23:27:42.850 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T23:27:42.850 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T23:27:42.850 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T23:27:42.850 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T23:27:42.850 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T23:27:42.850 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T23:27:42.850 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T23:27:42.850 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T23:27:42.850 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T23:27:42.850 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T23:27:42.850 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T23:27:42.850 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T23:27:42.851 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T23:27:42.851 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T23:27:42.851 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T23:27:42.851 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T23:27:42.851 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T23:27:42.851 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T23:27:42.851 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T23:27:42.851 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T23:27:42.851 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T23:27:42.851 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T23:27:42.851 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T23:27:42.851 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T23:27:42.851 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T23:27:42.851 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T23:27:42.852 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T23:27:42.852 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T23:27:42.852 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T23:27:42.852 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T23:27:42.852 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T23:27:42.852 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-26T23:27:42.852 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T23:27:42.852 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T23:27:42.852 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T23:27:42.852 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T23:27:42.852 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T23:27:42.852 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T23:27:42.852 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T23:27:42.852 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T23:27:42.852 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T23:27:42.853 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T23:27:42.853 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T23:27:42.853 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T23:27:42.853 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T23:27:42.853 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T23:27:42.853 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T23:27:42.853 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-26T23:27:42.853 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T23:27:42.853 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T23:27:42.853 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T23:27:42.853 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T23:27:42.853 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T23:27:42.853 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-26T23:27:42.853 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-26T23:27:42.854 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-26T23:27:42.854 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T23:27:42.854 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T23:27:42.854 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T23:27:42.854 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T23:27:42.854 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T23:27:42.854 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T23:27:42.854 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T23:27:42.854 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T23:27:42.854 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T23:27:42.854 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T23:27:42.854 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T23:27:42.854 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T23:27:42.854 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T23:27:42.855 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T23:27:42.855 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T23:27:42.855 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T23:27:42.855 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T23:27:42.855 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T23:27:42.855 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T23:27:42.855 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T23:27:42.855 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T23:27:42.855 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T23:27:42.855 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T23:27:42.855 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T23:27:42.855 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T23:27:42.855 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T23:27:42.855 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T23:27:42.856 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T23:27:42.856 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T23:27:42.856 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T23:27:42.856 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T23:27:42.856 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T23:27:42.856 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T23:27:42.856 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T23:27:42.856 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T23:27:42.856 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T23:27:42.856 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T23:27:42.856 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T23:27:42.856 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T23:27:42.856 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T23:27:42.856 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T23:27:42.856 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T23:27:42.857 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T23:27:42.857 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T23:27:42.857 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T23:27:42.857 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T23:27:42.857 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T23:27:42.857 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T23:27:42.857 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T23:27:42.857 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T23:27:42.857 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T23:27:42.857 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T23:27:42.857 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T23:27:42.857 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T23:27:42.857 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T23:27:42.857 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T23:27:42.858 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T23:27:42.858 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T23:27:42.858 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T23:27:42.858 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T23:27:42.858 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T23:27:42.858 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T23:27:42.858 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T23:27:42.858 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T23:27:42.858 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T23:27:42.858 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T23:27:42.858 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T23:27:42.858 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T23:27:42.858 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T23:27:42.858 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-26T23:27:42.859 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T23:27:42.859 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T23:27:42.859 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-26T23:27:42.859 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T23:27:42.859 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-26T23:27:42.859 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T23:27:42.859 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-26T23:27:42.859 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T23:27:42.859 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T23:27:42.859 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T23:27:42.859 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T23:27:42.859 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-26T23:27:42.859 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T23:27:42.859 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-26T23:27:42.860 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-26T23:27:42.860 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-26T23:27:42.860 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-26T23:27:42.860 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T23:27:42.860 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T23:27:42.860 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T23:27:42.860 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-26T23:27:42.860 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-26T23:27:42.860 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-26T23:27:42.860 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T23:27:42.860 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T23:27:42.860 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T23:27:42.860 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T23:27:42.860 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T23:27:42.860 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T23:27:42.861 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T23:27:42.861 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T23:27:42.861 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T23:27:42.861 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T23:27:42.861 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T23:27:42.861 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-26T23:27:42.861 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T23:27:42.861 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T23:27:42.861 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T23:27:42.861 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T23:27:42.861 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T23:27:42.861 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T23:27:42.861 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T23:27:42.861 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T23:27:42.862 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T23:27:42.862 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T23:27:42.862 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T23:27:42.862 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T23:27:42.862 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T23:27:42.862 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T23:27:42.862 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-26T23:27:42.862 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T23:27:42.862 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T23:27:42.862 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T23:27:42.862 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T23:27:42.862 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T23:27:42.862 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T23:27:42.862 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T23:27:42.862 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T23:27:42.863 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T23:27:42.863 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T23:27:42.863 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T23:27:42.863 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T23:27:42.863 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T23:27:42.863 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T23:27:42.863 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T23:27:42.863 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T23:27:42.863 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T23:27:42.863 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T23:27:42.863 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-26T23:27:42.863 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T23:27:42.863 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T23:27:42.864 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-26T23:27:42.864 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-26T23:27:42.864 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T23:27:42.864 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T23:27:42.864 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T23:27:42.864 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-26T23:27:42.864 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T23:27:42.864 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-26T23:27:42.864 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T23:27:42.864 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T23:27:42.864 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-26T23:27:42.864 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T23:27:42.864 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-26T23:27:42.864 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T23:27:42.865 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T23:27:42.865 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T23:27:42.865 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T23:27:42.865 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T23:27:42.865 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-26T23:27:42.865 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-26T23:27:42.865 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-26T23:27:42.865 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-26T23:27:42.865 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T23:27:42.865 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-26T23:27:42.865 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T23:27:42.865 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T23:27:42.865 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T23:27:42.865 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T23:27:42.866 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T23:27:42.866 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T23:27:42.866 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T23:27:42.866 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T23:27:42.866 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T23:27:42.866 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T23:27:42.866 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T23:27:42.866 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T23:27:42.866 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T23:27:42.866 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-26T23:27:42.866 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-26T23:27:42.866 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-26T23:27:42.866 INFO:teuthology.orchestra.run.smithi137.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-26T23:27:42.866 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-26T23:27:42.867 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-26T23:27:42.872 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T23:27:42.872 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-26T23:27:42.872 DEBUG:teuthology.orchestra.run.smithi137:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-26T23:27:42.879 INFO:teuthology.orchestra.run.smithi137.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T23:27:42.879 INFO:teuthology.orchestra.run.smithi137.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T23:27:42.879 INFO:teuthology.orchestra.run.smithi137.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T23:27:42.879 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-26T23:27:42.879 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-26T23:27:42.880 DEBUG:teuthology.orchestra.run.smithi137:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-26T23:27:42.924 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi137.front.sepia.ceph.com to complete... 2024-04-26T23:27:43.014 INFO:teuthology.orchestra.run.smithi170.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T23:27:43.022 INFO:teuthology.orchestra.run.smithi170.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T23:27:43.082 INFO:teuthology.orchestra.run.smithi170.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T23:27:43.088 INFO:teuthology.orchestra.run.smithi170.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T23:27:43.230 INFO:teuthology.orchestra.run.smithi170.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T23:27:43.230 INFO:teuthology.orchestra.run.smithi170.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T23:27:43.231 INFO:teuthology.orchestra.run.smithi170.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T23:27:43.270 INFO:teuthology.orchestra.run.smithi170.stderr:done 2024-04-26T23:27:43.373 INFO:teuthology.orchestra.run.smithi137.stderr:Sourcing file `/etc/default/grub' 2024-04-26T23:27:43.374 INFO:teuthology.orchestra.run.smithi137.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T23:27:43.394 INFO:teuthology.orchestra.run.smithi137.stderr:Generating grub configuration file ... 2024-04-26T23:27:43.425 DEBUG:teuthology.orchestra.run.smithi170:> dpkg-deb -c /tmp/linux-image.deb 2024-04-26T23:27:43.432 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-26T23:27:43.432 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-26T23:27:43.432 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T23:27:43.450 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T23:27:43.450 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T23:27:43.470 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-26T23:27:43.471 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-26T23:27:43.471 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-26T23:27:43.471 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-26T23:27:43.471 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-26T23:27:43.471 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-26T23:27:43.471 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-26T23:27:43.471 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-26T23:27:43.471 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-26T23:27:43.471 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-26T23:27:43.471 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-26T23:27:43.471 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-26T23:27:43.471 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-26T23:27:43.472 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-26T23:27:43.474 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T23:27:43.474 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T23:27:43.475 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T23:27:43.475 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T23:27:43.475 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T23:27:43.475 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T23:27:43.475 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T23:27:43.475 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T23:27:43.475 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T23:27:43.475 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T23:27:43.475 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T23:27:43.475 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T23:27:43.475 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T23:27:43.475 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T23:27:43.475 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T23:27:43.476 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T23:27:43.476 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T23:27:43.476 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T23:27:43.476 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T23:27:43.476 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-26T23:27:43.476 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-26T23:27:43.476 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-26T23:27:43.476 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T23:27:43.476 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-26T23:27:43.476 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-26T23:27:43.476 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-26T23:27:43.476 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T23:27:43.476 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T23:27:43.477 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T23:27:43.541 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-26T23:27:43.541 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-26T23:27:43.541 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-26T23:27:43.541 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-26T23:27:43.541 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T23:27:43.541 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T23:27:43.541 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T23:27:43.541 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-26T23:27:43.541 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-26T23:27:43.541 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-26T23:27:43.541 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T23:27:43.541 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T23:27:43.542 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T23:27:43.542 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T23:27:43.542 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T23:27:43.542 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T23:27:43.542 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T23:27:43.542 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T23:27:43.542 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T23:27:43.542 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T23:27:43.542 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T23:27:43.542 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T23:27:43.542 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T23:27:43.542 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T23:27:43.542 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T23:27:43.542 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T23:27:43.543 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T23:27:43.543 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T23:27:43.543 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-26T23:27:43.543 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T23:27:43.543 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-26T23:27:43.543 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T23:27:43.543 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T23:27:43.543 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T23:27:43.543 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T23:27:43.543 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T23:27:43.543 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T23:27:43.543 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T23:27:43.543 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T23:27:43.543 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-26T23:27:43.544 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T23:27:43.544 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T23:27:43.544 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T23:27:43.544 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T23:27:43.544 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T23:27:43.544 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T23:27:43.544 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T23:27:43.544 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T23:27:43.544 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T23:27:43.544 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T23:27:43.544 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T23:27:43.544 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T23:27:43.544 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T23:27:43.544 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T23:27:43.545 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T23:27:43.545 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T23:27:43.545 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T23:27:43.545 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-26T23:27:43.545 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T23:27:43.545 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-26T23:27:43.545 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-26T23:27:43.545 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-26T23:27:43.545 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T23:27:43.545 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T23:27:43.545 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-26T23:27:43.545 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-26T23:27:43.545 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T23:27:43.545 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T23:27:43.546 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T23:27:43.546 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T23:27:43.546 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T23:27:43.546 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-26T23:27:43.546 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T23:27:43.546 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-26T23:27:43.546 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T23:27:43.546 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-26T23:27:43.546 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T23:27:43.546 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T23:27:43.546 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T23:27:43.546 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T23:27:43.546 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T23:27:43.546 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T23:27:43.547 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T23:27:43.547 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T23:27:43.547 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T23:27:43.547 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T23:27:43.547 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T23:27:43.547 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T23:27:43.547 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T23:27:43.547 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T23:27:43.547 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T23:27:43.547 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T23:27:43.547 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T23:27:43.547 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T23:27:43.547 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-26T23:27:43.547 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T23:27:43.548 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T23:27:43.548 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T23:27:43.548 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T23:27:43.548 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T23:27:43.548 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T23:27:43.548 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T23:27:43.548 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T23:27:43.548 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T23:27:43.548 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T23:27:43.548 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T23:27:43.548 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T23:27:43.548 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T23:27:43.548 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-26T23:27:43.548 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T23:27:43.548 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-26T23:27:43.549 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T23:27:43.549 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T23:27:43.549 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T23:27:43.549 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T23:27:43.549 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T23:27:43.549 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T23:27:43.549 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T23:27:43.549 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T23:27:43.549 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T23:27:43.549 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T23:27:43.549 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T23:27:43.549 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T23:27:43.549 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T23:27:43.549 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T23:27:43.550 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T23:27:43.550 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T23:27:43.550 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T23:27:43.550 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T23:27:43.550 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T23:27:43.550 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T23:27:43.550 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-26T23:27:43.550 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T23:27:43.550 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-26T23:27:43.550 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T23:27:43.550 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-26T23:27:43.550 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-26T23:27:43.550 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T23:27:43.551 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-26T23:27:43.551 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T23:27:43.551 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T23:27:43.551 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-26T23:27:43.551 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T23:27:43.551 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T23:27:43.551 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-26T23:27:43.551 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T23:27:43.551 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T23:27:43.551 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T23:27:43.551 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-26T23:27:43.551 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T23:27:43.551 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-26T23:27:43.551 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T23:27:43.551 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-26T23:27:43.552 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-26T23:27:43.552 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T23:27:43.552 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-26T23:27:43.552 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T23:27:43.552 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T23:27:43.552 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T23:27:43.552 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T23:27:43.552 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T23:27:43.552 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-26T23:27:43.552 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T23:27:43.552 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T23:27:43.552 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T23:27:43.552 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T23:27:43.553 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T23:27:43.553 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T23:27:43.553 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T23:27:43.553 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-26T23:27:43.553 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T23:27:43.553 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-26T23:27:43.553 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T23:27:43.553 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T23:27:43.553 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-26T23:27:43.553 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T23:27:43.553 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-26T23:27:43.553 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-26T23:27:43.553 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-26T23:27:43.553 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T23:27:43.553 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T23:27:43.554 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-26T23:27:43.554 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-26T23:27:43.554 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-26T23:27:43.554 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-26T23:27:43.554 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-26T23:27:43.554 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-26T23:27:43.554 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-26T23:27:43.554 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-26T23:27:43.554 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-26T23:27:43.554 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-26T23:27:43.554 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-26T23:27:43.554 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T23:27:43.554 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T23:27:43.554 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T23:27:43.554 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-26T23:27:43.555 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-26T23:27:43.555 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T23:27:43.555 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T23:27:43.555 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-26T23:27:43.555 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-26T23:27:43.555 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-26T23:27:43.555 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T23:27:43.555 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-26T23:27:43.555 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T23:27:43.555 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T23:27:43.555 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T23:27:43.555 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-26T23:27:43.555 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T23:27:43.555 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-26T23:27:43.556 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T23:27:43.556 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-26T23:27:43.556 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-26T23:27:43.556 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T23:27:43.556 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-26T23:27:43.556 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T23:27:43.556 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-26T23:27:43.556 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T23:27:43.556 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T23:27:43.556 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T23:27:43.556 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T23:27:43.556 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T23:27:43.556 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T23:27:43.556 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T23:27:43.557 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T23:27:43.557 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T23:27:43.557 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T23:27:43.557 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T23:27:43.557 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T23:27:43.557 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T23:27:43.557 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-26T23:27:43.557 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-26T23:27:43.557 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-26T23:27:43.557 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-26T23:27:43.557 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-26T23:27:43.557 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-26T23:27:43.557 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-26T23:27:43.557 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-26T23:27:43.558 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-26T23:27:43.558 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-26T23:27:43.558 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-26T23:27:43.558 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-26T23:27:43.558 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T23:27:43.558 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-26T23:27:43.558 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-26T23:27:43.558 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-26T23:27:43.558 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-26T23:27:43.558 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-26T23:27:43.558 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-26T23:27:43.558 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-26T23:27:43.558 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-26T23:27:43.558 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-26T23:27:43.559 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T23:27:43.559 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-26T23:27:43.559 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-26T23:27:43.559 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-26T23:27:43.559 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-26T23:27:43.559 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-26T23:27:43.559 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-26T23:27:43.559 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-26T23:27:43.559 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-26T23:27:43.559 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-26T23:27:43.559 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-26T23:27:43.559 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-26T23:27:43.559 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-26T23:27:43.559 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-26T23:27:43.559 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-26T23:27:43.560 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-26T23:27:43.560 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T23:27:43.560 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-26T23:27:43.560 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-26T23:27:43.560 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-26T23:27:43.560 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-26T23:27:43.560 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-26T23:27:43.560 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-26T23:27:43.560 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-26T23:27:43.560 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T23:27:43.560 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T23:27:43.560 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T23:27:43.560 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-26T23:27:43.560 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-26T23:27:43.560 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-26T23:27:43.560 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-26T23:27:43.561 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-26T23:27:43.561 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T23:27:43.561 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T23:27:43.561 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T23:27:43.561 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T23:27:43.561 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-26T23:27:43.561 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T23:27:43.561 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-26T23:27:43.561 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T23:27:43.561 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T23:27:43.561 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T23:27:43.561 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T23:27:43.561 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T23:27:43.561 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T23:27:43.561 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T23:27:43.561 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-26T23:27:43.562 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T23:27:43.562 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T23:27:43.562 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T23:27:43.562 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T23:27:43.562 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T23:27:43.562 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-26T23:27:43.562 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T23:27:43.562 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T23:27:43.562 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-26T23:27:43.562 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-26T23:27:43.562 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-26T23:27:43.562 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-26T23:27:43.562 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T23:27:43.562 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-26T23:27:43.563 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T23:27:43.563 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T23:27:43.563 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T23:27:43.563 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T23:27:43.563 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T23:27:43.563 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T23:27:43.563 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T23:27:43.563 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T23:27:43.563 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T23:27:43.563 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T23:27:43.563 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T23:27:43.563 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T23:27:43.563 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T23:27:43.563 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T23:27:43.563 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T23:27:43.563 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T23:27:43.563 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T23:27:43.564 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T23:27:43.564 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T23:27:43.564 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T23:27:43.564 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T23:27:43.564 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T23:27:43.564 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T23:27:43.564 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T23:27:43.564 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T23:27:43.564 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T23:27:43.564 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T23:27:43.564 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T23:27:43.564 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T23:27:43.564 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T23:27:43.564 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T23:27:43.564 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T23:27:43.565 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T23:27:43.565 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T23:27:43.565 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T23:27:43.565 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T23:27:43.565 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T23:27:43.565 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T23:27:43.565 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T23:27:43.565 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-26T23:27:43.565 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T23:27:43.565 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-26T23:27:43.565 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-26T23:27:43.565 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-26T23:27:43.565 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-26T23:27:43.565 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T23:27:43.566 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-26T23:27:43.566 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T23:27:43.566 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T23:27:43.566 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T23:27:43.566 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-26T23:27:43.566 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T23:27:43.566 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T23:27:43.566 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T23:27:43.566 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T23:27:43.566 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T23:27:43.566 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T23:27:43.566 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T23:27:43.566 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T23:27:43.567 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T23:27:43.567 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T23:27:43.567 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T23:27:43.567 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T23:27:43.567 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T23:27:43.567 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T23:27:43.567 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T23:27:43.567 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T23:27:43.567 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T23:27:43.567 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T23:27:43.567 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T23:27:43.567 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T23:27:43.567 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T23:27:43.568 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T23:27:43.568 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T23:27:43.568 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T23:27:43.568 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T23:27:43.568 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-26T23:27:43.568 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-26T23:27:43.568 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T23:27:43.568 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T23:27:43.568 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T23:27:43.568 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T23:27:43.568 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T23:27:43.568 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-26T23:27:43.568 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T23:27:43.568 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T23:27:43.569 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T23:27:43.569 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T23:27:43.569 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T23:27:43.569 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T23:27:43.569 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T23:27:43.569 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T23:27:43.569 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T23:27:43.569 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T23:27:43.569 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-26T23:27:43.569 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T23:27:43.569 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T23:27:43.569 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T23:27:43.569 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T23:27:43.569 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T23:27:43.569 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T23:27:43.570 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T23:27:43.570 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T23:27:43.570 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-26T23:27:43.570 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T23:27:43.570 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T23:27:43.570 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T23:27:43.570 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T23:27:43.570 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T23:27:43.570 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T23:27:43.570 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T23:27:43.570 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T23:27:43.570 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T23:27:43.570 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T23:27:43.570 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T23:27:43.571 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T23:27:43.571 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T23:27:43.571 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T23:27:43.571 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T23:27:43.571 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T23:27:43.571 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T23:27:43.571 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T23:27:43.571 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T23:27:43.571 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T23:27:43.571 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T23:27:43.571 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T23:27:43.571 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T23:27:43.571 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T23:27:43.572 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T23:27:43.572 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T23:27:43.572 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T23:27:43.572 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T23:27:43.572 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T23:27:43.572 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T23:27:43.572 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T23:27:43.572 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T23:27:43.572 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-26T23:27:43.572 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T23:27:43.572 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-26T23:27:43.572 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T23:27:43.572 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T23:27:43.572 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T23:27:43.572 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T23:27:43.573 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T23:27:43.573 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T23:27:43.573 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T23:27:43.573 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-26T23:27:43.573 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T23:27:43.573 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T23:27:43.573 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T23:27:43.573 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T23:27:43.573 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T23:27:43.573 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T23:27:43.573 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T23:27:43.573 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T23:27:43.573 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T23:27:43.573 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T23:27:43.574 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T23:27:43.574 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T23:27:43.574 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T23:27:43.574 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T23:27:43.574 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T23:27:43.574 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T23:27:43.574 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T23:27:43.574 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T23:27:43.574 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T23:27:43.574 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T23:27:43.574 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T23:27:43.574 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T23:27:43.574 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T23:27:43.574 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T23:27:43.575 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T23:27:43.575 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T23:27:43.575 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T23:27:43.575 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T23:27:43.575 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T23:27:43.575 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T23:27:43.575 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T23:27:43.575 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T23:27:43.575 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T23:27:43.575 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T23:27:43.575 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T23:27:43.575 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T23:27:43.575 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T23:27:43.575 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T23:27:43.576 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T23:27:43.576 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T23:27:43.576 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T23:27:43.576 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-26T23:27:43.576 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-26T23:27:43.576 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-26T23:27:43.576 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-26T23:27:43.576 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T23:27:43.576 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T23:27:43.576 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-26T23:27:43.576 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-26T23:27:43.576 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-26T23:27:43.576 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-26T23:27:43.576 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T23:27:43.576 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T23:27:43.577 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T23:27:43.577 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-26T23:27:43.577 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T23:27:43.577 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-26T23:27:43.577 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T23:27:43.577 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T23:27:43.577 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T23:27:43.577 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T23:27:43.577 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-26T23:27:43.577 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-26T23:27:43.577 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T23:27:43.577 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T23:27:43.577 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T23:27:43.577 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-26T23:27:43.578 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T23:27:43.578 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T23:27:43.578 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-26T23:27:43.578 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T23:27:43.578 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T23:27:43.578 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T23:27:43.578 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-26T23:27:43.578 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T23:27:43.578 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T23:27:43.578 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-26T23:27:43.578 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-26T23:27:43.578 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T23:27:43.578 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-26T23:27:43.578 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T23:27:43.579 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T23:27:43.579 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T23:27:43.579 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T23:27:43.579 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-26T23:27:43.579 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T23:27:43.579 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T23:27:43.579 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T23:27:43.579 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-26T23:27:43.579 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-26T23:27:43.579 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-26T23:27:43.579 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-26T23:27:43.579 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-26T23:27:43.579 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-26T23:27:43.579 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T23:27:43.580 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T23:27:43.580 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T23:27:43.580 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T23:27:43.580 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T23:27:43.580 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T23:27:43.580 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T23:27:43.580 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-26T23:27:43.580 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-26T23:27:43.580 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T23:27:43.580 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-26T23:27:43.580 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T23:27:43.580 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-26T23:27:43.580 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T23:27:43.580 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-26T23:27:43.581 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T23:27:43.581 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-26T23:27:43.581 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-26T23:27:43.581 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-26T23:27:43.581 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-26T23:27:43.581 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-26T23:27:43.581 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-26T23:27:43.581 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T23:27:43.581 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-26T23:27:43.581 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T23:27:43.581 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-26T23:27:43.581 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T23:27:43.581 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-26T23:27:43.581 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T23:27:43.581 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-26T23:27:43.582 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T23:27:43.582 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-26T23:27:43.582 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-26T23:27:43.582 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-26T23:27:43.582 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-26T23:27:43.582 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T23:27:43.582 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T23:27:43.582 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T23:27:43.582 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T23:27:43.582 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-26T23:27:43.582 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-26T23:27:43.582 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-26T23:27:43.582 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-26T23:27:43.582 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-26T23:27:43.583 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T23:27:43.583 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-26T23:27:43.583 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-26T23:27:43.583 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-26T23:27:43.583 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-26T23:27:43.583 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-26T23:27:43.583 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-26T23:27:43.583 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-26T23:27:43.583 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-26T23:27:43.583 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-26T23:27:43.583 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-26T23:27:43.583 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-26T23:27:43.583 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-26T23:27:43.583 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-26T23:27:43.584 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-26T23:27:43.584 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-26T23:27:43.584 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-26T23:27:43.584 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-26T23:27:43.584 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-26T23:27:43.584 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-26T23:27:43.584 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-26T23:27:43.584 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-26T23:27:43.584 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T23:27:43.584 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T23:27:43.584 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T23:27:43.584 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T23:27:43.584 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-26T23:27:43.584 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-26T23:27:43.584 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T23:27:43.585 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T23:27:43.585 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T23:27:43.585 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T23:27:43.585 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-26T23:27:43.585 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T23:27:43.585 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-26T23:27:43.585 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T23:27:43.585 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T23:27:43.585 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-26T23:27:43.585 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T23:27:43.585 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-26T23:27:43.585 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-26T23:27:43.585 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-26T23:27:43.585 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T23:27:43.586 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-26T23:27:43.586 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T23:27:43.586 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-26T23:27:43.586 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-26T23:27:43.586 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-26T23:27:43.586 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-26T23:27:43.586 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T23:27:43.586 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-26T23:27:43.586 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-26T23:27:43.586 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-26T23:27:43.586 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T23:27:43.586 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-26T23:27:43.586 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-26T23:27:43.586 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-26T23:27:43.587 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T23:27:43.587 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-26T23:27:43.587 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-26T23:27:43.587 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-26T23:27:43.587 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-26T23:27:43.587 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-26T23:27:43.587 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-26T23:27:43.587 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-26T23:27:43.587 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T23:27:43.587 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-26T23:27:43.587 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-26T23:27:43.587 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-26T23:27:43.587 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-26T23:27:43.587 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T23:27:43.588 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T23:27:43.588 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T23:27:43.588 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T23:27:43.588 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T23:27:43.588 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T23:27:43.588 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T23:27:43.588 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T23:27:43.588 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T23:27:43.588 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-26T23:27:43.588 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-26T23:27:43.588 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T23:27:43.588 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T23:27:43.588 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-26T23:27:43.589 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T23:27:43.589 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T23:27:43.589 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T23:27:43.589 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T23:27:43.589 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-26T23:27:43.589 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T23:27:43.589 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T23:27:43.589 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-26T23:27:43.589 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-26T23:27:43.589 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T23:27:43.589 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T23:27:43.589 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T23:27:43.589 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-26T23:27:43.589 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T23:27:43.589 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T23:27:43.590 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-26T23:27:43.590 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T23:27:43.590 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T23:27:43.590 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T23:27:43.590 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-26T23:27:43.590 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-26T23:27:43.590 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T23:27:43.645 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T23:27:43.645 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T23:27:43.645 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T23:27:43.645 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T23:27:43.645 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-26T23:27:43.645 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-26T23:27:43.645 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T23:27:43.645 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T23:27:43.646 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T23:27:43.646 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T23:27:43.646 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T23:27:43.646 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T23:27:43.646 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T23:27:43.646 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-26T23:27:43.646 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-26T23:27:43.646 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-26T23:27:43.646 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-26T23:27:43.646 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-26T23:27:43.646 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-26T23:27:43.646 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-26T23:27:43.646 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-26T23:27:43.646 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-26T23:27:43.647 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-26T23:27:43.647 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-26T23:27:43.647 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-26T23:27:43.647 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-26T23:27:43.647 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-26T23:27:43.647 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T23:27:43.647 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T23:27:43.647 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-26T23:27:43.647 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-26T23:27:43.647 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-26T23:27:43.647 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-26T23:27:43.647 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-26T23:27:43.647 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-26T23:27:43.647 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-26T23:27:43.647 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-26T23:27:43.648 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-26T23:27:43.648 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-26T23:27:43.648 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T23:27:43.648 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-26T23:27:43.648 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-26T23:27:43.648 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T23:27:43.648 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T23:27:43.648 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T23:27:43.648 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-26T23:27:43.648 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-26T23:27:43.648 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-26T23:27:43.648 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-26T23:27:43.648 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-26T23:27:43.649 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T23:27:43.649 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T23:27:43.649 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T23:27:43.649 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T23:27:43.649 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-26T23:27:43.649 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-26T23:27:43.649 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-26T23:27:43.649 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-26T23:27:43.649 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T23:27:43.649 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-26T23:27:43.649 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-26T23:27:43.649 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-26T23:27:43.649 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-26T23:27:43.649 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-26T23:27:43.650 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T23:27:43.650 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T23:27:43.650 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T23:27:43.650 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T23:27:43.650 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-26T23:27:43.650 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-26T23:27:43.650 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-26T23:27:43.650 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T23:27:43.650 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-26T23:27:43.650 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-26T23:27:43.650 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-26T23:27:43.650 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T23:27:43.650 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T23:27:43.650 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-26T23:27:43.651 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T23:27:43.651 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T23:27:43.651 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-26T23:27:43.651 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T23:27:43.651 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T23:27:43.651 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T23:27:43.651 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-26T23:27:43.651 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-26T23:27:43.651 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-26T23:27:43.651 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T23:27:43.651 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T23:27:43.651 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T23:27:43.651 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T23:27:43.652 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-26T23:27:43.652 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T23:27:43.652 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-26T23:27:43.652 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-26T23:27:43.652 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T23:27:43.652 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-26T23:27:43.652 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-26T23:27:43.652 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T23:27:43.652 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T23:27:43.652 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T23:27:43.652 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-26T23:27:43.652 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T23:27:43.653 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T23:27:43.653 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T23:27:43.653 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-26T23:27:43.653 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-26T23:27:43.653 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T23:27:43.653 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T23:27:43.653 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T23:27:43.653 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T23:27:43.653 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-26T23:27:43.653 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T23:27:43.653 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T23:27:43.653 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T23:27:43.654 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T23:27:43.654 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-26T23:27:43.654 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T23:27:43.654 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-26T23:27:43.654 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T23:27:43.654 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-26T23:27:43.654 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T23:27:43.654 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-26T23:27:43.655 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T23:27:43.655 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-26T23:27:43.655 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T23:27:43.655 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T23:27:43.655 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T23:27:43.655 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-26T23:27:43.655 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-26T23:27:43.655 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T23:27:43.655 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-26T23:27:43.655 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T23:27:43.655 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-26T23:27:43.656 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T23:27:43.656 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-26T23:27:43.656 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T23:27:43.656 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T23:27:43.656 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-26T23:27:43.656 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T23:27:43.656 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T23:27:43.656 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-26T23:27:43.656 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T23:27:43.657 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T23:27:43.657 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-26T23:27:43.657 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T23:27:43.657 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T23:27:43.657 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-26T23:27:43.657 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-26T23:27:43.657 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T23:27:43.657 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-26T23:27:43.657 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-26T23:27:43.657 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T23:27:43.657 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-26T23:27:43.658 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T23:27:43.658 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-26T23:27:43.658 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T23:27:43.658 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-26T23:27:43.658 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T23:27:43.658 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-26T23:27:43.658 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T23:27:43.658 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-26T23:27:43.658 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-26T23:27:43.658 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T23:27:43.658 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-26T23:27:43.658 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-26T23:27:43.659 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T23:27:43.659 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T23:27:43.659 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T23:27:43.659 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T23:27:43.659 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T23:27:43.659 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T23:27:43.659 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-26T23:27:43.659 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T23:27:43.659 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T23:27:43.659 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T23:27:43.659 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-26T23:27:43.659 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-26T23:27:43.659 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-26T23:27:43.659 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T23:27:43.659 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T23:27:43.660 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T23:27:43.660 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-26T23:27:43.660 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-26T23:27:43.660 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-26T23:27:43.660 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T23:27:43.660 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-26T23:27:43.660 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T23:27:43.660 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-26T23:27:43.660 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T23:27:43.660 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-26T23:27:43.660 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T23:27:43.660 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-26T23:27:43.660 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T23:27:43.660 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-26T23:27:43.660 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T23:27:43.661 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-26T23:27:43.661 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T23:27:43.661 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-26T23:27:43.661 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T23:27:43.661 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-26T23:27:43.661 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T23:27:43.661 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-26T23:27:43.661 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T23:27:43.661 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T23:27:43.661 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-26T23:27:43.661 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T23:27:43.661 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T23:27:43.662 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T23:27:43.662 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-26T23:27:43.662 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-26T23:27:43.662 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T23:27:43.662 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T23:27:43.662 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-26T23:27:43.662 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-26T23:27:43.662 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T23:27:43.662 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-26T23:27:43.662 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-26T23:27:43.662 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-26T23:27:43.662 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-26T23:27:43.662 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T23:27:43.662 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-26T23:27:43.663 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-26T23:27:43.663 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T23:27:43.663 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-26T23:27:43.663 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T23:27:43.663 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T23:27:43.663 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-26T23:27:43.663 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T23:27:43.663 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-26T23:27:43.663 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T23:27:43.663 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-26T23:27:43.663 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T23:27:43.663 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T23:27:43.663 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-26T23:27:43.663 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-26T23:27:43.663 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T23:27:43.664 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T23:27:43.664 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-26T23:27:43.664 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T23:27:43.664 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-26T23:27:43.664 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T23:27:43.664 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-26T23:27:43.664 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T23:27:43.664 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T23:27:43.664 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T23:27:43.664 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T23:27:43.664 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-26T23:27:43.664 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-26T23:27:43.664 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-26T23:27:43.664 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-26T23:27:43.664 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T23:27:43.665 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-26T23:27:43.665 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T23:27:43.665 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-26T23:27:43.665 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T23:27:43.665 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T23:27:43.665 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-26T23:27:43.665 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T23:27:43.665 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T23:27:43.665 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T23:27:43.665 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T23:27:43.665 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-26T23:27:43.665 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-26T23:27:43.665 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-26T23:27:43.666 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T23:27:43.666 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-26T23:27:43.666 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T23:27:43.666 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-26T23:27:43.666 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T23:27:43.666 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T23:27:43.666 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T23:27:43.666 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T23:27:43.666 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-26T23:27:43.666 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T23:27:43.666 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-26T23:27:43.666 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T23:27:43.666 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-26T23:27:43.666 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T23:27:43.667 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T23:27:43.667 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-26T23:27:43.667 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T23:27:43.667 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T23:27:43.667 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-26T23:27:43.667 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T23:27:43.667 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-26T23:27:43.667 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-26T23:27:43.667 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-26T23:27:43.667 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-26T23:27:43.667 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T23:27:43.667 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-26T23:27:43.667 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T23:27:43.667 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-26T23:27:43.667 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T23:27:43.668 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T23:27:43.668 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-26T23:27:43.668 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T23:27:43.668 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T23:27:43.668 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T23:27:43.668 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-26T23:27:43.668 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T23:27:43.668 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T23:27:43.668 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-26T23:27:43.668 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T23:27:43.668 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T23:27:43.668 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T23:27:43.668 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T23:27:43.668 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T23:27:43.668 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-26T23:27:43.669 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T23:27:43.669 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T23:27:43.669 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-26T23:27:43.669 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T23:27:43.669 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T23:27:43.669 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T23:27:43.669 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T23:27:43.669 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T23:27:43.669 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T23:27:43.669 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T23:27:43.669 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T23:27:43.669 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T23:27:43.669 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T23:27:43.669 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T23:27:43.669 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T23:27:43.670 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T23:27:43.670 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T23:27:43.670 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T23:27:43.670 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T23:27:43.670 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T23:27:43.670 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T23:27:43.670 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T23:27:43.670 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-26T23:27:43.670 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-26T23:27:43.670 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-26T23:27:43.670 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T23:27:43.670 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T23:27:43.670 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T23:27:43.670 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T23:27:43.671 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T23:27:43.671 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T23:27:43.671 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T23:27:43.671 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T23:27:43.671 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-26T23:27:43.671 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-26T23:27:43.671 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T23:27:43.671 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T23:27:43.671 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T23:27:43.671 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-26T23:27:43.671 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T23:27:43.671 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T23:27:43.671 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T23:27:43.671 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T23:27:43.672 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T23:27:43.672 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T23:27:43.672 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T23:27:43.672 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-26T23:27:43.672 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T23:27:43.672 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-26T23:27:43.672 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T23:27:43.672 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-26T23:27:43.672 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T23:27:43.672 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-26T23:27:43.672 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T23:27:43.672 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-26T23:27:43.672 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-26T23:27:43.672 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T23:27:43.672 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T23:27:43.673 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-26T23:27:43.673 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T23:27:43.673 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T23:27:43.673 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T23:27:43.673 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T23:27:43.673 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-26T23:27:43.673 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-26T23:27:43.673 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T23:27:43.673 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-26T23:27:43.673 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-26T23:27:43.673 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-26T23:27:43.673 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T23:27:43.673 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-26T23:27:43.673 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T23:27:43.673 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-26T23:27:43.674 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-26T23:27:43.674 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-26T23:27:43.674 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T23:27:43.674 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T23:27:43.674 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-26T23:27:43.674 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-26T23:27:43.674 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-26T23:27:43.674 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-26T23:27:43.674 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-26T23:27:43.674 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-26T23:27:43.674 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-26T23:27:43.674 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T23:27:43.674 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-26T23:27:43.674 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-26T23:27:43.675 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-26T23:27:43.675 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-26T23:27:43.675 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-26T23:27:43.675 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-26T23:27:43.675 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-26T23:27:43.675 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-26T23:27:43.675 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-26T23:27:43.675 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-26T23:27:43.675 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T23:27:43.675 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T23:27:43.675 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T23:27:43.675 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T23:27:43.675 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T23:27:43.675 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T23:27:43.676 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T23:27:43.676 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T23:27:43.676 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T23:27:43.676 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T23:27:43.676 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T23:27:43.676 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T23:27:43.676 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-26T23:27:43.676 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-26T23:27:43.676 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T23:27:43.676 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-26T23:27:43.676 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T23:27:43.676 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T23:27:43.676 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T23:27:43.676 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T23:27:43.676 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T23:27:43.677 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T23:27:43.677 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T23:27:43.677 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T23:27:43.677 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T23:27:43.677 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T23:27:43.677 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T23:27:43.677 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-26T23:27:43.677 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-26T23:27:43.677 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-26T23:27:43.677 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-26T23:27:43.677 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-26T23:27:43.677 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-26T23:27:43.677 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-26T23:27:43.677 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-26T23:27:43.677 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-26T23:27:43.678 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-26T23:27:43.678 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-26T23:27:43.678 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-26T23:27:43.678 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-26T23:27:43.678 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-26T23:27:43.678 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-26T23:27:43.678 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-26T23:27:43.678 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-26T23:27:43.678 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-26T23:27:43.678 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-26T23:27:43.678 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-26T23:27:43.678 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-26T23:27:43.678 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-26T23:27:43.678 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-26T23:27:43.679 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-26T23:27:43.679 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-26T23:27:43.679 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-26T23:27:43.679 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-26T23:27:43.679 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-26T23:27:43.679 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-26T23:27:43.679 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T23:27:43.679 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T23:27:43.679 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-26T23:27:43.679 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-26T23:27:43.679 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T23:27:43.679 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T23:27:43.679 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T23:27:43.679 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T23:27:43.679 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-26T23:27:43.680 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T23:27:43.680 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T23:27:43.680 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-26T23:27:43.680 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-26T23:27:43.680 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-26T23:27:43.680 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T23:27:43.680 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T23:27:43.680 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-26T23:27:43.680 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-26T23:27:43.680 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-26T23:27:43.680 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T23:27:43.680 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-26T23:27:43.680 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-26T23:27:43.680 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-26T23:27:43.681 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T23:27:43.681 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T23:27:43.681 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T23:27:43.681 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T23:27:43.681 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T23:27:43.681 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T23:27:43.681 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T23:27:43.681 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T23:27:43.681 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T23:27:43.681 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T23:27:43.681 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T23:27:43.681 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T23:27:43.681 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T23:27:43.681 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-26T23:27:43.681 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T23:27:43.682 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T23:27:43.682 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T23:27:43.682 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-26T23:27:43.682 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T23:27:43.682 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-26T23:27:43.682 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-26T23:27:43.682 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-26T23:27:43.682 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-26T23:27:43.682 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-26T23:27:43.682 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T23:27:43.682 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-26T23:27:43.682 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T23:27:43.682 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-26T23:27:43.682 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T23:27:43.683 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T23:27:43.683 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T23:27:43.683 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T23:27:43.683 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-26T23:27:43.683 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T23:27:43.683 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T23:27:43.683 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T23:27:43.683 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T23:27:43.683 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T23:27:43.683 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-26T23:27:43.683 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T23:27:43.683 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-26T23:27:43.683 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-26T23:27:43.683 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-26T23:27:43.684 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-26T23:27:43.684 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T23:27:43.684 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-26T23:27:43.684 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T23:27:43.684 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T23:27:43.684 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T23:27:43.684 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T23:27:43.684 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T23:27:43.684 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-26T23:27:43.684 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T23:27:43.684 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T23:27:43.684 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-26T23:27:43.684 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T23:27:43.684 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T23:27:43.684 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-26T23:27:43.685 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-26T23:27:43.685 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T23:27:43.685 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-26T23:27:43.685 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T23:27:43.685 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T23:27:43.685 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-26T23:27:43.685 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T23:27:43.685 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-26T23:27:43.685 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T23:27:43.685 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-26T23:27:43.685 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T23:27:43.685 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-26T23:27:43.685 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T23:27:43.685 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T23:27:43.686 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-26T23:27:43.686 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T23:27:43.686 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-26T23:27:43.686 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-26T23:27:43.686 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T23:27:43.686 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-26T23:27:43.686 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T23:27:43.686 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T23:27:43.686 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T23:27:43.686 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T23:27:43.686 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-26T23:27:43.686 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T23:27:43.686 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T23:27:43.686 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-26T23:27:43.687 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T23:27:43.687 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T23:27:43.687 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-26T23:27:43.687 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-26T23:27:43.687 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T23:27:43.687 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T23:27:43.687 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T23:27:43.687 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T23:27:43.687 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-26T23:27:43.687 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T23:27:43.687 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T23:27:43.687 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T23:27:43.687 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-26T23:27:43.687 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T23:27:43.687 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T23:27:43.688 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T23:27:43.688 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-26T23:27:43.688 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T23:27:43.688 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T23:27:43.688 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T23:27:43.688 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-26T23:27:43.688 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T23:27:43.688 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-26T23:27:43.688 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T23:27:43.688 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-26T23:27:43.688 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T23:27:43.688 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T23:27:43.688 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T23:27:43.688 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T23:27:43.689 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-26T23:27:43.689 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T23:27:43.689 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-26T23:27:43.689 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T23:27:43.689 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T23:27:43.689 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-26T23:27:43.689 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-26T23:27:43.689 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-26T23:27:43.689 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-26T23:27:43.689 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-26T23:27:43.689 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-26T23:27:43.689 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T23:27:43.689 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T23:27:43.689 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-26T23:27:43.689 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T23:27:43.690 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-26T23:27:43.690 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T23:27:43.690 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T23:27:43.690 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-26T23:27:43.690 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T23:27:43.690 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-26T23:27:43.690 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T23:27:43.690 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T23:27:43.690 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T23:27:43.690 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T23:27:43.690 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T23:27:43.690 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T23:27:43.690 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T23:27:43.690 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T23:27:43.691 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T23:27:43.691 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T23:27:43.691 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-26T23:27:43.691 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T23:27:43.691 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T23:27:43.691 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T23:27:43.691 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T23:27:43.691 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-26T23:27:43.691 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-26T23:27:43.691 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T23:27:43.691 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-26T23:27:43.691 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-26T23:27:43.691 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T23:27:43.691 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-26T23:27:43.692 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T23:27:43.692 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T23:27:43.692 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T23:27:43.692 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T23:27:43.693 INFO:teuthology.orchestra.run.smithi137.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T23:27:43.693 INFO:teuthology.orchestra.run.smithi137.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T23:27:43.738 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T23:27:43.738 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T23:27:43.739 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-26T23:27:43.739 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T23:27:43.739 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-26T23:27:43.739 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-26T23:27:43.739 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-26T23:27:43.739 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T23:27:43.739 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T23:27:43.739 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T23:27:43.739 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T23:27:43.739 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T23:27:43.739 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T23:27:43.739 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T23:27:43.739 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T23:27:43.739 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T23:27:43.740 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T23:27:43.740 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T23:27:43.740 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T23:27:43.740 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T23:27:43.740 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T23:27:43.740 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T23:27:43.740 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-26T23:27:43.740 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T23:27:43.740 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T23:27:43.740 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T23:27:43.740 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-26T23:27:43.740 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-26T23:27:43.740 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T23:27:43.740 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-26T23:27:43.741 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-26T23:27:43.741 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T23:27:43.741 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T23:27:43.741 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T23:27:43.741 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-26T23:27:43.741 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-26T23:27:43.741 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-26T23:27:43.741 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T23:27:43.741 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-26T23:27:43.741 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-26T23:27:43.741 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T23:27:43.741 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-26T23:27:43.741 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-26T23:27:43.741 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T23:27:43.742 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-26T23:27:43.742 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-26T23:27:43.742 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-26T23:27:43.742 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-26T23:27:43.742 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T23:27:43.742 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-26T23:27:43.742 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T23:27:43.742 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-26T23:27:43.742 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-26T23:27:43.742 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T23:27:43.742 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T23:27:43.742 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T23:27:43.742 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-26T23:27:43.742 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-26T23:27:43.742 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-26T23:27:43.743 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T23:27:43.743 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-26T23:27:43.743 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T23:27:43.743 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-26T23:27:43.743 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-26T23:27:43.743 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-26T23:27:43.743 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-26T23:27:43.743 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-26T23:27:43.743 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-26T23:27:43.743 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-26T23:27:43.743 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-26T23:27:43.743 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-26T23:27:43.743 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-26T23:27:43.744 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T23:27:43.744 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T23:27:43.744 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T23:27:43.744 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T23:27:43.744 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-26T23:27:43.744 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-26T23:27:43.744 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-26T23:27:43.744 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-26T23:27:43.744 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-26T23:27:43.744 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-26T23:27:43.744 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-26T23:27:43.744 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-26T23:27:43.744 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-26T23:27:43.744 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-26T23:27:43.745 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-26T23:27:43.745 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-26T23:27:43.745 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-26T23:27:43.745 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-26T23:27:43.745 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-26T23:27:43.745 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-26T23:27:43.745 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-26T23:27:43.745 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-26T23:27:43.745 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-26T23:27:43.745 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-26T23:27:43.745 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-26T23:27:43.745 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-26T23:27:43.745 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-26T23:27:43.745 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-26T23:27:43.746 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-26T23:27:43.746 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-26T23:27:43.746 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-26T23:27:43.746 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-26T23:27:43.746 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-26T23:27:43.746 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-26T23:27:43.746 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-26T23:27:43.746 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-26T23:27:43.746 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-26T23:27:43.746 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-26T23:27:43.746 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-26T23:27:43.746 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-26T23:27:43.746 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-26T23:27:43.746 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-26T23:27:43.746 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-26T23:27:43.747 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-26T23:27:43.747 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-26T23:27:43.747 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-26T23:27:43.747 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-26T23:27:43.747 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-26T23:27:43.747 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-26T23:27:43.747 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-26T23:27:43.747 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-26T23:27:43.747 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-26T23:27:43.747 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-26T23:27:43.747 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-26T23:27:43.747 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-26T23:27:43.747 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-26T23:27:43.747 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-26T23:27:43.748 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-26T23:27:43.748 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-26T23:27:43.748 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-26T23:27:43.748 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-26T23:27:43.748 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-26T23:27:43.748 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-26T23:27:43.748 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-26T23:27:43.748 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-26T23:27:43.748 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-26T23:27:43.748 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-26T23:27:43.748 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T23:27:43.748 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-26T23:27:43.748 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-26T23:27:43.748 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-26T23:27:43.749 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-26T23:27:43.749 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T23:27:43.749 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T23:27:43.749 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-26T23:27:43.749 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T23:27:43.749 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T23:27:43.749 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-26T23:27:43.749 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-26T23:27:43.749 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-26T23:27:43.749 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T23:27:43.749 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T23:27:43.749 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T23:27:43.749 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T23:27:43.749 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T23:27:43.750 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T23:27:43.750 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T23:27:43.750 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T23:27:43.750 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-26T23:27:43.750 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-26T23:27:43.750 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T23:27:43.750 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T23:27:43.750 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T23:27:43.750 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T23:27:43.750 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T23:27:43.750 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-26T23:27:43.750 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T23:27:43.750 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T23:27:43.750 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-26T23:27:43.750 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-26T23:27:43.751 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-26T23:27:43.751 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-26T23:27:43.751 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-26T23:27:43.751 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T23:27:43.751 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-26T23:27:43.751 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-26T23:27:43.751 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-26T23:27:43.751 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-26T23:27:43.751 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T23:27:43.751 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T23:27:43.751 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T23:27:43.751 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T23:27:43.751 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T23:27:43.751 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T23:27:43.752 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T23:27:43.752 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T23:27:43.752 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T23:27:43.752 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-26T23:27:43.752 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T23:27:43.752 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T23:27:43.752 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T23:27:43.752 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T23:27:43.752 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T23:27:43.752 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T23:27:43.752 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T23:27:43.752 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T23:27:43.752 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T23:27:43.752 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T23:27:43.752 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T23:27:43.753 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T23:27:43.753 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T23:27:43.753 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-26T23:27:43.753 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T23:27:43.753 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T23:27:43.753 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-26T23:27:43.753 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T23:27:43.753 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T23:27:43.753 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T23:27:43.753 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T23:27:43.753 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T23:27:43.753 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T23:27:43.753 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T23:27:43.753 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T23:27:43.754 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T23:27:43.754 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T23:27:43.754 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T23:27:43.754 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T23:27:43.754 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T23:27:43.754 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T23:27:43.754 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T23:27:43.754 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T23:27:43.754 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T23:27:43.754 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T23:27:43.754 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-26T23:27:43.754 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T23:27:43.754 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T23:27:43.754 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-26T23:27:43.755 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T23:27:43.755 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-26T23:27:43.755 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T23:27:43.755 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T23:27:43.755 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T23:27:43.755 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T23:27:43.755 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T23:27:43.755 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T23:27:43.755 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T23:27:43.755 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T23:27:43.755 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T23:27:43.755 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T23:27:43.755 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T23:27:43.755 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T23:27:43.755 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T23:27:43.756 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T23:27:43.756 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T23:27:43.756 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-26T23:27:43.756 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T23:27:43.756 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T23:27:43.756 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T23:27:43.756 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-26T23:27:43.756 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-26T23:27:43.756 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T23:27:43.756 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T23:27:43.756 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T23:27:43.756 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T23:27:43.756 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-26T23:27:43.756 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T23:27:43.756 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T23:27:43.757 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T23:27:43.757 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T23:27:43.757 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-26T23:27:43.757 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-26T23:27:43.757 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-26T23:27:43.757 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-26T23:27:43.757 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-26T23:27:43.757 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-26T23:27:43.757 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-26T23:27:43.757 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T23:27:43.757 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-26T23:27:43.758 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-26T23:27:43.758 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-26T23:27:43.758 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-26T23:27:43.758 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-26T23:27:43.758 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-26T23:27:43.758 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T23:27:43.758 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-26T23:27:43.758 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-26T23:27:43.758 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-26T23:27:43.758 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-26T23:27:43.758 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-26T23:27:43.758 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-26T23:27:43.758 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T23:27:43.758 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-26T23:27:43.758 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-26T23:27:43.759 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-26T23:27:43.759 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T23:27:43.759 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T23:27:43.759 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-26T23:27:43.759 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-26T23:27:43.759 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-26T23:27:43.759 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T23:27:43.759 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T23:27:43.759 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T23:27:43.759 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T23:27:43.759 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T23:27:43.759 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T23:27:43.759 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T23:27:43.759 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T23:27:43.760 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T23:27:43.760 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T23:27:43.760 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T23:27:43.760 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T23:27:43.760 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-26T23:27:43.760 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-26T23:27:43.760 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-26T23:27:43.760 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T23:27:43.760 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T23:27:43.760 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-26T23:27:43.760 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-26T23:27:43.760 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-26T23:27:43.760 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-26T23:27:43.760 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-26T23:27:43.760 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-26T23:27:43.761 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T23:27:43.761 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T23:27:43.761 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T23:27:43.761 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T23:27:43.761 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T23:27:43.761 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T23:27:43.761 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T23:27:43.761 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T23:27:43.761 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T23:27:43.761 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T23:27:43.761 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-26T23:27:43.761 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T23:27:43.761 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-26T23:27:43.761 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-26T23:27:43.762 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T23:27:43.762 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-26T23:27:43.762 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-26T23:27:43.762 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T23:27:43.762 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T23:27:43.762 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-26T23:27:43.762 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-26T23:27:43.762 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-26T23:27:43.762 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T23:27:43.762 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-26T23:27:43.762 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T23:27:43.762 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-26T23:27:43.762 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T23:27:43.762 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T23:27:43.763 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-26T23:27:43.763 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T23:27:43.763 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T23:27:43.763 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T23:27:43.763 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T23:27:43.763 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-26T23:27:43.763 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T23:27:43.763 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-26T23:27:43.763 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-26T23:27:43.763 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T23:27:43.763 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-26T23:27:43.763 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T23:27:43.763 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T23:27:43.763 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T23:27:43.763 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-26T23:27:43.764 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T23:27:43.764 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T23:27:43.764 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-26T23:27:43.764 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-26T23:27:43.764 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T23:27:43.764 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-26T23:27:43.764 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-26T23:27:43.764 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T23:27:43.764 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-26T23:27:43.764 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-26T23:27:43.764 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-26T23:27:43.764 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T23:27:43.764 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-26T23:27:43.764 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-26T23:27:43.765 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-26T23:27:43.765 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-26T23:27:43.765 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-26T23:27:43.765 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T23:27:43.765 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-26T23:27:43.765 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-26T23:27:43.765 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T23:27:43.765 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-26T23:27:43.765 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T23:27:43.765 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-26T23:27:43.765 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T23:27:43.765 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-26T23:27:43.765 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T23:27:43.765 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-26T23:27:43.765 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T23:27:43.766 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-26T23:27:43.766 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-26T23:27:43.766 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-26T23:27:43.766 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T23:27:43.766 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-26T23:27:43.766 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T23:27:43.766 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-26T23:27:43.766 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-26T23:27:43.766 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-26T23:27:43.766 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T23:27:43.766 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-26T23:27:43.766 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T23:27:43.766 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-26T23:27:43.766 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-26T23:27:43.767 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-26T23:27:43.767 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T23:27:43.767 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-26T23:27:43.767 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T23:27:43.767 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-26T23:27:43.767 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T23:27:43.767 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-26T23:27:43.767 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T23:27:43.767 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-26T23:27:43.767 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-26T23:27:43.767 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-26T23:27:43.767 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T23:27:43.767 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-26T23:27:43.768 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T23:27:43.768 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-26T23:27:43.768 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T23:27:43.768 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-26T23:27:43.768 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T23:27:43.768 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-26T23:27:43.768 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T23:27:43.768 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-26T23:27:43.768 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-26T23:27:43.768 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T23:27:43.768 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-26T23:27:43.768 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T23:27:43.768 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-26T23:27:43.768 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T23:27:43.768 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T23:27:43.769 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-26T23:27:43.769 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T23:27:43.769 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T23:27:43.769 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-26T23:27:43.769 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T23:27:43.769 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T23:27:43.769 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-26T23:27:43.769 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T23:27:43.769 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-26T23:27:43.769 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T23:27:43.769 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-26T23:27:43.769 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T23:27:43.769 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T23:27:43.770 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T23:27:43.770 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T23:27:43.770 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T23:27:43.770 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T23:27:43.770 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T23:27:43.770 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T23:27:43.770 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T23:27:43.770 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T23:27:43.770 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T23:27:43.770 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-26T23:27:43.770 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T23:27:43.770 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T23:27:43.770 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T23:27:43.770 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T23:27:43.770 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T23:27:43.771 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T23:27:43.771 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T23:27:43.771 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T23:27:43.771 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T23:27:43.771 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T23:27:43.771 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T23:27:43.771 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T23:27:43.771 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T23:27:43.771 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T23:27:43.771 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T23:27:43.771 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T23:27:43.771 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T23:27:43.771 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T23:27:43.771 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T23:27:43.772 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T23:27:43.772 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T23:27:43.772 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T23:27:43.772 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T23:27:43.772 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T23:27:43.772 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T23:27:43.772 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T23:27:43.772 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T23:27:43.772 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T23:27:43.772 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T23:27:43.772 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T23:27:43.772 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T23:27:43.772 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T23:27:43.772 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T23:27:43.773 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T23:27:43.773 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T23:27:43.773 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T23:27:43.773 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T23:27:43.773 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T23:27:43.773 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T23:27:43.773 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-26T23:27:43.773 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-26T23:27:43.773 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T23:27:43.773 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-26T23:27:43.773 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T23:27:43.773 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-26T23:27:43.773 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T23:27:43.773 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T23:27:43.774 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T23:27:43.774 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T23:27:43.774 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T23:27:43.774 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-26T23:27:43.774 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-26T23:27:43.774 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-26T23:27:43.774 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T23:27:43.774 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-26T23:27:43.774 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T23:27:43.774 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-26T23:27:43.774 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-26T23:27:43.774 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-26T23:27:43.774 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-26T23:27:43.774 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-26T23:27:43.774 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-26T23:27:43.775 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-26T23:27:43.775 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-26T23:27:43.775 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-26T23:27:43.775 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T23:27:43.775 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-26T23:27:43.775 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T23:27:43.775 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-26T23:27:43.775 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-26T23:27:43.775 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T23:27:43.775 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-26T23:27:43.775 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T23:27:43.775 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T23:27:43.775 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-26T23:27:43.775 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T23:27:43.776 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-26T23:27:43.776 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T23:27:43.776 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-26T23:27:43.776 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T23:27:43.776 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-26T23:27:43.776 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T23:27:43.776 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-26T23:27:43.776 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T23:27:43.813 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-26T23:27:43.813 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-26T23:27:43.813 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-26T23:27:43.813 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-26T23:27:43.813 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-26T23:27:43.813 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T23:27:43.813 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-26T23:27:43.814 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T23:27:43.814 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-26T23:27:43.814 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T23:27:43.814 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-26T23:27:43.814 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T23:27:43.814 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T23:27:43.814 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-26T23:27:43.814 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T23:27:43.814 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T23:27:43.814 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-26T23:27:43.814 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T23:27:43.814 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T23:27:43.814 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-26T23:27:43.814 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T23:27:43.815 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-26T23:27:43.815 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-26T23:27:43.815 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-26T23:27:43.815 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-26T23:27:43.815 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-26T23:27:43.815 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T23:27:43.815 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-26T23:27:43.815 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-26T23:27:43.815 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T23:27:43.815 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-26T23:27:43.815 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-26T23:27:43.815 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-26T23:27:43.815 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-26T23:27:43.815 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-26T23:27:43.815 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T23:27:43.815 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T23:27:43.816 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T23:27:43.816 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-26T23:27:43.816 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-26T23:27:43.816 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-26T23:27:43.816 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T23:27:43.816 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-26T23:27:43.816 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-26T23:27:43.816 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T23:27:43.816 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T23:27:43.816 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T23:27:43.816 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T23:27:43.816 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T23:27:43.816 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T23:27:43.817 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T23:27:43.817 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T23:27:43.817 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-26T23:27:43.817 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T23:27:43.817 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T23:27:43.817 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T23:27:43.817 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T23:27:43.817 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T23:27:43.817 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-26T23:27:43.817 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T23:27:43.817 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-26T23:27:43.817 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T23:27:43.817 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T23:27:43.818 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T23:27:43.818 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T23:27:43.818 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-26T23:27:43.818 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T23:27:43.818 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-26T23:27:43.818 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T23:27:43.818 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T23:27:43.818 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-26T23:27:43.818 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T23:27:43.818 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T23:27:43.818 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T23:27:43.818 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T23:27:43.818 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T23:27:43.819 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T23:27:43.819 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T23:27:43.819 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T23:27:43.819 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T23:27:43.819 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T23:27:43.819 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T23:27:43.819 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T23:27:43.819 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T23:27:43.819 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T23:27:43.819 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T23:27:43.819 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T23:27:43.819 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T23:27:43.819 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T23:27:43.819 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T23:27:43.820 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T23:27:43.820 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T23:27:43.820 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T23:27:43.820 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T23:27:43.820 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-26T23:27:43.820 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T23:27:43.820 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-26T23:27:43.820 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T23:27:43.820 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-26T23:27:43.820 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T23:27:43.820 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T23:27:43.820 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T23:27:43.820 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T23:27:43.820 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-26T23:27:43.820 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T23:27:43.821 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T23:27:43.821 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T23:27:43.821 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T23:27:43.821 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T23:27:43.821 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-26T23:27:43.821 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-26T23:27:43.821 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-26T23:27:43.821 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-26T23:27:43.821 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T23:27:43.821 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T23:27:43.821 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T23:27:43.821 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-26T23:27:43.821 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T23:27:43.821 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T23:27:43.822 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T23:27:43.822 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T23:27:43.822 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T23:27:43.822 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T23:27:43.822 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T23:27:43.822 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T23:27:43.822 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T23:27:43.822 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T23:27:43.822 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-26T23:27:43.822 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T23:27:43.822 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T23:27:43.822 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T23:27:43.822 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-26T23:27:43.822 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T23:27:43.823 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-26T23:27:43.823 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T23:27:43.823 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T23:27:43.823 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T23:27:43.823 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-26T23:27:43.823 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T23:27:43.823 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T23:27:43.823 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T23:27:43.823 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T23:27:43.823 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T23:27:43.823 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T23:27:43.823 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T23:27:43.823 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T23:27:43.823 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T23:27:43.824 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-26T23:27:43.824 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T23:27:43.824 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T23:27:43.824 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T23:27:43.824 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T23:27:43.824 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T23:27:43.824 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T23:27:43.824 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T23:27:43.824 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T23:27:43.824 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T23:27:43.824 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T23:27:43.824 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T23:27:43.824 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T23:27:43.824 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T23:27:43.824 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T23:27:43.825 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T23:27:43.825 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T23:27:43.825 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T23:27:43.825 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T23:27:43.825 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T23:27:43.825 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T23:27:43.825 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T23:27:43.825 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T23:27:43.825 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-26T23:27:43.825 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T23:27:43.825 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T23:27:43.825 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T23:27:43.825 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-26T23:27:43.825 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T23:27:43.825 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T23:27:43.826 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T23:27:43.826 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T23:27:43.826 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-26T23:27:43.826 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-26T23:27:43.826 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T23:27:43.826 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-26T23:27:43.826 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T23:27:43.826 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T23:27:43.826 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T23:27:43.826 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T23:27:43.826 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T23:27:43.826 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T23:27:43.826 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T23:27:43.826 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T23:27:43.827 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T23:27:43.827 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T23:27:43.827 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T23:27:43.827 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T23:27:43.827 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T23:27:43.827 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T23:27:43.827 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T23:27:43.827 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T23:27:43.827 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T23:27:43.827 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T23:27:43.827 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T23:27:43.827 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T23:27:43.827 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T23:27:43.827 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T23:27:43.828 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T23:27:43.828 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T23:27:43.828 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T23:27:43.828 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T23:27:43.828 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-26T23:27:43.828 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T23:27:43.828 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-26T23:27:43.828 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T23:27:43.828 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T23:27:43.828 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T23:27:43.828 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T23:27:43.828 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T23:27:43.828 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T23:27:43.828 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T23:27:43.829 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-26T23:27:43.829 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-26T23:27:43.829 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-26T23:27:43.829 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T23:27:43.829 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-26T23:27:43.829 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-26T23:27:43.829 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T23:27:43.829 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-26T23:27:43.829 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T23:27:43.829 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-26T23:27:43.829 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-26T23:27:43.829 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T23:27:43.829 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T23:27:43.829 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T23:27:43.830 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T23:27:43.830 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T23:27:43.830 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T23:27:43.830 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T23:27:43.830 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T23:27:43.830 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T23:27:43.830 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T23:27:43.830 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T23:27:43.830 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T23:27:43.830 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T23:27:43.830 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T23:27:43.830 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T23:27:43.830 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T23:27:43.830 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-26T23:27:43.831 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T23:27:43.831 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T23:27:43.831 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T23:27:43.831 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T23:27:43.831 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T23:27:43.831 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T23:27:43.831 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T23:27:43.831 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T23:27:43.831 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T23:27:43.831 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T23:27:43.831 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T23:27:43.831 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T23:27:43.831 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T23:27:43.831 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T23:27:43.831 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T23:27:43.832 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T23:27:43.832 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T23:27:43.832 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T23:27:43.832 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T23:27:43.832 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T23:27:43.832 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T23:27:43.832 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T23:27:43.832 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T23:27:43.832 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T23:27:43.832 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T23:27:43.832 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T23:27:43.832 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T23:27:43.832 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T23:27:43.832 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T23:27:43.832 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T23:27:43.833 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T23:27:43.833 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T23:27:43.833 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T23:27:43.833 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T23:27:43.833 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T23:27:43.833 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T23:27:43.833 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T23:27:43.833 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T23:27:43.833 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T23:27:43.833 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T23:27:43.833 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T23:27:43.833 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T23:27:43.833 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-26T23:27:43.833 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T23:27:43.833 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T23:27:43.834 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T23:27:43.834 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T23:27:43.834 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T23:27:43.834 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T23:27:43.834 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T23:27:43.834 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T23:27:43.834 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T23:27:43.834 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T23:27:43.834 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T23:27:43.834 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T23:27:43.834 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T23:27:43.834 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T23:27:43.834 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T23:27:43.834 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-26T23:27:43.835 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T23:27:43.835 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T23:27:43.835 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T23:27:43.835 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T23:27:43.835 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T23:27:43.835 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-26T23:27:43.835 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-26T23:27:43.835 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-26T23:27:43.835 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T23:27:43.835 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T23:27:43.835 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T23:27:43.835 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T23:27:43.835 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T23:27:43.835 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T23:27:43.836 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T23:27:43.836 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T23:27:43.836 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T23:27:43.836 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T23:27:43.836 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T23:27:43.836 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T23:27:43.836 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T23:27:43.836 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T23:27:43.836 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T23:27:43.836 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T23:27:43.836 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T23:27:43.836 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T23:27:43.836 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T23:27:43.836 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T23:27:43.836 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T23:27:43.837 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T23:27:43.837 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T23:27:43.837 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T23:27:43.837 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T23:27:43.837 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T23:27:43.837 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T23:27:43.837 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T23:27:43.837 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T23:27:43.837 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T23:27:43.837 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T23:27:43.837 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T23:27:43.837 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T23:27:43.837 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T23:27:43.837 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T23:27:43.837 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T23:27:43.838 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T23:27:43.838 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T23:27:43.838 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T23:27:43.838 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T23:27:43.838 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T23:27:43.838 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T23:27:43.838 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T23:27:43.838 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T23:27:43.838 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T23:27:43.838 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T23:27:43.838 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T23:27:43.838 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T23:27:43.838 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T23:27:43.839 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T23:27:43.839 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T23:27:43.839 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T23:27:43.839 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T23:27:43.839 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T23:27:43.839 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T23:27:43.839 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T23:27:43.839 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T23:27:43.839 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T23:27:43.839 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T23:27:43.839 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T23:27:43.839 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T23:27:43.839 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T23:27:43.839 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T23:27:43.839 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T23:27:43.840 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T23:27:43.840 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T23:27:43.840 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T23:27:43.840 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T23:27:43.840 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T23:27:43.840 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-26T23:27:43.840 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T23:27:43.840 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T23:27:43.840 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-26T23:27:43.840 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T23:27:43.840 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-26T23:27:43.840 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T23:27:43.840 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-26T23:27:43.841 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T23:27:43.841 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T23:27:43.841 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T23:27:43.841 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T23:27:43.841 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-26T23:27:43.841 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T23:27:43.841 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-26T23:27:43.841 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-26T23:27:43.841 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-26T23:27:43.841 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-26T23:27:43.841 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T23:27:43.841 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T23:27:43.841 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T23:27:43.842 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-26T23:27:43.842 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-26T23:27:43.842 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-26T23:27:43.842 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T23:27:43.842 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T23:27:43.842 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T23:27:43.842 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T23:27:43.842 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T23:27:43.842 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T23:27:43.842 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T23:27:43.842 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T23:27:43.842 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T23:27:43.842 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T23:27:43.843 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T23:27:43.843 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-26T23:27:43.843 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T23:27:43.843 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T23:27:43.843 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T23:27:43.843 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T23:27:43.843 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T23:27:43.843 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T23:27:43.843 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T23:27:43.843 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T23:27:43.843 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T23:27:43.843 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T23:27:43.843 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T23:27:43.844 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T23:27:43.844 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T23:27:43.844 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T23:27:43.844 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-26T23:27:43.844 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T23:27:43.844 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T23:27:43.844 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T23:27:43.844 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T23:27:43.844 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T23:27:43.844 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T23:27:43.844 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T23:27:43.844 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T23:27:43.844 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T23:27:43.844 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T23:27:43.845 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T23:27:43.845 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T23:27:43.845 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T23:27:43.845 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T23:27:43.845 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T23:27:43.845 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T23:27:43.845 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T23:27:43.845 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T23:27:43.845 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-26T23:27:43.845 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T23:27:43.845 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T23:27:43.845 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-26T23:27:43.846 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-26T23:27:43.846 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T23:27:43.846 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T23:27:43.846 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T23:27:43.846 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-26T23:27:43.846 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T23:27:43.846 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-26T23:27:43.846 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T23:27:43.846 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T23:27:43.846 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-26T23:27:43.846 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T23:27:43.846 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-26T23:27:43.846 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T23:27:43.847 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T23:27:43.847 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T23:27:43.847 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T23:27:43.847 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T23:27:43.847 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-26T23:27:43.847 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-26T23:27:43.847 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-26T23:27:43.847 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-26T23:27:43.847 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T23:27:43.847 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-26T23:27:43.847 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T23:27:43.847 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T23:27:43.847 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T23:27:43.848 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T23:27:43.848 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T23:27:43.848 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T23:27:43.848 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T23:27:43.848 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T23:27:43.848 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T23:27:43.848 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T23:27:43.848 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T23:27:43.848 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T23:27:43.848 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T23:27:43.848 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-26T23:27:43.848 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-26T23:27:43.849 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-26T23:27:43.849 INFO:teuthology.orchestra.run.smithi170.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-26T23:27:43.849 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-26T23:27:43.849 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-26T23:27:43.853 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T23:27:43.853 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-26T23:27:43.854 DEBUG:teuthology.orchestra.run.smithi170:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-26T23:27:43.862 INFO:teuthology.orchestra.run.smithi170.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T23:27:43.863 INFO:teuthology.orchestra.run.smithi170.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T23:27:43.863 INFO:teuthology.orchestra.run.smithi170.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T23:27:43.864 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-26T23:27:43.864 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-26T23:27:43.864 DEBUG:teuthology.orchestra.run.smithi170:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-26T23:27:43.906 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi170.front.sepia.ceph.com to complete... 2024-04-26T23:27:43.955 INFO:teuthology.orchestra.run.smithi137.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T23:27:43.960 INFO:teuthology.orchestra.run.smithi137.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T23:27:44.002 INFO:teuthology.orchestra.run.smithi137.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T23:27:44.007 INFO:teuthology.orchestra.run.smithi137.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T23:27:44.127 INFO:teuthology.orchestra.run.smithi137.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T23:27:44.127 INFO:teuthology.orchestra.run.smithi137.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T23:27:44.127 INFO:teuthology.orchestra.run.smithi137.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T23:27:44.139 INFO:teuthology.orchestra.run.smithi137.stderr:done 2024-04-26T23:27:44.293 INFO:teuthology.orchestra.run.smithi170.stderr:Sourcing file `/etc/default/grub' 2024-04-26T23:27:44.294 INFO:teuthology.orchestra.run.smithi170.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T23:27:44.333 INFO:teuthology.orchestra.run.smithi170.stderr:Generating grub configuration file ... 2024-04-26T23:27:44.593 INFO:teuthology.orchestra.run.smithi170.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T23:27:44.599 INFO:teuthology.orchestra.run.smithi170.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T23:27:44.982 INFO:teuthology.orchestra.run.smithi170.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T23:27:44.988 INFO:teuthology.orchestra.run.smithi170.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T23:27:45.033 INFO:teuthology.orchestra.run.smithi170.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T23:27:45.038 INFO:teuthology.orchestra.run.smithi170.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T23:27:45.170 INFO:teuthology.orchestra.run.smithi170.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T23:27:45.171 INFO:teuthology.orchestra.run.smithi170.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T23:27:45.171 INFO:teuthology.orchestra.run.smithi170.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T23:27:45.200 INFO:teuthology.orchestra.run.smithi170.stderr:done 2024-04-26T23:28:15.267 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-26T23:28:15.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-26T23:28:15.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:28:16.304 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-26T23:28:16.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-04-26T23:28:16.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:28:33.822 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-26T23:28:34.846 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-04-26T23:28:42.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-26T23:28:42.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:28:43.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-04-26T23:28:43.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:28:45.886 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-26T23:28:46.910 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-04-26T23:28:57.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-26T23:28:57.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:28:58.912 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-04-26T23:28:58.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:29:16.319 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-26T23:29:17.346 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-04-26T23:29:31.330 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-26T23:29:31.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:29:32.173 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-04-26T23:29:32.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-04-26T23:29:32.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:29:32.925 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-04-26T23:29:33.006 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-26T23:29:33.007 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T23:29:33.007 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-04-26T23:29:33.057 INFO:teuthology.orchestra.run.smithi137.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T23:29:33.057 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T23:29:33.058 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T23:29:33.058 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T23:29:33.484 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-04-26T23:29:33.484 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T23:29:33.484 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2024-04-26T23:29:33.534 INFO:teuthology.orchestra.run.smithi170.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T23:29:33.535 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T23:29:33.535 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T23:29:33.535 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T23:29:34.058 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T23:29:34.058 DEBUG:teuthology.orchestra.run.smithi137:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T23:29:34.171 INFO:teuthology.orchestra.run.smithi137.stdout:ttyS1 2024-04-26T23:29:34.229 DEBUG:teuthology.parallel:result is None 2024-04-26T23:29:34.536 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-26T23:29:34.536 DEBUG:teuthology.orchestra.run.smithi170:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T23:29:34.611 INFO:teuthology.orchestra.run.smithi170.stdout:ttyS1 2024-04-26T23:29:34.667 DEBUG:teuthology.parallel:result is None 2024-04-26T23:29:34.667 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T23:29:34.679 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T23:29:34.680 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T23:29:34.683 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T23:29:34.692 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T23:29:34.701 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T23:29:34.708 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T23:29:34.708 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T23:29:34.733 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T23:29:34.807 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T23:29:34.815 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T23:29:34.815 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T23:29:34.818 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T23:29:34.841 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T23:29:34.844 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T23:29:34.854 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T23:29:34.858 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T23:29:34.861 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T23:29:34.871 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T23:29:34.871 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T23:29:34.902 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T23:29:34.928 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T23:29:34.938 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T23:29:34.939 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T23:29:34.960 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T23:29:34.984 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T23:29:35.014 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T23:29:35.070 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:29:35.070 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T23:29:35.149 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T23:29:35.158 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T23:29:35.208 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:29:35.208 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T23:29:35.281 DEBUG:teuthology.orchestra.run.smithi137:> sudo service rsyslog restart 2024-04-26T23:29:35.284 DEBUG:teuthology.orchestra.run.smithi170:> sudo service rsyslog restart 2024-04-26T23:29:35.413 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T23:29:35.421 INFO:teuthology.task.internal:Starting timer... 2024-04-26T23:29:35.421 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T23:29:35.525 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T23:29:35.534 DEBUG:teuthology.task.selinux:Excluding smithi137: OS 'ubuntu' does not support SELinux 2024-04-26T23:29:35.535 DEBUG:teuthology.task.selinux:Excluding smithi170: OS 'ubuntu' does not support SELinux 2024-04-26T23:29:35.535 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T23:29:35.535 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-26T23:29:35.535 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T23:29:35.535 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T23:29:35.545 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T23:29:35.561 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T23:29:35.563 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi137.front.sepia.ceph.com,smithi170.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T23:37:18.007 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi137.front.sepia.ceph.com'), Remote(name='ubuntu@smithi170.front.sepia.ceph.com')] 2024-04-26T23:37:18.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-26T23:37:18.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:37:18.091 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-04-26T23:37:18.237 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-26T23:37:18.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-04-26T23:37:18.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:37:18.320 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-04-26T23:37:18.437 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-04-26T23:37:18.437 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T23:37:18.449 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T23:37:18.449 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T23:37:18.450 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T23:37:18.453 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T23:37:18.453 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T23:37:18.489 INFO:teuthology.orchestra.run.smithi137.stdout:26 Apr 23:37:18 ntpd[17224]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T23:37:18.489 INFO:teuthology.orchestra.run.smithi137.stdout:26 Apr 23:37:18 ntpd[17224]: Command line: ntpd -gq 2024-04-26T23:37:18.490 INFO:teuthology.orchestra.run.smithi137.stdout:26 Apr 23:37:18 ntpd[17224]: ---------------------------------------------------- 2024-04-26T23:37:18.490 INFO:teuthology.orchestra.run.smithi137.stdout:26 Apr 23:37:18 ntpd[17224]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T23:37:18.490 INFO:teuthology.orchestra.run.smithi137.stdout:26 Apr 23:37:18 ntpd[17224]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T23:37:18.490 INFO:teuthology.orchestra.run.smithi137.stdout:26 Apr 23:37:18 ntpd[17224]: corporation. Support and training for ntp-4 are 2024-04-26T23:37:18.490 INFO:teuthology.orchestra.run.smithi137.stdout:26 Apr 23:37:18 ntpd[17224]: available at https://www.nwtime.org/support 2024-04-26T23:37:18.490 INFO:teuthology.orchestra.run.smithi137.stdout:26 Apr 23:37:18 ntpd[17224]: ---------------------------------------------------- 2024-04-26T23:37:18.491 INFO:teuthology.orchestra.run.smithi137.stdout:26 Apr 23:37:18 ntpd[17224]: proto: precision = 0.041 usec (-24) 2024-04-26T23:37:18.491 INFO:teuthology.orchestra.run.smithi137.stdout:26 Apr 23:37:18 ntpd[17224]: basedate set to 2022-02-04 2024-04-26T23:37:18.491 INFO:teuthology.orchestra.run.smithi137.stdout:26 Apr 23:37:18 ntpd[17224]: gps base set to 2022-02-06 (week 2196) 2024-04-26T23:37:18.491 INFO:teuthology.orchestra.run.smithi137.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T23:37:18.491 INFO:teuthology.orchestra.run.smithi137.stdout:26 Apr 23:37:18 ntpd[17224]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T23:37:18.491 INFO:teuthology.orchestra.run.smithi137.stdout:26 Apr 23:37:18 ntpd[17224]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T23:37:18.492 INFO:teuthology.orchestra.run.smithi137.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T23:37:18.493 INFO:teuthology.orchestra.run.smithi137.stdout:26 Apr 23:37:18 ntpd[17224]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T23:37:18.493 INFO:teuthology.orchestra.run.smithi137.stdout:26 Apr 23:37:18 ntpd[17224]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T23:37:18.493 INFO:teuthology.orchestra.run.smithi137.stdout:26 Apr 23:37:18 ntpd[17224]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T23:37:18.493 INFO:teuthology.orchestra.run.smithi137.stdout:26 Apr 23:37:18 ntpd[17224]: Listen normally on 3 enp3s0f1 172.21.15.137:123 2024-04-26T23:37:18.493 INFO:teuthology.orchestra.run.smithi137.stdout:26 Apr 23:37:18 ntpd[17224]: Listen normally on 4 lo [::1]:123 2024-04-26T23:37:18.493 INFO:teuthology.orchestra.run.smithi137.stdout:26 Apr 23:37:18 ntpd[17224]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8137%5]:123 2024-04-26T23:37:18.493 INFO:teuthology.orchestra.run.smithi137.stdout:26 Apr 23:37:18 ntpd[17224]: Listening on routing socket on fd #22 for interface updates 2024-04-26T23:37:18.515 INFO:teuthology.orchestra.run.smithi170.stdout:26 Apr 23:37:18 ntpd[17194]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T23:37:18.515 INFO:teuthology.orchestra.run.smithi170.stdout:26 Apr 23:37:18 ntpd[17194]: Command line: ntpd -gq 2024-04-26T23:37:18.515 INFO:teuthology.orchestra.run.smithi170.stdout:26 Apr 23:37:18 ntpd[17194]: ---------------------------------------------------- 2024-04-26T23:37:18.516 INFO:teuthology.orchestra.run.smithi170.stdout:26 Apr 23:37:18 ntpd[17194]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T23:37:18.516 INFO:teuthology.orchestra.run.smithi170.stdout:26 Apr 23:37:18 ntpd[17194]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T23:37:18.516 INFO:teuthology.orchestra.run.smithi170.stdout:26 Apr 23:37:18 ntpd[17194]: corporation. Support and training for ntp-4 are 2024-04-26T23:37:18.516 INFO:teuthology.orchestra.run.smithi170.stdout:26 Apr 23:37:18 ntpd[17194]: available at https://www.nwtime.org/support 2024-04-26T23:37:18.516 INFO:teuthology.orchestra.run.smithi170.stdout:26 Apr 23:37:18 ntpd[17194]: ---------------------------------------------------- 2024-04-26T23:37:18.516 INFO:teuthology.orchestra.run.smithi170.stdout:26 Apr 23:37:18 ntpd[17194]: proto: precision = 0.042 usec (-24) 2024-04-26T23:37:18.517 INFO:teuthology.orchestra.run.smithi170.stdout:26 Apr 23:37:18 ntpd[17194]: basedate set to 2022-02-04 2024-04-26T23:37:18.517 INFO:teuthology.orchestra.run.smithi170.stdout:26 Apr 23:37:18 ntpd[17194]: gps base set to 2022-02-06 (week 2196) 2024-04-26T23:37:18.517 INFO:teuthology.orchestra.run.smithi170.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T23:37:18.517 INFO:teuthology.orchestra.run.smithi170.stdout:26 Apr 23:37:18 ntpd[17194]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T23:37:18.518 INFO:teuthology.orchestra.run.smithi170.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T23:37:18.518 INFO:teuthology.orchestra.run.smithi170.stdout:26 Apr 23:37:18 ntpd[17194]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T23:37:18.518 INFO:teuthology.orchestra.run.smithi170.stdout:26 Apr 23:37:18 ntpd[17194]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T23:37:18.518 INFO:teuthology.orchestra.run.smithi170.stdout:26 Apr 23:37:18 ntpd[17194]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T23:37:18.519 INFO:teuthology.orchestra.run.smithi170.stdout:26 Apr 23:37:18 ntpd[17194]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T23:37:18.519 INFO:teuthology.orchestra.run.smithi170.stdout:26 Apr 23:37:18 ntpd[17194]: Listen normally on 3 enp3s0f1 172.21.15.170:123 2024-04-26T23:37:18.519 INFO:teuthology.orchestra.run.smithi170.stdout:26 Apr 23:37:18 ntpd[17194]: Listen normally on 4 lo [::1]:123 2024-04-26T23:37:18.519 INFO:teuthology.orchestra.run.smithi170.stdout:26 Apr 23:37:18 ntpd[17194]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7255%5]:123 2024-04-26T23:37:18.520 INFO:teuthology.orchestra.run.smithi170.stdout:26 Apr 23:37:18 ntpd[17194]: Listening on routing socket on fd #22 for interface updates 2024-04-26T23:37:20.516 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:20 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:20.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:20 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:20.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:20 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:20.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:20 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:20.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:20 ntpd[17194]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:37:20.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:20 ntpd[17194]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:37:21.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:21 ntpd[17224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:21.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:21 ntpd[17224]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:21.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:21 ntpd[17224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:21.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:21 ntpd[17224]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:21.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:21 ntpd[17224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:21.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:21 ntpd[17224]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:21.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:21 ntpd[17224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:21.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:21 ntpd[17224]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:21.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:21 ntpd[17224]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:37:21.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:21 ntpd[17224]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:37:21.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:21 ntpd[17224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:21.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:21 ntpd[17224]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:21.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:21 ntpd[17224]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:37:21.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:21 ntpd[17224]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:37:22.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:22 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:22.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:22 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:22.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:22 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:22.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:22 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:22.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:22 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:22.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:22 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:22.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:22 ntpd[17194]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:37:22.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:22 ntpd[17194]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:37:22.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:22 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:22.518 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:22 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:22.518 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:22 ntpd[17194]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:37:22.518 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:22 ntpd[17194]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:37:23.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:23 ntpd[17224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:23.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:23 ntpd[17224]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:23.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:23 ntpd[17224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:23.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:23 ntpd[17224]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:23.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:23 ntpd[17224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:23.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:23 ntpd[17224]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:23.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:23 ntpd[17224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:23.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:23 ntpd[17224]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:23.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:23 ntpd[17224]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:37:23.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:23 ntpd[17224]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:37:23.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:23 ntpd[17224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:23.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:23 ntpd[17224]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:23.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:23 ntpd[17224]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:37:23.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:23 ntpd[17224]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:37:23.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:23 ntpd[17224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:23.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:23 ntpd[17224]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:23.493 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:23 ntpd[17224]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:37:23.493 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:23 ntpd[17224]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:37:23.516 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:23 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:23.516 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:23 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:23.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:23 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:23.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:23 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:23.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:23 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:23.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:23 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:23.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:23 ntpd[17194]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:37:23.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:23 ntpd[17194]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:37:24.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:24 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:24.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:24 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:24.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:24 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:24.518 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:24 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:24.518 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:24 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:24.518 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:24 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:24.518 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:24 ntpd[17194]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:37:24.518 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:24 ntpd[17194]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:37:24.518 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:24 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:24.518 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:24 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:24.518 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:24 ntpd[17194]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:37:24.518 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:24 ntpd[17194]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:37:25.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:25 ntpd[17224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:25.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:25 ntpd[17224]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:25.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:25 ntpd[17224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:25.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:25 ntpd[17224]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:25.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:25 ntpd[17224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:25.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:25 ntpd[17224]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:25.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:25 ntpd[17224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:25.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:25 ntpd[17224]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:25.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:25 ntpd[17224]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:37:25.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:25 ntpd[17224]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:37:25.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:25 ntpd[17224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:25.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:25 ntpd[17224]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:25.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:25 ntpd[17224]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:37:25.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:25 ntpd[17224]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:37:25.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:25 ntpd[17224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:25.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:25 ntpd[17224]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:25.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:25 ntpd[17224]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:37:25.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:25 ntpd[17224]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:37:25.516 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:25 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:25.516 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:25 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:25.516 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:25 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:25.516 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:25 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:25.516 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:25 ntpd[17194]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:37:25.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:25 ntpd[17194]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:37:26.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:26 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:26.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:26 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:26.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:26 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:26.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:26 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:26.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:26 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:26.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:26 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:26.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:26 ntpd[17194]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:37:26.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:26 ntpd[17194]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:37:26.517 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:26 ntpd[17194]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:26.518 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:26 ntpd[17194]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:26.518 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:26 ntpd[17194]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:37:26.518 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:26 ntpd[17194]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:37:26.518 INFO:teuthology.orchestra.run.smithi170.stdout:26 Apr 23:37:26 ntpd[17194]: ntpd: time slew -0.001348 s 2024-04-26T23:37:26.518 INFO:teuthology.orchestra.run.smithi170.stdout:ntpd: time slew -0.001348s 2024-04-26T23:37:26.518 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:26 ntpd[17194]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T23:37:26.519 INFO:teuthology.orchestra.run.smithi170.stderr:26 Apr 23:37:26 ntpd[17194]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T23:37:26.604 INFO:teuthology.orchestra.run.smithi170.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T23:37:26.604 INFO:teuthology.orchestra.run.smithi170.stdout:============================================================================== 2024-04-26T23:37:26.604 INFO:teuthology.orchestra.run.smithi170.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:37:26.604 INFO:teuthology.orchestra.run.smithi170.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:37:26.604 INFO:teuthology.orchestra.run.smithi170.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:37:26.604 INFO:teuthology.orchestra.run.smithi170.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:37:27.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:27 ntpd[17224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:27.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:27 ntpd[17224]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:27.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:27 ntpd[17224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:27.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:27 ntpd[17224]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:27.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:27 ntpd[17224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:27.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:27 ntpd[17224]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:27.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:27 ntpd[17224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:37:27.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:27 ntpd[17224]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:37:27.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:27 ntpd[17224]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:37:27.491 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:27 ntpd[17224]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:37:27.492 INFO:teuthology.orchestra.run.smithi137.stdout:26 Apr 23:37:27 ntpd[17224]: ntpd: time slew +0.001182 s 2024-04-26T23:37:27.492 INFO:teuthology.orchestra.run.smithi137.stdout:ntpd: time slew +0.001182s 2024-04-26T23:37:27.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:27 ntpd[17224]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T23:37:27.492 INFO:teuthology.orchestra.run.smithi137.stderr:26 Apr 23:37:27 ntpd[17224]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T23:37:27.581 INFO:teuthology.orchestra.run.smithi137.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T23:37:27.581 INFO:teuthology.orchestra.run.smithi137.stdout:============================================================================== 2024-04-26T23:37:27.581 INFO:teuthology.orchestra.run.smithi137.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:37:27.581 INFO:teuthology.orchestra.run.smithi137.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:37:27.581 INFO:teuthology.orchestra.run.smithi137.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:37:27.581 INFO:teuthology.orchestra.run.smithi137.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:37:27.582 INFO:teuthology.run_tasks:Running task install... 2024-04-26T23:37:27.592 DEBUG:teuthology.task.install:project ceph 2024-04-26T23:37:27.592 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}} 2024-04-26T23:37:27.592 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'} 2024-04-26T23:37:27.592 INFO:teuthology.task.install:Using flavor: default 2024-04-26T23:37:27.598 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T23:37:27.598 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-26T23:37:27.599 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-key list | grep Ceph 2024-04-26T23:37:27.599 DEBUG:teuthology.orchestra.run.smithi170:> sudo apt-key list | grep Ceph 2024-04-26T23:37:27.703 INFO:teuthology.orchestra.run.smithi170.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T23:37:27.722 INFO:teuthology.orchestra.run.smithi137.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T23:37:27.754 INFO:teuthology.orchestra.run.smithi170.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T23:37:27.754 INFO:teuthology.orchestra.run.smithi170.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T23:37:27.755 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-26T23:37:27.756 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-26T23:37:27.756 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:37:27.772 INFO:teuthology.orchestra.run.smithi137.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T23:37:27.772 INFO:teuthology.orchestra.run.smithi137.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T23:37:27.773 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-26T23:37:27.773 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-26T23:37:27.773 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:37:28.075 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default/ 2024-04-26T23:37:28.075 INFO:teuthology.task.install.deb:Package version is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:37:28.108 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default/ 2024-04-26T23:37:28.108 INFO:teuthology.task.install.deb:Package version is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:37:28.187 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:37:28.187 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T23:37:28.208 DEBUG:teuthology.orchestra.run.smithi170:> sudo apt-get update 2024-04-26T23:37:28.413 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:37:28.413 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T23:37:28.433 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get update 2024-04-26T23:37:28.436 INFO:teuthology.orchestra.run.smithi170.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T23:37:28.440 INFO:teuthology.orchestra.run.smithi170.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T23:37:28.449 INFO:teuthology.orchestra.run.smithi170.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T23:37:28.450 INFO:teuthology.orchestra.run.smithi170.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T23:37:28.462 INFO:teuthology.orchestra.run.smithi170.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T23:37:28.472 INFO:teuthology.orchestra.run.smithi170.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T23:37:28.484 INFO:teuthology.orchestra.run.smithi170.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T23:37:28.505 INFO:teuthology.orchestra.run.smithi170.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-26T23:37:28.537 INFO:teuthology.orchestra.run.smithi170.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-26T23:37:28.621 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T23:37:28.665 INFO:teuthology.orchestra.run.smithi137.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T23:37:28.686 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T23:37:28.708 INFO:teuthology.orchestra.run.smithi137.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T23:37:28.728 INFO:teuthology.orchestra.run.smithi137.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-26T23:37:28.742 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T23:37:28.763 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-26T23:37:28.819 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-26T23:37:29.023 INFO:teuthology.orchestra.run.smithi170.stdout:Fetched 29.2 kB in 1s (49.2 kB/s) 2024-04-26T23:37:29.177 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T23:37:29.438 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 148 kB in 1s (189 kB/s) 2024-04-26T23:37:30.002 INFO:teuthology.orchestra.run.smithi170.stdout:Reading package lists... 2024-04-26T23:37:30.019 DEBUG:teuthology.orchestra.run.smithi170:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3306-gbc612ffb-1jammy cephadm=19.0.0-3306-gbc612ffb-1jammy ceph-mds=19.0.0-3306-gbc612ffb-1jammy ceph-mgr=19.0.0-3306-gbc612ffb-1jammy ceph-common=19.0.0-3306-gbc612ffb-1jammy ceph-fuse=19.0.0-3306-gbc612ffb-1jammy ceph-test=19.0.0-3306-gbc612ffb-1jammy ceph-volume=19.0.0-3306-gbc612ffb-1jammy radosgw=19.0.0-3306-gbc612ffb-1jammy python3-rados=19.0.0-3306-gbc612ffb-1jammy python3-rgw=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy python3-rbd=19.0.0-3306-gbc612ffb-1jammy libcephfs2=19.0.0-3306-gbc612ffb-1jammy libcephfs-dev=19.0.0-3306-gbc612ffb-1jammy librados2=19.0.0-3306-gbc612ffb-1jammy librbd1=19.0.0-3306-gbc612ffb-1jammy rbd-fuse=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy cephfs-shell=19.0.0-3306-gbc612ffb-1jammy cephfs-top=19.0.0-3306-gbc612ffb-1jammy cephfs-mirror=19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:37:30.093 INFO:teuthology.orchestra.run.smithi170.stdout:Reading package lists... 2024-04-26T23:37:30.268 INFO:teuthology.orchestra.run.smithi170.stdout:Building dependency tree... 2024-04-26T23:37:30.269 INFO:teuthology.orchestra.run.smithi170.stdout:Reading state information... 2024-04-26T23:37:30.429 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-04-26T23:37:30.441 DEBUG:teuthology.orchestra.run.smithi137:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3306-gbc612ffb-1jammy cephadm=19.0.0-3306-gbc612ffb-1jammy ceph-mds=19.0.0-3306-gbc612ffb-1jammy ceph-mgr=19.0.0-3306-gbc612ffb-1jammy ceph-common=19.0.0-3306-gbc612ffb-1jammy ceph-fuse=19.0.0-3306-gbc612ffb-1jammy ceph-test=19.0.0-3306-gbc612ffb-1jammy ceph-volume=19.0.0-3306-gbc612ffb-1jammy radosgw=19.0.0-3306-gbc612ffb-1jammy python3-rados=19.0.0-3306-gbc612ffb-1jammy python3-rgw=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy python3-rbd=19.0.0-3306-gbc612ffb-1jammy libcephfs2=19.0.0-3306-gbc612ffb-1jammy libcephfs-dev=19.0.0-3306-gbc612ffb-1jammy librados2=19.0.0-3306-gbc612ffb-1jammy librbd1=19.0.0-3306-gbc612ffb-1jammy rbd-fuse=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy cephfs-shell=19.0.0-3306-gbc612ffb-1jammy cephfs-top=19.0.0-3306-gbc612ffb-1jammy cephfs-mirror=19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:37:30.445 INFO:teuthology.orchestra.run.smithi170.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T23:37:30.446 INFO:teuthology.orchestra.run.smithi170.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T23:37:30.446 INFO:teuthology.orchestra.run.smithi170.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T23:37:30.446 INFO:teuthology.orchestra.run.smithi170.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T23:37:30.446 INFO:teuthology.orchestra.run.smithi170.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T23:37:30.446 INFO:teuthology.orchestra.run.smithi170.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T23:37:30.446 INFO:teuthology.orchestra.run.smithi170.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T23:37:30.447 INFO:teuthology.orchestra.run.smithi170.stdout:The following additional packages will be installed: 2024-04-26T23:37:30.447 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T23:37:30.449 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T23:37:30.449 INFO:teuthology.orchestra.run.smithi170.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T23:37:30.449 INFO:teuthology.orchestra.run.smithi170.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T23:37:30.449 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T23:37:30.449 INFO:teuthology.orchestra.run.smithi170.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T23:37:30.449 INFO:teuthology.orchestra.run.smithi170.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T23:37:30.449 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T23:37:30.449 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T23:37:30.449 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-26T23:37:30.449 INFO:teuthology.orchestra.run.smithi170.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-26T23:37:30.449 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-26T23:37:30.449 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-26T23:37:30.449 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-26T23:37:30.450 INFO:teuthology.orchestra.run.smithi170.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-26T23:37:30.450 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-26T23:37:30.450 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-26T23:37:30.450 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-26T23:37:30.450 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-26T23:37:30.450 INFO:teuthology.orchestra.run.smithi170.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T23:37:30.450 INFO:teuthology.orchestra.run.smithi170.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-26T23:37:30.450 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-26T23:37:30.450 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-26T23:37:30.450 INFO:teuthology.orchestra.run.smithi170.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-26T23:37:30.450 INFO:teuthology.orchestra.run.smithi170.stdout:Suggested packages: 2024-04-26T23:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T23:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T23:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T23:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T23:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T23:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T23:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T23:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout:Recommended packages: 2024-04-26T23:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout: btrfs-tools 2024-04-26T23:37:30.515 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-04-26T23:37:30.601 INFO:teuthology.orchestra.run.smithi170.stdout:The following NEW packages will be installed: 2024-04-26T23:37:30.601 INFO:teuthology.orchestra.run.smithi170.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T23:37:30.601 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T23:37:30.602 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T23:37:30.602 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-26T23:37:30.602 INFO:teuthology.orchestra.run.smithi170.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T23:37:30.602 INFO:teuthology.orchestra.run.smithi170.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-26T23:37:30.602 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-26T23:37:30.602 INFO:teuthology.orchestra.run.smithi170.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-26T23:37:30.602 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-26T23:37:30.602 INFO:teuthology.orchestra.run.smithi170.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-26T23:37:30.602 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T23:37:30.602 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-26T23:37:30.602 INFO:teuthology.orchestra.run.smithi170.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-26T23:37:30.602 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T23:37:30.602 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T23:37:30.602 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T23:37:30.603 INFO:teuthology.orchestra.run.smithi170.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T23:37:30.603 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T23:37:30.603 INFO:teuthology.orchestra.run.smithi170.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T23:37:30.603 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-26T23:37:30.603 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-26T23:37:30.603 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-26T23:37:30.603 INFO:teuthology.orchestra.run.smithi170.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T23:37:30.603 INFO:teuthology.orchestra.run.smithi170.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T23:37:30.603 INFO:teuthology.orchestra.run.smithi170.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T23:37:30.603 INFO:teuthology.orchestra.run.smithi170.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T23:37:30.603 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-26T23:37:30.603 INFO:teuthology.orchestra.run.smithi170.stdout: socat unzip xmlstarlet zip 2024-04-26T23:37:30.689 INFO:teuthology.orchestra.run.smithi137.stdout:Building dependency tree... 2024-04-26T23:37:30.689 INFO:teuthology.orchestra.run.smithi137.stdout:Reading state information... 2024-04-26T23:37:30.749 INFO:teuthology.orchestra.run.smithi170.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-26T23:37:30.749 INFO:teuthology.orchestra.run.smithi170.stdout:Need to get 182 MB of archives. 2024-04-26T23:37:30.749 INFO:teuthology.orchestra.run.smithi170.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-26T23:37:30.749 INFO:teuthology.orchestra.run.smithi170.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3306-gbc612ffb-1jammy [3,556 kB] 2024-04-26T23:37:30.799 INFO:teuthology.orchestra.run.smithi170.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-26T23:37:30.863 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T23:37:30.863 INFO:teuthology.orchestra.run.smithi137.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T23:37:30.863 INFO:teuthology.orchestra.run.smithi137.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T23:37:30.864 INFO:teuthology.orchestra.run.smithi137.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T23:37:30.864 INFO:teuthology.orchestra.run.smithi137.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T23:37:30.864 INFO:teuthology.orchestra.run.smithi137.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T23:37:30.864 INFO:teuthology.orchestra.run.smithi137.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T23:37:30.865 INFO:teuthology.orchestra.run.smithi137.stdout:The following additional packages will be installed: 2024-04-26T23:37:30.865 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T23:37:30.865 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T23:37:30.865 INFO:teuthology.orchestra.run.smithi137.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T23:37:30.865 INFO:teuthology.orchestra.run.smithi137.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T23:37:30.867 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T23:37:30.867 INFO:teuthology.orchestra.run.smithi137.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T23:37:30.867 INFO:teuthology.orchestra.run.smithi137.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T23:37:30.867 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T23:37:30.867 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T23:37:30.867 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-26T23:37:30.867 INFO:teuthology.orchestra.run.smithi137.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-26T23:37:30.867 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-26T23:37:30.867 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-26T23:37:30.868 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-26T23:37:30.868 INFO:teuthology.orchestra.run.smithi137.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-26T23:37:30.868 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-26T23:37:30.868 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-26T23:37:30.868 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-26T23:37:30.868 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-26T23:37:30.868 INFO:teuthology.orchestra.run.smithi137.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T23:37:30.868 INFO:teuthology.orchestra.run.smithi137.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-26T23:37:30.868 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-26T23:37:30.868 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-26T23:37:30.868 INFO:teuthology.orchestra.run.smithi137.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-26T23:37:30.869 INFO:teuthology.orchestra.run.smithi137.stdout:Suggested packages: 2024-04-26T23:37:30.869 INFO:teuthology.orchestra.run.smithi137.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T23:37:30.869 INFO:teuthology.orchestra.run.smithi137.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T23:37:30.869 INFO:teuthology.orchestra.run.smithi137.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T23:37:30.869 INFO:teuthology.orchestra.run.smithi137.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T23:37:30.869 INFO:teuthology.orchestra.run.smithi137.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T23:37:30.869 INFO:teuthology.orchestra.run.smithi137.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T23:37:30.869 INFO:teuthology.orchestra.run.smithi137.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T23:37:30.869 INFO:teuthology.orchestra.run.smithi137.stdout:Recommended packages: 2024-04-26T23:37:30.869 INFO:teuthology.orchestra.run.smithi137.stdout: btrfs-tools 2024-04-26T23:37:30.882 INFO:teuthology.orchestra.run.smithi170.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T23:37:30.927 INFO:teuthology.orchestra.run.smithi170.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-26T23:37:30.984 INFO:teuthology.orchestra.run.smithi170.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3306-gbc612ffb-1jammy [3,224 kB] 2024-04-26T23:37:31.017 INFO:teuthology.orchestra.run.smithi137.stdout:The following NEW packages will be installed: 2024-04-26T23:37:31.018 INFO:teuthology.orchestra.run.smithi137.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T23:37:31.018 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T23:37:31.018 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T23:37:31.018 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-26T23:37:31.018 INFO:teuthology.orchestra.run.smithi137.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T23:37:31.018 INFO:teuthology.orchestra.run.smithi137.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-26T23:37:31.018 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-26T23:37:31.018 INFO:teuthology.orchestra.run.smithi137.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-26T23:37:31.018 INFO:teuthology.orchestra.run.smithi137.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-26T23:37:31.018 INFO:teuthology.orchestra.run.smithi137.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-26T23:37:31.018 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T23:37:31.018 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-26T23:37:31.018 INFO:teuthology.orchestra.run.smithi137.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-26T23:37:31.019 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T23:37:31.019 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T23:37:31.019 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T23:37:31.019 INFO:teuthology.orchestra.run.smithi137.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T23:37:31.019 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T23:37:31.019 INFO:teuthology.orchestra.run.smithi137.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T23:37:31.019 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-26T23:37:31.019 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-26T23:37:31.019 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-26T23:37:31.019 INFO:teuthology.orchestra.run.smithi137.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T23:37:31.019 INFO:teuthology.orchestra.run.smithi137.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T23:37:31.019 INFO:teuthology.orchestra.run.smithi137.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T23:37:31.019 INFO:teuthology.orchestra.run.smithi137.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T23:37:31.019 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-26T23:37:31.019 INFO:teuthology.orchestra.run.smithi137.stdout: socat unzip xmlstarlet zip 2024-04-26T23:37:31.082 INFO:teuthology.orchestra.run.smithi170.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3306-gbc612ffb-1jammy [712 kB] 2024-04-26T23:37:31.090 INFO:teuthology.orchestra.run.smithi137.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-26T23:37:31.090 INFO:teuthology.orchestra.run.smithi137.stdout:Need to get 182 MB of archives. 2024-04-26T23:37:31.090 INFO:teuthology.orchestra.run.smithi137.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-26T23:37:31.090 INFO:teuthology.orchestra.run.smithi137.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-26T23:37:31.105 INFO:teuthology.orchestra.run.smithi170.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3306-gbc612ffb-1jammy [356 kB] 2024-04-26T23:37:31.110 INFO:teuthology.orchestra.run.smithi137.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T23:37:31.116 INFO:teuthology.orchestra.run.smithi170.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3306-gbc612ffb-1jammy [32.8 kB] 2024-04-26T23:37:31.117 INFO:teuthology.orchestra.run.smithi170.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3306-gbc612ffb-1jammy [180 kB] 2024-04-26T23:37:31.121 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-26T23:37:31.124 INFO:teuthology.orchestra.run.smithi170.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3306-gbc612ffb-1jammy [67.1 kB] 2024-04-26T23:37:31.126 INFO:teuthology.orchestra.run.smithi170.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3306-gbc612ffb-1jammy [330 kB] 2024-04-26T23:37:31.136 INFO:teuthology.orchestra.run.smithi170.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3306-gbc612ffb-1jammy [6,892 kB] 2024-04-26T23:37:31.151 INFO:teuthology.orchestra.run.smithi170.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T23:37:31.169 INFO:teuthology.orchestra.run.smithi137.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T23:37:31.193 INFO:teuthology.orchestra.run.smithi137.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T23:37:31.195 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T23:37:31.209 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T23:37:31.219 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3306-gbc612ffb-1jammy [3,556 kB] 2024-04-26T23:37:31.253 INFO:teuthology.orchestra.run.smithi137.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T23:37:31.256 INFO:teuthology.orchestra.run.smithi137.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T23:37:31.263 INFO:teuthology.orchestra.run.smithi137.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T23:37:31.266 INFO:teuthology.orchestra.run.smithi137.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T23:37:31.267 INFO:teuthology.orchestra.run.smithi137.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T23:37:31.274 INFO:teuthology.orchestra.run.smithi137.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T23:37:31.276 INFO:teuthology.orchestra.run.smithi137.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T23:37:31.278 INFO:teuthology.orchestra.run.smithi137.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T23:37:31.279 INFO:teuthology.orchestra.run.smithi137.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T23:37:31.279 INFO:teuthology.orchestra.run.smithi137.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T23:37:31.294 INFO:teuthology.orchestra.run.smithi137.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T23:37:31.296 INFO:teuthology.orchestra.run.smithi137.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T23:37:31.298 INFO:teuthology.orchestra.run.smithi137.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T23:37:31.299 INFO:teuthology.orchestra.run.smithi137.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T23:37:31.314 INFO:teuthology.orchestra.run.smithi137.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T23:37:31.315 INFO:teuthology.orchestra.run.smithi137.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T23:37:31.315 INFO:teuthology.orchestra.run.smithi137.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T23:37:31.316 INFO:teuthology.orchestra.run.smithi137.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T23:37:31.316 INFO:teuthology.orchestra.run.smithi137.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T23:37:31.316 INFO:teuthology.orchestra.run.smithi137.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T23:37:31.334 INFO:teuthology.orchestra.run.smithi137.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T23:37:31.334 INFO:teuthology.orchestra.run.smithi137.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T23:37:31.336 INFO:teuthology.orchestra.run.smithi137.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T23:37:31.337 INFO:teuthology.orchestra.run.smithi137.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T23:37:31.353 INFO:teuthology.orchestra.run.smithi137.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T23:37:31.353 INFO:teuthology.orchestra.run.smithi137.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T23:37:31.354 INFO:teuthology.orchestra.run.smithi137.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T23:37:31.355 INFO:teuthology.orchestra.run.smithi137.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T23:37:31.355 INFO:teuthology.orchestra.run.smithi137.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T23:37:31.356 INFO:teuthology.orchestra.run.smithi137.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T23:37:31.372 INFO:teuthology.orchestra.run.smithi170.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3306-gbc612ffb-1jammy [112 kB] 2024-04-26T23:37:31.373 INFO:teuthology.orchestra.run.smithi137.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T23:37:31.373 INFO:teuthology.orchestra.run.smithi137.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T23:37:31.374 INFO:teuthology.orchestra.run.smithi170.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3306-gbc612ffb-1jammy [466 kB] 2024-04-26T23:37:31.378 INFO:teuthology.orchestra.run.smithi137.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T23:37:31.378 INFO:teuthology.orchestra.run.smithi137.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T23:37:31.391 INFO:teuthology.orchestra.run.smithi170.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3306-gbc612ffb-1jammy [25.8 MB] 2024-04-26T23:37:31.392 INFO:teuthology.orchestra.run.smithi137.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T23:37:31.393 INFO:teuthology.orchestra.run.smithi137.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T23:37:31.394 INFO:teuthology.orchestra.run.smithi137.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T23:37:31.396 INFO:teuthology.orchestra.run.smithi137.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T23:37:31.396 INFO:teuthology.orchestra.run.smithi137.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T23:37:31.398 INFO:teuthology.orchestra.run.smithi137.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T23:37:31.409 INFO:teuthology.orchestra.run.smithi170.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T23:37:31.412 INFO:teuthology.orchestra.run.smithi137.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T23:37:31.414 INFO:teuthology.orchestra.run.smithi137.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T23:37:31.415 INFO:teuthology.orchestra.run.smithi137.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T23:37:31.416 INFO:teuthology.orchestra.run.smithi137.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T23:37:31.431 INFO:teuthology.orchestra.run.smithi137.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T23:37:31.445 INFO:teuthology.orchestra.run.smithi170.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T23:37:31.480 INFO:teuthology.orchestra.run.smithi137.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T23:37:31.481 INFO:teuthology.orchestra.run.smithi137.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T23:37:31.482 INFO:teuthology.orchestra.run.smithi137.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T23:37:31.483 INFO:teuthology.orchestra.run.smithi137.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T23:37:31.484 INFO:teuthology.orchestra.run.smithi137.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T23:37:31.504 INFO:teuthology.orchestra.run.smithi137.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T23:37:31.507 INFO:teuthology.orchestra.run.smithi137.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T23:37:31.507 INFO:teuthology.orchestra.run.smithi137.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T23:37:31.525 INFO:teuthology.orchestra.run.smithi137.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T23:37:31.525 INFO:teuthology.orchestra.run.smithi137.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T23:37:31.533 INFO:teuthology.orchestra.run.smithi137.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T23:37:31.533 INFO:teuthology.orchestra.run.smithi137.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T23:37:31.534 INFO:teuthology.orchestra.run.smithi137.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T23:37:31.535 INFO:teuthology.orchestra.run.smithi137.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T23:37:31.536 INFO:teuthology.orchestra.run.smithi137.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T23:37:31.536 INFO:teuthology.orchestra.run.smithi137.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T23:37:31.540 INFO:teuthology.orchestra.run.smithi137.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T23:37:31.553 INFO:teuthology.orchestra.run.smithi137.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T23:37:31.554 INFO:teuthology.orchestra.run.smithi137.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T23:37:31.555 INFO:teuthology.orchestra.run.smithi137.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T23:37:31.572 INFO:teuthology.orchestra.run.smithi137.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T23:37:31.576 INFO:teuthology.orchestra.run.smithi137.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-26T23:37:31.576 INFO:teuthology.orchestra.run.smithi137.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T23:37:31.577 INFO:teuthology.orchestra.run.smithi137.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T23:37:31.578 INFO:teuthology.orchestra.run.smithi137.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T23:37:31.583 INFO:teuthology.orchestra.run.smithi137.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T23:37:31.584 INFO:teuthology.orchestra.run.smithi137.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T23:37:31.592 INFO:teuthology.orchestra.run.smithi137.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T23:37:31.592 INFO:teuthology.orchestra.run.smithi137.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T23:37:31.593 INFO:teuthology.orchestra.run.smithi137.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T23:37:31.611 INFO:teuthology.orchestra.run.smithi137.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T23:37:31.613 INFO:teuthology.orchestra.run.smithi137.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T23:37:31.614 INFO:teuthology.orchestra.run.smithi137.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T23:37:31.622 INFO:teuthology.orchestra.run.smithi137.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T23:37:31.622 INFO:teuthology.orchestra.run.smithi137.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T23:37:31.622 INFO:teuthology.orchestra.run.smithi137.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T23:37:31.625 INFO:teuthology.orchestra.run.smithi137.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T23:37:31.631 INFO:teuthology.orchestra.run.smithi137.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T23:37:31.779 INFO:teuthology.orchestra.run.smithi170.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T23:37:32.302 INFO:teuthology.orchestra.run.smithi170.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3306-gbc612ffb-1jammy [5,094 kB] 2024-04-26T23:37:32.476 INFO:teuthology.orchestra.run.smithi170.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3306-gbc612ffb-1jammy [244 kB] 2024-04-26T23:37:32.481 INFO:teuthology.orchestra.run.smithi170.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T23:37:32.485 INFO:teuthology.orchestra.run.smithi170.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3306-gbc612ffb-1jammy [1,544 kB] 2024-04-26T23:37:32.540 INFO:teuthology.orchestra.run.smithi170.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3306-gbc612ffb-1jammy [6,261 kB] 2024-04-26T23:37:32.764 INFO:teuthology.orchestra.run.smithi170.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3306-gbc612ffb-1jammy [22.8 MB] 2024-04-26T23:37:33.090 INFO:teuthology.orchestra.run.smithi137.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3306-gbc612ffb-1jammy [3,224 kB] 2024-04-26T23:37:33.574 INFO:teuthology.orchestra.run.smithi170.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3306-gbc612ffb-1jammy [14.1 kB] 2024-04-26T23:37:33.574 INFO:teuthology.orchestra.run.smithi170.stdout:Get:27 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [870 kB] 2024-04-26T23:37:33.600 INFO:teuthology.orchestra.run.smithi170.stdout:Get:28 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3306-gbc612ffb-1jammy [2,437 kB] 2024-04-26T23:37:33.689 INFO:teuthology.orchestra.run.smithi170.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3306-gbc612ffb-1jammy [791 kB] 2024-04-26T23:37:33.715 INFO:teuthology.orchestra.run.smithi170.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3306-gbc612ffb-1jammy [148 kB] 2024-04-26T23:37:33.719 INFO:teuthology.orchestra.run.smithi170.stdout:Get:31 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3306-gbc612ffb-1jammy [2,297 kB] 2024-04-26T23:37:33.803 INFO:teuthology.orchestra.run.smithi170.stdout:Get:32 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3306-gbc612ffb-1jammy [8,625 kB] 2024-04-26T23:37:34.110 INFO:teuthology.orchestra.run.smithi170.stdout:Get:33 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3306-gbc612ffb-1jammy [14.2 kB] 2024-04-26T23:37:34.110 INFO:teuthology.orchestra.run.smithi170.stdout:Get:34 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3306-gbc612ffb-1jammy [51.7 MB] 2024-04-26T23:37:34.510 INFO:teuthology.orchestra.run.smithi137.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3306-gbc612ffb-1jammy [712 kB] 2024-04-26T23:37:34.645 INFO:teuthology.orchestra.run.smithi170.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T23:37:34.825 INFO:teuthology.orchestra.run.smithi137.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3306-gbc612ffb-1jammy [356 kB] 2024-04-26T23:37:34.952 INFO:teuthology.orchestra.run.smithi170.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T23:37:35.017 INFO:teuthology.orchestra.run.smithi137.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3306-gbc612ffb-1jammy [32.8 kB] 2024-04-26T23:37:35.018 INFO:teuthology.orchestra.run.smithi137.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3306-gbc612ffb-1jammy [180 kB] 2024-04-26T23:37:35.084 INFO:teuthology.orchestra.run.smithi137.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3306-gbc612ffb-1jammy [67.1 kB] 2024-04-26T23:37:35.147 INFO:teuthology.orchestra.run.smithi137.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3306-gbc612ffb-1jammy [330 kB] 2024-04-26T23:37:35.281 INFO:teuthology.orchestra.run.smithi137.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3306-gbc612ffb-1jammy [6,892 kB] 2024-04-26T23:37:35.532 INFO:teuthology.orchestra.run.smithi170.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T23:37:35.945 INFO:teuthology.orchestra.run.smithi170.stdout:Get:38 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T23:37:35.946 INFO:teuthology.orchestra.run.smithi170.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3306-gbc612ffb-1jammy [232 kB] 2024-04-26T23:37:35.948 INFO:teuthology.orchestra.run.smithi170.stdout:Get:40 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3306-gbc612ffb-1jammy [33.9 kB] 2024-04-26T23:37:35.949 INFO:teuthology.orchestra.run.smithi170.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3306-gbc612ffb-1jammy [23.4 kB] 2024-04-26T23:37:35.949 INFO:teuthology.orchestra.run.smithi170.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3306-gbc612ffb-1jammy [38.9 kB] 2024-04-26T23:37:35.950 INFO:teuthology.orchestra.run.smithi170.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3306-gbc612ffb-1jammy [13.6 MB] 2024-04-26T23:37:35.991 INFO:teuthology.orchestra.run.smithi170.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T23:37:36.289 INFO:teuthology.orchestra.run.smithi170.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T23:37:36.428 INFO:teuthology.orchestra.run.smithi170.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [91.2 kB] 2024-04-26T23:37:36.878 INFO:teuthology.orchestra.run.smithi170.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T23:37:36.894 INFO:teuthology.orchestra.run.smithi170.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T23:37:36.911 INFO:teuthology.orchestra.run.smithi170.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T23:37:36.919 INFO:teuthology.orchestra.run.smithi170.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T23:37:36.920 INFO:teuthology.orchestra.run.smithi170.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T23:37:36.938 INFO:teuthology.orchestra.run.smithi170.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T23:37:36.973 INFO:teuthology.orchestra.run.smithi170.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T23:37:36.987 INFO:teuthology.orchestra.run.smithi170.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T23:37:36.990 INFO:teuthology.orchestra.run.smithi170.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T23:37:36.992 INFO:teuthology.orchestra.run.smithi170.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T23:37:37.029 INFO:teuthology.orchestra.run.smithi137.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3306-gbc612ffb-1jammy [112 kB] 2024-04-26T23:37:37.033 INFO:teuthology.orchestra.run.smithi137.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3306-gbc612ffb-1jammy [466 kB] 2024-04-26T23:37:37.095 INFO:teuthology.orchestra.run.smithi137.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3306-gbc612ffb-1jammy [25.8 MB] 2024-04-26T23:37:37.162 INFO:teuthology.orchestra.run.smithi170.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T23:37:37.244 INFO:teuthology.orchestra.run.smithi170.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T23:37:37.256 INFO:teuthology.orchestra.run.smithi170.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T23:37:37.326 INFO:teuthology.orchestra.run.smithi170.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T23:37:37.352 INFO:teuthology.orchestra.run.smithi170.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T23:37:37.369 INFO:teuthology.orchestra.run.smithi170.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T23:37:37.407 INFO:teuthology.orchestra.run.smithi170.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T23:37:37.582 INFO:teuthology.orchestra.run.smithi170.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T23:37:37.597 INFO:teuthology.orchestra.run.smithi170.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T23:37:37.603 INFO:teuthology.orchestra.run.smithi170.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T23:37:37.609 INFO:teuthology.orchestra.run.smithi170.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T23:37:37.798 INFO:teuthology.orchestra.run.smithi170.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T23:37:37.892 INFO:teuthology.orchestra.run.smithi170.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T23:37:37.907 INFO:teuthology.orchestra.run.smithi170.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T23:37:38.107 INFO:teuthology.orchestra.run.smithi170.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T23:37:38.157 INFO:teuthology.orchestra.run.smithi170.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T23:37:38.179 INFO:teuthology.orchestra.run.smithi170.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T23:37:38.637 INFO:teuthology.orchestra.run.smithi170.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T23:37:38.638 INFO:teuthology.orchestra.run.smithi170.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T23:37:38.644 INFO:teuthology.orchestra.run.smithi170.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T23:37:38.650 INFO:teuthology.orchestra.run.smithi170.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T23:37:38.683 INFO:teuthology.orchestra.run.smithi170.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T23:37:38.926 INFO:teuthology.orchestra.run.smithi170.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T23:37:39.180 INFO:teuthology.orchestra.run.smithi170.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T23:37:39.324 INFO:teuthology.orchestra.run.smithi170.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T23:37:39.367 INFO:teuthology.orchestra.run.smithi170.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T23:37:39.457 INFO:teuthology.orchestra.run.smithi170.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T23:37:39.468 INFO:teuthology.orchestra.run.smithi170.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T23:37:39.481 INFO:teuthology.orchestra.run.smithi170.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T23:37:39.527 INFO:teuthology.orchestra.run.smithi170.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T23:37:39.586 INFO:teuthology.orchestra.run.smithi137.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3306-gbc612ffb-1jammy [5,094 kB] 2024-04-26T23:37:39.787 INFO:teuthology.orchestra.run.smithi170.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T23:37:39.788 INFO:teuthology.orchestra.run.smithi170.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T23:37:39.789 INFO:teuthology.orchestra.run.smithi170.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T23:37:39.954 INFO:teuthology.orchestra.run.smithi170.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T23:37:39.971 INFO:teuthology.orchestra.run.smithi137.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3306-gbc612ffb-1jammy [244 kB] 2024-04-26T23:37:39.990 INFO:teuthology.orchestra.run.smithi137.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T23:37:40.009 INFO:teuthology.orchestra.run.smithi137.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3306-gbc612ffb-1jammy [1,544 kB] 2024-04-26T23:37:40.114 INFO:teuthology.orchestra.run.smithi137.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3306-gbc612ffb-1jammy [6,261 kB] 2024-04-26T23:37:40.298 INFO:teuthology.orchestra.run.smithi170.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T23:37:40.570 INFO:teuthology.orchestra.run.smithi137.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3306-gbc612ffb-1jammy [22.8 MB] 2024-04-26T23:37:40.700 INFO:teuthology.orchestra.run.smithi170.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T23:37:40.709 INFO:teuthology.orchestra.run.smithi170.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T23:37:40.710 INFO:teuthology.orchestra.run.smithi170.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T23:37:40.779 INFO:teuthology.orchestra.run.smithi170.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T23:37:40.780 INFO:teuthology.orchestra.run.smithi170.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T23:37:40.781 INFO:teuthology.orchestra.run.smithi170.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T23:37:40.782 INFO:teuthology.orchestra.run.smithi170.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T23:37:40.782 INFO:teuthology.orchestra.run.smithi170.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T23:37:40.784 INFO:teuthology.orchestra.run.smithi170.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T23:37:40.948 INFO:teuthology.orchestra.run.smithi170.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T23:37:41.156 INFO:teuthology.orchestra.run.smithi170.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T23:37:41.486 INFO:teuthology.orchestra.run.smithi170.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T23:37:41.532 INFO:teuthology.orchestra.run.smithi170.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T23:37:41.558 INFO:teuthology.orchestra.run.smithi170.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T23:37:41.568 INFO:teuthology.orchestra.run.smithi170.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T23:37:41.613 INFO:teuthology.orchestra.run.smithi170.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T23:37:41.639 INFO:teuthology.orchestra.run.smithi170.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-26T23:37:41.641 INFO:teuthology.orchestra.run.smithi170.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T23:37:41.648 INFO:teuthology.orchestra.run.smithi170.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T23:37:41.651 INFO:teuthology.orchestra.run.smithi170.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T23:37:41.848 INFO:teuthology.orchestra.run.smithi170.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T23:37:42.043 INFO:teuthology.orchestra.run.smithi137.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3306-gbc612ffb-1jammy [14.1 kB] 2024-04-26T23:37:42.043 INFO:teuthology.orchestra.run.smithi137.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [870 kB] 2024-04-26T23:37:42.096 INFO:teuthology.orchestra.run.smithi137.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3306-gbc612ffb-1jammy [2,437 kB] 2024-04-26T23:37:42.107 INFO:teuthology.orchestra.run.smithi170.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T23:37:42.241 INFO:teuthology.orchestra.run.smithi137.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3306-gbc612ffb-1jammy [791 kB] 2024-04-26T23:37:42.291 INFO:teuthology.orchestra.run.smithi137.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3306-gbc612ffb-1jammy [148 kB] 2024-04-26T23:37:42.303 INFO:teuthology.orchestra.run.smithi137.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3306-gbc612ffb-1jammy [2,297 kB] 2024-04-26T23:37:42.376 INFO:teuthology.orchestra.run.smithi170.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T23:37:42.378 INFO:teuthology.orchestra.run.smithi170.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T23:37:42.395 INFO:teuthology.orchestra.run.smithi170.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T23:37:42.400 INFO:teuthology.orchestra.run.smithi170.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T23:37:42.428 INFO:teuthology.orchestra.run.smithi137.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3306-gbc612ffb-1jammy [8,625 kB] 2024-04-26T23:37:42.439 INFO:teuthology.orchestra.run.smithi170.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T23:37:42.453 INFO:teuthology.orchestra.run.smithi170.stdout:Get:119 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T23:37:42.544 INFO:teuthology.orchestra.run.smithi170.stdout:Get:120 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T23:37:42.545 INFO:teuthology.orchestra.run.smithi170.stdout:Get:121 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T23:37:42.546 INFO:teuthology.orchestra.run.smithi170.stdout:Get:122 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T23:37:42.727 INFO:teuthology.orchestra.run.smithi170.stdout:Get:123 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T23:37:42.924 INFO:teuthology.orchestra.run.smithi137.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3306-gbc612ffb-1jammy [14.2 kB] 2024-04-26T23:37:42.924 INFO:teuthology.orchestra.run.smithi137.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3306-gbc612ffb-1jammy [51.7 MB] 2024-04-26T23:37:42.992 INFO:teuthology.orchestra.run.smithi170.stdout:Get:124 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T23:37:45.445 INFO:teuthology.orchestra.run.smithi137.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T23:37:45.446 INFO:teuthology.orchestra.run.smithi137.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3306-gbc612ffb-1jammy [232 kB] 2024-04-26T23:37:45.448 INFO:teuthology.orchestra.run.smithi137.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3306-gbc612ffb-1jammy [33.9 kB] 2024-04-26T23:37:45.449 INFO:teuthology.orchestra.run.smithi137.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3306-gbc612ffb-1jammy [23.4 kB] 2024-04-26T23:37:45.449 INFO:teuthology.orchestra.run.smithi137.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3306-gbc612ffb-1jammy [38.9 kB] 2024-04-26T23:37:45.450 INFO:teuthology.orchestra.run.smithi137.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3306-gbc612ffb-1jammy [13.6 MB] 2024-04-26T23:37:45.970 INFO:teuthology.orchestra.run.smithi170.stdout:Fetched 182 MB in 15s (12.3 MB/s) 2024-04-26T23:37:45.971 INFO:teuthology.orchestra.run.smithi137.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [91.2 kB] 2024-04-26T23:37:46.128 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-26T23:37:46.195 INFO:teuthology.orchestra.run.smithi170.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-26T23:37:46.198 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-26T23:37:46.252 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-26T23:37:46.547 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T23:37:46.560 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T23:37:46.597 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T23:37:46.613 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 182 MB in 15s (12.2 MB/s) 2024-04-26T23:37:46.737 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-26T23:37:46.804 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-26T23:37:46.808 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-26T23:37:46.844 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-26T23:37:47.041 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-cmd2. 2024-04-26T23:37:47.055 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-26T23:37:47.099 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-26T23:37:47.164 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T23:37:47.177 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T23:37:47.222 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T23:37:47.436 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T23:37:47.450 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T23:37:47.553 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T23:37:47.558 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cmd2. 2024-04-26T23:37:47.573 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-26T23:37:47.616 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-26T23:37:47.898 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T23:37:47.903 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T23:37:47.912 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T23:37:47.918 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T23:37:47.956 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T23:37:47.995 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T23:37:48.242 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T23:37:48.257 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T23:37:48.300 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T23:37:48.365 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T23:37:48.380 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T23:37:48.423 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T23:37:48.737 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T23:37:48.751 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T23:37:48.751 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:37:48.766 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T23:37:48.809 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T23:37:48.812 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:37:49.196 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T23:37:49.211 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:37:49.240 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T23:37:49.254 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:37:49.255 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:37:49.307 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:37:49.601 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T23:37:49.616 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:37:49.659 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:37:49.682 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T23:37:49.697 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:37:49.741 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:37:50.021 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T23:37:50.036 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T23:37:50.077 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T23:37:50.079 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T23:37:50.091 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:37:50.135 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:37:50.399 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package librados2. 2024-04-26T23:37:50.413 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../010-librados2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:37:50.457 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:50.459 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T23:37:50.473 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T23:37:50.513 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T23:37:50.783 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librados2. 2024-04-26T23:37:50.797 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../010-librados2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:37:50.850 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:50.860 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package librbd1. 2024-04-26T23:37:50.874 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../011-librbd1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:37:50.910 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:51.286 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librbd1. 2024-04-26T23:37:51.299 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../011-librbd1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:37:51.304 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T23:37:51.318 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:37:51.344 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:51.363 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:51.632 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-rados. 2024-04-26T23:37:51.646 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:37:51.844 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:51.938 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T23:37:51.952 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:37:51.996 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:52.018 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T23:37:52.032 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:37:52.076 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:52.265 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rados. 2024-04-26T23:37:52.280 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:37:52.315 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:52.420 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T23:37:52.435 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:37:52.479 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:52.610 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T23:37:52.625 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:37:52.668 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:52.773 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T23:37:52.788 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:37:52.831 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:52.937 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T23:37:52.952 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:37:52.987 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:53.159 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T23:37:53.174 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T23:37:53.217 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T23:37:53.298 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T23:37:53.313 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:37:53.356 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:53.495 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T23:37:53.510 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:37:53.553 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:53.710 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T23:37:53.724 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T23:37:53.767 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T23:37:53.890 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T23:37:53.904 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T23:37:53.939 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T23:37:54.029 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T23:37:54.043 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:37:54.087 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:54.184 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T23:37:54.198 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T23:37:54.242 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T23:37:54.399 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T23:37:54.413 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T23:37:54.448 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T23:37:54.545 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T23:37:54.559 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T23:37:54.603 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T23:37:54.742 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T23:37:54.757 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T23:37:54.800 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T23:37:54.965 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package lua5.1. 2024-04-26T23:37:54.979 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T23:37:55.023 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T23:37:55.061 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T23:37:55.076 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T23:37:55.119 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T23:37:55.301 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package lua-any. 2024-04-26T23:37:55.315 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-26T23:37:55.359 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T23:37:55.448 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package lua5.1. 2024-04-26T23:37:55.463 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T23:37:55.506 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T23:37:55.595 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package zip. 2024-04-26T23:37:55.610 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-26T23:37:55.653 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T23:37:55.818 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package lua-any. 2024-04-26T23:37:55.833 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-26T23:37:55.876 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T23:37:55.965 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package unzip. 2024-04-26T23:37:55.980 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T23:37:56.023 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T23:37:56.137 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package zip. 2024-04-26T23:37:56.152 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-26T23:37:56.186 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T23:37:56.444 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package luarocks. 2024-04-26T23:37:56.458 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T23:37:56.498 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package unzip. 2024-04-26T23:37:56.501 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T23:37:56.513 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T23:37:56.556 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T23:37:56.893 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package librgw2. 2024-04-26T23:37:56.906 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../027-librgw2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:37:56.951 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:56.985 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package luarocks. 2024-04-26T23:37:57.000 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T23:37:57.043 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T23:37:57.434 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librgw2. 2024-04-26T23:37:57.445 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T23:37:57.448 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../027-librgw2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:37:57.459 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:37:57.484 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:57.503 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:57.831 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T23:37:57.846 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T23:37:57.881 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T23:37:57.962 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T23:37:57.976 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:37:58.019 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:58.167 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T23:37:58.182 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:37:58.225 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:58.356 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T23:37:58.371 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T23:37:58.414 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T23:37:58.654 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-common. 2024-04-26T23:37:58.668 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:37:58.712 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:58.717 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T23:37:58.732 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:37:58.767 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:59.129 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-common. 2024-04-26T23:37:59.144 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:37:59.187 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:37:59.868 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-base. 2024-04-26T23:37:59.883 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:37:59.935 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:00.342 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-base. 2024-04-26T23:38:00.358 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:00.410 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:00.472 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T23:38:00.486 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T23:38:00.561 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T23:38:00.825 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T23:38:00.839 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T23:38:00.874 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T23:38:00.996 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T23:38:01.010 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T23:38:01.054 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T23:38:01.177 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T23:38:01.192 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T23:38:01.236 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T23:38:01.324 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T23:38:01.338 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T23:38:01.374 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T23:38:01.522 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T23:38:01.538 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T23:38:01.580 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T23:38:01.635 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T23:38:01.649 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T23:38:01.685 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T23:38:01.883 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T23:38:01.898 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T23:38:01.941 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T23:38:02.173 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T23:38:02.186 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T23:38:02.229 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T23:38:02.236 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T23:38:02.251 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T23:38:02.285 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T23:38:02.491 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T23:38:02.506 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T23:38:02.549 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T23:38:02.869 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T23:38:02.883 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T23:38:02.927 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T23:38:03.213 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-portend. 2024-04-26T23:38:03.228 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-26T23:38:03.263 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T23:38:03.465 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-portend. 2024-04-26T23:38:03.480 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-26T23:38:03.523 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T23:38:03.825 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T23:38:03.841 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T23:38:03.883 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T23:38:04.169 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T23:38:04.185 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T23:38:04.228 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T23:38:04.274 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T23:38:04.289 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T23:38:04.332 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T23:38:04.540 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T23:38:04.554 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T23:38:04.590 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T23:38:04.636 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T23:38:04.650 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T23:38:04.694 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T23:38:04.918 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T23:38:04.933 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T23:38:04.976 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T23:38:05.039 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T23:38:05.054 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T23:38:05.097 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T23:38:05.279 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T23:38:05.294 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T23:38:05.337 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T23:38:05.401 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T23:38:05.415 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T23:38:05.459 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T23:38:05.640 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-mako. 2024-04-26T23:38:05.656 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T23:38:05.698 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T23:38:05.762 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T23:38:05.776 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T23:38:05.828 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T23:38:06.026 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T23:38:06.041 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T23:38:06.085 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T23:38:06.089 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-mako. 2024-04-26T23:38:06.104 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T23:38:06.139 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T23:38:06.371 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T23:38:06.386 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T23:38:06.426 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T23:38:06.429 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T23:38:06.441 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T23:38:06.484 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T23:38:06.732 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-webob. 2024-04-26T23:38:06.747 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T23:38:06.790 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T23:38:06.820 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T23:38:06.835 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T23:38:06.878 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T23:38:07.135 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T23:38:07.150 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T23:38:07.164 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-webob. 2024-04-26T23:38:07.179 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T23:38:07.195 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T23:38:07.222 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T23:38:07.504 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T23:38:07.519 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T23:38:07.551 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T23:38:07.562 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T23:38:07.566 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T23:38:07.603 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T23:38:07.857 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-paste. 2024-04-26T23:38:07.872 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T23:38:07.878 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T23:38:07.894 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T23:38:07.907 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T23:38:07.936 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T23:38:08.226 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T23:38:08.241 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T23:38:08.265 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-paste. 2024-04-26T23:38:08.280 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T23:38:08.285 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T23:38:08.322 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T23:38:08.554 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T23:38:08.570 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T23:38:08.604 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T23:38:08.634 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T23:38:08.649 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T23:38:08.692 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T23:38:08.899 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T23:38:08.914 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T23:38:08.957 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T23:38:09.020 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T23:38:09.035 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T23:38:09.078 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T23:38:09.294 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T23:38:09.309 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T23:38:09.351 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T23:38:09.365 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T23:38:09.380 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T23:38:09.414 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T23:38:09.684 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T23:38:09.699 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T23:38:09.715 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T23:38:09.731 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T23:38:09.734 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T23:38:09.773 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T23:38:10.089 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T23:38:10.101 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-idna. 2024-04-26T23:38:10.103 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T23:38:10.116 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-26T23:38:10.147 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T23:38:10.159 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T23:38:10.445 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T23:38:10.460 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T23:38:10.466 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-idna. 2024-04-26T23:38:10.481 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-26T23:38:10.495 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T23:38:10.524 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T23:38:10.815 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-requests. 2024-04-26T23:38:10.830 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T23:38:10.865 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T23:38:10.878 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T23:38:10.893 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T23:38:10.936 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T23:38:11.185 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T23:38:11.200 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T23:38:11.242 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T23:38:11.264 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-requests. 2024-04-26T23:38:11.279 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T23:38:11.322 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T23:38:11.529 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T23:38:11.544 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:38:11.587 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:11.642 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T23:38:11.656 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T23:38:11.692 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T23:38:11.978 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T23:38:11.993 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:38:11.994 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T23:38:12.008 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:12.036 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:12.077 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:12.380 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T23:38:12.394 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T23:38:12.438 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T23:38:12.641 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T23:38:12.656 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:12.699 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:12.741 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T23:38:12.756 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T23:38:12.800 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T23:38:13.011 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T23:38:13.026 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T23:38:13.094 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T23:38:13.136 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T23:38:13.151 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:13.194 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:13.372 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T23:38:13.387 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T23:38:13.421 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T23:38:13.564 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T23:38:13.579 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:13.622 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:13.733 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T23:38:13.748 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:13.791 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:14.201 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T23:38:14.213 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T23:38:14.215 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:14.228 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:14.259 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:14.271 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:14.799 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T23:38:14.814 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:14.849 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:15.038 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph. 2024-04-26T23:38:15.052 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../068-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:15.087 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:15.398 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T23:38:15.413 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:15.456 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:15.602 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph. 2024-04-26T23:38:15.616 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../068-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:15.660 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:15.826 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T23:38:15.835 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:15.876 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:15.980 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T23:38:15.994 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:16.038 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:16.271 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package cephadm. 2024-04-26T23:38:16.282 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../071-cephadm_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:16.321 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:16.416 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T23:38:16.431 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:16.466 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:16.624 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T23:38:16.633 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T23:38:16.665 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T23:38:16.869 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package cephadm. 2024-04-26T23:38:16.878 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../071-cephadm_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:16.910 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:16.960 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T23:38:16.969 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T23:38:17.009 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T23:38:17.255 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T23:38:17.270 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T23:38:17.313 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T23:38:17.741 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T23:38:17.755 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T23:38:17.799 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T23:38:18.123 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-babel. 2024-04-26T23:38:18.132 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T23:38:18.164 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T23:38:18.509 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T23:38:18.518 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T23:38:18.551 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T23:38:18.812 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-babel. 2024-04-26T23:38:18.823 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T23:38:18.862 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T23:38:18.887 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T23:38:18.897 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:38:18.929 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:19.181 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T23:38:19.193 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T23:38:19.231 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T23:38:19.249 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T23:38:19.258 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T23:38:19.315 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T23:38:19.601 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T23:38:19.610 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-routes. 2024-04-26T23:38:19.613 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:38:19.622 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T23:38:19.651 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:19.660 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T23:38:19.962 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T23:38:19.971 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T23:38:19.975 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T23:38:19.985 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:38:20.012 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T23:38:20.029 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:20.349 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-routes. 2024-04-26T23:38:20.361 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T23:38:20.398 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T23:38:20.735 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T23:38:20.747 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:38:20.784 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:21.226 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T23:38:21.237 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T23:38:21.276 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T23:38:21.772 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T23:38:21.782 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T23:38:21.821 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T23:38:21.906 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T23:38:21.917 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T23:38:21.973 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T23:38:22.175 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T23:38:22.186 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T23:38:22.302 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T23:38:22.443 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T23:38:22.706 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T23:38:22.706 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T23:38:22.706 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T23:38:22.706 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T23:38:22.707 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T23:38:22.963 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T23:38:22.974 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T23:38:23.090 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T23:38:23.360 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T23:38:23.371 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T23:38:23.401 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T23:38:23.522 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T23:38:23.533 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:38:23.572 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:24.069 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T23:38:24.080 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:38:24.118 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:24.534 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T23:38:24.546 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T23:38:24.576 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T23:38:24.879 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T23:38:24.891 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T23:38:24.928 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T23:38:25.063 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T23:38:25.076 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T23:38:25.113 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T23:38:25.257 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T23:38:25.268 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T23:38:25.323 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T23:38:25.408 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T23:38:25.420 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T23:38:25.457 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T23:38:25.619 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T23:38:25.633 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-26T23:38:25.676 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T23:38:25.786 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T23:38:25.799 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T23:38:25.835 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T23:38:25.997 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T23:38:26.007 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T23:38:26.047 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T23:38:26.164 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T23:38:26.176 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-26T23:38:26.213 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T23:38:26.367 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T23:38:26.377 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T23:38:26.417 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T23:38:26.492 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T23:38:26.505 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T23:38:26.534 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T23:38:26.753 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T23:38:26.766 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T23:38:26.803 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T23:38:26.904 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T23:38:26.916 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T23:38:26.954 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T23:38:27.123 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T23:38:27.134 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T23:38:27.173 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T23:38:27.223 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T23:38:27.233 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T23:38:27.273 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T23:38:27.576 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T23:38:27.586 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T23:38:27.618 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T23:38:27.812 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T23:38:27.822 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:38:27.862 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:28.106 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T23:38:28.116 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T23:38:28.189 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T23:38:28.457 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T23:38:28.465 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:38:28.506 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:28.534 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T23:38:28.544 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T23:38:28.584 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T23:38:28.826 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T23:38:28.835 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T23:38:28.846 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package jq. 2024-04-26T23:38:28.856 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T23:38:28.876 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T23:38:28.895 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T23:38:29.123 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package socat. 2024-04-26T23:38:29.133 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T23:38:29.165 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T23:38:29.246 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T23:38:29.255 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T23:38:29.296 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T23:38:29.443 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T23:38:29.454 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T23:38:29.493 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T23:38:29.540 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package jq. 2024-04-26T23:38:29.550 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T23:38:29.589 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T23:38:29.818 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package socat. 2024-04-26T23:38:29.828 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T23:38:29.856 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-test. 2024-04-26T23:38:29.866 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:29.867 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T23:38:29.897 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:30.204 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T23:38:30.214 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T23:38:30.253 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T23:38:30.591 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-test. 2024-04-26T23:38:30.600 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:30.640 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:31.810 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T23:38:31.821 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:38:31.860 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:32.230 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-26T23:38:32.240 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:32.280 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:32.553 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T23:38:32.563 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:38:32.603 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:32.617 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-colorama. 2024-04-26T23:38:32.627 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-26T23:38:32.667 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-26T23:38:32.944 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package cephfs-shell. 2024-04-26T23:38:32.955 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:38:32.982 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-26T23:38:32.992 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:32.994 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:33.032 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:33.247 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package cephfs-top. 2024-04-26T23:38:33.258 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:38:33.296 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:33.377 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-colorama. 2024-04-26T23:38:33.387 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-26T23:38:33.426 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-26T23:38:33.516 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T23:38:33.527 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:33.565 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:33.696 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package cephfs-shell. 2024-04-26T23:38:33.706 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:38:33.746 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:33.869 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T23:38:33.883 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T23:38:33.927 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T23:38:33.990 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package cephfs-top. 2024-04-26T23:38:34.000 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:38:34.031 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:34.259 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T23:38:34.270 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:34.273 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T23:38:34.285 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T23:38:34.309 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:34.323 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T23:38:34.637 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T23:38:34.644 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T23:38:34.647 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T23:38:34.656 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T23:38:34.685 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T23:38:34.686 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T23:38:35.049 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T23:38:35.062 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T23:38:35.065 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package pkg-config. 2024-04-26T23:38:35.077 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T23:38:35.107 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T23:38:35.115 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T23:38:35.386 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T23:38:35.397 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T23:38:35.436 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T23:38:35.450 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T23:38:35.468 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T23:38:35.485 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T23:38:35.880 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T23:38:35.892 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T23:38:35.916 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package pkg-config. 2024-04-26T23:38:35.928 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T23:38:35.930 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T23:38:35.966 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T23:38:36.233 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T23:38:36.235 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T23:38:36.244 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T23:38:36.248 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T23:38:36.282 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T23:38:36.285 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T23:38:36.603 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T23:38:36.615 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T23:38:36.653 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T23:38:36.714 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T23:38:36.726 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T23:38:36.763 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T23:38:36.956 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T23:38:36.968 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T23:38:36.997 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T23:38:37.016 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T23:38:37.028 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T23:38:37.066 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T23:38:37.350 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-py. 2024-04-26T23:38:37.361 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-26T23:38:37.400 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T23:38:37.402 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T23:38:37.414 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T23:38:37.452 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T23:38:37.729 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T23:38:37.741 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T23:38:37.778 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T23:38:37.789 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T23:38:37.801 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T23:38:37.838 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T23:38:38.208 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-py. 2024-04-26T23:38:38.220 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-26T23:38:38.232 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T23:38:38.243 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T23:38:38.258 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T23:38:38.282 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T23:38:38.561 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T23:38:38.573 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T23:38:38.611 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T23:38:38.860 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-toml. 2024-04-26T23:38:38.872 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-26T23:38:38.910 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T23:38:39.065 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T23:38:39.076 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T23:38:39.115 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T23:38:39.196 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T23:38:39.209 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T23:38:39.246 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T23:38:39.401 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-toml. 2024-04-26T23:38:39.411 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-26T23:38:39.442 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T23:38:39.591 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T23:38:39.603 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T23:38:39.641 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T23:38:39.778 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T23:38:39.790 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T23:38:39.828 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T23:38:39.944 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T23:38:39.956 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T23:38:39.994 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T23:38:40.148 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T23:38:40.160 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T23:38:40.198 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T23:38:40.468 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T23:38:40.480 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T23:38:40.537 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T23:38:40.681 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package radosgw. 2024-04-26T23:38:40.692 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../122-radosgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:40.731 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:41.230 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package radosgw. 2024-04-26T23:38:41.240 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../122-radosgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:41.279 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:41.376 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T23:38:41.388 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:41.417 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:41.702 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T23:38:41.858 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T23:38:41.869 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:38:41.907 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:41.981 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T23:38:42.107 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T23:38:42.224 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T23:38:42.365 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T23:38:42.496 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T23:38:42.622 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T23:38:42.775 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T23:38:42.869 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T23:38:43.257 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T23:38:43.361 INFO:teuthology.orchestra.run.smithi170.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T23:38:43.404 INFO:teuthology.orchestra.run.smithi170.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-26T23:38:43.450 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:43.893 INFO:teuthology.orchestra.run.smithi137.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T23:38:43.935 INFO:teuthology.orchestra.run.smithi137.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-26T23:38:43.982 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:44.003 INFO:teuthology.orchestra.run.smithi170.stdout:Adding system user cephadm....done 2024-04-26T23:38:44.173 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T23:38:44.450 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T23:38:44.492 INFO:teuthology.orchestra.run.smithi137.stdout:Adding system user cephadm....done 2024-04-26T23:38:44.638 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T23:38:44.701 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T23:38:44.827 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T23:38:44.914 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T23:38:45.086 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T23:38:45.157 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T23:38:45.266 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T23:38:45.354 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T23:38:45.480 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T23:38:45.560 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T23:38:45.824 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T23:38:45.827 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T23:38:45.953 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T23:38:46.193 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T23:38:46.263 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T23:38:46.453 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-26T23:38:46.623 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T23:38:46.720 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T23:38:46.874 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-26T23:38:47.005 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T23:38:47.151 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T23:38:47.323 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T23:38:47.435 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T23:38:47.599 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T23:38:47.661 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T23:38:47.876 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T23:38:47.946 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T23:38:48.127 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:48.264 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T23:38:48.420 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T23:38:48.507 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:48.554 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T23:38:48.680 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-26T23:38:48.802 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T23:38:48.917 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T23:38:48.964 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T23:38:49.042 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-26T23:38:49.065 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T23:38:49.310 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T23:38:49.333 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T23:38:49.444 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T23:38:49.696 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T23:38:49.863 INFO:teuthology.orchestra.run.smithi170.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T23:38:49.923 INFO:teuthology.orchestra.run.smithi170.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T23:38:49.986 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T23:38:50.061 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T23:38:50.093 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T23:38:50.112 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T23:38:50.199 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T23:38:50.325 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T23:38:50.489 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T23:38:50.615 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T23:38:50.685 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T23:38:50.811 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T23:38:50.883 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T23:38:51.087 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T23:38:51.150 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T23:38:51.380 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T23:38:51.452 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T23:38:51.578 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T23:38:51.681 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T23:38:51.823 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T23:38:52.263 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T23:38:52.500 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T23:38:52.539 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T23:38:52.665 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T23:38:52.801 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T23:38:52.816 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T23:38:52.927 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T23:38:53.053 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T23:38:53.136 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T23:38:53.371 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T23:38:53.537 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T23:38:53.764 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T23:38:53.797 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T23:38:54.015 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T23:38:54.392 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T23:38:54.415 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T23:38:54.693 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-26T23:38:54.716 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-26T23:38:55.019 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T23:38:55.034 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T23:38:55.362 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T23:38:55.386 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T23:38:55.622 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T23:38:55.678 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T23:38:55.772 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:55.821 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:38:56.074 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T23:38:56.122 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T23:38:56.400 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T23:38:56.457 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T23:38:57.641 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T23:38:57.679 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T23:38:57.884 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:38:57.914 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:38:58.018 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T23:38:58.032 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T23:38:58.287 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T23:38:58.300 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T23:38:58.401 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T23:38:58.413 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T23:38:58.538 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T23:38:58.560 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T23:38:58.840 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T23:38:58.862 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T23:38:59.130 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T23:38:59.132 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T23:38:59.392 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:38:59.397 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:38:59.517 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T23:38:59.523 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T23:38:59.833 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T23:38:59.836 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T23:39:00.084 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T23:39:00.087 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T23:39:00.361 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T23:39:00.363 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T23:39:00.620 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T23:39:00.631 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T23:39:00.873 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T23:39:00.888 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T23:39:01.133 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T23:39:01.155 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T23:39:01.258 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T23:39:01.281 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T23:39:01.574 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T23:39:01.576 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T23:39:01.686 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T23:39:01.700 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T23:39:01.970 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T23:39:01.993 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T23:39:02.280 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T23:39:02.303 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T23:39:02.539 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T23:39:02.571 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T23:39:02.665 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T23:39:02.688 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T23:39:02.791 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T23:39:02.797 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T23:39:02.879 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T23:39:02.894 INFO:teuthology.orchestra.run.smithi170.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T23:39:03.118 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T23:39:03.133 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T23:39:03.244 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T23:39:03.258 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T23:39:03.637 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T23:39:03.660 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T23:39:03.897 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T23:39:03.937 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T23:39:04.006 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T23:39:04.062 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T23:39:04.248 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:39:04.355 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:39:04.383 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T23:39:04.456 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T23:39:04.709 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T23:39:04.766 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T23:39:05.018 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T23:39:05.075 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T23:39:05.286 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T23:39:05.360 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T23:39:05.489 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T23:39:05.563 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T23:39:05.757 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T23:39:05.831 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T23:39:06.033 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T23:39:06.091 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T23:39:06.326 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T23:39:06.359 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T23:39:06.711 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T23:39:06.744 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T23:39:07.004 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T23:39:07.037 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T23:39:07.357 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T23:39:07.398 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T23:39:07.483 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:07.524 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:07.609 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:07.633 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:07.751 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T23:39:07.768 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T23:39:08.088 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:08.104 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:08.214 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:08.214 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:08.315 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T23:39:08.340 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T23:39:08.591 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:08.650 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:08.717 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:08.776 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:08.843 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:08.918 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:09.034 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T23:39:09.034 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T23:39:09.138 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T23:39:09.138 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T23:39:09.703 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:09.804 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:09.812 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:09.930 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:09.930 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:10.064 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:10.081 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:10.198 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:10.215 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T23:39:10.324 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T23:39:11.494 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:11.603 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:11.603 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:11.729 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:11.762 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:11.847 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:11.888 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:11.948 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:12.023 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:12.066 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:12.149 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:12.192 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:12.668 INFO:teuthology.orchestra.run.smithi137.stdout:Adding group ceph....done 2024-04-26T23:39:12.720 INFO:teuthology.orchestra.run.smithi170.stdout:Adding group ceph....done 2024-04-26T23:39:12.986 INFO:teuthology.orchestra.run.smithi137.stdout:Adding system user ceph....done 2024-04-26T23:39:13.112 INFO:teuthology.orchestra.run.smithi170.stdout:Adding system user ceph....done 2024-04-26T23:39:13.155 INFO:teuthology.orchestra.run.smithi137.stdout:Setting system user ceph properties....done 2024-04-26T23:39:13.177 INFO:teuthology.orchestra.run.smithi137.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T23:39:13.281 INFO:teuthology.orchestra.run.smithi170.stdout:Setting system user ceph properties....done 2024-04-26T23:39:13.299 INFO:teuthology.orchestra.run.smithi170.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T23:39:13.323 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T23:39:13.442 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T23:39:13.718 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T23:39:13.815 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T23:39:14.583 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:14.593 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:14.793 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:39:14.793 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:39:14.806 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:39:14.806 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:39:15.417 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:15.480 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:15.543 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:15.682 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:16.112 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:39:16.112 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:39:16.320 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:39:16.320 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:39:16.754 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:16.974 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:17.093 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T23:39:17.384 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T23:39:17.772 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:17.987 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T23:39:17.987 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T23:39:18.127 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:18.349 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T23:39:18.349 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T23:39:18.615 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:18.827 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T23:39:18.827 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T23:39:18.962 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:19.174 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T23:39:19.175 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T23:39:19.467 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:19.761 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T23:39:19.762 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T23:39:20.192 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:20.402 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:20.528 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:20.533 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T23:39:20.533 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T23:39:20.670 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:20.888 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T23:39:20.888 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T23:39:21.158 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:21.276 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:21.419 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:21.538 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:21.626 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T23:39:21.626 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T23:39:21.681 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:21.807 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:21.950 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:22.279 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:22.310 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T23:39:22.411 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T23:39:22.413 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:22.514 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:22.563 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T23:39:22.648 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:39:23.001 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T23:39:23.135 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T23:39:23.270 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T23:39:23.714 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T23:39:24.054 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T23:39:24.432 INFO:teuthology.orchestra.run.smithi137.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T23:39:24.437 DEBUG:teuthology.orchestra.run.smithi137:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-26T23:39:24.511 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-04-26T23:39:24.685 INFO:teuthology.orchestra.run.smithi137.stdout:Building dependency tree... 2024-04-26T23:39:24.686 INFO:teuthology.orchestra.run.smithi137.stdout:Reading state information... 2024-04-26T23:39:24.810 INFO:teuthology.orchestra.run.smithi170.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T23:39:24.814 DEBUG:teuthology.orchestra.run.smithi170:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-26T23:39:24.859 INFO:teuthology.orchestra.run.smithi137.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-26T23:39:24.859 INFO:teuthology.orchestra.run.smithi137.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-26T23:39:24.859 INFO:teuthology.orchestra.run.smithi137.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-26T23:39:24.859 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T23:39:24.859 INFO:teuthology.orchestra.run.smithi137.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T23:39:24.859 INFO:teuthology.orchestra.run.smithi137.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T23:39:24.859 INFO:teuthology.orchestra.run.smithi137.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T23:39:24.860 INFO:teuthology.orchestra.run.smithi137.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T23:39:24.860 INFO:teuthology.orchestra.run.smithi137.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T23:39:24.860 INFO:teuthology.orchestra.run.smithi137.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T23:39:24.860 INFO:teuthology.orchestra.run.smithi137.stdout:The following additional packages will be installed: 2024-04-26T23:39:24.861 INFO:teuthology.orchestra.run.smithi137.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-26T23:39:24.861 INFO:teuthology.orchestra.run.smithi137.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-26T23:39:24.861 INFO:teuthology.orchestra.run.smithi137.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-26T23:39:24.861 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-26T23:39:24.861 INFO:teuthology.orchestra.run.smithi137.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T23:39:24.862 INFO:teuthology.orchestra.run.smithi137.stdout:Suggested packages: 2024-04-26T23:39:24.862 INFO:teuthology.orchestra.run.smithi137.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-26T23:39:24.863 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-26T23:39:24.863 INFO:teuthology.orchestra.run.smithi137.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-26T23:39:24.890 INFO:teuthology.orchestra.run.smithi170.stdout:Reading package lists... 2024-04-26T23:39:24.916 INFO:teuthology.orchestra.run.smithi137.stdout:The following NEW packages will be installed: 2024-04-26T23:39:24.917 INFO:teuthology.orchestra.run.smithi137.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-26T23:39:24.917 INFO:teuthology.orchestra.run.smithi137.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-26T23:39:24.917 INFO:teuthology.orchestra.run.smithi137.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-26T23:39:24.918 INFO:teuthology.orchestra.run.smithi137.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-26T23:39:24.918 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-26T23:39:24.918 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-26T23:39:24.918 INFO:teuthology.orchestra.run.smithi137.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T23:39:24.919 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages will be upgraded: 2024-04-26T23:39:24.920 INFO:teuthology.orchestra.run.smithi137.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-26T23:39:25.077 INFO:teuthology.orchestra.run.smithi170.stdout:Building dependency tree... 2024-04-26T23:39:25.078 INFO:teuthology.orchestra.run.smithi170.stdout:Reading state information... 2024-04-26T23:39:25.132 INFO:teuthology.orchestra.run.smithi137.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-26T23:39:25.132 INFO:teuthology.orchestra.run.smithi137.stdout:Need to get 55.7 MB of archives. 2024-04-26T23:39:25.132 INFO:teuthology.orchestra.run.smithi137.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-26T23:39:25.132 INFO:teuthology.orchestra.run.smithi137.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-26T23:39:25.256 INFO:teuthology.orchestra.run.smithi170.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-26T23:39:25.256 INFO:teuthology.orchestra.run.smithi170.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-26T23:39:25.256 INFO:teuthology.orchestra.run.smithi170.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-26T23:39:25.256 INFO:teuthology.orchestra.run.smithi170.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T23:39:25.256 INFO:teuthology.orchestra.run.smithi170.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T23:39:25.256 INFO:teuthology.orchestra.run.smithi170.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T23:39:25.256 INFO:teuthology.orchestra.run.smithi170.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T23:39:25.257 INFO:teuthology.orchestra.run.smithi170.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T23:39:25.257 INFO:teuthology.orchestra.run.smithi170.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T23:39:25.257 INFO:teuthology.orchestra.run.smithi170.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T23:39:25.258 INFO:teuthology.orchestra.run.smithi170.stdout:The following additional packages will be installed: 2024-04-26T23:39:25.258 INFO:teuthology.orchestra.run.smithi170.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-26T23:39:25.258 INFO:teuthology.orchestra.run.smithi170.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-26T23:39:25.258 INFO:teuthology.orchestra.run.smithi170.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-26T23:39:25.259 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-26T23:39:25.259 INFO:teuthology.orchestra.run.smithi170.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T23:39:25.260 INFO:teuthology.orchestra.run.smithi170.stdout:Suggested packages: 2024-04-26T23:39:25.260 INFO:teuthology.orchestra.run.smithi170.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-26T23:39:25.260 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-26T23:39:25.260 INFO:teuthology.orchestra.run.smithi170.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-26T23:39:25.314 INFO:teuthology.orchestra.run.smithi170.stdout:The following NEW packages will be installed: 2024-04-26T23:39:25.314 INFO:teuthology.orchestra.run.smithi170.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-26T23:39:25.315 INFO:teuthology.orchestra.run.smithi170.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-26T23:39:25.315 INFO:teuthology.orchestra.run.smithi170.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-26T23:39:25.315 INFO:teuthology.orchestra.run.smithi170.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-26T23:39:25.316 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-26T23:39:25.316 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-26T23:39:25.316 INFO:teuthology.orchestra.run.smithi170.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T23:39:25.317 INFO:teuthology.orchestra.run.smithi170.stdout:The following packages will be upgraded: 2024-04-26T23:39:25.317 INFO:teuthology.orchestra.run.smithi170.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-26T23:39:25.399 INFO:teuthology.orchestra.run.smithi170.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-26T23:39:25.399 INFO:teuthology.orchestra.run.smithi170.stdout:Need to get 55.7 MB of archives. 2024-04-26T23:39:25.399 INFO:teuthology.orchestra.run.smithi170.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-26T23:39:25.399 INFO:teuthology.orchestra.run.smithi170.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-26T23:39:25.651 INFO:teuthology.orchestra.run.smithi170.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-26T23:39:25.659 INFO:teuthology.orchestra.run.smithi170.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-26T23:39:25.728 INFO:teuthology.orchestra.run.smithi170.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-26T23:39:25.729 INFO:teuthology.orchestra.run.smithi170.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-26T23:39:25.730 INFO:teuthology.orchestra.run.smithi170.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-26T23:39:25.747 INFO:teuthology.orchestra.run.smithi170.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-26T23:39:25.749 INFO:teuthology.orchestra.run.smithi170.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-26T23:39:25.751 INFO:teuthology.orchestra.run.smithi170.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-26T23:39:25.753 INFO:teuthology.orchestra.run.smithi170.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-26T23:39:25.753 INFO:teuthology.orchestra.run.smithi170.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-26T23:39:25.755 INFO:teuthology.orchestra.run.smithi170.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-26T23:39:25.767 INFO:teuthology.orchestra.run.smithi170.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-26T23:39:25.782 INFO:teuthology.orchestra.run.smithi137.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-26T23:39:25.788 INFO:teuthology.orchestra.run.smithi170.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-26T23:39:25.788 INFO:teuthology.orchestra.run.smithi170.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-26T23:39:25.789 INFO:teuthology.orchestra.run.smithi170.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-26T23:39:25.839 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-26T23:39:26.295 INFO:teuthology.orchestra.run.smithi170.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-26T23:39:26.297 INFO:teuthology.orchestra.run.smithi170.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-26T23:39:26.297 INFO:teuthology.orchestra.run.smithi170.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-26T23:39:26.300 INFO:teuthology.orchestra.run.smithi170.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-26T23:39:26.301 INFO:teuthology.orchestra.run.smithi170.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-26T23:39:26.305 INFO:teuthology.orchestra.run.smithi170.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-26T23:39:26.306 INFO:teuthology.orchestra.run.smithi170.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-26T23:39:26.319 INFO:teuthology.orchestra.run.smithi170.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-26T23:39:26.320 INFO:teuthology.orchestra.run.smithi170.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-26T23:39:26.372 INFO:teuthology.orchestra.run.smithi170.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-26T23:39:26.377 INFO:teuthology.orchestra.run.smithi170.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-26T23:39:26.388 INFO:teuthology.orchestra.run.smithi170.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-26T23:39:26.478 INFO:teuthology.orchestra.run.smithi170.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-26T23:39:26.482 INFO:teuthology.orchestra.run.smithi170.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-26T23:39:26.483 INFO:teuthology.orchestra.run.smithi170.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-26T23:39:26.483 INFO:teuthology.orchestra.run.smithi170.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-26T23:39:26.484 INFO:teuthology.orchestra.run.smithi170.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-26T23:39:26.490 INFO:teuthology.orchestra.run.smithi137.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-26T23:39:26.492 INFO:teuthology.orchestra.run.smithi137.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-26T23:39:26.494 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-26T23:39:26.496 INFO:teuthology.orchestra.run.smithi170.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-26T23:39:26.499 INFO:teuthology.orchestra.run.smithi170.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-26T23:39:26.545 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-26T23:39:26.547 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-26T23:39:26.556 INFO:teuthology.orchestra.run.smithi137.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-26T23:39:26.562 INFO:teuthology.orchestra.run.smithi137.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-26T23:39:26.564 INFO:teuthology.orchestra.run.smithi137.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-26T23:39:26.733 INFO:teuthology.orchestra.run.smithi137.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-26T23:39:26.764 INFO:teuthology.orchestra.run.smithi170.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-26T23:39:26.764 INFO:teuthology.orchestra.run.smithi170.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-26T23:39:26.764 INFO:teuthology.orchestra.run.smithi170.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-26T23:39:26.765 INFO:teuthology.orchestra.run.smithi170.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-26T23:39:26.765 INFO:teuthology.orchestra.run.smithi170.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-26T23:39:26.765 INFO:teuthology.orchestra.run.smithi170.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-26T23:39:26.783 INFO:teuthology.orchestra.run.smithi170.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-26T23:39:26.783 INFO:teuthology.orchestra.run.smithi170.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-26T23:39:27.015 INFO:teuthology.orchestra.run.smithi137.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-26T23:39:27.025 INFO:teuthology.orchestra.run.smithi137.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-26T23:39:27.030 INFO:teuthology.orchestra.run.smithi137.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-26T23:39:27.118 INFO:teuthology.orchestra.run.smithi137.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-26T23:39:27.162 INFO:teuthology.orchestra.run.smithi170.stdout:Preconfiguring packages ... 2024-04-26T23:39:27.307 INFO:teuthology.orchestra.run.smithi170.stdout:Fetched 55.7 MB in 1s (38.2 MB/s) 2024-04-26T23:39:27.570 INFO:teuthology.orchestra.run.smithi170.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T23:39:27.574 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:39:27.716 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:39:28.089 INFO:teuthology.orchestra.run.smithi137.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-26T23:39:28.091 INFO:teuthology.orchestra.run.smithi137.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-26T23:39:28.091 INFO:teuthology.orchestra.run.smithi137.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-26T23:39:28.094 INFO:teuthology.orchestra.run.smithi137.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-26T23:39:28.094 INFO:teuthology.orchestra.run.smithi137.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-26T23:39:28.128 INFO:teuthology.orchestra.run.smithi137.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-26T23:39:28.293 INFO:teuthology.orchestra.run.smithi137.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-26T23:39:28.340 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-26T23:39:28.898 INFO:teuthology.orchestra.run.smithi137.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-26T23:39:28.898 INFO:teuthology.orchestra.run.smithi137.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-26T23:39:29.213 INFO:teuthology.orchestra.run.smithi137.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-26T23:39:29.213 INFO:teuthology.orchestra.run.smithi137.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-26T23:39:29.264 INFO:teuthology.orchestra.run.smithi137.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-26T23:39:29.327 INFO:teuthology.orchestra.run.smithi137.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-26T23:39:29.336 INFO:teuthology.orchestra.run.smithi137.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-26T23:39:29.337 INFO:teuthology.orchestra.run.smithi137.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-26T23:39:29.338 INFO:teuthology.orchestra.run.smithi137.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-26T23:39:29.338 INFO:teuthology.orchestra.run.smithi137.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-26T23:39:29.399 INFO:teuthology.orchestra.run.smithi170.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-26T23:39:29.536 INFO:teuthology.orchestra.run.smithi137.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-26T23:39:29.629 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package flex. 2024-04-26T23:39:29.700 INFO:teuthology.orchestra.run.smithi170.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T23:39:29.704 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-26T23:39:29.745 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-26T23:39:29.963 INFO:teuthology.orchestra.run.smithi137.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-26T23:39:30.231 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T23:39:30.426 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-26T23:39:30.700 INFO:teuthology.orchestra.run.smithi137.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-26T23:39:30.700 INFO:teuthology.orchestra.run.smithi137.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-26T23:39:30.700 INFO:teuthology.orchestra.run.smithi137.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-26T23:39:30.701 INFO:teuthology.orchestra.run.smithi137.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-26T23:39:30.701 INFO:teuthology.orchestra.run.smithi137.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-26T23:39:30.701 INFO:teuthology.orchestra.run.smithi137.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-26T23:39:30.740 INFO:teuthology.orchestra.run.smithi137.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-26T23:39:30.740 INFO:teuthology.orchestra.run.smithi137.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-26T23:39:30.841 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:39:31.118 INFO:teuthology.orchestra.run.smithi137.stdout:Preconfiguring packages ... 2024-04-26T23:39:31.272 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 55.7 MB in 6s (9,588 kB/s) 2024-04-26T23:39:31.391 INFO:teuthology.orchestra.run.smithi170.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T23:39:31.394 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:39:31.503 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T23:39:31.506 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:39:31.517 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:39:31.639 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:39:31.896 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:39:32.015 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:39:32.272 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-26T23:39:32.323 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T23:39:32.708 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package bison. 2024-04-26T23:39:32.782 INFO:teuthology.orchestra.run.smithi170.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T23:39:32.786 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-26T23:39:32.827 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T23:39:33.253 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-26T23:39:33.267 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-26T23:39:33.311 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T23:39:33.388 INFO:teuthology.orchestra.run.smithi137.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-26T23:39:33.648 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package dump. 2024-04-26T23:39:33.662 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-26T23:39:33.678 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package flex. 2024-04-26T23:39:33.706 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking dump (0.4b47-3) ... 2024-04-26T23:39:33.750 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T23:39:33.754 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-26T23:39:33.794 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-26T23:39:33.985 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package indent. 2024-04-26T23:39:34.000 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:39:34.043 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T23:39:34.289 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T23:39:34.304 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T23:39:34.320 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-26T23:39:34.363 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T23:39:34.558 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-26T23:39:34.708 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-26T23:39:34.724 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-26T23:39:34.758 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T23:39:34.923 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:39:35.011 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T23:39:35.027 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-26T23:39:35.103 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T23:39:35.440 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-26T23:39:35.456 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-26T23:39:35.489 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T23:39:35.493 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:39:35.498 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T23:39:35.624 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:39:35.767 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-26T23:39:35.783 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-26T23:39:35.826 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T23:39:36.028 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:39:36.100 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libjson-perl. 2024-04-26T23:39:36.116 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-26T23:39:36.162 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-26T23:39:36.164 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:39:36.474 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-26T23:39:36.479 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T23:39:36.490 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-26T23:39:36.532 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T23:39:36.857 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package bison. 2024-04-26T23:39:36.930 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T23:39:36.934 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-26T23:39:36.983 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T23:39:37.384 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-26T23:39:37.398 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-26T23:39:37.442 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T23:39:37.770 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package dump. 2024-04-26T23:39:37.785 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-26T23:39:37.820 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking dump (0.4b47-3) ... 2024-04-26T23:39:38.027 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-26T23:39:38.043 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T23:39:38.074 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package indent. 2024-04-26T23:39:38.076 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:39:38.089 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:39:38.132 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T23:39:38.304 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-26T23:39:38.320 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T23:39:38.354 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:39:38.393 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T23:39:38.409 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-26T23:39:38.452 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T23:39:38.649 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-26T23:39:38.664 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T23:39:38.707 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:39:38.747 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-26T23:39:38.763 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-26T23:39:38.805 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T23:39:39.033 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T23:39:39.049 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-26T23:39:39.077 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-26T23:39:39.091 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T23:39:39.093 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-26T23:39:39.135 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T23:39:39.428 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-26T23:39:39.430 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-26T23:39:39.444 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-26T23:39:39.446 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T23:39:39.486 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T23:39:39.488 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T23:39:39.756 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-26T23:39:39.771 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-26T23:39:39.814 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T23:39:39.825 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-26T23:39:39.840 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:39:39.891 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:39:40.084 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libjson-perl. 2024-04-26T23:39:40.099 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-26T23:39:40.133 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-26T23:39:40.227 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-26T23:39:40.243 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:39:40.286 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:39:40.437 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-26T23:39:40.453 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-26T23:39:40.512 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T23:39:40.589 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-26T23:39:40.605 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:39:40.647 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:39:40.891 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T23:39:40.907 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T23:39:40.950 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:39:41.447 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-26T23:39:41.463 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-26T23:39:41.505 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T23:39:41.865 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-26T23:39:41.881 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T23:39:41.883 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package modemmanager. 2024-04-26T23:39:41.899 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T23:39:41.924 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:39:41.941 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:39:42.160 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-26T23:39:42.175 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T23:39:42.209 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:39:42.499 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package network-manager. 2024-04-26T23:39:42.514 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T23:39:42.554 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-26T23:39:42.556 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-26T23:39:42.569 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T23:39:42.612 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:39:42.957 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-26T23:39:42.972 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-26T23:39:43.015 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T23:39:43.181 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ppp. 2024-04-26T23:39:43.196 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-26T23:39:43.351 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-26T23:39:43.367 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T23:39:43.401 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T23:39:43.520 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T23:39:43.712 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-26T23:39:43.728 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:39:43.771 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:39:43.835 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package pptp-linux. 2024-04-26T23:39:43.850 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-26T23:39:43.894 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-26T23:39:44.124 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-26T23:39:44.139 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:39:44.146 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-26T23:39:44.161 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-26T23:39:44.182 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:39:44.205 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-26T23:39:44.460 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-26T23:39:44.544 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-26T23:39:44.545 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-26T23:39:44.545 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:39:44.545 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:39:44.549 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking postgresql-client-common (238) ... 2024-04-26T23:39:44.754 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T23:39:44.769 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T23:39:44.820 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:39:44.845 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-26T23:39:44.860 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:39:44.903 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:39:45.332 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-26T23:39:45.347 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-26T23:39:45.390 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T23:39:45.475 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package postgresql-common. 2024-04-26T23:39:45.490 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-26T23:39:45.550 INFO:teuthology.orchestra.run.smithi170.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-26T23:39:45.581 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking postgresql-common (238) ... 2024-04-26T23:39:46.007 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package postgresql-14. 2024-04-26T23:39:46.022 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:39:46.068 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:39:46.237 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package modemmanager. 2024-04-26T23:39:46.253 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T23:39:46.287 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:39:46.952 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package network-manager. 2024-04-26T23:39:46.968 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T23:39:47.018 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-26T23:39:47.135 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package postgresql. 2024-04-26T23:39:47.150 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-26T23:39:47.193 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking postgresql (14+238) ... 2024-04-26T23:39:47.437 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package postgresql-client. 2024-04-26T23:39:47.451 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-26T23:39:47.495 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking postgresql-client (14+238) ... 2024-04-26T23:39:47.618 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ppp. 2024-04-26T23:39:47.633 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-26T23:39:47.722 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-26T23:39:47.737 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-26T23:39:47.789 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-26T23:39:47.973 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T23:39:48.133 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package tcl8.6. 2024-04-26T23:39:48.149 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-26T23:39:48.191 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T23:39:48.281 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package pptp-linux. 2024-04-26T23:39:48.295 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-26T23:39:48.339 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-26T23:39:48.427 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package tcl. 2024-04-26T23:39:48.443 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-26T23:39:48.490 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-26T23:39:48.591 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-26T23:39:48.606 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-26T23:39:48.650 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-26T23:39:48.822 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package wpasupplicant. 2024-04-26T23:39:48.838 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-26T23:39:48.880 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T23:39:48.978 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-26T23:39:48.993 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-26T23:39:49.036 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking postgresql-client-common (238) ... 2024-04-26T23:39:49.201 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-26T23:39:49.217 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-26T23:39:49.250 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-26T23:39:49.326 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-26T23:39:49.341 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:39:49.383 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:39:49.629 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-26T23:39:49.645 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-26T23:39:49.695 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T23:39:49.971 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package postgresql-common. 2024-04-26T23:39:49.981 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up postgresql-client-common (238) ... 2024-04-26T23:39:49.986 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-26T23:39:50.047 INFO:teuthology.orchestra.run.smithi137.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-26T23:39:50.069 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking postgresql-common (238) ... 2024-04-26T23:39:50.168 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-26T23:39:50.294 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T23:39:50.420 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:39:50.511 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package postgresql-14. 2024-04-26T23:39:50.526 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:39:50.546 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T23:39:50.564 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:39:51.089 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T23:39:51.215 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:39:51.631 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package postgresql. 2024-04-26T23:39:51.646 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-26T23:39:51.689 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking postgresql (14+238) ... 2024-04-26T23:39:51.933 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package postgresql-client. 2024-04-26T23:39:51.948 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-26T23:39:52.008 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking postgresql-client (14+238) ... 2024-04-26T23:39:52.165 INFO:teuthology.orchestra.run.smithi170.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-26T23:39:52.202 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-26T23:39:52.217 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-26T23:39:52.260 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-26T23:39:52.262 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T23:39:52.579 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package tcl8.6. 2024-04-26T23:39:52.595 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-26T23:39:52.637 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T23:39:52.676 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T23:39:52.676 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T23:39:52.957 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package tcl. 2024-04-26T23:39:52.973 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-26T23:39:53.019 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-26T23:39:53.335 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package wpasupplicant. 2024-04-26T23:39:53.348 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T23:39:53.351 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-26T23:39:53.384 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T23:39:53.474 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T23:39:53.600 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:39:53.747 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-26T23:39:53.751 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-26T23:39:53.763 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-26T23:39:53.805 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-26T23:39:53.877 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T23:39:54.053 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T23:39:54.171 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T23:39:54.175 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-26T23:39:54.191 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-26T23:39:54.241 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T23:39:54.280 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T23:39:54.552 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up postgresql-client-common (238) ... 2024-04-26T23:39:54.755 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-26T23:39:54.873 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T23:39:54.952 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T23:39:54.983 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:39:55.078 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up dump (0.4b47-3) ... 2024-04-26T23:39:55.109 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T23:39:55.198 INFO:teuthology.orchestra.run.smithi170.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-26T23:39:55.263 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:39:55.268 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T23:39:55.372 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T23:39:55.394 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:39:55.507 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-26T23:39:55.633 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-26T23:39:55.759 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T23:39:55.848 INFO:teuthology.orchestra.run.smithi170.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-26T23:39:55.918 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T23:39:56.345 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-26T23:39:56.411 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T23:39:56.620 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T23:39:56.725 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T23:39:56.747 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:39:56.873 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-26T23:39:57.041 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up postgresql-client (14+238) ... 2024-04-26T23:39:57.121 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T23:39:57.121 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T23:39:57.159 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-26T23:39:57.711 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:39:57.711 INFO:teuthology.orchestra.run.smithi170.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-26T23:39:57.711 INFO:teuthology.orchestra.run.smithi170.stdout:which means they are currently configured by ifupdown: 2024-04-26T23:39:57.711 INFO:teuthology.orchestra.run.smithi170.stdout:- enp3s0f1 2024-04-26T23:39:57.711 INFO:teuthology.orchestra.run.smithi170.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-26T23:39:57.711 INFO:teuthology.orchestra.run.smithi170.stdout:remove their configuration from /etc/network/interfaces. 2024-04-26T23:39:57.711 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:39:57.803 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T23:39:57.844 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-26T23:39:57.904 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T23:39:58.013 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:39:58.139 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-26T23:39:58.253 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-26T23:39:58.256 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T23:39:58.408 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T23:39:58.559 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T23:39:58.650 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-26T23:39:58.710 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T23:39:59.369 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:39:59.415 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T23:39:59.537 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T23:39:59.541 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up dump (0.4b47-3) ... 2024-04-26T23:39:59.636 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-26T23:39:59.663 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-26T23:39:59.701 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:39:59.789 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up postgresql-common (238) ... 2024-04-26T23:39:59.852 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T23:40:00.028 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-26T23:40:00.179 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-26T23:40:00.330 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T23:40:00.436 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-26T23:40:00.506 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T23:40:00.641 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T23:40:00.735 INFO:teuthology.orchestra.run.smithi170.stdout:Adding user postgres to group ssl-cert 2024-04-26T23:40:00.868 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T23:40:01.010 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:01.010 INFO:teuthology.orchestra.run.smithi170.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-26T23:40:01.018 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:40:01.186 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-26T23:40:01.275 INFO:teuthology.orchestra.run.smithi170.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-26T23:40:01.275 INFO:teuthology.orchestra.run.smithi170.stdout:Removing obsolete dictionary files: 2024-04-26T23:40:01.387 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up postgresql-client (14+238) ... 2024-04-26T23:40:01.538 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-26T23:40:01.997 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-26T23:40:02.188 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:02.188 INFO:teuthology.orchestra.run.smithi137.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-26T23:40:02.188 INFO:teuthology.orchestra.run.smithi137.stdout:which means they are currently configured by ifupdown: 2024-04-26T23:40:02.188 INFO:teuthology.orchestra.run.smithi137.stdout:- enp3s0f1 2024-04-26T23:40:02.188 INFO:teuthology.orchestra.run.smithi137.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-26T23:40:02.188 INFO:teuthology.orchestra.run.smithi137.stdout:remove their configuration from /etc/network/interfaces. 2024-04-26T23:40:02.188 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:02.320 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-26T23:40:02.566 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:40:02.718 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-26T23:40:02.905 INFO:teuthology.orchestra.run.smithi170.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-26T23:40:02.920 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-26T23:40:02.983 INFO:teuthology.orchestra.run.smithi170.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-26T23:40:02.983 INFO:teuthology.orchestra.run.smithi170.stdout:This user must also own the server process. 2024-04-26T23:40:02.983 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:02.983 INFO:teuthology.orchestra.run.smithi170.stdout:The database cluster will be initialized with locale "en_US". 2024-04-26T23:40:02.983 INFO:teuthology.orchestra.run.smithi170.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-26T23:40:02.983 INFO:teuthology.orchestra.run.smithi170.stdout:The default text search configuration will be set to "english". 2024-04-26T23:40:02.984 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:02.984 INFO:teuthology.orchestra.run.smithi170.stdout:Data page checksums are disabled. 2024-04-26T23:40:02.984 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:02.984 INFO:teuthology.orchestra.run.smithi170.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-26T23:40:02.984 INFO:teuthology.orchestra.run.smithi170.stdout:creating subdirectories ... ok 2024-04-26T23:40:02.985 INFO:teuthology.orchestra.run.smithi170.stdout:selecting dynamic shared memory implementation ... posix 2024-04-26T23:40:03.009 INFO:teuthology.orchestra.run.smithi170.stdout:selecting default max_connections ... 100 2024-04-26T23:40:03.043 INFO:teuthology.orchestra.run.smithi170.stdout:selecting default shared_buffers ... 128MB 2024-04-26T23:40:03.057 INFO:teuthology.orchestra.run.smithi170.stdout:selecting default time zone ... Etc/UTC 2024-04-26T23:40:03.058 INFO:teuthology.orchestra.run.smithi170.stdout:creating configuration files ... ok 2024-04-26T23:40:03.131 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-26T23:40:03.223 INFO:teuthology.orchestra.run.smithi170.stdout:running bootstrap script ... ok 2024-04-26T23:40:03.850 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:40:03.857 INFO:teuthology.orchestra.run.smithi170.stdout:performing post-bootstrap initialization ... ok 2024-04-26T23:40:04.043 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T23:40:04.194 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-26T23:40:04.345 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up postgresql-common (238) ... 2024-04-26T23:40:04.400 INFO:teuthology.orchestra.run.smithi170.stdout:syncing data to disk ... ok 2024-04-26T23:40:04.926 INFO:teuthology.orchestra.run.smithi170.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-26T23:40:05.368 INFO:teuthology.orchestra.run.smithi137.stdout:Adding user postgres to group ssl-cert 2024-04-26T23:40:05.619 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:05.619 INFO:teuthology.orchestra.run.smithi137.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-26T23:40:05.870 INFO:teuthology.orchestra.run.smithi137.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-26T23:40:05.870 INFO:teuthology.orchestra.run.smithi137.stdout:Removing obsolete dictionary files: 2024-04-26T23:40:06.598 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-26T23:40:07.037 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:40:07.394 INFO:teuthology.orchestra.run.smithi137.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-26T23:40:07.409 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-26T23:40:07.466 INFO:teuthology.orchestra.run.smithi137.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-26T23:40:07.466 INFO:teuthology.orchestra.run.smithi137.stdout:This user must also own the server process. 2024-04-26T23:40:07.466 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:07.466 INFO:teuthology.orchestra.run.smithi137.stdout:The database cluster will be initialized with locale "en_US". 2024-04-26T23:40:07.466 INFO:teuthology.orchestra.run.smithi137.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-26T23:40:07.466 INFO:teuthology.orchestra.run.smithi137.stdout:The default text search configuration will be set to "english". 2024-04-26T23:40:07.466 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:07.466 INFO:teuthology.orchestra.run.smithi137.stdout:Data page checksums are disabled. 2024-04-26T23:40:07.466 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:07.466 INFO:teuthology.orchestra.run.smithi137.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-26T23:40:07.467 INFO:teuthology.orchestra.run.smithi137.stdout:creating subdirectories ... ok 2024-04-26T23:40:07.467 INFO:teuthology.orchestra.run.smithi137.stdout:selecting dynamic shared memory implementation ... posix 2024-04-26T23:40:07.490 INFO:teuthology.orchestra.run.smithi137.stdout:selecting default max_connections ... 100 2024-04-26T23:40:07.524 INFO:teuthology.orchestra.run.smithi137.stdout:selecting default shared_buffers ... 128MB 2024-04-26T23:40:07.537 INFO:teuthology.orchestra.run.smithi137.stdout:selecting default time zone ... Etc/UTC 2024-04-26T23:40:07.538 INFO:teuthology.orchestra.run.smithi137.stdout:creating configuration files ... ok 2024-04-26T23:40:07.702 INFO:teuthology.orchestra.run.smithi137.stdout:running bootstrap script ... ok 2024-04-26T23:40:07.965 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:40:08.083 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-26T23:40:08.217 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up postgresql (14+238) ... 2024-04-26T23:40:08.329 INFO:teuthology.orchestra.run.smithi137.stdout:performing post-bootstrap initialization ... ok 2024-04-26T23:40:08.343 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:40:08.469 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:40:08.728 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T23:40:08.728 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T23:40:08.902 INFO:teuthology.orchestra.run.smithi137.stdout:syncing data to disk ... ok 2024-04-26T23:40:09.414 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-26T23:40:09.471 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T23:40:09.580 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-26T23:40:09.916 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T23:40:10.059 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T23:40:11.403 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-26T23:40:11.495 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T23:40:12.023 INFO:teuthology.orchestra.run.smithi170.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T23:40:12.031 DEBUG:teuthology.parallel:result is None 2024-04-26T23:40:12.478 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:40:12.605 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-26T23:40:12.730 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up postgresql (14+238) ... 2024-04-26T23:40:12.889 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:40:13.016 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:40:13.277 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T23:40:13.277 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T23:40:14.018 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T23:40:14.110 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-26T23:40:14.496 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T23:40:14.648 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T23:40:16.085 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-26T23:40:16.176 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T23:40:16.699 INFO:teuthology.orchestra.run.smithi137.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T23:40:16.705 DEBUG:teuthology.parallel:result is None 2024-04-26T23:40:16.706 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:40:16.854 DEBUG:teuthology.orchestra.run.smithi137:> dpkg-query -W -f '${Version}' ceph 2024-04-26T23:40:16.875 INFO:teuthology.orchestra.run.smithi137.stdout:19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:40:16.875 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:40:16.875 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306-gbc612ffb-1jammy is installed. 2024-04-26T23:40:16.877 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:40:17.095 DEBUG:teuthology.orchestra.run.smithi170:> dpkg-query -W -f '${Version}' ceph 2024-04-26T23:40:17.120 INFO:teuthology.orchestra.run.smithi170.stdout:19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:40:17.120 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:40:17.120 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306-gbc612ffb-1jammy is installed. 2024-04-26T23:40:17.121 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T23:40:17.122 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:17.122 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T23:40:17.141 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:40:17.141 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T23:40:17.182 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T23:40:17.182 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:17.183 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T23:40:17.206 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T23:40:17.270 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:40:17.270 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T23:40:17.291 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T23:40:17.353 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T23:40:17.353 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:17.353 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T23:40:17.372 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T23:40:17.434 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:40:17.434 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T23:40:17.454 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T23:40:17.516 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T23:40:17.516 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:17.517 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T23:40:17.535 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T23:40:17.598 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:40:17.598 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T23:40:17.619 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T23:40:17.685 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T23:40:17.768 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T23:40:17.768 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 777 /var/log/ceph 2024-04-26T23:40:17.771 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 777 /var/log/ceph 2024-04-26T23:40:17.791 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T23:40:17.792 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T23:40:17.834 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T23:40:17.857 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T23:40:17.857 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T23:40:17.894 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T23:40:17.927 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-26T23:40:17.927 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-26T23:40:17.927 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-26T23:40:17.928 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:17.928 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T23:40:17.964 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T23:40:18.051 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:40:18.052 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T23:40:18.060 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T23:40:18.155 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T23:40:18.155 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'client session with non-allowable root'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T23:40:18.155 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675320', 'branch': 'wip-rishabh-testing-20240426.111959', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/sessionmap}', 'email': None, 'first_in_suite': False, 'job_id': '7675320', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240426.111959'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'client session with non-allowable root'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240426.111959', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 816, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'sleep_before_teardown': 0, 'subset': '166/512', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240426.111959', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi137.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIHNbNMXt9RcIZmJG2VcLv075LWZCe3nmIPXJpkY9tilmXW5o7JB6QwrSYD28Ecz5MtItiEgX0K6p15TFi4egsQ=', 'smithi170.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCekY1twoglNRLendcsrWI0NZUuvy57BUZ+r0FTVkzKnuAA/UN5Aq/ai/nJ+KlJldhm+eK4FM3vBlZ2iQUtv9tc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'client session with non-allowable root'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_sessionmap']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-26_19:30:57', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T23:40:18.156 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T23:40:18.159 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T23:40:18.167 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T23:40:18.206 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T23:40:18.232 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:18.232 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T23:40:18.272 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T23:40:18.272 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_1 2024-04-26T23:40:18.320 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T23:40:18.320 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:40:18.320 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 886 Links: 1 2024-04-26T23:40:18.320 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:40:18.320 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-26 23:33:53.879588397 +0000 2024-04-26T23:40:18.320 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-26 23:33:53.599590897 +0000 2024-04-26T23:40:18.320 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-26 23:33:53.599590897 +0000 2024-04-26T23:40:18.321 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-04-26 23:33:53.599590897 +0000 2024-04-26T23:40:18.321 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T23:40:18.380 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-26T23:40:18.380 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-26T23:40:18.381 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000379367 s, 1.3 MB/s 2024-04-26T23:40:18.382 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T23:40:18.433 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_2 2024-04-26T23:40:18.484 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T23:40:18.484 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:40:18.484 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 901 Links: 1 2024-04-26T23:40:18.484 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:40:18.484 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-26 23:33:54.507582787 +0000 2024-04-26T23:40:18.484 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-26 23:33:54.231585253 +0000 2024-04-26T23:40:18.484 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-26 23:33:54.231585253 +0000 2024-04-26T23:40:18.484 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-04-26 23:33:54.231585253 +0000 2024-04-26T23:40:18.484 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T23:40:18.540 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-26T23:40:18.540 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-26T23:40:18.540 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000344075 s, 1.5 MB/s 2024-04-26T23:40:18.542 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T23:40:18.593 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_3 2024-04-26T23:40:18.644 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T23:40:18.644 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:40:18.644 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 919 Links: 1 2024-04-26T23:40:18.644 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:40:18.644 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-26 23:33:55.043578000 +0000 2024-04-26T23:40:18.644 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-26 23:33:54.771580429 +0000 2024-04-26T23:40:18.644 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-26 23:33:54.771580429 +0000 2024-04-26T23:40:18.644 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-04-26 23:33:54.771580429 +0000 2024-04-26T23:40:18.645 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T23:40:18.701 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-26T23:40:18.701 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-26T23:40:18.701 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.00031802 s, 1.6 MB/s 2024-04-26T23:40:18.702 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T23:40:18.753 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_4 2024-04-26T23:40:18.804 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T23:40:18.804 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:40:18.804 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 938 Links: 1 2024-04-26T23:40:18.804 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:40:18.804 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-26 23:33:55.651572569 +0000 2024-04-26T23:40:18.804 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-26 23:33:55.367575105 +0000 2024-04-26T23:40:18.804 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-26 23:33:55.367575105 +0000 2024-04-26T23:40:18.804 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-04-26 23:33:55.367575105 +0000 2024-04-26T23:40:18.805 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T23:40:18.864 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-26T23:40:18.864 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-26T23:40:18.864 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000380688 s, 1.3 MB/s 2024-04-26T23:40:18.866 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T23:40:18.917 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:40:18.917 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:40:18.917 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T23:40:18.926 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T23:40:18.926 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_1 2024-04-26T23:40:18.977 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T23:40:18.977 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:40:18.977 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 6h/6d Inode: 891 Links: 1 2024-04-26T23:40:18.978 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:40:18.978 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-04-26 23:33:42.509132786 +0000 2024-04-26T23:40:18.978 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-04-26 23:33:42.213135425 +0000 2024-04-26T23:40:18.978 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-04-26 23:33:42.213135425 +0000 2024-04-26T23:40:18.978 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-04-26 23:33:42.213135425 +0000 2024-04-26T23:40:18.978 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T23:40:19.039 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-04-26T23:40:19.039 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-04-26T23:40:19.039 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000274746 s, 1.9 MB/s 2024-04-26T23:40:19.041 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T23:40:19.099 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_2 2024-04-26T23:40:19.149 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T23:40:19.149 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:40:19.149 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 6h/6d Inode: 906 Links: 1 2024-04-26T23:40:19.149 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:40:19.149 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-04-26 23:33:42.773130431 +0000 2024-04-26T23:40:19.150 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-04-26 23:33:42.769130466 +0000 2024-04-26T23:40:19.150 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-04-26 23:33:42.769130466 +0000 2024-04-26T23:40:19.150 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-04-26 23:33:42.769130466 +0000 2024-04-26T23:40:19.150 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T23:40:19.211 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-04-26T23:40:19.211 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-04-26T23:40:19.211 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000321409 s, 1.6 MB/s 2024-04-26T23:40:19.213 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T23:40:19.267 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_3 2024-04-26T23:40:19.317 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T23:40:19.317 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:40:19.318 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 6h/6d Inode: 926 Links: 1 2024-04-26T23:40:19.318 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:40:19.318 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-04-26 23:33:43.557123437 +0000 2024-04-26T23:40:19.318 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-04-26 23:33:43.305125684 +0000 2024-04-26T23:40:19.318 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-04-26 23:33:43.305125684 +0000 2024-04-26T23:40:19.318 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-04-26 23:33:43.305125684 +0000 2024-04-26T23:40:19.318 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T23:40:19.379 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-04-26T23:40:19.379 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-04-26T23:40:19.379 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000275908 s, 1.9 MB/s 2024-04-26T23:40:19.381 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T23:40:19.435 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_4 2024-04-26T23:40:19.485 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T23:40:19.485 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:40:19.485 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 6h/6d Inode: 943 Links: 1 2024-04-26T23:40:19.485 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:40:19.485 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-04-26 23:33:44.065118905 +0000 2024-04-26T23:40:19.485 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-04-26 23:33:43.797121296 +0000 2024-04-26T23:40:19.485 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-04-26 23:33:43.797121296 +0000 2024-04-26T23:40:19.485 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-04-26 23:33:43.797121296 +0000 2024-04-26T23:40:19.486 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T23:40:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-04-26T23:40:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-04-26T23:40:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000268753 s, 1.9 MB/s 2024-04-26T23:40:19.549 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T23:40:19.603 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:40:19.603 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T23:40:19.603 INFO:tasks.ceph:Generating config... 2024-04-26T23:40:19.605 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-26T23:40:19.605 INFO:tasks.ceph:[client] debug client = 20 2024-04-26T23:40:19.605 INFO:tasks.ceph:[client] debug ms = 1 2024-04-26T23:40:19.605 INFO:tasks.ceph:[client] pid file = 2024-04-26T23:40:19.605 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-26T23:40:19.605 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-26T23:40:19.605 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-26T23:40:19.605 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-26T23:40:19.606 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-26T23:40:19.606 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-26T23:40:19.606 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-26T23:40:19.606 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-26T23:40:19.606 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-26T23:40:19.606 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-26T23:40:19.606 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-26T23:40:19.606 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-26T23:40:19.606 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-26T23:40:19.606 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T23:40:19.606 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T23:40:19.606 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T23:40:19.606 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T23:40:19.606 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T23:40:19.607 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-26T23:40:19.607 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-26T23:40:19.607 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-26T23:40:19.607 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-26T23:40:19.607 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-26T23:40:19.607 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T23:40:19.607 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T23:40:19.607 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T23:40:19.608 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T23:40:19.608 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T23:40:19.608 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T23:40:19.608 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T23:40:19.608 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T23:40:19.608 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T23:40:19.608 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T23:40:19.609 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T23:40:19.609 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T23:40:19.609 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-26T23:40:19.609 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T23:40:19.609 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T23:40:19.652 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T23:40:19.666 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T23:40:19.754 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T23:40:19.815 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.137'), ('mon.b', '172.21.15.170'), ('mon.c', '[v2:172.21.15.170:3301,v1:172.21.15.170:6790]')] 2024-04-26T23:40:19.815 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.137,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-26T23:40:19.816 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:19.816 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T23:40:19.864 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.137 --add b 172.21.15.170 --addv c '[v2:172.21.15.170:3301,v1:172.21.15.170:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:40:19.950 INFO:teuthology.orchestra.run.smithi137.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:40:19.950 INFO:teuthology.orchestra.run.smithi137.stdout:monmaptool: generated fsid efde6204-be0d-4c4f-9ea0-954d26627e78 2024-04-26T23:40:19.950 INFO:teuthology.orchestra.run.smithi137.stdout:setting min_mon_release = quincy 2024-04-26T23:40:19.950 INFO:teuthology.orchestra.run.smithi137.stdout:epoch 0 2024-04-26T23:40:19.950 INFO:teuthology.orchestra.run.smithi137.stdout:fsid efde6204-be0d-4c4f-9ea0-954d26627e78 2024-04-26T23:40:19.950 INFO:teuthology.orchestra.run.smithi137.stdout:last_changed 2024-04-26T23:40:19.951239+0000 2024-04-26T23:40:19.950 INFO:teuthology.orchestra.run.smithi137.stdout:created 2024-04-26T23:40:19.951239+0000 2024-04-26T23:40:19.951 INFO:teuthology.orchestra.run.smithi137.stdout:min_mon_release 17 (quincy) 2024-04-26T23:40:19.951 INFO:teuthology.orchestra.run.smithi137.stdout:election_strategy: 1 2024-04-26T23:40:19.951 INFO:teuthology.orchestra.run.smithi137.stdout:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-04-26T23:40:19.951 INFO:teuthology.orchestra.run.smithi137.stdout:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-04-26T23:40:19.951 INFO:teuthology.orchestra.run.smithi137.stdout:2: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2024-04-26T23:40:19.951 INFO:teuthology.orchestra.run.smithi137.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T23:40:19.953 DEBUG:teuthology.orchestra.run.smithi137:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T23:40:19.960 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID efde6204-be0d-4c4f-9ea0-954d26627e78... 2024-04-26T23:40:19.961 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T23:40:20.007 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T23:40:20.046 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2024-04-26T23:40:20.046 INFO:teuthology.orchestra.run.smithi137.stdout: chdir = "" 2024-04-26T23:40:20.046 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T23:40:20.046 INFO:teuthology.orchestra.run.smithi137.stdout: auth supported = cephx 2024-04-26T23:40:20.046 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.046 INFO:teuthology.orchestra.run.smithi137.stdout: filestore xattr use omap = true 2024-04-26T23:40:20.046 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.046 INFO:teuthology.orchestra.run.smithi137.stdout: mon clock drift allowed = 1.000 2024-04-26T23:40:20.046 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.046 INFO:teuthology.orchestra.run.smithi137.stdout: osd crush chooseleaf type = 0 2024-04-26T23:40:20.047 INFO:teuthology.orchestra.run.smithi137.stdout: auth debug = true 2024-04-26T23:40:20.047 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.047 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on old message = true 2024-04-26T23:40:20.047 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on bug = true 2024-04-26T23:40:20.047 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.047 INFO:teuthology.orchestra.run.smithi137.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T23:40:20.047 INFO:teuthology.orchestra.run.smithi137.stdout: mon pg warn max object skew = 0 2024-04-26T23:40:20.047 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.047 INFO:teuthology.orchestra.run.smithi137.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T23:40:20.047 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T23:40:20.047 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.047 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default size = 2 2024-04-26T23:40:20.047 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.047 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow primary affinity = true 2024-04-26T23:40:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow pg remap = true 2024-04-26T23:40:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on legacy crush tunables = false 2024-04-26T23:40:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on crush straw calc version zero = false 2024-04-26T23:40:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on no sortbitwise = false 2024-04-26T23:40:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on osd down out interval zero = false 2024-04-26T23:40:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on too few osds = false 2024-04-26T23:40:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T23:40:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T23:40:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: mon_allow_pool_size_one = true 2024-04-26T23:40:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T23:40:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: osd default data pool replay window = 5 2024-04-26T23:40:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: mon allow pool delete = true 2024-04-26T23:40:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: mon cluster log file level = debug 2024-04-26T23:40:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: debug asserts on shutdown = true 2024-04-26T23:40:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: mon health detail to clog = false 2024-04-26T23:40:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: mon host = "172.21.15.137,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]" 2024-04-26T23:40:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = efde6204-be0d-4c4f-9ea0-954d26627e78 2024-04-26T23:40:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.049 INFO:teuthology.orchestra.run.smithi137.stdout:[osd] 2024-04-26T23:40:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: osd journal size = 100 2024-04-26T23:40:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub load threshold = 5.0 2024-04-26T23:40:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub max interval = 600 2024-04-26T23:40:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: osd mclock profile = high_recovery_ops 2024-04-26T23:40:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: osd recover clone overlap = true 2024-04-26T23:40:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: osd recovery max chunk = 1048576 2024-04-26T23:40:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug shutdown = true 2024-04-26T23:40:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug op order = true 2024-04-26T23:40:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify stray on activate = true 2024-04-26T23:40:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug trim objects = true 2024-04-26T23:40:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: osd open classes on start = true 2024-04-26T23:40:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug pg log writeout = true 2024-04-26T23:40:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: osd deep scrub update digest min age = 30 2024-04-26T23:40:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: osd map max advance = 10 2024-04-26T23:40:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: journal zero on create = true 2024-04-26T23:40:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.051 INFO:teuthology.orchestra.run.smithi137.stdout: filestore ondisk finisher threads = 3 2024-04-26T23:40:20.051 INFO:teuthology.orchestra.run.smithi137.stdout: filestore apply finisher threads = 3 2024-04-26T23:40:20.051 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.051 INFO:teuthology.orchestra.run.smithi137.stdout: bdev debug aio = true 2024-04-26T23:40:20.051 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug misdirected ops = true 2024-04-26T23:40:20.051 INFO:teuthology.orchestra.run.smithi137.stdout: bdev async discard = True 2024-04-26T23:40:20.051 INFO:teuthology.orchestra.run.smithi137.stdout: bdev enable discard = True 2024-04-26T23:40:20.051 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore allocator = bitmap 2024-04-26T23:40:20.051 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore block size = 96636764160 2024-04-26T23:40:20.051 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore fsck on mount = True 2024-04-26T23:40:20.052 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluefs = 1/20 2024-04-26T23:40:20.052 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluestore = 1/20 2024-04-26T23:40:20.052 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T23:40:20.052 INFO:teuthology.orchestra.run.smithi137.stdout: debug osd = 20 2024-04-26T23:40:20.052 INFO:teuthology.orchestra.run.smithi137.stdout: debug rocksdb = 4/10 2024-04-26T23:40:20.052 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T23:40:20.052 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd full ratio = 0.9 2024-04-26T23:40:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd nearfull ratio = 0.8 2024-04-26T23:40:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: osd failsafe full ratio = 0.95 2024-04-26T23:40:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: osd objectstore = bluestore 2024-04-26T23:40:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-04-26T23:40:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.053 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr] 2024-04-26T23:40:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T23:40:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: debug mgr = 20 2024-04-26T23:40:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-04-26T23:40:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-04-26T23:40:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:40:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:40:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: mgr/telemetry/nag = false 2024-04-26T23:40:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-04-26T23:40:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.054 INFO:teuthology.orchestra.run.smithi137.stdout:[mon] 2024-04-26T23:40:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T23:40:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-04-26T23:40:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: debug paxos = 20 2024-04-26T23:40:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-04-26T23:40:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: mon data avail warn = 5 2024-04-26T23:40:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: mon mgr mkfs grace = 240 2024-04-26T23:40:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:40:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd reporter subtree level = osd 2024-04-26T23:40:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd prime pg temp = true 2024-04-26T23:40:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:40:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T23:40:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T23:40:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T23:40:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T23:40:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T23:40:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T23:40:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: # 1m isn't quite enough 2024-04-26T23:40:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: mon_down_mkfs_grace = 2m 2024-04-26T23:40:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_filestore_osds = false 2024-04-26T23:40:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: mon down mkfs grace = 300 2024-04-26T23:40:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: mon op complaint time = 120 2024-04-26T23:40:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:40:20.055 INFO:teuthology.orchestra.run.smithi137.stdout:[client] 2024-04-26T23:40:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: rgw cache enabled = true 2024-04-26T23:40:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable ops log = true 2024-04-26T23:40:20.056 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable usage log = true 2024-04-26T23:40:20.056 INFO:teuthology.orchestra.run.smithi137.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T23:40:20.056 INFO:teuthology.orchestra.run.smithi137.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T23:40:20.056 INFO:teuthology.orchestra.run.smithi137.stdout: client mount timeout = 600 2024-04-26T23:40:20.056 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-04-26T23:40:20.056 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T23:40:20.056 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = "" 2024-04-26T23:40:20.056 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-04-26T23:40:20.056 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-04-26T23:40:20.056 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.a] 2024-04-26T23:40:20.056 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.b] 2024-04-26T23:40:20.056 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.c] 2024-04-26T23:40:20.056 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2024-04-26T23:40:20.056 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2024-04-26T23:40:20.056 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2024-04-26T23:40:20.056 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d] 2024-04-26T23:40:20.057 INFO:teuthology.orchestra.run.smithi137.stdout:[mds] 2024-04-26T23:40:20.057 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds = 20 2024-04-26T23:40:20.057 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds balancer = 20 2024-04-26T23:40:20.057 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T23:40:20.057 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug frag = True 2024-04-26T23:40:20.057 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug scatterstat = True 2024-04-26T23:40:20.057 INFO:teuthology.orchestra.run.smithi137.stdout: mds op complaint time = 180 2024-04-26T23:40:20.057 INFO:teuthology.orchestra.run.smithi137.stdout: mds verify scatter = True 2024-04-26T23:40:20.057 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-04-26T23:40:20.057 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-04-26T23:40:20.057 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-04-26T23:40:20.057 INFO:teuthology.orchestra.run.smithi170.stdout:[global] 2024-04-26T23:40:20.058 INFO:teuthology.orchestra.run.smithi170.stdout: chdir = "" 2024-04-26T23:40:20.058 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T23:40:20.058 INFO:teuthology.orchestra.run.smithi170.stdout: auth supported = cephx 2024-04-26T23:40:20.058 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.058 INFO:teuthology.orchestra.run.smithi170.stdout: filestore xattr use omap = true 2024-04-26T23:40:20.058 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.058 INFO:teuthology.orchestra.run.smithi170.stdout: mon clock drift allowed = 1.000 2024-04-26T23:40:20.058 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.058 INFO:teuthology.orchestra.run.smithi170.stdout: osd crush chooseleaf type = 0 2024-04-26T23:40:20.058 INFO:teuthology.orchestra.run.smithi170.stdout: auth debug = true 2024-04-26T23:40:20.058 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.058 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on old message = true 2024-04-26T23:40:20.058 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on bug = true 2024-04-26T23:40:20.058 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.058 INFO:teuthology.orchestra.run.smithi170.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T23:40:20.059 INFO:teuthology.orchestra.run.smithi170.stdout: mon pg warn max object skew = 0 2024-04-26T23:40:20.059 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.059 INFO:teuthology.orchestra.run.smithi170.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T23:40:20.059 INFO:teuthology.orchestra.run.smithi170.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T23:40:20.059 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.059 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default size = 2 2024-04-26T23:40:20.059 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.059 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow primary affinity = true 2024-04-26T23:40:20.059 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow pg remap = true 2024-04-26T23:40:20.059 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on legacy crush tunables = false 2024-04-26T23:40:20.059 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on crush straw calc version zero = false 2024-04-26T23:40:20.059 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on no sortbitwise = false 2024-04-26T23:40:20.059 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on osd down out interval zero = false 2024-04-26T23:40:20.059 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on too few osds = false 2024-04-26T23:40:20.059 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T23:40:20.059 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T23:40:20.060 INFO:teuthology.orchestra.run.smithi170.stdout: mon_allow_pool_size_one = true 2024-04-26T23:40:20.060 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.060 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T23:40:20.060 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.060 INFO:teuthology.orchestra.run.smithi170.stdout: osd default data pool replay window = 5 2024-04-26T23:40:20.060 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.060 INFO:teuthology.orchestra.run.smithi170.stdout: mon allow pool delete = true 2024-04-26T23:40:20.060 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.060 INFO:teuthology.orchestra.run.smithi170.stdout: mon cluster log file level = debug 2024-04-26T23:40:20.060 INFO:teuthology.orchestra.run.smithi170.stdout: debug asserts on shutdown = true 2024-04-26T23:40:20.060 INFO:teuthology.orchestra.run.smithi170.stdout: mon health detail to clog = false 2024-04-26T23:40:20.060 INFO:teuthology.orchestra.run.smithi170.stdout: mon host = "172.21.15.137,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]" 2024-04-26T23:40:20.060 INFO:teuthology.orchestra.run.smithi170.stdout: fsid = efde6204-be0d-4c4f-9ea0-954d26627e78 2024-04-26T23:40:20.060 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.060 INFO:teuthology.orchestra.run.smithi170.stdout:[osd] 2024-04-26T23:40:20.061 INFO:teuthology.orchestra.run.smithi170.stdout: osd journal size = 100 2024-04-26T23:40:20.061 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.061 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub load threshold = 5.0 2024-04-26T23:40:20.061 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub max interval = 600 2024-04-26T23:40:20.061 INFO:teuthology.orchestra.run.smithi170.stdout: osd mclock profile = high_recovery_ops 2024-04-26T23:40:20.061 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.061 INFO:teuthology.orchestra.run.smithi170.stdout: osd recover clone overlap = true 2024-04-26T23:40:20.061 INFO:teuthology.orchestra.run.smithi170.stdout: osd recovery max chunk = 1048576 2024-04-26T23:40:20.061 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.061 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug shutdown = true 2024-04-26T23:40:20.061 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug op order = true 2024-04-26T23:40:20.061 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug verify stray on activate = true 2024-04-26T23:40:20.061 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug trim objects = true 2024-04-26T23:40:20.061 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.061 INFO:teuthology.orchestra.run.smithi170.stdout: osd open classes on start = true 2024-04-26T23:40:20.061 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug pg log writeout = true 2024-04-26T23:40:20.062 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.062 INFO:teuthology.orchestra.run.smithi170.stdout: osd deep scrub update digest min age = 30 2024-04-26T23:40:20.062 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.062 INFO:teuthology.orchestra.run.smithi170.stdout: osd map max advance = 10 2024-04-26T23:40:20.062 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.062 INFO:teuthology.orchestra.run.smithi170.stdout: journal zero on create = true 2024-04-26T23:40:20.062 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.062 INFO:teuthology.orchestra.run.smithi170.stdout: filestore ondisk finisher threads = 3 2024-04-26T23:40:20.062 INFO:teuthology.orchestra.run.smithi170.stdout: filestore apply finisher threads = 3 2024-04-26T23:40:20.062 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.062 INFO:teuthology.orchestra.run.smithi170.stdout: bdev debug aio = true 2024-04-26T23:40:20.062 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug misdirected ops = true 2024-04-26T23:40:20.062 INFO:teuthology.orchestra.run.smithi170.stdout: bdev async discard = True 2024-04-26T23:40:20.063 INFO:teuthology.orchestra.run.smithi170.stdout: bdev enable discard = True 2024-04-26T23:40:20.063 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore allocator = bitmap 2024-04-26T23:40:20.063 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore block size = 96636764160 2024-04-26T23:40:20.063 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore fsck on mount = True 2024-04-26T23:40:20.063 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluefs = 1/20 2024-04-26T23:40:20.063 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluestore = 1/20 2024-04-26T23:40:20.063 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T23:40:20.063 INFO:teuthology.orchestra.run.smithi170.stdout: debug osd = 20 2024-04-26T23:40:20.063 INFO:teuthology.orchestra.run.smithi170.stdout: debug rocksdb = 4/10 2024-04-26T23:40:20.063 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T23:40:20.063 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd full ratio = 0.9 2024-04-26T23:40:20.063 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd nearfull ratio = 0.8 2024-04-26T23:40:20.064 INFO:teuthology.orchestra.run.smithi170.stdout: osd failsafe full ratio = 0.95 2024-04-26T23:40:20.064 INFO:teuthology.orchestra.run.smithi170.stdout: osd objectstore = bluestore 2024-04-26T23:40:20.064 INFO:teuthology.orchestra.run.smithi170.stdout: osd op complaint time = 180 2024-04-26T23:40:20.064 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.064 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr] 2024-04-26T23:40:20.064 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T23:40:20.064 INFO:teuthology.orchestra.run.smithi170.stdout: debug mgr = 20 2024-04-26T23:40:20.064 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-04-26T23:40:20.064 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-04-26T23:40:20.064 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:40:20.064 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:40:20.064 INFO:teuthology.orchestra.run.smithi170.stdout: mgr/telemetry/nag = false 2024-04-26T23:40:20.064 INFO:teuthology.orchestra.run.smithi170.stdout: debug client = 20 2024-04-26T23:40:20.065 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.065 INFO:teuthology.orchestra.run.smithi170.stdout:[mon] 2024-04-26T23:40:20.065 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T23:40:20.065 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-04-26T23:40:20.065 INFO:teuthology.orchestra.run.smithi170.stdout: debug paxos = 20 2024-04-26T23:40:20.065 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-04-26T23:40:20.065 INFO:teuthology.orchestra.run.smithi170.stdout: mon data avail warn = 5 2024-04-26T23:40:20.065 INFO:teuthology.orchestra.run.smithi170.stdout: mon mgr mkfs grace = 240 2024-04-26T23:40:20.065 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:40:20.065 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd reporter subtree level = osd 2024-04-26T23:40:20.065 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd prime pg temp = true 2024-04-26T23:40:20.065 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:40:20.065 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.065 INFO:teuthology.orchestra.run.smithi170.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T23:40:20.066 INFO:teuthology.orchestra.run.smithi170.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T23:40:20.066 INFO:teuthology.orchestra.run.smithi170.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T23:40:20.066 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.066 INFO:teuthology.orchestra.run.smithi170.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T23:40:20.066 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T23:40:20.066 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T23:40:20.066 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.066 INFO:teuthology.orchestra.run.smithi170.stdout: # 1m isn't quite enough 2024-04-26T23:40:20.066 INFO:teuthology.orchestra.run.smithi170.stdout: mon_down_mkfs_grace = 2m 2024-04-26T23:40:20.066 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.066 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_filestore_osds = false 2024-04-26T23:40:20.066 INFO:teuthology.orchestra.run.smithi170.stdout: mon down mkfs grace = 300 2024-04-26T23:40:20.066 INFO:teuthology.orchestra.run.smithi170.stdout: mon op complaint time = 120 2024-04-26T23:40:20.066 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:40:20.066 INFO:teuthology.orchestra.run.smithi170.stdout:[client] 2024-04-26T23:40:20.067 INFO:teuthology.orchestra.run.smithi170.stdout: rgw cache enabled = true 2024-04-26T23:40:20.067 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable ops log = true 2024-04-26T23:40:20.067 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable usage log = true 2024-04-26T23:40:20.067 INFO:teuthology.orchestra.run.smithi170.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T23:40:20.067 INFO:teuthology.orchestra.run.smithi170.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T23:40:20.067 INFO:teuthology.orchestra.run.smithi170.stdout: client mount timeout = 600 2024-04-26T23:40:20.067 INFO:teuthology.orchestra.run.smithi170.stdout: debug client = 20 2024-04-26T23:40:20.067 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T23:40:20.067 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = "" 2024-04-26T23:40:20.067 INFO:teuthology.orchestra.run.smithi170.stdout: rados mon op timeout = 900 2024-04-26T23:40:20.067 INFO:teuthology.orchestra.run.smithi170.stdout: rados osd op timeout = 900 2024-04-26T23:40:20.067 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.a] 2024-04-26T23:40:20.067 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.b] 2024-04-26T23:40:20.067 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.c] 2024-04-26T23:40:20.067 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.a] 2024-04-26T23:40:20.067 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.c] 2024-04-26T23:40:20.068 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.b] 2024-04-26T23:40:20.068 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.d] 2024-04-26T23:40:20.068 INFO:teuthology.orchestra.run.smithi170.stdout:[mds] 2024-04-26T23:40:20.068 INFO:teuthology.orchestra.run.smithi170.stdout: debug mds = 20 2024-04-26T23:40:20.068 INFO:teuthology.orchestra.run.smithi170.stdout: debug mds balancer = 20 2024-04-26T23:40:20.068 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T23:40:20.068 INFO:teuthology.orchestra.run.smithi170.stdout: mds debug frag = True 2024-04-26T23:40:20.068 INFO:teuthology.orchestra.run.smithi170.stdout: mds debug scatterstat = True 2024-04-26T23:40:20.068 INFO:teuthology.orchestra.run.smithi170.stdout: mds op complaint time = 180 2024-04-26T23:40:20.068 INFO:teuthology.orchestra.run.smithi170.stdout: mds verify scatter = True 2024-04-26T23:40:20.068 INFO:teuthology.orchestra.run.smithi170.stdout: osd op complaint time = 180 2024-04-26T23:40:20.068 INFO:teuthology.orchestra.run.smithi170.stdout: rados mon op timeout = 900 2024-04-26T23:40:20.068 INFO:teuthology.orchestra.run.smithi170.stdout: rados osd op timeout = 900 2024-04-26T23:40:20.070 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T23:40:20.070 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T23:40:20.174 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T23:40:20.174 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:20.174 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T23:40:20.183 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:20.183 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T23:40:20.232 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T23:40:20.232 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:20.232 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T23:40:20.232 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T23:40:20.306 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:20.306 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:40:20.360 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T23:40:20.360 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:40:20.360 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T23:40:20.360 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T23:40:20.393 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:40:20.393 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:40:20.449 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T23:40:20.449 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T23:40:20.449 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T23:40:20.503 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T23:40:20.509 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T23:40:20.565 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T23:40:20.582 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T23:40:20.582 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T23:40:20.636 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T23:40:20.641 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T23:40:20.661 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T23:40:20.757 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T23:40:20.761 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-26T23:40:20.780 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T23:40:20.836 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T23:40:20.842 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-26T23:40:20.862 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-26T23:40:20.958 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-26T23:40:20.963 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-26T23:40:20.982 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T23:40:20.982 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T23:40:21.024 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T23:40:21.041 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-26T23:40:21.125 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-26T23:40:21.142 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-26T23:40:21.184 INFO:teuthology.orchestra.run.smithi170.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-26T23:40:21.201 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-26T23:40:21.285 INFO:teuthology.orchestra.run.smithi170.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-26T23:40:21.302 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T23:40:21.302 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T23:40:21.302 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T23:40:21.322 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:40:21.322 INFO:tasks.ceph:role: osd.0 2024-04-26T23:40:21.322 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T23:40:21.322 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T23:40:21.390 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:40:21.390 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:40:21.390 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:40:21.390 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:40:21.391 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:40:21.391 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:40:21.391 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:40:21.391 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:40:21.391 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:40:21.391 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:40:21.788 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-04-26T23:40:21.791 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-04-26T23:40:21.791 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T23:40:21.889 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T23:40:21.905 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:40:21.905 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:40:21.906 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T23:40:21.967 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:40:21.967 INFO:tasks.ceph:role: osd.1 2024-04-26T23:40:21.967 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T23:40:21.967 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T23:40:22.035 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:40:22.035 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:40:22.035 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:40:22.035 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:40:22.035 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:40:22.035 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:40:22.035 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:40:22.035 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:40:22.035 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:40:22.035 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:40:22.428 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-04-26T23:40:22.431 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-04-26T23:40:22.431 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-26T23:40:22.529 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T23:40:22.545 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:40:22.546 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:40:22.547 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T23:40:22.607 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:40:22.607 INFO:tasks.ceph:role: osd.2 2024-04-26T23:40:22.607 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T23:40:22.607 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T23:40:22.675 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:40:22.675 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:40:22.675 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:40:22.675 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:40:22.675 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:40:22.675 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:40:22.675 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:40:22.675 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:40:22.675 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:40:22.676 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:40:23.090 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-04-26T23:40:23.093 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-04-26T23:40:23.093 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-26T23:40:23.228 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T23:40:23.245 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:40:23.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:40:23.246 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-26T23:40:23.313 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:40:23.313 INFO:tasks.ceph:role: osd.3 2024-04-26T23:40:23.313 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T23:40:23.313 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T23:40:23.385 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:40:23.385 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:40:23.385 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:40:23.385 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:40:23.385 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:40:23.385 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:40:23.385 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:40:23.385 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:40:23.385 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:40:23.385 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:40:23.751 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-04-26T23:40:23.754 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-04-26T23:40:23.755 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-26T23:40:23.828 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-26T23:40:23.889 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:40:23.890 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:40:23.890 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:40:24.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:24.017+0000 7f57be8b87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T23:40:24.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:24.017+0000 7f57be8b87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T23:40:24.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:24.017+0000 7f57be8b87c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T23:40:24.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:24.017+0000 7f57be8b87c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T23:40:24.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:24.017+0000 7f57be8b87c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T23:40:24.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:24.025+0000 7f57be8b87c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T23:40:27.099 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T23:40:27.120 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:40:27.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:27.217+0000 7f5ffbfb67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T23:40:27.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:27.217+0000 7f5ffbfb67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T23:40:27.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:27.217+0000 7f5ffbfb67c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T23:40:27.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:27.217+0000 7f5ffbfb67c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T23:40:27.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:27.217+0000 7f5ffbfb67c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T23:40:27.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:27.217+0000 7f5ffbfb67c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T23:40:30.275 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T23:40:30.295 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:40:30.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:30.389+0000 7f6e293887c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T23:40:30.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:30.389+0000 7f6e293887c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T23:40:30.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:30.389+0000 7f6e293887c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T23:40:30.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:30.389+0000 7f6e293887c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T23:40:30.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:30.389+0000 7f6e293887c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T23:40:30.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:30.393+0000 7f6e293887c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T23:40:33.418 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T23:40:33.439 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:40:33.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:33.529+0000 7fdfeaf017c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-26T23:40:33.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:33.533+0000 7fdfeaf017c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-26T23:40:33.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:33.533+0000 7fdfeaf017c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T23:40:33.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:33.533+0000 7fdfeaf017c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T23:40:33.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:33.533+0000 7fdfeaf017c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T23:40:33.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:33.533+0000 7fdfeaf017c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-26T23:40:36.594 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T23:40:36.615 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-26T23:40:36.637 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:40:36.637 INFO:tasks.ceph:role: osd.4 2024-04-26T23:40:36.637 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T23:40:36.637 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T23:40:36.701 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:40:36.701 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:40:36.701 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:40:36.701 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:40:36.701 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:40:36.701 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:40:36.701 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:40:36.701 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:40:36.701 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:40:36.701 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:40:36.726 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-04-26T23:40:36.729 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-04-26T23:40:36.730 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-26T23:40:36.797 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-26T23:40:36.856 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:40:36.857 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:40:36.857 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-26T23:40:36.919 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:40:36.919 INFO:tasks.ceph:role: osd.5 2024-04-26T23:40:36.919 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T23:40:36.919 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T23:40:36.978 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:40:36.979 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:40:36.979 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:40:36.979 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:40:36.979 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:40:36.979 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:40:36.979 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:40:36.979 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:40:36.979 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:40:36.979 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:40:37.003 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-04-26T23:40:37.007 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-04-26T23:40:37.007 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-26T23:40:37.072 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-26T23:40:37.127 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:40:37.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:40:37.128 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-26T23:40:37.190 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:40:37.190 INFO:tasks.ceph:role: osd.6 2024-04-26T23:40:37.190 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T23:40:37.191 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T23:40:37.254 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:40:37.254 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:40:37.255 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:40:37.255 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:40:37.255 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:40:37.255 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:40:37.255 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:40:37.255 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:40:37.255 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:40:37.255 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:40:37.279 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-04-26T23:40:37.282 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-04-26T23:40:37.282 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-26T23:40:37.352 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-26T23:40:37.412 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:40:37.412 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:40:37.413 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-26T23:40:37.479 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:40:37.479 INFO:tasks.ceph:role: osd.7 2024-04-26T23:40:37.479 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T23:40:37.479 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T23:40:37.542 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:40:37.542 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:40:37.542 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:40:37.543 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:40:37.543 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:40:37.543 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:40:37.543 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:40:37.543 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:40:37.543 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:40:37.543 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:40:37.567 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-04-26T23:40:37.569 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-04-26T23:40:37.569 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-26T23:40:37.640 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-26T23:40:37.695 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:40:37.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:40:37.697 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:40:37.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:37.820+0000 7f8a624ba7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-26T23:40:37.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:37.820+0000 7f8a624ba7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-26T23:40:37.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:37.820+0000 7f8a624ba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T23:40:37.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:37.820+0000 7f8a624ba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T23:40:37.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:37.820+0000 7f8a624ba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T23:40:37.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:37.824+0000 7f8a624ba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-26T23:40:40.861 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T23:40:40.882 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:40:40.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:40.972+0000 7f61dd75a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-26T23:40:40.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:40.972+0000 7f61dd75a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-26T23:40:40.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:40.972+0000 7f61dd75a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T23:40:40.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:40.972+0000 7f61dd75a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T23:40:40.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:40.972+0000 7f61dd75a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T23:40:40.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:40.972+0000 7f61dd75a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-26T23:40:44.011 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T23:40:44.031 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:40:44.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:44.116+0000 7f179845e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-26T23:40:44.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:44.116+0000 7f179845e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-26T23:40:44.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:44.116+0000 7f179845e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T23:40:44.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:44.116+0000 7f179845e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T23:40:44.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:44.116+0000 7f179845e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T23:40:44.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:44.116+0000 7f179845e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-26T23:40:47.171 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-26T23:40:47.193 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:40:47.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:47.284+0000 7f03f1f9d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-26T23:40:47.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:47.284+0000 7f03f1f9d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-26T23:40:47.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:47.284+0000 7f03f1f9d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T23:40:47.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:47.284+0000 7f03f1f9d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T23:40:47.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:47.284+0000 7f03f1f9d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T23:40:47.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:47.288+0000 7f03f1f9d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-26T23:40:48.156 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:40:48.160 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:40:50.355 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-26T23:40:50.374 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T23:40:50.374 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:50.374 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T23:40:50.396 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:50.396 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T23:40:50.456 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:50.456 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-26T23:40:50.515 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:50.515 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T23:40:50.575 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:50.575 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T23:40:50.635 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:50.635 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T23:40:50.695 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:50.695 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-26T23:40:50.755 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:40:50.755 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T23:40:50.775 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:40:50.775 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-26T23:40:50.835 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:40:50.835 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-26T23:40:50.895 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:40:51.230 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-26T23:40:51.251 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:40:51.251 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-26T23:40:51.316 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:40:51.316 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-26T23:40:51.377 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:40:51.377 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-26T23:40:51.440 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:51.440 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T23:40:51.449 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:51.449 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-26T23:40:51.500 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:40:51.500 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-26T23:40:51.509 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:40:51.509 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-26T23:40:51.560 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T23:40:51.560 DEBUG:teuthology.orchestra.run.smithi137:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T23:40:51.564 DEBUG:teuthology.orchestra.run.smithi170:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T23:40:51.604 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.y] 2024-04-26T23:40:51.604 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBkOyxmdEIZHhAAPO3gVpDHmMunKrxtjSmYxw== 2024-04-26T23:40:51.604 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2024-04-26T23:40:51.604 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBkOyxm8fEFJhAApnO8C5VzrzRze2CXBFDX+w== 2024-04-26T23:40:51.604 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2024-04-26T23:40:51.604 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBkOyxmxOM0LRAAqjFB1cWhxjLMmH2Hw08y4Q== 2024-04-26T23:40:51.604 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.0] 2024-04-26T23:40:51.604 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBoOyxmBpUlARAAFTI893hK3CG+M43N95QY0Q== 2024-04-26T23:40:51.604 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.1] 2024-04-26T23:40:51.605 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBrOyxmOKoBDRAAEKl+f5dgrhKsrw9GLl/aZg== 2024-04-26T23:40:51.605 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.2] 2024-04-26T23:40:51.605 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBuOyxmRCxpFxAAiugbUkmCpSi3PpcfSIqzag== 2024-04-26T23:40:51.605 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.3] 2024-04-26T23:40:51.605 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBxOyxmAVDRHxAAn16e0bzh8lMn7IfompY4tg== 2024-04-26T23:40:51.605 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.x] 2024-04-26T23:40:51.605 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBkOyxmXYSgIRAAYsHzI8tb+DSiNPdNJxRDag== 2024-04-26T23:40:51.605 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2024-04-26T23:40:51.605 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBkOyxmcIXMMRAAbatu788GHajE0CeUmSfG6g== 2024-04-26T23:40:51.605 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d] 2024-04-26T23:40:51.605 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBkOyxmtB0QORAA4pb1qkARdVDYWtrlHHLM8A== 2024-04-26T23:40:51.605 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.4] 2024-04-26T23:40:51.605 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQB1OyxmBaU+MRAADSzfJp0HfnkgWh57F6vmGw== 2024-04-26T23:40:51.605 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.5] 2024-04-26T23:40:51.605 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQB4OyxmFhNFOhAAIqlQNOvaL8EMnodLeQMhDw== 2024-04-26T23:40:51.606 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.6] 2024-04-26T23:40:51.606 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQB8Oyxm1y03BxAAZaVKAAMQ8CgZxR9QOSmmxg== 2024-04-26T23:40:51.606 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.7] 2024-04-26T23:40:51.606 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQB/Oyxmnl5HERAAzW6LvTGUe02XbfzKUdE9Ww== 2024-04-26T23:40:51.606 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-04-26T23:40:51.606 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBlOyxmNsaKARAAi0ecpgpB9GUVCXS04Xi03g== 2024-04-26T23:40:51.606 INFO:teuthology.orchestra.run.smithi137.stdout:[client.2] 2024-04-26T23:40:51.606 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBlOyxmtliOBxAADAAo7qWwq7kTIiAzKhdSEw== 2024-04-26T23:40:51.606 INFO:teuthology.orchestra.run.smithi137.stdout:[client.1] 2024-04-26T23:40:51.606 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBlOyxmZdztChAA5CqZN408iUQConPiWOpzNA== 2024-04-26T23:40:51.606 INFO:teuthology.orchestra.run.smithi137.stdout:[client.3] 2024-04-26T23:40:51.606 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBlOyxmY+nwEBAAwfSl/XoOGWEecTT5NKOaUQ== 2024-04-26T23:40:51.618 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr.y] 2024-04-26T23:40:51.618 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBkOyxmdEIZHhAAPO3gVpDHmMunKrxtjSmYxw== 2024-04-26T23:40:51.618 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.a] 2024-04-26T23:40:51.618 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBkOyxm8fEFJhAApnO8C5VzrzRze2CXBFDX+w== 2024-04-26T23:40:51.618 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.c] 2024-04-26T23:40:51.618 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBkOyxmxOM0LRAAqjFB1cWhxjLMmH2Hw08y4Q== 2024-04-26T23:40:51.618 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.0] 2024-04-26T23:40:51.618 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBoOyxmBpUlARAAFTI893hK3CG+M43N95QY0Q== 2024-04-26T23:40:51.619 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.1] 2024-04-26T23:40:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBrOyxmOKoBDRAAEKl+f5dgrhKsrw9GLl/aZg== 2024-04-26T23:40:51.619 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.2] 2024-04-26T23:40:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBuOyxmRCxpFxAAiugbUkmCpSi3PpcfSIqzag== 2024-04-26T23:40:51.619 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.3] 2024-04-26T23:40:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBxOyxmAVDRHxAAn16e0bzh8lMn7IfompY4tg== 2024-04-26T23:40:51.619 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr.x] 2024-04-26T23:40:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBkOyxmXYSgIRAAYsHzI8tb+DSiNPdNJxRDag== 2024-04-26T23:40:51.619 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.b] 2024-04-26T23:40:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBkOyxmcIXMMRAAbatu788GHajE0CeUmSfG6g== 2024-04-26T23:40:51.619 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.d] 2024-04-26T23:40:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBkOyxmtB0QORAA4pb1qkARdVDYWtrlHHLM8A== 2024-04-26T23:40:51.619 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.4] 2024-04-26T23:40:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQB1OyxmBaU+MRAADSzfJp0HfnkgWh57F6vmGw== 2024-04-26T23:40:51.619 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.5] 2024-04-26T23:40:51.620 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQB4OyxmFhNFOhAAIqlQNOvaL8EMnodLeQMhDw== 2024-04-26T23:40:51.620 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.6] 2024-04-26T23:40:51.620 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQB8Oyxm1y03BxAAZaVKAAMQ8CgZxR9QOSmmxg== 2024-04-26T23:40:51.620 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.7] 2024-04-26T23:40:51.620 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQB/Oyxmnl5HERAAzW6LvTGUe02XbfzKUdE9Ww== 2024-04-26T23:40:51.620 INFO:teuthology.orchestra.run.smithi170.stdout:[client.0] 2024-04-26T23:40:51.620 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBlOyxmNsaKARAAi0ecpgpB9GUVCXS04Xi03g== 2024-04-26T23:40:51.620 INFO:teuthology.orchestra.run.smithi170.stdout:[client.2] 2024-04-26T23:40:51.620 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBlOyxmtliOBxAADAAo7qWwq7kTIiAzKhdSEw== 2024-04-26T23:40:51.620 INFO:teuthology.orchestra.run.smithi170.stdout:[client.1] 2024-04-26T23:40:51.620 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBlOyxmZdztChAA5CqZN408iUQConPiWOpzNA== 2024-04-26T23:40:51.620 INFO:teuthology.orchestra.run.smithi170.stdout:[client.3] 2024-04-26T23:40:51.620 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBlOyxmY+nwEBAAwfSl/XoOGWEecTT5NKOaUQ== 2024-04-26T23:40:51.621 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:40:51.651 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:40:51.721 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:40:51.724 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:40:51.781 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:40:51.784 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:40:51.840 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:51.843 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:51.897 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:51.900 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:51.952 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:51.955 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:52.008 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:52.011 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:52.064 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:40:52.068 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:40:52.121 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:40:52.124 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:40:52.180 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:40:52.183 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:40:52.239 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:52.243 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:52.296 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:52.299 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:52.352 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:52.355 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:52.408 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:52.411 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:52.464 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:40:52.468 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:40:52.524 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:40:52.528 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:40:52.584 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:40:52.587 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:40:52.644 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:40:52.647 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:40:52.704 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T23:40:52.704 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T23:40:52.723 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T23:40:52.832 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T23:40:52.851 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T23:40:52.870 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T23:40:52.978 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T23:40:52.998 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T23:40:53.063 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T23:40:53.174 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T23:40:53.193 DEBUG:teuthology.orchestra.run.smithi137:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:40:53.196 DEBUG:teuthology.orchestra.run.smithi170:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:40:53.244 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T23:40:53.244 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T23:40:53.244 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T23:40:53.247 INFO:tasks.ceph.mon.a:Started 2024-04-26T23:40:53.247 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T23:40:53.247 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T23:40:53.287 INFO:tasks.ceph.mon.b:Started 2024-04-26T23:40:53.287 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T23:40:53.287 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T23:40:53.290 INFO:tasks.ceph.mon.c:Started 2024-04-26T23:40:53.290 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T23:40:53.290 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T23:40:53.291 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T23:40:53.294 INFO:tasks.ceph.mgr.y:Started 2024-04-26T23:40:53.294 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T23:40:53.294 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T23:40:53.297 INFO:tasks.ceph.mgr.x:Started 2024-04-26T23:40:53.297 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T23:40:53.298 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T23:40:53.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.432+0000 7f8ffb000640 1 Processor -- start 2024-04-26T23:40:53.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.432+0000 7f8ffb000640 1 -- start start 2024-04-26T23:40:53.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.436+0000 7f8ffb000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 0x7f8ff40b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:53.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.436+0000 7f8ffb000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 0x7f8ff415f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:53.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.436+0000 7f8ffb000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ff4160250 con 0x7f8ff415fe30 2024-04-26T23:40:53.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.436+0000 7f8ffb000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f8ff40b3d90 con 0x7f8ff40cd710 2024-04-26T23:40:53.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.436+0000 7f8ffb000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff40d0840 con 0x7f8ff40b54e0 2024-04-26T23:40:53.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.436+0000 7f8ff3e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 0x7f8ff40b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:53.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.436+0000 7f8ff3e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 0x7f8ff40b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:33654/0 (socket says 172.21.15.137:33654) 2024-04-26T23:40:53.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.436+0000 7f8ff3e00640 1 -- 172.21.15.137:0/2600058137 learned_addr learned my addr 172.21.15.137:0/2600058137 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:40:53.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.436+0000 7f8ff3e00640 1 -- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 msgr2=0x7f8ff40b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:40:53.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.436+0000 7f8ff3e00640 1 -- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 msgr2=0x7f8ff40b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:40:53.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.436+0000 7f8ff3e00640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 0x7f8ff40b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:40:53.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.436+0000 7f8ff3e00640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 0x7f8ff40b5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:40:53.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.436+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 0x7f8ff415f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:53.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.436+0000 7f8febe00640 1 -- 172.21.15.137:0/2600058137 >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 msgr2=0x7f8ff415f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:40:53.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.436+0000 7f8febe00640 1 -- 172.21.15.137:0/2600058137 >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 msgr2=0x7f8ff415f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:40:53.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.436+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 0x7f8ff415f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:40:53.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.436+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 0x7f8ff415f8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:40:53.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.640+0000 7f8ff3e00640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 0x7f8ff40b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:53.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.640+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 0x7f8ff415f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:53.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.640+0000 7f8ff3e00640 1 -- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 msgr2=0x7f8ff40b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:40:53.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.640+0000 7f8ff3e00640 1 -- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 msgr2=0x7f8ff40b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:40:53.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.640+0000 7f8ff3e00640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 0x7f8ff40b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:40:53.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.640+0000 7f8ff3e00640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 0x7f8ff40b5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:40:53.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.640+0000 7f8febe00640 1 -- 172.21.15.137:0/2600058137 >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 msgr2=0x7f8ff415f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:40:53.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.640+0000 7f8febe00640 1 -- 172.21.15.137:0/2600058137 >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 msgr2=0x7f8ff415f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:40:53.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.640+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 0x7f8ff415f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:40:53.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:53.640+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 0x7f8ff415f8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:40:54.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:54.044+0000 7f8ff3e00640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 0x7f8ff40b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:54.044+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 0x7f8ff415f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:54.044+0000 7f8ff3e00640 1 -- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 msgr2=0x7f8ff40b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:40:54.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:54.044+0000 7f8ff3e00640 1 -- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 msgr2=0x7f8ff40b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:40:54.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:54.044+0000 7f8ff3e00640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 0x7f8ff40b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:40:54.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:54.044+0000 7f8ff3e00640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 0x7f8ff40b5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:40:54.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:54.044+0000 7f8febe00640 1 -- 172.21.15.137:0/2600058137 >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 msgr2=0x7f8ff415f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:40:54.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:54.044+0000 7f8febe00640 1 -- 172.21.15.137:0/2600058137 >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 msgr2=0x7f8ff415f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:40:54.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:54.044+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 0x7f8ff415f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:40:54.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:54.044+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 0x7f8ff415f8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:40:54.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:54.848+0000 7f8ff3e00640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 0x7f8ff40b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:54.848+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 0x7f8ff415f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:54.848+0000 7f8ff3e00640 1 -- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 msgr2=0x7f8ff40b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:40:54.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:54.848+0000 7f8ff3e00640 1 -- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 msgr2=0x7f8ff40b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:40:54.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:54.848+0000 7f8ff3e00640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 0x7f8ff40b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:40:54.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:54.848+0000 7f8febe00640 1 -- 172.21.15.137:0/2600058137 >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 msgr2=0x7f8ff415f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:40:54.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:54.848+0000 7f8febe00640 1 -- 172.21.15.137:0/2600058137 >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 msgr2=0x7f8ff415f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:40:54.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:54.848+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 0x7f8ff415f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:40:54.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:54.848+0000 7f8ff3e00640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 0x7f8ff40b5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:40:54.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:54.848+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 0x7f8ff415f8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:40:56.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:56.436+0000 7f8ff2000640 1 -- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 msgr2=0x7f8ff40b5ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:40:56.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:56.436+0000 7f8ff2000640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 0x7f8ff40b5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:56.436+0000 7f8ff2000640 1 -- 172.21.15.137:0/2600058137 >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 msgr2=0x7f8ff415f8f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:40:56.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:56.436+0000 7f8ff2000640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.170:3300/0 conn(0x7f8ff40cd710 0x7f8ff415f8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:56.436+0000 7f8ff2000640 1 -- 172.21.15.137:0/2600058137 >> v1:172.21.15.170:6789/0 conn(0x7f8ff415fe30 legacy=0x7f8ff4144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:56.436+0000 7f8ff2000640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 0x7f8fd0009850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:56.436+0000 7f8ff2000640 1 -- 172.21.15.137:0/2600058137 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ff40cffa0 con 0x7f8fd00036e0 2024-04-26T23:40:56.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:56.436+0000 7f8ff2000640 1 -- 172.21.15.137:0/2600058137 --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8ff40d0840 con 0x7f8fd0007390 2024-04-26T23:40:56.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:56.436+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 0x7f8fd0009850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:56.436+0000 7f8febe00640 1 -- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 msgr2=0x7f8fd0009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:40:56.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:56.436+0000 7f8febe00640 1 -- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 msgr2=0x7f8fd0009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:40:56.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:56.436+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 0x7f8fd0009850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:40:56.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:56.436+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 0x7f8fd0009850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:40:56.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:56.639+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 0x7f8fd0009850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:56.639+0000 7f8febe00640 1 -- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 msgr2=0x7f8fd0009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:40:56.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:56.639+0000 7f8febe00640 1 -- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 msgr2=0x7f8fd0009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:40:56.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:56.639+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 0x7f8fd0009850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:40:56.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:56.639+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 0x7f8fd0009850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:40:57.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:57.043+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 0x7f8fd0009850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:57.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:57.043+0000 7f8febe00640 1 -- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 msgr2=0x7f8fd0009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:40:57.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:57.043+0000 7f8febe00640 1 -- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 msgr2=0x7f8fd0009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:40:57.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:57.043+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 0x7f8fd0009850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:40:57.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:57.043+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 0x7f8fd0009850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:40:57.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:57.847+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 0x7f8fd0009850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:57.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:57.847+0000 7f8febe00640 1 -- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 msgr2=0x7f8fd0009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:40:57.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:57.847+0000 7f8febe00640 1 -- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 msgr2=0x7f8fd0009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:40:57.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:57.847+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 0x7f8fd0009850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:40:57.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:57.847+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 0x7f8fd0009850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:40:58.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.579+0000 7f8ff3400640 1 -- 172.21.15.137:0/2600058137 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3265994927 0 0) 0x7f8ff40cffa0 con 0x7f8fd00036e0 2024-04-26T23:40:58.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.579+0000 7f8ff3400640 1 -- 172.21.15.137:0/2600058137 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fd8003530 con 0x7f8fd00036e0 2024-04-26T23:40:58.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.579+0000 7f8ff3400640 1 -- 172.21.15.137:0/2600058137 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3023910669 0 0) 0x7f8fd8003530 con 0x7f8fd00036e0 2024-04-26T23:40:58.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.579+0000 7f8ff3400640 1 -- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 msgr2=0x7f8fd0009850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:40:58.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.579+0000 7f8ff3400640 1 --2- 172.21.15.137:0/2600058137 >> v2:172.21.15.137:3300/0 conn(0x7f8fd0007390 0x7f8fd0009850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.579+0000 7f8ff3400640 1 -- 172.21.15.137:0/2600058137 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd000af70 con 0x7f8fd00036e0 2024-04-26T23:40:58.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.579+0000 7f8ff3400640 1 -- 172.21.15.137:0/2600058137 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f8fe400e700 con 0x7f8fd00036e0 2024-04-26T23:40:58.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.579+0000 7f8ff3400640 1 -- 172.21.15.137:0/2600058137 >> v1:172.21.15.137:6789/0 conn(0x7f8fd00036e0 legacy=0x7f8fd0005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:58.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.579+0000 7f8ff3400640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fd80039c0 0x7f8fd8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.579+0000 7f8ff9000640 1 -- 172.21.15.137:0/2600058137 reap_dead start 2024-04-26T23:40:58.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.579+0000 7f8ff3400640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 0x7f8fd8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.579+0000 7f8ff3400640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fd8004da0 0x7f8fd8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.579+0000 7f8ff3400640 1 -- 172.21.15.137:0/2600058137 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff40d0840 con 0x7f8fd80039c0 2024-04-26T23:40:58.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.579+0000 7f8ff3400640 1 -- 172.21.15.137:0/2600058137 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd800bc50 con 0x7f8fd8004da0 2024-04-26T23:40:58.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.579+0000 7f8ff3400640 1 -- 172.21.15.137:0/2600058137 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8fd800be50 con 0x7f8ff40b54e0 2024-04-26T23:40:58.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.579+0000 7f8ff3e00640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fd80039c0 0x7f8fd8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.583+0000 7f8febe00640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 0x7f8fd8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.583+0000 7f8ff9000640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fd8004da0 0x7f8fd8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.583+0000 7f8ff3e00640 1 -- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 msgr2=0x7f8fd8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:58.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.583+0000 7f8ff3e00640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 0x7f8fd8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.583+0000 7f8ff3e00640 1 -- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fd8004da0 msgr2=0x7f8fd8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:58.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.583+0000 7f8ff3e00640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fd8004da0 0x7f8fd8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.583+0000 7f8ff3e00640 1 -- 172.21.15.137:0/2600058137 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd8003530 con 0x7f8fd80039c0 2024-04-26T23:40:58.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.583+0000 7f8ff9000640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fd8004da0 0x7f8fd8005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:58.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.587+0000 7f8ff3e00640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fd80039c0 0x7f8fd8003dc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4009100 tx=0x7f8fe401ffa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf0e1e32d3c37be server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:58.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.587+0000 7f8ff3400640 1 -- 172.21.15.137:0/2600058137 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe40b4070 con 0x7f8fd80039c0 2024-04-26T23:40:58.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.587+0000 7f8ff3400640 1 -- 172.21.15.137:0/2600058137 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe40af400 con 0x7f8fd80039c0 2024-04-26T23:40:58.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.587+0000 7f8ff3400640 1 -- 172.21.15.137:0/2600058137 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe40134b0 con 0x7f8fd80039c0 2024-04-26T23:40:58.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.587+0000 7f8ffb000640 1 -- 172.21.15.137:0/2600058137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fd80039c0 msgr2=0x7f8fd8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:58.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.587+0000 7f8ffb000640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fd80039c0 0x7f8fd8003dc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4009100 tx=0x7f8fe401ffa0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.587+0000 7f8ffb000640 1 -- 172.21.15.137:0/2600058137 shutdown_connections 2024-04-26T23:40:58.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.587+0000 7f8ffb000640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fd8004da0 0x7f8fd8005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.587+0000 7f8ffb000640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ff40b54e0 0x7f8fd8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.587+0000 7f8ffb000640 1 --2- 172.21.15.137:0/2600058137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fd80039c0 0x7f8fd8003dc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.587+0000 7f8ffb000640 1 -- 172.21.15.137:0/2600058137 >> 172.21.15.137:0/2600058137 conn(0x7f8ff406c800 msgr2=0x7f8ff406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:58.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.587+0000 7f8ffb000640 1 -- 172.21.15.137:0/2600058137 shutdown_connections 2024-04-26T23:40:58.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.587+0000 7f8ffb000640 1 -- 172.21.15.137:0/2600058137 wait complete. 2024-04-26T23:40:58.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ffb000640 1 Processor -- start 2024-04-26T23:40:58.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ffb000640 1 -- start start 2024-04-26T23:40:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ffb000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fd80039c0 0x7f8ff41319d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ffb000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8fd8004da0 0x7f8ff41338d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ffb000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ff40b54e0 0x7f8ff4133e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ffb000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff40cdaf0 con 0x7f8ff40b54e0 2024-04-26T23:40:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ffb000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff40cded0 con 0x7f8fd80039c0 2024-04-26T23:40:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ffb000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff40cdc70 con 0x7f8fd8004da0 2024-04-26T23:40:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ff9000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ff40b54e0 0x7f8ff4133e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ff9000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ff40b54e0 0x7f8ff4133e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59338/0 (socket says 172.21.15.137:59338) 2024-04-26T23:40:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ff9000640 1 -- 172.21.15.137:0/2194823430 learned_addr learned my addr 172.21.15.137:0/2194823430 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:40:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ff3e00640 1 --2- 172.21.15.137:0/2194823430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fd80039c0 0x7f8ff41319d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8febe00640 1 --2- 172.21.15.137:0/2194823430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8fd8004da0 0x7f8ff41338d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8febe00640 1 -- 172.21.15.137:0/2194823430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8fd8004da0 msgr2=0x7f8ff41338d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-26T23:40:58.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8febe00640 1 -- 172.21.15.137:0/2194823430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8fd8004da0 msgr2=0x7f8ff41338d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:40:58.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8febe00640 1 --2- 172.21.15.137:0/2194823430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8fd8004da0 0x7f8ff41338d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:40:58.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8febe00640 1 --2- 172.21.15.137:0/2194823430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8fd8004da0 0x7f8ff41338d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:40:58.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ff9000640 1 -- 172.21.15.137:0/2194823430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8fd8004da0 msgr2=0x7f8ff41338d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:40:58.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ff9000640 1 --2- 172.21.15.137:0/2194823430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8fd8004da0 0x7f8ff41338d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ff9000640 1 -- 172.21.15.137:0/2194823430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fd80039c0 msgr2=0x7f8ff41319d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:58.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ff9000640 1 --2- 172.21.15.137:0/2194823430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fd80039c0 0x7f8ff41319d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ff9000640 1 -- 172.21.15.137:0/2194823430 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff4130930 con 0x7f8ff40b54e0 2024-04-26T23:40:58.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ff9000640 1 --2- 172.21.15.137:0/2194823430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ff40b54e0 0x7f8ff4133e10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009e10 tx=0x7f8fec00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:58.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ff0c00640 1 -- 172.21.15.137:0/2194823430 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec005b50 con 0x7f8ff40b54e0 2024-04-26T23:40:58.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ff0c00640 1 -- 172.21.15.137:0/2194823430 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fec005cf0 con 0x7f8ff40b54e0 2024-04-26T23:40:58.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ff0c00640 1 -- 172.21.15.137:0/2194823430 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec003980 con 0x7f8ff40b54e0 2024-04-26T23:40:58.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ffb000640 1 -- 172.21.15.137:0/2194823430 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff4130c10 con 0x7f8ff40b54e0 2024-04-26T23:40:58.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ffb000640 1 -- 172.21.15.137:0/2194823430 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff41311d0 con 0x7f8ff40b54e0 2024-04-26T23:40:58.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.591+0000 7f8ff0c00640 1 -- 172.21.15.137:0/2194823430 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8fec01a020 con 0x7f8ff40b54e0 2024-04-26T23:40:58.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.595+0000 7f8ff0c00640 1 -- 172.21.15.137:0/2194823430 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8fec004000 con 0x7f8ff40b54e0 2024-04-26T23:40:58.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.595+0000 7f8ffb000640 1 -- 172.21.15.137:0/2194823430 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ff40cd4c0 con 0x7f8ff40b54e0 2024-04-26T23:40:58.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.615+0000 7f8ff0c00640 1 -- 172.21.15.137:0/2194823430 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f8fec004310 con 0x7f8ff40b54e0 2024-04-26T23:40:58.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.679+0000 7f8ffb000640 1 -- 172.21.15.137:0/2194823430 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8ff406f890 con 0x7f8ff40b54e0 2024-04-26T23:40:58.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.683+0000 7f8ff0c00640 1 -- 172.21.15.137:0/2194823430 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f8fec0044f0 con 0x7f8ff40b54e0 2024-04-26T23:40:58.687 INFO:teuthology.orchestra.run.smithi137.stderr:adjusted tunables profile to default 2024-04-26T23:40:58.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.683+0000 7f8ffb000640 1 -- 172.21.15.137:0/2194823430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ff40b54e0 msgr2=0x7f8ff4133e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:58.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.683+0000 7f8ffb000640 1 --2- 172.21.15.137:0/2194823430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ff40b54e0 0x7f8ff4133e10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009e10 tx=0x7f8fec00ec10 comp rx=0 tx=0).stop 2024-04-26T23:40:58.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.683+0000 7f8ffb000640 1 -- 172.21.15.137:0/2194823430 shutdown_connections 2024-04-26T23:40:58.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.683+0000 7f8ffb000640 1 --2- 172.21.15.137:0/2194823430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ff40b54e0 0x7f8ff4133e10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.683+0000 7f8ffb000640 1 --2- 172.21.15.137:0/2194823430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8fd8004da0 0x7f8ff41338d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.683+0000 7f8ffb000640 1 --2- 172.21.15.137:0/2194823430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fd80039c0 0x7f8ff41319d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.683+0000 7f8ffb000640 1 -- 172.21.15.137:0/2194823430 >> 172.21.15.137:0/2194823430 conn(0x7f8ff406c800 msgr2=0x7f8ff40b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:58.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.683+0000 7f8ffb000640 1 -- 172.21.15.137:0/2194823430 shutdown_connections 2024-04-26T23:40:58.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:40:58.683+0000 7f8ffb000640 1 -- 172.21.15.137:0/2194823430 wait complete. 2024-04-26T23:40:58.707 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T23:40:58.708 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T23:40:58.708 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:58.708 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T23:40:58.728 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:58.728 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T23:40:58.788 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:58.788 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T23:40:58.803 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:40:58.799+0000 7f24b0454180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T23:40:58.833 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:40:58.827+0000 7f1b8ae55180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T23:40:58.848 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:40:58.848 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-26T23:40:58.908 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:40:58.908 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-26T23:40:58.928 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:40:58.928 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-26T23:40:58.988 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:40:58.988 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-26T23:40:59.048 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:40:59.048 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-26T23:40:59.108 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22 0 2024-04-26T23:40:59.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.279+0000 7fa373800640 1 Processor -- start 2024-04-26T23:40:59.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.279+0000 7fa373800640 1 -- start start 2024-04-26T23:40:59.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.279+0000 7fa373800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa36c15f4d0 0x7fa36c0b2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.283+0000 7fa373800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa36c06c610 0x7fa36c0cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.283+0000 7fa373800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa36c0d0680 con 0x7fa36c06cc60 2024-04-26T23:40:59.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.283+0000 7fa373800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa36c0d0f80 con 0x7fa36c15f4d0 2024-04-26T23:40:59.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.283+0000 7fa373800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fa36c0cfbb0 con 0x7fa36c06c610 2024-04-26T23:40:59.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.283+0000 7fa36be00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa36c06c610 0x7fa36c0cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.283+0000 7fa36be00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa36c06c610 0x7fa36c0cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36166/0 (socket says 172.21.15.170:36166) 2024-04-26T23:40:59.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.283+0000 7fa36be00640 1 -- 172.21.15.170:0/131661968 learned_addr learned my addr 172.21.15.170:0/131661968 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T23:40:59.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.283+0000 7fa370e00640 1 --2- 172.21.15.170:0/131661968 >> v2:172.21.15.137:3300/0 conn(0x7fa36c15f4d0 0x7fa36c0b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.283+0000 7fa36be00640 1 -- 172.21.15.170:0/131661968 >> v2:172.21.15.137:3300/0 conn(0x7fa36c15f4d0 msgr2=0x7fa36c0b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:59.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.283+0000 7fa36be00640 1 --2- 172.21.15.170:0/131661968 >> v2:172.21.15.137:3300/0 conn(0x7fa36c15f4d0 0x7fa36c0b2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.283+0000 7fa36be00640 1 -- 172.21.15.170:0/131661968 >> v1:172.21.15.137:6789/0 conn(0x7fa36c06cc60 legacy=0x7fa36c0d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.283+0000 7fa36be00640 1 -- 172.21.15.170:0/131661968 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa36c0cfde0 con 0x7fa36c06c610 2024-04-26T23:40:59.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.283+0000 7fa36be00640 1 --2- 172.21.15.170:0/131661968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa36c06c610 0x7fa36c0cf670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa36c06e5e0 tx=0x7fa35801c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c9780162a579d85 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:59.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa36b400640 1 -- 172.21.15.170:0/131661968 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3580ab430 con 0x7fa36c06c610 2024-04-26T23:40:59.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa36b400640 1 -- 172.21.15.170:0/131661968 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3580b0070 con 0x7fa36c06c610 2024-04-26T23:40:59.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa36b400640 1 -- 172.21.15.170:0/131661968 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3580ab7f0 con 0x7fa36c06c610 2024-04-26T23:40:59.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa373800640 1 -- 172.21.15.170:0/131661968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa36c06c610 msgr2=0x7fa36c0cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa373800640 1 --2- 172.21.15.170:0/131661968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa36c06c610 0x7fa36c0cf670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa36c06e5e0 tx=0x7fa35801c520 comp rx=0 tx=0).stop 2024-04-26T23:40:59.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa373800640 1 -- 172.21.15.170:0/131661968 shutdown_connections 2024-04-26T23:40:59.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa373800640 1 --2- 172.21.15.170:0/131661968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa36c06c610 0x7fa36c0cf670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa373800640 1 --2- 172.21.15.170:0/131661968 >> v2:172.21.15.137:3300/0 conn(0x7fa36c15f4d0 0x7fa36c0b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa373800640 1 -- 172.21.15.170:0/131661968 >> 172.21.15.170:0/131661968 conn(0x7fa36c09ba60 msgr2=0x7fa36c09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:59.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa373800640 1 -- 172.21.15.170:0/131661968 shutdown_connections 2024-04-26T23:40:59.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa373800640 1 -- 172.21.15.170:0/131661968 wait complete. 2024-04-26T23:40:59.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa373800640 1 Processor -- start 2024-04-26T23:40:59.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa373800640 1 -- start start 2024-04-26T23:40:59.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa373800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa36c06c610 0x7fa36c0b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa373800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa36c06cc60 0x7fa36c162010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa373800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa36c15f4d0 0x7fa36c15f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa373800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa36c06d480 con 0x7fa36c06c610 2024-04-26T23:40:59.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa373800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa36c0d21f0 con 0x7fa36c15f4d0 2024-04-26T23:40:59.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa373800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa36c14c480 con 0x7fa36c06cc60 2024-04-26T23:40:59.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa36be00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa36c06cc60 0x7fa36c162010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa371800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa36c15f4d0 0x7fa36c15f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa36be00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa36c06cc60 0x7fa36c162010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:36598/0 (socket says 172.21.15.170:36598) 2024-04-26T23:40:59.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa36be00640 1 -- 172.21.15.170:0/515957670 learned_addr learned my addr 172.21.15.170:0/515957670 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T23:40:59.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.287+0000 7fa370e00640 1 --2- 172.21.15.170:0/515957670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa36c06c610 0x7fa36c0b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.291+0000 7fa36be00640 1 -- 172.21.15.170:0/515957670 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa36c06cc60 msgr2=0x7fa36c162010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.291+0000 7fa36be00640 1 -- 172.21.15.170:0/515957670 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa36c06cc60 msgr2=0x7fa36c162010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.291+0000 7fa36be00640 1 --2- 172.21.15.170:0/515957670 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa36c06cc60 0x7fa36c162010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.291+0000 7fa36be00640 1 --2- 172.21.15.170:0/515957670 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa36c06cc60 0x7fa36c162010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.291+0000 7fa370e00640 1 -- 172.21.15.170:0/515957670 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa36c06cc60 msgr2=0x7fa36c162010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.291+0000 7fa370e00640 1 --2- 172.21.15.170:0/515957670 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa36c06cc60 0x7fa36c162010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.291+0000 7fa370e00640 1 -- 172.21.15.170:0/515957670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa36c15f4d0 msgr2=0x7fa36c15f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.291+0000 7fa370e00640 1 --2- 172.21.15.170:0/515957670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa36c15f4d0 0x7fa36c15f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.291+0000 7fa370e00640 1 -- 172.21.15.170:0/515957670 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa36c1607c0 con 0x7fa36c06c610 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.291+0000 7fa370e00640 1 --2- 172.21.15.170:0/515957670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa36c06c610 0x7fa36c0b1a80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa36000e8a0 tx=0x7fa36000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:59.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.291+0000 7fa368c00640 1 -- 172.21.15.170:0/515957670 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa360017070 con 0x7fa36c06c610 2024-04-26T23:40:59.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.291+0000 7fa368c00640 1 -- 172.21.15.170:0/515957670 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36000c940 con 0x7fa36c06c610 2024-04-26T23:40:59.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.291+0000 7fa373800640 1 -- 172.21.15.170:0/515957670 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa36c15ab10 con 0x7fa36c06c610 2024-04-26T23:40:59.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.291+0000 7fa368c00640 1 -- 172.21.15.170:0/515957670 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36000ccf0 con 0x7fa36c06c610 2024-04-26T23:40:59.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.291+0000 7fa373800640 1 -- 172.21.15.170:0/515957670 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa36c15b0d0 con 0x7fa36c06c610 2024-04-26T23:40:59.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.291+0000 7fa368c00640 1 -- 172.21.15.170:0/515957670 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa36001a070 con 0x7fa36c06c610 2024-04-26T23:40:59.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.291+0000 7fa368c00640 1 -- 172.21.15.170:0/515957670 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fa36001c860 con 0x7fa36c06c610 2024-04-26T23:40:59.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.291+0000 7fa373800640 1 -- 172.21.15.170:0/515957670 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa36c06a410 con 0x7fa36c06c610 2024-04-26T23:40:59.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.295+0000 7fa368c00640 1 -- 172.21.15.170:0/515957670 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa360013470 con 0x7fa36c06c610 2024-04-26T23:40:59.303 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:40:59.299+0000 7f24b0454180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T23:40:59.328 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:40:59.323+0000 7f1b8ae55180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T23:40:59.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.359+0000 7fa373800640 1 -- 172.21.15.170:0/515957670 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22", "id": 0} v 0) -- 0x7fa36c0cf8a0 con 0x7fa36c06c610 2024-04-26T23:40:59.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.363+0000 7fa368c00640 1 -- 172.21.15.170:0/515957670 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fa3600059a0 con 0x7fa36c06c610 2024-04-26T23:40:59.367 INFO:teuthology.orchestra.run.smithi170.stdout:0 2024-04-26T23:40:59.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.363+0000 7fa373800640 1 -- 172.21.15.170:0/515957670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa36c06c610 msgr2=0x7fa36c0b1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.363+0000 7fa373800640 1 --2- 172.21.15.170:0/515957670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa36c06c610 0x7fa36c0b1a80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa36000e8a0 tx=0x7fa36000ed60 comp rx=0 tx=0).stop 2024-04-26T23:40:59.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.363+0000 7fa373800640 1 -- 172.21.15.170:0/515957670 shutdown_connections 2024-04-26T23:40:59.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.363+0000 7fa373800640 1 --2- 172.21.15.170:0/515957670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa36c15f4d0 0x7fa36c15f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.363+0000 7fa373800640 1 --2- 172.21.15.170:0/515957670 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa36c06cc60 0x7fa36c162010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.363+0000 7fa373800640 1 --2- 172.21.15.170:0/515957670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa36c06c610 0x7fa36c0b1a80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.363+0000 7fa373800640 1 -- 172.21.15.170:0/515957670 >> 172.21.15.170:0/515957670 conn(0x7fa36c09ba60 msgr2=0x7fa36c0b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:59.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.363+0000 7fa373800640 1 -- 172.21.15.170:0/515957670 shutdown_connections 2024-04-26T23:40:59.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.363+0000 7fa373800640 1 -- 172.21.15.170:0/515957670 wait complete. 2024-04-26T23:40:59.387 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 82c58162-4c7b-4145-b65b-f1e4b5218edb 1 2024-04-26T23:40:59.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.519+0000 7ff185000640 1 Processor -- start 2024-04-26T23:40:59.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.519+0000 7ff185000640 1 -- start start 2024-04-26T23:40:59.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.519+0000 7ff185000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff18006f000 0x7ff180071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.519+0000 7ff185000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1800af180 0x7ff1800af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.519+0000 7ff185000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1800b1610 con 0x7ff18006d410 2024-04-26T23:40:59.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.519+0000 7ff185000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff18015d8a0 con 0x7ff18006f000 2024-04-26T23:40:59.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.519+0000 7ff185000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff18015db80 con 0x7ff1800af180 2024-04-26T23:40:59.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.519+0000 7ff17e800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1800af180 0x7ff1800af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.519+0000 7ff177e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff18006f000 0x7ff180071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.519+0000 7ff17de00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7ff18006d410 0x7ff18006d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51134/0 (socket says 172.21.15.170:51134) 2024-04-26T23:40:59.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.519+0000 7ff17de00640 1 -- 172.21.15.170:0/2667681386 learned_addr learned my addr 172.21.15.170:0/2667681386 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T23:40:59.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.519+0000 7ff17e800640 1 -- 172.21.15.170:0/2667681386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1800af180 msgr2=0x7ff1800af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:40:59.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.519+0000 7ff17e800640 1 -- 172.21.15.170:0/2667681386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1800af180 msgr2=0x7ff1800af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:40:59.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.519+0000 7ff17e800640 1 --2- 172.21.15.170:0/2667681386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1800af180 0x7ff1800af5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:40:59.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.519+0000 7ff17e800640 1 --2- 172.21.15.170:0/2667681386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1800af180 0x7ff1800af5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:40:59.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.519+0000 7ff177e00640 1 -- 172.21.15.170:0/2667681386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1800af180 msgr2=0x7ff1800af5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:40:59.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.519+0000 7ff177e00640 1 --2- 172.21.15.170:0/2667681386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1800af180 0x7ff1800af5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.519+0000 7ff177e00640 1 -- 172.21.15.170:0/2667681386 >> v1:172.21.15.170:6789/0 conn(0x7ff18006d410 legacy=0x7ff18006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:59.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.519+0000 7ff177e00640 1 -- 172.21.15.170:0/2667681386 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18015de60 con 0x7ff18006f000 2024-04-26T23:40:59.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.523+0000 7ff177e00640 1 --2- 172.21.15.170:0/2667681386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff18006f000 0x7ff180071780 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff1680097c0 tx=0x7ff16801c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a1fe51e5f78395c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:59.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.523+0000 7ff17d400640 1 -- 172.21.15.170:0/2667681386 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1680b1070 con 0x7ff18006f000 2024-04-26T23:40:59.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.523+0000 7ff17d400640 1 -- 172.21.15.170:0/2667681386 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1680ac640 con 0x7ff18006f000 2024-04-26T23:40:59.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.523+0000 7ff17d400640 1 -- 172.21.15.170:0/2667681386 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1680aca10 con 0x7ff18006f000 2024-04-26T23:40:59.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.523+0000 7ff185000640 1 -- 172.21.15.170:0/2667681386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff18006f000 msgr2=0x7ff180071780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.523+0000 7ff185000640 1 --2- 172.21.15.170:0/2667681386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff18006f000 0x7ff180071780 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff1680097c0 tx=0x7ff16801c460 comp rx=0 tx=0).stop 2024-04-26T23:40:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.523+0000 7ff185000640 1 -- 172.21.15.170:0/2667681386 shutdown_connections 2024-04-26T23:40:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.523+0000 7ff185000640 1 --2- 172.21.15.170:0/2667681386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1800af180 0x7ff1800af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.523+0000 7ff185000640 1 --2- 172.21.15.170:0/2667681386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff18006f000 0x7ff180071780 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.523+0000 7ff185000640 1 -- 172.21.15.170:0/2667681386 >> 172.21.15.170:0/2667681386 conn(0x7ff180073160 msgr2=0x7ff180073570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.523+0000 7ff185000640 1 -- 172.21.15.170:0/2667681386 shutdown_connections 2024-04-26T23:40:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.523+0000 7ff185000640 1 -- 172.21.15.170:0/2667681386 wait complete. 2024-04-26T23:40:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff185000640 1 Processor -- start 2024-04-26T23:40:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff185000640 1 -- start start 2024-04-26T23:40:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff185000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff18006d410 0x7ff1800b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff185000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff18006f000 0x7ff18015a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff185000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1800af180 0x7ff180147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff185000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff180169e50 con 0x7ff18006f000 2024-04-26T23:40:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff185000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff180169cd0 con 0x7ff1800af180 2024-04-26T23:40:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff185000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff180169fd0 con 0x7ff18006d410 2024-04-26T23:40:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff17e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1800af180 0x7ff180147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff17de00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff18006d410 0x7ff1800b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff17e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1800af180 0x7ff180147790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36208/0 (socket says 172.21.15.170:36208) 2024-04-26T23:40:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff17e800640 1 -- 172.21.15.170:0/4017006165 learned_addr learned my addr 172.21.15.170:0/4017006165 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T23:40:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff17de00640 1 -- 172.21.15.170:0/4017006165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff18006d410 msgr2=0x7ff1800b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-26T23:40:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff17de00640 1 -- 172.21.15.170:0/4017006165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff18006d410 msgr2=0x7ff1800b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:40:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff17de00640 1 --2- 172.21.15.170:0/4017006165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff18006d410 0x7ff1800b5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:40:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff177e00640 1 --2- 172.21.15.170:0/4017006165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff18006f000 0x7ff18015a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff17de00640 1 --2- 172.21.15.170:0/4017006165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff18006d410 0x7ff1800b5dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:40:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff17e800640 1 -- 172.21.15.170:0/4017006165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff18006d410 msgr2=0x7ff1800b5dc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:40:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff17e800640 1 --2- 172.21.15.170:0/4017006165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff18006d410 0x7ff1800b5dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff17e800640 1 -- 172.21.15.170:0/4017006165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff18006f000 msgr2=0x7ff18015a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff17e800640 1 --2- 172.21.15.170:0/4017006165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff18006f000 0x7ff18015a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff17e800640 1 -- 172.21.15.170:0/4017006165 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1800b6430 con 0x7ff1800af180 2024-04-26T23:40:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff177e00640 1 --2- 172.21.15.170:0/4017006165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff18006f000 0x7ff18015a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff17e800640 1 --2- 172.21.15.170:0/4017006165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1800af180 0x7ff180147790 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff178007e30 tx=0x7ff17800e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff176000640 1 -- 172.21.15.170:0/4017006165 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff178014420 con 0x7ff1800af180 2024-04-26T23:40:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff176000640 1 -- 172.21.15.170:0/4017006165 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff178019070 con 0x7ff1800af180 2024-04-26T23:40:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff185000640 1 -- 172.21.15.170:0/4017006165 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1800b6710 con 0x7ff1800af180 2024-04-26T23:40:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff176000640 1 -- 172.21.15.170:0/4017006165 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff178014820 con 0x7ff1800af180 2024-04-26T23:40:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff185000640 1 -- 172.21.15.170:0/4017006165 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1800b6cd0 con 0x7ff1800af180 2024-04-26T23:40:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff176000640 1 -- 172.21.15.170:0/4017006165 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff1780149c0 con 0x7ff1800af180 2024-04-26T23:40:59.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.527+0000 7ff176000640 1 -- 172.21.15.170:0/4017006165 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7ff17801d3c0 con 0x7ff1800af180 2024-04-26T23:40:59.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.531+0000 7ff185000640 1 -- 172.21.15.170:0/4017006165 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff18006a410 con 0x7ff1800af180 2024-04-26T23:40:59.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.531+0000 7ff176000640 1 -- 172.21.15.170:0/4017006165 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ff17801e460 con 0x7ff1800af180 2024-04-26T23:40:59.538 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:40:59.535+0000 7f24b0454180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T23:40:59.538 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:40:59.535+0000 7f1b8ae55180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T23:40:59.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.603+0000 7ff185000640 1 -- 172.21.15.170:0/4017006165 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "82c58162-4c7b-4145-b65b-f1e4b5218edb", "id": 1} v 0) -- 0x7ff18009fe20 con 0x7ff1800af180 2024-04-26T23:40:59.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.611+0000 7ff176000640 1 -- 172.21.15.170:0/4017006165 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "82c58162-4c7b-4145-b65b-f1e4b5218edb", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7ff17801e640 con 0x7ff1800af180 2024-04-26T23:40:59.615 INFO:teuthology.orchestra.run.smithi170.stdout:1 2024-04-26T23:40:59.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.611+0000 7ff185000640 1 -- 172.21.15.170:0/4017006165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1800af180 msgr2=0x7ff180147790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.611+0000 7ff185000640 1 --2- 172.21.15.170:0/4017006165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1800af180 0x7ff180147790 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff178007e30 tx=0x7ff17800e4b0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.611+0000 7ff185000640 1 -- 172.21.15.170:0/4017006165 shutdown_connections 2024-04-26T23:40:59.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.611+0000 7ff185000640 1 --2- 172.21.15.170:0/4017006165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff18006f000 0x7ff18015a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.611+0000 7ff185000640 1 --2- 172.21.15.170:0/4017006165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1800af180 0x7ff180147790 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.611+0000 7ff185000640 1 --2- 172.21.15.170:0/4017006165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff18006d410 0x7ff1800b5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.611+0000 7ff185000640 1 -- 172.21.15.170:0/4017006165 >> 172.21.15.170:0/4017006165 conn(0x7ff180073160 msgr2=0x7ff18006f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:59.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.611+0000 7ff185000640 1 -- 172.21.15.170:0/4017006165 shutdown_connections 2024-04-26T23:40:59.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.611+0000 7ff185000640 1 -- 172.21.15.170:0/4017006165 wait complete. 2024-04-26T23:40:59.634 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new cf9165b2-8592-4bf9-b097-e0fb78f0d2f7 2 2024-04-26T23:40:59.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.763+0000 7fbfd9200640 1 Processor -- start 2024-04-26T23:40:59.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.763+0000 7fbfd9200640 1 -- start start 2024-04-26T23:40:59.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.767+0000 7fbfd9200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbfd4160450 0x7fbfd40d3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.767+0000 7fbfd9200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbfd40d19c0 0x7fbfd40b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.767+0000 7fbfd9200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfd40b0cb0 con 0x7fbfd40b0470 2024-04-26T23:40:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.767+0000 7fbfd9200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fbfd40b0f90 con 0x7fbfd4160450 2024-04-26T23:40:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.767+0000 7fbfd9200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fbfd40b1270 con 0x7fbfd40d19c0 2024-04-26T23:40:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.767+0000 7fbfcbe00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fbfd40b0470 0x7fbfd40d12b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:59822/0 (socket says 172.21.15.170:59822) 2024-04-26T23:40:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.767+0000 7fbfcbe00640 1 -- 172.21.15.170:0/2156536938 learned_addr learned my addr 172.21.15.170:0/2156536938 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T23:40:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.767+0000 7fbfd2800640 1 --2- 172.21.15.170:0/2156536938 >> v2:172.21.15.170:3300/0 conn(0x7fbfd40d19c0 0x7fbfd40b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.767+0000 7fbfd1e00640 1 --2- 172.21.15.170:0/2156536938 >> v2:172.21.15.137:3300/0 conn(0x7fbfd4160450 0x7fbfd40d3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.767+0000 7fbfd1400640 1 -- 172.21.15.170:0/2156536938 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3368556485 0 0) 0x7fbfd40b0cb0 con 0x7fbfd40b0470 2024-04-26T23:40:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.767+0000 7fbfd1400640 1 -- 172.21.15.170:0/2156536938 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfb8003530 con 0x7fbfd40b0470 2024-04-26T23:40:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.767+0000 7fbfd2800640 1 -- 172.21.15.170:0/2156536938 >> v2:172.21.15.137:3300/0 conn(0x7fbfd4160450 msgr2=0x7fbfd40d3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.767+0000 7fbfd2800640 1 --2- 172.21.15.170:0/2156536938 >> v2:172.21.15.137:3300/0 conn(0x7fbfd4160450 0x7fbfd40d3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.767+0000 7fbfd2800640 1 -- 172.21.15.170:0/2156536938 >> v1:172.21.15.170:6789/0 conn(0x7fbfd40b0470 legacy=0x7fbfd40d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.767+0000 7fbfd2800640 1 -- 172.21.15.170:0/2156536938 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd40b1550 con 0x7fbfd40d19c0 2024-04-26T23:40:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.767+0000 7fbfd1e00640 1 --2- 172.21.15.170:0/2156536938 >> v2:172.21.15.137:3300/0 conn(0x7fbfd4160450 0x7fbfd40d3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:59.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.771+0000 7fbfd2800640 1 --2- 172.21.15.170:0/2156536938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfd40d19c0 0x7fbfd40b2130 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40cd370 tx=0x7fbfcc01c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e58d50b9ab4d57 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:59.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.771+0000 7fbfd1400640 1 -- 172.21.15.170:0/2156536938 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0ad070 con 0x7fbfd40d19c0 2024-04-26T23:40:59.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.771+0000 7fbfd1400640 1 -- 172.21.15.170:0/2156536938 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfcc0a9620 con 0x7fbfd40d19c0 2024-04-26T23:40:59.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.771+0000 7fbfd1400640 1 -- 172.21.15.170:0/2156536938 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0a99f0 con 0x7fbfd40d19c0 2024-04-26T23:40:59.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.771+0000 7fbfd9200640 1 -- 172.21.15.170:0/2156536938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfd40d19c0 msgr2=0x7fbfd40b2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.771+0000 7fbfd9200640 1 --2- 172.21.15.170:0/2156536938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfd40d19c0 0x7fbfd40b2130 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40cd370 tx=0x7fbfcc01c900 comp rx=0 tx=0).stop 2024-04-26T23:40:59.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.771+0000 7fbfd9200640 1 -- 172.21.15.170:0/2156536938 shutdown_connections 2024-04-26T23:40:59.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.771+0000 7fbfd9200640 1 --2- 172.21.15.170:0/2156536938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfd40d19c0 0x7fbfd40b2130 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.771+0000 7fbfd9200640 1 --2- 172.21.15.170:0/2156536938 >> v2:172.21.15.137:3300/0 conn(0x7fbfd4160450 0x7fbfd40d3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.771+0000 7fbfd9200640 1 -- 172.21.15.170:0/2156536938 >> 172.21.15.170:0/2156536938 conn(0x7fbfd409ba60 msgr2=0x7fbfd409be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:59.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.771+0000 7fbfd9200640 1 -- 172.21.15.170:0/2156536938 shutdown_connections 2024-04-26T23:40:59.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.771+0000 7fbfd9200640 1 -- 172.21.15.170:0/2156536938 wait complete. 2024-04-26T23:40:59.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.771+0000 7fbfd9200640 1 Processor -- start 2024-04-26T23:40:59.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.771+0000 7fbfd9200640 1 -- start start 2024-04-26T23:40:59.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.771+0000 7fbfd9200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfd40b0470 0x7fbfd41567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.771+0000 7fbfd9200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfd40d19c0 0x7fbfd414e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.771+0000 7fbfd9200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd4160450 0x7fbfd415ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.771+0000 7fbfd9200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd41609b0 con 0x7fbfd4160450 2024-04-26T23:40:59.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.771+0000 7fbfd9200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd4160830 con 0x7fbfd40d19c0 2024-04-26T23:40:59.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.771+0000 7fbfd9200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbfd4169dd0 con 0x7fbfd40b0470 2024-04-26T23:40:59.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.771+0000 7fbfd1e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfd40b0470 0x7fbfd41567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.775+0000 7fbfcbe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfd40d19c0 0x7fbfd414e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.775+0000 7fbfd1e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfd40b0470 0x7fbfd41567c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:33910/0 (socket says 172.21.15.170:33910) 2024-04-26T23:40:59.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.775+0000 7fbfd1e00640 1 -- 172.21.15.170:0/610971747 learned_addr learned my addr 172.21.15.170:0/610971747 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T23:40:59.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.775+0000 7fbfd2800640 1 --2- 172.21.15.170:0/610971747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd4160450 0x7fbfd415ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.775+0000 7fbfd1e00640 1 -- 172.21.15.170:0/610971747 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfd40b0470 msgr2=0x7fbfd41567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-26T23:40:59.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.775+0000 7fbfd1e00640 1 -- 172.21.15.170:0/610971747 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfd40b0470 msgr2=0x7fbfd41567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:40:59.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.775+0000 7fbfd1e00640 1 --2- 172.21.15.170:0/610971747 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfd40b0470 0x7fbfd41567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:40:59.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.775+0000 7fbfd1e00640 1 --2- 172.21.15.170:0/610971747 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfd40b0470 0x7fbfd41567c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:40:59.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.775+0000 7fbfcbe00640 1 -- 172.21.15.170:0/610971747 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfd40b0470 msgr2=0x7fbfd41567c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:40:59.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.775+0000 7fbfcbe00640 1 --2- 172.21.15.170:0/610971747 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfd40b0470 0x7fbfd41567c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.775+0000 7fbfcbe00640 1 -- 172.21.15.170:0/610971747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd4160450 msgr2=0x7fbfd415ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.775+0000 7fbfcbe00640 1 --2- 172.21.15.170:0/610971747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd4160450 0x7fbfd415ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.775+0000 7fbfcbe00640 1 -- 172.21.15.170:0/610971747 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd406e370 con 0x7fbfd40d19c0 2024-04-26T23:40:59.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.775+0000 7fbfcbe00640 1 --2- 172.21.15.170:0/610971747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfd40d19c0 0x7fbfd414e430 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc007fd0 tx=0x7fbfbc00c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:59.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.775+0000 7fbfca000640 1 -- 172.21.15.170:0/610971747 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc017070 con 0x7fbfd40d19c0 2024-04-26T23:40:59.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.775+0000 7fbfca000640 1 -- 172.21.15.170:0/610971747 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfbc005cf0 con 0x7fbfd40d19c0 2024-04-26T23:40:59.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.775+0000 7fbfd9200640 1 -- 172.21.15.170:0/610971747 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfd4156d00 con 0x7fbfd40d19c0 2024-04-26T23:40:59.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.775+0000 7fbfca000640 1 -- 172.21.15.170:0/610971747 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc0072f0 con 0x7fbfd40d19c0 2024-04-26T23:40:59.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.775+0000 7fbfd9200640 1 -- 172.21.15.170:0/610971747 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfd4158880 con 0x7fbfd40d19c0 2024-04-26T23:40:59.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.775+0000 7fbfca000640 1 -- 172.21.15.170:0/610971747 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbfbc01a070 con 0x7fbfd40d19c0 2024-04-26T23:40:59.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.775+0000 7fbfca000640 1 -- 172.21.15.170:0/610971747 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fbfbc01c860 con 0x7fbfd40d19c0 2024-04-26T23:40:59.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.775+0000 7fbfd9200640 1 -- 172.21.15.170:0/610971747 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfd406a410 con 0x7fbfd40d19c0 2024-04-26T23:40:59.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.779+0000 7fbfca000640 1 -- 172.21.15.170:0/610971747 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fbfbc021070 con 0x7fbfd40d19c0 2024-04-26T23:40:59.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.843+0000 7fbfd9200640 1 -- 172.21.15.170:0/610971747 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cf9165b2-8592-4bf9-b097-e0fb78f0d2f7", "id": 2} v 0) -- 0x7fbfd40d3670 con 0x7fbfd40d19c0 2024-04-26T23:40:59.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.847+0000 7fbfca000640 1 -- 172.21.15.170:0/610971747 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cf9165b2-8592-4bf9-b097-e0fb78f0d2f7", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fbfbc0075a0 con 0x7fbfd40d19c0 2024-04-26T23:40:59.852 INFO:teuthology.orchestra.run.smithi170.stdout:2 2024-04-26T23:40:59.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.851+0000 7fbfd9200640 1 -- 172.21.15.170:0/610971747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfd40d19c0 msgr2=0x7fbfd414e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.851+0000 7fbfd9200640 1 --2- 172.21.15.170:0/610971747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfd40d19c0 0x7fbfd414e430 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc007fd0 tx=0x7fbfbc00c890 comp rx=0 tx=0).stop 2024-04-26T23:40:59.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.851+0000 7fbfd9200640 1 -- 172.21.15.170:0/610971747 shutdown_connections 2024-04-26T23:40:59.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.851+0000 7fbfd9200640 1 --2- 172.21.15.170:0/610971747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfd4160450 0x7fbfd415ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.851+0000 7fbfd9200640 1 --2- 172.21.15.170:0/610971747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfd40d19c0 0x7fbfd414e430 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.851+0000 7fbfd9200640 1 --2- 172.21.15.170:0/610971747 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfd40b0470 0x7fbfd41567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.851+0000 7fbfd9200640 1 -- 172.21.15.170:0/610971747 >> 172.21.15.170:0/610971747 conn(0x7fbfd409ba60 msgr2=0x7fbfd40b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:59.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.851+0000 7fbfd9200640 1 -- 172.21.15.170:0/610971747 shutdown_connections 2024-04-26T23:40:59.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:40:59.851+0000 7fbfd9200640 1 -- 172.21.15.170:0/610971747 wait complete. 2024-04-26T23:40:59.872 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new ce01b13c-4107-4227-a697-3a6b402bc7a7 3 2024-04-26T23:41:00.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.003+0000 7f8c6ca00640 1 Processor -- start 2024-04-26T23:41:00.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.003+0000 7f8c6ca00640 1 -- start start 2024-04-26T23:41:00.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c6ca00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c680b4dc0 0x7f8c68070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:00.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c6ca00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c680b6bc0 con 0x7f8c68159570 2024-04-26T23:41:00.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c6ca00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c6815f650 con 0x7f8c68075380 2024-04-26T23:41:00.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c6ca00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8c6806cb10 con 0x7f8c680b4dc0 2024-04-26T23:41:00.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c65400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c680b4dc0 0x7f8c68070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:00.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c66800640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f8c68075380 0x7f8c6815fb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:59832/0 (socket says 172.21.15.170:59832) 2024-04-26T23:41:00.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c66800640 1 -- 172.21.15.170:0/2504323533 learned_addr learned my addr 172.21.15.170:0/2504323533 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T23:41:00.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c65400640 1 -- 172.21.15.170:0/2504323533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c680b4dc0 msgr2=0x7f8c68070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:41:00.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c65400640 1 -- 172.21.15.170:0/2504323533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c680b4dc0 msgr2=0x7f8c68070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:41:00.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c65400640 1 --2- 172.21.15.170:0/2504323533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c680b4dc0 0x7f8c68070bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:41:00.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c65400640 1 --2- 172.21.15.170:0/2504323533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c680b4dc0 0x7f8c68070bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:41:00.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c64a00640 1 -- 172.21.15.170:0/2504323533 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3187969767 0 0) 0x7f8c6815f650 con 0x7f8c68075380 2024-04-26T23:41:00.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c64a00640 1 -- 172.21.15.170:0/2504323533 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c4c003530 con 0x7f8c68075380 2024-04-26T23:41:00.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c64a00640 1 -- 172.21.15.170:0/2504323533 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 526885803 0 0) 0x7f8c680b6bc0 con 0x7f8c68159570 2024-04-26T23:41:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c64a00640 1 -- 172.21.15.170:0/2504323533 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c6815f650 con 0x7f8c68159570 2024-04-26T23:41:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c64a00640 1 -- 172.21.15.170:0/2504323533 <== mon.1 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3612601050 0 0) 0x7f8c4c003530 con 0x7f8c68075380 2024-04-26T23:41:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c64a00640 1 -- 172.21.15.170:0/2504323533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c680b4dc0 msgr2=0x7f8c68070bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:41:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c64a00640 1 --2- 172.21.15.170:0/2504323533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c680b4dc0 0x7f8c68070bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c64a00640 1 -- 172.21.15.170:0/2504323533 >> v1:172.21.15.137:6789/0 conn(0x7f8c68159570 legacy=0x7f8c6806c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c64a00640 1 -- 172.21.15.170:0/2504323533 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c680b6e30 con 0x7f8c68075380 2024-04-26T23:41:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c64a00640 1 -- 172.21.15.170:0/2504323533 <== mon.1 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f8c60001a00 con 0x7f8c68075380 2024-04-26T23:41:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c64a00640 1 -- 172.21.15.170:0/2504323533 >> v1:172.21.15.170:6789/0 conn(0x7f8c68075380 legacy=0x7f8c6815fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c64a00640 1 --2- 172.21.15.170:0/2504323533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c680b4dc0 0x7f8c4c004be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c64a00640 1 --2- 172.21.15.170:0/2504323533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c4c005120 0x7f8c4c0037b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c64a00640 1 --2- 172.21.15.170:0/2504323533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c4c003cf0 0x7f8c4c004170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c64a00640 1 -- 172.21.15.170:0/2504323533 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6806cb10 con 0x7f8c4c003cf0 2024-04-26T23:41:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c64a00640 1 -- 172.21.15.170:0/2504323533 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c00bae0 con 0x7f8c4c005120 2024-04-26T23:41:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c64a00640 1 -- 172.21.15.170:0/2504323533 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8c4c00bce0 con 0x7f8c680b4dc0 2024-04-26T23:41:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c65e00640 1 --2- 172.21.15.170:0/2504323533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c680b4dc0 0x7f8c4c004be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:00.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c65400640 1 --2- 172.21.15.170:0/2504323533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c4c005120 0x7f8c4c0037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:00.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c66800640 1 --2- 172.21.15.170:0/2504323533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c4c003cf0 0x7f8c4c004170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:00.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c65e00640 1 -- 172.21.15.170:0/2504323533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c4c005120 msgr2=0x7f8c4c0037b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:00.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c65e00640 1 --2- 172.21.15.170:0/2504323533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c4c005120 0x7f8c4c0037b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c65e00640 1 -- 172.21.15.170:0/2504323533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c4c003cf0 msgr2=0x7f8c4c004170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:00.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c65e00640 1 --2- 172.21.15.170:0/2504323533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c4c003cf0 0x7f8c4c004170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.007+0000 7f8c65e00640 1 -- 172.21.15.170:0/2504323533 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4c003530 con 0x7f8c680b4dc0 2024-04-26T23:41:00.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.011+0000 7f8c65e00640 1 --2- 172.21.15.170:0/2504323533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c680b4dc0 0x7f8c4c004be0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8c58007ee0 tx=0x7f8c5801ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e290707f676e9f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:00.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.011+0000 7f8c64a00640 1 -- 172.21.15.170:0/2504323533 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58007ae0 con 0x7f8c680b4dc0 2024-04-26T23:41:00.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.011+0000 7f8c64a00640 1 -- 172.21.15.170:0/2504323533 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c580a9070 con 0x7f8c680b4dc0 2024-04-26T23:41:00.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.011+0000 7f8c64a00640 1 -- 172.21.15.170:0/2504323533 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c580a5750 con 0x7f8c680b4dc0 2024-04-26T23:41:00.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.011+0000 7f8c6ca00640 1 -- 172.21.15.170:0/2504323533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c680b4dc0 msgr2=0x7f8c4c004be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:00.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.011+0000 7f8c6ca00640 1 --2- 172.21.15.170:0/2504323533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c680b4dc0 0x7f8c4c004be0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8c58007ee0 tx=0x7f8c5801ca60 comp rx=0 tx=0).stop 2024-04-26T23:41:00.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.011+0000 7f8c66800640 1 -- 172.21.15.170:0/2504323533 reap_dead start 2024-04-26T23:41:00.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.011+0000 7f8c6ca00640 1 -- 172.21.15.170:0/2504323533 shutdown_connections 2024-04-26T23:41:00.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.011+0000 7f8c6ca00640 1 -- 172.21.15.170:0/2504323533 >> 172.21.15.170:0/2504323533 conn(0x7f8c680d1db0 msgr2=0x7f8c680d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:00.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.011+0000 7f8c6ca00640 1 -- 172.21.15.170:0/2504323533 shutdown_connections 2024-04-26T23:41:00.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.011+0000 7f8c6ca00640 1 -- 172.21.15.170:0/2504323533 wait complete. 2024-04-26T23:41:00.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.011+0000 7f8c6ca00640 1 Processor -- start 2024-04-26T23:41:00.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c6ca00640 1 -- start start 2024-04-26T23:41:00.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c6ca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c680b4dc0 0x7f8c681f5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:00.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c6ca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c68156f20 0x7f8c680b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:00.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c6ca00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c6815c810 0x7f8c680b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:00.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c6ca00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8c680b55d0 con 0x7f8c68156f20 2024-04-26T23:41:00.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c6ca00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8c680b5450 con 0x7f8c680b4dc0 2024-04-26T23:41:00.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c6ca00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8c68159950 con 0x7f8c6815c810 2024-04-26T23:41:00.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c66800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c6815c810 0x7f8c680b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:00.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c65e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c680b4dc0 0x7f8c681f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:00.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c66800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c6815c810 0x7f8c680b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:33932/0 (socket says 172.21.15.170:33932) 2024-04-26T23:41:00.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c66800640 1 -- 172.21.15.170:0/3220016427 learned_addr learned my addr 172.21.15.170:0/3220016427 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T23:41:00.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c65400640 1 --2- 172.21.15.170:0/3220016427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c68156f20 0x7f8c680b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:00.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c66800640 1 -- 172.21.15.170:0/3220016427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c6815c810 msgr2=0x7f8c680b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-26T23:41:00.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c66800640 1 -- 172.21.15.170:0/3220016427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c6815c810 msgr2=0x7f8c680b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:41:00.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c66800640 1 --2- 172.21.15.170:0/3220016427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c6815c810 0x7f8c680b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:41:00.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c66800640 1 --2- 172.21.15.170:0/3220016427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c6815c810 0x7f8c680b2cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:41:00.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c65e00640 1 -- 172.21.15.170:0/3220016427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c6815c810 msgr2=0x7f8c680b2cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:41:00.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c65e00640 1 --2- 172.21.15.170:0/3220016427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c6815c810 0x7f8c680b2cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c65e00640 1 -- 172.21.15.170:0/3220016427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c68156f20 msgr2=0x7f8c680b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:00.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c65e00640 1 --2- 172.21.15.170:0/3220016427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c68156f20 0x7f8c680b27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c65e00640 1 -- 172.21.15.170:0/3220016427 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c680b0cb0 con 0x7f8c680b4dc0 2024-04-26T23:41:00.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c65400640 1 --2- 172.21.15.170:0/3220016427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c68156f20 0x7f8c680b27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:41:00.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c65e00640 1 --2- 172.21.15.170:0/3220016427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c680b4dc0 0x7f8c681f5620 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c00beb0 tx=0x7f8c4c005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:00.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c5e000640 1 -- 172.21.15.170:0/3220016427 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58007ae0 con 0x7f8c680b4dc0 2024-04-26T23:41:00.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c5e000640 1 -- 172.21.15.170:0/3220016427 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c580a5960 con 0x7f8c680b4dc0 2024-04-26T23:41:00.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c6ca00640 1 -- 172.21.15.170:0/3220016427 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c680b0f90 con 0x7f8c680b4dc0 2024-04-26T23:41:00.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c5e000640 1 -- 172.21.15.170:0/3220016427 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c580a5d10 con 0x7f8c680b4dc0 2024-04-26T23:41:00.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c6ca00640 1 -- 172.21.15.170:0/3220016427 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c680b1550 con 0x7f8c680b4dc0 2024-04-26T23:41:00.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c5e000640 1 -- 172.21.15.170:0/3220016427 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8c58003990 con 0x7f8c680b4dc0 2024-04-26T23:41:00.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c5e000640 1 -- 172.21.15.170:0/3220016427 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f8c580aeda0 con 0x7f8c680b4dc0 2024-04-26T23:41:00.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.015+0000 7f8c6ca00640 1 -- 172.21.15.170:0/3220016427 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c6806a410 con 0x7f8c680b4dc0 2024-04-26T23:41:00.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.039+0000 7f8c5e000640 1 -- 172.21.15.170:0/3220016427 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f8c580bf060 con 0x7f8c680b4dc0 2024-04-26T23:41:00.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.107+0000 7f8c6ca00640 1 -- 172.21.15.170:0/3220016427 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ce01b13c-4107-4227-a697-3a6b402bc7a7", "id": 3} v 0) -- 0x7f8c680d21c0 con 0x7f8c680b4dc0 2024-04-26T23:41:00.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.111+0000 7f8c5e000640 1 -- 172.21.15.170:0/3220016427 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ce01b13c-4107-4227-a697-3a6b402bc7a7", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f8c58016770 con 0x7f8c680b4dc0 2024-04-26T23:41:00.115 INFO:teuthology.orchestra.run.smithi170.stdout:3 2024-04-26T23:41:00.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.111+0000 7f8c6ca00640 1 -- 172.21.15.170:0/3220016427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c680b4dc0 msgr2=0x7f8c681f5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:00.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.111+0000 7f8c6ca00640 1 --2- 172.21.15.170:0/3220016427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c680b4dc0 0x7f8c681f5620 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c00beb0 tx=0x7f8c4c005840 comp rx=0 tx=0).stop 2024-04-26T23:41:00.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.111+0000 7f8c6ca00640 1 -- 172.21.15.170:0/3220016427 shutdown_connections 2024-04-26T23:41:00.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.111+0000 7f8c6ca00640 1 --2- 172.21.15.170:0/3220016427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c68156f20 0x7f8c680b27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.111+0000 7f8c6ca00640 1 --2- 172.21.15.170:0/3220016427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c6815c810 0x7f8c680b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.111+0000 7f8c6ca00640 1 --2- 172.21.15.170:0/3220016427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c680b4dc0 0x7f8c681f5620 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.111+0000 7f8c6ca00640 1 -- 172.21.15.170:0/3220016427 >> 172.21.15.170:0/3220016427 conn(0x7f8c680d1db0 msgr2=0x7f8c680aee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:00.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.111+0000 7f8c6ca00640 1 -- 172.21.15.170:0/3220016427 shutdown_connections 2024-04-26T23:41:00.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.111+0000 7f8c6ca00640 1 -- 172.21.15.170:0/3220016427 wait complete. 2024-04-26T23:41:00.135 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new a562f6c7-ff1e-473f-96e7-f87d330a3499 4 2024-04-26T23:41:00.164 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:41:00.159+0000 7f1b8ae55180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T23:41:00.200 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:41:00.195+0000 7f24b0454180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T23:41:00.226 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:41:00.223+0000 7f1b8ae55180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T23:41:00.265 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:41:00.259+0000 7f24b0454180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T23:41:00.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.267+0000 7f8da6c00640 1 Processor -- start 2024-04-26T23:41:00.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.267+0000 7f8da6c00640 1 -- start start 2024-04-26T23:41:00.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.267+0000 7f8da6c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8da0073cd0 0x7f8da00b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:00.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.267+0000 7f8da6c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8da006d410 0x7f8da006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:00.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.267+0000 7f8da6c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8da00b0ee0 con 0x7f8da015f360 2024-04-26T23:41:00.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.267+0000 7f8da6c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8da0163040 con 0x7f8da0073cd0 2024-04-26T23:41:00.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.267+0000 7f8da6c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8da0163be0 con 0x7f8da006d410 2024-04-26T23:41:00.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.267+0000 7f8da4c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8da006d410 0x7f8da006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:00.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.267+0000 7f8da4c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8da006d410 0x7f8da006d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:33934/0 (socket says 172.21.15.170:33934) 2024-04-26T23:41:00.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.267+0000 7f8da4c00640 1 -- 172.21.15.170:0/3002080927 learned_addr learned my addr 172.21.15.170:0/3002080927 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T23:41:00.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.267+0000 7f8d97e00640 1 --2- 172.21.15.170:0/3002080927 >> v2:172.21.15.137:3300/0 conn(0x7f8da0073cd0 0x7f8da00b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:00.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.267+0000 7f8da4c00640 1 -- 172.21.15.170:0/3002080927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8da006d410 msgr2=0x7f8da006d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:41:00.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.267+0000 7f8da4c00640 1 -- 172.21.15.170:0/3002080927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8da006d410 msgr2=0x7f8da006d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:41:00.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.267+0000 7f8da4c00640 1 --2- 172.21.15.170:0/3002080927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8da006d410 0x7f8da006d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:41:00.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.267+0000 7f8da4c00640 1 --2- 172.21.15.170:0/3002080927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8da006d410 0x7f8da006d8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:41:00.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.267+0000 7f8d9f400640 1 -- 172.21.15.170:0/3002080927 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3260634094 0 0) 0x7f8da00b0ee0 con 0x7f8da015f360 2024-04-26T23:41:00.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.267+0000 7f8d9f400640 1 -- 172.21.15.170:0/3002080927 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d84003530 con 0x7f8da015f360 2024-04-26T23:41:00.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.271+0000 7f8d97e00640 1 -- 172.21.15.170:0/3002080927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8da006d410 msgr2=0x7f8da006d8a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:41:00.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.271+0000 7f8d97e00640 1 --2- 172.21.15.170:0/3002080927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8da006d410 0x7f8da006d8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.271+0000 7f8d97e00640 1 -- 172.21.15.170:0/3002080927 >> v1:172.21.15.137:6789/0 conn(0x7f8da015f360 legacy=0x7f8da01634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:00.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.271+0000 7f8d97e00640 1 -- 172.21.15.170:0/3002080927 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da00b6f60 con 0x7f8da0073cd0 2024-04-26T23:41:00.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.275+0000 7f8d97e00640 1 --2- 172.21.15.170:0/3002080927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8da0073cd0 0x7f8da00b1170 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8d880097c0 tx=0x7f8d8801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfab912bb2e44c84 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:00.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.275+0000 7f8d9f400640 1 -- 172.21.15.170:0/3002080927 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d880b0070 con 0x7f8da0073cd0 2024-04-26T23:41:00.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.275+0000 7f8d9f400640 1 -- 172.21.15.170:0/3002080927 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d880ab600 con 0x7f8da0073cd0 2024-04-26T23:41:00.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.275+0000 7f8d9f400640 1 -- 172.21.15.170:0/3002080927 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d880ab9b0 con 0x7f8da0073cd0 2024-04-26T23:41:00.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.275+0000 7f8da6c00640 1 -- 172.21.15.170:0/3002080927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8da0073cd0 msgr2=0x7f8da00b1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:00.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.275+0000 7f8da6c00640 1 --2- 172.21.15.170:0/3002080927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8da0073cd0 0x7f8da00b1170 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8d880097c0 tx=0x7f8d8801c410 comp rx=0 tx=0).stop 2024-04-26T23:41:00.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.275+0000 7f8da6c00640 1 -- 172.21.15.170:0/3002080927 shutdown_connections 2024-04-26T23:41:00.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.275+0000 7f8da6c00640 1 --2- 172.21.15.170:0/3002080927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8da006d410 0x7f8da006d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.275+0000 7f8da6c00640 1 --2- 172.21.15.170:0/3002080927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8da0073cd0 0x7f8da00b1170 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.275+0000 7f8da6c00640 1 -- 172.21.15.170:0/3002080927 >> 172.21.15.170:0/3002080927 conn(0x7f8da00731b0 msgr2=0x7f8da00735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:00.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.275+0000 7f8da6c00640 1 -- 172.21.15.170:0/3002080927 shutdown_connections 2024-04-26T23:41:00.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.275+0000 7f8da6c00640 1 -- 172.21.15.170:0/3002080927 wait complete. 2024-04-26T23:41:00.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.275+0000 7f8da6c00640 1 Processor -- start 2024-04-26T23:41:00.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.275+0000 7f8da6c00640 1 -- start start 2024-04-26T23:41:00.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8da6c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8da006d410 0x7f8da01529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:00.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8da6c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8da0073cd0 0x7f8da0161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:00.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8da6c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8da015f360 0x7f8da01535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:00.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8da6c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8da016bfe0 con 0x7f8da0073cd0 2024-04-26T23:41:00.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8da6c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8da016be60 con 0x7f8da015f360 2024-04-26T23:41:00.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8da6c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8da016c160 con 0x7f8da006d410 2024-04-26T23:41:00.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8d9fe00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8da006d410 0x7f8da01529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:00.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8da4c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8da015f360 0x7f8da01535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:00.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8d9fe00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8da006d410 0x7f8da01529f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:33944/0 (socket says 172.21.15.170:33944) 2024-04-26T23:41:00.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8d9fe00640 1 -- 172.21.15.170:0/73304705 learned_addr learned my addr 172.21.15.170:0/73304705 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T23:41:00.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8d97e00640 1 --2- 172.21.15.170:0/73304705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8da0073cd0 0x7f8da0161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:00.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8d9fe00640 1 -- 172.21.15.170:0/73304705 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8da006d410 msgr2=0x7f8da01529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-26T23:41:00.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8d9fe00640 1 -- 172.21.15.170:0/73304705 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8da006d410 msgr2=0x7f8da01529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:41:00.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8d9fe00640 1 --2- 172.21.15.170:0/73304705 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8da006d410 0x7f8da01529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:41:00.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8d9fe00640 1 --2- 172.21.15.170:0/73304705 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8da006d410 0x7f8da01529f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:41:00.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8d97e00640 1 -- 172.21.15.170:0/73304705 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8da006d410 msgr2=0x7f8da01529f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:41:00.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8d97e00640 1 --2- 172.21.15.170:0/73304705 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8da006d410 0x7f8da01529f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8d97e00640 1 -- 172.21.15.170:0/73304705 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8da015f360 msgr2=0x7f8da01535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:00.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8d97e00640 1 --2- 172.21.15.170:0/73304705 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8da015f360 0x7f8da01535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8d97e00640 1 -- 172.21.15.170:0/73304705 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da01527e0 con 0x7f8da0073cd0 2024-04-26T23:41:00.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8d97e00640 1 --2- 172.21.15.170:0/73304705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8da0073cd0 0x7f8da0161fa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8da0076460 tx=0x7f8d880191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:00.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8d9cc00640 1 -- 172.21.15.170:0/73304705 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d880b0040 con 0x7f8da0073cd0 2024-04-26T23:41:00.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8d9cc00640 1 -- 172.21.15.170:0/73304705 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d880b9070 con 0x7f8da0073cd0 2024-04-26T23:41:00.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8d9cc00640 1 -- 172.21.15.170:0/73304705 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d880b4630 con 0x7f8da0073cd0 2024-04-26T23:41:00.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8da6c00640 1 -- 172.21.15.170:0/73304705 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da01602a0 con 0x7f8da0073cd0 2024-04-26T23:41:00.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8da6c00640 1 -- 172.21.15.170:0/73304705 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da015f990 con 0x7f8da0073cd0 2024-04-26T23:41:00.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8d9cc00640 1 -- 172.21.15.170:0/73304705 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8d880b47d0 con 0x7f8da0073cd0 2024-04-26T23:41:00.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8d9cc00640 1 -- 172.21.15.170:0/73304705 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f8d880bd3c0 con 0x7f8da0073cd0 2024-04-26T23:41:00.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.279+0000 7f8da6c00640 1 -- 172.21.15.170:0/73304705 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8da006a410 con 0x7f8da0073cd0 2024-04-26T23:41:00.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.283+0000 7f8d9cc00640 1 -- 172.21.15.170:0/73304705 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f8d88016090 con 0x7f8da0073cd0 2024-04-26T23:41:00.287 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:41:00.283+0000 7f1b8ae55180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T23:41:00.331 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:41:00.327+0000 7f24b0454180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T23:41:00.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.351+0000 7f8da6c00640 1 -- 172.21.15.170:0/73304705 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a562f6c7-ff1e-473f-96e7-f87d330a3499", "id": 4} v 0) -- 0x7f8da015f740 con 0x7f8da0073cd0 2024-04-26T23:41:00.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.351+0000 7f8d9cc00640 1 -- 172.21.15.170:0/73304705 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a562f6c7-ff1e-473f-96e7-f87d330a3499", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f8d880b4ac0 con 0x7f8da0073cd0 2024-04-26T23:41:00.356 INFO:teuthology.orchestra.run.smithi170.stdout:4 2024-04-26T23:41:00.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.355+0000 7f8da6c00640 1 -- 172.21.15.170:0/73304705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8da0073cd0 msgr2=0x7f8da0161fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:00.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.355+0000 7f8da6c00640 1 --2- 172.21.15.170:0/73304705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8da0073cd0 0x7f8da0161fa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8da0076460 tx=0x7f8d880191b0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.355+0000 7f8da6c00640 1 -- 172.21.15.170:0/73304705 shutdown_connections 2024-04-26T23:41:00.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.355+0000 7f8da6c00640 1 --2- 172.21.15.170:0/73304705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8da0073cd0 0x7f8da0161fa0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.355+0000 7f8da6c00640 1 --2- 172.21.15.170:0/73304705 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8da015f360 0x7f8da01535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.355+0000 7f8da6c00640 1 --2- 172.21.15.170:0/73304705 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8da006d410 0x7f8da01529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.355+0000 7f8da6c00640 1 -- 172.21.15.170:0/73304705 >> 172.21.15.170:0/73304705 conn(0x7f8da00731b0 msgr2=0x7f8da0075c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:00.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.355+0000 7f8da6c00640 1 -- 172.21.15.170:0/73304705 shutdown_connections 2024-04-26T23:41:00.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.355+0000 7f8da6c00640 1 -- 172.21.15.170:0/73304705 wait complete. 2024-04-26T23:41:00.376 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 6016cfc3-8cd3-418b-8a07-201fadfeade7 5 2024-04-26T23:41:00.377 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:41:00.375+0000 7f1b8ae55180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T23:41:00.424 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:41:00.419+0000 7f24b0454180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T23:41:00.437 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:41:00.431+0000 7f1b8ae55180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T23:41:00.487 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:41:00.483+0000 7f24b0454180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T23:41:00.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.507+0000 7f7907000640 1 Processor -- start 2024-04-26T23:41:00.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.507+0000 7f7907000640 1 -- start start 2024-04-26T23:41:00.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.507+0000 7f7907000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7900071780 0x7f79000af890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:00.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.507+0000 7f7907000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79000b1610 con 0x7f790006f000 2024-04-26T23:41:00.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.507+0000 7f7907000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f790015d8a0 con 0x7f790006d410 2024-04-26T23:41:00.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.507+0000 7f7907000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f790015db80 con 0x7f7900071780 2024-04-26T23:41:00.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.507+0000 7f78ffe00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f790006d410 0x7f790006d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:59844/0 (socket says 172.21.15.170:59844) 2024-04-26T23:41:00.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.507+0000 7f78ffe00640 1 -- 172.21.15.170:0/680680729 learned_addr learned my addr 172.21.15.170:0/680680729 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T23:41:00.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.507+0000 7f7905000640 1 --2- 172.21.15.170:0/680680729 >> v2:172.21.15.170:3300/0 conn(0x7f7900071780 0x7f79000af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:00.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.507+0000 7f78fea00640 1 -- 172.21.15.170:0/680680729 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1201109716 0 0) 0x7f790015d8a0 con 0x7f790006d410 2024-04-26T23:41:00.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.507+0000 7f78fea00640 1 -- 172.21.15.170:0/680680729 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78e4003530 con 0x7f790006d410 2024-04-26T23:41:00.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.507+0000 7f78fea00640 1 -- 172.21.15.170:0/680680729 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4252118129 0 0) 0x7f79000b1610 con 0x7f790006f000 2024-04-26T23:41:00.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.507+0000 7f78fea00640 1 -- 172.21.15.170:0/680680729 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f790015d8a0 con 0x7f790006f000 2024-04-26T23:41:00.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.507+0000 7f7905000640 1 -- 172.21.15.170:0/680680729 >> v1:172.21.15.170:6789/0 conn(0x7f790006d410 legacy=0x7f790006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:00.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.507+0000 7f7905000640 1 -- 172.21.15.170:0/680680729 >> v1:172.21.15.137:6789/0 conn(0x7f790006f000 legacy=0x7f79000af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:00.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.507+0000 7f7905000640 1 -- 172.21.15.170:0/680680729 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790015de60 con 0x7f7900071780 2024-04-26T23:41:00.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.511+0000 7f7905000640 1 --2- 172.21.15.170:0/680680729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7900071780 0x7f79000af890 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009d90 tx=0x7f78f801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74bdbac4d56c8bf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:00.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.511+0000 7f78fea00640 1 -- 172.21.15.170:0/680680729 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f80b2070 con 0x7f7900071780 2024-04-26T23:41:00.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.511+0000 7f78fea00640 1 -- 172.21.15.170:0/680680729 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f80a5830 con 0x7f7900071780 2024-04-26T23:41:00.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.511+0000 7f78fea00640 1 -- 172.21.15.170:0/680680729 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f80a5c00 con 0x7f7900071780 2024-04-26T23:41:00.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.511+0000 7f7907000640 1 -- 172.21.15.170:0/680680729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7900071780 msgr2=0x7f79000af890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:00.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.511+0000 7f7907000640 1 --2- 172.21.15.170:0/680680729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7900071780 0x7f79000af890 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009d90 tx=0x7f78f801c970 comp rx=0 tx=0).stop 2024-04-26T23:41:00.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.511+0000 7f7907000640 1 -- 172.21.15.170:0/680680729 shutdown_connections 2024-04-26T23:41:00.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.511+0000 7f7907000640 1 --2- 172.21.15.170:0/680680729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7900071780 0x7f79000af890 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.511+0000 7f7907000640 1 -- 172.21.15.170:0/680680729 >> 172.21.15.170:0/680680729 conn(0x7f7900073160 msgr2=0x7f7900073570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:00.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.511+0000 7f7907000640 1 -- 172.21.15.170:0/680680729 shutdown_connections 2024-04-26T23:41:00.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.511+0000 7f7907000640 1 -- 172.21.15.170:0/680680729 wait complete. 2024-04-26T23:41:00.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f7907000640 1 Processor -- start 2024-04-26T23:41:00.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f7907000640 1 -- start start 2024-04-26T23:41:00.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f7907000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f790006d410 0x7f79000cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:00.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f7907000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f790006f000 0x7f7900158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:00.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f7907000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7900071780 0x7f7900151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:00.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f7907000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f790016ae60 con 0x7f7900071780 2024-04-26T23:41:00.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f7907000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f790016ace0 con 0x7f790006f000 2024-04-26T23:41:00.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f7907000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f790016afe0 con 0x7f790006d410 2024-04-26T23:41:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f78ffe00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f790006d410 0x7f79000cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f78ff400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f790006f000 0x7f7900158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f78ffe00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f790006d410 0x7f79000cffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:33960/0 (socket says 172.21.15.170:33960) 2024-04-26T23:41:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f78ffe00640 1 -- 172.21.15.170:0/1701644091 learned_addr learned my addr 172.21.15.170:0/1701644091 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T23:41:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f7905000640 1 --2- 172.21.15.170:0/1701644091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7900071780 0x7f7900151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f78ffe00640 1 -- 172.21.15.170:0/1701644091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f790006d410 msgr2=0x7f79000cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-26T23:41:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f78ffe00640 1 -- 172.21.15.170:0/1701644091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f790006d410 msgr2=0x7f79000cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:41:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f78ffe00640 1 --2- 172.21.15.170:0/1701644091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f790006d410 0x7f79000cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:41:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f78ffe00640 1 --2- 172.21.15.170:0/1701644091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f790006d410 0x7f79000cffb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:41:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f7905000640 1 -- 172.21.15.170:0/1701644091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f790006d410 msgr2=0x7f79000cffb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:41:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f7905000640 1 --2- 172.21.15.170:0/1701644091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f790006d410 0x7f79000cffb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f7905000640 1 -- 172.21.15.170:0/1701644091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f790006f000 msgr2=0x7f7900158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f7905000640 1 --2- 172.21.15.170:0/1701644091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f790006f000 0x7f7900158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f7905000640 1 -- 172.21.15.170:0/1701644091 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79000cb440 con 0x7f7900071780 2024-04-26T23:41:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f78ff400640 1 --2- 172.21.15.170:0/1701644091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f790006f000 0x7f7900158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:41:00.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f7905000640 1 --2- 172.21.15.170:0/1701644091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7900071780 0x7f7900151c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f790006e8d0 tx=0x7f79000b05e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:00.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f78f7e00640 1 -- 172.21.15.170:0/1701644091 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f80b2040 con 0x7f7900071780 2024-04-26T23:41:00.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f78f7e00640 1 -- 172.21.15.170:0/1701644091 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f80a5630 con 0x7f7900071780 2024-04-26T23:41:00.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f7907000640 1 -- 172.21.15.170:0/1701644091 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79000cb720 con 0x7f7900071780 2024-04-26T23:41:00.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f78f7e00640 1 -- 172.21.15.170:0/1701644091 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f80ad660 con 0x7f7900071780 2024-04-26T23:41:00.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f7907000640 1 -- 172.21.15.170:0/1701644091 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79000cbce0 con 0x7f7900071780 2024-04-26T23:41:00.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f78f7e00640 1 -- 172.21.15.170:0/1701644091 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f78f80c1020 con 0x7f7900071780 2024-04-26T23:41:00.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.515+0000 7f78f7e00640 1 -- 172.21.15.170:0/1701644091 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f78f80a57e0 con 0x7f7900071780 2024-04-26T23:41:00.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.519+0000 7f7907000640 1 -- 172.21.15.170:0/1701644091 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f790006a410 con 0x7f7900071780 2024-04-26T23:41:00.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.519+0000 7f78f7e00640 1 -- 172.21.15.170:0/1701644091 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f78f80c8020 con 0x7f7900071780 2024-04-26T23:41:00.526 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:41:00.523+0000 7f1b8ae55180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T23:41:00.581 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:41:00.575+0000 7f24b0454180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T23:41:00.591 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:41:00.587+0000 7f1b8ae55180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T23:41:00.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.591+0000 7f7907000640 1 -- 172.21.15.170:0/1701644091 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6016cfc3-8cd3-418b-8a07-201fadfeade7", "id": 5} v 0) -- 0x7f79000af460 con 0x7f7900071780 2024-04-26T23:41:00.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.591+0000 7f78f7e00640 1 -- 172.21.15.170:0/1701644091 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6016cfc3-8cd3-418b-8a07-201fadfeade7", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f78f8016560 con 0x7f7900071780 2024-04-26T23:41:00.595 INFO:teuthology.orchestra.run.smithi170.stdout:5 2024-04-26T23:41:00.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.591+0000 7f7907000640 1 -- 172.21.15.170:0/1701644091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7900071780 msgr2=0x7f7900151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:00.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.591+0000 7f7907000640 1 --2- 172.21.15.170:0/1701644091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7900071780 0x7f7900151c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f790006e8d0 tx=0x7f79000b05e0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.591+0000 7f7907000640 1 -- 172.21.15.170:0/1701644091 shutdown_connections 2024-04-26T23:41:00.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.591+0000 7f7907000640 1 --2- 172.21.15.170:0/1701644091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7900071780 0x7f7900151c90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.591+0000 7f7907000640 1 --2- 172.21.15.170:0/1701644091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f790006f000 0x7f7900158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.591+0000 7f7907000640 1 --2- 172.21.15.170:0/1701644091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f790006d410 0x7f79000cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.591+0000 7f7907000640 1 -- 172.21.15.170:0/1701644091 >> 172.21.15.170:0/1701644091 conn(0x7f7900073160 msgr2=0x7f79000b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:00.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.591+0000 7f7907000640 1 -- 172.21.15.170:0/1701644091 shutdown_connections 2024-04-26T23:41:00.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.591+0000 7f7907000640 1 -- 172.21.15.170:0/1701644091 wait complete. 2024-04-26T23:41:00.616 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 3c33e60d-7803-46ec-beba-573a3a42ccfe 6 2024-04-26T23:41:00.649 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:41:00.647+0000 7f24b0454180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T23:41:00.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.747+0000 7ff7d2200640 1 Processor -- start 2024-04-26T23:41:00.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.747+0000 7ff7d2200640 1 -- start start 2024-04-26T23:41:00.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.747+0000 7ff7d2200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7cc160450 0x7ff7cc0d3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:00.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.747+0000 7ff7d2200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff7cc0b0470 0x7ff7cc0d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:00.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.747+0000 7ff7d2200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7cc0b0cb0 con 0x7ff7cc0d17f0 2024-04-26T23:41:00.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.747+0000 7ff7d2200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff7cc0d1c40 con 0x7ff7cc0b0470 2024-04-26T23:41:00.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.747+0000 7ff7d2200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff7cc0b0f90 con 0x7ff7cc160450 2024-04-26T23:41:00.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.747+0000 7ff7cb400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7cc160450 0x7ff7cc0d3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:00.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.747+0000 7ff7c3e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff7cc0b0470 0x7ff7cc0d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:00.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.747+0000 7ff7cb400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7cc160450 0x7ff7cc0d3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:33976/0 (socket says 172.21.15.170:33976) 2024-04-26T23:41:00.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.747+0000 7ff7c3e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff7cc0b0470 0x7ff7cc0d12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53322/0 (socket says 172.21.15.170:53322) 2024-04-26T23:41:00.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.747+0000 7ff7cb400640 1 -- 172.21.15.170:0/485742605 learned_addr learned my addr 172.21.15.170:0/485742605 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T23:41:00.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.747+0000 7ff7cb400640 1 -- 172.21.15.170:0/485742605 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7cc160450 msgr2=0x7ff7cc0d3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:41:00.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.747+0000 7ff7cb400640 1 -- 172.21.15.170:0/485742605 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7cc160450 msgr2=0x7ff7cc0d3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:41:00.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.747+0000 7ff7cb400640 1 --2- 172.21.15.170:0/485742605 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7cc160450 0x7ff7cc0d3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:41:00.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.747+0000 7ff7cb400640 1 --2- 172.21.15.170:0/485742605 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7cc160450 0x7ff7cc0d3360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:41:00.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.747+0000 7ff7c3e00640 1 -- 172.21.15.170:0/485742605 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7cc160450 msgr2=0x7ff7cc0d3360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:41:00.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.747+0000 7ff7c3e00640 1 --2- 172.21.15.170:0/485742605 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7cc160450 0x7ff7cc0d3360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.747+0000 7ff7c3e00640 1 -- 172.21.15.170:0/485742605 >> v1:172.21.15.137:6789/0 conn(0x7ff7cc0d17f0 legacy=0x7ff7cc160c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:00.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.747+0000 7ff7c3e00640 1 -- 172.21.15.170:0/485742605 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7cc0b1270 con 0x7ff7cc0b0470 2024-04-26T23:41:00.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.751+0000 7ff7c3e00640 1 --2- 172.21.15.170:0/485742605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7cc0b0470 0x7ff7cc0d12b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40097c0 tx=0x7ff7b401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83fdf6849c9162bc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:00.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.751+0000 7ff7caa00640 1 -- 172.21.15.170:0/485742605 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40b0070 con 0x7ff7cc0b0470 2024-04-26T23:41:00.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.751+0000 7ff7caa00640 1 -- 172.21.15.170:0/485742605 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b40ab600 con 0x7ff7cc0b0470 2024-04-26T23:41:00.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.751+0000 7ff7caa00640 1 -- 172.21.15.170:0/485742605 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40ab9d0 con 0x7ff7cc0b0470 2024-04-26T23:41:00.756 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:41:00.751+0000 7f1b8ae55180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T23:41:00.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.751+0000 7ff7d2200640 1 -- 172.21.15.170:0/485742605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7cc0b0470 msgr2=0x7ff7cc0d12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:00.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.751+0000 7ff7d2200640 1 --2- 172.21.15.170:0/485742605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7cc0b0470 0x7ff7cc0d12b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40097c0 tx=0x7ff7b401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.751+0000 7ff7d2200640 1 -- 172.21.15.170:0/485742605 shutdown_connections 2024-04-26T23:41:00.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.751+0000 7ff7d2200640 1 --2- 172.21.15.170:0/485742605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7cc0b0470 0x7ff7cc0d12b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.751+0000 7ff7d2200640 1 --2- 172.21.15.170:0/485742605 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7cc160450 0x7ff7cc0d3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.751+0000 7ff7d2200640 1 -- 172.21.15.170:0/485742605 >> 172.21.15.170:0/485742605 conn(0x7ff7cc09ba60 msgr2=0x7ff7cc09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:00.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.751+0000 7ff7d2200640 1 -- 172.21.15.170:0/485742605 shutdown_connections 2024-04-26T23:41:00.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.751+0000 7ff7d2200640 1 -- 172.21.15.170:0/485742605 wait complete. 2024-04-26T23:41:00.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7d2200640 1 Processor -- start 2024-04-26T23:41:00.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7d2200640 1 -- start start 2024-04-26T23:41:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7d2200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7cc0b0470 0x7ff7cc154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7d2200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7cc0d17f0 0x7ff7cc0b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7d2200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7cc160450 0x7ff7cc1583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7d2200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff7cc0b0a50 con 0x7ff7cc0b0470 2024-04-26T23:41:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7d2200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff7cc0b08d0 con 0x7ff7cc0d17f0 2024-04-26T23:41:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7d2200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff7cc160830 con 0x7ff7cc160450 2024-04-26T23:41:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7c3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7cc0d17f0 0x7ff7cc0b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7c3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7cc0d17f0 0x7ff7cc0b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53332/0 (socket says 172.21.15.170:53332) 2024-04-26T23:41:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7c3e00640 1 -- 172.21.15.170:0/3767613732 learned_addr learned my addr 172.21.15.170:0/3767613732 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T23:41:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7cb400640 1 --2- 172.21.15.170:0/3767613732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7cc0b0470 0x7ff7cc154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7cbe00640 1 --2- 172.21.15.170:0/3767613732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7cc160450 0x7ff7cc1583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7cbe00640 1 -- 172.21.15.170:0/3767613732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7cc160450 msgr2=0x7ff7cc1583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-26T23:41:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7cbe00640 1 -- 172.21.15.170:0/3767613732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7cc160450 msgr2=0x7ff7cc1583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:41:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7cbe00640 1 --2- 172.21.15.170:0/3767613732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7cc160450 0x7ff7cc1583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:41:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7c3e00640 1 -- 172.21.15.170:0/3767613732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7cc160450 msgr2=0x7ff7cc1583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7cbe00640 1 --2- 172.21.15.170:0/3767613732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7cc160450 0x7ff7cc1583c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:41:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7c3e00640 1 --2- 172.21.15.170:0/3767613732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7cc160450 0x7ff7cc1583c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7c3e00640 1 -- 172.21.15.170:0/3767613732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7cc0b0470 msgr2=0x7ff7cc154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7c3e00640 1 --2- 172.21.15.170:0/3767613732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7cc0b0470 0x7ff7cc154f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7c3e00640 1 -- 172.21.15.170:0/3767613732 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7cc0ce080 con 0x7ff7cc0d17f0 2024-04-26T23:41:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7c3e00640 1 --2- 172.21.15.170:0/3767613732 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7cc0d17f0 0x7ff7cc0b5200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40ae040 tx=0x7ff7b4019240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7c3400640 1 -- 172.21.15.170:0/3767613732 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40b8030 con 0x7ff7cc0d17f0 2024-04-26T23:41:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7c3400640 1 -- 172.21.15.170:0/3767613732 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b40ab400 con 0x7ff7cc0d17f0 2024-04-26T23:41:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7d2200640 1 -- 172.21.15.170:0/3767613732 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7cc166290 con 0x7ff7cc0d17f0 2024-04-26T23:41:00.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7c3400640 1 -- 172.21.15.170:0/3767613732 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40b0040 con 0x7ff7cc0d17f0 2024-04-26T23:41:00.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.755+0000 7ff7d2200640 1 -- 172.21.15.170:0/3767613732 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7cc0b5740 con 0x7ff7cc0d17f0 2024-04-26T23:41:00.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.759+0000 7ff7c3400640 1 -- 172.21.15.170:0/3767613732 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff7b40bb070 con 0x7ff7cc0d17f0 2024-04-26T23:41:00.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.759+0000 7ff7c3400640 1 -- 172.21.15.170:0/3767613732 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7ff7b40ab5b0 con 0x7ff7cc0d17f0 2024-04-26T23:41:00.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.759+0000 7ff7d2200640 1 -- 172.21.15.170:0/3767613732 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7cc06a410 con 0x7ff7cc0d17f0 2024-04-26T23:41:00.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.759+0000 7ff7c3400640 1 -- 172.21.15.170:0/3767613732 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ff7b40c3020 con 0x7ff7cc0d17f0 2024-04-26T23:41:00.822 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:41:00.819+0000 7f24b0454180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T23:41:00.827 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:41:00.823+0000 7f1b8ae55180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T23:41:00.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.827+0000 7ff7d2200640 1 -- 172.21.15.170:0/3767613732 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3c33e60d-7803-46ec-beba-573a3a42ccfe", "id": 6} v 0) -- 0x7ff7cc071f40 con 0x7ff7cc0d17f0 2024-04-26T23:41:00.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.831+0000 7ff7c3400640 1 -- 172.21.15.170:0/3767613732 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3c33e60d-7803-46ec-beba-573a3a42ccfe", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7ff7b4016090 con 0x7ff7cc0d17f0 2024-04-26T23:41:00.835 INFO:teuthology.orchestra.run.smithi170.stdout:6 2024-04-26T23:41:00.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.831+0000 7ff7d2200640 1 -- 172.21.15.170:0/3767613732 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7cc0d17f0 msgr2=0x7ff7cc0b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:00.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.831+0000 7ff7d2200640 1 --2- 172.21.15.170:0/3767613732 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7cc0d17f0 0x7ff7cc0b5200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40ae040 tx=0x7ff7b4019240 comp rx=0 tx=0).stop 2024-04-26T23:41:00.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.831+0000 7ff7d2200640 1 -- 172.21.15.170:0/3767613732 shutdown_connections 2024-04-26T23:41:00.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.831+0000 7ff7d2200640 1 --2- 172.21.15.170:0/3767613732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7cc160450 0x7ff7cc1583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.831+0000 7ff7d2200640 1 --2- 172.21.15.170:0/3767613732 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7cc0d17f0 0x7ff7cc0b5200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.831+0000 7ff7d2200640 1 --2- 172.21.15.170:0/3767613732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7cc0b0470 0x7ff7cc154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.831+0000 7ff7d2200640 1 -- 172.21.15.170:0/3767613732 >> 172.21.15.170:0/3767613732 conn(0x7ff7cc09ba60 msgr2=0x7ff7cc0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:00.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.831+0000 7ff7d2200640 1 -- 172.21.15.170:0/3767613732 shutdown_connections 2024-04-26T23:41:00.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:00.831+0000 7ff7d2200640 1 -- 172.21.15.170:0/3767613732 wait complete. 2024-04-26T23:41:00.854 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new a39b04d0-f879-4336-920a-9f569ac3e22a 7 2024-04-26T23:41:00.897 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:41:00.891+0000 7f24b0454180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T23:41:01.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.027+0000 7fde99400640 1 Processor -- start 2024-04-26T23:41:01.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.027+0000 7fde99400640 1 -- start start 2024-04-26T23:41:01.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde99400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde9406d370 0x7fde940b2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:01.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde99400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde940d0680 con 0x7fde9415f4d0 2024-04-26T23:41:01.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde99400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde940cfde0 con 0x7fde9406c610 2024-04-26T23:41:01.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde99400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fde940d0f80 con 0x7fde9406d370 2024-04-26T23:41:01.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde89e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde9406d370 0x7fde940b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:01.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde93200640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fde9406c610 0x7fde940d16d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:59854/0 (socket says 172.21.15.170:59854) 2024-04-26T23:41:01.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde93200640 1 -- 172.21.15.170:0/1581447490 learned_addr learned my addr 172.21.15.170:0/1581447490 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T23:41:01.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde89e00640 1 -- 172.21.15.170:0/1581447490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde9406d370 msgr2=0x7fde940b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:41:01.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde89e00640 1 -- 172.21.15.170:0/1581447490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde9406d370 msgr2=0x7fde940b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:41:01.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde89e00640 1 --2- 172.21.15.170:0/1581447490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde9406d370 0x7fde940b2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:41:01.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde89e00640 1 --2- 172.21.15.170:0/1581447490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde9406d370 0x7fde940b2750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:41:01.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde91e00640 1 -- 172.21.15.170:0/1581447490 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3913779295 0 0) 0x7fde940cfde0 con 0x7fde9406c610 2024-04-26T23:41:01.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde91e00640 1 -- 172.21.15.170:0/1581447490 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde78003530 con 0x7fde9406c610 2024-04-26T23:41:01.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde91e00640 1 -- 172.21.15.170:0/1581447490 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2269926317 0 0) 0x7fde940d0680 con 0x7fde9415f4d0 2024-04-26T23:41:01.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde91e00640 1 -- 172.21.15.170:0/1581447490 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde940cfde0 con 0x7fde9415f4d0 2024-04-26T23:41:01.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde91e00640 1 -- 172.21.15.170:0/1581447490 <== mon.1 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2688480364 0 0) 0x7fde78003530 con 0x7fde9406c610 2024-04-26T23:41:01.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde91e00640 1 -- 172.21.15.170:0/1581447490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde9406d370 msgr2=0x7fde940b2750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:41:01.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde91e00640 1 --2- 172.21.15.170:0/1581447490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde9406d370 0x7fde940b2750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde91e00640 1 -- 172.21.15.170:0/1581447490 >> v1:172.21.15.137:6789/0 conn(0x7fde9415f4d0 legacy=0x7fde9406cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:01.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde91e00640 1 -- 172.21.15.170:0/1581447490 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde940d00c0 con 0x7fde9406c610 2024-04-26T23:41:01.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde91e00640 1 -- 172.21.15.170:0/1581447490 <== mon.1 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fde8c001a00 con 0x7fde9406c610 2024-04-26T23:41:01.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde91e00640 1 -- 172.21.15.170:0/1581447490 >> v1:172.21.15.170:6789/0 conn(0x7fde9406c610 legacy=0x7fde940d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:01.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde91e00640 1 --2- 172.21.15.170:0/1581447490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde78004bb0 0x7fde78004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:01.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde91e00640 1 --2- 172.21.15.170:0/1581447490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde9406d370 0x7fde780037b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:01.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde91e00640 1 --2- 172.21.15.170:0/1581447490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde78003cf0 0x7fde78004170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:01.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde91e00640 1 -- 172.21.15.170:0/1581447490 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fde7800bab0 con 0x7fde78003cf0 2024-04-26T23:41:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde91e00640 1 -- 172.21.15.170:0/1581447490 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fde7800bc60 con 0x7fde78004bb0 2024-04-26T23:41:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde91e00640 1 -- 172.21.15.170:0/1581447490 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fde7800be60 con 0x7fde9406d370 2024-04-26T23:41:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde89e00640 1 --2- 172.21.15.170:0/1581447490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde9406d370 0x7fde780037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde92800640 1 --2- 172.21.15.170:0/1581447490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde78004bb0 0x7fde78004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde93200640 1 --2- 172.21.15.170:0/1581447490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde78003cf0 0x7fde78004170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde89e00640 1 -- 172.21.15.170:0/1581447490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde78004bb0 msgr2=0x7fde78004fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde89e00640 1 --2- 172.21.15.170:0/1581447490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde78004bb0 0x7fde78004fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde89e00640 1 -- 172.21.15.170:0/1581447490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde78003cf0 msgr2=0x7fde78004170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde89e00640 1 --2- 172.21.15.170:0/1581447490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde78003cf0 0x7fde78004170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.031+0000 7fde89e00640 1 -- 172.21.15.170:0/1581447490 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde78003530 con 0x7fde9406d370 2024-04-26T23:41:01.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.035+0000 7fde89e00640 1 --2- 172.21.15.170:0/1581447490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde9406d370 0x7fde780037b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00c820 tx=0x7fde7c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b56f935e8ab094e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:01.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.035+0000 7fde91e00640 1 -- 172.21.15.170:0/1581447490 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0b1070 con 0x7fde9406d370 2024-04-26T23:41:01.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.035+0000 7fde91e00640 1 -- 172.21.15.170:0/1581447490 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde7c0ac410 con 0x7fde9406d370 2024-04-26T23:41:01.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.035+0000 7fde91e00640 1 -- 172.21.15.170:0/1581447490 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c00f040 con 0x7fde9406d370 2024-04-26T23:41:01.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.035+0000 7fde99400640 1 -- 172.21.15.170:0/1581447490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde9406d370 msgr2=0x7fde780037b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:01.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.035+0000 7fde99400640 1 --2- 172.21.15.170:0/1581447490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde9406d370 0x7fde780037b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00c820 tx=0x7fde7c01c470 comp rx=0 tx=0).stop 2024-04-26T23:41:01.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.035+0000 7fde93200640 1 -- 172.21.15.170:0/1581447490 reap_dead start 2024-04-26T23:41:01.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.035+0000 7fde99400640 1 -- 172.21.15.170:0/1581447490 shutdown_connections 2024-04-26T23:41:01.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.035+0000 7fde99400640 1 -- 172.21.15.170:0/1581447490 >> 172.21.15.170:0/1581447490 conn(0x7fde9409ba60 msgr2=0x7fde9409be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:01.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.035+0000 7fde99400640 1 -- 172.21.15.170:0/1581447490 shutdown_connections 2024-04-26T23:41:01.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.035+0000 7fde99400640 1 -- 172.21.15.170:0/1581447490 wait complete. 2024-04-26T23:41:01.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde99400640 1 Processor -- start 2024-04-26T23:41:01.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde99400640 1 -- start start 2024-04-26T23:41:01.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde99400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde9406d370 0x7fde94163430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:01.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde99400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde94152bd0 0x7fde94153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:01.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde99400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde940b5e00 0x7fde940b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:01.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde99400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fde940d11b0 con 0x7fde94152bd0 2024-04-26T23:41:01.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde99400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fde940b4730 con 0x7fde9406d370 2024-04-26T23:41:01.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde99400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fde940b2750 con 0x7fde940b5e00 2024-04-26T23:41:01.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde92800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde9406d370 0x7fde94163430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:01.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde92800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde9406d370 0x7fde94163430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53356/0 (socket says 172.21.15.170:53356) 2024-04-26T23:41:01.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde92800640 1 -- 172.21.15.170:0/1990157568 learned_addr learned my addr 172.21.15.170:0/1990157568 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T23:41:01.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde93200640 1 --2- 172.21.15.170:0/1990157568 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde940b5e00 0x7fde940b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:01.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde89e00640 1 --2- 172.21.15.170:0/1990157568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde94152bd0 0x7fde94153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:01.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde93200640 1 -- 172.21.15.170:0/1990157568 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde940b5e00 msgr2=0x7fde940b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-26T23:41:01.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde93200640 1 -- 172.21.15.170:0/1990157568 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde940b5e00 msgr2=0x7fde940b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:41:01.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde93200640 1 --2- 172.21.15.170:0/1990157568 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde940b5e00 0x7fde940b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:41:01.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde93200640 1 --2- 172.21.15.170:0/1990157568 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde940b5e00 0x7fde940b6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:41:01.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde92800640 1 -- 172.21.15.170:0/1990157568 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde940b5e00 msgr2=0x7fde940b6260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:41:01.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde92800640 1 --2- 172.21.15.170:0/1990157568 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde940b5e00 0x7fde940b6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde92800640 1 -- 172.21.15.170:0/1990157568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde94152bd0 msgr2=0x7fde94153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:01.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde92800640 1 --2- 172.21.15.170:0/1990157568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde94152bd0 0x7fde94153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde92800640 1 -- 172.21.15.170:0/1990157568 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde940b67a0 con 0x7fde9406d370 2024-04-26T23:41:01.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde92800640 1 --2- 172.21.15.170:0/1990157568 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde9406d370 0x7fde94163430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fde8400f760 tx=0x7fde8400fc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:01.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde8b400640 1 -- 172.21.15.170:0/1990157568 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8400fe70 con 0x7fde9406d370 2024-04-26T23:41:01.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde8b400640 1 -- 172.21.15.170:0/1990157568 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde84018070 con 0x7fde9406d370 2024-04-26T23:41:01.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde8b400640 1 -- 172.21.15.170:0/1990157568 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8400d730 con 0x7fde9406d370 2024-04-26T23:41:01.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde99400640 1 -- 172.21.15.170:0/1990157568 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde941f8a40 con 0x7fde9406d370 2024-04-26T23:41:01.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde99400640 1 -- 172.21.15.170:0/1990157568 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde941f9000 con 0x7fde9406d370 2024-04-26T23:41:01.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde8b400640 1 -- 172.21.15.170:0/1990157568 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fde8400d8d0 con 0x7fde9406d370 2024-04-26T23:41:01.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde8b400640 1 -- 172.21.15.170:0/1990157568 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fde84003dd0 con 0x7fde9406d370 2024-04-26T23:41:01.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.039+0000 7fde99400640 1 -- 172.21.15.170:0/1990157568 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde9406a410 con 0x7fde9406d370 2024-04-26T23:41:01.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.043+0000 7fde8b400640 1 -- 172.21.15.170:0/1990157568 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fde8400dbc0 con 0x7fde9406d370 2024-04-26T23:41:01.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.107+0000 7fde99400640 1 -- 172.21.15.170:0/1990157568 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a39b04d0-f879-4336-920a-9f569ac3e22a", "id": 7} v 0) -- 0x7fde94162960 con 0x7fde9406d370 2024-04-26T23:41:01.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.111+0000 7fde8b400640 1 -- 172.21.15.170:0/1990157568 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a39b04d0-f879-4336-920a-9f569ac3e22a", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fde84003600 con 0x7fde9406d370 2024-04-26T23:41:01.117 INFO:teuthology.orchestra.run.smithi170.stdout:7 2024-04-26T23:41:01.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.115+0000 7fde99400640 1 -- 172.21.15.170:0/1990157568 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde9406d370 msgr2=0x7fde94163430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:01.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.115+0000 7fde99400640 1 --2- 172.21.15.170:0/1990157568 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde9406d370 0x7fde94163430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fde8400f760 tx=0x7fde8400fc20 comp rx=0 tx=0).stop 2024-04-26T23:41:01.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.115+0000 7fde99400640 1 -- 172.21.15.170:0/1990157568 shutdown_connections 2024-04-26T23:41:01.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.115+0000 7fde99400640 1 --2- 172.21.15.170:0/1990157568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde94152bd0 0x7fde94153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.115+0000 7fde99400640 1 --2- 172.21.15.170:0/1990157568 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde940b5e00 0x7fde940b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.115+0000 7fde99400640 1 --2- 172.21.15.170:0/1990157568 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde9406d370 0x7fde94163430 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.115+0000 7fde99400640 1 -- 172.21.15.170:0/1990157568 >> 172.21.15.170:0/1990157568 conn(0x7fde9409ba60 msgr2=0x7fde94070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:01.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.115+0000 7fde99400640 1 -- 172.21.15.170:0/1990157568 shutdown_connections 2024-04-26T23:41:01.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:01.115+0000 7fde99400640 1 -- 172.21.15.170:0/1990157568 wait complete. 2024-04-26T23:41:01.138 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T23:41:01.138 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T23:41:01.141 INFO:tasks.ceph.osd.0:Started 2024-04-26T23:41:01.141 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T23:41:01.141 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T23:41:01.144 INFO:tasks.ceph.osd.1:Started 2024-04-26T23:41:01.144 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T23:41:01.144 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T23:41:01.147 INFO:tasks.ceph.osd.2:Started 2024-04-26T23:41:01.147 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T23:41:01.147 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T23:41:01.150 INFO:tasks.ceph.osd.3:Started 2024-04-26T23:41:01.150 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-26T23:41:01.151 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-26T23:41:01.155 INFO:tasks.ceph.osd.4:Started 2024-04-26T23:41:01.155 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-26T23:41:01.155 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-26T23:41:01.158 INFO:tasks.ceph.osd.5:Started 2024-04-26T23:41:01.158 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-26T23:41:01.159 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-26T23:41:01.161 INFO:tasks.ceph.osd.6:Started 2024-04-26T23:41:01.162 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-26T23:41:01.162 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-26T23:41:01.166 INFO:tasks.ceph.osd.7:Started 2024-04-26T23:41:01.166 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:01.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.363+0000 7ffb42c00640 1 Processor -- start 2024-04-26T23:41:01.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.363+0000 7ffb42c00640 1 -- start start 2024-04-26T23:41:01.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.363+0000 7ffb42c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ffb3c1596f0 0x7ffb3c15f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:01.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.363+0000 7ffb42c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ffb3c073040 0x7ffb3c0afb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:01.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.363+0000 7ffb42c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb3c159ad0 con 0x7ffb3c0b5290 2024-04-26T23:41:01.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.363+0000 7ffb42c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ffb3c0b5a70 con 0x7ffb3c1596f0 2024-04-26T23:41:01.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.363+0000 7ffb42c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ffb3c0b5d50 con 0x7ffb3c073040 2024-04-26T23:41:01.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.363+0000 7ffb3be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ffb3c1596f0 0x7ffb3c15f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:01.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.363+0000 7ffb3be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ffb3c1596f0 0x7ffb3c15f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41850/0 (socket says 172.21.15.137:41850) 2024-04-26T23:41:01.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.363+0000 7ffb3be00640 1 -- 172.21.15.137:0/315824674 learned_addr learned my addr 172.21.15.137:0/315824674 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:01.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.363+0000 7ffb40c00640 1 --2- 172.21.15.137:0/315824674 >> v2:172.21.15.170:3300/0 conn(0x7ffb3c073040 0x7ffb3c0afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:01.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.363+0000 7ffb3be00640 1 -- 172.21.15.137:0/315824674 >> v2:172.21.15.170:3300/0 conn(0x7ffb3c073040 msgr2=0x7ffb3c0afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:01.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.363+0000 7ffb3be00640 1 --2- 172.21.15.137:0/315824674 >> v2:172.21.15.170:3300/0 conn(0x7ffb3c073040 0x7ffb3c0afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.363+0000 7ffb3be00640 1 -- 172.21.15.137:0/315824674 >> v1:172.21.15.170:6789/0 conn(0x7ffb3c0b5290 legacy=0x7ffb3c072930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:01.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.363+0000 7ffb3be00640 1 -- 172.21.15.137:0/315824674 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb3c0b6030 con 0x7ffb3c1596f0 2024-04-26T23:41:01.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.363+0000 7ffb40c00640 1 --2- 172.21.15.137:0/315824674 >> v2:172.21.15.170:3300/0 conn(0x7ffb3c073040 0x7ffb3c0afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:01.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.367+0000 7ffb3be00640 1 --2- 172.21.15.137:0/315824674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb3c1596f0 0x7ffb3c15f630 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c0b4380 tx=0x7ffb2c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8234d92c2e6a9bd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:01.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.367+0000 7ffb3b400640 1 -- 172.21.15.137:0/315824674 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0b1070 con 0x7ffb3c1596f0 2024-04-26T23:41:01.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.367+0000 7ffb3b400640 1 -- 172.21.15.137:0/315824674 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb2c0ac630 con 0x7ffb3c1596f0 2024-04-26T23:41:01.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.367+0000 7ffb3b400640 1 -- 172.21.15.137:0/315824674 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0a8050 con 0x7ffb3c1596f0 2024-04-26T23:41:01.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.367+0000 7ffb42c00640 1 -- 172.21.15.137:0/315824674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb3c1596f0 msgr2=0x7ffb3c15f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:01.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.367+0000 7ffb42c00640 1 --2- 172.21.15.137:0/315824674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb3c1596f0 0x7ffb3c15f630 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c0b4380 tx=0x7ffb2c01c4e0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb42c00640 1 -- 172.21.15.137:0/315824674 shutdown_connections 2024-04-26T23:41:01.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb42c00640 1 --2- 172.21.15.137:0/315824674 >> v2:172.21.15.170:3300/0 conn(0x7ffb3c073040 0x7ffb3c0afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb42c00640 1 --2- 172.21.15.137:0/315824674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb3c1596f0 0x7ffb3c15f630 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb42c00640 1 -- 172.21.15.137:0/315824674 >> 172.21.15.137:0/315824674 conn(0x7ffb3c0b3370 msgr2=0x7ffb3c0b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:01.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb42c00640 1 -- 172.21.15.137:0/315824674 shutdown_connections 2024-04-26T23:41:01.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb42c00640 1 -- 172.21.15.137:0/315824674 wait complete. 2024-04-26T23:41:01.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb42c00640 1 Processor -- start 2024-04-26T23:41:01.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb42c00640 1 -- start start 2024-04-26T23:41:01.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb42c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb3c073040 0x7ffb3c14a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:01.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb42c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb3c0b5290 0x7ffb3c1557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:01.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb42c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb3c1596f0 0x7ffb3c155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:01.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb42c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ffb3c0b09e0 con 0x7ffb3c1596f0 2024-04-26T23:41:01.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb42c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ffb3c0b0860 con 0x7ffb3c073040 2024-04-26T23:41:01.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb42c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ffb3c0b0b60 con 0x7ffb3c0b5290 2024-04-26T23:41:01.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb40c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb3c1596f0 0x7ffb3c155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:01.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb3be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb3c073040 0x7ffb3c14a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:01.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb3be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb3c073040 0x7ffb3c14a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:49028/0 (socket says 172.21.15.137:49028) 2024-04-26T23:41:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb3be00640 1 -- 172.21.15.137:0/2193180826 learned_addr learned my addr 172.21.15.137:0/2193180826 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb33e00640 1 --2- 172.21.15.137:0/2193180826 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb3c0b5290 0x7ffb3c1557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb33e00640 1 -- 172.21.15.137:0/2193180826 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb3c0b5290 msgr2=0x7ffb3c1557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-26T23:41:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb33e00640 1 -- 172.21.15.137:0/2193180826 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb3c0b5290 msgr2=0x7ffb3c1557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:41:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb33e00640 1 --2- 172.21.15.137:0/2193180826 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb3c0b5290 0x7ffb3c1557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:41:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb33e00640 1 --2- 172.21.15.137:0/2193180826 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb3c0b5290 0x7ffb3c1557c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:41:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb3be00640 1 -- 172.21.15.137:0/2193180826 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb3c0b5290 msgr2=0x7ffb3c1557c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:41:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb3be00640 1 --2- 172.21.15.137:0/2193180826 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb3c0b5290 0x7ffb3c1557c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb3be00640 1 -- 172.21.15.137:0/2193180826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb3c1596f0 msgr2=0x7ffb3c155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb3be00640 1 --2- 172.21.15.137:0/2193180826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb3c1596f0 0x7ffb3c155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb3be00640 1 -- 172.21.15.137:0/2193180826 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb3c0b21d0 con 0x7ffb3c073040 2024-04-26T23:41:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb40c00640 1 --2- 172.21.15.137:0/2193180826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb3c1596f0 0x7ffb3c155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:41:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.371+0000 7ffb3be00640 1 --2- 172.21.15.137:0/2193180826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb3c073040 0x7ffb3c14a0b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c01a110 tx=0x7ffb2c019280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.375+0000 7ffb38c00640 1 -- 172.21.15.137:0/2193180826 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0bc070 con 0x7ffb3c073040 2024-04-26T23:41:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.375+0000 7ffb38c00640 1 -- 172.21.15.137:0/2193180826 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb2c0ab800 con 0x7ffb3c073040 2024-04-26T23:41:01.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.375+0000 7ffb38c00640 1 -- 172.21.15.137:0/2193180826 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0b1070 con 0x7ffb3c073040 2024-04-26T23:41:01.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.375+0000 7ffb42c00640 1 -- 172.21.15.137:0/2193180826 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb3c0b24b0 con 0x7ffb3c073040 2024-04-26T23:41:01.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.375+0000 7ffb42c00640 1 -- 172.21.15.137:0/2193180826 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb3c0b2a70 con 0x7ffb3c073040 2024-04-26T23:41:01.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.375+0000 7ffb38c00640 1 -- 172.21.15.137:0/2193180826 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffb2c0ac4f0 con 0x7ffb3c073040 2024-04-26T23:41:01.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.375+0000 7ffb38c00640 1 -- 172.21.15.137:0/2193180826 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ffb2c0b7440 con 0x7ffb3c073040 2024-04-26T23:41:01.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.375+0000 7ffb42c00640 1 -- 172.21.15.137:0/2193180826 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb3c06a4b0 con 0x7ffb3c073040 2024-04-26T23:41:01.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.375+0000 7ffb38c00640 1 -- 172.21.15.137:0/2193180826 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ffb2c0c5080 con 0x7ffb3c073040 2024-04-26T23:41:01.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.431+0000 7ffb42c00640 1 -- 172.21.15.137:0/2193180826 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb3c1f8f80 con 0x7ffb3c073040 2024-04-26T23:41:01.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.435+0000 7ffb38c00640 1 -- 172.21.15.137:0/2193180826 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ffb2c0160d0 con 0x7ffb3c073040 2024-04-26T23:41:01.438 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:01.438 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":10,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:01.114767+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:01.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.435+0000 7ffb42c00640 1 -- 172.21.15.137:0/2193180826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb3c073040 msgr2=0x7ffb3c14a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:01.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.435+0000 7ffb42c00640 1 --2- 172.21.15.137:0/2193180826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb3c073040 0x7ffb3c14a0b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c01a110 tx=0x7ffb2c019280 comp rx=0 tx=0).stop 2024-04-26T23:41:01.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.435+0000 7ffb42c00640 1 -- 172.21.15.137:0/2193180826 shutdown_connections 2024-04-26T23:41:01.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.435+0000 7ffb42c00640 1 --2- 172.21.15.137:0/2193180826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb3c1596f0 0x7ffb3c155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.435+0000 7ffb42c00640 1 --2- 172.21.15.137:0/2193180826 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb3c0b5290 0x7ffb3c1557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.435+0000 7ffb42c00640 1 --2- 172.21.15.137:0/2193180826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb3c073040 0x7ffb3c14a0b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.435+0000 7ffb42c00640 1 -- 172.21.15.137:0/2193180826 >> 172.21.15.137:0/2193180826 conn(0x7ffb3c0b3370 msgr2=0x7ffb3c162a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:01.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.435+0000 7ffb42c00640 1 -- 172.21.15.137:0/2193180826 shutdown_connections 2024-04-26T23:41:01.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:01.435+0000 7ffb42c00640 1 -- 172.21.15.137:0/2193180826 wait complete. 2024-04-26T23:41:01.456 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T23:41:01.457 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T23:41:01.483 INFO:tasks.ceph.mgr.y.smithi137.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T23:41:01.483 INFO:tasks.ceph.mgr.y.smithi137.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T23:41:01.483 INFO:tasks.ceph.mgr.y.smithi137.stderr: from numpy import show_config as show_numpy_config 2024-04-26T23:41:01.537 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:41:01.531+0000 7f1b8ae55180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T23:41:01.574 INFO:tasks.ceph.mgr.x.smithi170.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T23:41:01.574 INFO:tasks.ceph.mgr.x.smithi170.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T23:41:01.574 INFO:tasks.ceph.mgr.x.smithi170.stderr: from numpy import show_config as show_numpy_config 2024-04-26T23:41:01.618 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-26T23:41:01.615+0000 7fdd2a1347c0 -1 Falling back to public interface 2024-04-26T23:41:01.636 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:41:01.631+0000 7f24b0454180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T23:41:01.687 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:41:01.683+0000 7f1b8ae55180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:41:01.784 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:41:01.779+0000 7f24b0454180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:41:01.826 INFO:tasks.ceph.osd.2.smithi137.stderr:2024-04-26T23:41:01.823+0000 7f98c922b7c0 -1 Falling back to public interface 2024-04-26T23:41:01.842 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-26T23:41:01.839+0000 7f68c08a97c0 -1 Falling back to public interface 2024-04-26T23:41:01.862 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-26T23:41:01.859+0000 7f5f34f517c0 -1 Falling back to public interface 2024-04-26T23:41:01.863 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-04-26T23:41:01.859+0000 7f3078b7c7c0 -1 Falling back to public interface 2024-04-26T23:41:01.869 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:41:01.863+0000 7f1b8ae55180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T23:41:01.870 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-26T23:41:01.867+0000 7f94667ab7c0 -1 Falling back to public interface 2024-04-26T23:41:01.878 INFO:tasks.ceph.osd.3.smithi137.stderr:2024-04-26T23:41:01.875+0000 7f04989437c0 -1 Falling back to public interface 2024-04-26T23:41:01.894 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-04-26T23:41:01.891+0000 7f5f17f537c0 -1 Falling back to public interface 2024-04-26T23:41:01.944 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:41:01.939+0000 7f1b8ae55180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T23:41:01.976 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:41:01.971+0000 7f24b0454180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T23:41:02.050 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:41:02.047+0000 7f24b0454180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T23:41:02.094 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:41:02.091+0000 7f1b8ae55180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:41:02.201 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:41:02.195+0000 7f24b0454180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:41:02.263 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:02.392 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.387+0000 7f0993000640 1 Processor -- start 2024-04-26T23:41:02.392 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.387+0000 7f0993000640 1 -- start start 2024-04-26T23:41:02.393 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.387+0000 7f0993000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f098c15d310 0x7f098c0d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:02.393 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.387+0000 7f0993000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f098c0afc40 con 0x7f098c0b13e0 2024-04-26T23:41:02.393 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.387+0000 7f0993000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f098c0ce770 con 0x7f098c0d0f60 2024-04-26T23:41:02.393 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.387+0000 7f0993000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f098c0aff40 con 0x7f098c15d310 2024-04-26T23:41:02.393 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.387+0000 7f0991000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f098c0b13e0 0x7f098c0cfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:59106/0 (socket says 172.21.15.137:59106) 2024-04-26T23:41:02.394 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.387+0000 7f0991000640 1 -- 172.21.15.137:0/2526650760 learned_addr learned my addr 172.21.15.137:0/2526650760 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:02.394 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.387+0000 7f098be00640 1 --2- 172.21.15.137:0/2526650760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f098c15d310 0x7f098c0d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:02.396 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098be00640 1 -- 172.21.15.137:0/2526650760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f098c15d310 msgr2=0x7f098c0d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:41:02.396 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098be00640 1 -- 172.21.15.137:0/2526650760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f098c15d310 msgr2=0x7f098c0d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:41:02.396 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098be00640 1 --2- 172.21.15.137:0/2526650760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f098c15d310 0x7f098c0d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:41:02.396 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098be00640 1 --2- 172.21.15.137:0/2526650760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f098c15d310 0x7f098c0d0a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:41:02.396 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098aa00640 1 -- 172.21.15.137:0/2526650760 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 610680723 0 0) 0x7f098c0afc40 con 0x7f098c0b13e0 2024-04-26T23:41:02.396 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098aa00640 1 -- 172.21.15.137:0/2526650760 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0970003530 con 0x7f098c0b13e0 2024-04-26T23:41:02.397 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098aa00640 1 -- 172.21.15.137:0/2526650760 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4113299497 0 0) 0x7f098c0ce770 con 0x7f098c0d0f60 2024-04-26T23:41:02.397 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098aa00640 1 -- 172.21.15.137:0/2526650760 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f098c0afc40 con 0x7f098c0d0f60 2024-04-26T23:41:02.397 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098aa00640 1 -- 172.21.15.137:0/2526650760 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3167085237 0 0) 0x7f0970003530 con 0x7f098c0b13e0 2024-04-26T23:41:02.397 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098aa00640 1 -- 172.21.15.137:0/2526650760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f098c15d310 msgr2=0x7f098c0d0a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:41:02.397 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098aa00640 1 --2- 172.21.15.137:0/2526650760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f098c15d310 0x7f098c0d0a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:02.397 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098aa00640 1 -- 172.21.15.137:0/2526650760 >> v1:172.21.15.170:6789/0 conn(0x7f098c0d0f60 legacy=0x7f098c0cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:02.397 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098aa00640 1 -- 172.21.15.137:0/2526650760 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f098c0cea50 con 0x7f098c0b13e0 2024-04-26T23:41:02.397 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098aa00640 1 -- 172.21.15.137:0/2526650760 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f0984001a00 con 0x7f098c0b13e0 2024-04-26T23:41:02.397 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098aa00640 1 -- 172.21.15.137:0/2526650760 >> v1:172.21.15.137:6789/0 conn(0x7f098c0b13e0 legacy=0x7f098c0cfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:02.397 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098aa00640 1 --2- 172.21.15.137:0/2526650760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0970004c10 0x7f0970004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:02.397 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098aa00640 1 --2- 172.21.15.137:0/2526650760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09700037b0 0x7f0970003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:02.397 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098aa00640 1 --2- 172.21.15.137:0/2526650760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f098c15d310 0x7f0970004240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:02.398 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098aa00640 1 -- 172.21.15.137:0/2526650760 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f098c0aff40 con 0x7f0970004c10 2024-04-26T23:41:02.398 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098aa00640 1 -- 172.21.15.137:0/2526650760 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f097000bb90 con 0x7f09700037b0 2024-04-26T23:41:02.398 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098aa00640 1 -- 172.21.15.137:0/2526650760 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f097000bd90 con 0x7f098c15d310 2024-04-26T23:41:02.398 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098be00640 1 --2- 172.21.15.137:0/2526650760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0970004c10 0x7f0970004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:02.398 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f0991000640 1 --2- 172.21.15.137:0/2526650760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f098c15d310 0x7f0970004240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:02.398 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098b400640 1 --2- 172.21.15.137:0/2526650760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09700037b0 0x7f0970003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:02.398 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098be00640 1 -- 172.21.15.137:0/2526650760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f098c15d310 msgr2=0x7f0970004240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:02.398 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098be00640 1 --2- 172.21.15.137:0/2526650760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f098c15d310 0x7f0970004240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:02.398 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098be00640 1 -- 172.21.15.137:0/2526650760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09700037b0 msgr2=0x7f0970003c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:02.398 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098be00640 1 --2- 172.21.15.137:0/2526650760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09700037b0 0x7f0970003c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:02.398 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.391+0000 7f098be00640 1 -- 172.21.15.137:0/2526650760 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0970003530 con 0x7f0970004c10 2024-04-26T23:41:02.400 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.395+0000 7f098be00640 1 --2- 172.21.15.137:0/2526650760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0970004c10 0x7f0970004ff0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f097c00c820 tx=0x7f097c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf57ae85cdde36f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:02.400 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.395+0000 7f098aa00640 1 -- 172.21.15.137:0/2526650760 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c0b0070 con 0x7f0970004c10 2024-04-26T23:41:02.400 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.395+0000 7f098aa00640 1 -- 172.21.15.137:0/2526650760 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f097c0ab600 con 0x7f0970004c10 2024-04-26T23:41:02.400 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.395+0000 7f098aa00640 1 -- 172.21.15.137:0/2526650760 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c00f040 con 0x7f0970004c10 2024-04-26T23:41:02.400 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.395+0000 7f0993000640 1 -- 172.21.15.137:0/2526650760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0970004c10 msgr2=0x7f0970004ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:02.400 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.395+0000 7f0993000640 1 --2- 172.21.15.137:0/2526650760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0970004c10 0x7f0970004ff0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f097c00c820 tx=0x7f097c01c510 comp rx=0 tx=0).stop 2024-04-26T23:41:02.400 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.395+0000 7f0991000640 1 -- 172.21.15.137:0/2526650760 reap_dead start 2024-04-26T23:41:02.400 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.395+0000 7f0993000640 1 -- 172.21.15.137:0/2526650760 shutdown_connections 2024-04-26T23:41:02.401 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.395+0000 7f0993000640 1 -- 172.21.15.137:0/2526650760 >> 172.21.15.137:0/2526650760 conn(0x7f098c0d2e50 msgr2=0x7f098c0d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:02.401 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.395+0000 7f0993000640 1 -- 172.21.15.137:0/2526650760 shutdown_connections 2024-04-26T23:41:02.401 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.395+0000 7f0993000640 1 -- 172.21.15.137:0/2526650760 wait complete. 2024-04-26T23:41:02.404 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.395+0000 7f0993000640 1 Processor -- start 2024-04-26T23:41:02.404 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.395+0000 7f0993000640 1 -- start start 2024-04-26T23:41:02.404 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f0993000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0970004c10 0x7f098c0c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:02.404 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f0993000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f098c157790 0x7f098c156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:02.404 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f0993000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f098c1581c0 0x7f098c15f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:02.404 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f0993000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f098c0ce550 con 0x7f0970004c10 2024-04-26T23:41:02.404 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f0993000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f098c0ce3d0 con 0x7f098c1581c0 2024-04-26T23:41:02.404 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f0993000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f098c0d0560 con 0x7f098c157790 2024-04-26T23:41:02.404 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f098be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0970004c10 0x7f098c0c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:02.404 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f098be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0970004c10 0x7f098c0c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41880/0 (socket says 172.21.15.137:41880) 2024-04-26T23:41:02.404 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f098be00640 1 -- 172.21.15.137:0/2832636674 learned_addr learned my addr 172.21.15.137:0/2832636674 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:02.404 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f0991000640 1 --2- 172.21.15.137:0/2832636674 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f098c1581c0 0x7f098c15f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:02.405 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f098b400640 1 --2- 172.21.15.137:0/2832636674 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f098c157790 0x7f098c156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:02.405 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f098b400640 1 -- 172.21.15.137:0/2832636674 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f098c157790 msgr2=0x7f098c156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-26T23:41:02.405 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f098b400640 1 -- 172.21.15.137:0/2832636674 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f098c157790 msgr2=0x7f098c156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:41:02.405 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f098b400640 1 --2- 172.21.15.137:0/2832636674 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f098c157790 0x7f098c156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:41:02.405 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f098be00640 1 -- 172.21.15.137:0/2832636674 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f098c157790 msgr2=0x7f098c156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:02.405 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f098b400640 1 --2- 172.21.15.137:0/2832636674 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f098c157790 0x7f098c156ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:41:02.405 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f098be00640 1 --2- 172.21.15.137:0/2832636674 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f098c157790 0x7f098c156ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:02.405 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f098be00640 1 -- 172.21.15.137:0/2832636674 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f098c1581c0 msgr2=0x7f098c15f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:02.405 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f098be00640 1 --2- 172.21.15.137:0/2832636674 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f098c1581c0 0x7f098c15f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:02.405 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f098be00640 1 -- 172.21.15.137:0/2832636674 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f098c158da0 con 0x7f0970004c10 2024-04-26T23:41:02.405 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f0991000640 1 --2- 172.21.15.137:0/2832636674 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f098c1581c0 0x7f098c15f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:41:02.405 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f098be00640 1 --2- 172.21.15.137:0/2832636674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0970004c10 0x7f098c0c7500 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f097c097e10 tx=0x7f0970005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:02.405 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f0983e00640 1 -- 172.21.15.137:0/2832636674 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c0b0070 con 0x7f0970004c10 2024-04-26T23:41:02.406 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f0983e00640 1 -- 172.21.15.137:0/2832636674 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f097c0bd070 con 0x7f0970004c10 2024-04-26T23:41:02.406 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f0993000640 1 -- 172.21.15.137:0/2832636674 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f098c158ac0 con 0x7f0970004c10 2024-04-26T23:41:02.406 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f0983e00640 1 -- 172.21.15.137:0/2832636674 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c0b7480 con 0x7f0970004c10 2024-04-26T23:41:02.406 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f0993000640 1 -- 172.21.15.137:0/2832636674 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f098c0c6d00 con 0x7f0970004c10 2024-04-26T23:41:02.406 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f0983e00640 1 -- 172.21.15.137:0/2832636674 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f097c0b7620 con 0x7f0970004c10 2024-04-26T23:41:02.406 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f0983e00640 1 -- 172.21.15.137:0/2832636674 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f097c0c2da0 con 0x7f0970004c10 2024-04-26T23:41:02.407 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.399+0000 7f0993000640 1 -- 172.21.15.137:0/2832636674 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f098c069930 con 0x7f0970004c10 2024-04-26T23:41:02.407 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.403+0000 7f0983e00640 1 -- 172.21.15.137:0/2832636674 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f097c016220 con 0x7f0970004c10 2024-04-26T23:41:02.464 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.459+0000 7f0993000640 1 -- 172.21.15.137:0/2832636674 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f098c15dd90 con 0x7f0970004c10 2024-04-26T23:41:02.465 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.459+0000 7f0983e00640 1 -- 172.21.15.137:0/2832636674 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f097c0b7af0 con 0x7f0970004c10 2024-04-26T23:41:02.465 INFO:teuthology.misc.health.smithi137.stdout: 2024-04-26T23:41:02.465 INFO:teuthology.misc.health.smithi137.stdout:{"epoch":10,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:01.114767+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:02.466 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.463+0000 7f0993000640 1 -- 172.21.15.137:0/2832636674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0970004c10 msgr2=0x7f098c0c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:02.466 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.463+0000 7f0993000640 1 --2- 172.21.15.137:0/2832636674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0970004c10 0x7f098c0c7500 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f097c097e10 tx=0x7f0970005840 comp rx=0 tx=0).stop 2024-04-26T23:41:02.466 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.463+0000 7f0993000640 1 -- 172.21.15.137:0/2832636674 shutdown_connections 2024-04-26T23:41:02.466 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.463+0000 7f0993000640 1 --2- 172.21.15.137:0/2832636674 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f098c1581c0 0x7f098c15f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:02.466 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.463+0000 7f0993000640 1 --2- 172.21.15.137:0/2832636674 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f098c157790 0x7f098c156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:02.466 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.463+0000 7f0993000640 1 --2- 172.21.15.137:0/2832636674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0970004c10 0x7f098c0c7500 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:02.467 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.463+0000 7f0993000640 1 -- 172.21.15.137:0/2832636674 >> 172.21.15.137:0/2832636674 conn(0x7f098c0d2e50 msgr2=0x7f098c160660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:02.467 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.463+0000 7f0993000640 1 -- 172.21.15.137:0/2832636674 shutdown_connections 2024-04-26T23:41:02.467 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:02.463+0000 7f0993000640 1 -- 172.21.15.137:0/2832636674 wait complete. 2024-04-26T23:41:02.482 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T23:41:02.798 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:41:02.795+0000 7f1b8ae55180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T23:41:02.885 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:41:02.879+0000 7f1b8ae55180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T23:41:02.904 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:41:02.899+0000 7f24b0454180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T23:41:02.992 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:41:02.987+0000 7f24b0454180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T23:41:03.087 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:41:03.083+0000 7f1b8ae55180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T23:41:03.172 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:41:03.167+0000 7f1b8ae55180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T23:41:03.197 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:41:03.191+0000 7f24b0454180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T23:41:03.282 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:41:03.279+0000 7f24b0454180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T23:41:03.501 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:41:03.495+0000 7f1b8ae55180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T23:41:03.572 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:41:03.567+0000 7f1b8ae55180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T23:41:03.620 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:41:03.615+0000 7f24b0454180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T23:41:03.691 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T23:41:03.687+0000 7f24b0454180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T23:41:04.592 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:41:04.587+0000 7f1b30600640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T23:41:04.595 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T23:41:04.591+0000 7f1b30600640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T23:41:05.644 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-26T23:41:05.639+0000 7fdd2a1347c0 -1 osd.5 0 log_to_monitors true 2024-04-26T23:41:05.694 INFO:tasks.ceph.osd.2.smithi137.stderr:2024-04-26T23:41:05.691+0000 7f98c922b7c0 -1 osd.2 0 log_to_monitors true 2024-04-26T23:41:05.756 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-04-26T23:41:05.751+0000 7f3078b7c7c0 -1 osd.1 0 log_to_monitors true 2024-04-26T23:41:05.768 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-26T23:41:05.762+0000 7f68c08a97c0 -1 osd.4 0 log_to_monitors true 2024-04-26T23:41:05.809 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-26T23:41:05.802+0000 7f5f34f517c0 -1 osd.7 0 log_to_monitors true 2024-04-26T23:41:05.873 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-04-26T23:41:05.867+0000 7f5f17f537c0 -1 osd.0 0 log_to_monitors true 2024-04-26T23:41:05.888 INFO:tasks.ceph.osd.3.smithi137.stderr:2024-04-26T23:41:05.883+0000 7f04989437c0 -1 osd.3 0 log_to_monitors true 2024-04-26T23:41:05.933 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-26T23:41:05.930+0000 7f94667ab7c0 -1 osd.6 0 log_to_monitors true 2024-04-26T23:41:09.238 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-26T23:41:09.234+0000 7f68bb800640 -1 osd.4 0 waiting for initial osdmap 2024-04-26T23:41:09.256 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-26T23:41:09.250+0000 7f5f2fe00640 -1 osd.7 0 waiting for initial osdmap 2024-04-26T23:41:09.267 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-26T23:41:09.262+0000 7f9462000640 -1 osd.6 0 waiting for initial osdmap 2024-04-26T23:41:09.271 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-26T23:41:09.266+0000 7f68b1800640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:41:09.282 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-26T23:41:09.278+0000 7f5f25e00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:41:09.289 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:09.295 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-26T23:41:09.290+0000 7fdd25a00640 -1 osd.5 0 waiting for initial osdmap 2024-04-26T23:41:09.303 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-26T23:41:09.298+0000 7f9457600640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:41:09.319 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-26T23:41:09.314+0000 7fdd1b000640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:41:09.503 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.499+0000 7f43ba000640 1 Processor -- start 2024-04-26T23:41:09.505 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.499+0000 7f43ba000640 1 -- start start 2024-04-26T23:41:09.505 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.499+0000 7f43ba000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f43b40b15c0 0x7f43b406d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.505 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.499+0000 7f43ba000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f43b40c6470 0x7f43b40afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.505 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.499+0000 7f43ba000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43b40b19a0 con 0x7f43b40b30b0 2024-04-26T23:41:09.505 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.499+0000 7f43ba000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f43b40b38a0 con 0x7f43b40b15c0 2024-04-26T23:41:09.505 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.499+0000 7f43ba000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f43b40b3b80 con 0x7f43b40c6470 2024-04-26T23:41:09.506 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.499+0000 7f43b8c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f43b40b15c0 0x7f43b406d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.506 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.499+0000 7f43b9600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f43b40c6470 0x7f43b40afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.506 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.499+0000 7f43b9600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f43b40c6470 0x7f43b40afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:49130/0 (socket says 172.21.15.137:49130) 2024-04-26T23:41:09.506 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.499+0000 7f43b9600640 1 -- 172.21.15.137:0/1696224142 learned_addr learned my addr 172.21.15.137:0/1696224142 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:09.507 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.503+0000 7f43b9600640 1 -- 172.21.15.137:0/1696224142 >> v2:172.21.15.137:3300/0 conn(0x7f43b40b15c0 msgr2=0x7f43b406d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:09.507 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.503+0000 7f43b9600640 1 --2- 172.21.15.137:0/1696224142 >> v2:172.21.15.137:3300/0 conn(0x7f43b40b15c0 0x7f43b406d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.507 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.503+0000 7f43b3400640 1 -- 172.21.15.137:0/1696224142 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1350481373 0 0) 0x7f43b40b19a0 con 0x7f43b40b30b0 2024-04-26T23:41:09.507 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.503+0000 7f43b9600640 1 -- 172.21.15.137:0/1696224142 >> v1:172.21.15.170:6789/0 conn(0x7f43b40b30b0 legacy=0x7f43b40c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.507 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.503+0000 7f43b9600640 1 -- 172.21.15.137:0/1696224142 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b40b3e60 con 0x7f43b40c6470 2024-04-26T23:41:09.512 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.507+0000 7f43b9600640 1 --2- 172.21.15.137:0/1696224142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43b40c6470 0x7f43b40afa80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f43b40b4800 tx=0x7f43a401c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e3502cd9bc40340 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:09.512 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.507+0000 7f43b3400640 1 -- 172.21.15.137:0/1696224142 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a40ab610 con 0x7f43b40c6470 2024-04-26T23:41:09.512 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.507+0000 7f43b3400640 1 -- 172.21.15.137:0/1696224142 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a40b0070 con 0x7f43b40c6470 2024-04-26T23:41:09.512 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.507+0000 7f43b3400640 1 -- 172.21.15.137:0/1696224142 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a40ab9d0 con 0x7f43b40c6470 2024-04-26T23:41:09.513 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.507+0000 7f43ba000640 1 -- 172.21.15.137:0/1696224142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43b40c6470 msgr2=0x7f43b40afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.513 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.507+0000 7f43ba000640 1 --2- 172.21.15.137:0/1696224142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43b40c6470 0x7f43b40afa80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f43b40b4800 tx=0x7f43a401c540 comp rx=0 tx=0).stop 2024-04-26T23:41:09.514 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.511+0000 7f43ba000640 1 -- 172.21.15.137:0/1696224142 shutdown_connections 2024-04-26T23:41:09.514 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.511+0000 7f43ba000640 1 --2- 172.21.15.137:0/1696224142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43b40c6470 0x7f43b40afa80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.514 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.511+0000 7f43ba000640 1 --2- 172.21.15.137:0/1696224142 >> v2:172.21.15.137:3300/0 conn(0x7f43b40b15c0 0x7f43b406d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.514 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.511+0000 7f43ba000640 1 -- 172.21.15.137:0/1696224142 >> 172.21.15.137:0/1696224142 conn(0x7f43b408cfd0 msgr2=0x7f43b409c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:09.515 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.511+0000 7f43ba000640 1 -- 172.21.15.137:0/1696224142 shutdown_connections 2024-04-26T23:41:09.515 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.511+0000 7f43ba000640 1 -- 172.21.15.137:0/1696224142 wait complete. 2024-04-26T23:41:09.517 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.511+0000 7f43ba000640 1 Processor -- start 2024-04-26T23:41:09.518 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.515+0000 7f43ba000640 1 -- start start 2024-04-26T23:41:09.520 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.515+0000 7f43ba000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43b40b15c0 0x7f43b409d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.520 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.515+0000 7f43ba000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43b40b30b0 0x7f43b4166450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.521 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.515+0000 7f43b3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43b40b30b0 0x7f43b4166450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.521 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.515+0000 7f43b8c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43b40b15c0 0x7f43b409d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.521 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.515+0000 7f43b8c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43b40b15c0 0x7f43b409d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:49142/0 (socket says 172.21.15.137:49142) 2024-04-26T23:41:09.521 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.515+0000 7f43ba000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43b40c6470 0x7f43b40b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.521 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.515+0000 7f43b8c00640 1 -- 172.21.15.137:0/137627567 learned_addr learned my addr 172.21.15.137:0/137627567 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:09.522 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.515+0000 7f43ba000640 1 -- 172.21.15.137:0/137627567 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f43b40b0950 con 0x7f43b40b30b0 2024-04-26T23:41:09.522 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.515+0000 7f43ba000640 1 -- 172.21.15.137:0/137627567 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f43b40b07d0 con 0x7f43b40b15c0 2024-04-26T23:41:09.522 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.515+0000 7f43ba000640 1 -- 172.21.15.137:0/137627567 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f43b40b0ad0 con 0x7f43b40c6470 2024-04-26T23:41:09.522 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.515+0000 7f43b9600640 1 --2- 172.21.15.137:0/137627567 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43b40c6470 0x7f43b40b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.522 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.519+0000 7f43b9600640 1 -- 172.21.15.137:0/137627567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43b40b15c0 msgr2=0x7f43b409d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.522 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.519+0000 7f43b9600640 1 --2- 172.21.15.137:0/137627567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43b40b15c0 0x7f43b409d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.522 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.519+0000 7f43b9600640 1 -- 172.21.15.137:0/137627567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43b40b30b0 msgr2=0x7f43b4166450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.523 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.519+0000 7f43b9600640 1 --2- 172.21.15.137:0/137627567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43b40b30b0 0x7f43b4166450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.523 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.519+0000 7f43b9600640 1 -- 172.21.15.137:0/137627567 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b40bc4f0 con 0x7f43b40c6470 2024-04-26T23:41:09.523 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.519+0000 7f43b3e00640 1 --2- 172.21.15.137:0/137627567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43b40b30b0 0x7f43b4166450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:09.523 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.519+0000 7f43b8c00640 1 --2- 172.21.15.137:0/137627567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43b40b15c0 0x7f43b409d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:09.525 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.519+0000 7f43b9600640 1 --2- 172.21.15.137:0/137627567 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43b40c6470 0x7f43b40b59b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f43a40ac000 tx=0x7f43a401ad80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:09.525 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.519+0000 7f43b0c00640 1 -- 172.21.15.137:0/137627567 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a40ba070 con 0x7f43b40c6470 2024-04-26T23:41:09.525 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.519+0000 7f43ba000640 1 -- 172.21.15.137:0/137627567 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b409cba0 con 0x7f43b40c6470 2024-04-26T23:41:09.525 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.519+0000 7f43ba000640 1 -- 172.21.15.137:0/137627567 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b409d160 con 0x7f43b40c6470 2024-04-26T23:41:09.525 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.519+0000 7f43b0c00640 1 -- 172.21.15.137:0/137627567 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a40abbd0 con 0x7f43b40c6470 2024-04-26T23:41:09.525 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.519+0000 7f43b0c00640 1 -- 172.21.15.137:0/137627567 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a40ba070 con 0x7f43b40c6470 2024-04-26T23:41:09.530 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.527+0000 7f43ba000640 1 -- 172.21.15.137:0/137627567 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f438c0052a0 con 0x7f43b40c6470 2024-04-26T23:41:09.533 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.527+0000 7f43b0c00640 1 -- 172.21.15.137:0/137627567 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7f43a4004020 con 0x7f43b40c6470 2024-04-26T23:41:09.534 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.531+0000 7f43b0c00640 1 --2- 172.21.15.137:0/137627567 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f43940684f0 0x7f439406a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.534 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.531+0000 7f43b0c00640 1 -- 172.21.15.137:0/137627567 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f43a411fd30 con 0x7f43b40c6470 2024-04-26T23:41:09.534 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.531+0000 7f43b8c00640 1 --2- 172.21.15.137:0/137627567 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f43940684f0 0x7f439406a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.538 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.535+0000 7f43b8c00640 1 --2- 172.21.15.137:0/137627567 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f43940684f0 0x7f439406a9b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f43b40c5b70 tx=0x7f43ac00b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:09.539 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.535+0000 7f43b0c00640 1 -- 172.21.15.137:0/137627567 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f43a40c3060 con 0x7f43b40c6470 2024-04-26T23:41:09.663 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-04-26T23:41:09.659+0000 7f3074400640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T23:41:09.721 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-04-26T23:41:09.715+0000 7f3069a00640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:41:09.868 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.863+0000 7f43ba000640 1 -- 172.21.15.137:0/137627567 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f438c005590 con 0x7f43b40c6470 2024-04-26T23:41:09.868 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.863+0000 7f43b0c00640 1 -- 172.21.15.137:0/137627567 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f43a40a8050 con 0x7f43b40c6470 2024-04-26T23:41:09.872 INFO:teuthology.misc.health.smithi137.stdout: 2024-04-26T23:41:09.872 INFO:teuthology.misc.health.smithi137.stdout:{"epoch":12,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:07.600713+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:09.873 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.867+0000 7f43ba000640 1 -- 172.21.15.137:0/137627567 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f43940684f0 msgr2=0x7f439406a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.873 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.867+0000 7f43ba000640 1 --2- 172.21.15.137:0/137627567 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f43940684f0 0x7f439406a9b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f43b40c5b70 tx=0x7f43ac00b040 comp rx=0 tx=0).stop 2024-04-26T23:41:09.873 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.867+0000 7f43ba000640 1 -- 172.21.15.137:0/137627567 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43b40c6470 msgr2=0x7f43b40b59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.873 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.867+0000 7f43ba000640 1 --2- 172.21.15.137:0/137627567 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43b40c6470 0x7f43b40b59b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f43a40ac000 tx=0x7f43a401ad80 comp rx=0 tx=0).stop 2024-04-26T23:41:09.873 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.867+0000 7f43ba000640 1 -- 172.21.15.137:0/137627567 shutdown_connections 2024-04-26T23:41:09.873 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.867+0000 7f43ba000640 1 --2- 172.21.15.137:0/137627567 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f43940684f0 0x7f439406a9b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.874 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.867+0000 7f43ba000640 1 --2- 172.21.15.137:0/137627567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43b40b30b0 0x7f43b4166450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.874 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.867+0000 7f43ba000640 1 --2- 172.21.15.137:0/137627567 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43b40c6470 0x7f43b40b59b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.874 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.867+0000 7f43ba000640 1 --2- 172.21.15.137:0/137627567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43b40b15c0 0x7f43b409d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.874 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.867+0000 7f43ba000640 1 -- 172.21.15.137:0/137627567 >> 172.21.15.137:0/137627567 conn(0x7f43b408cfd0 msgr2=0x7f43b40c8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:09.874 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.867+0000 7f43ba000640 1 -- 172.21.15.137:0/137627567 shutdown_connections 2024-04-26T23:41:09.874 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:09.867+0000 7f43ba000640 1 -- 172.21.15.137:0/137627567 wait complete. 2024-04-26T23:41:09.900 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T23:41:09.911 INFO:tasks.ceph.osd.2.smithi137.stderr:2024-04-26T23:41:09.907+0000 7f98c4000640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T23:41:09.943 INFO:tasks.ceph.osd.2.smithi137.stderr:2024-04-26T23:41:09.939+0000 7f98b9600640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:41:09.944 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-04-26T23:41:09.939+0000 7f5f12e00640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T23:41:09.967 INFO:tasks.ceph.osd.3.smithi137.stderr:2024-04-26T23:41:09.963+0000 7f0494200640 -1 osd.3 0 waiting for initial osdmap 2024-04-26T23:41:09.975 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-04-26T23:41:09.971+0000 7f5f08e00640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:41:10.003 INFO:tasks.ceph.osd.3.smithi137.stderr:2024-04-26T23:41:09.999+0000 7f0489800640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:41:16.707 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:16.844 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.838+0000 7f5459c00640 1 Processor -- start 2024-04-26T23:41:16.844 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.838+0000 7f5459c00640 1 -- start start 2024-04-26T23:41:16.845 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.838+0000 7f5459c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f54540cd0a0 0x7f54540cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:16.845 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.838+0000 7f5459c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f545415ae90 con 0x7f5454072390 2024-04-26T23:41:16.845 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.838+0000 7f5459c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5454073230 con 0x7f5454073f50 2024-04-26T23:41:16.845 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.838+0000 7f5459c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f545406df90 con 0x7f54540cd0a0 2024-04-26T23:41:16.845 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.838+0000 7f5452a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f5454072390 0x7f545406faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48898/0 (socket says 172.21.15.137:48898) 2024-04-26T23:41:16.846 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.838+0000 7f5452a00640 1 -- 172.21.15.137:0/1242711011 learned_addr learned my addr 172.21.15.137:0/1242711011 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:16.847 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.838+0000 7f5453400640 1 --2- 172.21.15.137:0/1242711011 >> v2:172.21.15.170:3300/0 conn(0x7f54540cd0a0 0x7f54540cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:16.848 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.838+0000 7f5452000640 1 -- 172.21.15.137:0/1242711011 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4034613331 0 0) 0x7f545415ae90 con 0x7f5454072390 2024-04-26T23:41:16.848 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.838+0000 7f5452000640 1 -- 172.21.15.137:0/1242711011 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5438003530 con 0x7f5454072390 2024-04-26T23:41:16.848 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f5452000640 1 -- 172.21.15.137:0/1242711011 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1111194635 0 0) 0x7f5438003530 con 0x7f5454072390 2024-04-26T23:41:16.848 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f5452000640 1 -- 172.21.15.137:0/1242711011 >> v2:172.21.15.170:3300/0 conn(0x7f54540cd0a0 msgr2=0x7f54540cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:16.848 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f5452000640 1 --2- 172.21.15.137:0/1242711011 >> v2:172.21.15.170:3300/0 conn(0x7f54540cd0a0 0x7f54540cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:16.848 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f5452000640 1 -- 172.21.15.137:0/1242711011 >> v1:172.21.15.170:6789/0 conn(0x7f5454073f50 legacy=0x7f5454072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:16.848 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f5452000640 1 -- 172.21.15.137:0/1242711011 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f545415dfd0 con 0x7f5454072390 2024-04-26T23:41:16.848 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f5452000640 1 -- 172.21.15.137:0/1242711011 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f5444001680 con 0x7f5454072390 2024-04-26T23:41:16.848 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f5452000640 1 -- 172.21.15.137:0/1242711011 >> v1:172.21.15.137:6789/0 conn(0x7f5454072390 legacy=0x7f545406faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:16.848 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f5452000640 1 --2- 172.21.15.137:0/1242711011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54380039c0 0x7f5438003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:16.848 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f5452000640 1 --2- 172.21.15.137:0/1242711011 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5438004810 0x7f5438004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:16.848 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f5452000640 1 --2- 172.21.15.137:0/1242711011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54380051d0 0x7f543800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:16.849 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f5452000640 1 -- 172.21.15.137:0/1242711011 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f545406df90 con 0x7f54380051d0 2024-04-26T23:41:16.849 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f5452000640 1 -- 172.21.15.137:0/1242711011 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f543800c170 con 0x7f54380039c0 2024-04-26T23:41:16.849 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f5452000640 1 -- 172.21.15.137:0/1242711011 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f543800c370 con 0x7f5438004810 2024-04-26T23:41:16.849 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f5453400640 1 --2- 172.21.15.137:0/1242711011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54380051d0 0x7f543800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:16.849 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f5452a00640 1 --2- 172.21.15.137:0/1242711011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54380039c0 0x7f5438003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:16.849 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f544be00640 1 --2- 172.21.15.137:0/1242711011 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5438004810 0x7f5438004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:16.849 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f5453400640 1 -- 172.21.15.137:0/1242711011 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5438004810 msgr2=0x7f5438004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:16.849 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f5453400640 1 --2- 172.21.15.137:0/1242711011 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5438004810 0x7f5438004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:16.849 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f5453400640 1 -- 172.21.15.137:0/1242711011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54380039c0 msgr2=0x7f5438003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:16.849 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f5453400640 1 --2- 172.21.15.137:0/1242711011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54380039c0 0x7f5438003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:16.849 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f5453400640 1 -- 172.21.15.137:0/1242711011 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5438003530 con 0x7f54380051d0 2024-04-26T23:41:16.850 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f5453400640 1 -- 172.21.15.137:0/1242711011 reap_dead start 2024-04-26T23:41:16.850 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.842+0000 7f5453400640 1 --2- 172.21.15.137:0/1242711011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54380051d0 0x7f543800b9d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f544c009f90 tx=0x7f544c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b6913f3d1c4377 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:16.850 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f5452000640 1 -- 172.21.15.137:0/1242711011 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f544c0b2070 con 0x7f54380051d0 2024-04-26T23:41:16.850 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f5452000640 1 -- 172.21.15.137:0/1242711011 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f544c0a5c90 con 0x7f54380051d0 2024-04-26T23:41:16.850 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f5452000640 1 -- 172.21.15.137:0/1242711011 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f544c009c10 con 0x7f54380051d0 2024-04-26T23:41:16.851 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f5459c00640 1 -- 172.21.15.137:0/1242711011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54380051d0 msgr2=0x7f543800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:16.851 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f5459c00640 1 --2- 172.21.15.137:0/1242711011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54380051d0 0x7f543800b9d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f544c009f90 tx=0x7f544c01cc80 comp rx=0 tx=0).stop 2024-04-26T23:41:16.851 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f5459c00640 1 -- 172.21.15.137:0/1242711011 shutdown_connections 2024-04-26T23:41:16.851 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f5459c00640 1 --2- 172.21.15.137:0/1242711011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54380051d0 0x7f543800b9d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:16.851 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f5459c00640 1 -- 172.21.15.137:0/1242711011 >> 172.21.15.137:0/1242711011 conn(0x7f54540d0bb0 msgr2=0x7f54540d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:16.851 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f5459c00640 1 -- 172.21.15.137:0/1242711011 shutdown_connections 2024-04-26T23:41:16.851 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f5459c00640 1 -- 172.21.15.137:0/1242711011 wait complete. 2024-04-26T23:41:16.852 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f5459c00640 1 Processor -- start 2024-04-26T23:41:16.852 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f5459c00640 1 -- start start 2024-04-26T23:41:16.855 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f5459c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54380051d0 0x7f5454160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:16.855 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f5459c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54540b5960 0x7f54540cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:16.855 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f5459c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54540b3a50 0x7f54540b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:16.855 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f5459c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f545406faf0 con 0x7f54540b3a50 2024-04-26T23:41:16.855 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f5459c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f545406e270 con 0x7f54380051d0 2024-04-26T23:41:16.855 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f5459c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f545406fc70 con 0x7f54540b5960 2024-04-26T23:41:16.855 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f5453400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54540b3a50 0x7f54540b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:16.855 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f5453400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54540b3a50 0x7f54540b3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54176/0 (socket says 172.21.15.137:54176) 2024-04-26T23:41:16.855 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f5453400640 1 -- 172.21.15.137:0/2804435961 learned_addr learned my addr 172.21.15.137:0/2804435961 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:16.855 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f5452a00640 1 --2- 172.21.15.137:0/2804435961 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54380051d0 0x7f5454160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:16.855 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.846+0000 7f544be00640 1 --2- 172.21.15.137:0/2804435961 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54540b5960 0x7f54540cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:16.856 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.850+0000 7f5453400640 1 -- 172.21.15.137:0/2804435961 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54540b5960 msgr2=0x7f54540cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:16.856 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.850+0000 7f5453400640 1 --2- 172.21.15.137:0/2804435961 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54540b5960 0x7f54540cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:16.856 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.850+0000 7f5453400640 1 -- 172.21.15.137:0/2804435961 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54380051d0 msgr2=0x7f5454160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:16.856 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.850+0000 7f5453400640 1 --2- 172.21.15.137:0/2804435961 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54380051d0 0x7f5454160ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:16.856 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.850+0000 7f5453400640 1 -- 172.21.15.137:0/2804435961 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54540b6140 con 0x7f54540b3a50 2024-04-26T23:41:16.856 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.850+0000 7f544be00640 1 --2- 172.21.15.137:0/2804435961 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54540b5960 0x7f54540cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:16.856 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.850+0000 7f5452a00640 1 --2- 172.21.15.137:0/2804435961 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54380051d0 0x7f5454160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:16.856 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.850+0000 7f5453400640 1 --2- 172.21.15.137:0/2804435961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54540b3a50 0x7f54540b3ed0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f544c01d520 tx=0x7f544c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:16.856 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.850+0000 7f544aa00640 1 -- 172.21.15.137:0/2804435961 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f544c0bb070 con 0x7f54540b3a50 2024-04-26T23:41:16.856 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.850+0000 7f544aa00640 1 -- 172.21.15.137:0/2804435961 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f544c0ada60 con 0x7f54540b3a50 2024-04-26T23:41:16.856 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.850+0000 7f544aa00640 1 -- 172.21.15.137:0/2804435961 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f544c0b2040 con 0x7f54540b3a50 2024-04-26T23:41:16.856 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.850+0000 7f5459c00640 1 -- 172.21.15.137:0/2804435961 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54540b6420 con 0x7f54540b3a50 2024-04-26T23:41:16.856 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.850+0000 7f5459c00640 1 -- 172.21.15.137:0/2804435961 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54540ce820 con 0x7f54540b3a50 2024-04-26T23:41:16.857 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.850+0000 7f5459c00640 1 -- 172.21.15.137:0/2804435961 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5454069d90 con 0x7f54540b3a50 2024-04-26T23:41:16.857 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.850+0000 7f544aa00640 1 -- 172.21.15.137:0/2804435961 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f544c0be070 con 0x7f54540b3a50 2024-04-26T23:41:16.858 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.850+0000 7f544aa00640 1 --2- 172.21.15.137:0/2804435961 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5430068380 0x7f543006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:16.858 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.854+0000 7f544aa00640 1 -- 172.21.15.137:0/2804435961 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f544c120380 con 0x7f54540b3a50 2024-04-26T23:41:16.858 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.854+0000 7f5452a00640 1 --2- 172.21.15.137:0/2804435961 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5430068380 0x7f543006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:16.859 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.854+0000 7f5452a00640 1 --2- 172.21.15.137:0/2804435961 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5430068380 0x7f543006a840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5444000c10 tx=0x7f5444009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:16.863 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:16.858+0000 7f544aa00640 1 -- 172.21.15.137:0/2804435961 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f544c016990 con 0x7f54540b3a50 2024-04-26T23:41:17.026 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:17.018+0000 7f5459c00640 1 -- 172.21.15.137:0/2804435961 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f54540c5930 con 0x7f54540b3a50 2024-04-26T23:41:17.027 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:17.022+0000 7f544aa00640 1 -- 172.21.15.137:0/2804435961 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12932 (secure 0 0 0) 0x7f544c0f06b0 con 0x7f54540b3a50 2024-04-26T23:41:17.027 INFO:teuthology.misc.health.smithi137.stdout: 2024-04-26T23:41:17.027 INFO:teuthology.misc.health.smithi137.stdout:{"epoch":16,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:13.632279+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:17.029 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:17.022+0000 7f5459c00640 1 -- 172.21.15.137:0/2804435961 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5430068380 msgr2=0x7f543006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:17.029 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:17.022+0000 7f5459c00640 1 --2- 172.21.15.137:0/2804435961 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5430068380 0x7f543006a840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5444000c10 tx=0x7f5444009040 comp rx=0 tx=0).stop 2024-04-26T23:41:17.029 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:17.022+0000 7f5459c00640 1 -- 172.21.15.137:0/2804435961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54540b3a50 msgr2=0x7f54540b3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:17.029 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:17.022+0000 7f5459c00640 1 --2- 172.21.15.137:0/2804435961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54540b3a50 0x7f54540b3ed0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f544c01d520 tx=0x7f544c009750 comp rx=0 tx=0).stop 2024-04-26T23:41:17.029 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:17.022+0000 7f5459c00640 1 -- 172.21.15.137:0/2804435961 shutdown_connections 2024-04-26T23:41:17.029 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:17.022+0000 7f5459c00640 1 --2- 172.21.15.137:0/2804435961 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5430068380 0x7f543006a840 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.029 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:17.022+0000 7f5459c00640 1 --2- 172.21.15.137:0/2804435961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54540b3a50 0x7f54540b3ed0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.029 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:17.022+0000 7f5459c00640 1 --2- 172.21.15.137:0/2804435961 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54540b5960 0x7f54540cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.029 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:17.022+0000 7f5459c00640 1 --2- 172.21.15.137:0/2804435961 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54380051d0 0x7f5454160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.030 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:17.022+0000 7f5459c00640 1 -- 172.21.15.137:0/2804435961 >> 172.21.15.137:0/2804435961 conn(0x7f54540d0bb0 msgr2=0x7f545415d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:17.030 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:17.022+0000 7f5459c00640 1 -- 172.21.15.137:0/2804435961 shutdown_connections 2024-04-26T23:41:17.030 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T23:41:17.022+0000 7f5459c00640 1 -- 172.21.15.137:0/2804435961 wait complete. 2024-04-26T23:41:17.045 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-26T23:41:17.046 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T23:41:17.046 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T23:41:17.046 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T23:41:17.050 INFO:tasks.ceph.mds.a:Started 2024-04-26T23:41:17.050 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T23:41:17.050 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T23:41:17.053 INFO:tasks.ceph.mds.c:Started 2024-04-26T23:41:17.053 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T23:41:17.053 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T23:41:17.057 INFO:tasks.ceph.mds.b:Started 2024-04-26T23:41:17.057 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T23:41:17.057 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T23:41:17.060 INFO:tasks.ceph.mds.d:Started 2024-04-26T23:41:17.060 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T23:41:17.061 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:17.145 INFO:tasks.ceph.mds.a.smithi137.stdout:starting mds.a at 2024-04-26T23:41:17.148 INFO:tasks.ceph.mds.c.smithi137.stdout:starting mds.c at 2024-04-26T23:41:17.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.202+0000 7ff6e8600640 1 Processor -- start 2024-04-26T23:41:17.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.202+0000 7ff6e8600640 1 -- start start 2024-04-26T23:41:17.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.202+0000 7ff6e8600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff6e00b4100 0x7ff6e00d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:17.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.202+0000 7ff6e8600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff6e00d2d80 0x7ff6e00d3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:17.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.202+0000 7ff6e8600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6e00d36c0 con 0x7ff6e015f3d0 2024-04-26T23:41:17.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.202+0000 7ff6e8600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff6e00b2960 con 0x7ff6e00d2d80 2024-04-26T23:41:17.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.202+0000 7ff6e8600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff6e0160240 con 0x7ff6e00b4100 2024-04-26T23:41:17.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.202+0000 7ff6e6600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff6e00d2d80 0x7ff6e00d3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:17.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.202+0000 7ff6e5c00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7ff6e015f3d0 0x7ff6e015f7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48920/0 (socket says 172.21.15.137:48920) 2024-04-26T23:41:17.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.202+0000 7ff6e5c00640 1 -- 172.21.15.137:0/598397478 learned_addr learned my addr 172.21.15.137:0/598397478 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:17.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.202+0000 7ff6e5200640 1 --2- 172.21.15.137:0/598397478 >> v2:172.21.15.170:3300/0 conn(0x7ff6e00b4100 0x7ff6e00d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:17.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.202+0000 7ff6e6600640 1 -- 172.21.15.137:0/598397478 >> v2:172.21.15.170:3300/0 conn(0x7ff6e00b4100 msgr2=0x7ff6e00d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:17.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.202+0000 7ff6e6600640 1 --2- 172.21.15.137:0/598397478 >> v2:172.21.15.170:3300/0 conn(0x7ff6e00b4100 0x7ff6e00d1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.202+0000 7ff6e6600640 1 -- 172.21.15.137:0/598397478 >> v1:172.21.15.137:6789/0 conn(0x7ff6e015f3d0 legacy=0x7ff6e015f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:17.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.202+0000 7ff6dfe00640 1 -- 172.21.15.137:0/598397478 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3056766935 0 0) 0x7ff6e00d36c0 con 0x7ff6e015f3d0 2024-04-26T23:41:17.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.202+0000 7ff6e6600640 1 -- 172.21.15.137:0/598397478 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e0160520 con 0x7ff6e00d2d80 2024-04-26T23:41:17.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.206+0000 7ff6e6600640 1 --2- 172.21.15.137:0/598397478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e00d2d80 0x7ff6e00d3180 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0074160 tx=0x7ff6d801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3532a89e4cee932f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:17.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.206+0000 7ff6dfe00640 1 -- 172.21.15.137:0/598397478 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d80b2070 con 0x7ff6e00d2d80 2024-04-26T23:41:17.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.206+0000 7ff6dfe00640 1 -- 172.21.15.137:0/598397478 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d80a5900 con 0x7ff6e00d2d80 2024-04-26T23:41:17.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.206+0000 7ff6dfe00640 1 -- 172.21.15.137:0/598397478 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d80a5cd0 con 0x7ff6e00d2d80 2024-04-26T23:41:17.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.206+0000 7ff6e8600640 1 -- 172.21.15.137:0/598397478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e00d2d80 msgr2=0x7ff6e00d3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:17.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.206+0000 7ff6e8600640 1 --2- 172.21.15.137:0/598397478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e00d2d80 0x7ff6e00d3180 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0074160 tx=0x7ff6d801c930 comp rx=0 tx=0).stop 2024-04-26T23:41:17.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.206+0000 7ff6e8600640 1 -- 172.21.15.137:0/598397478 shutdown_connections 2024-04-26T23:41:17.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.206+0000 7ff6e8600640 1 --2- 172.21.15.137:0/598397478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e00d2d80 0x7ff6e00d3180 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.206+0000 7ff6e8600640 1 --2- 172.21.15.137:0/598397478 >> v2:172.21.15.170:3300/0 conn(0x7ff6e00b4100 0x7ff6e00d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.206+0000 7ff6e8600640 1 -- 172.21.15.137:0/598397478 >> 172.21.15.137:0/598397478 conn(0x7ff6e009ba60 msgr2=0x7ff6e009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:17.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.206+0000 7ff6e8600640 1 -- 172.21.15.137:0/598397478 shutdown_connections 2024-04-26T23:41:17.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.206+0000 7ff6e8600640 1 -- 172.21.15.137:0/598397478 wait complete. 2024-04-26T23:41:17.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6e8600640 1 Processor -- start 2024-04-26T23:41:17.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6e8600640 1 -- start start 2024-04-26T23:41:17.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6e8600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6e00b4100 0x7ff6e014cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:17.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6e8600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6e00d2d80 0x7ff6e015c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:17.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6e8600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e015f3d0 0x7ff6e00b7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:17.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6e8600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e00b39d0 con 0x7ff6e015f3d0 2024-04-26T23:41:17.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6e8600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e00b3850 con 0x7ff6e00b4100 2024-04-26T23:41:17.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6e8600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e00b3b50 con 0x7ff6e00d2d80 2024-04-26T23:41:17.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6e6600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e015f3d0 0x7ff6e00b7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:17.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6e6600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e015f3d0 0x7ff6e00b7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54204/0 (socket says 172.21.15.137:54204) 2024-04-26T23:41:17.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6e6600640 1 -- 172.21.15.137:0/1934446688 learned_addr learned my addr 172.21.15.137:0/1934446688 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:17.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6e5c00640 1 --2- 172.21.15.137:0/1934446688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6e00b4100 0x7ff6e014cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:17.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6e5200640 1 --2- 172.21.15.137:0/1934446688 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6e00d2d80 0x7ff6e015c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:17.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6e6600640 1 -- 172.21.15.137:0/1934446688 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6e00d2d80 msgr2=0x7ff6e015c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:17.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6e6600640 1 --2- 172.21.15.137:0/1934446688 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6e00d2d80 0x7ff6e015c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6e6600640 1 -- 172.21.15.137:0/1934446688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6e00b4100 msgr2=0x7ff6e014cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:17.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6e6600640 1 --2- 172.21.15.137:0/1934446688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6e00b4100 0x7ff6e014cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6e6600640 1 -- 172.21.15.137:0/1934446688 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e014d310 con 0x7ff6e015f3d0 2024-04-26T23:41:17.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6e6600640 1 --2- 172.21.15.137:0/1934446688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e015f3d0 0x7ff6e00b7ec0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff6d801afe0 tx=0x7ff6d80196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:17.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6dd600640 1 -- 172.21.15.137:0/1934446688 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d80b2050 con 0x7ff6e015f3d0 2024-04-26T23:41:17.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6dd600640 1 -- 172.21.15.137:0/1934446688 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d80be070 con 0x7ff6e015f3d0 2024-04-26T23:41:17.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6dd600640 1 -- 172.21.15.137:0/1934446688 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d80ada90 con 0x7ff6e015f3d0 2024-04-26T23:41:17.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6e8600640 1 -- 172.21.15.137:0/1934446688 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e014d5a0 con 0x7ff6e015f3d0 2024-04-26T23:41:17.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.210+0000 7ff6e8600640 1 -- 172.21.15.137:0/1934446688 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e00b1ab0 con 0x7ff6e015f3d0 2024-04-26T23:41:17.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.214+0000 7ff6e8600640 1 -- 172.21.15.137:0/1934446688 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6e006a4b0 con 0x7ff6e015f3d0 2024-04-26T23:41:17.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.214+0000 7ff6dd600640 1 -- 172.21.15.137:0/1934446688 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff6d80adc30 con 0x7ff6e015f3d0 2024-04-26T23:41:17.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.214+0000 7ff6dd600640 1 --2- 172.21.15.137:0/1934446688 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff6c0068380 0x7ff6c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:17.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.214+0000 7ff6dd600640 1 -- 172.21.15.137:0/1934446688 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff6d81217f0 con 0x7ff6e015f3d0 2024-04-26T23:41:17.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.214+0000 7ff6e5c00640 1 --2- 172.21.15.137:0/1934446688 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff6c0068380 0x7ff6c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:17.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.214+0000 7ff6e5c00640 1 --2- 172.21.15.137:0/1934446688 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff6c0068380 0x7ff6c006a840 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4007fd0 tx=0x7ff6d4007d60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:17.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.218+0000 7ff6dd600640 1 -- 172.21.15.137:0/1934446688 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff6d8016520 con 0x7ff6e015f3d0 2024-04-26T23:41:17.330 INFO:tasks.ceph.mds.d.smithi170.stdout:starting mds.d at 2024-04-26T23:41:17.330 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2024-04-26T23:41:17.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.378+0000 7ff6e8600640 1 -- 172.21.15.137:0/1934446688 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6e00b24f0 con 0x7ff6e015f3d0 2024-04-26T23:41:17.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.378+0000 7ff6dd600640 1 -- 172.21.15.137:0/1934446688 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12932 (secure 0 0 0) 0x7ff6d80f1b40 con 0x7ff6e015f3d0 2024-04-26T23:41:17.385 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:17.386 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":16,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:13.632279+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:17.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.382+0000 7ff6e8600640 1 -- 172.21.15.137:0/1934446688 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff6c0068380 msgr2=0x7ff6c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:17.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.382+0000 7ff6e8600640 1 --2- 172.21.15.137:0/1934446688 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff6c0068380 0x7ff6c006a840 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4007fd0 tx=0x7ff6d4007d60 comp rx=0 tx=0).stop 2024-04-26T23:41:17.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.382+0000 7ff6e8600640 1 -- 172.21.15.137:0/1934446688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e015f3d0 msgr2=0x7ff6e00b7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:17.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.382+0000 7ff6e8600640 1 --2- 172.21.15.137:0/1934446688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e015f3d0 0x7ff6e00b7ec0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff6d801afe0 tx=0x7ff6d80196d0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.382+0000 7ff6e8600640 1 -- 172.21.15.137:0/1934446688 shutdown_connections 2024-04-26T23:41:17.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.382+0000 7ff6e8600640 1 --2- 172.21.15.137:0/1934446688 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff6c0068380 0x7ff6c006a840 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.382+0000 7ff6e8600640 1 --2- 172.21.15.137:0/1934446688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e015f3d0 0x7ff6e00b7ec0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.382+0000 7ff6e8600640 1 --2- 172.21.15.137:0/1934446688 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6e00d2d80 0x7ff6e015c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.382+0000 7ff6e8600640 1 --2- 172.21.15.137:0/1934446688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6e00b4100 0x7ff6e014cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.382+0000 7ff6e8600640 1 -- 172.21.15.137:0/1934446688 >> 172.21.15.137:0/1934446688 conn(0x7ff6e009ba60 msgr2=0x7ff6e0070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:17.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.382+0000 7ff6e8600640 1 -- 172.21.15.137:0/1934446688 shutdown_connections 2024-04-26T23:41:17.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.382+0000 7ff6e8600640 1 -- 172.21.15.137:0/1934446688 wait complete. 2024-04-26T23:41:17.406 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:41:17.406 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:41:17.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.538+0000 7fe6f5c00640 1 Processor -- start 2024-04-26T23:41:17.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.538+0000 7fe6f5c00640 1 -- start start 2024-04-26T23:41:17.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.538+0000 7fe6f5c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe6f0073f20 0x7fe6f015df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:17.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.538+0000 7fe6f5c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe6f00affa0 0x7fe6f00ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:17.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.538+0000 7fe6f5c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6f0072860 con 0x7fe6f00afbc0 2024-04-26T23:41:17.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.538+0000 7fe6f5c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe6f00743b0 con 0x7fe6f0073f20 2024-04-26T23:41:17.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.538+0000 7fe6f5c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe6f0072b00 con 0x7fe6f00affa0 2024-04-26T23:41:17.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.542+0000 7fe6eea00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fe6f00afbc0 0x7fe6f00735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48934/0 (socket says 172.21.15.137:48934) 2024-04-26T23:41:17.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.542+0000 7fe6eea00640 1 -- 172.21.15.137:0/2809439963 learned_addr learned my addr 172.21.15.137:0/2809439963 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:17.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.542+0000 7fe6e6000640 1 --2- 172.21.15.137:0/2809439963 >> v2:172.21.15.137:3300/0 conn(0x7fe6f0073f20 0x7fe6f015df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:17.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.542+0000 7fe6ef400640 1 --2- 172.21.15.137:0/2809439963 >> v2:172.21.15.170:3300/0 conn(0x7fe6f00affa0 0x7fe6f00ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:17.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.542+0000 7fe6e6000640 1 -- 172.21.15.137:0/2809439963 >> v2:172.21.15.170:3300/0 conn(0x7fe6f00affa0 msgr2=0x7fe6f00ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:17.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.542+0000 7fe6e6000640 1 --2- 172.21.15.137:0/2809439963 >> v2:172.21.15.170:3300/0 conn(0x7fe6f00affa0 0x7fe6f00ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.542+0000 7fe6e6000640 1 -- 172.21.15.137:0/2809439963 >> v1:172.21.15.137:6789/0 conn(0x7fe6f00afbc0 legacy=0x7fe6f00735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:17.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.542+0000 7fe6e6000640 1 -- 172.21.15.137:0/2809439963 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f0072de0 con 0x7fe6f0073f20 2024-04-26T23:41:17.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.542+0000 7fe6ee000640 1 -- 172.21.15.137:0/2809439963 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2758622835 0 0) 0x7fe6f0072860 con 0x7fe6f00afbc0 2024-04-26T23:41:17.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.542+0000 7fe6e6000640 1 --2- 172.21.15.137:0/2809439963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6f0073f20 0x7fe6f015df90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80097c0 tx=0x7fe6d801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b3c050ad602539 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:17.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.542+0000 7fe6ee000640 1 -- 172.21.15.137:0/2809439963 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d80b0070 con 0x7fe6f0073f20 2024-04-26T23:41:17.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.542+0000 7fe6ee000640 1 -- 172.21.15.137:0/2809439963 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d80ab600 con 0x7fe6f0073f20 2024-04-26T23:41:17.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.542+0000 7fe6ee000640 1 -- 172.21.15.137:0/2809439963 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d80ab9d0 con 0x7fe6f0073f20 2024-04-26T23:41:17.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6f5c00640 1 -- 172.21.15.137:0/2809439963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6f0073f20 msgr2=0x7fe6f015df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:17.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6f5c00640 1 --2- 172.21.15.137:0/2809439963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6f0073f20 0x7fe6f015df90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80097c0 tx=0x7fe6d801c460 comp rx=0 tx=0).stop 2024-04-26T23:41:17.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6f5c00640 1 -- 172.21.15.137:0/2809439963 shutdown_connections 2024-04-26T23:41:17.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6f5c00640 1 --2- 172.21.15.137:0/2809439963 >> v2:172.21.15.170:3300/0 conn(0x7fe6f00affa0 0x7fe6f00ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6f5c00640 1 --2- 172.21.15.137:0/2809439963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6f0073f20 0x7fe6f015df90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6f5c00640 1 -- 172.21.15.137:0/2809439963 >> 172.21.15.137:0/2809439963 conn(0x7fe6f006c800 msgr2=0x7fe6f006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:17.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6f5c00640 1 -- 172.21.15.137:0/2809439963 shutdown_connections 2024-04-26T23:41:17.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6f5c00640 1 -- 172.21.15.137:0/2809439963 wait complete. 2024-04-26T23:41:17.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6f5c00640 1 Processor -- start 2024-04-26T23:41:17.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6f5c00640 1 -- start start 2024-04-26T23:41:17.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6f5c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6f00afbc0 0x7fe6f0150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:17.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6f5c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6f00affa0 0x7fe6f00b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:17.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6f5c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6f00b5090 0x7fe6f015bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:17.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6f5c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f006f360 con 0x7fe6f00afbc0 2024-04-26T23:41:17.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6f5c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f006f1e0 con 0x7fe6f00affa0 2024-04-26T23:41:17.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6f5c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe6f006f4e0 con 0x7fe6f00b5090 2024-04-26T23:41:17.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6eea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6f00afbc0 0x7fe6f0150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:17.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6eea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6f00afbc0 0x7fe6f0150620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54212/0 (socket says 172.21.15.137:54212) 2024-04-26T23:41:17.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6eea00640 1 -- 172.21.15.137:0/1829103560 learned_addr learned my addr 172.21.15.137:0/1829103560 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:17.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6ef400640 1 --2- 172.21.15.137:0/1829103560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6f00b5090 0x7fe6f015bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:17.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6e6000640 1 --2- 172.21.15.137:0/1829103560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6f00affa0 0x7fe6f00b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:17.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6eea00640 1 -- 172.21.15.137:0/1829103560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6f00b5090 msgr2=0x7fe6f015bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:17.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6eea00640 1 --2- 172.21.15.137:0/1829103560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6f00b5090 0x7fe6f015bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6eea00640 1 -- 172.21.15.137:0/1829103560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6f00affa0 msgr2=0x7fe6f00b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:17.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6eea00640 1 --2- 172.21.15.137:0/1829103560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6f00affa0 0x7fe6f00b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6eea00640 1 -- 172.21.15.137:0/1829103560 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f015a5b0 con 0x7fe6f00afbc0 2024-04-26T23:41:17.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6ef400640 1 --2- 172.21.15.137:0/1829103560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6f00b5090 0x7fe6f015bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:17.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6e6000640 1 --2- 172.21.15.137:0/1829103560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6f00affa0 0x7fe6f00b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:17.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.546+0000 7fe6eea00640 1 --2- 172.21.15.137:0/1829103560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6f00afbc0 0x7fe6f0150620 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0001570 tx=0x7fe6e000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:17.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.550+0000 7fe6e7400640 1 -- 172.21.15.137:0/1829103560 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0018070 con 0x7fe6f00afbc0 2024-04-26T23:41:17.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.550+0000 7fe6e7400640 1 -- 172.21.15.137:0/1829103560 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e000a640 con 0x7fe6f00afbc0 2024-04-26T23:41:17.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.550+0000 7fe6e7400640 1 -- 172.21.15.137:0/1829103560 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e000aa30 con 0x7fe6f00afbc0 2024-04-26T23:41:17.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.550+0000 7fe6f5c00640 1 -- 172.21.15.137:0/1829103560 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6f015a890 con 0x7fe6f00afbc0 2024-04-26T23:41:17.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.550+0000 7fe6f5c00640 1 -- 172.21.15.137:0/1829103560 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6f015ae50 con 0x7fe6f00afbc0 2024-04-26T23:41:17.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.550+0000 7fe6f5c00640 1 -- 172.21.15.137:0/1829103560 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6f00b54a0 con 0x7fe6f00afbc0 2024-04-26T23:41:17.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.550+0000 7fe6e7400640 1 -- 172.21.15.137:0/1829103560 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe6e000abd0 con 0x7fe6f00afbc0 2024-04-26T23:41:17.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.550+0000 7fe6e7400640 1 --2- 172.21.15.137:0/1829103560 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6cc0683b0 0x7fe6cc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:17.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.550+0000 7fe6e7400640 1 -- 172.21.15.137:0/1829103560 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fe6e0085cd0 con 0x7fe6f00afbc0 2024-04-26T23:41:17.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.550+0000 7fe6e6000640 1 --2- 172.21.15.137:0/1829103560 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6cc0683b0 0x7fe6cc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:17.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.554+0000 7fe6e6000640 1 --2- 172.21.15.137:0/1829103560 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6cc0683b0 0x7fe6cc06a870 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80ad000 tx=0x7fe6d80a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:17.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.554+0000 7fe6e7400640 1 -- 172.21.15.137:0/1829103560 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe6f00b54a0 con 0x7fe6f00afbc0 2024-04-26T23:41:17.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.714+0000 7fe6f5c00640 1 -- 172.21.15.137:0/1829103560 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe6f006a410 con 0x7fe6f00afbc0 2024-04-26T23:41:17.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.714+0000 7fe6e7400640 1 -- 172.21.15.137:0/1829103560 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fe6e00565d0 con 0x7fe6f00afbc0 2024-04-26T23:41:17.722 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:41:17.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.718+0000 7fe6f5c00640 1 -- 172.21.15.137:0/1829103560 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6cc0683b0 msgr2=0x7fe6cc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:17.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.718+0000 7fe6f5c00640 1 --2- 172.21.15.137:0/1829103560 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6cc0683b0 0x7fe6cc06a870 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80ad000 tx=0x7fe6d80a6000 comp rx=0 tx=0).stop 2024-04-26T23:41:17.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.718+0000 7fe6f5c00640 1 -- 172.21.15.137:0/1829103560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6f00afbc0 msgr2=0x7fe6f0150620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:17.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.718+0000 7fe6f5c00640 1 --2- 172.21.15.137:0/1829103560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6f00afbc0 0x7fe6f0150620 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0001570 tx=0x7fe6e000cd20 comp rx=0 tx=0).stop 2024-04-26T23:41:17.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.718+0000 7fe6f5c00640 1 -- 172.21.15.137:0/1829103560 shutdown_connections 2024-04-26T23:41:17.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.718+0000 7fe6f5c00640 1 --2- 172.21.15.137:0/1829103560 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6cc0683b0 0x7fe6cc06a870 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.718+0000 7fe6f5c00640 1 --2- 172.21.15.137:0/1829103560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6f00b5090 0x7fe6f015bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.718+0000 7fe6f5c00640 1 --2- 172.21.15.137:0/1829103560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6f00affa0 0x7fe6f00b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.718+0000 7fe6f5c00640 1 --2- 172.21.15.137:0/1829103560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6f00afbc0 0x7fe6f0150620 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.718+0000 7fe6f5c00640 1 -- 172.21.15.137:0/1829103560 >> 172.21.15.137:0/1829103560 conn(0x7fe6f006c800 msgr2=0x7fe6f0153470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:17.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.718+0000 7fe6f5c00640 1 -- 172.21.15.137:0/1829103560 shutdown_connections 2024-04-26T23:41:17.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.718+0000 7fe6f5c00640 1 -- 172.21.15.137:0/1829103560 wait complete. 2024-04-26T23:41:17.743 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:41:17.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.870+0000 7f057a600640 1 Processor -- start 2024-04-26T23:41:17.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.874+0000 7f057a600640 1 -- start start 2024-04-26T23:41:17.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.874+0000 7f057a600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0574148aa0 0x7f0574072630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:17.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.874+0000 7f057a600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0574160550 0x7f05740b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:17.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.874+0000 7f057a600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0574148e80 con 0x7f05740b6360 2024-04-26T23:41:17.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.874+0000 7f057a600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f05740b67e0 con 0x7f0574160550 2024-04-26T23:41:17.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.874+0000 7f057a600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0574071b50 con 0x7f0574148aa0 2024-04-26T23:41:17.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.874+0000 7f0573400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0574148aa0 0x7f0574072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:17.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.874+0000 7f0572a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0574160550 0x7f05740b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:17.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.874+0000 7f0573400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0574148aa0 0x7f0574072630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:46544/0 (socket says 172.21.15.137:46544) 2024-04-26T23:41:17.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.874+0000 7f0573400640 1 -- 172.21.15.137:0/275433644 learned_addr learned my addr 172.21.15.137:0/275433644 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:17.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.874+0000 7f0573400640 1 -- 172.21.15.137:0/275433644 >> v2:172.21.15.170:3300/0 conn(0x7f0574160550 msgr2=0x7f05740b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:17.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.874+0000 7f0573400640 1 --2- 172.21.15.137:0/275433644 >> v2:172.21.15.170:3300/0 conn(0x7f0574160550 0x7f05740b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.874+0000 7f0573400640 1 -- 172.21.15.137:0/275433644 >> v1:172.21.15.170:6789/0 conn(0x7f05740b6360 legacy=0x7f05740704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:17.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.874+0000 7f0573400640 1 -- 172.21.15.137:0/275433644 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0574071e30 con 0x7f0574148aa0 2024-04-26T23:41:17.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.878+0000 7f0573400640 1 --2- 172.21.15.137:0/275433644 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0574148aa0 0x7f0574072630 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0564009e50 tx=0x7f056401c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28c6e8a1928a904f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:17.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.878+0000 7f0572000640 1 -- 172.21.15.137:0/275433644 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05640a56e0 con 0x7f0574148aa0 2024-04-26T23:41:17.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.878+0000 7f0572000640 1 -- 172.21.15.137:0/275433644 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05640a5880 con 0x7f0574148aa0 2024-04-26T23:41:17.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.878+0000 7f0572000640 1 -- 172.21.15.137:0/275433644 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05640a5c50 con 0x7f0574148aa0 2024-04-26T23:41:17.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.878+0000 7f057a600640 1 -- 172.21.15.137:0/275433644 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0574148aa0 msgr2=0x7f0574072630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:17.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.878+0000 7f057a600640 1 --2- 172.21.15.137:0/275433644 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0574148aa0 0x7f0574072630 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0564009e50 tx=0x7f056401c910 comp rx=0 tx=0).stop 2024-04-26T23:41:17.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.878+0000 7f057a600640 1 -- 172.21.15.137:0/275433644 shutdown_connections 2024-04-26T23:41:17.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.878+0000 7f057a600640 1 --2- 172.21.15.137:0/275433644 >> v2:172.21.15.170:3300/0 conn(0x7f0574160550 0x7f05740b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.878+0000 7f057a600640 1 --2- 172.21.15.137:0/275433644 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0574148aa0 0x7f0574072630 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.878+0000 7f057a600640 1 -- 172.21.15.137:0/275433644 >> 172.21.15.137:0/275433644 conn(0x7f05740b4b20 msgr2=0x7f05740b4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:17.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.878+0000 7f057a600640 1 -- 172.21.15.137:0/275433644 shutdown_connections 2024-04-26T23:41:17.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.878+0000 7f057a600640 1 -- 172.21.15.137:0/275433644 wait complete. 2024-04-26T23:41:17.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.878+0000 7f057a600640 1 Processor -- start 2024-04-26T23:41:17.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.878+0000 7f057a600640 1 -- start start 2024-04-26T23:41:17.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f057a600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05740b6360 0x7f0574140a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:17.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f057a600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0574148aa0 0x7f0574169210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:17.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f057a600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05740cd880 0x7f05740cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:17.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f057a600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f057406d370 con 0x7f05740b6360 2024-04-26T23:41:17.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f057a600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f057406d1f0 con 0x7f0574148aa0 2024-04-26T23:41:17.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f057a600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f057406d4f0 con 0x7f05740cd880 2024-04-26T23:41:17.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f0573400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05740b6360 0x7f0574140a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:17.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f0573400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05740b6360 0x7f0574140a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54216/0 (socket says 172.21.15.137:54216) 2024-04-26T23:41:17.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f0573400640 1 -- 172.21.15.137:0/593939270 learned_addr learned my addr 172.21.15.137:0/593939270 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:17.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f0572a00640 1 --2- 172.21.15.137:0/593939270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0574148aa0 0x7f0574169210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:17.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f0573e00640 1 --2- 172.21.15.137:0/593939270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05740cd880 0x7f05740cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:17.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f0573400640 1 -- 172.21.15.137:0/593939270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05740cd880 msgr2=0x7f05740cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:17.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f0573400640 1 --2- 172.21.15.137:0/593939270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05740cd880 0x7f05740cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f0573400640 1 -- 172.21.15.137:0/593939270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0574148aa0 msgr2=0x7f0574169210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:17.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f0573400640 1 --2- 172.21.15.137:0/593939270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0574148aa0 0x7f0574169210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:17.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f0573400640 1 -- 172.21.15.137:0/593939270 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05740cd4c0 con 0x7f05740b6360 2024-04-26T23:41:17.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f0573e00640 1 --2- 172.21.15.137:0/593939270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05740cd880 0x7f05740cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:17.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f0573400640 1 --2- 172.21.15.137:0/593939270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05740b6360 0x7f0574140a50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f05640af040 tx=0x7f05640196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:17.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f056b400640 1 -- 172.21.15.137:0/593939270 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05640bc030 con 0x7f05740b6360 2024-04-26T23:41:17.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f056b400640 1 -- 172.21.15.137:0/593939270 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05640090d0 con 0x7f05740b6360 2024-04-26T23:41:17.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f057a600640 1 -- 172.21.15.137:0/593939270 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0574140f90 con 0x7f05740b6360 2024-04-26T23:41:17.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f056b400640 1 -- 172.21.15.137:0/593939270 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0564009510 con 0x7f05740b6360 2024-04-26T23:41:17.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f057a600640 1 -- 172.21.15.137:0/593939270 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05740cd1e0 con 0x7f05740b6360 2024-04-26T23:41:17.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.882+0000 7f057a600640 1 -- 172.21.15.137:0/593939270 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f057406a4b0 con 0x7f05740b6360 2024-04-26T23:41:17.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.886+0000 7f056b400640 1 -- 172.21.15.137:0/593939270 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f05640bf070 con 0x7f05740b6360 2024-04-26T23:41:17.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.886+0000 7f056b400640 1 --2- 172.21.15.137:0/593939270 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0554068380 0x7f055406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:17.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.886+0000 7f056b400640 1 -- 172.21.15.137:0/593939270 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f0564120f50 con 0x7f05740b6360 2024-04-26T23:41:17.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.886+0000 7f0572a00640 1 --2- 172.21.15.137:0/593939270 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0554068380 0x7f055406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:17.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.886+0000 7f0572a00640 1 --2- 172.21.15.137:0/593939270 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0554068380 0x7f055406a840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f05740cf590 tx=0x7f0560009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:17.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:17.890+0000 7f056b400640 1 -- 172.21.15.137:0/593939270 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f05640c6070 con 0x7f05740b6360 2024-04-26T23:41:18.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:18.082+0000 7f057a600640 1 -- 172.21.15.137:0/593939270 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05740711c0 con 0x7f05740b6360 2024-04-26T23:41:18.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:18.082+0000 7f056b400640 1 -- 172.21.15.137:0/593939270 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f0564016620 con 0x7f05740b6360 2024-04-26T23:41:18.087 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:18.087 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/861150521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":861150521},{"type":"v1","addr":"172.21.15.137:6836","nonce":861150521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T23:41:18.088 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 2 2024-04-26T23:41:18.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:18.082+0000 7f057a600640 1 -- 172.21.15.137:0/593939270 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0554068380 msgr2=0x7f055406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:18.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:18.082+0000 7f057a600640 1 --2- 172.21.15.137:0/593939270 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0554068380 0x7f055406a840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f05740cf590 tx=0x7f0560009190 comp rx=0 tx=0).stop 2024-04-26T23:41:18.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:18.082+0000 7f057a600640 1 -- 172.21.15.137:0/593939270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05740b6360 msgr2=0x7f0574140a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:18.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:18.082+0000 7f057a600640 1 --2- 172.21.15.137:0/593939270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05740b6360 0x7f0574140a50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f05640af040 tx=0x7f05640196b0 comp rx=0 tx=0).stop 2024-04-26T23:41:18.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:18.082+0000 7f057a600640 1 -- 172.21.15.137:0/593939270 shutdown_connections 2024-04-26T23:41:18.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:18.082+0000 7f057a600640 1 --2- 172.21.15.137:0/593939270 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0554068380 0x7f055406a840 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:18.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:18.082+0000 7f057a600640 1 --2- 172.21.15.137:0/593939270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05740cd880 0x7f05740cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:18.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:18.082+0000 7f057a600640 1 --2- 172.21.15.137:0/593939270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0574148aa0 0x7f0574169210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:18.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:18.082+0000 7f057a600640 1 --2- 172.21.15.137:0/593939270 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05740b6360 0x7f0574140a50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:18.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:18.082+0000 7f057a600640 1 -- 172.21.15.137:0/593939270 >> 172.21.15.137:0/593939270 conn(0x7f05740b4b20 msgr2=0x7f05740b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:18.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:18.082+0000 7f057a600640 1 -- 172.21.15.137:0/593939270 shutdown_connections 2024-04-26T23:41:18.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:18.082+0000 7f057a600640 1 -- 172.21.15.137:0/593939270 wait complete. 2024-04-26T23:41:18.240 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:41:18.243 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:41:20.110 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:41:20.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.250+0000 7f28fea00640 1 Processor -- start 2024-04-26T23:41:20.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.250+0000 7f28fea00640 1 -- start start 2024-04-26T23:41:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.254+0000 7f28fea00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28f806eff0 0x7f28f815c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.254+0000 7f28fea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f28f80b5c90 0x7f28f8155510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:20.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.254+0000 7f28fea00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f28f806f3d0 0x7f28f8155a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:20.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.254+0000 7f28fea00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f28f80d0850 con 0x7f28f80b5c90 2024-04-26T23:41:20.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.254+0000 7f28fea00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f28f815ca00 con 0x7f28f806f3d0 2024-04-26T23:41:20.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.254+0000 7f28fea00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f28f80b3e30 con 0x7f28f806eff0 2024-04-26T23:41:20.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.254+0000 7f28f7400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f28f80b5c90 0x7f28f8155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:20.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.254+0000 7f28f7400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f28f80b5c90 0x7f28f8155510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54224/0 (socket says 172.21.15.137:54224) 2024-04-26T23:41:20.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.254+0000 7f28f7400640 1 -- 172.21.15.137:0/3516132542 learned_addr learned my addr 172.21.15.137:0/3516132542 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:20.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.254+0000 7f28fca00640 1 --2- 172.21.15.137:0/3516132542 >> v2:172.21.15.170:3300/0 conn(0x7f28f806f3d0 0x7f28f8155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:20.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.254+0000 7f28f7e00640 1 --2- 172.21.15.137:0/3516132542 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28f806eff0 0x7f28f815c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:20.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.254+0000 7f28f7400640 1 -- 172.21.15.137:0/3516132542 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28f806eff0 msgr2=0x7f28f815c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:20.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.254+0000 7f28f7400640 1 --2- 172.21.15.137:0/3516132542 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28f806eff0 0x7f28f815c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.254+0000 7f28f7400640 1 -- 172.21.15.137:0/3516132542 >> v2:172.21.15.170:3300/0 conn(0x7f28f806f3d0 msgr2=0x7f28f8155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:20.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.254+0000 7f28f7400640 1 --2- 172.21.15.137:0/3516132542 >> v2:172.21.15.170:3300/0 conn(0x7f28f806f3d0 0x7f28f8155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.254+0000 7f28f7400640 1 -- 172.21.15.137:0/3516132542 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f80b40a0 con 0x7f28f80b5c90 2024-04-26T23:41:20.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.254+0000 7f28fca00640 1 --2- 172.21.15.137:0/3516132542 >> v2:172.21.15.170:3300/0 conn(0x7f28f806f3d0 0x7f28f8155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:20.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28f7400640 1 --2- 172.21.15.137:0/3516132542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28f80b5c90 0x7f28f8155510 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f28f806fbf0 tx=0x7f28e401e9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990748a4f649d735 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:20.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28f6a00640 1 -- 172.21.15.137:0/3516132542 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e40ad070 con 0x7f28f80b5c90 2024-04-26T23:41:20.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28f6a00640 1 -- 172.21.15.137:0/3516132542 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28e4004230 con 0x7f28f80b5c90 2024-04-26T23:41:20.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28f6a00640 1 -- 172.21.15.137:0/3516132542 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e40a76b0 con 0x7f28f80b5c90 2024-04-26T23:41:20.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28fea00640 1 -- 172.21.15.137:0/3516132542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28f80b5c90 msgr2=0x7f28f8155510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:20.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28fea00640 1 --2- 172.21.15.137:0/3516132542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28f80b5c90 0x7f28f8155510 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f28f806fbf0 tx=0x7f28e401e9b0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28fea00640 1 -- 172.21.15.137:0/3516132542 shutdown_connections 2024-04-26T23:41:20.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28fea00640 1 --2- 172.21.15.137:0/3516132542 >> v2:172.21.15.170:3300/0 conn(0x7f28f806f3d0 0x7f28f8155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28fea00640 1 --2- 172.21.15.137:0/3516132542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28f80b5c90 0x7f28f8155510 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28fea00640 1 --2- 172.21.15.137:0/3516132542 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28f806eff0 0x7f28f815c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28fea00640 1 -- 172.21.15.137:0/3516132542 >> 172.21.15.137:0/3516132542 conn(0x7f28f806c5d0 msgr2=0x7f28f806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:20.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28fea00640 1 -- 172.21.15.137:0/3516132542 shutdown_connections 2024-04-26T23:41:20.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28fea00640 1 -- 172.21.15.137:0/3516132542 wait complete. 2024-04-26T23:41:20.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28fea00640 1 Processor -- start 2024-04-26T23:41:20.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28fea00640 1 -- start start 2024-04-26T23:41:20.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28fea00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28f806eff0 0x7f28f8154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:20.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28fea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f806f3d0 0x7f28f8153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:20.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28fea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28f80b5c90 0x7f28f8149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:20.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28fea00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f28f815f080 con 0x7f28f80b5c90 2024-04-26T23:41:20.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28fea00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f28f80b61e0 con 0x7f28f806f3d0 2024-04-26T23:41:20.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28fea00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f28f815f200 con 0x7f28f806eff0 2024-04-26T23:41:20.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28fca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28f80b5c90 0x7f28f8149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:20.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28fca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28f80b5c90 0x7f28f8149040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54236/0 (socket says 172.21.15.137:54236) 2024-04-26T23:41:20.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28fca00640 1 -- 172.21.15.137:0/24771736 learned_addr learned my addr 172.21.15.137:0/24771736 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:20.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28f7e00640 1 --2- 172.21.15.137:0/24771736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28f806eff0 0x7f28f8154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:20.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.258+0000 7f28f7400640 1 --2- 172.21.15.137:0/24771736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f806f3d0 0x7f28f8153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:20.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.262+0000 7f28fca00640 1 -- 172.21.15.137:0/24771736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28f806eff0 msgr2=0x7f28f8154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:20.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.262+0000 7f28fca00640 1 --2- 172.21.15.137:0/24771736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28f806eff0 0x7f28f8154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.262+0000 7f28fca00640 1 -- 172.21.15.137:0/24771736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f806f3d0 msgr2=0x7f28f8153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:20.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.262+0000 7f28fca00640 1 --2- 172.21.15.137:0/24771736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f806f3d0 0x7f28f8153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.262+0000 7f28fca00640 1 -- 172.21.15.137:0/24771736 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f8143940 con 0x7f28f80b5c90 2024-04-26T23:41:20.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.262+0000 7f28fca00640 1 --2- 172.21.15.137:0/24771736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28f80b5c90 0x7f28f8149040 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f28f000cf20 tx=0x7f28f000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:20.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.262+0000 7f28efe00640 1 -- 172.21.15.137:0/24771736 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f001a070 con 0x7f28f80b5c90 2024-04-26T23:41:20.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.262+0000 7f28efe00640 1 -- 172.21.15.137:0/24771736 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f000d840 con 0x7f28f80b5c90 2024-04-26T23:41:20.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.262+0000 7f28efe00640 1 -- 172.21.15.137:0/24771736 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f000dc30 con 0x7f28f80b5c90 2024-04-26T23:41:20.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.262+0000 7f28fea00640 1 -- 172.21.15.137:0/24771736 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28f8153990 con 0x7f28f80b5c90 2024-04-26T23:41:20.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.262+0000 7f28fea00640 1 -- 172.21.15.137:0/24771736 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28f8153f50 con 0x7f28f80b5c90 2024-04-26T23:41:20.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.262+0000 7f28fea00640 1 -- 172.21.15.137:0/24771736 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28f806a4b0 con 0x7f28f80b5c90 2024-04-26T23:41:20.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.262+0000 7f28efe00640 1 -- 172.21.15.137:0/24771736 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f28f001d070 con 0x7f28f80b5c90 2024-04-26T23:41:20.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.266+0000 7f28efe00640 1 --2- 172.21.15.137:0/24771736 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f28d8068380 0x7f28d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:20.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.266+0000 7f28efe00640 1 -- 172.21.15.137:0/24771736 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f28f0086dd0 con 0x7f28f80b5c90 2024-04-26T23:41:20.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.266+0000 7f28f7e00640 1 --2- 172.21.15.137:0/24771736 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f28d8068380 0x7f28d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:20.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.266+0000 7f28f7e00640 1 --2- 172.21.15.137:0/24771736 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f28d8068380 0x7f28d806a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f28e800aae0 tx=0x7f28e8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:20.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.270+0000 7f28efe00640 1 -- 172.21.15.137:0/24771736 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f28f008b070 con 0x7f28f80b5c90 2024-04-26T23:41:20.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.454+0000 7f28fea00640 1 -- 172.21.15.137:0/24771736 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28f806ca50 con 0x7f28f80b5c90 2024-04-26T23:41:20.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.458+0000 7f28efe00640 1 -- 172.21.15.137:0/24771736 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3870 (secure 0 0 0) 0x7f28f0057080 con 0x7f28f80b5c90 2024-04-26T23:41:20.463 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:20.463 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/861150521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":861150521},{"type":"v1","addr":"172.21.15.137:6836","nonce":861150521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/980246912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":980246912},{"type":"v1","addr":"172.21.15.137:6837","nonce":980246912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3288315078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3288315078},{"type":"v1","addr":"172.21.15.170:6835","nonce":3288315078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2444921875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2444921875},{"type":"v1","addr":"172.21.15.170:6834","nonce":2444921875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-26T23:41:20.463 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 3 2024-04-26T23:41:20.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.458+0000 7f28fea00640 1 -- 172.21.15.137:0/24771736 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f28d8068380 msgr2=0x7f28d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:20.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.458+0000 7f28fea00640 1 --2- 172.21.15.137:0/24771736 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f28d8068380 0x7f28d806a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f28e800aae0 tx=0x7f28e8008040 comp rx=0 tx=0).stop 2024-04-26T23:41:20.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.458+0000 7f28fea00640 1 -- 172.21.15.137:0/24771736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28f80b5c90 msgr2=0x7f28f8149040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:20.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.458+0000 7f28fea00640 1 --2- 172.21.15.137:0/24771736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28f80b5c90 0x7f28f8149040 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f28f000cf20 tx=0x7f28f000a7d0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.458+0000 7f28fea00640 1 -- 172.21.15.137:0/24771736 shutdown_connections 2024-04-26T23:41:20.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.458+0000 7f28fea00640 1 --2- 172.21.15.137:0/24771736 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f28d8068380 0x7f28d806a840 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.458+0000 7f28fea00640 1 --2- 172.21.15.137:0/24771736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28f80b5c90 0x7f28f8149040 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.458+0000 7f28fea00640 1 --2- 172.21.15.137:0/24771736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f806f3d0 0x7f28f8153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.458+0000 7f28fea00640 1 --2- 172.21.15.137:0/24771736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28f806eff0 0x7f28f8154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.458+0000 7f28fea00640 1 -- 172.21.15.137:0/24771736 >> 172.21.15.137:0/24771736 conn(0x7f28f806c5d0 msgr2=0x7f28f80cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:20.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.458+0000 7f28fea00640 1 -- 172.21.15.137:0/24771736 shutdown_connections 2024-04-26T23:41:20.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.458+0000 7f28fea00640 1 -- 172.21.15.137:0/24771736 wait complete. 2024-04-26T23:41:20.483 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:20.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.614+0000 7efc9a800640 1 Processor -- start 2024-04-26T23:41:20.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.614+0000 7efc9a800640 1 -- start start 2024-04-26T23:41:20.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.614+0000 7efc9a800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7efc940ce3e0 0x7efc94073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:20.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.614+0000 7efc9a800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efc9415de80 0x7efc940d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:20.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.614+0000 7efc9a800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc94073010 con 0x7efc940ce7c0 2024-04-26T23:41:20.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.614+0000 7efc9a800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7efc940cef90 con 0x7efc9415de80 2024-04-26T23:41:20.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.614+0000 7efc9a800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7efc94073280 con 0x7efc940ce3e0 2024-04-26T23:41:20.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.614+0000 7efc8aa00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efc9415de80 0x7efc940d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:20.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.614+0000 7efc93e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7efc940ce7c0 0x7efc94146210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48936/0 (socket says 172.21.15.137:48936) 2024-04-26T23:41:20.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.614+0000 7efc93e00640 1 -- 172.21.15.137:0/1812583139 learned_addr learned my addr 172.21.15.137:0/1812583139 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:20.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.614+0000 7efc93400640 1 --2- 172.21.15.137:0/1812583139 >> v2:172.21.15.170:3300/0 conn(0x7efc940ce3e0 0x7efc94073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:20.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.614+0000 7efc8aa00640 1 -- 172.21.15.137:0/1812583139 >> v2:172.21.15.170:3300/0 conn(0x7efc940ce3e0 msgr2=0x7efc94073d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:20.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.614+0000 7efc8aa00640 1 --2- 172.21.15.137:0/1812583139 >> v2:172.21.15.170:3300/0 conn(0x7efc940ce3e0 0x7efc94073d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.614+0000 7efc8aa00640 1 -- 172.21.15.137:0/1812583139 >> v1:172.21.15.137:6789/0 conn(0x7efc940ce7c0 legacy=0x7efc94146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:20.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.614+0000 7efc8aa00640 1 -- 172.21.15.137:0/1812583139 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc94073560 con 0x7efc9415de80 2024-04-26T23:41:20.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.618+0000 7efc8aa00640 1 --2- 172.21.15.137:0/1812583139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc9415de80 0x7efc940d04e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009d90 tx=0x7efc7c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817eb5a7459747a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:20.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.618+0000 7efc92a00640 1 -- 172.21.15.137:0/1812583139 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7c0b2070 con 0x7efc9415de80 2024-04-26T23:41:20.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.618+0000 7efc92a00640 1 -- 172.21.15.137:0/1812583139 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc7c0a59e0 con 0x7efc9415de80 2024-04-26T23:41:20.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.618+0000 7efc92a00640 1 -- 172.21.15.137:0/1812583139 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7c0a5db0 con 0x7efc9415de80 2024-04-26T23:41:20.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.618+0000 7efc9a800640 1 -- 172.21.15.137:0/1812583139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc9415de80 msgr2=0x7efc940d04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:20.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.618+0000 7efc9a800640 1 --2- 172.21.15.137:0/1812583139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc9415de80 0x7efc940d04e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009d90 tx=0x7efc7c01c900 comp rx=0 tx=0).stop 2024-04-26T23:41:20.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.618+0000 7efc9a800640 1 -- 172.21.15.137:0/1812583139 shutdown_connections 2024-04-26T23:41:20.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.618+0000 7efc9a800640 1 --2- 172.21.15.137:0/1812583139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc9415de80 0x7efc940d04e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.618+0000 7efc9a800640 1 --2- 172.21.15.137:0/1812583139 >> v2:172.21.15.170:3300/0 conn(0x7efc940ce3e0 0x7efc94073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.618+0000 7efc9a800640 1 -- 172.21.15.137:0/1812583139 >> 172.21.15.137:0/1812583139 conn(0x7efc9406c5d0 msgr2=0x7efc9406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:20.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.618+0000 7efc9a800640 1 -- 172.21.15.137:0/1812583139 shutdown_connections 2024-04-26T23:41:20.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.618+0000 7efc9a800640 1 -- 172.21.15.137:0/1812583139 wait complete. 2024-04-26T23:41:20.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.618+0000 7efc9a800640 1 Processor -- start 2024-04-26T23:41:20.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.618+0000 7efc9a800640 1 -- start start 2024-04-26T23:41:20.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc9a800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc940ce3e0 0x7efc9415bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:20.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc9a800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efc940ce7c0 0x7efc94141450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:20.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc9a800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc9415de80 0x7efc94141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:20.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc9a800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efc94146aa0 con 0x7efc9415de80 2024-04-26T23:41:20.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc9a800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efc94146920 con 0x7efc940ce3e0 2024-04-26T23:41:20.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc9a800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7efc9406ed10 con 0x7efc940ce7c0 2024-04-26T23:41:20.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc93e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc9415de80 0x7efc94141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:20.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc93e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc9415de80 0x7efc94141990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54262/0 (socket says 172.21.15.137:54262) 2024-04-26T23:41:20.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc93e00640 1 -- 172.21.15.137:0/2610798452 learned_addr learned my addr 172.21.15.137:0/2610798452 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:20.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc8aa00640 1 --2- 172.21.15.137:0/2610798452 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efc940ce7c0 0x7efc94141450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:20.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc93400640 1 --2- 172.21.15.137:0/2610798452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc940ce3e0 0x7efc9415bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:20.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc93e00640 1 -- 172.21.15.137:0/2610798452 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efc940ce7c0 msgr2=0x7efc94141450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:20.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc93e00640 1 --2- 172.21.15.137:0/2610798452 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efc940ce7c0 0x7efc94141450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc93e00640 1 -- 172.21.15.137:0/2610798452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc940ce3e0 msgr2=0x7efc9415bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:20.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc93e00640 1 --2- 172.21.15.137:0/2610798452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc940ce3e0 0x7efc9415bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc93e00640 1 -- 172.21.15.137:0/2610798452 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9415c060 con 0x7efc9415de80 2024-04-26T23:41:20.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc8aa00640 1 --2- 172.21.15.137:0/2610798452 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efc940ce7c0 0x7efc94141450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:20.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc93400640 1 --2- 172.21.15.137:0/2610798452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc940ce3e0 0x7efc9415bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:20.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc93e00640 1 --2- 172.21.15.137:0/2610798452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc9415de80 0x7efc94141990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00c400 tx=0x7efc8c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:20.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc8be00640 1 -- 172.21.15.137:0/2610798452 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c017070 con 0x7efc9415de80 2024-04-26T23:41:20.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc8be00640 1 -- 172.21.15.137:0/2610798452 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc8c005cf0 con 0x7efc9415de80 2024-04-26T23:41:20.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc8be00640 1 -- 172.21.15.137:0/2610798452 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0072d0 con 0x7efc9415de80 2024-04-26T23:41:20.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc9a800640 1 -- 172.21.15.137:0/2610798452 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc940b5050 con 0x7efc9415de80 2024-04-26T23:41:20.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc9a800640 1 -- 172.21.15.137:0/2610798452 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc941453d0 con 0x7efc9415de80 2024-04-26T23:41:20.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc9a800640 1 -- 172.21.15.137:0/2610798452 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc9406a4b0 con 0x7efc9415de80 2024-04-26T23:41:20.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.622+0000 7efc8be00640 1 -- 172.21.15.137:0/2610798452 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efc8c01a070 con 0x7efc9415de80 2024-04-26T23:41:20.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.626+0000 7efc8be00640 1 --2- 172.21.15.137:0/2610798452 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efc70068380 0x7efc7006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:20.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.626+0000 7efc8be00640 1 -- 172.21.15.137:0/2610798452 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7efc8c085950 con 0x7efc9415de80 2024-04-26T23:41:20.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.626+0000 7efc93400640 1 --2- 172.21.15.137:0/2610798452 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efc70068380 0x7efc7006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:20.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.626+0000 7efc93400640 1 --2- 172.21.15.137:0/2610798452 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efc70068380 0x7efc7006a840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efc84007a70 tx=0x7efc84008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:20.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.630+0000 7efc8be00640 1 -- 172.21.15.137:0/2610798452 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efc8c055b70 con 0x7efc9415de80 2024-04-26T23:41:20.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.786+0000 7efc9a800640 1 -- 172.21.15.137:0/2610798452 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc94142d80 con 0x7efc9415de80 2024-04-26T23:41:20.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.790+0000 7efc8be00640 1 -- 172.21.15.137:0/2610798452 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12932 (secure 0 0 0) 0x7efc8c059e70 con 0x7efc9415de80 2024-04-26T23:41:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:20.794 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":16,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:13.632279+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:20.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.790+0000 7efc9a800640 1 -- 172.21.15.137:0/2610798452 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efc70068380 msgr2=0x7efc7006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:20.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.790+0000 7efc9a800640 1 --2- 172.21.15.137:0/2610798452 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efc70068380 0x7efc7006a840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efc84007a70 tx=0x7efc84008040 comp rx=0 tx=0).stop 2024-04-26T23:41:20.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.790+0000 7efc9a800640 1 -- 172.21.15.137:0/2610798452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc9415de80 msgr2=0x7efc94141990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:20.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.790+0000 7efc9a800640 1 --2- 172.21.15.137:0/2610798452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc9415de80 0x7efc94141990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00c400 tx=0x7efc8c00c8c0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.790+0000 7efc9a800640 1 -- 172.21.15.137:0/2610798452 shutdown_connections 2024-04-26T23:41:20.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.790+0000 7efc9a800640 1 --2- 172.21.15.137:0/2610798452 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efc70068380 0x7efc7006a840 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.790+0000 7efc9a800640 1 --2- 172.21.15.137:0/2610798452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc9415de80 0x7efc94141990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.790+0000 7efc9a800640 1 --2- 172.21.15.137:0/2610798452 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efc940ce7c0 0x7efc94141450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.790+0000 7efc9a800640 1 --2- 172.21.15.137:0/2610798452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc940ce3e0 0x7efc9415bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.790+0000 7efc9a800640 1 -- 172.21.15.137:0/2610798452 >> 172.21.15.137:0/2610798452 conn(0x7efc9406c5d0 msgr2=0x7efc9406f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:20.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.790+0000 7efc9a800640 1 -- 172.21.15.137:0/2610798452 shutdown_connections 2024-04-26T23:41:20.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.790+0000 7efc9a800640 1 -- 172.21.15.137:0/2610798452 wait complete. 2024-04-26T23:41:20.817 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:41:20.817 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:41:20.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.950+0000 7fa442000640 1 Processor -- start 2024-04-26T23:41:20.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.950+0000 7fa442000640 1 -- start start 2024-04-26T23:41:20.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.950+0000 7fa442000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa43c159560 0x7fa43c0b5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:20.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.950+0000 7fa442000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa43c0b57d0 0x7fa43c072930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:20.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.950+0000 7fa442000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa43c073280 con 0x7fa43c072e70 2024-04-26T23:41:20.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.950+0000 7fa442000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa43c0b5c50 con 0x7fa43c0b57d0 2024-04-26T23:41:20.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.950+0000 7fa442000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fa43c0b5f30 con 0x7fa43c159560 2024-04-26T23:41:20.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.950+0000 7fa43be00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa43c072e70 0x7fa43c162c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45956/0 (socket says 172.21.15.137:45956) 2024-04-26T23:41:20.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.950+0000 7fa43be00640 1 -- 172.21.15.137:0/781002333 learned_addr learned my addr 172.21.15.137:0/781002333 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:20.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.950+0000 7fa43aa00640 1 --2- 172.21.15.137:0/781002333 >> v2:172.21.15.137:3300/0 conn(0x7fa43c0b57d0 0x7fa43c072930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:20.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.950+0000 7fa43b400640 1 --2- 172.21.15.137:0/781002333 >> v2:172.21.15.170:3300/0 conn(0x7fa43c159560 0x7fa43c0b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:20.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.950+0000 7fa43aa00640 1 -- 172.21.15.137:0/781002333 >> v2:172.21.15.170:3300/0 conn(0x7fa43c159560 msgr2=0x7fa43c0b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:20.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.950+0000 7fa43aa00640 1 --2- 172.21.15.137:0/781002333 >> v2:172.21.15.170:3300/0 conn(0x7fa43c159560 0x7fa43c0b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.950+0000 7fa43aa00640 1 -- 172.21.15.137:0/781002333 >> v1:172.21.15.137:6789/0 conn(0x7fa43c072e70 legacy=0x7fa43c162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:20.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.950+0000 7fa43aa00640 1 -- 172.21.15.137:0/781002333 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43c0b6210 con 0x7fa43c0b57d0 2024-04-26T23:41:20.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.950+0000 7fa43a000640 1 -- 172.21.15.137:0/781002333 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 336958674 0 0) 0x7fa4340014a0 con 0x7fa43c072e70 2024-04-26T23:41:20.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.954+0000 7fa43aa00640 1 --2- 172.21.15.137:0/781002333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa43c0b57d0 0x7fa43c072930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa43c06e820 tx=0x7fa42801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4d25a87e94d91c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:20.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.954+0000 7fa43a000640 1 -- 172.21.15.137:0/781002333 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4280b0070 con 0x7fa43c0b57d0 2024-04-26T23:41:20.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.954+0000 7fa43a000640 1 -- 172.21.15.137:0/781002333 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4280ab600 con 0x7fa43c0b57d0 2024-04-26T23:41:20.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.954+0000 7fa43a000640 1 -- 172.21.15.137:0/781002333 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4280ab9d0 con 0x7fa43c0b57d0 2024-04-26T23:41:20.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.954+0000 7fa442000640 1 -- 172.21.15.137:0/781002333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa43c0b57d0 msgr2=0x7fa43c072930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:20.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.954+0000 7fa442000640 1 --2- 172.21.15.137:0/781002333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa43c0b57d0 0x7fa43c072930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa43c06e820 tx=0x7fa42801c480 comp rx=0 tx=0).stop 2024-04-26T23:41:20.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.954+0000 7fa442000640 1 -- 172.21.15.137:0/781002333 shutdown_connections 2024-04-26T23:41:20.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.954+0000 7fa442000640 1 --2- 172.21.15.137:0/781002333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa43c0b57d0 0x7fa43c072930 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.954+0000 7fa442000640 1 --2- 172.21.15.137:0/781002333 >> v2:172.21.15.170:3300/0 conn(0x7fa43c159560 0x7fa43c0b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.954+0000 7fa442000640 1 -- 172.21.15.137:0/781002333 >> 172.21.15.137:0/781002333 conn(0x7fa43c0b3370 msgr2=0x7fa43c0b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:20.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.954+0000 7fa442000640 1 -- 172.21.15.137:0/781002333 shutdown_connections 2024-04-26T23:41:20.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.954+0000 7fa442000640 1 -- 172.21.15.137:0/781002333 wait complete. 2024-04-26T23:41:20.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa442000640 1 Processor -- start 2024-04-26T23:41:20.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa442000640 1 -- start start 2024-04-26T23:41:20.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa442000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa43c072e70 0x7fa43c1389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:20.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa442000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa43c0b57d0 0x7fa43c14c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:20.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa442000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa43c159560 0x7fa43c14a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:20.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa442000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa43c15f950 con 0x7fa43c159560 2024-04-26T23:41:20.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa442000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa43c15f7d0 con 0x7fa43c072e70 2024-04-26T23:41:20.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa442000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa43c16bd70 con 0x7fa43c0b57d0 2024-04-26T23:41:20.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa43be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa43c159560 0x7fa43c14a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:20.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa43be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa43c159560 0x7fa43c14a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33602/0 (socket says 172.21.15.137:33602) 2024-04-26T23:41:20.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa43b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa43c072e70 0x7fa43c1389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:20.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa43be00640 1 -- 172.21.15.137:0/2508831328 learned_addr learned my addr 172.21.15.137:0/2508831328 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:20.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa43aa00640 1 --2- 172.21.15.137:0/2508831328 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa43c0b57d0 0x7fa43c14c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:20.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa43be00640 1 -- 172.21.15.137:0/2508831328 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa43c0b57d0 msgr2=0x7fa43c14c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:20.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa43be00640 1 --2- 172.21.15.137:0/2508831328 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa43c0b57d0 0x7fa43c14c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa43be00640 1 -- 172.21.15.137:0/2508831328 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa43c072e70 msgr2=0x7fa43c1389c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:20.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa43be00640 1 --2- 172.21.15.137:0/2508831328 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa43c072e70 0x7fa43c1389c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:20.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa43be00640 1 -- 172.21.15.137:0/2508831328 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43c0b2090 con 0x7fa43c159560 2024-04-26T23:41:20.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa43b400640 1 --2- 172.21.15.137:0/2508831328 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa43c072e70 0x7fa43c1389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:41:20.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa43be00640 1 --2- 172.21.15.137:0/2508831328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa43c159560 0x7fa43c14a750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa43400c7f0 tx=0x7fa43400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:20.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa433400640 1 -- 172.21.15.137:0/2508831328 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa434018070 con 0x7fa43c159560 2024-04-26T23:41:20.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa433400640 1 -- 172.21.15.137:0/2508831328 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa43400a640 con 0x7fa43c159560 2024-04-26T23:41:20.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa433400640 1 -- 172.21.15.137:0/2508831328 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43400aa30 con 0x7fa43c159560 2024-04-26T23:41:20.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.958+0000 7fa442000640 1 -- 172.21.15.137:0/2508831328 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa43c0b2370 con 0x7fa43c159560 2024-04-26T23:41:20.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.962+0000 7fa442000640 1 -- 172.21.15.137:0/2508831328 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa43c0b2930 con 0x7fa43c159560 2024-04-26T23:41:20.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.962+0000 7fa442000640 1 -- 172.21.15.137:0/2508831328 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa43c139310 con 0x7fa43c159560 2024-04-26T23:41:20.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.962+0000 7fa433400640 1 -- 172.21.15.137:0/2508831328 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa43400abd0 con 0x7fa43c159560 2024-04-26T23:41:20.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.962+0000 7fa433400640 1 --2- 172.21.15.137:0/2508831328 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa41c068380 0x7fa41c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:20.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.962+0000 7fa433400640 1 -- 172.21.15.137:0/2508831328 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fa434085d10 con 0x7fa43c159560 2024-04-26T23:41:20.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.962+0000 7fa43b400640 1 --2- 172.21.15.137:0/2508831328 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa41c068380 0x7fa41c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:20.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.962+0000 7fa43b400640 1 --2- 172.21.15.137:0/2508831328 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa41c068380 0x7fa41c06a840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009eb0 tx=0x7fa42c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:20.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:20.966+0000 7fa433400640 1 -- 172.21.15.137:0/2508831328 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa43408b020 con 0x7fa43c159560 2024-04-26T23:41:21.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.122+0000 7fa442000640 1 -- 172.21.15.137:0/2508831328 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa43c06a410 con 0x7fa43c159560 2024-04-26T23:41:21.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.122+0000 7fa433400640 1 -- 172.21.15.137:0/2508831328 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fa43c073280 con 0x7fa43c159560 2024-04-26T23:41:21.129 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:41:21.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.126+0000 7fa442000640 1 -- 172.21.15.137:0/2508831328 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa41c068380 msgr2=0x7fa41c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:21.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.126+0000 7fa442000640 1 --2- 172.21.15.137:0/2508831328 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa41c068380 0x7fa41c06a840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009eb0 tx=0x7fa42c009190 comp rx=0 tx=0).stop 2024-04-26T23:41:21.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.126+0000 7fa442000640 1 -- 172.21.15.137:0/2508831328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa43c159560 msgr2=0x7fa43c14a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:21.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.126+0000 7fa442000640 1 --2- 172.21.15.137:0/2508831328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa43c159560 0x7fa43c14a750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa43400c7f0 tx=0x7fa43400ccb0 comp rx=0 tx=0).stop 2024-04-26T23:41:21.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.126+0000 7fa442000640 1 -- 172.21.15.137:0/2508831328 shutdown_connections 2024-04-26T23:41:21.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.126+0000 7fa442000640 1 --2- 172.21.15.137:0/2508831328 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa41c068380 0x7fa41c06a840 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:21.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.126+0000 7fa442000640 1 --2- 172.21.15.137:0/2508831328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa43c159560 0x7fa43c14a750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:21.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.126+0000 7fa442000640 1 --2- 172.21.15.137:0/2508831328 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa43c0b57d0 0x7fa43c14c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:21.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.126+0000 7fa442000640 1 --2- 172.21.15.137:0/2508831328 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa43c072e70 0x7fa43c1389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:21.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.126+0000 7fa442000640 1 -- 172.21.15.137:0/2508831328 >> 172.21.15.137:0/2508831328 conn(0x7fa43c0b3370 msgr2=0x7fa43c1607b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:21.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.126+0000 7fa442000640 1 -- 172.21.15.137:0/2508831328 shutdown_connections 2024-04-26T23:41:21.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.126+0000 7fa442000640 1 -- 172.21.15.137:0/2508831328 wait complete. 2024-04-26T23:41:21.150 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T23:41:21.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.282+0000 7f21c7a00640 1 Processor -- start 2024-04-26T23:41:21.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.282+0000 7f21c7a00640 1 -- start start 2024-04-26T23:41:21.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.282+0000 7f21c7a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f21c0070590 0x7f21c0070a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:21.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.282+0000 7f21c7a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21c015f750 con 0x7f21c015f9c0 2024-04-26T23:41:21.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.282+0000 7f21c7a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21c006c580 con 0x7f21c015f370 2024-04-26T23:41:21.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.282+0000 7f21c7a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f21c00b53d0 con 0x7f21c0070590 2024-04-26T23:41:21.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.282+0000 7f21c5a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f21c015f9c0 0x7f21c006d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45966/0 (socket says 172.21.15.137:45966) 2024-04-26T23:41:21.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.282+0000 7f21c5a00640 1 -- 172.21.15.137:0/3836118393 learned_addr learned my addr 172.21.15.137:0/3836118393 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:21.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.282+0000 7f21bfe00640 1 --2- 172.21.15.137:0/3836118393 >> v2:172.21.15.170:3300/0 conn(0x7f21c0070590 0x7f21c0070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:21.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.282+0000 7f21bf400640 1 -- 172.21.15.137:0/3836118393 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1795998009 0 0) 0x7f21c015f750 con 0x7f21c015f9c0 2024-04-26T23:41:21.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.282+0000 7f21bf400640 1 -- 172.21.15.137:0/3836118393 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21a8003530 con 0x7f21c015f9c0 2024-04-26T23:41:21.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.282+0000 7f21bf400640 1 -- 172.21.15.137:0/3836118393 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3403637295 0 0) 0x7f21a8003530 con 0x7f21c015f9c0 2024-04-26T23:41:21.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.282+0000 7f21bfe00640 1 -- 172.21.15.137:0/3836118393 >> v1:172.21.15.170:6789/0 conn(0x7f21c015f370 legacy=0x7f21c00b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:21.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.282+0000 7f21bfe00640 1 -- 172.21.15.137:0/3836118393 >> v1:172.21.15.137:6789/0 conn(0x7f21c015f9c0 legacy=0x7f21c006d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:21.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.282+0000 7f21bfe00640 1 -- 172.21.15.137:0/3836118393 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c006c840 con 0x7f21c0070590 2024-04-26T23:41:21.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.286+0000 7f21bfe00640 1 --2- 172.21.15.137:0/3836118393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21c0070590 0x7f21c0070a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f21ac0097f0 tx=0x7f21ac01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96fe6aa2d61ea28b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:21.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.286+0000 7f21bf400640 1 -- 172.21.15.137:0/3836118393 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac0b1070 con 0x7f21c0070590 2024-04-26T23:41:21.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.286+0000 7f21bf400640 1 -- 172.21.15.137:0/3836118393 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ac0ac400 con 0x7f21c0070590 2024-04-26T23:41:21.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.286+0000 7f21bf400640 1 -- 172.21.15.137:0/3836118393 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b8001a20 con 0x7f21c0070590 2024-04-26T23:41:21.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.286+0000 7f21c7a00640 1 -- 172.21.15.137:0/3836118393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21c0070590 msgr2=0x7f21c0070a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:21.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.286+0000 7f21c7a00640 1 --2- 172.21.15.137:0/3836118393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21c0070590 0x7f21c0070a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f21ac0097f0 tx=0x7f21ac01c3c0 comp rx=0 tx=0).stop 2024-04-26T23:41:21.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.286+0000 7f21c7a00640 1 -- 172.21.15.137:0/3836118393 shutdown_connections 2024-04-26T23:41:21.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.286+0000 7f21c7a00640 1 --2- 172.21.15.137:0/3836118393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21c0070590 0x7f21c0070a00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:21.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.286+0000 7f21c7a00640 1 -- 172.21.15.137:0/3836118393 >> 172.21.15.137:0/3836118393 conn(0x7f21c00b43e0 msgr2=0x7f21c00d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:21.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.286+0000 7f21c7a00640 1 -- 172.21.15.137:0/3836118393 shutdown_connections 2024-04-26T23:41:21.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.286+0000 7f21c7a00640 1 -- 172.21.15.137:0/3836118393 wait complete. 2024-04-26T23:41:21.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21c7a00640 1 Processor -- start 2024-04-26T23:41:21.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21c7a00640 1 -- start start 2024-04-26T23:41:21.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21c7a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21c0070590 0x7f21c015dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:21.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21c7a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f21c015f370 0x7f21c01584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:21.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21c7a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21c015f9c0 0x7f21c00b3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:21.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21c7a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f21c016a580 con 0x7f21c015f9c0 2024-04-26T23:41:21.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21c7a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f21c0160220 con 0x7f21c0070590 2024-04-26T23:41:21.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21c7a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f21c016a700 con 0x7f21c015f370 2024-04-26T23:41:21.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21c5a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21c015f9c0 0x7f21c00b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:21.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21c5a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21c015f9c0 0x7f21c00b3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33604/0 (socket says 172.21.15.137:33604) 2024-04-26T23:41:21.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21c5a00640 1 -- 172.21.15.137:0/3790319115 learned_addr learned my addr 172.21.15.137:0/3790319115 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:21.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21c5000640 1 --2- 172.21.15.137:0/3790319115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21c0070590 0x7f21c015dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:21.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21bfe00640 1 --2- 172.21.15.137:0/3790319115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f21c015f370 0x7f21c01584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:21.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21c5a00640 1 -- 172.21.15.137:0/3790319115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f21c015f370 msgr2=0x7f21c01584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:21.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21c5a00640 1 --2- 172.21.15.137:0/3790319115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f21c015f370 0x7f21c01584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:21.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21c5a00640 1 -- 172.21.15.137:0/3790319115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21c0070590 msgr2=0x7f21c015dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:21.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21c5a00640 1 --2- 172.21.15.137:0/3790319115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21c0070590 0x7f21c015dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:21.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21c5a00640 1 -- 172.21.15.137:0/3790319115 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c00b3670 con 0x7f21c015f9c0 2024-04-26T23:41:21.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21bfe00640 1 --2- 172.21.15.137:0/3790319115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f21c015f370 0x7f21c01584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:21.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21c5a00640 1 --2- 172.21.15.137:0/3790319115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21c015f9c0 0x7f21c00b3130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f21b800c840 tx=0x7f21b800cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:21.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21bcc00640 1 -- 172.21.15.137:0/3790319115 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b8018070 con 0x7f21c015f9c0 2024-04-26T23:41:21.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21bcc00640 1 -- 172.21.15.137:0/3790319115 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21b800a640 con 0x7f21c015f9c0 2024-04-26T23:41:21.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21bcc00640 1 -- 172.21.15.137:0/3790319115 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b800aa30 con 0x7f21c015f9c0 2024-04-26T23:41:21.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21c7a00640 1 -- 172.21.15.137:0/3790319115 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21c015e300 con 0x7f21c015f9c0 2024-04-26T23:41:21.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.290+0000 7f21c7a00640 1 -- 172.21.15.137:0/3790319115 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21c015ca10 con 0x7f21c015f9c0 2024-04-26T23:41:21.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.294+0000 7f21c7a00640 1 -- 172.21.15.137:0/3790319115 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21c006a4b0 con 0x7f21c015f9c0 2024-04-26T23:41:21.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.294+0000 7f21bcc00640 1 -- 172.21.15.137:0/3790319115 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f21b801b070 con 0x7f21c015f9c0 2024-04-26T23:41:21.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.294+0000 7f21bcc00640 1 --2- 172.21.15.137:0/3790319115 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f21a0068380 0x7f21a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:21.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.294+0000 7f21bcc00640 1 -- 172.21.15.137:0/3790319115 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f21b8085d00 con 0x7f21c015f9c0 2024-04-26T23:41:21.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.294+0000 7f21c5000640 1 --2- 172.21.15.137:0/3790319115 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f21a0068380 0x7f21a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:21.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.294+0000 7f21c5000640 1 --2- 172.21.15.137:0/3790319115 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f21a0068380 0x7f21a006a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f21b4007fd0 tx=0x7f21b4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:21.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.298+0000 7f21bcc00640 1 -- 172.21.15.137:0/3790319115 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f21c00b3670 con 0x7f21c015f9c0 2024-04-26T23:41:21.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.458+0000 7f21c7a00640 1 -- 172.21.15.137:0/3790319115 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f21c0156350 con 0x7f21c015f9c0 2024-04-26T23:41:21.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.458+0000 7f21bcc00640 1 -- 172.21.15.137:0/3790319115 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f21b8055f20 con 0x7f21c015f9c0 2024-04-26T23:41:21.463 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:21.463 INFO:teuthology.orchestra.run.smithi137.stdout:[ 2024-04-26T23:41:21.464 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:41:21.464 INFO:teuthology.orchestra.run.smithi137.stdout: "poolnum": 1, 2024-04-26T23:41:21.464 INFO:teuthology.orchestra.run.smithi137.stdout: "poolname": ".mgr" 2024-04-26T23:41:21.464 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:41:21.464 INFO:teuthology.orchestra.run.smithi137.stdout:] 2024-04-26T23:41:21.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.458+0000 7f21c7a00640 1 -- 172.21.15.137:0/3790319115 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f21a0068380 msgr2=0x7f21a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:21.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.458+0000 7f21c7a00640 1 --2- 172.21.15.137:0/3790319115 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f21a0068380 0x7f21a006a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f21b4007fd0 tx=0x7f21b4009040 comp rx=0 tx=0).stop 2024-04-26T23:41:21.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.458+0000 7f21c7a00640 1 -- 172.21.15.137:0/3790319115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21c015f9c0 msgr2=0x7f21c00b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:21.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.458+0000 7f21c7a00640 1 --2- 172.21.15.137:0/3790319115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21c015f9c0 0x7f21c00b3130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f21b800c840 tx=0x7f21b800cd00 comp rx=0 tx=0).stop 2024-04-26T23:41:21.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.458+0000 7f21c7a00640 1 -- 172.21.15.137:0/3790319115 shutdown_connections 2024-04-26T23:41:21.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.458+0000 7f21c7a00640 1 --2- 172.21.15.137:0/3790319115 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f21a0068380 0x7f21a006a840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:21.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.458+0000 7f21c7a00640 1 --2- 172.21.15.137:0/3790319115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21c015f9c0 0x7f21c00b3130 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:21.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.458+0000 7f21c7a00640 1 --2- 172.21.15.137:0/3790319115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f21c015f370 0x7f21c01584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:21.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.458+0000 7f21c7a00640 1 --2- 172.21.15.137:0/3790319115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21c0070590 0x7f21c015dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:21.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.458+0000 7f21c7a00640 1 -- 172.21.15.137:0/3790319115 >> 172.21.15.137:0/3790319115 conn(0x7f21c00b43e0 msgr2=0x7f21c015b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:21.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.458+0000 7f21c7a00640 1 -- 172.21.15.137:0/3790319115 shutdown_connections 2024-04-26T23:41:21.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.458+0000 7f21c7a00640 1 -- 172.21.15.137:0/3790319115 wait complete. 2024-04-26T23:41:21.485 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T23:41:21.485 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T23:41:21.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.618+0000 7f2ce0200640 1 Processor -- start 2024-04-26T23:41:21.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.618+0000 7f2ce0200640 1 -- start start 2024-04-26T23:41:21.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.618+0000 7f2ce0200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2cd8148160 0x7f2cd81485d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:21.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.618+0000 7f2ce0200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2cd8148b10 0x7f2cd8070680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:21.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.618+0000 7f2ce0200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cd8070bc0 0x7f2cd8162e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:21.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.618+0000 7f2ce0200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2cd8070fc0 con 0x7f2cd8148160 2024-04-26T23:41:21.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.618+0000 7f2ce0200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f2cd815f9a0 con 0x7f2cd8148b10 2024-04-26T23:41:21.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.618+0000 7f2ce0200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2cd815fc80 con 0x7f2cd8070bc0 2024-04-26T23:41:21.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.622+0000 7f2cdd800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2cd8148160 0x7f2cd81485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:21.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.622+0000 7f2cdd800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2cd8148160 0x7f2cd81485d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33618/0 (socket says 172.21.15.137:33618) 2024-04-26T23:41:21.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.622+0000 7f2cdd800640 1 -- 172.21.15.137:0/707048165 learned_addr learned my addr 172.21.15.137:0/707048165 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:21.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.622+0000 7f2cdce00640 1 --2- 172.21.15.137:0/707048165 >> v2:172.21.15.170:3300/0 conn(0x7f2cd8148b10 0x7f2cd8070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:21.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.622+0000 7f2cde200640 1 --2- 172.21.15.137:0/707048165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cd8070bc0 0x7f2cd8162e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:21.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.622+0000 7f2cdd800640 1 -- 172.21.15.137:0/707048165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cd8070bc0 msgr2=0x7f2cd8162e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:21.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.622+0000 7f2cdd800640 1 --2- 172.21.15.137:0/707048165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cd8070bc0 0x7f2cd8162e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:21.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.622+0000 7f2cdd800640 1 -- 172.21.15.137:0/707048165 >> v2:172.21.15.170:3300/0 conn(0x7f2cd8148b10 msgr2=0x7f2cd8070680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:21.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.622+0000 7f2cdd800640 1 --2- 172.21.15.137:0/707048165 >> v2:172.21.15.170:3300/0 conn(0x7f2cd8148b10 0x7f2cd8070680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:21.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.622+0000 7f2cdd800640 1 -- 172.21.15.137:0/707048165 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd815ff60 con 0x7f2cd8148160 2024-04-26T23:41:21.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.622+0000 7f2cde200640 1 --2- 172.21.15.137:0/707048165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cd8070bc0 0x7f2cd8162e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:21.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.622+0000 7f2cdd800640 1 --2- 172.21.15.137:0/707048165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cd8148160 0x7f2cd81485d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2cd806deb0 tx=0x7f2ccc01c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8790222d71298040 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:21.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.626+0000 7f2cd7e00640 1 -- 172.21.15.137:0/707048165 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc0b0070 con 0x7f2cd8148160 2024-04-26T23:41:21.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.626+0000 7f2cd7e00640 1 -- 172.21.15.137:0/707048165 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ccc0ab600 con 0x7f2cd8148160 2024-04-26T23:41:21.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.626+0000 7f2cd7e00640 1 -- 172.21.15.137:0/707048165 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc0ab9d0 con 0x7f2cd8148160 2024-04-26T23:41:21.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.626+0000 7f2ce0200640 1 -- 172.21.15.137:0/707048165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cd8148160 msgr2=0x7f2cd81485d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:21.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.626+0000 7f2ce0200640 1 --2- 172.21.15.137:0/707048165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cd8148160 0x7f2cd81485d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2cd806deb0 tx=0x7f2ccc01c1d0 comp rx=0 tx=0).stop 2024-04-26T23:41:21.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.626+0000 7f2ce0200640 1 -- 172.21.15.137:0/707048165 shutdown_connections 2024-04-26T23:41:21.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.626+0000 7f2ce0200640 1 --2- 172.21.15.137:0/707048165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cd8070bc0 0x7f2cd8162e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:21.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.626+0000 7f2ce0200640 1 --2- 172.21.15.137:0/707048165 >> v2:172.21.15.170:3300/0 conn(0x7f2cd8148b10 0x7f2cd8070680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:21.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.626+0000 7f2ce0200640 1 --2- 172.21.15.137:0/707048165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cd8148160 0x7f2cd81485d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:21.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.626+0000 7f2ce0200640 1 -- 172.21.15.137:0/707048165 >> 172.21.15.137:0/707048165 conn(0x7f2cd80b4b90 msgr2=0x7f2cd80b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:21.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.626+0000 7f2ce0200640 1 -- 172.21.15.137:0/707048165 shutdown_connections 2024-04-26T23:41:21.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.626+0000 7f2ce0200640 1 -- 172.21.15.137:0/707048165 wait complete. 2024-04-26T23:41:21.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.626+0000 7f2ce0200640 1 Processor -- start 2024-04-26T23:41:21.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.626+0000 7f2ce0200640 1 -- start start 2024-04-26T23:41:21.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.626+0000 7f2ce0200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cd8070bc0 0x7f2cd80cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:21.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.626+0000 7f2ce0200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cd8148160 0x7f2cd80cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:21.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.626+0000 7f2ce0200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cd8148b10 0x7f2cd8145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:21.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.626+0000 7f2ce0200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd8071eb0 con 0x7f2cd8148160 2024-04-26T23:41:21.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.626+0000 7f2ce0200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd8071d30 con 0x7f2cd8148b10 2024-04-26T23:41:21.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.626+0000 7f2ce0200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2cd8072030 con 0x7f2cd8070bc0 2024-04-26T23:41:21.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.626+0000 7f2cdce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cd8148160 0x7f2cd80cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:21.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.630+0000 7f2cdd800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cd8070bc0 0x7f2cd80cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:21.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.630+0000 7f2cdd800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cd8070bc0 0x7f2cd80cc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:41200/0 (socket says 172.21.15.137:41200) 2024-04-26T23:41:21.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.630+0000 7f2cdd800640 1 -- 172.21.15.137:0/4270486172 learned_addr learned my addr 172.21.15.137:0/4270486172 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:21.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.630+0000 7f2cde200640 1 --2- 172.21.15.137:0/4270486172 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cd8148b10 0x7f2cd8145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:21.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.630+0000 7f2cdce00640 1 -- 172.21.15.137:0/4270486172 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cd8070bc0 msgr2=0x7f2cd80cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:21.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.630+0000 7f2cdce00640 1 --2- 172.21.15.137:0/4270486172 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cd8070bc0 0x7f2cd80cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:21.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.630+0000 7f2cdce00640 1 -- 172.21.15.137:0/4270486172 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cd8148b10 msgr2=0x7f2cd8145f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:21.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.630+0000 7f2cdce00640 1 --2- 172.21.15.137:0/4270486172 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cd8148b10 0x7f2cd8145f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:21.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.630+0000 7f2cdce00640 1 -- 172.21.15.137:0/4270486172 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd8141d20 con 0x7f2cd8148160 2024-04-26T23:41:21.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.630+0000 7f2cdce00640 1 --2- 172.21.15.137:0/4270486172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cd8148160 0x7f2cd80cce20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400e840 tx=0x7f2cc400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:21.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.630+0000 7f2cd5600640 1 -- 172.21.15.137:0/4270486172 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4017070 con 0x7f2cd8148160 2024-04-26T23:41:21.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.630+0000 7f2cd5600640 1 -- 172.21.15.137:0/4270486172 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc400c730 con 0x7f2cd8148160 2024-04-26T23:41:21.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.630+0000 7f2cd5600640 1 -- 172.21.15.137:0/4270486172 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc400cb00 con 0x7f2cd8148160 2024-04-26T23:41:21.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.630+0000 7f2ce0200640 1 -- 172.21.15.137:0/4270486172 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd81f8810 con 0x7f2cd8148160 2024-04-26T23:41:21.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.630+0000 7f2ce0200640 1 -- 172.21.15.137:0/4270486172 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd81f8dd0 con 0x7f2cd8148160 2024-04-26T23:41:21.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.630+0000 7f2ce0200640 1 -- 172.21.15.137:0/4270486172 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cd80765d0 con 0x7f2cd8148160 2024-04-26T23:41:21.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.630+0000 7f2cd5600640 1 -- 172.21.15.137:0/4270486172 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2cc401a070 con 0x7f2cd8148160 2024-04-26T23:41:21.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.630+0000 7f2cd5600640 1 --2- 172.21.15.137:0/4270486172 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2cb8068380 0x7f2cb806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:21.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.630+0000 7f2cd5600640 1 -- 172.21.15.137:0/4270486172 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f2cc4086420 con 0x7f2cd8148160 2024-04-26T23:41:21.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.634+0000 7f2cdd800640 1 --2- 172.21.15.137:0/4270486172 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2cb8068380 0x7f2cb806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:21.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.634+0000 7f2cdd800640 1 --2- 172.21.15.137:0/4270486172 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2cb8068380 0x7f2cb806a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc01c210 tx=0x7f2ccc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:21.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.638+0000 7f2cd5600640 1 -- 172.21.15.137:0/4270486172 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2cc4056640 con 0x7f2cd8148160 2024-04-26T23:41:21.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:21.794+0000 7f2ce0200640 1 -- 172.21.15.137:0/4270486172 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f2cd80b7a30 con 0x7f2cd8148160 2024-04-26T23:41:22.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.170+0000 7f2cd5600640 1 -- 172.21.15.137:0/4270486172 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f2cc405a940 con 0x7f2cd8148160 2024-04-26T23:41:22.177 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' created 2024-04-26T23:41:22.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.174+0000 7f2ce0200640 1 -- 172.21.15.137:0/4270486172 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2cb8068380 msgr2=0x7f2cb806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:22.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.174+0000 7f2ce0200640 1 --2- 172.21.15.137:0/4270486172 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2cb8068380 0x7f2cb806a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc01c210 tx=0x7f2ccc008040 comp rx=0 tx=0).stop 2024-04-26T23:41:22.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.174+0000 7f2ce0200640 1 -- 172.21.15.137:0/4270486172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cd8148160 msgr2=0x7f2cd80cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:22.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.174+0000 7f2ce0200640 1 --2- 172.21.15.137:0/4270486172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cd8148160 0x7f2cd80cce20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400e840 tx=0x7f2cc400ed00 comp rx=0 tx=0).stop 2024-04-26T23:41:22.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.174+0000 7f2ce0200640 1 -- 172.21.15.137:0/4270486172 shutdown_connections 2024-04-26T23:41:22.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.174+0000 7f2ce0200640 1 --2- 172.21.15.137:0/4270486172 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2cb8068380 0x7f2cb806a840 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:22.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.174+0000 7f2ce0200640 1 --2- 172.21.15.137:0/4270486172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cd8148160 0x7f2cd80cce20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:22.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.174+0000 7f2ce0200640 1 --2- 172.21.15.137:0/4270486172 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cd8148b10 0x7f2cd8145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:22.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.174+0000 7f2ce0200640 1 --2- 172.21.15.137:0/4270486172 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cd8070bc0 0x7f2cd80cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:22.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.174+0000 7f2ce0200640 1 -- 172.21.15.137:0/4270486172 >> 172.21.15.137:0/4270486172 conn(0x7f2cd80b4b90 msgr2=0x7f2cd8072400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:22.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.174+0000 7f2ce0200640 1 -- 172.21.15.137:0/4270486172 shutdown_connections 2024-04-26T23:41:22.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.174+0000 7f2ce0200640 1 -- 172.21.15.137:0/4270486172 wait complete. 2024-04-26T23:41:22.206 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T23:41:22.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.342+0000 7f8bb5e00640 1 Processor -- start 2024-04-26T23:41:22.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.342+0000 7f8bb5e00640 1 -- start start 2024-04-26T23:41:22.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bb5e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb0160000 0x7f8bb0144d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:22.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bb5e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb00cffa0 con 0x7f8bb00b5ee0 2024-04-26T23:41:22.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bb5e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb00d0280 con 0x7f8bb00b54e0 2024-04-26T23:41:22.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bb5e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb00b3d90 con 0x7f8bb0160000 2024-04-26T23:41:22.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bae000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f8bb00b5ee0 0x7f8bb015f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45974/0 (socket says 172.21.15.137:45974) 2024-04-26T23:41:22.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bae000640 1 -- 172.21.15.137:0/1376675704 learned_addr learned my addr 172.21.15.137:0/1376675704 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:22.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8baf400640 1 --2- 172.21.15.137:0/1376675704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb0160000 0x7f8bb0144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:22.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bad600640 1 -- 172.21.15.137:0/1376675704 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1650165424 0 0) 0x7f8bb00cffa0 con 0x7f8bb00b5ee0 2024-04-26T23:41:22.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bad600640 1 -- 172.21.15.137:0/1376675704 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b94003530 con 0x7f8bb00b5ee0 2024-04-26T23:41:22.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bad600640 1 -- 172.21.15.137:0/1376675704 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3444559112 0 0) 0x7f8b94003530 con 0x7f8bb00b5ee0 2024-04-26T23:41:22.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bad600640 1 -- 172.21.15.137:0/1376675704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb0160000 msgr2=0x7f8bb0144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:22.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bad600640 1 --2- 172.21.15.137:0/1376675704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb0160000 0x7f8bb0144d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:22.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bad600640 1 -- 172.21.15.137:0/1376675704 >> v1:172.21.15.170:6789/0 conn(0x7f8bb00b54e0 legacy=0x7f8bb00cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:22.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bad600640 1 -- 172.21.15.137:0/1376675704 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb00d0560 con 0x7f8bb00b5ee0 2024-04-26T23:41:22.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bad600640 1 -- 172.21.15.137:0/1376675704 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f8b9c001680 con 0x7f8bb00b5ee0 2024-04-26T23:41:22.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bad600640 1 -- 172.21.15.137:0/1376675704 >> v1:172.21.15.137:6789/0 conn(0x7f8bb00b5ee0 legacy=0x7f8bb015f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:22.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bad600640 1 --2- 172.21.15.137:0/1376675704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b940039f0 0x7f8b94003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:22.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bad600640 1 --2- 172.21.15.137:0/1376675704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b94004350 0x7f8b94004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:22.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bad600640 1 --2- 172.21.15.137:0/1376675704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb0160000 0x7f8b94005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:22.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bad600640 1 -- 172.21.15.137:0/1376675704 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9400b9d0 con 0x7f8b940039f0 2024-04-26T23:41:22.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bad600640 1 -- 172.21.15.137:0/1376675704 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9400bb50 con 0x7f8b94004350 2024-04-26T23:41:22.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bad600640 1 -- 172.21.15.137:0/1376675704 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9400df60 con 0x7f8bb0160000 2024-04-26T23:41:22.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8baea00640 1 --2- 172.21.15.137:0/1376675704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b940039f0 0x7f8b94003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:22.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bae000640 1 --2- 172.21.15.137:0/1376675704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b94004350 0x7f8b94004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:22.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8baf400640 1 --2- 172.21.15.137:0/1376675704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb0160000 0x7f8b94005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:22.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8baea00640 1 -- 172.21.15.137:0/1376675704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb0160000 msgr2=0x7f8b94005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:22.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8baea00640 1 --2- 172.21.15.137:0/1376675704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb0160000 0x7f8b94005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:22.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8baea00640 1 -- 172.21.15.137:0/1376675704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b94004350 msgr2=0x7f8b94004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:22.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8baea00640 1 --2- 172.21.15.137:0/1376675704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b94004350 0x7f8b94004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:22.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8baea00640 1 -- 172.21.15.137:0/1376675704 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb00d0560 con 0x7f8b940039f0 2024-04-26T23:41:22.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.346+0000 7f8bae000640 1 --2- 172.21.15.137:0/1376675704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b94004350 0x7f8b94004830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:22.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.350+0000 7f8baea00640 1 --2- 172.21.15.137:0/1376675704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b940039f0 0x7f8b94003dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0001f60 tx=0x7f8ba001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41032a7569d20cf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:22.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.350+0000 7f8bad600640 1 -- 172.21.15.137:0/1376675704 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0001b60 con 0x7f8b940039f0 2024-04-26T23:41:22.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.350+0000 7f8bad600640 1 -- 172.21.15.137:0/1376675704 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba00a9680 con 0x7f8b940039f0 2024-04-26T23:41:22.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.350+0000 7f8bad600640 1 -- 172.21.15.137:0/1376675704 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba00a9a70 con 0x7f8b940039f0 2024-04-26T23:41:22.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.350+0000 7f8bb5e00640 1 -- 172.21.15.137:0/1376675704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b940039f0 msgr2=0x7f8b94003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:22.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.350+0000 7f8bb5e00640 1 --2- 172.21.15.137:0/1376675704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b940039f0 0x7f8b94003dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0001f60 tx=0x7f8ba001c8a0 comp rx=0 tx=0).stop 2024-04-26T23:41:22.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.350+0000 7f8baf400640 1 -- 172.21.15.137:0/1376675704 reap_dead start 2024-04-26T23:41:22.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.350+0000 7f8bb5e00640 1 -- 172.21.15.137:0/1376675704 shutdown_connections 2024-04-26T23:41:22.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.350+0000 7f8bb5e00640 1 -- 172.21.15.137:0/1376675704 >> 172.21.15.137:0/1376675704 conn(0x7f8bb006c800 msgr2=0x7f8bb006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:22.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.350+0000 7f8bb5e00640 1 -- 172.21.15.137:0/1376675704 shutdown_connections 2024-04-26T23:41:22.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.350+0000 7f8bb5e00640 1 -- 172.21.15.137:0/1376675704 wait complete. 2024-04-26T23:41:22.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.350+0000 7f8bb5e00640 1 Processor -- start 2024-04-26T23:41:22.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8bb5e00640 1 -- start start 2024-04-26T23:41:22.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8bb5e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b940039f0 0x7f8bb0135fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:22.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8bb5e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bb01440d0 0x7f8bb01422d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:22.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8bb5e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb01398c0 0x7f8bb0139d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:22.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8bb5e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb01456b0 con 0x7f8bb01440d0 2024-04-26T23:41:22.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8bb5e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb0145530 con 0x7f8b940039f0 2024-04-26T23:41:22.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8bb5e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb0145830 con 0x7f8bb01398c0 2024-04-26T23:41:22.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8bae000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bb01440d0 0x7f8bb01422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:22.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8bae000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bb01440d0 0x7f8bb01422d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33654/0 (socket says 172.21.15.137:33654) 2024-04-26T23:41:22.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8bae000640 1 -- 172.21.15.137:0/1658058364 learned_addr learned my addr 172.21.15.137:0/1658058364 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:22.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8baf400640 1 --2- 172.21.15.137:0/1658058364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb01398c0 0x7f8bb0139d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:22.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8baea00640 1 --2- 172.21.15.137:0/1658058364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b940039f0 0x7f8bb0135fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:22.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8bae000640 1 -- 172.21.15.137:0/1658058364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb01398c0 msgr2=0x7f8bb0139d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:22.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8bae000640 1 --2- 172.21.15.137:0/1658058364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb01398c0 0x7f8bb0139d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:22.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8bae000640 1 -- 172.21.15.137:0/1658058364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b940039f0 msgr2=0x7f8bb0135fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:22.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8bae000640 1 --2- 172.21.15.137:0/1658058364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b940039f0 0x7f8bb0135fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:22.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8bae000640 1 -- 172.21.15.137:0/1658058364 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb006efc0 con 0x7f8bb01440d0 2024-04-26T23:41:22.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8bae000640 1 --2- 172.21.15.137:0/1658058364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bb01440d0 0x7f8bb01422d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c000fe0 tx=0x7f8b9c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:22.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8ba7400640 1 -- 172.21.15.137:0/1658058364 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c00c870 con 0x7f8bb01440d0 2024-04-26T23:41:22.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8ba7400640 1 -- 172.21.15.137:0/1658058364 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b9c018070 con 0x7f8bb01440d0 2024-04-26T23:41:22.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8bb5e00640 1 -- 172.21.15.137:0/1658058364 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb0142c20 con 0x7f8bb01440d0 2024-04-26T23:41:22.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8ba7400640 1 -- 172.21.15.137:0/1658058364 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c00cc10 con 0x7f8bb01440d0 2024-04-26T23:41:22.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8bb5e00640 1 -- 172.21.15.137:0/1658058364 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb01431e0 con 0x7f8bb01440d0 2024-04-26T23:41:22.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.354+0000 7f8bb5e00640 1 -- 172.21.15.137:0/1658058364 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bb006a410 con 0x7f8bb01440d0 2024-04-26T23:41:22.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.358+0000 7f8ba7400640 1 -- 172.21.15.137:0/1658058364 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8b9c026430 con 0x7f8bb01440d0 2024-04-26T23:41:22.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.358+0000 7f8ba7400640 1 --2- 172.21.15.137:0/1658058364 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8b900683b0 0x7f8b9006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:22.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.358+0000 7f8ba7400640 1 -- 172.21.15.137:0/1658058364 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f8b9c086e00 con 0x7f8bb01440d0 2024-04-26T23:41:22.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.358+0000 7f8baea00640 1 --2- 172.21.15.137:0/1658058364 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8b900683b0 0x7f8b9006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:22.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.358+0000 7f8baea00640 1 --2- 172.21.15.137:0/1658058364 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8b900683b0 0x7f8b9006a870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00ae000 tx=0x7f8ba00b3040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:22.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.362+0000 7f8ba7400640 1 -- 172.21.15.137:0/1658058364 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8b9c057650 con 0x7f8bb01440d0 2024-04-26T23:41:22.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:22.518+0000 7f8bb5e00640 1 -- 172.21.15.137:0/1658058364 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f8bb0141de0 con 0x7f8bb01440d0 2024-04-26T23:41:23.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.178+0000 7f8ba7400640 1 -- 172.21.15.137:0/1658058364 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7f8b9c056f50 con 0x7f8bb01440d0 2024-04-26T23:41:23.184 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' created 2024-04-26T23:41:23.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.182+0000 7f8bb5e00640 1 -- 172.21.15.137:0/1658058364 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8b900683b0 msgr2=0x7f8b9006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:23.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.182+0000 7f8bb5e00640 1 --2- 172.21.15.137:0/1658058364 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8b900683b0 0x7f8b9006a870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00ae000 tx=0x7f8ba00b3040 comp rx=0 tx=0).stop 2024-04-26T23:41:23.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.182+0000 7f8bb5e00640 1 -- 172.21.15.137:0/1658058364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bb01440d0 msgr2=0x7f8bb01422d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:23.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.182+0000 7f8bb5e00640 1 --2- 172.21.15.137:0/1658058364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bb01440d0 0x7f8bb01422d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c000fe0 tx=0x7f8b9c00ec80 comp rx=0 tx=0).stop 2024-04-26T23:41:23.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.182+0000 7f8bb5e00640 1 -- 172.21.15.137:0/1658058364 shutdown_connections 2024-04-26T23:41:23.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.182+0000 7f8bb5e00640 1 --2- 172.21.15.137:0/1658058364 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8b900683b0 0x7f8b9006a870 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:23.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.182+0000 7f8bb5e00640 1 --2- 172.21.15.137:0/1658058364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bb01440d0 0x7f8bb01422d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:23.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.182+0000 7f8bb5e00640 1 --2- 172.21.15.137:0/1658058364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb01398c0 0x7f8bb0139d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:23.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.182+0000 7f8bb5e00640 1 --2- 172.21.15.137:0/1658058364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b940039f0 0x7f8bb0135fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:23.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.182+0000 7f8bb5e00640 1 -- 172.21.15.137:0/1658058364 >> 172.21.15.137:0/1658058364 conn(0x7f8bb006c800 msgr2=0x7f8bb015d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:23.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.182+0000 7f8bb5e00640 1 -- 172.21.15.137:0/1658058364 shutdown_connections 2024-04-26T23:41:23.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.186+0000 7f8bb5e00640 1 -- 172.21.15.137:0/1658058364 wait complete. 2024-04-26T23:41:23.229 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T23:41:23.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.362+0000 7f1f48800640 1 Processor -- start 2024-04-26T23:41:23.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.362+0000 7f1f48800640 1 -- start start 2024-04-26T23:41:23.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.362+0000 7f1f48800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1f40152510 0x7f1f4006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:23.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.362+0000 7f1f48800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f4015baf0 con 0x7f1f400ceb00 2024-04-26T23:41:23.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.362+0000 7f1f48800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f4015bdb0 con 0x7f1f40073fe0 2024-04-26T23:41:23.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.362+0000 7f1f48800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f1f4015c090 con 0x7f1f40152510 2024-04-26T23:41:23.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.362+0000 7f1f45400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f1f400ceb00 0x7f1f400738d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45982/0 (socket says 172.21.15.137:45982) 2024-04-26T23:41:23.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.362+0000 7f1f45400640 1 -- 172.21.15.137:0/3208641458 learned_addr learned my addr 172.21.15.137:0/3208641458 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:23.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.362+0000 7f1f45e00640 1 --2- 172.21.15.137:0/3208641458 >> v2:172.21.15.170:3300/0 conn(0x7f1f40152510 0x7f1f4006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:23.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.362+0000 7f1f44a00640 1 -- 172.21.15.137:0/3208641458 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1473135463 0 0) 0x7f1f4015baf0 con 0x7f1f400ceb00 2024-04-26T23:41:23.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.362+0000 7f1f44a00640 1 -- 172.21.15.137:0/3208641458 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f28003530 con 0x7f1f400ceb00 2024-04-26T23:41:23.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.362+0000 7f1f44a00640 1 -- 172.21.15.137:0/3208641458 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3031268878 0 0) 0x7f1f4015bdb0 con 0x7f1f40073fe0 2024-04-26T23:41:23.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.362+0000 7f1f44a00640 1 -- 172.21.15.137:0/3208641458 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f4015baf0 con 0x7f1f40073fe0 2024-04-26T23:41:23.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.362+0000 7f1f44a00640 1 -- 172.21.15.137:0/3208641458 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3356175567 0 0) 0x7f1f28003530 con 0x7f1f400ceb00 2024-04-26T23:41:23.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.362+0000 7f1f45e00640 1 -- 172.21.15.137:0/3208641458 >> v1:172.21.15.170:6789/0 conn(0x7f1f40073fe0 legacy=0x7f1f400b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:23.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.362+0000 7f1f45e00640 1 -- 172.21.15.137:0/3208641458 >> v1:172.21.15.137:6789/0 conn(0x7f1f400ceb00 legacy=0x7f1f400738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:23.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.362+0000 7f1f45e00640 1 -- 172.21.15.137:0/3208641458 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f4015c370 con 0x7f1f40152510 2024-04-26T23:41:23.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.366+0000 7f1f45e00640 1 --2- 172.21.15.137:0/3208641458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f40152510 0x7f1f4006ef60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400a960 tx=0x7f1f3401c5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bab82f20395e0d9d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:23.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.366+0000 7f1f44a00640 1 -- 172.21.15.137:0/3208641458 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f30001680 con 0x7f1f40152510 2024-04-26T23:41:23.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.366+0000 7f1f44a00640 1 -- 172.21.15.137:0/3208641458 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f340af070 con 0x7f1f40152510 2024-04-26T23:41:23.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.366+0000 7f1f44a00640 1 -- 172.21.15.137:0/3208641458 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3400b040 con 0x7f1f40152510 2024-04-26T23:41:23.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.366+0000 7f1f48800640 1 -- 172.21.15.137:0/3208641458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f40152510 msgr2=0x7f1f4006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:23.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.366+0000 7f1f48800640 1 --2- 172.21.15.137:0/3208641458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f40152510 0x7f1f4006ef60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400a960 tx=0x7f1f3401c5d0 comp rx=0 tx=0).stop 2024-04-26T23:41:23.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.366+0000 7f1f48800640 1 -- 172.21.15.137:0/3208641458 shutdown_connections 2024-04-26T23:41:23.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.366+0000 7f1f48800640 1 --2- 172.21.15.137:0/3208641458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f40152510 0x7f1f4006ef60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:23.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.366+0000 7f1f48800640 1 -- 172.21.15.137:0/3208641458 >> 172.21.15.137:0/3208641458 conn(0x7f1f4006c800 msgr2=0x7f1f4006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:23.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.366+0000 7f1f48800640 1 -- 172.21.15.137:0/3208641458 shutdown_connections 2024-04-26T23:41:23.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.366+0000 7f1f48800640 1 -- 172.21.15.137:0/3208641458 wait complete. 2024-04-26T23:41:23.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f48800640 1 Processor -- start 2024-04-26T23:41:23.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f48800640 1 -- start start 2024-04-26T23:41:23.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f48800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f40073fe0 0x7f1f4013bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:23.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f48800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f40152510 0x7f1f4013e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:23.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f48800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f40142110 0x7f1f401fbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:23.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f48800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1f400b4870 con 0x7f1f40142110 2024-04-26T23:41:23.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f48800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1f400b46f0 con 0x7f1f40152510 2024-04-26T23:41:23.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f48800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1f400b49f0 con 0x7f1f40073fe0 2024-04-26T23:41:23.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f46800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f40142110 0x7f1f401fbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:23.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f46800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f40142110 0x7f1f401fbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33670/0 (socket says 172.21.15.137:33670) 2024-04-26T23:41:23.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f46800640 1 -- 172.21.15.137:0/3560549118 learned_addr learned my addr 172.21.15.137:0/3560549118 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:23.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f45e00640 1 --2- 172.21.15.137:0/3560549118 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f40073fe0 0x7f1f4013bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:23.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f45400640 1 --2- 172.21.15.137:0/3560549118 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f40152510 0x7f1f4013e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:23.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f46800640 1 -- 172.21.15.137:0/3560549118 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f40073fe0 msgr2=0x7f1f4013bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:23.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f46800640 1 --2- 172.21.15.137:0/3560549118 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f40073fe0 0x7f1f4013bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:23.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f46800640 1 -- 172.21.15.137:0/3560549118 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f40152510 msgr2=0x7f1f4013e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:23.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f46800640 1 --2- 172.21.15.137:0/3560549118 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f40152510 0x7f1f4013e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:23.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f46800640 1 -- 172.21.15.137:0/3560549118 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f401f7c20 con 0x7f1f40142110 2024-04-26T23:41:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f45400640 1 --2- 172.21.15.137:0/3560549118 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f40152510 0x7f1f4013e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f46800640 1 --2- 172.21.15.137:0/3560549118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f40142110 0x7f1f401fbb60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00c7c0 tx=0x7f1f3c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f3a000640 1 -- 172.21.15.137:0/3560549118 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c003b80 con 0x7f1f40142110 2024-04-26T23:41:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f3a000640 1 -- 172.21.15.137:0/3560549118 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3c003d20 con 0x7f1f40142110 2024-04-26T23:41:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f48800640 1 -- 172.21.15.137:0/3560549118 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f401fb3a0 con 0x7f1f40142110 2024-04-26T23:41:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f3a000640 1 -- 172.21.15.137:0/3560549118 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c00aa50 con 0x7f1f40142110 2024-04-26T23:41:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f48800640 1 -- 172.21.15.137:0/3560549118 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f4013f180 con 0x7f1f40142110 2024-04-26T23:41:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.370+0000 7f1f48800640 1 -- 172.21.15.137:0/3560549118 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f4006a410 con 0x7f1f40142110 2024-04-26T23:41:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.374+0000 7f1f3a000640 1 -- 172.21.15.137:0/3560549118 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1f3c00abf0 con 0x7f1f40142110 2024-04-26T23:41:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.374+0000 7f1f3a000640 1 --2- 172.21.15.137:0/3560549118 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1f24068380 0x7f1f2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.374+0000 7f1f3a000640 1 -- 172.21.15.137:0/3560549118 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f1f3c0873a0 con 0x7f1f40142110 2024-04-26T23:41:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.374+0000 7f1f45e00640 1 --2- 172.21.15.137:0/3560549118 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1f24068380 0x7f1f2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.374+0000 7f1f45e00640 1 --2- 172.21.15.137:0/3560549118 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1f24068380 0x7f1f2406a840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1f340ae000 tx=0x7f1f3400c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:23.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.378+0000 7f1f3a000640 1 -- 172.21.15.137:0/3560549118 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1f3c057a30 con 0x7f1f40142110 2024-04-26T23:41:23.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:23.570+0000 7f1f48800640 1 -- 172.21.15.137:0/3560549118 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1f4013eb90 con 0x7f1f40142110 2024-04-26T23:41:24.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.194+0000 7f1f3a000640 1 -- 172.21.15.137:0/3560549118 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f1f3c057330 con 0x7f1f40142110 2024-04-26T23:41:24.207 INFO:teuthology.orchestra.run.smithi137.stderr:new fs with metadata pool 2 and data pool 3 2024-04-26T23:41:24.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.206+0000 7f1f48800640 1 -- 172.21.15.137:0/3560549118 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1f24068380 msgr2=0x7f1f2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:24.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.206+0000 7f1f48800640 1 --2- 172.21.15.137:0/3560549118 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1f24068380 0x7f1f2406a840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1f340ae000 tx=0x7f1f3400c040 comp rx=0 tx=0).stop 2024-04-26T23:41:24.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.206+0000 7f1f48800640 1 -- 172.21.15.137:0/3560549118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f40142110 msgr2=0x7f1f401fbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:24.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.206+0000 7f1f48800640 1 --2- 172.21.15.137:0/3560549118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f40142110 0x7f1f401fbb60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00c7c0 tx=0x7f1f3c00cc80 comp rx=0 tx=0).stop 2024-04-26T23:41:24.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.206+0000 7f1f48800640 1 -- 172.21.15.137:0/3560549118 shutdown_connections 2024-04-26T23:41:24.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.206+0000 7f1f48800640 1 --2- 172.21.15.137:0/3560549118 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1f24068380 0x7f1f2406a840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:24.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.206+0000 7f1f48800640 1 --2- 172.21.15.137:0/3560549118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f40142110 0x7f1f401fbb60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:24.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.206+0000 7f1f48800640 1 --2- 172.21.15.137:0/3560549118 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f40152510 0x7f1f4013e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:24.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.206+0000 7f1f48800640 1 --2- 172.21.15.137:0/3560549118 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f40073fe0 0x7f1f4013bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:24.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.206+0000 7f1f48800640 1 -- 172.21.15.137:0/3560549118 >> 172.21.15.137:0/3560549118 conn(0x7f1f4006c800 msgr2=0x7f1f4006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:24.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.206+0000 7f1f48800640 1 -- 172.21.15.137:0/3560549118 shutdown_connections 2024-04-26T23:41:24.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.206+0000 7f1f48800640 1 -- 172.21.15.137:0/3560549118 wait complete. 2024-04-26T23:41:24.249 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:24.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.378+0000 7f54aa000640 1 Processor -- start 2024-04-26T23:41:24.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.378+0000 7f54aa000640 1 -- start start 2024-04-26T23:41:24.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.382+0000 7f54aa000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f54a40ce3e0 0x7f54a4073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:24.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.382+0000 7f54aa000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54a4073010 con 0x7f54a415de80 2024-04-26T23:41:24.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.382+0000 7f54aa000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54a40cef90 con 0x7f54a40ce7c0 2024-04-26T23:41:24.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.382+0000 7f54aa000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f54a4073280 con 0x7f54a40ce3e0 2024-04-26T23:41:24.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.382+0000 7f54a2a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f54a415de80 0x7f54a40d04e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45986/0 (socket says 172.21.15.137:45986) 2024-04-26T23:41:24.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.382+0000 7f54a3400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f54a40ce3e0 0x7f54a4073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:24.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.382+0000 7f54a2a00640 1 -- 172.21.15.137:0/610693910 learned_addr learned my addr 172.21.15.137:0/610693910 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:24.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.382+0000 7f54a3400640 1 -- 172.21.15.137:0/610693910 >> v1:172.21.15.170:6789/0 conn(0x7f54a40ce7c0 legacy=0x7f54a4146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:24.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.382+0000 7f54a3400640 1 -- 172.21.15.137:0/610693910 >> v1:172.21.15.137:6789/0 conn(0x7f54a415de80 legacy=0x7f54a40d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:24.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.382+0000 7f54a2000640 1 -- 172.21.15.137:0/610693910 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3507896462 0 0) 0x7f54a4073010 con 0x7f54a415de80 2024-04-26T23:41:24.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.382+0000 7f54a3400640 1 -- 172.21.15.137:0/610693910 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a4073560 con 0x7f54a40ce3e0 2024-04-26T23:41:24.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.382+0000 7f54a3400640 1 --2- 172.21.15.137:0/610693910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54a40ce3e0 0x7f54a4073d60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5494009dc0 tx=0x7f549401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dffd5a51647d2c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:24.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54a2000640 1 -- 172.21.15.137:0/610693910 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54940b2070 con 0x7f54a40ce3e0 2024-04-26T23:41:24.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54a2000640 1 -- 172.21.15.137:0/610693910 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54940a5a00 con 0x7f54a40ce3e0 2024-04-26T23:41:24.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54a2000640 1 -- 172.21.15.137:0/610693910 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54940a5dd0 con 0x7f54a40ce3e0 2024-04-26T23:41:24.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54aa000640 1 -- 172.21.15.137:0/610693910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54a40ce3e0 msgr2=0x7f54a4073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:24.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54aa000640 1 --2- 172.21.15.137:0/610693910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54a40ce3e0 0x7f54a4073d60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5494009dc0 tx=0x7f549401c920 comp rx=0 tx=0).stop 2024-04-26T23:41:24.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54aa000640 1 -- 172.21.15.137:0/610693910 shutdown_connections 2024-04-26T23:41:24.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54aa000640 1 --2- 172.21.15.137:0/610693910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54a40ce3e0 0x7f54a4073d60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:24.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54aa000640 1 -- 172.21.15.137:0/610693910 >> 172.21.15.137:0/610693910 conn(0x7f54a406c5d0 msgr2=0x7f54a406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:24.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54aa000640 1 -- 172.21.15.137:0/610693910 shutdown_connections 2024-04-26T23:41:24.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54aa000640 1 -- 172.21.15.137:0/610693910 wait complete. 2024-04-26T23:41:24.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54aa000640 1 Processor -- start 2024-04-26T23:41:24.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54aa000640 1 -- start start 2024-04-26T23:41:24.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54aa000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54a40ce3e0 0x7f54a41559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:24.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54aa000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54a40ce7c0 0x7f54a415ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:24.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54aa000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54a415de80 0x7f54a4159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:24.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54aa000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f54a406ed10 con 0x7f54a40ce3e0 2024-04-26T23:41:24.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54aa000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f54a406ee90 con 0x7f54a40ce7c0 2024-04-26T23:41:24.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54aa000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f54a406f010 con 0x7f54a415de80 2024-04-26T23:41:24.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54a3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54a40ce3e0 0x7f54a41559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:24.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54a3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54a40ce3e0 0x7f54a41559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33676/0 (socket says 172.21.15.137:33676) 2024-04-26T23:41:24.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54a3400640 1 -- 172.21.15.137:0/2875174316 learned_addr learned my addr 172.21.15.137:0/2875174316 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:24.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54a3e00640 1 --2- 172.21.15.137:0/2875174316 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54a415de80 0x7f54a4159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:24.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54a2a00640 1 --2- 172.21.15.137:0/2875174316 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54a40ce7c0 0x7f54a415ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:24.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54a3400640 1 -- 172.21.15.137:0/2875174316 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54a415de80 msgr2=0x7f54a4159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:24.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54a3400640 1 --2- 172.21.15.137:0/2875174316 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54a415de80 0x7f54a4159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:24.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54a3400640 1 -- 172.21.15.137:0/2875174316 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54a40ce7c0 msgr2=0x7f54a415ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:24.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54a3400640 1 --2- 172.21.15.137:0/2875174316 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54a40ce7c0 0x7f54a415ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:24.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54a3400640 1 -- 172.21.15.137:0/2875174316 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a40b3c90 con 0x7f54a40ce3e0 2024-04-26T23:41:24.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54a3e00640 1 --2- 172.21.15.137:0/2875174316 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54a415de80 0x7f54a4159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:24.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.386+0000 7f54a2a00640 1 --2- 172.21.15.137:0/2875174316 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54a40ce7c0 0x7f54a415ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:24.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.390+0000 7f54a3400640 1 --2- 172.21.15.137:0/2875174316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54a40ce3e0 0x7f54a41559f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f54940b0040 tx=0x7f54940196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:24.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.390+0000 7f549b400640 1 -- 172.21.15.137:0/2875174316 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54940b2040 con 0x7f54a40ce3e0 2024-04-26T23:41:24.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.390+0000 7f549b400640 1 -- 172.21.15.137:0/2875174316 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54940bf070 con 0x7f54a40ce3e0 2024-04-26T23:41:24.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.390+0000 7f54aa000640 1 -- 172.21.15.137:0/2875174316 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54a4157fe0 con 0x7f54a40ce3e0 2024-04-26T23:41:24.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.390+0000 7f549b400640 1 -- 172.21.15.137:0/2875174316 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54940adb70 con 0x7f54a40ce3e0 2024-04-26T23:41:24.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.390+0000 7f54aa000640 1 -- 172.21.15.137:0/2875174316 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54a41585a0 con 0x7f54a40ce3e0 2024-04-26T23:41:24.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.390+0000 7f54aa000640 1 -- 172.21.15.137:0/2875174316 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54a406a4b0 con 0x7f54a40ce3e0 2024-04-26T23:41:24.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.390+0000 7f549b400640 1 -- 172.21.15.137:0/2875174316 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f54940add10 con 0x7f54a40ce3e0 2024-04-26T23:41:24.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.390+0000 7f549b400640 1 --2- 172.21.15.137:0/2875174316 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5484068380 0x7f548406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:24.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.390+0000 7f549b400640 1 -- 172.21.15.137:0/2875174316 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f5494121eb0 con 0x7f54a40ce3e0 2024-04-26T23:41:24.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.390+0000 7f54a2a00640 1 --2- 172.21.15.137:0/2875174316 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5484068380 0x7f548406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:24.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.394+0000 7f54a2a00640 1 --2- 172.21.15.137:0/2875174316 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5484068380 0x7f548406a840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f54a40b28f0 tx=0x7f5490007dd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:24.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.394+0000 7f549b400640 1 -- 172.21.15.137:0/2875174316 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5494016540 con 0x7f54a40ce3e0 2024-04-26T23:41:24.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.550+0000 7f54aa000640 1 -- 172.21.15.137:0/2875174316 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f54a41420f0 con 0x7f54a40ce3e0 2024-04-26T23:41:24.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.554+0000 7f549b400640 1 -- 172.21.15.137:0/2875174316 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16666 (secure 0 0 0) 0x7f54940ab340 con 0x7f54a40ce3e0 2024-04-26T23:41:24.559 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:24.559 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":19,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:23.574398+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:24.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.554+0000 7f54aa000640 1 -- 172.21.15.137:0/2875174316 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5484068380 msgr2=0x7f548406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:24.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.554+0000 7f54aa000640 1 --2- 172.21.15.137:0/2875174316 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5484068380 0x7f548406a840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f54a40b28f0 tx=0x7f5490007dd0 comp rx=0 tx=0).stop 2024-04-26T23:41:24.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.554+0000 7f54aa000640 1 -- 172.21.15.137:0/2875174316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54a40ce3e0 msgr2=0x7f54a41559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:24.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.554+0000 7f54aa000640 1 --2- 172.21.15.137:0/2875174316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54a40ce3e0 0x7f54a41559f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f54940b0040 tx=0x7f54940196c0 comp rx=0 tx=0).stop 2024-04-26T23:41:24.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.554+0000 7f54aa000640 1 -- 172.21.15.137:0/2875174316 shutdown_connections 2024-04-26T23:41:24.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.554+0000 7f54aa000640 1 --2- 172.21.15.137:0/2875174316 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5484068380 0x7f548406a840 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:24.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.554+0000 7f54aa000640 1 --2- 172.21.15.137:0/2875174316 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54a415de80 0x7f54a4159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:24.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.554+0000 7f54aa000640 1 --2- 172.21.15.137:0/2875174316 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54a40ce7c0 0x7f54a415ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:24.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.554+0000 7f54aa000640 1 --2- 172.21.15.137:0/2875174316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54a40ce3e0 0x7f54a41559f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:24.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.554+0000 7f54aa000640 1 -- 172.21.15.137:0/2875174316 >> 172.21.15.137:0/2875174316 conn(0x7f54a406c5d0 msgr2=0x7f54a41413d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:24.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.554+0000 7f54aa000640 1 -- 172.21.15.137:0/2875174316 shutdown_connections 2024-04-26T23:41:24.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.554+0000 7f54aa000640 1 -- 172.21.15.137:0/2875174316 wait complete. 2024-04-26T23:41:24.580 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:24.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.710+0000 7f5cfe000640 1 Processor -- start 2024-04-26T23:41:24.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.710+0000 7f5cfe000640 1 -- start start 2024-04-26T23:41:24.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.710+0000 7f5cfe000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cf80d1ac0 0x7f5cf80b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:24.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.710+0000 7f5cfe000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cf80b1b30 con 0x7f5cf815ced0 2024-04-26T23:41:24.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.710+0000 7f5cfe000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cf80b1e10 con 0x7f5cf815d2b0 2024-04-26T23:41:24.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.710+0000 7f5cfe000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf80b23f0 con 0x7f5cf80d1ac0 2024-04-26T23:41:24.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.710+0000 7f5cf7400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f5cf815ced0 0x7f5cf80d13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45994/0 (socket says 172.21.15.137:45994) 2024-04-26T23:41:24.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.710+0000 7f5cf7400640 1 -- 172.21.15.137:0/1278991425 learned_addr learned my addr 172.21.15.137:0/1278991425 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:24.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.710+0000 7f5cf6a00640 1 --2- 172.21.15.137:0/1278991425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cf80d1ac0 0x7f5cf80b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:24.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.714+0000 7f5cf6000640 1 -- 172.21.15.137:0/1278991425 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3535393891 0 0) 0x7f5cf80b1b30 con 0x7f5cf815ced0 2024-04-26T23:41:24.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.714+0000 7f5cf6000640 1 -- 172.21.15.137:0/1278991425 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cdc003530 con 0x7f5cf815ced0 2024-04-26T23:41:24.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.714+0000 7f5cf6000640 1 -- 172.21.15.137:0/1278991425 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2684842295 0 0) 0x7f5cdc003530 con 0x7f5cf815ced0 2024-04-26T23:41:24.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.714+0000 7f5cf6a00640 1 -- 172.21.15.137:0/1278991425 >> v1:172.21.15.170:6789/0 conn(0x7f5cf815d2b0 legacy=0x7f5cf80b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:24.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.714+0000 7f5cf6a00640 1 -- 172.21.15.137:0/1278991425 >> v1:172.21.15.137:6789/0 conn(0x7f5cf815ced0 legacy=0x7f5cf80d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:24.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.714+0000 7f5cf6a00640 1 -- 172.21.15.137:0/1278991425 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf80b26d0 con 0x7f5cf80d1ac0 2024-04-26T23:41:24.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.714+0000 7f5cf6a00640 1 --2- 172.21.15.137:0/1278991425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cf80d1ac0 0x7f5cf80b0d90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4009770 tx=0x7f5ce401c230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b9b140f16198204 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:24.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cf6000640 1 -- 172.21.15.137:0/1278991425 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce40b0070 con 0x7f5cf80d1ac0 2024-04-26T23:41:24.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cf6000640 1 -- 172.21.15.137:0/1278991425 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce40ab400 con 0x7f5cf80d1ac0 2024-04-26T23:41:24.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cf6000640 1 -- 172.21.15.137:0/1278991425 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8001680 con 0x7f5cf80d1ac0 2024-04-26T23:41:24.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cfe000640 1 -- 172.21.15.137:0/1278991425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cf80d1ac0 msgr2=0x7f5cf80b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:24.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cfe000640 1 --2- 172.21.15.137:0/1278991425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cf80d1ac0 0x7f5cf80b0d90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4009770 tx=0x7f5ce401c230 comp rx=0 tx=0).stop 2024-04-26T23:41:24.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cfe000640 1 -- 172.21.15.137:0/1278991425 shutdown_connections 2024-04-26T23:41:24.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cfe000640 1 --2- 172.21.15.137:0/1278991425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cf80d1ac0 0x7f5cf80b0d90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:24.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cfe000640 1 -- 172.21.15.137:0/1278991425 >> 172.21.15.137:0/1278991425 conn(0x7f5cf809ba60 msgr2=0x7f5cf809be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:24.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cfe000640 1 -- 172.21.15.137:0/1278991425 shutdown_connections 2024-04-26T23:41:24.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cfe000640 1 -- 172.21.15.137:0/1278991425 wait complete. 2024-04-26T23:41:24.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cfe000640 1 Processor -- start 2024-04-26T23:41:24.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cfe000640 1 -- start start 2024-04-26T23:41:24.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cfe000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cf80d1ac0 0x7f5cf81522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:24.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cfe000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cf815ced0 0x7f5cf81562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:24.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cfe000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cf815d2b0 0x7f5cf8151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:24.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cfe000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf816aee0 con 0x7f5cf815d2b0 2024-04-26T23:41:24.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cfe000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf816ad60 con 0x7f5cf80d1ac0 2024-04-26T23:41:24.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cfe000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf816b060 con 0x7f5cf815ced0 2024-04-26T23:41:24.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cf7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cf815d2b0 0x7f5cf8151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:24.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cf7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cf815d2b0 0x7f5cf8151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33684/0 (socket says 172.21.15.137:33684) 2024-04-26T23:41:24.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cf7e00640 1 -- 172.21.15.137:0/4233467190 learned_addr learned my addr 172.21.15.137:0/4233467190 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:24.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cf6a00640 1 --2- 172.21.15.137:0/4233467190 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cf815ced0 0x7f5cf81562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:24.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.718+0000 7f5cf7400640 1 --2- 172.21.15.137:0/4233467190 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cf80d1ac0 0x7f5cf81522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:24.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.722+0000 7f5cf7e00640 1 -- 172.21.15.137:0/4233467190 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cf815ced0 msgr2=0x7f5cf81562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:24.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.722+0000 7f5cf7e00640 1 --2- 172.21.15.137:0/4233467190 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cf815ced0 0x7f5cf81562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:24.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.722+0000 7f5cf7e00640 1 -- 172.21.15.137:0/4233467190 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cf80d1ac0 msgr2=0x7f5cf81522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:24.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.722+0000 7f5cf7e00640 1 --2- 172.21.15.137:0/4233467190 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cf80d1ac0 0x7f5cf81522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:24.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.722+0000 7f5cf7e00640 1 -- 172.21.15.137:0/4233467190 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf8167480 con 0x7f5cf815d2b0 2024-04-26T23:41:24.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.722+0000 7f5cf6a00640 1 --2- 172.21.15.137:0/4233467190 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cf815ced0 0x7f5cf81562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:24.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.722+0000 7f5cf7e00640 1 --2- 172.21.15.137:0/4233467190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cf815d2b0 0x7f5cf8151200 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000c8a0 tx=0x7f5cf000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:24.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.722+0000 7f5cef400640 1 -- 172.21.15.137:0/4233467190 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0017070 con 0x7f5cf815d2b0 2024-04-26T23:41:24.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.722+0000 7f5cef400640 1 -- 172.21.15.137:0/4233467190 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf0003db0 con 0x7f5cf815d2b0 2024-04-26T23:41:24.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.722+0000 7f5cef400640 1 -- 172.21.15.137:0/4233467190 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf00052b0 con 0x7f5cf815d2b0 2024-04-26T23:41:24.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.722+0000 7f5cfe000640 1 -- 172.21.15.137:0/4233467190 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf8165050 con 0x7f5cf815d2b0 2024-04-26T23:41:24.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.722+0000 7f5cfe000640 1 -- 172.21.15.137:0/4233467190 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf8167720 con 0x7f5cf815d2b0 2024-04-26T23:41:24.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.722+0000 7f5cfe000640 1 -- 172.21.15.137:0/4233467190 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cf806a4b0 con 0x7f5cf815d2b0 2024-04-26T23:41:24.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.722+0000 7f5cef400640 1 -- 172.21.15.137:0/4233467190 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5cf001a070 con 0x7f5cf815d2b0 2024-04-26T23:41:24.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.722+0000 7f5cef400640 1 --2- 172.21.15.137:0/4233467190 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5cd8068380 0x7f5cd806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:24.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.722+0000 7f5cef400640 1 -- 172.21.15.137:0/4233467190 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f5cf0086160 con 0x7f5cf815d2b0 2024-04-26T23:41:24.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.722+0000 7f5cf7400640 1 --2- 172.21.15.137:0/4233467190 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5cd8068380 0x7f5cd806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:24.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.726+0000 7f5cf7400640 1 --2- 172.21.15.137:0/4233467190 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5cd8068380 0x7f5cd806a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80017f0 tx=0x7f5ce8001560 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:24.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.726+0000 7f5cef400640 1 -- 172.21.15.137:0/4233467190 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5cf0056710 con 0x7f5cf815d2b0 2024-04-26T23:41:24.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.886+0000 7f5cfe000640 1 -- 172.21.15.137:0/4233467190 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5cf8068dd0 con 0x7f5cf815d2b0 2024-04-26T23:41:24.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.886+0000 7f5cef400640 1 -- 172.21.15.137:0/4233467190 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16666 (secure 0 0 0) 0x7f5cf0056010 con 0x7f5cf815d2b0 2024-04-26T23:41:24.892 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:24.893 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":19,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:23.574398+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:24.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.886+0000 7f5cfe000640 1 -- 172.21.15.137:0/4233467190 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5cd8068380 msgr2=0x7f5cd806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:24.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.886+0000 7f5cfe000640 1 --2- 172.21.15.137:0/4233467190 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5cd8068380 0x7f5cd806a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80017f0 tx=0x7f5ce8001560 comp rx=0 tx=0).stop 2024-04-26T23:41:24.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.886+0000 7f5cfe000640 1 -- 172.21.15.137:0/4233467190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cf815d2b0 msgr2=0x7f5cf8151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:24.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.886+0000 7f5cfe000640 1 --2- 172.21.15.137:0/4233467190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cf815d2b0 0x7f5cf8151200 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000c8a0 tx=0x7f5cf000cd60 comp rx=0 tx=0).stop 2024-04-26T23:41:24.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.886+0000 7f5cfe000640 1 -- 172.21.15.137:0/4233467190 shutdown_connections 2024-04-26T23:41:24.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.886+0000 7f5cfe000640 1 --2- 172.21.15.137:0/4233467190 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5cd8068380 0x7f5cd806a840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:24.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.886+0000 7f5cfe000640 1 --2- 172.21.15.137:0/4233467190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cf815d2b0 0x7f5cf8151200 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:24.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.886+0000 7f5cfe000640 1 --2- 172.21.15.137:0/4233467190 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cf815ced0 0x7f5cf81562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:24.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.886+0000 7f5cfe000640 1 --2- 172.21.15.137:0/4233467190 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cf80d1ac0 0x7f5cf81522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:24.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.886+0000 7f5cfe000640 1 -- 172.21.15.137:0/4233467190 >> 172.21.15.137:0/4233467190 conn(0x7f5cf809ba60 msgr2=0x7f5cf8070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:24.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.886+0000 7f5cfe000640 1 -- 172.21.15.137:0/4233467190 shutdown_connections 2024-04-26T23:41:24.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:24.886+0000 7f5cfe000640 1 -- 172.21.15.137:0/4233467190 wait complete. 2024-04-26T23:41:24.913 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T23:41:25.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.046+0000 7f627ba00640 1 Processor -- start 2024-04-26T23:41:25.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.046+0000 7f627ba00640 1 -- start start 2024-04-26T23:41:25.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.046+0000 7f627ba00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f62740b54e0 0x7f62740b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:25.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.046+0000 7f627ba00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f62740cd710 0x7f627415f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:25.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.046+0000 7f627ba00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62740cffa0 con 0x7f627415fe30 2024-04-26T23:41:25.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.046+0000 7f627ba00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f62740b3d90 con 0x7f62740cd710 2024-04-26T23:41:25.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.046+0000 7f627ba00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f62740d0840 con 0x7f62740b54e0 2024-04-26T23:41:25.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.046+0000 7f6273e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f62740cd710 0x7f627415f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:25.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.046+0000 7f6279a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f627415fe30 0x7f6274144d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46004/0 (socket says 172.21.15.137:46004) 2024-04-26T23:41:25.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.046+0000 7f6279a00640 1 -- 172.21.15.137:0/3421189209 learned_addr learned my addr 172.21.15.137:0/3421189209 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:25.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.046+0000 7f6279000640 1 --2- 172.21.15.137:0/3421189209 >> v2:172.21.15.170:3300/0 conn(0x7f62740b54e0 0x7f62740b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:25.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.046+0000 7f6273e00640 1 -- 172.21.15.137:0/3421189209 >> v2:172.21.15.170:3300/0 conn(0x7f62740b54e0 msgr2=0x7f62740b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:25.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.046+0000 7f6273e00640 1 --2- 172.21.15.137:0/3421189209 >> v2:172.21.15.170:3300/0 conn(0x7f62740b54e0 0x7f62740b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:25.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.046+0000 7f6273e00640 1 -- 172.21.15.137:0/3421189209 >> v1:172.21.15.137:6789/0 conn(0x7f627415fe30 legacy=0x7f6274144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:25.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.046+0000 7f6273e00640 1 -- 172.21.15.137:0/3421189209 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62740d0280 con 0x7f62740cd710 2024-04-26T23:41:25.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.046+0000 7f6273400640 1 -- 172.21.15.137:0/3421189209 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 266807924 0 0) 0x7f62740cffa0 con 0x7f627415fe30 2024-04-26T23:41:25.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.046+0000 7f6279000640 1 --2- 172.21.15.137:0/3421189209 >> v2:172.21.15.170:3300/0 conn(0x7f62740b54e0 0x7f62740b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:25.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.050+0000 7f6273e00640 1 --2- 172.21.15.137:0/3421189209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62740cd710 0x7f627415f8f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f627406de40 tx=0x7f626001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff595e380b0ffde5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:25.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.050+0000 7f6273400640 1 -- 172.21.15.137:0/3421189209 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62600b2070 con 0x7f62740cd710 2024-04-26T23:41:25.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.050+0000 7f6273400640 1 -- 172.21.15.137:0/3421189209 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62600ad640 con 0x7f62740cd710 2024-04-26T23:41:25.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.050+0000 7f6273400640 1 -- 172.21.15.137:0/3421189209 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62600ada10 con 0x7f62740cd710 2024-04-26T23:41:25.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.050+0000 7f627ba00640 1 -- 172.21.15.137:0/3421189209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62740cd710 msgr2=0x7f627415f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:25.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.050+0000 7f627ba00640 1 --2- 172.21.15.137:0/3421189209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62740cd710 0x7f627415f8f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f627406de40 tx=0x7f626001c480 comp rx=0 tx=0).stop 2024-04-26T23:41:25.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.050+0000 7f627ba00640 1 -- 172.21.15.137:0/3421189209 shutdown_connections 2024-04-26T23:41:25.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.050+0000 7f627ba00640 1 --2- 172.21.15.137:0/3421189209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62740cd710 0x7f627415f8f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:25.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.050+0000 7f627ba00640 1 --2- 172.21.15.137:0/3421189209 >> v2:172.21.15.170:3300/0 conn(0x7f62740b54e0 0x7f62740b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:25.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.050+0000 7f627ba00640 1 -- 172.21.15.137:0/3421189209 >> 172.21.15.137:0/3421189209 conn(0x7f627406c800 msgr2=0x7f627406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:25.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.050+0000 7f627ba00640 1 -- 172.21.15.137:0/3421189209 shutdown_connections 2024-04-26T23:41:25.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.050+0000 7f627ba00640 1 -- 172.21.15.137:0/3421189209 wait complete. 2024-04-26T23:41:25.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f627ba00640 1 Processor -- start 2024-04-26T23:41:25.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f627ba00640 1 -- start start 2024-04-26T23:41:25.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f627ba00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62740b54e0 0x7f6274138950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:25.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f627ba00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62740cd710 0x7f627415b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f627ba00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f627415fe30 0x7f6274156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f627ba00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6274145840 con 0x7f627415fe30 2024-04-26T23:41:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f627ba00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f62740cded0 con 0x7f62740b54e0 2024-04-26T23:41:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f627ba00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f62741459c0 con 0x7f62740cd710 2024-04-26T23:41:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f6279a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f627415fe30 0x7f6274156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f6279a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f627415fe30 0x7f6274156930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33702/0 (socket says 172.21.15.137:33702) 2024-04-26T23:41:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f6279a00640 1 -- 172.21.15.137:0/574191212 learned_addr learned my addr 172.21.15.137:0/574191212 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f6279000640 1 --2- 172.21.15.137:0/574191212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62740b54e0 0x7f6274138950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f6273e00640 1 --2- 172.21.15.137:0/574191212 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62740cd710 0x7f627415b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f6279a00640 1 -- 172.21.15.137:0/574191212 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62740cd710 msgr2=0x7f627415b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f6279a00640 1 --2- 172.21.15.137:0/574191212 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62740cd710 0x7f627415b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f6279a00640 1 -- 172.21.15.137:0/574191212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62740b54e0 msgr2=0x7f6274138950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f6279a00640 1 --2- 172.21.15.137:0/574191212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62740b54e0 0x7f6274138950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f6279a00640 1 -- 172.21.15.137:0/574191212 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6274138e90 con 0x7f627415fe30 2024-04-26T23:41:25.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f6279a00640 1 --2- 172.21.15.137:0/574191212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f627415fe30 0x7f6274156930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f626c001570 tx=0x7f626c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:25.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f6270c00640 1 -- 172.21.15.137:0/574191212 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626c018070 con 0x7f627415fe30 2024-04-26T23:41:25.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f6270c00640 1 -- 172.21.15.137:0/574191212 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f626c00a640 con 0x7f627415fe30 2024-04-26T23:41:25.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f6270c00640 1 -- 172.21.15.137:0/574191212 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626c00aa30 con 0x7f627415fe30 2024-04-26T23:41:25.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f627ba00640 1 -- 172.21.15.137:0/574191212 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f627415a4b0 con 0x7f627415fe30 2024-04-26T23:41:25.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f627ba00640 1 -- 172.21.15.137:0/574191212 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f627415aa70 con 0x7f627415fe30 2024-04-26T23:41:25.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.054+0000 7f627ba00640 1 -- 172.21.15.137:0/574191212 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f627406a410 con 0x7f627415fe30 2024-04-26T23:41:25.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.058+0000 7f6270c00640 1 -- 172.21.15.137:0/574191212 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f626c01b070 con 0x7f627415fe30 2024-04-26T23:41:25.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.058+0000 7f6270c00640 1 --2- 172.21.15.137:0/574191212 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6254068380 0x7f625406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:25.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.058+0000 7f6270c00640 1 -- 172.21.15.137:0/574191212 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f626c0860e0 con 0x7f627415fe30 2024-04-26T23:41:25.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.058+0000 7f6279000640 1 --2- 172.21.15.137:0/574191212 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6254068380 0x7f625406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:25.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.058+0000 7f6279000640 1 --2- 172.21.15.137:0/574191212 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6254068380 0x7f625406a840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f626800ba10 tx=0x7f6268008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:25.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.062+0000 7f6270c00640 1 -- 172.21.15.137:0/574191212 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f626c056600 con 0x7f627415fe30 2024-04-26T23:41:25.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:25.258+0000 7f627ba00640 1 -- 172.21.15.137:0/574191212 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f627406d410 con 0x7f627415fe30 2024-04-26T23:41:26.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.206+0000 7f6270c00640 1 -- 172.21.15.137:0/574191212 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f626c055f00 con 0x7f627415fe30 2024-04-26T23:41:26.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.210+0000 7f627ba00640 1 -- 172.21.15.137:0/574191212 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6254068380 msgr2=0x7f625406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:26.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.210+0000 7f627ba00640 1 --2- 172.21.15.137:0/574191212 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6254068380 0x7f625406a840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f626800ba10 tx=0x7f6268008040 comp rx=0 tx=0).stop 2024-04-26T23:41:26.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.210+0000 7f627ba00640 1 -- 172.21.15.137:0/574191212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f627415fe30 msgr2=0x7f6274156930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:26.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.210+0000 7f627ba00640 1 --2- 172.21.15.137:0/574191212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f627415fe30 0x7f6274156930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f626c001570 tx=0x7f626c00cca0 comp rx=0 tx=0).stop 2024-04-26T23:41:26.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.210+0000 7f627ba00640 1 -- 172.21.15.137:0/574191212 shutdown_connections 2024-04-26T23:41:26.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.210+0000 7f627ba00640 1 --2- 172.21.15.137:0/574191212 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6254068380 0x7f625406a840 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:26.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.210+0000 7f627ba00640 1 --2- 172.21.15.137:0/574191212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f627415fe30 0x7f6274156930 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:26.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.210+0000 7f627ba00640 1 --2- 172.21.15.137:0/574191212 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62740cd710 0x7f627415b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:26.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.210+0000 7f627ba00640 1 --2- 172.21.15.137:0/574191212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62740b54e0 0x7f6274138950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:26.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.210+0000 7f627ba00640 1 -- 172.21.15.137:0/574191212 >> 172.21.15.137:0/574191212 conn(0x7f627406c800 msgr2=0x7f627415e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:26.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.210+0000 7f627ba00640 1 -- 172.21.15.137:0/574191212 shutdown_connections 2024-04-26T23:41:26.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.210+0000 7f627ba00640 1 -- 172.21.15.137:0/574191212 wait complete. 2024-04-26T23:41:26.239 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T23:41:26.240 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T23:41:26.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.374+0000 7f4883e00640 1 Processor -- start 2024-04-26T23:41:26.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.374+0000 7f4883e00640 1 -- start start 2024-04-26T23:41:26.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.374+0000 7f4883e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f487c152510 0x7f487c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:26.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.374+0000 7f4883e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f487c0ceb00 0x7f487c06f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:26.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.374+0000 7f4883e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f487c15baf0 con 0x7f487c0738d0 2024-04-26T23:41:26.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.374+0000 7f4883e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f487c15bdb0 con 0x7f487c0ceb00 2024-04-26T23:41:26.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.374+0000 7f4883e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f487c15c090 con 0x7f487c152510 2024-04-26T23:41:26.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.378+0000 7f4880a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f487c0ceb00 0x7f487c06f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:26.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.378+0000 7f4880a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f487c0ceb00 0x7f487c06f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:35674/0 (socket says 172.21.15.137:35674) 2024-04-26T23:41:26.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.378+0000 7f4881e00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f487c0738d0 0x7f487c073d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:50182/0 (socket says 172.21.15.137:50182) 2024-04-26T23:41:26.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.378+0000 7f4880a00640 1 -- 172.21.15.137:0/4084322320 learned_addr learned my addr 172.21.15.137:0/4084322320 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:26.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.378+0000 7f4881400640 1 --2- 172.21.15.137:0/4084322320 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f487c152510 0x7f487c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:26.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.378+0000 7f4880a00640 1 -- 172.21.15.137:0/4084322320 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f487c152510 msgr2=0x7f487c06ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:26.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.378+0000 7f4880a00640 1 --2- 172.21.15.137:0/4084322320 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f487c152510 0x7f487c06ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:26.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.378+0000 7f4880a00640 1 -- 172.21.15.137:0/4084322320 >> v1:172.21.15.170:6789/0 conn(0x7f487c0738d0 legacy=0x7f487c073d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:26.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.378+0000 7f4880a00640 1 -- 172.21.15.137:0/4084322320 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487c15c370 con 0x7f487c0ceb00 2024-04-26T23:41:26.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.378+0000 7f4880a00640 1 --2- 172.21.15.137:0/4084322320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f487c0ceb00 0x7f487c06f4a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4868009870 tx=0x7f486801e6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7384554a1c2073c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:26.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.382+0000 7f487be00640 1 -- 172.21.15.137:0/4084322320 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48680b2600 con 0x7f487c0ceb00 2024-04-26T23:41:26.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.382+0000 7f487be00640 1 -- 172.21.15.137:0/4084322320 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48680b27a0 con 0x7f487c0ceb00 2024-04-26T23:41:26.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.382+0000 7f487be00640 1 -- 172.21.15.137:0/4084322320 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48680b2b70 con 0x7f487c0ceb00 2024-04-26T23:41:26.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.382+0000 7f4883e00640 1 -- 172.21.15.137:0/4084322320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f487c0ceb00 msgr2=0x7f487c06f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:26.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.382+0000 7f4883e00640 1 --2- 172.21.15.137:0/4084322320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f487c0ceb00 0x7f487c06f4a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4868009870 tx=0x7f486801e6b0 comp rx=0 tx=0).stop 2024-04-26T23:41:26.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.382+0000 7f4883e00640 1 -- 172.21.15.137:0/4084322320 shutdown_connections 2024-04-26T23:41:26.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.382+0000 7f4883e00640 1 --2- 172.21.15.137:0/4084322320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f487c0ceb00 0x7f487c06f4a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:26.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.382+0000 7f4883e00640 1 --2- 172.21.15.137:0/4084322320 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f487c152510 0x7f487c06ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:26.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.382+0000 7f4883e00640 1 -- 172.21.15.137:0/4084322320 >> 172.21.15.137:0/4084322320 conn(0x7f487c06c800 msgr2=0x7f487c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:26.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.382+0000 7f4883e00640 1 -- 172.21.15.137:0/4084322320 shutdown_connections 2024-04-26T23:41:26.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.382+0000 7f4883e00640 1 -- 172.21.15.137:0/4084322320 wait complete. 2024-04-26T23:41:26.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.382+0000 7f4883e00640 1 Processor -- start 2024-04-26T23:41:26.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.382+0000 7f4883e00640 1 -- start start 2024-04-26T23:41:26.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.382+0000 7f4883e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f487c0738d0 0x7f487c14b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:26.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.382+0000 7f4883e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f487c152510 0x7f487c14c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:26.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.382+0000 7f4883e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f487c14c940 0x7f487c1512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:26.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.382+0000 7f4883e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f487c0b4120 con 0x7f487c0738d0 2024-04-26T23:41:26.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.382+0000 7f4883e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f487c0b3fa0 con 0x7f487c152510 2024-04-26T23:41:26.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.382+0000 7f4883e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f487c0b42a0 con 0x7f487c14c940 2024-04-26T23:41:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.382+0000 7f4881400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f487c0738d0 0x7f487c14b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.386+0000 7f4881400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f487c0738d0 0x7f487c14b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33712/0 (socket says 172.21.15.137:33712) 2024-04-26T23:41:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.386+0000 7f4881400640 1 -- 172.21.15.137:0/1089038415 learned_addr learned my addr 172.21.15.137:0/1089038415 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.386+0000 7f4881e00640 1 --2- 172.21.15.137:0/1089038415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f487c14c940 0x7f487c1512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.386+0000 7f4880a00640 1 --2- 172.21.15.137:0/1089038415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f487c152510 0x7f487c14c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.386+0000 7f4881400640 1 -- 172.21.15.137:0/1089038415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f487c14c940 msgr2=0x7f487c1512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.386+0000 7f4881400640 1 --2- 172.21.15.137:0/1089038415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f487c14c940 0x7f487c1512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.386+0000 7f4881400640 1 -- 172.21.15.137:0/1089038415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f487c152510 msgr2=0x7f487c14c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.386+0000 7f4881400640 1 --2- 172.21.15.137:0/1089038415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f487c152510 0x7f487c14c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.386+0000 7f4881400640 1 -- 172.21.15.137:0/1089038415 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487c14b850 con 0x7f487c0738d0 2024-04-26T23:41:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.386+0000 7f4881e00640 1 --2- 172.21.15.137:0/1089038415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f487c14c940 0x7f487c1512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.386+0000 7f4881400640 1 --2- 172.21.15.137:0/1089038415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f487c0738d0 0x7f487c14b310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f487000efc0 tx=0x7f487000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.386+0000 7f4879600640 1 -- 172.21.15.137:0/1089038415 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4870018020 con 0x7f487c0738d0 2024-04-26T23:41:26.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.386+0000 7f4879600640 1 -- 172.21.15.137:0/1089038415 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4870014480 con 0x7f487c0738d0 2024-04-26T23:41:26.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.386+0000 7f4879600640 1 -- 172.21.15.137:0/1089038415 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4870014850 con 0x7f487c0738d0 2024-04-26T23:41:26.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.386+0000 7f4883e00640 1 -- 172.21.15.137:0/1089038415 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f487c14d2d0 con 0x7f487c0738d0 2024-04-26T23:41:26.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.386+0000 7f4883e00640 1 -- 172.21.15.137:0/1089038415 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f487c14d890 con 0x7f487c0738d0 2024-04-26T23:41:26.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.386+0000 7f4883e00640 1 -- 172.21.15.137:0/1089038415 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f487c06a410 con 0x7f487c0738d0 2024-04-26T23:41:26.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.386+0000 7f4879600640 1 -- 172.21.15.137:0/1089038415 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f487001b020 con 0x7f487c0738d0 2024-04-26T23:41:26.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.390+0000 7f4879600640 1 --2- 172.21.15.137:0/1089038415 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f485c068380 0x7f485c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:26.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.390+0000 7f4879600640 1 -- 172.21.15.137:0/1089038415 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f48700873b0 con 0x7f487c0738d0 2024-04-26T23:41:26.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.390+0000 7f4880a00640 1 --2- 172.21.15.137:0/1089038415 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f485c068380 0x7f485c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:26.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.390+0000 7f4880a00640 1 --2- 172.21.15.137:0/1089038415 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f485c068380 0x7f485c06a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f48680b1000 tx=0x7f48680a9000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:26.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.394+0000 7f4879600640 1 -- 172.21.15.137:0/1089038415 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4870022070 con 0x7f487c0738d0 2024-04-26T23:41:26.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:26.586+0000 7f4883e00640 1 -- 172.21.15.137:0/1089038415 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f487c06cef0 con 0x7f487c0738d0 2024-04-26T23:41:27.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.210+0000 7f4879600640 1 -- 172.21.15.137:0/1089038415 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f4870010040 con 0x7f487c0738d0 2024-04-26T23:41:27.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.210+0000 7f4883e00640 1 -- 172.21.15.137:0/1089038415 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f485c068380 msgr2=0x7f485c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:27.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.210+0000 7f4883e00640 1 --2- 172.21.15.137:0/1089038415 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f485c068380 0x7f485c06a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f48680b1000 tx=0x7f48680a9000 comp rx=0 tx=0).stop 2024-04-26T23:41:27.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.210+0000 7f4883e00640 1 -- 172.21.15.137:0/1089038415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f487c0738d0 msgr2=0x7f487c14b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:27.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.210+0000 7f4883e00640 1 --2- 172.21.15.137:0/1089038415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f487c0738d0 0x7f487c14b310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f487000efc0 tx=0x7f487000c490 comp rx=0 tx=0).stop 2024-04-26T23:41:27.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.210+0000 7f4883e00640 1 -- 172.21.15.137:0/1089038415 shutdown_connections 2024-04-26T23:41:27.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.210+0000 7f4883e00640 1 --2- 172.21.15.137:0/1089038415 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f485c068380 0x7f485c06a840 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.210+0000 7f4883e00640 1 --2- 172.21.15.137:0/1089038415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f487c14c940 0x7f487c1512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.210+0000 7f4883e00640 1 --2- 172.21.15.137:0/1089038415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f487c152510 0x7f487c14c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.210+0000 7f4883e00640 1 --2- 172.21.15.137:0/1089038415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f487c0738d0 0x7f487c14b310 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.210+0000 7f4883e00640 1 -- 172.21.15.137:0/1089038415 >> 172.21.15.137:0/1089038415 conn(0x7f487c06c800 msgr2=0x7f487c0b4730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:27.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.210+0000 7f4883e00640 1 -- 172.21.15.137:0/1089038415 shutdown_connections 2024-04-26T23:41:27.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.210+0000 7f4883e00640 1 -- 172.21.15.137:0/1089038415 wait complete. 2024-04-26T23:41:27.240 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T23:41:27.240 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:41:27.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.370+0000 7f22bc200640 1 Processor -- start 2024-04-26T23:41:27.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.370+0000 7f22bc200640 1 -- start start 2024-04-26T23:41:27.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.370+0000 7f22bc200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22b40b5080 0x7f22b40cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:27.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.370+0000 7f22bc200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f22b4072980 0x7f22b4072e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:27.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.370+0000 7f22bc200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22b40cfef0 con 0x7f22b40725a0 2024-04-26T23:41:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.370+0000 7f22bc200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f22b40cddc0 con 0x7f22b4072980 2024-04-26T23:41:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.370+0000 7f22bc200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f22b40d01b0 con 0x7f22b40b5080 2024-04-26T23:41:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.370+0000 7f22b9800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f22b40725a0 0x7f22b4073f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46016/0 (socket says 172.21.15.137:46016) 2024-04-26T23:41:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.370+0000 7f22b9800640 1 -- 172.21.15.137:0/2024847320 learned_addr learned my addr 172.21.15.137:0/2024847320 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.370+0000 7f22ba200640 1 --2- 172.21.15.137:0/2024847320 >> v2:172.21.15.170:3300/0 conn(0x7f22b4072980 0x7f22b4072e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.370+0000 7f22b8e00640 1 --2- 172.21.15.137:0/2024847320 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22b40b5080 0x7f22b40cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b3e00640 1 -- 172.21.15.137:0/2024847320 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3236629390 0 0) 0x7f22b40cfef0 con 0x7f22b40725a0 2024-04-26T23:41:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b3e00640 1 -- 172.21.15.137:0/2024847320 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f229c003530 con 0x7f22b40725a0 2024-04-26T23:41:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b3e00640 1 -- 172.21.15.137:0/2024847320 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1042949780 0 0) 0x7f229c003530 con 0x7f22b40725a0 2024-04-26T23:41:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b3e00640 1 -- 172.21.15.137:0/2024847320 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22b40b5080 msgr2=0x7f22b40cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b3e00640 1 --2- 172.21.15.137:0/2024847320 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22b40b5080 0x7f22b40cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b3e00640 1 -- 172.21.15.137:0/2024847320 >> v2:172.21.15.170:3300/0 conn(0x7f22b4072980 msgr2=0x7f22b4072e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b3e00640 1 --2- 172.21.15.137:0/2024847320 >> v2:172.21.15.170:3300/0 conn(0x7f22b4072980 0x7f22b4072e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b3e00640 1 -- 172.21.15.137:0/2024847320 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b40d0490 con 0x7f22b40725a0 2024-04-26T23:41:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b3e00640 1 -- 172.21.15.137:0/2024847320 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f22a8001a00 con 0x7f22b40725a0 2024-04-26T23:41:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b3e00640 1 -- 172.21.15.137:0/2024847320 >> v1:172.21.15.137:6789/0 conn(0x7f22b40725a0 legacy=0x7f22b4073f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b3e00640 1 --2- 172.21.15.137:0/2024847320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f229c0039c0 0x7f229c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b3e00640 1 --2- 172.21.15.137:0/2024847320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f229c004810 0x7f229c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b3e00640 1 --2- 172.21.15.137:0/2024847320 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22b40b5080 0x7f229c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b3e00640 1 -- 172.21.15.137:0/2024847320 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f22b40cddc0 con 0x7f229c0039c0 2024-04-26T23:41:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b3e00640 1 -- 172.21.15.137:0/2024847320 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f22b40d01b0 con 0x7f229c004810 2024-04-26T23:41:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b3e00640 1 -- 172.21.15.137:0/2024847320 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f229c00b9d0 con 0x7f22b40b5080 2024-04-26T23:41:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b9800640 1 --2- 172.21.15.137:0/2024847320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f229c0039c0 0x7f229c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b8e00640 1 --2- 172.21.15.137:0/2024847320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f229c004810 0x7f229c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22ba200640 1 --2- 172.21.15.137:0/2024847320 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22b40b5080 0x7f229c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b9800640 1 -- 172.21.15.137:0/2024847320 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22b40b5080 msgr2=0x7f229c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b9800640 1 --2- 172.21.15.137:0/2024847320 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22b40b5080 0x7f229c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b9800640 1 -- 172.21.15.137:0/2024847320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f229c004810 msgr2=0x7f229c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b9800640 1 --2- 172.21.15.137:0/2024847320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f229c004810 0x7f229c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.374+0000 7f22b9800640 1 -- 172.21.15.137:0/2024847320 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f229c003530 con 0x7f229c0039c0 2024-04-26T23:41:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22b9800640 1 --2- 172.21.15.137:0/2024847320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f229c0039c0 0x7f229c003de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f22a800a880 tx=0x7f22a801d370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6868227af7c09be5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22b3e00640 1 -- 172.21.15.137:0/2024847320 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a800a4a0 con 0x7f229c0039c0 2024-04-26T23:41:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22b3e00640 1 -- 172.21.15.137:0/2024847320 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a80ad650 con 0x7f229c0039c0 2024-04-26T23:41:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22b3e00640 1 -- 172.21.15.137:0/2024847320 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a80ada40 con 0x7f229c0039c0 2024-04-26T23:41:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22bc200640 1 -- 172.21.15.137:0/2024847320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f229c0039c0 msgr2=0x7f229c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22bc200640 1 --2- 172.21.15.137:0/2024847320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f229c0039c0 0x7f229c003de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f22a800a880 tx=0x7f22a801d370 comp rx=0 tx=0).stop 2024-04-26T23:41:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22ba200640 1 -- 172.21.15.137:0/2024847320 reap_dead start 2024-04-26T23:41:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22bc200640 1 -- 172.21.15.137:0/2024847320 shutdown_connections 2024-04-26T23:41:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22bc200640 1 -- 172.21.15.137:0/2024847320 >> 172.21.15.137:0/2024847320 conn(0x7f22b406c5d0 msgr2=0x7f22b406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:27.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22bc200640 1 -- 172.21.15.137:0/2024847320 shutdown_connections 2024-04-26T23:41:27.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22bc200640 1 -- 172.21.15.137:0/2024847320 wait complete. 2024-04-26T23:41:27.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22bc200640 1 Processor -- start 2024-04-26T23:41:27.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22bc200640 1 -- start start 2024-04-26T23:41:27.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22bc200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f229c0039c0 0x7f22b415e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:27.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22bc200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22b415d870 0x7f22b415c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:27.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22bc200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22b413fd20 0x7f22b41401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:27.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22bc200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f22b41664d0 con 0x7f229c0039c0 2024-04-26T23:41:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22bc200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f22b4166350 con 0x7f22b415d870 2024-04-26T23:41:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22bc200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f22b4166650 con 0x7f22b413fd20 2024-04-26T23:41:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22b9800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f229c0039c0 0x7f22b415e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22b8e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22b415d870 0x7f22b415c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22b9800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f229c0039c0 0x7f22b415e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33734/0 (socket says 172.21.15.137:33734) 2024-04-26T23:41:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22b9800640 1 -- 172.21.15.137:0/767797533 learned_addr learned my addr 172.21.15.137:0/767797533 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.378+0000 7f22ba200640 1 --2- 172.21.15.137:0/767797533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22b413fd20 0x7f22b41401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.382+0000 7f22b8e00640 1 -- 172.21.15.137:0/767797533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22b413fd20 msgr2=0x7f22b41401d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.382+0000 7f22b8e00640 1 --2- 172.21.15.137:0/767797533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22b413fd20 0x7f22b41401d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.382+0000 7f22b8e00640 1 -- 172.21.15.137:0/767797533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f229c0039c0 msgr2=0x7f22b415e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.382+0000 7f22b8e00640 1 --2- 172.21.15.137:0/767797533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f229c0039c0 0x7f22b415e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.382+0000 7f22b8e00640 1 -- 172.21.15.137:0/767797533 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b415e820 con 0x7f22b415d870 2024-04-26T23:41:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.382+0000 7f22b9800640 1 --2- 172.21.15.137:0/767797533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f229c0039c0 0x7f22b415e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:41:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.382+0000 7f22b8e00640 1 --2- 172.21.15.137:0/767797533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22b415d870 0x7f22b415c340 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f22a0011960 tx=0x7f22a0011d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.382+0000 7f22b1600640 1 -- 172.21.15.137:0/767797533 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a0011e90 con 0x7f22b415d870 2024-04-26T23:41:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.382+0000 7f22b1600640 1 -- 172.21.15.137:0/767797533 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a000fa30 con 0x7f22b415d870 2024-04-26T23:41:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.382+0000 7f22b1600640 1 -- 172.21.15.137:0/767797533 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a000fe00 con 0x7f22b415d870 2024-04-26T23:41:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.382+0000 7f22bc200640 1 -- 172.21.15.137:0/767797533 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22b415c880 con 0x7f22b415d870 2024-04-26T23:41:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.382+0000 7f22bc200640 1 -- 172.21.15.137:0/767797533 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22b415ce00 con 0x7f22b415d870 2024-04-26T23:41:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.382+0000 7f22bc200640 1 -- 172.21.15.137:0/767797533 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22b406a4b0 con 0x7f22b415d870 2024-04-26T23:41:27.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.382+0000 7f22b1600640 1 -- 172.21.15.137:0/767797533 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f22a0012040 con 0x7f22b415d870 2024-04-26T23:41:27.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.382+0000 7f22b1600640 1 --2- 172.21.15.137:0/767797533 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2294068520 0x7f229406a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:27.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.382+0000 7f22b1600640 1 -- 172.21.15.137:0/767797533 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f22a00870c0 con 0x7f22b415d870 2024-04-26T23:41:27.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.386+0000 7f22b9800640 1 --2- 172.21.15.137:0/767797533 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2294068520 0x7f229406a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:27.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.386+0000 7f22b9800640 1 --2- 172.21.15.137:0/767797533 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2294068520 0x7f229406a9e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f22a801d3b0 tx=0x7f22b40cdcb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.390+0000 7f22b1600640 1 -- 172.21.15.137:0/767797533 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f22a0019030 con 0x7f22b415d870 2024-04-26T23:41:27.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.578+0000 7f22bc200640 1 -- 172.21.15.137:0/767797533 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22b406ced0 con 0x7f22b415d870 2024-04-26T23:41:27.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.582+0000 7f22b1600640 1 -- 172.21.15.137:0/767797533 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f22a00576f0 con 0x7f22b415d870 2024-04-26T23:41:27.587 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:27.587 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/861150521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":861150521},{"type":"v1","addr":"172.21.15.137:6836","nonce":861150521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/980246912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":980246912},{"type":"v1","addr":"172.21.15.137:6837","nonce":980246912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3288315078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3288315078},{"type":"v1","addr":"172.21.15.170:6835","nonce":3288315078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:41:23.574363+0000","modified":"2024-04-26T23:41:26.591710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6834/2444921875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2444921875},{"type":"v1","addr":"172.21.15.170:6834","nonce":2444921875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-26T23:41:27.587 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 8 2024-04-26T23:41:27.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.582+0000 7f22bc200640 1 -- 172.21.15.137:0/767797533 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2294068520 msgr2=0x7f229406a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:27.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.582+0000 7f22bc200640 1 --2- 172.21.15.137:0/767797533 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2294068520 0x7f229406a9e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f22a801d3b0 tx=0x7f22b40cdcb0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.582+0000 7f22bc200640 1 -- 172.21.15.137:0/767797533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22b415d870 msgr2=0x7f22b415c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:27.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.582+0000 7f22bc200640 1 --2- 172.21.15.137:0/767797533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22b415d870 0x7f22b415c340 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f22a0011960 tx=0x7f22a0011d60 comp rx=0 tx=0).stop 2024-04-26T23:41:27.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.582+0000 7f22bc200640 1 -- 172.21.15.137:0/767797533 shutdown_connections 2024-04-26T23:41:27.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.582+0000 7f22bc200640 1 --2- 172.21.15.137:0/767797533 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2294068520 0x7f229406a9e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.582+0000 7f22bc200640 1 --2- 172.21.15.137:0/767797533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22b413fd20 0x7f22b41401d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.582+0000 7f22bc200640 1 --2- 172.21.15.137:0/767797533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22b415d870 0x7f22b415c340 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.582+0000 7f22bc200640 1 --2- 172.21.15.137:0/767797533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f229c0039c0 0x7f22b415e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.582+0000 7f22bc200640 1 -- 172.21.15.137:0/767797533 >> 172.21.15.137:0/767797533 conn(0x7f22b406c5d0 msgr2=0x7f22b4164be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:27.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.582+0000 7f22bc200640 1 -- 172.21.15.137:0/767797533 shutdown_connections 2024-04-26T23:41:27.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.582+0000 7f22bc200640 1 -- 172.21.15.137:0/767797533 wait complete. 2024-04-26T23:41:27.608 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:27.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4461200640 1 Processor -- start 2024-04-26T23:41:27.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4461200640 1 -- start start 2024-04-26T23:41:27.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4461200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f445c15f3d0 0x7f445c0d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:27.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4461200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f445c160240 con 0x7f445c0b4100 2024-04-26T23:41:27.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4461200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f445c160520 con 0x7f445c0d2d80 2024-04-26T23:41:27.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4461200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f445c0b2960 con 0x7f445c15f3d0 2024-04-26T23:41:27.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4451400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f445c0b4100 0x7f445c15f7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46024/0 (socket says 172.21.15.137:46024) 2024-04-26T23:41:27.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4451400640 1 -- 172.21.15.137:0/1764046381 learned_addr learned my addr 172.21.15.137:0/1764046381 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:27.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4459e00640 1 --2- 172.21.15.137:0/1764046381 >> v2:172.21.15.170:3300/0 conn(0x7f445c15f3d0 0x7f445c0d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:27.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4459400640 1 -- 172.21.15.137:0/1764046381 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3820653075 0 0) 0x7f445c160240 con 0x7f445c0b4100 2024-04-26T23:41:27.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4459400640 1 -- 172.21.15.137:0/1764046381 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4440003530 con 0x7f445c0b4100 2024-04-26T23:41:27.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4459400640 1 -- 172.21.15.137:0/1764046381 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2666362745 0 0) 0x7f445c160520 con 0x7f445c0d2d80 2024-04-26T23:41:27.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4459400640 1 -- 172.21.15.137:0/1764046381 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f445c160240 con 0x7f445c0d2d80 2024-04-26T23:41:27.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4459400640 1 -- 172.21.15.137:0/1764046381 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 943705940 0 0) 0x7f4440003530 con 0x7f445c0b4100 2024-04-26T23:41:27.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4459400640 1 -- 172.21.15.137:0/1764046381 >> v2:172.21.15.170:3300/0 conn(0x7f445c15f3d0 msgr2=0x7f445c0d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:27.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4459400640 1 --2- 172.21.15.137:0/1764046381 >> v2:172.21.15.170:3300/0 conn(0x7f445c15f3d0 0x7f445c0d1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4459400640 1 -- 172.21.15.137:0/1764046381 >> v1:172.21.15.170:6789/0 conn(0x7f445c0d2d80 legacy=0x7f445c0d3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:27.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4459400640 1 -- 172.21.15.137:0/1764046381 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f445c160800 con 0x7f445c0b4100 2024-04-26T23:41:27.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4459400640 1 -- 172.21.15.137:0/1764046381 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f4444001680 con 0x7f445c0b4100 2024-04-26T23:41:27.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4459400640 1 -- 172.21.15.137:0/1764046381 >> v1:172.21.15.137:6789/0 conn(0x7f445c0b4100 legacy=0x7f445c15f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:27.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4459400640 1 --2- 172.21.15.137:0/1764046381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4440003b50 0x7f4440003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:27.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4459400640 1 --2- 172.21.15.137:0/1764046381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4440004810 0x7f4440004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:27.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4459400640 1 --2- 172.21.15.137:0/1764046381 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44400051d0 0x7f444000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:27.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4459400640 1 -- 172.21.15.137:0/1764046381 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f445c0b2960 con 0x7f4440004810 2024-04-26T23:41:27.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4459400640 1 -- 172.21.15.137:0/1764046381 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f444000c050 con 0x7f4440003b50 2024-04-26T23:41:27.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4459400640 1 -- 172.21.15.137:0/1764046381 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f444000c250 con 0x7f44400051d0 2024-04-26T23:41:27.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4451400640 1 --2- 172.21.15.137:0/1764046381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4440004810 0x7f4440004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:27.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f4459e00640 1 --2- 172.21.15.137:0/1764046381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4440003b50 0x7f4440003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:27.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.738+0000 7f445a800640 1 --2- 172.21.15.137:0/1764046381 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44400051d0 0x7f444000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:27.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.742+0000 7f4451400640 1 -- 172.21.15.137:0/1764046381 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44400051d0 msgr2=0x7f444000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:27.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.742+0000 7f4451400640 1 --2- 172.21.15.137:0/1764046381 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44400051d0 0x7f444000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.742+0000 7f4451400640 1 -- 172.21.15.137:0/1764046381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4440003b50 msgr2=0x7f4440003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:27.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.742+0000 7f4451400640 1 --2- 172.21.15.137:0/1764046381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4440003b50 0x7f4440003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.742+0000 7f4451400640 1 -- 172.21.15.137:0/1764046381 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4440003530 con 0x7f4440004810 2024-04-26T23:41:27.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.742+0000 7f445a800640 1 --2- 172.21.15.137:0/1764046381 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44400051d0 0x7f444000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:27.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.742+0000 7f445a800640 1 -- 172.21.15.137:0/1764046381 reap_dead start 2024-04-26T23:41:27.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.742+0000 7f4451400640 1 --2- 172.21.15.137:0/1764046381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4440004810 0x7f4440004c90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f444400c160 tx=0x7f444401cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c20e95798f6f14 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:27.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.742+0000 7f4459400640 1 -- 172.21.15.137:0/1764046381 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4444007cd0 con 0x7f4440004810 2024-04-26T23:41:27.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.742+0000 7f4459400640 1 -- 172.21.15.137:0/1764046381 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44440a9020 con 0x7f4440004810 2024-04-26T23:41:27.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.742+0000 7f4459400640 1 -- 172.21.15.137:0/1764046381 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4444005ae0 con 0x7f4440004810 2024-04-26T23:41:27.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.742+0000 7f4461200640 1 -- 172.21.15.137:0/1764046381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4440004810 msgr2=0x7f4440004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:27.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.742+0000 7f4461200640 1 --2- 172.21.15.137:0/1764046381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4440004810 0x7f4440004c90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f444400c160 tx=0x7f444401cbc0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.742+0000 7f4461200640 1 -- 172.21.15.137:0/1764046381 shutdown_connections 2024-04-26T23:41:27.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.742+0000 7f4461200640 1 --2- 172.21.15.137:0/1764046381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4440004810 0x7f4440004c90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.742+0000 7f4461200640 1 -- 172.21.15.137:0/1764046381 >> 172.21.15.137:0/1764046381 conn(0x7f445c09ba60 msgr2=0x7f445c09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:27.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.742+0000 7f4461200640 1 -- 172.21.15.137:0/1764046381 shutdown_connections 2024-04-26T23:41:27.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.742+0000 7f4461200640 1 -- 172.21.15.137:0/1764046381 wait complete. 2024-04-26T23:41:27.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4461200640 1 Processor -- start 2024-04-26T23:41:27.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4461200640 1 -- start start 2024-04-26T23:41:27.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4461200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4440004810 0x7f445c14b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:27.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4461200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f445c14be90 0x7f445c15d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:27.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4461200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f445c149210 0x7f445c15a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:27.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4461200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f445c0d13c0 con 0x7f445c14be90 2024-04-26T23:41:27.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4461200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f445c0d1240 con 0x7f4440004810 2024-04-26T23:41:27.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4461200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f445c0d3180 con 0x7f445c149210 2024-04-26T23:41:27.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4451400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f445c14be90 0x7f445c15d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:27.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4451400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f445c14be90 0x7f445c15d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33746/0 (socket says 172.21.15.137:33746) 2024-04-26T23:41:27.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4451400640 1 -- 172.21.15.137:0/1082359312 learned_addr learned my addr 172.21.15.137:0/1082359312 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:27.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4459e00640 1 --2- 172.21.15.137:0/1082359312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4440004810 0x7f445c14b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:27.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f445a800640 1 --2- 172.21.15.137:0/1082359312 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f445c149210 0x7f445c15a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:27.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4451400640 1 -- 172.21.15.137:0/1082359312 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f445c149210 msgr2=0x7f445c15a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:27.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4451400640 1 --2- 172.21.15.137:0/1082359312 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f445c149210 0x7f445c15a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4451400640 1 -- 172.21.15.137:0/1082359312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4440004810 msgr2=0x7f445c14b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:27.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4451400640 1 --2- 172.21.15.137:0/1082359312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4440004810 0x7f445c14b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4451400640 1 -- 172.21.15.137:0/1082359312 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f445c15dc70 con 0x7f445c14be90 2024-04-26T23:41:27.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4459e00640 1 --2- 172.21.15.137:0/1082359312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4440004810 0x7f445c14b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:27.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f445a800640 1 --2- 172.21.15.137:0/1082359312 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f445c149210 0x7f445c15a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:27.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4451400640 1 --2- 172.21.15.137:0/1082359312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f445c14be90 0x7f445c15d420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f44440ab040 tx=0x7f4440005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:27.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4452a00640 1 -- 172.21.15.137:0/1082359312 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44440049f0 con 0x7f445c14be90 2024-04-26T23:41:27.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4452a00640 1 -- 172.21.15.137:0/1082359312 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4444004b90 con 0x7f445c14be90 2024-04-26T23:41:27.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4452a00640 1 -- 172.21.15.137:0/1082359312 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44440070d0 con 0x7f445c14be90 2024-04-26T23:41:27.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.746+0000 7f4461200640 1 -- 172.21.15.137:0/1082359312 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f445c0c79f0 con 0x7f445c14be90 2024-04-26T23:41:27.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.750+0000 7f4461200640 1 -- 172.21.15.137:0/1082359312 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f445c0c7fb0 con 0x7f445c14be90 2024-04-26T23:41:27.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.750+0000 7f4461200640 1 -- 172.21.15.137:0/1082359312 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f445c06a4b0 con 0x7f445c14be90 2024-04-26T23:41:27.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.750+0000 7f4452a00640 1 -- 172.21.15.137:0/1082359312 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f44440bd060 con 0x7f445c14be90 2024-04-26T23:41:27.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.750+0000 7f4452a00640 1 --2- 172.21.15.137:0/1082359312 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4438068380 0x7f443806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:27.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.750+0000 7f4452a00640 1 -- 172.21.15.137:0/1082359312 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4444120050 con 0x7f445c14be90 2024-04-26T23:41:27.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.750+0000 7f4459e00640 1 --2- 172.21.15.137:0/1082359312 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4438068380 0x7f443806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:27.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.750+0000 7f4459e00640 1 --2- 172.21.15.137:0/1082359312 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4438068380 0x7f443806a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f444c006d50 tx=0x7f444c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:27.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.754+0000 7f4452a00640 1 -- 172.21.15.137:0/1082359312 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f44440168d0 con 0x7f445c14be90 2024-04-26T23:41:27.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.914+0000 7f4461200640 1 -- 172.21.15.137:0/1082359312 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f445c0b24f0 con 0x7f445c14be90 2024-04-26T23:41:27.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.914+0000 7f4452a00640 1 -- 172.21.15.137:0/1082359312 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16653 (secure 0 0 0) 0x7f44440f0600 con 0x7f445c14be90 2024-04-26T23:41:27.921 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:27.921 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:25.186308+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.918+0000 7f4461200640 1 -- 172.21.15.137:0/1082359312 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4438068380 msgr2=0x7f443806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.918+0000 7f4461200640 1 --2- 172.21.15.137:0/1082359312 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4438068380 0x7f443806a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f444c006d50 tx=0x7f444c008040 comp rx=0 tx=0).stop 2024-04-26T23:41:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.918+0000 7f4461200640 1 -- 172.21.15.137:0/1082359312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f445c14be90 msgr2=0x7f445c15d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.918+0000 7f4461200640 1 --2- 172.21.15.137:0/1082359312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f445c14be90 0x7f445c15d420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f44440ab040 tx=0x7f4440005840 comp rx=0 tx=0).stop 2024-04-26T23:41:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.918+0000 7f4461200640 1 -- 172.21.15.137:0/1082359312 shutdown_connections 2024-04-26T23:41:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.918+0000 7f4461200640 1 --2- 172.21.15.137:0/1082359312 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4438068380 0x7f443806a840 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.918+0000 7f4461200640 1 --2- 172.21.15.137:0/1082359312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f445c14be90 0x7f445c15d420 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.918+0000 7f4461200640 1 --2- 172.21.15.137:0/1082359312 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f445c149210 0x7f445c15a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.918+0000 7f4461200640 1 --2- 172.21.15.137:0/1082359312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4440004810 0x7f445c14b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.918+0000 7f4461200640 1 -- 172.21.15.137:0/1082359312 >> 172.21.15.137:0/1082359312 conn(0x7f445c09ba60 msgr2=0x7f445c070250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.918+0000 7f4461200640 1 -- 172.21.15.137:0/1082359312 shutdown_connections 2024-04-26T23:41:27.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:27.918+0000 7f4461200640 1 -- 172.21.15.137:0/1082359312 wait complete. 2024-04-26T23:41:27.942 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T23:41:27.943 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:41:28.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.070+0000 7f3034000640 1 Processor -- start 2024-04-26T23:41:28.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.070+0000 7f3034000640 1 -- start start 2024-04-26T23:41:28.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.074+0000 7f3034000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f302c15de80 0x7f302c073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:28.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.074+0000 7f3034000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f302c0ce7c0 0x7f302c146210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:28.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.074+0000 7f3034000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f302c073010 con 0x7f302c0ce3e0 2024-04-26T23:41:28.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.074+0000 7f3034000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f302c0cef90 con 0x7f302c0ce7c0 2024-04-26T23:41:28.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.074+0000 7f3034000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f302c073280 con 0x7f302c15de80 2024-04-26T23:41:28.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.074+0000 7f3031600640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f302c0ce3e0 0x7f302c0d04e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46026/0 (socket says 172.21.15.137:46026) 2024-04-26T23:41:28.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.074+0000 7f3032000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f302c0ce7c0 0x7f302c146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:28.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.074+0000 7f3031600640 1 -- 172.21.15.137:0/243961714 learned_addr learned my addr 172.21.15.137:0/243961714 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:28.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.074+0000 7f3030c00640 1 --2- 172.21.15.137:0/243961714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f302c15de80 0x7f302c073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:28.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.074+0000 7f3032000640 1 -- 172.21.15.137:0/243961714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f302c15de80 msgr2=0x7f302c073d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:28.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.074+0000 7f3032000640 1 --2- 172.21.15.137:0/243961714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f302c15de80 0x7f302c073d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.074+0000 7f3032000640 1 -- 172.21.15.137:0/243961714 >> v1:172.21.15.137:6789/0 conn(0x7f302c0ce3e0 legacy=0x7f302c0d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:28.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.074+0000 7f3032000640 1 -- 172.21.15.137:0/243961714 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302c073560 con 0x7f302c0ce7c0 2024-04-26T23:41:28.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.074+0000 7f302be00640 1 -- 172.21.15.137:0/243961714 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1628319307 0 0) 0x7f302c073010 con 0x7f302c0ce3e0 2024-04-26T23:41:28.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.074+0000 7f3030c00640 1 --2- 172.21.15.137:0/243961714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f302c15de80 0x7f302c073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:28.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.078+0000 7f3032000640 1 --2- 172.21.15.137:0/243961714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f302c0ce7c0 0x7f302c146210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f30240097c0 tx=0x7f302401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d963dd18f10523b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:28.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.078+0000 7f302be00640 1 -- 172.21.15.137:0/243961714 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30240b2070 con 0x7f302c0ce7c0 2024-04-26T23:41:28.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.078+0000 7f302be00640 1 -- 172.21.15.137:0/243961714 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30240ad680 con 0x7f302c0ce7c0 2024-04-26T23:41:28.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.078+0000 7f302be00640 1 -- 172.21.15.137:0/243961714 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30240ada50 con 0x7f302c0ce7c0 2024-04-26T23:41:28.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.078+0000 7f3034000640 1 -- 172.21.15.137:0/243961714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f302c0ce7c0 msgr2=0x7f302c146210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:28.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.078+0000 7f3034000640 1 --2- 172.21.15.137:0/243961714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f302c0ce7c0 0x7f302c146210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f30240097c0 tx=0x7f302401c470 comp rx=0 tx=0).stop 2024-04-26T23:41:28.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.078+0000 7f3034000640 1 -- 172.21.15.137:0/243961714 shutdown_connections 2024-04-26T23:41:28.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.078+0000 7f3034000640 1 --2- 172.21.15.137:0/243961714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f302c0ce7c0 0x7f302c146210 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.078+0000 7f3034000640 1 --2- 172.21.15.137:0/243961714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f302c15de80 0x7f302c073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.078+0000 7f3034000640 1 -- 172.21.15.137:0/243961714 >> 172.21.15.137:0/243961714 conn(0x7f302c06c5d0 msgr2=0x7f302c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:28.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.078+0000 7f3034000640 1 -- 172.21.15.137:0/243961714 shutdown_connections 2024-04-26T23:41:28.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.078+0000 7f3034000640 1 -- 172.21.15.137:0/243961714 wait complete. 2024-04-26T23:41:28.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.078+0000 7f3034000640 1 Processor -- start 2024-04-26T23:41:28.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.078+0000 7f3034000640 1 -- start start 2024-04-26T23:41:28.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3034000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f302c0ce3e0 0x7f302c15c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:28.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3034000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f302c0ce7c0 0x7f302c15a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:28.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3034000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f302c15de80 0x7f302c15ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:28.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3034000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f302c06f0a0 con 0x7f302c15de80 2024-04-26T23:41:28.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3034000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f302c06ef20 con 0x7f302c0ce3e0 2024-04-26T23:41:28.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3034000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f302c06f220 con 0x7f302c0ce7c0 2024-04-26T23:41:28.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3032000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f302c15de80 0x7f302c15ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:28.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3032000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f302c15de80 0x7f302c15ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33770/0 (socket says 172.21.15.137:33770) 2024-04-26T23:41:28.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3032000640 1 -- 172.21.15.137:0/3169994345 learned_addr learned my addr 172.21.15.137:0/3169994345 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:28.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3031600640 1 --2- 172.21.15.137:0/3169994345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f302c0ce3e0 0x7f302c15c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:28.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3032000640 1 -- 172.21.15.137:0/3169994345 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f302c0ce7c0 msgr2=0x7f302c15a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:28.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3030c00640 1 --2- 172.21.15.137:0/3169994345 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f302c0ce7c0 0x7f302c15a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:28.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3032000640 1 --2- 172.21.15.137:0/3169994345 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f302c0ce7c0 0x7f302c15a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3032000640 1 -- 172.21.15.137:0/3169994345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f302c0ce3e0 msgr2=0x7f302c15c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:28.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3032000640 1 --2- 172.21.15.137:0/3169994345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f302c0ce3e0 0x7f302c15c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3032000640 1 -- 172.21.15.137:0/3169994345 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302c164710 con 0x7f302c15de80 2024-04-26T23:41:28.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3031600640 1 --2- 172.21.15.137:0/3169994345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f302c0ce3e0 0x7f302c15c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:28.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3030c00640 1 --2- 172.21.15.137:0/3169994345 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f302c0ce7c0 0x7f302c15a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:28.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3032000640 1 --2- 172.21.15.137:0/3169994345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f302c15de80 0x7f302c15ab40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f302401a0a0 tx=0x7f302401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:28.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3029600640 1 -- 172.21.15.137:0/3169994345 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30240b2040 con 0x7f302c15de80 2024-04-26T23:41:28.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3029600640 1 -- 172.21.15.137:0/3169994345 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30240bd070 con 0x7f302c15de80 2024-04-26T23:41:28.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3029600640 1 -- 172.21.15.137:0/3169994345 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30240ade10 con 0x7f302c15de80 2024-04-26T23:41:28.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3034000640 1 -- 172.21.15.137:0/3169994345 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f302c13e6f0 con 0x7f302c15de80 2024-04-26T23:41:28.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3034000640 1 -- 172.21.15.137:0/3169994345 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f302c140210 con 0x7f302c15de80 2024-04-26T23:41:28.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3034000640 1 -- 172.21.15.137:0/3169994345 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f302c06a4b0 con 0x7f302c15de80 2024-04-26T23:41:28.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.082+0000 7f3029600640 1 -- 172.21.15.137:0/3169994345 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f30240c2460 con 0x7f302c15de80 2024-04-26T23:41:28.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.086+0000 7f3029600640 1 --2- 172.21.15.137:0/3169994345 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f300c0683b0 0x7f300c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:28.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.086+0000 7f3029600640 1 -- 172.21.15.137:0/3169994345 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3024120da0 con 0x7f302c15de80 2024-04-26T23:41:28.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.086+0000 7f3031600640 1 --2- 172.21.15.137:0/3169994345 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f300c0683b0 0x7f300c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:28.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.086+0000 7f3031600640 1 --2- 172.21.15.137:0/3169994345 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f300c0683b0 0x7f300c06a870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3020007fd0 tx=0x7f3020009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:28.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.090+0000 7f3029600640 1 -- 172.21.15.137:0/3169994345 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f302c164710 con 0x7f302c15de80 2024-04-26T23:41:28.167 INFO:tasks.ceph.mds.d.smithi170.stderr:2024-04-26T23:41:28.162+0000 7fdfa6a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:41:28.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.246+0000 7f3034000640 1 -- 172.21.15.137:0/3169994345 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f302c15b080 con 0x7f300c0683b0 2024-04-26T23:41:28.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.254+0000 7f3029600640 1 -- 172.21.15.137:0/3169994345 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251920 (secure 0 0 0) 0x7f302c15b080 con 0x7f300c0683b0 2024-04-26T23:41:28.261 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:28.265 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T23:41:28.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.258+0000 7f3034000640 1 -- 172.21.15.137:0/3169994345 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f300c0683b0 msgr2=0x7f300c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:28.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.258+0000 7f3034000640 1 --2- 172.21.15.137:0/3169994345 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f300c0683b0 0x7f300c06a870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3020007fd0 tx=0x7f3020009040 comp rx=0 tx=0).stop 2024-04-26T23:41:28.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.258+0000 7f3034000640 1 -- 172.21.15.137:0/3169994345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f302c15de80 msgr2=0x7f302c15ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:28.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.258+0000 7f3034000640 1 --2- 172.21.15.137:0/3169994345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f302c15de80 0x7f302c15ab40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f302401a0a0 tx=0x7f302401acb0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.258+0000 7f3034000640 1 -- 172.21.15.137:0/3169994345 shutdown_connections 2024-04-26T23:41:28.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.258+0000 7f3034000640 1 --2- 172.21.15.137:0/3169994345 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f300c0683b0 0x7f300c06a870 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.258+0000 7f3034000640 1 --2- 172.21.15.137:0/3169994345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f302c15de80 0x7f302c15ab40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.258+0000 7f3034000640 1 --2- 172.21.15.137:0/3169994345 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f302c0ce7c0 0x7f302c15a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.258+0000 7f3034000640 1 --2- 172.21.15.137:0/3169994345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f302c0ce3e0 0x7f302c15c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.258+0000 7f3034000640 1 -- 172.21.15.137:0/3169994345 >> 172.21.15.137:0/3169994345 conn(0x7f302c06c5d0 msgr2=0x7f302c0b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:28.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.258+0000 7f3034000640 1 -- 172.21.15.137:0/3169994345 shutdown_connections 2024-04-26T23:41:28.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.258+0000 7f3034000640 1 -- 172.21.15.137:0/3169994345 wait complete. 2024-04-26T23:41:28.283 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-26T23:41:27.589983+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235540,"kb_used_data":2728,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739180,"statfs":{"total":773094113280,"available":772852920320,"internally_reserved":0,"allocated":2793472,"data_stored":1702628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.412786"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.229920+0000","last_change":"2024-04-26T23:41:24.226081+0000","last_active":"2024-04-26T23:41:24.229920+0000","last_peered":"2024-04-26T23:41:24.229920+0000","last_clean":"2024-04-26T23:41:24.229920+0000","last_became_active":"2024-04-26T23:41:24.224081+0000","last_became_peered":"2024-04-26T23:41:24.224081+0000","last_unstale":"2024-04-26T23:41:24.229920+0000","last_undegraded":"2024-04-26T23:41:24.229920+0000","last_fullsized":"2024-04-26T23:41:24.229920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:21.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192782+0000","last_change":"2024-04-26T23:41:24.215201+0000","last_active":"2024-04-26T23:41:25.192782+0000","last_peered":"2024-04-26T23:41:25.192782+0000","last_clean":"2024-04-26T23:41:25.192782+0000","last_became_active":"2024-04-26T23:41:24.214743+0000","last_became_peered":"2024-04-26T23:41:24.214743+0000","last_unstale":"2024-04-26T23:41:25.192782+0000","last_undegraded":"2024-04-26T23:41:25.192782+0000","last_fullsized":"2024-04-26T23:41:25.192782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:44.639875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.218893+0000","last_change":"2024-04-26T23:41:24.213419+0000","last_active":"2024-04-26T23:41:24.218893+0000","last_peered":"2024-04-26T23:41:24.218893+0000","last_clean":"2024-04-26T23:41:24.218893+0000","last_became_active":"2024-04-26T23:41:24.213156+0000","last_became_peered":"2024-04-26T23:41:24.213156+0000","last_unstale":"2024-04-26T23:41:24.218893+0000","last_undegraded":"2024-04-26T23:41:24.218893+0000","last_fullsized":"2024-04-26T23:41:24.218893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:25.948379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190322+0000","last_change":"2024-04-26T23:41:24.210450+0000","last_active":"2024-04-26T23:41:25.190322+0000","last_peered":"2024-04-26T23:41:25.190322+0000","last_clean":"2024-04-26T23:41:25.190322+0000","last_became_active":"2024-04-26T23:41:24.209075+0000","last_became_peered":"2024-04-26T23:41:24.209075+0000","last_unstale":"2024-04-26T23:41:25.190322+0000","last_undegraded":"2024-04-26T23:41:25.190322+0000","last_fullsized":"2024-04-26T23:41:25.190322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:22:11.814233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.228517+0000","last_change":"2024-04-26T23:41:24.218615+0000","last_active":"2024-04-26T23:41:24.228517+0000","last_peered":"2024-04-26T23:41:24.228517+0000","last_clean":"2024-04-26T23:41:24.228517+0000","last_became_active":"2024-04-26T23:41:24.207757+0000","last_became_peered":"2024-04-26T23:41:24.207757+0000","last_unstale":"2024-04-26T23:41:24.228517+0000","last_undegraded":"2024-04-26T23:41:24.228517+0000","last_fullsized":"2024-04-26T23:41:24.228517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:36.344325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190989+0000","last_change":"2024-04-26T23:41:24.215319+0000","last_active":"2024-04-26T23:41:25.190989+0000","last_peered":"2024-04-26T23:41:25.190989+0000","last_clean":"2024-04-26T23:41:25.190989+0000","last_became_active":"2024-04-26T23:41:24.214101+0000","last_became_peered":"2024-04-26T23:41:24.214101+0000","last_unstale":"2024-04-26T23:41:25.190989+0000","last_undegraded":"2024-04-26T23:41:25.190989+0000","last_fullsized":"2024-04-26T23:41:25.190989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:12.164234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.228469+0000","last_change":"2024-04-26T23:41:24.218275+0000","last_active":"2024-04-26T23:41:24.228469+0000","last_peered":"2024-04-26T23:41:24.228469+0000","last_clean":"2024-04-26T23:41:24.228469+0000","last_became_active":"2024-04-26T23:41:24.217914+0000","last_became_peered":"2024-04-26T23:41:24.217914+0000","last_unstale":"2024-04-26T23:41:24.228469+0000","last_undegraded":"2024-04-26T23:41:24.228469+0000","last_fullsized":"2024-04-26T23:41:24.228469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:05:07.675269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597030+0000","last_change":"2024-04-26T23:41:24.217179+0000","last_active":"2024-04-26T23:41:25.597030+0000","last_peered":"2024-04-26T23:41:25.597030+0000","last_clean":"2024-04-26T23:41:25.597030+0000","last_became_active":"2024-04-26T23:41:24.215768+0000","last_became_peered":"2024-04-26T23:41:24.215768+0000","last_unstale":"2024-04-26T23:41:25.597030+0000","last_undegraded":"2024-04-26T23:41:25.597030+0000","last_fullsized":"2024-04-26T23:41:25.597030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:05:07.675269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.229896+0000","last_change":"2024-04-26T23:41:24.225884+0000","last_active":"2024-04-26T23:41:24.229896+0000","last_peered":"2024-04-26T23:41:24.229896+0000","last_clean":"2024-04-26T23:41:24.229896+0000","last_became_active":"2024-04-26T23:41:24.224023+0000","last_became_peered":"2024-04-26T23:41:24.224023+0000","last_unstale":"2024-04-26T23:41:24.229896+0000","last_undegraded":"2024-04-26T23:41:24.229896+0000","last_fullsized":"2024-04-26T23:41:24.229896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:44.639875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215198+0000","last_change":"2024-04-26T23:41:24.219022+0000","last_active":"2024-04-26T23:41:25.215198+0000","last_peered":"2024-04-26T23:41:25.215198+0000","last_clean":"2024-04-26T23:41:25.215198+0000","last_became_active":"2024-04-26T23:41:24.218769+0000","last_became_peered":"2024-04-26T23:41:24.218769+0000","last_unstale":"2024-04-26T23:41:25.215198+0000","last_undegraded":"2024-04-26T23:41:25.215198+0000","last_fullsized":"2024-04-26T23:41:25.215198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:21.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215175+0000","last_change":"2024-04-26T23:41:24.219493+0000","last_active":"2024-04-26T23:41:25.215175+0000","last_peered":"2024-04-26T23:41:25.215175+0000","last_clean":"2024-04-26T23:41:25.215175+0000","last_became_active":"2024-04-26T23:41:24.219227+0000","last_became_peered":"2024-04-26T23:41:24.219227+0000","last_unstale":"2024-04-26T23:41:25.215175+0000","last_undegraded":"2024-04-26T23:41:25.215175+0000","last_fullsized":"2024-04-26T23:41:25.215175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:44.639875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190908+0000","last_change":"2024-04-26T23:41:24.213018+0000","last_active":"2024-04-26T23:41:25.190908+0000","last_peered":"2024-04-26T23:41:25.190908+0000","last_clean":"2024-04-26T23:41:25.190908+0000","last_became_active":"2024-04-26T23:41:24.210261+0000","last_became_peered":"2024-04-26T23:41:24.210261+0000","last_unstale":"2024-04-26T23:41:25.190908+0000","last_undegraded":"2024-04-26T23:41:25.190908+0000","last_fullsized":"2024-04-26T23:41:25.190908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:25:35.815770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597367+0000","last_change":"2024-04-26T23:41:24.208860+0000","last_active":"2024-04-26T23:41:25.597367+0000","last_peered":"2024-04-26T23:41:25.597367+0000","last_clean":"2024-04-26T23:41:25.597367+0000","last_became_active":"2024-04-26T23:41:24.208537+0000","last_became_peered":"2024-04-26T23:41:24.208537+0000","last_unstale":"2024-04-26T23:41:25.597367+0000","last_undegraded":"2024-04-26T23:41:25.597367+0000","last_fullsized":"2024-04-26T23:41:25.597367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:49:27.834697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.215691+0000","last_change":"2024-04-26T23:41:24.212959+0000","last_active":"2024-04-26T23:41:24.215691+0000","last_peered":"2024-04-26T23:41:24.215691+0000","last_clean":"2024-04-26T23:41:24.215691+0000","last_became_active":"2024-04-26T23:41:24.208009+0000","last_became_peered":"2024-04-26T23:41:24.208009+0000","last_unstale":"2024-04-26T23:41:24.215691+0000","last_undegraded":"2024-04-26T23:41:24.215691+0000","last_fullsized":"2024-04-26T23:41:24.215691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:59.322866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192382+0000","last_change":"2024-04-26T23:41:24.202794+0000","last_active":"2024-04-26T23:41:25.192382+0000","last_peered":"2024-04-26T23:41:25.192382+0000","last_clean":"2024-04-26T23:41:25.192382+0000","last_became_active":"2024-04-26T23:41:24.202484+0000","last_became_peered":"2024-04-26T23:41:24.202484+0000","last_unstale":"2024-04-26T23:41:25.192382+0000","last_undegraded":"2024-04-26T23:41:25.192382+0000","last_fullsized":"2024-04-26T23:41:25.192382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:36.344325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.189800+0000","last_change":"2024-04-26T23:41:24.209356+0000","last_active":"2024-04-26T23:41:25.189800+0000","last_peered":"2024-04-26T23:41:25.189800+0000","last_clean":"2024-04-26T23:41:25.189800+0000","last_became_active":"2024-04-26T23:41:24.208427+0000","last_became_peered":"2024-04-26T23:41:24.208427+0000","last_unstale":"2024-04-26T23:41:25.189800+0000","last_undegraded":"2024-04-26T23:41:25.189800+0000","last_fullsized":"2024-04-26T23:41:25.189800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:21.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191177+0000","last_change":"2024-04-26T23:41:24.209097+0000","last_active":"2024-04-26T23:41:25.191177+0000","last_peered":"2024-04-26T23:41:25.191177+0000","last_clean":"2024-04-26T23:41:25.191177+0000","last_became_active":"2024-04-26T23:41:24.208802+0000","last_became_peered":"2024-04-26T23:41:24.208802+0000","last_unstale":"2024-04-26T23:41:25.191177+0000","last_undegraded":"2024-04-26T23:41:25.191177+0000","last_fullsized":"2024-04-26T23:41:25.191177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:28.775250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.214897+0000","last_change":"2024-04-26T23:41:24.209948+0000","last_active":"2024-04-26T23:41:24.214897+0000","last_peered":"2024-04-26T23:41:24.214897+0000","last_clean":"2024-04-26T23:41:24.214897+0000","last_became_active":"2024-04-26T23:41:24.209643+0000","last_became_peered":"2024-04-26T23:41:24.209643+0000","last_unstale":"2024-04-26T23:41:24.214897+0000","last_undegraded":"2024-04-26T23:41:24.214897+0000","last_fullsized":"2024-04-26T23:41:24.214897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:39.968567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.228927+0000","last_change":"2024-04-26T23:41:24.223030+0000","last_active":"2024-04-26T23:41:24.228927+0000","last_peered":"2024-04-26T23:41:24.228927+0000","last_clean":"2024-04-26T23:41:24.228927+0000","last_became_active":"2024-04-26T23:41:24.221662+0000","last_became_peered":"2024-04-26T23:41:24.221662+0000","last_unstale":"2024-04-26T23:41:24.228927+0000","last_undegraded":"2024-04-26T23:41:24.228927+0000","last_fullsized":"2024-04-26T23:41:24.228927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:50.550871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215142+0000","last_change":"2024-04-26T23:41:24.218402+0000","last_active":"2024-04-26T23:41:25.215142+0000","last_peered":"2024-04-26T23:41:25.215142+0000","last_clean":"2024-04-26T23:41:25.215142+0000","last_became_active":"2024-04-26T23:41:24.217441+0000","last_became_peered":"2024-04-26T23:41:24.217441+0000","last_unstale":"2024-04-26T23:41:25.215142+0000","last_undegraded":"2024-04-26T23:41:25.215142+0000","last_fullsized":"2024-04-26T23:41:25.215142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:49:27.834697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.219753+0000","last_change":"2024-04-26T23:41:24.209698+0000","last_active":"2024-04-26T23:41:24.219753+0000","last_peered":"2024-04-26T23:41:24.219753+0000","last_clean":"2024-04-26T23:41:24.219753+0000","last_became_active":"2024-04-26T23:41:24.208252+0000","last_became_peered":"2024-04-26T23:41:24.208252+0000","last_unstale":"2024-04-26T23:41:24.219753+0000","last_undegraded":"2024-04-26T23:41:24.219753+0000","last_fullsized":"2024-04-26T23:41:24.219753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:39.940714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191156+0000","last_change":"2024-04-26T23:41:24.223785+0000","last_active":"2024-04-26T23:41:25.191156+0000","last_peered":"2024-04-26T23:41:25.191156+0000","last_clean":"2024-04-26T23:41:25.191156+0000","last_became_active":"2024-04-26T23:41:24.223547+0000","last_became_peered":"2024-04-26T23:41:24.223547+0000","last_unstale":"2024-04-26T23:41:25.191156+0000","last_undegraded":"2024-04-26T23:41:25.191156+0000","last_fullsized":"2024-04-26T23:41:25.191156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:15.741774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597131+0000","last_change":"2024-04-26T23:41:24.204428+0000","last_active":"2024-04-26T23:41:25.597131+0000","last_peered":"2024-04-26T23:41:25.597131+0000","last_clean":"2024-04-26T23:41:25.597131+0000","last_became_active":"2024-04-26T23:41:24.203845+0000","last_became_peered":"2024-04-26T23:41:24.203845+0000","last_unstale":"2024-04-26T23:41:25.597131+0000","last_undegraded":"2024-04-26T23:41:25.597131+0000","last_fullsized":"2024-04-26T23:41:25.597131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:36.344325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.189964+0000","last_change":"2024-04-26T23:41:24.201596+0000","last_active":"2024-04-26T23:41:25.189964+0000","last_peered":"2024-04-26T23:41:25.189964+0000","last_clean":"2024-04-26T23:41:25.189964+0000","last_became_active":"2024-04-26T23:41:24.201257+0000","last_became_peered":"2024-04-26T23:41:24.201257+0000","last_unstale":"2024-04-26T23:41:25.189964+0000","last_undegraded":"2024-04-26T23:41:25.189964+0000","last_fullsized":"2024-04-26T23:41:25.189964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:10.486440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597494+0000","last_change":"2024-04-26T23:41:24.213190+0000","last_active":"2024-04-26T23:41:25.597494+0000","last_peered":"2024-04-26T23:41:25.597494+0000","last_clean":"2024-04-26T23:41:25.597494+0000","last_became_active":"2024-04-26T23:41:24.212878+0000","last_became_peered":"2024-04-26T23:41:24.212878+0000","last_unstale":"2024-04-26T23:41:25.597494+0000","last_undegraded":"2024-04-26T23:41:25.597494+0000","last_fullsized":"2024-04-26T23:41:25.597494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:21.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215267+0000","last_change":"2024-04-26T23:41:24.222681+0000","last_active":"2024-04-26T23:41:25.215267+0000","last_peered":"2024-04-26T23:41:25.215267+0000","last_clean":"2024-04-26T23:41:25.215267+0000","last_became_active":"2024-04-26T23:41:24.222435+0000","last_became_peered":"2024-04-26T23:41:24.222435+0000","last_unstale":"2024-04-26T23:41:25.215267+0000","last_undegraded":"2024-04-26T23:41:25.215267+0000","last_fullsized":"2024-04-26T23:41:25.215267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:10.486440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192815+0000","last_change":"2024-04-26T23:41:24.207533+0000","last_active":"2024-04-26T23:41:25.192815+0000","last_peered":"2024-04-26T23:41:25.192815+0000","last_clean":"2024-04-26T23:41:25.192815+0000","last_became_active":"2024-04-26T23:41:24.207267+0000","last_became_peered":"2024-04-26T23:41:24.207267+0000","last_unstale":"2024-04-26T23:41:25.192815+0000","last_undegraded":"2024-04-26T23:41:25.192815+0000","last_fullsized":"2024-04-26T23:41:25.192815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:21.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597519+0000","last_change":"2024-04-26T23:41:24.216811+0000","last_active":"2024-04-26T23:41:25.597519+0000","last_peered":"2024-04-26T23:41:25.597519+0000","last_clean":"2024-04-26T23:41:25.597519+0000","last_became_active":"2024-04-26T23:41:24.216532+0000","last_became_peered":"2024-04-26T23:41:24.216532+0000","last_unstale":"2024-04-26T23:41:25.597519+0000","last_undegraded":"2024-04-26T23:41:25.597519+0000","last_fullsized":"2024-04-26T23:41:25.597519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:10.486440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.213740+0000","last_change":"2024-04-26T23:41:24.201499+0000","last_active":"2024-04-26T23:41:24.213740+0000","last_peered":"2024-04-26T23:41:24.213740+0000","last_clean":"2024-04-26T23:41:24.213740+0000","last_became_active":"2024-04-26T23:41:24.201217+0000","last_became_peered":"2024-04-26T23:41:24.201217+0000","last_unstale":"2024-04-26T23:41:24.213740+0000","last_undegraded":"2024-04-26T23:41:24.213740+0000","last_fullsized":"2024-04-26T23:41:24.213740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:07:32.451536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191338+0000","last_change":"2024-04-26T23:41:24.215543+0000","last_active":"2024-04-26T23:41:25.191338+0000","last_peered":"2024-04-26T23:41:25.191338+0000","last_clean":"2024-04-26T23:41:25.191338+0000","last_became_active":"2024-04-26T23:41:24.214468+0000","last_became_peered":"2024-04-26T23:41:24.214468+0000","last_unstale":"2024-04-26T23:41:25.191338+0000","last_undegraded":"2024-04-26T23:41:25.191338+0000","last_fullsized":"2024-04-26T23:41:25.191338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:57:21.438653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.234331+0000","last_change":"2024-04-26T23:41:24.228988+0000","last_active":"2024-04-26T23:41:24.234331+0000","last_peered":"2024-04-26T23:41:24.234331+0000","last_clean":"2024-04-26T23:41:24.234331+0000","last_became_active":"2024-04-26T23:41:24.228753+0000","last_became_peered":"2024-04-26T23:41:24.228753+0000","last_unstale":"2024-04-26T23:41:24.234331+0000","last_undegraded":"2024-04-26T23:41:24.234331+0000","last_fullsized":"2024-04-26T23:41:24.234331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:59.322866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.214825+0000","last_change":"2024-04-26T23:41:24.213487+0000","last_active":"2024-04-26T23:41:25.214825+0000","last_peered":"2024-04-26T23:41:25.214825+0000","last_clean":"2024-04-26T23:41:25.214825+0000","last_became_active":"2024-04-26T23:41:24.212794+0000","last_became_peered":"2024-04-26T23:41:24.212794+0000","last_unstale":"2024-04-26T23:41:25.214825+0000","last_undegraded":"2024-04-26T23:41:25.214825+0000","last_fullsized":"2024-04-26T23:41:25.214825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:36.344325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190783+0000","last_change":"2024-04-26T23:41:24.202787+0000","last_active":"2024-04-26T23:41:25.190783+0000","last_peered":"2024-04-26T23:41:25.190783+0000","last_clean":"2024-04-26T23:41:25.190783+0000","last_became_active":"2024-04-26T23:41:24.202474+0000","last_became_peered":"2024-04-26T23:41:24.202474+0000","last_unstale":"2024-04-26T23:41:25.190783+0000","last_undegraded":"2024-04-26T23:41:25.190783+0000","last_fullsized":"2024-04-26T23:41:25.190783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:25.948379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597494+0000","last_change":"2024-04-26T23:41:23.211330+0000","last_active":"2024-04-26T23:41:25.597494+0000","last_peered":"2024-04-26T23:41:25.597494+0000","last_clean":"2024-04-26T23:41:25.597494+0000","last_became_active":"2024-04-26T23:41:23.210860+0000","last_became_peered":"2024-04-26T23:41:23.210860+0000","last_unstale":"2024-04-26T23:41:25.597494+0000","last_undegraded":"2024-04-26T23:41:25.597494+0000","last_fullsized":"2024-04-26T23:41:25.597494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:07.156356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.215807+0000","last_change":"2024-04-26T23:41:24.212656+0000","last_active":"2024-04-26T23:41:24.215807+0000","last_peered":"2024-04-26T23:41:24.215807+0000","last_clean":"2024-04-26T23:41:24.215807+0000","last_became_active":"2024-04-26T23:41:24.208356+0000","last_became_peered":"2024-04-26T23:41:24.208356+0000","last_unstale":"2024-04-26T23:41:24.215807+0000","last_undegraded":"2024-04-26T23:41:24.215807+0000","last_fullsized":"2024-04-26T23:41:24.215807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:39.968567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.214878+0000","last_change":"2024-04-26T23:41:23.203211+0000","last_active":"2024-04-26T23:41:25.214878+0000","last_peered":"2024-04-26T23:41:25.214878+0000","last_clean":"2024-04-26T23:41:25.214878+0000","last_became_active":"2024-04-26T23:41:23.202884+0000","last_became_peered":"2024-04-26T23:41:23.202884+0000","last_unstale":"2024-04-26T23:41:25.214878+0000","last_undegraded":"2024-04-26T23:41:25.214878+0000","last_fullsized":"2024-04-26T23:41:25.214878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:38.962512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597235+0000","last_change":"2024-04-26T23:41:23.204160+0000","last_active":"2024-04-26T23:41:25.597235+0000","last_peered":"2024-04-26T23:41:25.597235+0000","last_clean":"2024-04-26T23:41:25.597235+0000","last_became_active":"2024-04-26T23:41:23.203160+0000","last_became_peered":"2024-04-26T23:41:23.203160+0000","last_unstale":"2024-04-26T23:41:25.597235+0000","last_undegraded":"2024-04-26T23:41:25.597235+0000","last_fullsized":"2024-04-26T23:41:25.597235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:07:31.445481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597143+0000","last_change":"2024-04-26T23:41:24.199055+0000","last_active":"2024-04-26T23:41:25.597143+0000","last_peered":"2024-04-26T23:41:25.597143+0000","last_clean":"2024-04-26T23:41:25.597143+0000","last_became_active":"2024-04-26T23:41:24.198722+0000","last_became_peered":"2024-04-26T23:41:24.198722+0000","last_unstale":"2024-04-26T23:41:25.597143+0000","last_undegraded":"2024-04-26T23:41:25.597143+0000","last_fullsized":"2024-04-26T23:41:25.597143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:24.389021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190075+0000","last_change":"2024-04-26T23:41:23.201562+0000","last_active":"2024-04-26T23:41:25.190075+0000","last_peered":"2024-04-26T23:41:25.190075+0000","last_clean":"2024-04-26T23:41:25.190075+0000","last_became_active":"2024-04-26T23:41:23.200676+0000","last_became_peered":"2024-04-26T23:41:23.200676+0000","last_unstale":"2024-04-26T23:41:25.190075+0000","last_undegraded":"2024-04-26T23:41:25.190075+0000","last_fullsized":"2024-04-26T23:41:25.190075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:24.942324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192584+0000","last_change":"2024-04-26T23:41:24.204813+0000","last_active":"2024-04-26T23:41:25.192584+0000","last_peered":"2024-04-26T23:41:25.192584+0000","last_clean":"2024-04-26T23:41:25.192584+0000","last_became_active":"2024-04-26T23:41:24.204553+0000","last_became_peered":"2024-04-26T23:41:24.204553+0000","last_unstale":"2024-04-26T23:41:25.192584+0000","last_undegraded":"2024-04-26T23:41:25.192584+0000","last_fullsized":"2024-04-26T23:41:25.192584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:49:27.834697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215042+0000","last_change":"2024-04-26T23:41:23.206952+0000","last_active":"2024-04-26T23:41:25.215042+0000","last_peered":"2024-04-26T23:41:25.215042+0000","last_clean":"2024-04-26T23:41:25.215042+0000","last_became_active":"2024-04-26T23:41:23.206577+0000","last_became_peered":"2024-04-26T23:41:23.206577+0000","last_unstale":"2024-04-26T23:41:25.215042+0000","last_undegraded":"2024-04-26T23:41:25.215042+0000","last_fullsized":"2024-04-26T23:41:25.215042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:56.090036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190165+0000","last_change":"2024-04-26T23:41:24.205876+0000","last_active":"2024-04-26T23:41:25.190165+0000","last_peered":"2024-04-26T23:41:25.190165+0000","last_clean":"2024-04-26T23:41:25.190165+0000","last_became_active":"2024-04-26T23:41:24.205566+0000","last_became_peered":"2024-04-26T23:41:24.205566+0000","last_unstale":"2024-04-26T23:41:25.190165+0000","last_undegraded":"2024-04-26T23:41:25.190165+0000","last_fullsized":"2024-04-26T23:41:25.190165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:39:55.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190265+0000","last_change":"2024-04-26T23:41:23.208519+0000","last_active":"2024-04-26T23:41:25.190265+0000","last_peered":"2024-04-26T23:41:25.190265+0000","last_clean":"2024-04-26T23:41:25.190265+0000","last_became_active":"2024-04-26T23:41:23.208271+0000","last_became_peered":"2024-04-26T23:41:23.208271+0000","last_unstale":"2024-04-26T23:41:25.190265+0000","last_undegraded":"2024-04-26T23:41:25.190265+0000","last_fullsized":"2024-04-26T23:41:25.190265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:38.962512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.221980+0000","last_change":"2024-04-26T23:41:24.213954+0000","last_active":"2024-04-26T23:41:24.221980+0000","last_peered":"2024-04-26T23:41:24.221980+0000","last_clean":"2024-04-26T23:41:24.221980+0000","last_became_active":"2024-04-26T23:41:24.210823+0000","last_became_peered":"2024-04-26T23:41:24.210823+0000","last_unstale":"2024-04-26T23:41:24.221980+0000","last_undegraded":"2024-04-26T23:41:24.221980+0000","last_fullsized":"2024-04-26T23:41:24.221980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:49.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192815+0000","last_change":"2024-04-26T23:41:23.208525+0000","last_active":"2024-04-26T23:41:25.192815+0000","last_peered":"2024-04-26T23:41:25.192815+0000","last_clean":"2024-04-26T23:41:25.192815+0000","last_became_active":"2024-04-26T23:41:23.208296+0000","last_became_peered":"2024-04-26T23:41:23.208296+0000","last_unstale":"2024-04-26T23:41:25.192815+0000","last_undegraded":"2024-04-26T23:41:25.192815+0000","last_fullsized":"2024-04-26T23:41:25.192815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:56.090036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191122+0000","last_change":"2024-04-26T23:41:24.214223+0000","last_active":"2024-04-26T23:41:25.191122+0000","last_peered":"2024-04-26T23:41:25.191122+0000","last_clean":"2024-04-26T23:41:25.191122+0000","last_became_active":"2024-04-26T23:41:24.212904+0000","last_became_peered":"2024-04-26T23:41:24.212904+0000","last_unstale":"2024-04-26T23:41:25.191122+0000","last_undegraded":"2024-04-26T23:41:25.191122+0000","last_fullsized":"2024-04-26T23:41:25.191122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:49.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215122+0000","last_change":"2024-04-26T23:41:23.203321+0000","last_active":"2024-04-26T23:41:25.215122+0000","last_peered":"2024-04-26T23:41:25.215122+0000","last_clean":"2024-04-26T23:41:25.215122+0000","last_became_active":"2024-04-26T23:41:23.203033+0000","last_became_peered":"2024-04-26T23:41:23.203033+0000","last_unstale":"2024-04-26T23:41:25.215122+0000","last_undegraded":"2024-04-26T23:41:25.215122+0000","last_fullsized":"2024-04-26T23:41:25.215122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.316812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.223197+0000","last_change":"2024-04-26T23:41:24.206337+0000","last_active":"2024-04-26T23:41:24.223197+0000","last_peered":"2024-04-26T23:41:24.223197+0000","last_clean":"2024-04-26T23:41:24.223197+0000","last_became_active":"2024-04-26T23:41:24.206071+0000","last_became_peered":"2024-04-26T23:41:24.206071+0000","last_unstale":"2024-04-26T23:41:24.223197+0000","last_undegraded":"2024-04-26T23:41:24.223197+0000","last_fullsized":"2024-04-26T23:41:24.223197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:59.675062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.226570+0000","last_change":"2024-04-26T23:41:23.209289+0000","last_active":"2024-04-26T23:41:24.226570+0000","last_peered":"2024-04-26T23:41:24.226570+0000","last_clean":"2024-04-26T23:41:24.226570+0000","last_became_active":"2024-04-26T23:41:23.209014+0000","last_became_peered":"2024-04-26T23:41:23.209014+0000","last_unstale":"2024-04-26T23:41:24.226570+0000","last_undegraded":"2024-04-26T23:41:24.226570+0000","last_fullsized":"2024-04-26T23:41:24.226570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:03.988829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.215711+0000","last_change":"2024-04-26T23:41:24.213072+0000","last_active":"2024-04-26T23:41:24.215711+0000","last_peered":"2024-04-26T23:41:24.215711+0000","last_clean":"2024-04-26T23:41:24.215711+0000","last_became_active":"2024-04-26T23:41:24.208424+0000","last_became_peered":"2024-04-26T23:41:24.208424+0000","last_unstale":"2024-04-26T23:41:24.215711+0000","last_undegraded":"2024-04-26T23:41:24.215711+0000","last_fullsized":"2024-04-26T23:41:24.215711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:57.096091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191349+0000","last_change":"2024-04-26T23:41:23.202871+0000","last_active":"2024-04-26T23:41:25.191349+0000","last_peered":"2024-04-26T23:41:25.191349+0000","last_clean":"2024-04-26T23:41:25.191349+0000","last_became_active":"2024-04-26T23:41:23.202591+0000","last_became_peered":"2024-04-26T23:41:23.202591+0000","last_unstale":"2024-04-26T23:41:25.191349+0000","last_undegraded":"2024-04-26T23:41:25.191349+0000","last_fullsized":"2024-04-26T23:41:25.191349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.316812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.229709+0000","last_change":"2024-04-26T23:41:24.224407+0000","last_active":"2024-04-26T23:41:24.229709+0000","last_peered":"2024-04-26T23:41:24.229709+0000","last_clean":"2024-04-26T23:41:24.229709+0000","last_became_active":"2024-04-26T23:41:24.224097+0000","last_became_peered":"2024-04-26T23:41:24.224097+0000","last_unstale":"2024-04-26T23:41:24.229709+0000","last_undegraded":"2024-04-26T23:41:24.229709+0000","last_fullsized":"2024-04-26T23:41:24.229709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:49:27.834697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.214815+0000","last_change":"2024-04-26T23:41:23.207396+0000","last_active":"2024-04-26T23:41:25.214815+0000","last_peered":"2024-04-26T23:41:25.214815+0000","last_clean":"2024-04-26T23:41:25.214815+0000","last_became_active":"2024-04-26T23:41:23.207008+0000","last_became_peered":"2024-04-26T23:41:23.207008+0000","last_unstale":"2024-04-26T23:41:25.214815+0000","last_undegraded":"2024-04-26T23:41:25.214815+0000","last_fullsized":"2024-04-26T23:41:25.214815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:38.934659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.214836+0000","last_change":"2024-04-26T23:41:24.213631+0000","last_active":"2024-04-26T23:41:25.214836+0000","last_peered":"2024-04-26T23:41:25.214836+0000","last_clean":"2024-04-26T23:41:25.214836+0000","last_became_active":"2024-04-26T23:41:24.213186+0000","last_became_peered":"2024-04-26T23:41:24.213186+0000","last_unstale":"2024-04-26T23:41:25.214836+0000","last_undegraded":"2024-04-26T23:41:25.214836+0000","last_fullsized":"2024-04-26T23:41:25.214836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:24.389021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.241612+0000","last_change":"2024-04-26T23:41:23.201745+0000","last_active":"2024-04-26T23:41:24.241612+0000","last_peered":"2024-04-26T23:41:24.241612+0000","last_clean":"2024-04-26T23:41:24.241612+0000","last_became_active":"2024-04-26T23:41:23.200889+0000","last_became_peered":"2024-04-26T23:41:23.200889+0000","last_unstale":"2024-04-26T23:41:24.241612+0000","last_undegraded":"2024-04-26T23:41:24.241612+0000","last_fullsized":"2024-04-26T23:41:24.241612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:07.156356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.228913+0000","last_change":"2024-04-26T23:41:24.222601+0000","last_active":"2024-04-26T23:41:24.228913+0000","last_peered":"2024-04-26T23:41:24.228913+0000","last_clean":"2024-04-26T23:41:24.228913+0000","last_became_active":"2024-04-26T23:41:24.222239+0000","last_became_peered":"2024-04-26T23:41:24.222239+0000","last_unstale":"2024-04-26T23:41:24.228913+0000","last_undegraded":"2024-04-26T23:41:24.228913+0000","last_fullsized":"2024-04-26T23:41:24.228913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:24.389021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191163+0000","last_change":"2024-04-26T23:41:23.200281+0000","last_active":"2024-04-26T23:41:25.191163+0000","last_peered":"2024-04-26T23:41:25.191163+0000","last_clean":"2024-04-26T23:41:25.191163+0000","last_became_active":"2024-04-26T23:41:23.199967+0000","last_became_peered":"2024-04-26T23:41:23.199967+0000","last_unstale":"2024-04-26T23:41:25.191163+0000","last_undegraded":"2024-04-26T23:41:25.191163+0000","last_fullsized":"2024-04-26T23:41:25.191163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:03.988829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.225813+0000","last_change":"2024-04-26T23:41:24.216444+0000","last_active":"2024-04-26T23:41:24.225813+0000","last_peered":"2024-04-26T23:41:24.225813+0000","last_clean":"2024-04-26T23:41:24.225813+0000","last_became_active":"2024-04-26T23:41:24.216284+0000","last_became_peered":"2024-04-26T23:41:24.216284+0000","last_unstale":"2024-04-26T23:41:24.225813+0000","last_undegraded":"2024-04-26T23:41:24.225813+0000","last_fullsized":"2024-04-26T23:41:24.225813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:18.779130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.240721+0000","last_change":"2024-04-26T23:41:23.201500+0000","last_active":"2024-04-26T23:41:24.240721+0000","last_peered":"2024-04-26T23:41:24.240721+0000","last_clean":"2024-04-26T23:41:24.240721+0000","last_became_active":"2024-04-26T23:41:23.200957+0000","last_became_peered":"2024-04-26T23:41:23.200957+0000","last_unstale":"2024-04-26T23:41:24.240721+0000","last_undegraded":"2024-04-26T23:41:24.240721+0000","last_fullsized":"2024-04-26T23:41:24.240721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:38.934659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.229947+0000","last_change":"2024-04-26T23:41:24.226576+0000","last_active":"2024-04-26T23:41:24.229947+0000","last_peered":"2024-04-26T23:41:24.229947+0000","last_clean":"2024-04-26T23:41:24.229947+0000","last_became_active":"2024-04-26T23:41:24.226264+0000","last_became_peered":"2024-04-26T23:41:24.226264+0000","last_unstale":"2024-04-26T23:41:24.229947+0000","last_undegraded":"2024-04-26T23:41:24.229947+0000","last_fullsized":"2024-04-26T23:41:24.229947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:10.486440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192896+0000","last_change":"2024-04-26T23:41:23.203818+0000","last_active":"2024-04-26T23:41:25.192896+0000","last_peered":"2024-04-26T23:41:25.192896+0000","last_clean":"2024-04-26T23:41:25.192896+0000","last_became_active":"2024-04-26T23:41:23.202837+0000","last_became_peered":"2024-04-26T23:41:23.202837+0000","last_unstale":"2024-04-26T23:41:25.192896+0000","last_undegraded":"2024-04-26T23:41:25.192896+0000","last_fullsized":"2024-04-26T23:41:25.192896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:24.942324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190624+0000","last_change":"2024-04-26T23:41:24.213182+0000","last_active":"2024-04-26T23:41:25.190624+0000","last_peered":"2024-04-26T23:41:25.190624+0000","last_clean":"2024-04-26T23:41:25.190624+0000","last_became_active":"2024-04-26T23:41:24.209618+0000","last_became_peered":"2024-04-26T23:41:24.209618+0000","last_unstale":"2024-04-26T23:41:25.190624+0000","last_undegraded":"2024-04-26T23:41:25.190624+0000","last_fullsized":"2024-04-26T23:41:25.190624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:22.105178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.204995+0000","last_change":"2024-04-26T23:41:23.205194+0000","last_active":"2024-04-26T23:41:24.204995+0000","last_peered":"2024-04-26T23:41:24.204995+0000","last_clean":"2024-04-26T23:41:24.204995+0000","last_became_active":"2024-04-26T23:41:23.204713+0000","last_became_peered":"2024-04-26T23:41:23.204713+0000","last_unstale":"2024-04-26T23:41:24.204995+0000","last_undegraded":"2024-04-26T23:41:24.204995+0000","last_fullsized":"2024-04-26T23:41:24.204995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:07:31.445481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.223174+0000","last_change":"2024-04-26T23:41:24.205123+0000","last_active":"2024-04-26T23:41:24.223174+0000","last_peered":"2024-04-26T23:41:24.223174+0000","last_clean":"2024-04-26T23:41:24.223174+0000","last_became_active":"2024-04-26T23:41:24.204841+0000","last_became_peered":"2024-04-26T23:41:24.204841+0000","last_unstale":"2024-04-26T23:41:24.223174+0000","last_undegraded":"2024-04-26T23:41:24.223174+0000","last_fullsized":"2024-04-26T23:41:24.223174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:47.058231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":168,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.196733+0000","last_change":"2024-04-26T23:41:12.783987+0000","last_active":"2024-04-26T23:41:24.196733+0000","last_peered":"2024-04-26T23:41:24.196733+0000","last_clean":"2024-04-26T23:41:24.196733+0000","last_became_active":"2024-04-26T23:41:12.782901+0000","last_became_peered":"2024-04-26T23:41:12.782901+0000","last_unstale":"2024-04-26T23:41:24.196733+0000","last_undegraded":"2024-04-26T23:41:24.196733+0000","last_fullsized":"2024-04-26T23:41:24.196733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_clean_scrub_stamp":"2024-04-26T23:41:11.626255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:16.305521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.189889+0000","last_change":"2024-04-26T23:41:23.200012+0000","last_active":"2024-04-26T23:41:25.189889+0000","last_peered":"2024-04-26T23:41:25.189889+0000","last_clean":"2024-04-26T23:41:25.189889+0000","last_became_active":"2024-04-26T23:41:23.199386+0000","last_became_peered":"2024-04-26T23:41:23.199386+0000","last_unstale":"2024-04-26T23:41:25.189889+0000","last_undegraded":"2024-04-26T23:41:25.189889+0000","last_fullsized":"2024-04-26T23:41:25.189889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:38.934659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597544+0000","last_change":"2024-04-26T23:41:24.206857+0000","last_active":"2024-04-26T23:41:25.597544+0000","last_peered":"2024-04-26T23:41:25.597544+0000","last_clean":"2024-04-26T23:41:25.597544+0000","last_became_active":"2024-04-26T23:41:24.206372+0000","last_became_peered":"2024-04-26T23:41:24.206372+0000","last_unstale":"2024-04-26T23:41:25.597544+0000","last_undegraded":"2024-04-26T23:41:25.597544+0000","last_fullsized":"2024-04-26T23:41:25.597544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:39:55.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.196667+0000","last_change":"2024-04-26T23:41:23.217608+0000","last_active":"2024-04-26T23:41:24.196667+0000","last_peered":"2024-04-26T23:41:24.196667+0000","last_clean":"2024-04-26T23:41:24.196667+0000","last_became_active":"2024-04-26T23:41:23.217314+0000","last_became_peered":"2024-04-26T23:41:23.217314+0000","last_unstale":"2024-04-26T23:41:24.196667+0000","last_undegraded":"2024-04-26T23:41:24.196667+0000","last_fullsized":"2024-04-26T23:41:24.196667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:24.942324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.213801+0000","last_change":"2024-04-26T23:41:24.204857+0000","last_active":"2024-04-26T23:41:24.213801+0000","last_peered":"2024-04-26T23:41:24.213801+0000","last_clean":"2024-04-26T23:41:24.213801+0000","last_became_active":"2024-04-26T23:41:24.204562+0000","last_became_peered":"2024-04-26T23:41:24.204562+0000","last_unstale":"2024-04-26T23:41:24.213801+0000","last_undegraded":"2024-04-26T23:41:24.213801+0000","last_fullsized":"2024-04-26T23:41:24.213801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:52:47.206669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.206737+0000","last_change":"2024-04-26T23:41:23.200698+0000","last_active":"2024-04-26T23:41:24.206737+0000","last_peered":"2024-04-26T23:41:24.206737+0000","last_clean":"2024-04-26T23:41:24.206737+0000","last_became_active":"2024-04-26T23:41:23.200370+0000","last_became_peered":"2024-04-26T23:41:23.200370+0000","last_unstale":"2024-04-26T23:41:24.206737+0000","last_undegraded":"2024-04-26T23:41:24.206737+0000","last_fullsized":"2024-04-26T23:41:24.206737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:52:46.200614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192390+0000","last_change":"2024-04-26T23:41:24.210162+0000","last_active":"2024-04-26T23:41:25.192390+0000","last_peered":"2024-04-26T23:41:25.192390+0000","last_clean":"2024-04-26T23:41:25.192390+0000","last_became_active":"2024-04-26T23:41:24.208845+0000","last_became_peered":"2024-04-26T23:41:24.208845+0000","last_unstale":"2024-04-26T23:41:25.192390+0000","last_undegraded":"2024-04-26T23:41:25.192390+0000","last_fullsized":"2024-04-26T23:41:25.192390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:24.389021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191434+0000","last_change":"2024-04-26T23:41:23.206844+0000","last_active":"2024-04-26T23:41:25.191434+0000","last_peered":"2024-04-26T23:41:25.191434+0000","last_clean":"2024-04-26T23:41:25.191434+0000","last_became_active":"2024-04-26T23:41:23.206402+0000","last_became_peered":"2024-04-26T23:41:23.206402+0000","last_unstale":"2024-04-26T23:41:25.191434+0000","last_undegraded":"2024-04-26T23:41:25.191434+0000","last_fullsized":"2024-04-26T23:41:25.191434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:56.090036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190708+0000","last_change":"2024-04-26T23:41:24.206303+0000","last_active":"2024-04-26T23:41:25.190708+0000","last_peered":"2024-04-26T23:41:25.190708+0000","last_clean":"2024-04-26T23:41:25.190708+0000","last_became_active":"2024-04-26T23:41:24.202022+0000","last_became_peered":"2024-04-26T23:41:24.202022+0000","last_unstale":"2024-04-26T23:41:25.190708+0000","last_undegraded":"2024-04-26T23:41:25.190708+0000","last_fullsized":"2024-04-26T23:41:25.190708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:59.322866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192695+0000","last_change":"2024-04-26T23:41:23.206647+0000","last_active":"2024-04-26T23:41:25.192695+0000","last_peered":"2024-04-26T23:41:25.192695+0000","last_clean":"2024-04-26T23:41:25.192695+0000","last_became_active":"2024-04-26T23:41:23.206356+0000","last_became_peered":"2024-04-26T23:41:23.206356+0000","last_unstale":"2024-04-26T23:41:25.192695+0000","last_undegraded":"2024-04-26T23:41:25.192695+0000","last_fullsized":"2024-04-26T23:41:25.192695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.316812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190853+0000","last_change":"2024-04-26T23:41:24.211005+0000","last_active":"2024-04-26T23:41:25.190853+0000","last_peered":"2024-04-26T23:41:25.190853+0000","last_clean":"2024-04-26T23:41:25.190853+0000","last_became_active":"2024-04-26T23:41:24.210556+0000","last_became_peered":"2024-04-26T23:41:24.210556+0000","last_unstale":"2024-04-26T23:41:25.190853+0000","last_undegraded":"2024-04-26T23:41:25.190853+0000","last_fullsized":"2024-04-26T23:41:25.190853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:08:46.957484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.198914+0000","last_change":"2024-04-26T23:41:23.217996+0000","last_active":"2024-04-26T23:41:24.198914+0000","last_peered":"2024-04-26T23:41:24.198914+0000","last_clean":"2024-04-26T23:41:24.198914+0000","last_became_active":"2024-04-26T23:41:23.217230+0000","last_became_peered":"2024-04-26T23:41:23.217230+0000","last_unstale":"2024-04-26T23:41:24.198914+0000","last_undegraded":"2024-04-26T23:41:24.198914+0000","last_fullsized":"2024-04-26T23:41:24.198914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:16.153073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192392+0000","last_change":"2024-04-26T23:41:24.209392+0000","last_active":"2024-04-26T23:41:25.192392+0000","last_peered":"2024-04-26T23:41:25.192392+0000","last_clean":"2024-04-26T23:41:25.192392+0000","last_became_active":"2024-04-26T23:41:24.208952+0000","last_became_peered":"2024-04-26T23:41:24.208952+0000","last_unstale":"2024-04-26T23:41:25.192392+0000","last_undegraded":"2024-04-26T23:41:25.192392+0000","last_fullsized":"2024-04-26T23:41:25.192392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:50.550871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215906+0000","last_change":"2024-04-26T23:41:23.209568+0000","last_active":"2024-04-26T23:41:25.215906+0000","last_peered":"2024-04-26T23:41:25.215906+0000","last_clean":"2024-04-26T23:41:25.215906+0000","last_became_active":"2024-04-26T23:41:23.208643+0000","last_became_peered":"2024-04-26T23:41:23.208643+0000","last_unstale":"2024-04-26T23:41:25.215906+0000","last_undegraded":"2024-04-26T23:41:25.215906+0000","last_fullsized":"2024-04-26T23:41:25.215906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:25:34.809716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597606+0000","last_change":"2024-04-26T23:41:24.206669+0000","last_active":"2024-04-26T23:41:25.597606+0000","last_peered":"2024-04-26T23:41:25.597606+0000","last_clean":"2024-04-26T23:41:25.597606+0000","last_became_active":"2024-04-26T23:41:24.206394+0000","last_became_peered":"2024-04-26T23:41:24.206394+0000","last_unstale":"2024-04-26T23:41:25.597606+0000","last_undegraded":"2024-04-26T23:41:25.597606+0000","last_fullsized":"2024-04-26T23:41:25.597606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:26.029165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215176+0000","last_change":"2024-04-26T23:41:23.212534+0000","last_active":"2024-04-26T23:41:25.215176+0000","last_peered":"2024-04-26T23:41:25.215176+0000","last_clean":"2024-04-26T23:41:25.215176+0000","last_became_active":"2024-04-26T23:41:23.212211+0000","last_became_peered":"2024-04-26T23:41:23.212211+0000","last_unstale":"2024-04-26T23:41:25.215176+0000","last_undegraded":"2024-04-26T23:41:25.215176+0000","last_fullsized":"2024-04-26T23:41:25.215176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:24.942324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.214065+0000","last_change":"2024-04-26T23:41:24.202665+0000","last_active":"2024-04-26T23:41:24.214065+0000","last_peered":"2024-04-26T23:41:24.214065+0000","last_clean":"2024-04-26T23:41:24.214065+0000","last_became_active":"2024-04-26T23:41:24.202391+0000","last_became_peered":"2024-04-26T23:41:24.202391+0000","last_unstale":"2024-04-26T23:41:24.214065+0000","last_undegraded":"2024-04-26T23:41:24.214065+0000","last_fullsized":"2024-04-26T23:41:24.214065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:08.162411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.196517+0000","last_change":"2024-04-26T23:41:23.216618+0000","last_active":"2024-04-26T23:41:24.196517+0000","last_peered":"2024-04-26T23:41:24.196517+0000","last_clean":"2024-04-26T23:41:24.196517+0000","last_became_active":"2024-04-26T23:41:23.216394+0000","last_became_peered":"2024-04-26T23:41:23.216394+0000","last_unstale":"2024-04-26T23:41:24.196517+0000","last_undegraded":"2024-04-26T23:41:24.196517+0000","last_fullsized":"2024-04-26T23:41:24.196517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:56.090036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190709+0000","last_change":"2024-04-26T23:41:24.213349+0000","last_active":"2024-04-26T23:41:25.190709+0000","last_peered":"2024-04-26T23:41:25.190709+0000","last_clean":"2024-04-26T23:41:25.190709+0000","last_became_active":"2024-04-26T23:41:24.212106+0000","last_became_peered":"2024-04-26T23:41:24.212106+0000","last_unstale":"2024-04-26T23:41:25.190709+0000","last_undegraded":"2024-04-26T23:41:25.190709+0000","last_fullsized":"2024-04-26T23:41:25.190709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:57.096091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192456+0000","last_change":"2024-04-26T23:41:23.216515+0000","last_active":"2024-04-26T23:41:25.192456+0000","last_peered":"2024-04-26T23:41:25.192456+0000","last_clean":"2024-04-26T23:41:25.192456+0000","last_became_active":"2024-04-26T23:41:23.216281+0000","last_became_peered":"2024-04-26T23:41:23.216281+0000","last_unstale":"2024-04-26T23:41:25.192456+0000","last_undegraded":"2024-04-26T23:41:25.192456+0000","last_fullsized":"2024-04-26T23:41:25.192456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:38.934659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597219+0000","last_change":"2024-04-26T23:41:24.199305+0000","last_active":"2024-04-26T23:41:25.597219+0000","last_peered":"2024-04-26T23:41:25.597219+0000","last_clean":"2024-04-26T23:41:25.597219+0000","last_became_active":"2024-04-26T23:41:24.199005+0000","last_became_peered":"2024-04-26T23:41:24.199005+0000","last_unstale":"2024-04-26T23:41:25.597219+0000","last_undegraded":"2024-04-26T23:41:25.597219+0000","last_fullsized":"2024-04-26T23:41:25.597219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:50.550871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192447+0000","last_change":"2024-04-26T23:41:23.215183+0000","last_active":"2024-04-26T23:41:25.192447+0000","last_peered":"2024-04-26T23:41:25.192447+0000","last_clean":"2024-04-26T23:41:25.192447+0000","last_became_active":"2024-04-26T23:41:23.214884+0000","last_became_peered":"2024-04-26T23:41:23.214884+0000","last_unstale":"2024-04-26T23:41:25.192447+0000","last_undegraded":"2024-04-26T23:41:25.192447+0000","last_fullsized":"2024-04-26T23:41:25.192447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:38.962512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597577+0000","last_change":"2024-04-26T23:41:24.200053+0000","last_active":"2024-04-26T23:41:25.597577+0000","last_peered":"2024-04-26T23:41:25.597577+0000","last_clean":"2024-04-26T23:41:25.597577+0000","last_became_active":"2024-04-26T23:41:24.199582+0000","last_became_peered":"2024-04-26T23:41:24.199582+0000","last_unstale":"2024-04-26T23:41:25.597577+0000","last_undegraded":"2024-04-26T23:41:25.597577+0000","last_fullsized":"2024-04-26T23:41:25.597577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:22:11.814233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.230376+0000","last_change":"2024-04-26T23:41:23.217680+0000","last_active":"2024-04-26T23:41:24.230376+0000","last_peered":"2024-04-26T23:41:24.230376+0000","last_clean":"2024-04-26T23:41:24.230376+0000","last_became_active":"2024-04-26T23:41:23.217310+0000","last_became_peered":"2024-04-26T23:41:23.217310+0000","last_unstale":"2024-04-26T23:41:24.230376+0000","last_undegraded":"2024-04-26T23:41:24.230376+0000","last_fullsized":"2024-04-26T23:41:24.230376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:47.997792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215087+0000","last_change":"2024-04-26T23:41:24.212308+0000","last_active":"2024-04-26T23:41:25.215087+0000","last_peered":"2024-04-26T23:41:25.215087+0000","last_clean":"2024-04-26T23:41:25.215087+0000","last_became_active":"2024-04-26T23:41:24.210877+0000","last_became_peered":"2024-04-26T23:41:24.210877+0000","last_unstale":"2024-04-26T23:41:25.215087+0000","last_undegraded":"2024-04-26T23:41:25.215087+0000","last_fullsized":"2024-04-26T23:41:25.215087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:50.550871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190698+0000","last_change":"2024-04-26T23:41:24.205082+0000","last_active":"2024-04-26T23:41:25.190698+0000","last_peered":"2024-04-26T23:41:25.190698+0000","last_clean":"2024-04-26T23:41:25.190698+0000","last_became_active":"2024-04-26T23:41:24.204829+0000","last_became_peered":"2024-04-26T23:41:24.204829+0000","last_unstale":"2024-04-26T23:41:25.190698+0000","last_undegraded":"2024-04-26T23:41:25.190698+0000","last_fullsized":"2024-04-26T23:41:25.190698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:16.493479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.232204+0000","last_change":"2024-04-26T23:41:23.216385+0000","last_active":"2024-04-26T23:41:24.232204+0000","last_peered":"2024-04-26T23:41:24.232204+0000","last_clean":"2024-04-26T23:41:24.232204+0000","last_became_active":"2024-04-26T23:41:23.215863+0000","last_became_peered":"2024-04-26T23:41:23.215863+0000","last_unstale":"2024-04-26T23:41:24.232204+0000","last_undegraded":"2024-04-26T23:41:24.232204+0000","last_fullsized":"2024-04-26T23:41:24.232204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.316812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190471+0000","last_change":"2024-04-26T23:41:24.221698+0000","last_active":"2024-04-26T23:41:25.190471+0000","last_peered":"2024-04-26T23:41:25.190471+0000","last_clean":"2024-04-26T23:41:25.190471+0000","last_became_active":"2024-04-26T23:41:24.221304+0000","last_became_peered":"2024-04-26T23:41:24.221304+0000","last_unstale":"2024-04-26T23:41:25.190471+0000","last_undegraded":"2024-04-26T23:41:25.190471+0000","last_fullsized":"2024-04-26T23:41:25.190471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:26.029165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.229287+0000","last_change":"2024-04-26T23:41:23.218166+0000","last_active":"2024-04-26T23:41:24.229287+0000","last_peered":"2024-04-26T23:41:24.229287+0000","last_clean":"2024-04-26T23:41:24.229287+0000","last_became_active":"2024-04-26T23:41:23.217699+0000","last_became_peered":"2024-04-26T23:41:23.217699+0000","last_unstale":"2024-04-26T23:41:24.229287+0000","last_undegraded":"2024-04-26T23:41:24.229287+0000","last_fullsized":"2024-04-26T23:41:24.229287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:25:34.809716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.220098+0000","last_change":"2024-04-26T23:41:24.213827+0000","last_active":"2024-04-26T23:41:24.220098+0000","last_peered":"2024-04-26T23:41:24.220098+0000","last_clean":"2024-04-26T23:41:24.220098+0000","last_became_active":"2024-04-26T23:41:24.212763+0000","last_became_peered":"2024-04-26T23:41:24.212763+0000","last_unstale":"2024-04-26T23:41:24.220098+0000","last_undegraded":"2024-04-26T23:41:24.220098+0000","last_fullsized":"2024-04-26T23:41:24.220098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:25:35.815770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597735+0000","last_change":"2024-04-26T23:41:23.204817+0000","last_active":"2024-04-26T23:41:25.597735+0000","last_peered":"2024-04-26T23:41:25.597735+0000","last_clean":"2024-04-26T23:41:25.597735+0000","last_became_active":"2024-04-26T23:41:23.204536+0000","last_became_peered":"2024-04-26T23:41:23.204536+0000","last_unstale":"2024-04-26T23:41:25.597735+0000","last_undegraded":"2024-04-26T23:41:25.597735+0000","last_fullsized":"2024-04-26T23:41:25.597735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:03.988829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597451+0000","last_change":"2024-04-26T23:41:24.209853+0000","last_active":"2024-04-26T23:41:25.597451+0000","last_peered":"2024-04-26T23:41:25.597451+0000","last_clean":"2024-04-26T23:41:25.597451+0000","last_became_active":"2024-04-26T23:41:24.208923+0000","last_became_peered":"2024-04-26T23:41:24.208923+0000","last_unstale":"2024-04-26T23:41:25.597451+0000","last_undegraded":"2024-04-26T23:41:25.597451+0000","last_fullsized":"2024-04-26T23:41:25.597451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:44.639875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.232513+0000","last_change":"2024-04-26T23:41:23.213860+0000","last_active":"2024-04-26T23:41:24.232513+0000","last_peered":"2024-04-26T23:41:24.232513+0000","last_clean":"2024-04-26T23:41:24.232513+0000","last_became_active":"2024-04-26T23:41:23.213552+0000","last_became_peered":"2024-04-26T23:41:23.213552+0000","last_unstale":"2024-04-26T23:41:24.232513+0000","last_undegraded":"2024-04-26T23:41:24.232513+0000","last_fullsized":"2024-04-26T23:41:24.232513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:45:21.419358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":196608,"data_stored":64724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":64760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":64794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:41:28.287 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:41:28.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.454+0000 7f8636e00640 1 Processor -- start 2024-04-26T23:41:28.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.454+0000 7f8636e00640 1 -- start start 2024-04-26T23:41:28.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.454+0000 7f8636e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f863015f3d0 0x7f86300d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:28.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.454+0000 7f8636e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f86300b4100 0x7f863015f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:28.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.454+0000 7f8636e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8630160240 con 0x7f863015fcf0 2024-04-26T23:41:28.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.454+0000 7f8636e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f86300b2960 con 0x7f863015f3d0 2024-04-26T23:41:28.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.454+0000 7f8636e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f8630160520 con 0x7f86300b4100 2024-04-26T23:41:28.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.454+0000 7f862fe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f863015f3d0 0x7f86300d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:28.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.454+0000 7f8634e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f863015fcf0 0x7f86300d2d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46028/0 (socket says 172.21.15.137:46028) 2024-04-26T23:41:28.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.454+0000 7f8634e00640 1 -- 172.21.15.137:0/2574715930 learned_addr learned my addr 172.21.15.137:0/2574715930 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:28.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.454+0000 7f862f400640 1 --2- 172.21.15.137:0/2574715930 >> v2:172.21.15.170:3300/0 conn(0x7f86300b4100 0x7f863015f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:28.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.454+0000 7f862fe00640 1 -- 172.21.15.137:0/2574715930 >> v2:172.21.15.170:3300/0 conn(0x7f86300b4100 msgr2=0x7f863015f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:28.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.454+0000 7f862fe00640 1 --2- 172.21.15.137:0/2574715930 >> v2:172.21.15.170:3300/0 conn(0x7f86300b4100 0x7f863015f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.454+0000 7f862fe00640 1 -- 172.21.15.137:0/2574715930 >> v1:172.21.15.137:6789/0 conn(0x7f863015fcf0 legacy=0x7f86300d2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:28.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.454+0000 7f862fe00640 1 -- 172.21.15.137:0/2574715930 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8630160800 con 0x7f863015f3d0 2024-04-26T23:41:28.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.454+0000 7f862ea00640 1 -- 172.21.15.137:0/2574715930 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3644330053 0 0) 0x7f8630160240 con 0x7f863015fcf0 2024-04-26T23:41:28.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.454+0000 7f862f400640 1 --2- 172.21.15.137:0/2574715930 >> v2:172.21.15.170:3300/0 conn(0x7f86300b4100 0x7f863015f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:28.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.458+0000 7f862fe00640 1 --2- 172.21.15.137:0/2574715930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f863015f3d0 0x7f86300d1030 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8630074160 tx=0x7f862001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aea71e9a010bd70 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:28.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.458+0000 7f862ea00640 1 -- 172.21.15.137:0/2574715930 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86200b2070 con 0x7f863015f3d0 2024-04-26T23:41:28.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.458+0000 7f862ea00640 1 -- 172.21.15.137:0/2574715930 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86200ad640 con 0x7f863015f3d0 2024-04-26T23:41:28.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.458+0000 7f862ea00640 1 -- 172.21.15.137:0/2574715930 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86200ada10 con 0x7f863015f3d0 2024-04-26T23:41:28.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.458+0000 7f8636e00640 1 -- 172.21.15.137:0/2574715930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f863015f3d0 msgr2=0x7f86300d1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:28.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.458+0000 7f8636e00640 1 --2- 172.21.15.137:0/2574715930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f863015f3d0 0x7f86300d1030 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8630074160 tx=0x7f862001c480 comp rx=0 tx=0).stop 2024-04-26T23:41:28.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.458+0000 7f8636e00640 1 -- 172.21.15.137:0/2574715930 shutdown_connections 2024-04-26T23:41:28.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.458+0000 7f8636e00640 1 --2- 172.21.15.137:0/2574715930 >> v2:172.21.15.170:3300/0 conn(0x7f86300b4100 0x7f863015f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.458+0000 7f8636e00640 1 --2- 172.21.15.137:0/2574715930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f863015f3d0 0x7f86300d1030 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.458+0000 7f8636e00640 1 -- 172.21.15.137:0/2574715930 >> 172.21.15.137:0/2574715930 conn(0x7f863009ba60 msgr2=0x7f863009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:28.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.458+0000 7f8636e00640 1 -- 172.21.15.137:0/2574715930 shutdown_connections 2024-04-26T23:41:28.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.458+0000 7f8636e00640 1 -- 172.21.15.137:0/2574715930 wait complete. 2024-04-26T23:41:28.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f8636e00640 1 Processor -- start 2024-04-26T23:41:28.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f8636e00640 1 -- start start 2024-04-26T23:41:28.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f8636e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86300b4100 0x7f8630157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:28.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f8636e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f863015f3d0 0x7f86300b7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:28.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f8636e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f863015fcf0 0x7f863015a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:28.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f8636e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f86300b39d0 con 0x7f86300b4100 2024-04-26T23:41:28.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f8636e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f86300b3850 con 0x7f863015f3d0 2024-04-26T23:41:28.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f8636e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f86300b3b50 con 0x7f863015fcf0 2024-04-26T23:41:28.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f862fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86300b4100 0x7f8630157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:28.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f862fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86300b4100 0x7f8630157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33780/0 (socket says 172.21.15.137:33780) 2024-04-26T23:41:28.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f862fe00640 1 -- 172.21.15.137:0/1629187328 learned_addr learned my addr 172.21.15.137:0/1629187328 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:28.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f862f400640 1 --2- 172.21.15.137:0/1629187328 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f863015f3d0 0x7f86300b7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:28.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f8634e00640 1 --2- 172.21.15.137:0/1629187328 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f863015fcf0 0x7f863015a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:28.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f862fe00640 1 -- 172.21.15.137:0/1629187328 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f863015fcf0 msgr2=0x7f863015a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:28.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f862fe00640 1 --2- 172.21.15.137:0/1629187328 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f863015fcf0 0x7f863015a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f862fe00640 1 -- 172.21.15.137:0/1629187328 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f863015f3d0 msgr2=0x7f86300b7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:28.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f862fe00640 1 --2- 172.21.15.137:0/1629187328 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f863015f3d0 0x7f86300b7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f862fe00640 1 -- 172.21.15.137:0/1629187328 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86300b8370 con 0x7f86300b4100 2024-04-26T23:41:28.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f862fe00640 1 --2- 172.21.15.137:0/1629187328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86300b4100 0x7f8630157520 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f86200b0040 tx=0x7f8620019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:28.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f8627e00640 1 -- 172.21.15.137:0/1629187328 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86200ba020 con 0x7f86300b4100 2024-04-26T23:41:28.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f8627e00640 1 -- 172.21.15.137:0/1629187328 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86200b6410 con 0x7f86300b4100 2024-04-26T23:41:28.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f8636e00640 1 -- 172.21.15.137:0/1629187328 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f863015c700 con 0x7f86300b4100 2024-04-26T23:41:28.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f8627e00640 1 -- 172.21.15.137:0/1629187328 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86200b2040 con 0x7f86300b4100 2024-04-26T23:41:28.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f8636e00640 1 -- 172.21.15.137:0/1629187328 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f863015ccc0 con 0x7f86300b4100 2024-04-26T23:41:28.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.462+0000 7f8636e00640 1 -- 172.21.15.137:0/1629187328 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f863006a4b0 con 0x7f86300b4100 2024-04-26T23:41:28.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.466+0000 7f8627e00640 1 -- 172.21.15.137:0/1629187328 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f86200bd020 con 0x7f86300b4100 2024-04-26T23:41:28.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.466+0000 7f8627e00640 1 --2- 172.21.15.137:0/1629187328 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8610068380 0x7f861006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:28.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.466+0000 7f8627e00640 1 -- 172.21.15.137:0/1629187328 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8620120870 con 0x7f86300b4100 2024-04-26T23:41:28.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.466+0000 7f862f400640 1 --2- 172.21.15.137:0/1629187328 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8610068380 0x7f861006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:28.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.466+0000 7f862f400640 1 --2- 172.21.15.137:0/1629187328 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8610068380 0x7f861006a840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f863015ad40 tx=0x7f861c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:28.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.470+0000 7f8627e00640 1 -- 172.21.15.137:0/1629187328 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f86200c4030 con 0x7f86300b4100 2024-04-26T23:41:28.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.626+0000 7f8636e00640 1 -- 172.21.15.137:0/1629187328 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f86300b24f0 con 0x7f8610068380 2024-04-26T23:41:28.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.630+0000 7f8627e00640 1 -- 172.21.15.137:0/1629187328 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251920 (secure 0 0 0) 0x7f86300b24f0 con 0x7f8610068380 2024-04-26T23:41:28.641 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:28.642 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T23:41:28.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.634+0000 7f8636e00640 1 -- 172.21.15.137:0/1629187328 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8610068380 msgr2=0x7f861006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:28.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.634+0000 7f8636e00640 1 --2- 172.21.15.137:0/1629187328 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8610068380 0x7f861006a840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f863015ad40 tx=0x7f861c008040 comp rx=0 tx=0).stop 2024-04-26T23:41:28.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.634+0000 7f8636e00640 1 -- 172.21.15.137:0/1629187328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86300b4100 msgr2=0x7f8630157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:28.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.634+0000 7f8636e00640 1 --2- 172.21.15.137:0/1629187328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86300b4100 0x7f8630157520 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f86200b0040 tx=0x7f8620019220 comp rx=0 tx=0).stop 2024-04-26T23:41:28.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.634+0000 7f8636e00640 1 -- 172.21.15.137:0/1629187328 shutdown_connections 2024-04-26T23:41:28.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.634+0000 7f8636e00640 1 --2- 172.21.15.137:0/1629187328 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8610068380 0x7f861006a840 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.634+0000 7f8636e00640 1 --2- 172.21.15.137:0/1629187328 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f863015fcf0 0x7f863015a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.634+0000 7f8636e00640 1 --2- 172.21.15.137:0/1629187328 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f863015f3d0 0x7f86300b7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.634+0000 7f8636e00640 1 --2- 172.21.15.137:0/1629187328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86300b4100 0x7f8630157520 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.634+0000 7f8636e00640 1 -- 172.21.15.137:0/1629187328 >> 172.21.15.137:0/1629187328 conn(0x7f863009ba60 msgr2=0x7f86300d1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:28.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.634+0000 7f8636e00640 1 -- 172.21.15.137:0/1629187328 shutdown_connections 2024-04-26T23:41:28.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.634+0000 7f8636e00640 1 -- 172.21.15.137:0/1629187328 wait complete. 2024-04-26T23:41:28.661 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-26T23:41:27.589983+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235540,"kb_used_data":2728,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739180,"statfs":{"total":773094113280,"available":772852920320,"internally_reserved":0,"allocated":2793472,"data_stored":1702628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.412786"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.229920+0000","last_change":"2024-04-26T23:41:24.226081+0000","last_active":"2024-04-26T23:41:24.229920+0000","last_peered":"2024-04-26T23:41:24.229920+0000","last_clean":"2024-04-26T23:41:24.229920+0000","last_became_active":"2024-04-26T23:41:24.224081+0000","last_became_peered":"2024-04-26T23:41:24.224081+0000","last_unstale":"2024-04-26T23:41:24.229920+0000","last_undegraded":"2024-04-26T23:41:24.229920+0000","last_fullsized":"2024-04-26T23:41:24.229920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:21.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192782+0000","last_change":"2024-04-26T23:41:24.215201+0000","last_active":"2024-04-26T23:41:25.192782+0000","last_peered":"2024-04-26T23:41:25.192782+0000","last_clean":"2024-04-26T23:41:25.192782+0000","last_became_active":"2024-04-26T23:41:24.214743+0000","last_became_peered":"2024-04-26T23:41:24.214743+0000","last_unstale":"2024-04-26T23:41:25.192782+0000","last_undegraded":"2024-04-26T23:41:25.192782+0000","last_fullsized":"2024-04-26T23:41:25.192782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:44.639875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.218893+0000","last_change":"2024-04-26T23:41:24.213419+0000","last_active":"2024-04-26T23:41:24.218893+0000","last_peered":"2024-04-26T23:41:24.218893+0000","last_clean":"2024-04-26T23:41:24.218893+0000","last_became_active":"2024-04-26T23:41:24.213156+0000","last_became_peered":"2024-04-26T23:41:24.213156+0000","last_unstale":"2024-04-26T23:41:24.218893+0000","last_undegraded":"2024-04-26T23:41:24.218893+0000","last_fullsized":"2024-04-26T23:41:24.218893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:25.948379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190322+0000","last_change":"2024-04-26T23:41:24.210450+0000","last_active":"2024-04-26T23:41:25.190322+0000","last_peered":"2024-04-26T23:41:25.190322+0000","last_clean":"2024-04-26T23:41:25.190322+0000","last_became_active":"2024-04-26T23:41:24.209075+0000","last_became_peered":"2024-04-26T23:41:24.209075+0000","last_unstale":"2024-04-26T23:41:25.190322+0000","last_undegraded":"2024-04-26T23:41:25.190322+0000","last_fullsized":"2024-04-26T23:41:25.190322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:22:11.814233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.228517+0000","last_change":"2024-04-26T23:41:24.218615+0000","last_active":"2024-04-26T23:41:24.228517+0000","last_peered":"2024-04-26T23:41:24.228517+0000","last_clean":"2024-04-26T23:41:24.228517+0000","last_became_active":"2024-04-26T23:41:24.207757+0000","last_became_peered":"2024-04-26T23:41:24.207757+0000","last_unstale":"2024-04-26T23:41:24.228517+0000","last_undegraded":"2024-04-26T23:41:24.228517+0000","last_fullsized":"2024-04-26T23:41:24.228517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:36.344325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190989+0000","last_change":"2024-04-26T23:41:24.215319+0000","last_active":"2024-04-26T23:41:25.190989+0000","last_peered":"2024-04-26T23:41:25.190989+0000","last_clean":"2024-04-26T23:41:25.190989+0000","last_became_active":"2024-04-26T23:41:24.214101+0000","last_became_peered":"2024-04-26T23:41:24.214101+0000","last_unstale":"2024-04-26T23:41:25.190989+0000","last_undegraded":"2024-04-26T23:41:25.190989+0000","last_fullsized":"2024-04-26T23:41:25.190989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:12.164234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.228469+0000","last_change":"2024-04-26T23:41:24.218275+0000","last_active":"2024-04-26T23:41:24.228469+0000","last_peered":"2024-04-26T23:41:24.228469+0000","last_clean":"2024-04-26T23:41:24.228469+0000","last_became_active":"2024-04-26T23:41:24.217914+0000","last_became_peered":"2024-04-26T23:41:24.217914+0000","last_unstale":"2024-04-26T23:41:24.228469+0000","last_undegraded":"2024-04-26T23:41:24.228469+0000","last_fullsized":"2024-04-26T23:41:24.228469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:05:07.675269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597030+0000","last_change":"2024-04-26T23:41:24.217179+0000","last_active":"2024-04-26T23:41:25.597030+0000","last_peered":"2024-04-26T23:41:25.597030+0000","last_clean":"2024-04-26T23:41:25.597030+0000","last_became_active":"2024-04-26T23:41:24.215768+0000","last_became_peered":"2024-04-26T23:41:24.215768+0000","last_unstale":"2024-04-26T23:41:25.597030+0000","last_undegraded":"2024-04-26T23:41:25.597030+0000","last_fullsized":"2024-04-26T23:41:25.597030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:05:07.675269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.229896+0000","last_change":"2024-04-26T23:41:24.225884+0000","last_active":"2024-04-26T23:41:24.229896+0000","last_peered":"2024-04-26T23:41:24.229896+0000","last_clean":"2024-04-26T23:41:24.229896+0000","last_became_active":"2024-04-26T23:41:24.224023+0000","last_became_peered":"2024-04-26T23:41:24.224023+0000","last_unstale":"2024-04-26T23:41:24.229896+0000","last_undegraded":"2024-04-26T23:41:24.229896+0000","last_fullsized":"2024-04-26T23:41:24.229896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:44.639875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215198+0000","last_change":"2024-04-26T23:41:24.219022+0000","last_active":"2024-04-26T23:41:25.215198+0000","last_peered":"2024-04-26T23:41:25.215198+0000","last_clean":"2024-04-26T23:41:25.215198+0000","last_became_active":"2024-04-26T23:41:24.218769+0000","last_became_peered":"2024-04-26T23:41:24.218769+0000","last_unstale":"2024-04-26T23:41:25.215198+0000","last_undegraded":"2024-04-26T23:41:25.215198+0000","last_fullsized":"2024-04-26T23:41:25.215198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:21.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215175+0000","last_change":"2024-04-26T23:41:24.219493+0000","last_active":"2024-04-26T23:41:25.215175+0000","last_peered":"2024-04-26T23:41:25.215175+0000","last_clean":"2024-04-26T23:41:25.215175+0000","last_became_active":"2024-04-26T23:41:24.219227+0000","last_became_peered":"2024-04-26T23:41:24.219227+0000","last_unstale":"2024-04-26T23:41:25.215175+0000","last_undegraded":"2024-04-26T23:41:25.215175+0000","last_fullsized":"2024-04-26T23:41:25.215175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:44.639875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190908+0000","last_change":"2024-04-26T23:41:24.213018+0000","last_active":"2024-04-26T23:41:25.190908+0000","last_peered":"2024-04-26T23:41:25.190908+0000","last_clean":"2024-04-26T23:41:25.190908+0000","last_became_active":"2024-04-26T23:41:24.210261+0000","last_became_peered":"2024-04-26T23:41:24.210261+0000","last_unstale":"2024-04-26T23:41:25.190908+0000","last_undegraded":"2024-04-26T23:41:25.190908+0000","last_fullsized":"2024-04-26T23:41:25.190908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:25:35.815770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597367+0000","last_change":"2024-04-26T23:41:24.208860+0000","last_active":"2024-04-26T23:41:25.597367+0000","last_peered":"2024-04-26T23:41:25.597367+0000","last_clean":"2024-04-26T23:41:25.597367+0000","last_became_active":"2024-04-26T23:41:24.208537+0000","last_became_peered":"2024-04-26T23:41:24.208537+0000","last_unstale":"2024-04-26T23:41:25.597367+0000","last_undegraded":"2024-04-26T23:41:25.597367+0000","last_fullsized":"2024-04-26T23:41:25.597367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:49:27.834697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.215691+0000","last_change":"2024-04-26T23:41:24.212959+0000","last_active":"2024-04-26T23:41:24.215691+0000","last_peered":"2024-04-26T23:41:24.215691+0000","last_clean":"2024-04-26T23:41:24.215691+0000","last_became_active":"2024-04-26T23:41:24.208009+0000","last_became_peered":"2024-04-26T23:41:24.208009+0000","last_unstale":"2024-04-26T23:41:24.215691+0000","last_undegraded":"2024-04-26T23:41:24.215691+0000","last_fullsized":"2024-04-26T23:41:24.215691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:59.322866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192382+0000","last_change":"2024-04-26T23:41:24.202794+0000","last_active":"2024-04-26T23:41:25.192382+0000","last_peered":"2024-04-26T23:41:25.192382+0000","last_clean":"2024-04-26T23:41:25.192382+0000","last_became_active":"2024-04-26T23:41:24.202484+0000","last_became_peered":"2024-04-26T23:41:24.202484+0000","last_unstale":"2024-04-26T23:41:25.192382+0000","last_undegraded":"2024-04-26T23:41:25.192382+0000","last_fullsized":"2024-04-26T23:41:25.192382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:36.344325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.189800+0000","last_change":"2024-04-26T23:41:24.209356+0000","last_active":"2024-04-26T23:41:25.189800+0000","last_peered":"2024-04-26T23:41:25.189800+0000","last_clean":"2024-04-26T23:41:25.189800+0000","last_became_active":"2024-04-26T23:41:24.208427+0000","last_became_peered":"2024-04-26T23:41:24.208427+0000","last_unstale":"2024-04-26T23:41:25.189800+0000","last_undegraded":"2024-04-26T23:41:25.189800+0000","last_fullsized":"2024-04-26T23:41:25.189800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:21.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191177+0000","last_change":"2024-04-26T23:41:24.209097+0000","last_active":"2024-04-26T23:41:25.191177+0000","last_peered":"2024-04-26T23:41:25.191177+0000","last_clean":"2024-04-26T23:41:25.191177+0000","last_became_active":"2024-04-26T23:41:24.208802+0000","last_became_peered":"2024-04-26T23:41:24.208802+0000","last_unstale":"2024-04-26T23:41:25.191177+0000","last_undegraded":"2024-04-26T23:41:25.191177+0000","last_fullsized":"2024-04-26T23:41:25.191177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:28.775250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.214897+0000","last_change":"2024-04-26T23:41:24.209948+0000","last_active":"2024-04-26T23:41:24.214897+0000","last_peered":"2024-04-26T23:41:24.214897+0000","last_clean":"2024-04-26T23:41:24.214897+0000","last_became_active":"2024-04-26T23:41:24.209643+0000","last_became_peered":"2024-04-26T23:41:24.209643+0000","last_unstale":"2024-04-26T23:41:24.214897+0000","last_undegraded":"2024-04-26T23:41:24.214897+0000","last_fullsized":"2024-04-26T23:41:24.214897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:39.968567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.228927+0000","last_change":"2024-04-26T23:41:24.223030+0000","last_active":"2024-04-26T23:41:24.228927+0000","last_peered":"2024-04-26T23:41:24.228927+0000","last_clean":"2024-04-26T23:41:24.228927+0000","last_became_active":"2024-04-26T23:41:24.221662+0000","last_became_peered":"2024-04-26T23:41:24.221662+0000","last_unstale":"2024-04-26T23:41:24.228927+0000","last_undegraded":"2024-04-26T23:41:24.228927+0000","last_fullsized":"2024-04-26T23:41:24.228927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:50.550871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215142+0000","last_change":"2024-04-26T23:41:24.218402+0000","last_active":"2024-04-26T23:41:25.215142+0000","last_peered":"2024-04-26T23:41:25.215142+0000","last_clean":"2024-04-26T23:41:25.215142+0000","last_became_active":"2024-04-26T23:41:24.217441+0000","last_became_peered":"2024-04-26T23:41:24.217441+0000","last_unstale":"2024-04-26T23:41:25.215142+0000","last_undegraded":"2024-04-26T23:41:25.215142+0000","last_fullsized":"2024-04-26T23:41:25.215142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:49:27.834697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.219753+0000","last_change":"2024-04-26T23:41:24.209698+0000","last_active":"2024-04-26T23:41:24.219753+0000","last_peered":"2024-04-26T23:41:24.219753+0000","last_clean":"2024-04-26T23:41:24.219753+0000","last_became_active":"2024-04-26T23:41:24.208252+0000","last_became_peered":"2024-04-26T23:41:24.208252+0000","last_unstale":"2024-04-26T23:41:24.219753+0000","last_undegraded":"2024-04-26T23:41:24.219753+0000","last_fullsized":"2024-04-26T23:41:24.219753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:39.940714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191156+0000","last_change":"2024-04-26T23:41:24.223785+0000","last_active":"2024-04-26T23:41:25.191156+0000","last_peered":"2024-04-26T23:41:25.191156+0000","last_clean":"2024-04-26T23:41:25.191156+0000","last_became_active":"2024-04-26T23:41:24.223547+0000","last_became_peered":"2024-04-26T23:41:24.223547+0000","last_unstale":"2024-04-26T23:41:25.191156+0000","last_undegraded":"2024-04-26T23:41:25.191156+0000","last_fullsized":"2024-04-26T23:41:25.191156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:15.741774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597131+0000","last_change":"2024-04-26T23:41:24.204428+0000","last_active":"2024-04-26T23:41:25.597131+0000","last_peered":"2024-04-26T23:41:25.597131+0000","last_clean":"2024-04-26T23:41:25.597131+0000","last_became_active":"2024-04-26T23:41:24.203845+0000","last_became_peered":"2024-04-26T23:41:24.203845+0000","last_unstale":"2024-04-26T23:41:25.597131+0000","last_undegraded":"2024-04-26T23:41:25.597131+0000","last_fullsized":"2024-04-26T23:41:25.597131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:36.344325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.189964+0000","last_change":"2024-04-26T23:41:24.201596+0000","last_active":"2024-04-26T23:41:25.189964+0000","last_peered":"2024-04-26T23:41:25.189964+0000","last_clean":"2024-04-26T23:41:25.189964+0000","last_became_active":"2024-04-26T23:41:24.201257+0000","last_became_peered":"2024-04-26T23:41:24.201257+0000","last_unstale":"2024-04-26T23:41:25.189964+0000","last_undegraded":"2024-04-26T23:41:25.189964+0000","last_fullsized":"2024-04-26T23:41:25.189964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:10.486440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597494+0000","last_change":"2024-04-26T23:41:24.213190+0000","last_active":"2024-04-26T23:41:25.597494+0000","last_peered":"2024-04-26T23:41:25.597494+0000","last_clean":"2024-04-26T23:41:25.597494+0000","last_became_active":"2024-04-26T23:41:24.212878+0000","last_became_peered":"2024-04-26T23:41:24.212878+0000","last_unstale":"2024-04-26T23:41:25.597494+0000","last_undegraded":"2024-04-26T23:41:25.597494+0000","last_fullsized":"2024-04-26T23:41:25.597494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:21.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215267+0000","last_change":"2024-04-26T23:41:24.222681+0000","last_active":"2024-04-26T23:41:25.215267+0000","last_peered":"2024-04-26T23:41:25.215267+0000","last_clean":"2024-04-26T23:41:25.215267+0000","last_became_active":"2024-04-26T23:41:24.222435+0000","last_became_peered":"2024-04-26T23:41:24.222435+0000","last_unstale":"2024-04-26T23:41:25.215267+0000","last_undegraded":"2024-04-26T23:41:25.215267+0000","last_fullsized":"2024-04-26T23:41:25.215267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:10.486440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192815+0000","last_change":"2024-04-26T23:41:24.207533+0000","last_active":"2024-04-26T23:41:25.192815+0000","last_peered":"2024-04-26T23:41:25.192815+0000","last_clean":"2024-04-26T23:41:25.192815+0000","last_became_active":"2024-04-26T23:41:24.207267+0000","last_became_peered":"2024-04-26T23:41:24.207267+0000","last_unstale":"2024-04-26T23:41:25.192815+0000","last_undegraded":"2024-04-26T23:41:25.192815+0000","last_fullsized":"2024-04-26T23:41:25.192815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:21.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597519+0000","last_change":"2024-04-26T23:41:24.216811+0000","last_active":"2024-04-26T23:41:25.597519+0000","last_peered":"2024-04-26T23:41:25.597519+0000","last_clean":"2024-04-26T23:41:25.597519+0000","last_became_active":"2024-04-26T23:41:24.216532+0000","last_became_peered":"2024-04-26T23:41:24.216532+0000","last_unstale":"2024-04-26T23:41:25.597519+0000","last_undegraded":"2024-04-26T23:41:25.597519+0000","last_fullsized":"2024-04-26T23:41:25.597519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:10.486440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.213740+0000","last_change":"2024-04-26T23:41:24.201499+0000","last_active":"2024-04-26T23:41:24.213740+0000","last_peered":"2024-04-26T23:41:24.213740+0000","last_clean":"2024-04-26T23:41:24.213740+0000","last_became_active":"2024-04-26T23:41:24.201217+0000","last_became_peered":"2024-04-26T23:41:24.201217+0000","last_unstale":"2024-04-26T23:41:24.213740+0000","last_undegraded":"2024-04-26T23:41:24.213740+0000","last_fullsized":"2024-04-26T23:41:24.213740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:07:32.451536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191338+0000","last_change":"2024-04-26T23:41:24.215543+0000","last_active":"2024-04-26T23:41:25.191338+0000","last_peered":"2024-04-26T23:41:25.191338+0000","last_clean":"2024-04-26T23:41:25.191338+0000","last_became_active":"2024-04-26T23:41:24.214468+0000","last_became_peered":"2024-04-26T23:41:24.214468+0000","last_unstale":"2024-04-26T23:41:25.191338+0000","last_undegraded":"2024-04-26T23:41:25.191338+0000","last_fullsized":"2024-04-26T23:41:25.191338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:57:21.438653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.234331+0000","last_change":"2024-04-26T23:41:24.228988+0000","last_active":"2024-04-26T23:41:24.234331+0000","last_peered":"2024-04-26T23:41:24.234331+0000","last_clean":"2024-04-26T23:41:24.234331+0000","last_became_active":"2024-04-26T23:41:24.228753+0000","last_became_peered":"2024-04-26T23:41:24.228753+0000","last_unstale":"2024-04-26T23:41:24.234331+0000","last_undegraded":"2024-04-26T23:41:24.234331+0000","last_fullsized":"2024-04-26T23:41:24.234331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:59.322866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.214825+0000","last_change":"2024-04-26T23:41:24.213487+0000","last_active":"2024-04-26T23:41:25.214825+0000","last_peered":"2024-04-26T23:41:25.214825+0000","last_clean":"2024-04-26T23:41:25.214825+0000","last_became_active":"2024-04-26T23:41:24.212794+0000","last_became_peered":"2024-04-26T23:41:24.212794+0000","last_unstale":"2024-04-26T23:41:25.214825+0000","last_undegraded":"2024-04-26T23:41:25.214825+0000","last_fullsized":"2024-04-26T23:41:25.214825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:36.344325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190783+0000","last_change":"2024-04-26T23:41:24.202787+0000","last_active":"2024-04-26T23:41:25.190783+0000","last_peered":"2024-04-26T23:41:25.190783+0000","last_clean":"2024-04-26T23:41:25.190783+0000","last_became_active":"2024-04-26T23:41:24.202474+0000","last_became_peered":"2024-04-26T23:41:24.202474+0000","last_unstale":"2024-04-26T23:41:25.190783+0000","last_undegraded":"2024-04-26T23:41:25.190783+0000","last_fullsized":"2024-04-26T23:41:25.190783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:25.948379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597494+0000","last_change":"2024-04-26T23:41:23.211330+0000","last_active":"2024-04-26T23:41:25.597494+0000","last_peered":"2024-04-26T23:41:25.597494+0000","last_clean":"2024-04-26T23:41:25.597494+0000","last_became_active":"2024-04-26T23:41:23.210860+0000","last_became_peered":"2024-04-26T23:41:23.210860+0000","last_unstale":"2024-04-26T23:41:25.597494+0000","last_undegraded":"2024-04-26T23:41:25.597494+0000","last_fullsized":"2024-04-26T23:41:25.597494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:07.156356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.215807+0000","last_change":"2024-04-26T23:41:24.212656+0000","last_active":"2024-04-26T23:41:24.215807+0000","last_peered":"2024-04-26T23:41:24.215807+0000","last_clean":"2024-04-26T23:41:24.215807+0000","last_became_active":"2024-04-26T23:41:24.208356+0000","last_became_peered":"2024-04-26T23:41:24.208356+0000","last_unstale":"2024-04-26T23:41:24.215807+0000","last_undegraded":"2024-04-26T23:41:24.215807+0000","last_fullsized":"2024-04-26T23:41:24.215807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:39.968567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.214878+0000","last_change":"2024-04-26T23:41:23.203211+0000","last_active":"2024-04-26T23:41:25.214878+0000","last_peered":"2024-04-26T23:41:25.214878+0000","last_clean":"2024-04-26T23:41:25.214878+0000","last_became_active":"2024-04-26T23:41:23.202884+0000","last_became_peered":"2024-04-26T23:41:23.202884+0000","last_unstale":"2024-04-26T23:41:25.214878+0000","last_undegraded":"2024-04-26T23:41:25.214878+0000","last_fullsized":"2024-04-26T23:41:25.214878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:38.962512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597235+0000","last_change":"2024-04-26T23:41:23.204160+0000","last_active":"2024-04-26T23:41:25.597235+0000","last_peered":"2024-04-26T23:41:25.597235+0000","last_clean":"2024-04-26T23:41:25.597235+0000","last_became_active":"2024-04-26T23:41:23.203160+0000","last_became_peered":"2024-04-26T23:41:23.203160+0000","last_unstale":"2024-04-26T23:41:25.597235+0000","last_undegraded":"2024-04-26T23:41:25.597235+0000","last_fullsized":"2024-04-26T23:41:25.597235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:07:31.445481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597143+0000","last_change":"2024-04-26T23:41:24.199055+0000","last_active":"2024-04-26T23:41:25.597143+0000","last_peered":"2024-04-26T23:41:25.597143+0000","last_clean":"2024-04-26T23:41:25.597143+0000","last_became_active":"2024-04-26T23:41:24.198722+0000","last_became_peered":"2024-04-26T23:41:24.198722+0000","last_unstale":"2024-04-26T23:41:25.597143+0000","last_undegraded":"2024-04-26T23:41:25.597143+0000","last_fullsized":"2024-04-26T23:41:25.597143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:24.389021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190075+0000","last_change":"2024-04-26T23:41:23.201562+0000","last_active":"2024-04-26T23:41:25.190075+0000","last_peered":"2024-04-26T23:41:25.190075+0000","last_clean":"2024-04-26T23:41:25.190075+0000","last_became_active":"2024-04-26T23:41:23.200676+0000","last_became_peered":"2024-04-26T23:41:23.200676+0000","last_unstale":"2024-04-26T23:41:25.190075+0000","last_undegraded":"2024-04-26T23:41:25.190075+0000","last_fullsized":"2024-04-26T23:41:25.190075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:24.942324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192584+0000","last_change":"2024-04-26T23:41:24.204813+0000","last_active":"2024-04-26T23:41:25.192584+0000","last_peered":"2024-04-26T23:41:25.192584+0000","last_clean":"2024-04-26T23:41:25.192584+0000","last_became_active":"2024-04-26T23:41:24.204553+0000","last_became_peered":"2024-04-26T23:41:24.204553+0000","last_unstale":"2024-04-26T23:41:25.192584+0000","last_undegraded":"2024-04-26T23:41:25.192584+0000","last_fullsized":"2024-04-26T23:41:25.192584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:49:27.834697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215042+0000","last_change":"2024-04-26T23:41:23.206952+0000","last_active":"2024-04-26T23:41:25.215042+0000","last_peered":"2024-04-26T23:41:25.215042+0000","last_clean":"2024-04-26T23:41:25.215042+0000","last_became_active":"2024-04-26T23:41:23.206577+0000","last_became_peered":"2024-04-26T23:41:23.206577+0000","last_unstale":"2024-04-26T23:41:25.215042+0000","last_undegraded":"2024-04-26T23:41:25.215042+0000","last_fullsized":"2024-04-26T23:41:25.215042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:56.090036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190165+0000","last_change":"2024-04-26T23:41:24.205876+0000","last_active":"2024-04-26T23:41:25.190165+0000","last_peered":"2024-04-26T23:41:25.190165+0000","last_clean":"2024-04-26T23:41:25.190165+0000","last_became_active":"2024-04-26T23:41:24.205566+0000","last_became_peered":"2024-04-26T23:41:24.205566+0000","last_unstale":"2024-04-26T23:41:25.190165+0000","last_undegraded":"2024-04-26T23:41:25.190165+0000","last_fullsized":"2024-04-26T23:41:25.190165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:39:55.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190265+0000","last_change":"2024-04-26T23:41:23.208519+0000","last_active":"2024-04-26T23:41:25.190265+0000","last_peered":"2024-04-26T23:41:25.190265+0000","last_clean":"2024-04-26T23:41:25.190265+0000","last_became_active":"2024-04-26T23:41:23.208271+0000","last_became_peered":"2024-04-26T23:41:23.208271+0000","last_unstale":"2024-04-26T23:41:25.190265+0000","last_undegraded":"2024-04-26T23:41:25.190265+0000","last_fullsized":"2024-04-26T23:41:25.190265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:38.962512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.221980+0000","last_change":"2024-04-26T23:41:24.213954+0000","last_active":"2024-04-26T23:41:24.221980+0000","last_peered":"2024-04-26T23:41:24.221980+0000","last_clean":"2024-04-26T23:41:24.221980+0000","last_became_active":"2024-04-26T23:41:24.210823+0000","last_became_peered":"2024-04-26T23:41:24.210823+0000","last_unstale":"2024-04-26T23:41:24.221980+0000","last_undegraded":"2024-04-26T23:41:24.221980+0000","last_fullsized":"2024-04-26T23:41:24.221980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:49.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192815+0000","last_change":"2024-04-26T23:41:23.208525+0000","last_active":"2024-04-26T23:41:25.192815+0000","last_peered":"2024-04-26T23:41:25.192815+0000","last_clean":"2024-04-26T23:41:25.192815+0000","last_became_active":"2024-04-26T23:41:23.208296+0000","last_became_peered":"2024-04-26T23:41:23.208296+0000","last_unstale":"2024-04-26T23:41:25.192815+0000","last_undegraded":"2024-04-26T23:41:25.192815+0000","last_fullsized":"2024-04-26T23:41:25.192815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:56.090036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191122+0000","last_change":"2024-04-26T23:41:24.214223+0000","last_active":"2024-04-26T23:41:25.191122+0000","last_peered":"2024-04-26T23:41:25.191122+0000","last_clean":"2024-04-26T23:41:25.191122+0000","last_became_active":"2024-04-26T23:41:24.212904+0000","last_became_peered":"2024-04-26T23:41:24.212904+0000","last_unstale":"2024-04-26T23:41:25.191122+0000","last_undegraded":"2024-04-26T23:41:25.191122+0000","last_fullsized":"2024-04-26T23:41:25.191122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:49.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215122+0000","last_change":"2024-04-26T23:41:23.203321+0000","last_active":"2024-04-26T23:41:25.215122+0000","last_peered":"2024-04-26T23:41:25.215122+0000","last_clean":"2024-04-26T23:41:25.215122+0000","last_became_active":"2024-04-26T23:41:23.203033+0000","last_became_peered":"2024-04-26T23:41:23.203033+0000","last_unstale":"2024-04-26T23:41:25.215122+0000","last_undegraded":"2024-04-26T23:41:25.215122+0000","last_fullsized":"2024-04-26T23:41:25.215122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.316812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.223197+0000","last_change":"2024-04-26T23:41:24.206337+0000","last_active":"2024-04-26T23:41:24.223197+0000","last_peered":"2024-04-26T23:41:24.223197+0000","last_clean":"2024-04-26T23:41:24.223197+0000","last_became_active":"2024-04-26T23:41:24.206071+0000","last_became_peered":"2024-04-26T23:41:24.206071+0000","last_unstale":"2024-04-26T23:41:24.223197+0000","last_undegraded":"2024-04-26T23:41:24.223197+0000","last_fullsized":"2024-04-26T23:41:24.223197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:59.675062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.226570+0000","last_change":"2024-04-26T23:41:23.209289+0000","last_active":"2024-04-26T23:41:24.226570+0000","last_peered":"2024-04-26T23:41:24.226570+0000","last_clean":"2024-04-26T23:41:24.226570+0000","last_became_active":"2024-04-26T23:41:23.209014+0000","last_became_peered":"2024-04-26T23:41:23.209014+0000","last_unstale":"2024-04-26T23:41:24.226570+0000","last_undegraded":"2024-04-26T23:41:24.226570+0000","last_fullsized":"2024-04-26T23:41:24.226570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:03.988829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.215711+0000","last_change":"2024-04-26T23:41:24.213072+0000","last_active":"2024-04-26T23:41:24.215711+0000","last_peered":"2024-04-26T23:41:24.215711+0000","last_clean":"2024-04-26T23:41:24.215711+0000","last_became_active":"2024-04-26T23:41:24.208424+0000","last_became_peered":"2024-04-26T23:41:24.208424+0000","last_unstale":"2024-04-26T23:41:24.215711+0000","last_undegraded":"2024-04-26T23:41:24.215711+0000","last_fullsized":"2024-04-26T23:41:24.215711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:57.096091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191349+0000","last_change":"2024-04-26T23:41:23.202871+0000","last_active":"2024-04-26T23:41:25.191349+0000","last_peered":"2024-04-26T23:41:25.191349+0000","last_clean":"2024-04-26T23:41:25.191349+0000","last_became_active":"2024-04-26T23:41:23.202591+0000","last_became_peered":"2024-04-26T23:41:23.202591+0000","last_unstale":"2024-04-26T23:41:25.191349+0000","last_undegraded":"2024-04-26T23:41:25.191349+0000","last_fullsized":"2024-04-26T23:41:25.191349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.316812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.229709+0000","last_change":"2024-04-26T23:41:24.224407+0000","last_active":"2024-04-26T23:41:24.229709+0000","last_peered":"2024-04-26T23:41:24.229709+0000","last_clean":"2024-04-26T23:41:24.229709+0000","last_became_active":"2024-04-26T23:41:24.224097+0000","last_became_peered":"2024-04-26T23:41:24.224097+0000","last_unstale":"2024-04-26T23:41:24.229709+0000","last_undegraded":"2024-04-26T23:41:24.229709+0000","last_fullsized":"2024-04-26T23:41:24.229709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:49:27.834697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.214815+0000","last_change":"2024-04-26T23:41:23.207396+0000","last_active":"2024-04-26T23:41:25.214815+0000","last_peered":"2024-04-26T23:41:25.214815+0000","last_clean":"2024-04-26T23:41:25.214815+0000","last_became_active":"2024-04-26T23:41:23.207008+0000","last_became_peered":"2024-04-26T23:41:23.207008+0000","last_unstale":"2024-04-26T23:41:25.214815+0000","last_undegraded":"2024-04-26T23:41:25.214815+0000","last_fullsized":"2024-04-26T23:41:25.214815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:38.934659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.214836+0000","last_change":"2024-04-26T23:41:24.213631+0000","last_active":"2024-04-26T23:41:25.214836+0000","last_peered":"2024-04-26T23:41:25.214836+0000","last_clean":"2024-04-26T23:41:25.214836+0000","last_became_active":"2024-04-26T23:41:24.213186+0000","last_became_peered":"2024-04-26T23:41:24.213186+0000","last_unstale":"2024-04-26T23:41:25.214836+0000","last_undegraded":"2024-04-26T23:41:25.214836+0000","last_fullsized":"2024-04-26T23:41:25.214836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:24.389021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.241612+0000","last_change":"2024-04-26T23:41:23.201745+0000","last_active":"2024-04-26T23:41:24.241612+0000","last_peered":"2024-04-26T23:41:24.241612+0000","last_clean":"2024-04-26T23:41:24.241612+0000","last_became_active":"2024-04-26T23:41:23.200889+0000","last_became_peered":"2024-04-26T23:41:23.200889+0000","last_unstale":"2024-04-26T23:41:24.241612+0000","last_undegraded":"2024-04-26T23:41:24.241612+0000","last_fullsized":"2024-04-26T23:41:24.241612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:07.156356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.228913+0000","last_change":"2024-04-26T23:41:24.222601+0000","last_active":"2024-04-26T23:41:24.228913+0000","last_peered":"2024-04-26T23:41:24.228913+0000","last_clean":"2024-04-26T23:41:24.228913+0000","last_became_active":"2024-04-26T23:41:24.222239+0000","last_became_peered":"2024-04-26T23:41:24.222239+0000","last_unstale":"2024-04-26T23:41:24.228913+0000","last_undegraded":"2024-04-26T23:41:24.228913+0000","last_fullsized":"2024-04-26T23:41:24.228913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:24.389021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191163+0000","last_change":"2024-04-26T23:41:23.200281+0000","last_active":"2024-04-26T23:41:25.191163+0000","last_peered":"2024-04-26T23:41:25.191163+0000","last_clean":"2024-04-26T23:41:25.191163+0000","last_became_active":"2024-04-26T23:41:23.199967+0000","last_became_peered":"2024-04-26T23:41:23.199967+0000","last_unstale":"2024-04-26T23:41:25.191163+0000","last_undegraded":"2024-04-26T23:41:25.191163+0000","last_fullsized":"2024-04-26T23:41:25.191163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:03.988829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.225813+0000","last_change":"2024-04-26T23:41:24.216444+0000","last_active":"2024-04-26T23:41:24.225813+0000","last_peered":"2024-04-26T23:41:24.225813+0000","last_clean":"2024-04-26T23:41:24.225813+0000","last_became_active":"2024-04-26T23:41:24.216284+0000","last_became_peered":"2024-04-26T23:41:24.216284+0000","last_unstale":"2024-04-26T23:41:24.225813+0000","last_undegraded":"2024-04-26T23:41:24.225813+0000","last_fullsized":"2024-04-26T23:41:24.225813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:18.779130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.240721+0000","last_change":"2024-04-26T23:41:23.201500+0000","last_active":"2024-04-26T23:41:24.240721+0000","last_peered":"2024-04-26T23:41:24.240721+0000","last_clean":"2024-04-26T23:41:24.240721+0000","last_became_active":"2024-04-26T23:41:23.200957+0000","last_became_peered":"2024-04-26T23:41:23.200957+0000","last_unstale":"2024-04-26T23:41:24.240721+0000","last_undegraded":"2024-04-26T23:41:24.240721+0000","last_fullsized":"2024-04-26T23:41:24.240721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:38.934659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.229947+0000","last_change":"2024-04-26T23:41:24.226576+0000","last_active":"2024-04-26T23:41:24.229947+0000","last_peered":"2024-04-26T23:41:24.229947+0000","last_clean":"2024-04-26T23:41:24.229947+0000","last_became_active":"2024-04-26T23:41:24.226264+0000","last_became_peered":"2024-04-26T23:41:24.226264+0000","last_unstale":"2024-04-26T23:41:24.229947+0000","last_undegraded":"2024-04-26T23:41:24.229947+0000","last_fullsized":"2024-04-26T23:41:24.229947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:10.486440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192896+0000","last_change":"2024-04-26T23:41:23.203818+0000","last_active":"2024-04-26T23:41:25.192896+0000","last_peered":"2024-04-26T23:41:25.192896+0000","last_clean":"2024-04-26T23:41:25.192896+0000","last_became_active":"2024-04-26T23:41:23.202837+0000","last_became_peered":"2024-04-26T23:41:23.202837+0000","last_unstale":"2024-04-26T23:41:25.192896+0000","last_undegraded":"2024-04-26T23:41:25.192896+0000","last_fullsized":"2024-04-26T23:41:25.192896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:24.942324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190624+0000","last_change":"2024-04-26T23:41:24.213182+0000","last_active":"2024-04-26T23:41:25.190624+0000","last_peered":"2024-04-26T23:41:25.190624+0000","last_clean":"2024-04-26T23:41:25.190624+0000","last_became_active":"2024-04-26T23:41:24.209618+0000","last_became_peered":"2024-04-26T23:41:24.209618+0000","last_unstale":"2024-04-26T23:41:25.190624+0000","last_undegraded":"2024-04-26T23:41:25.190624+0000","last_fullsized":"2024-04-26T23:41:25.190624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:22.105178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.204995+0000","last_change":"2024-04-26T23:41:23.205194+0000","last_active":"2024-04-26T23:41:24.204995+0000","last_peered":"2024-04-26T23:41:24.204995+0000","last_clean":"2024-04-26T23:41:24.204995+0000","last_became_active":"2024-04-26T23:41:23.204713+0000","last_became_peered":"2024-04-26T23:41:23.204713+0000","last_unstale":"2024-04-26T23:41:24.204995+0000","last_undegraded":"2024-04-26T23:41:24.204995+0000","last_fullsized":"2024-04-26T23:41:24.204995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:07:31.445481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.223174+0000","last_change":"2024-04-26T23:41:24.205123+0000","last_active":"2024-04-26T23:41:24.223174+0000","last_peered":"2024-04-26T23:41:24.223174+0000","last_clean":"2024-04-26T23:41:24.223174+0000","last_became_active":"2024-04-26T23:41:24.204841+0000","last_became_peered":"2024-04-26T23:41:24.204841+0000","last_unstale":"2024-04-26T23:41:24.223174+0000","last_undegraded":"2024-04-26T23:41:24.223174+0000","last_fullsized":"2024-04-26T23:41:24.223174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:47.058231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":168,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.196733+0000","last_change":"2024-04-26T23:41:12.783987+0000","last_active":"2024-04-26T23:41:24.196733+0000","last_peered":"2024-04-26T23:41:24.196733+0000","last_clean":"2024-04-26T23:41:24.196733+0000","last_became_active":"2024-04-26T23:41:12.782901+0000","last_became_peered":"2024-04-26T23:41:12.782901+0000","last_unstale":"2024-04-26T23:41:24.196733+0000","last_undegraded":"2024-04-26T23:41:24.196733+0000","last_fullsized":"2024-04-26T23:41:24.196733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_clean_scrub_stamp":"2024-04-26T23:41:11.626255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:16.305521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.189889+0000","last_change":"2024-04-26T23:41:23.200012+0000","last_active":"2024-04-26T23:41:25.189889+0000","last_peered":"2024-04-26T23:41:25.189889+0000","last_clean":"2024-04-26T23:41:25.189889+0000","last_became_active":"2024-04-26T23:41:23.199386+0000","last_became_peered":"2024-04-26T23:41:23.199386+0000","last_unstale":"2024-04-26T23:41:25.189889+0000","last_undegraded":"2024-04-26T23:41:25.189889+0000","last_fullsized":"2024-04-26T23:41:25.189889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:38.934659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597544+0000","last_change":"2024-04-26T23:41:24.206857+0000","last_active":"2024-04-26T23:41:25.597544+0000","last_peered":"2024-04-26T23:41:25.597544+0000","last_clean":"2024-04-26T23:41:25.597544+0000","last_became_active":"2024-04-26T23:41:24.206372+0000","last_became_peered":"2024-04-26T23:41:24.206372+0000","last_unstale":"2024-04-26T23:41:25.597544+0000","last_undegraded":"2024-04-26T23:41:25.597544+0000","last_fullsized":"2024-04-26T23:41:25.597544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:39:55.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.196667+0000","last_change":"2024-04-26T23:41:23.217608+0000","last_active":"2024-04-26T23:41:24.196667+0000","last_peered":"2024-04-26T23:41:24.196667+0000","last_clean":"2024-04-26T23:41:24.196667+0000","last_became_active":"2024-04-26T23:41:23.217314+0000","last_became_peered":"2024-04-26T23:41:23.217314+0000","last_unstale":"2024-04-26T23:41:24.196667+0000","last_undegraded":"2024-04-26T23:41:24.196667+0000","last_fullsized":"2024-04-26T23:41:24.196667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:24.942324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.213801+0000","last_change":"2024-04-26T23:41:24.204857+0000","last_active":"2024-04-26T23:41:24.213801+0000","last_peered":"2024-04-26T23:41:24.213801+0000","last_clean":"2024-04-26T23:41:24.213801+0000","last_became_active":"2024-04-26T23:41:24.204562+0000","last_became_peered":"2024-04-26T23:41:24.204562+0000","last_unstale":"2024-04-26T23:41:24.213801+0000","last_undegraded":"2024-04-26T23:41:24.213801+0000","last_fullsized":"2024-04-26T23:41:24.213801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:52:47.206669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.206737+0000","last_change":"2024-04-26T23:41:23.200698+0000","last_active":"2024-04-26T23:41:24.206737+0000","last_peered":"2024-04-26T23:41:24.206737+0000","last_clean":"2024-04-26T23:41:24.206737+0000","last_became_active":"2024-04-26T23:41:23.200370+0000","last_became_peered":"2024-04-26T23:41:23.200370+0000","last_unstale":"2024-04-26T23:41:24.206737+0000","last_undegraded":"2024-04-26T23:41:24.206737+0000","last_fullsized":"2024-04-26T23:41:24.206737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:52:46.200614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192390+0000","last_change":"2024-04-26T23:41:24.210162+0000","last_active":"2024-04-26T23:41:25.192390+0000","last_peered":"2024-04-26T23:41:25.192390+0000","last_clean":"2024-04-26T23:41:25.192390+0000","last_became_active":"2024-04-26T23:41:24.208845+0000","last_became_peered":"2024-04-26T23:41:24.208845+0000","last_unstale":"2024-04-26T23:41:25.192390+0000","last_undegraded":"2024-04-26T23:41:25.192390+0000","last_fullsized":"2024-04-26T23:41:25.192390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:24.389021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191434+0000","last_change":"2024-04-26T23:41:23.206844+0000","last_active":"2024-04-26T23:41:25.191434+0000","last_peered":"2024-04-26T23:41:25.191434+0000","last_clean":"2024-04-26T23:41:25.191434+0000","last_became_active":"2024-04-26T23:41:23.206402+0000","last_became_peered":"2024-04-26T23:41:23.206402+0000","last_unstale":"2024-04-26T23:41:25.191434+0000","last_undegraded":"2024-04-26T23:41:25.191434+0000","last_fullsized":"2024-04-26T23:41:25.191434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:56.090036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190708+0000","last_change":"2024-04-26T23:41:24.206303+0000","last_active":"2024-04-26T23:41:25.190708+0000","last_peered":"2024-04-26T23:41:25.190708+0000","last_clean":"2024-04-26T23:41:25.190708+0000","last_became_active":"2024-04-26T23:41:24.202022+0000","last_became_peered":"2024-04-26T23:41:24.202022+0000","last_unstale":"2024-04-26T23:41:25.190708+0000","last_undegraded":"2024-04-26T23:41:25.190708+0000","last_fullsized":"2024-04-26T23:41:25.190708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:59.322866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192695+0000","last_change":"2024-04-26T23:41:23.206647+0000","last_active":"2024-04-26T23:41:25.192695+0000","last_peered":"2024-04-26T23:41:25.192695+0000","last_clean":"2024-04-26T23:41:25.192695+0000","last_became_active":"2024-04-26T23:41:23.206356+0000","last_became_peered":"2024-04-26T23:41:23.206356+0000","last_unstale":"2024-04-26T23:41:25.192695+0000","last_undegraded":"2024-04-26T23:41:25.192695+0000","last_fullsized":"2024-04-26T23:41:25.192695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.316812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190853+0000","last_change":"2024-04-26T23:41:24.211005+0000","last_active":"2024-04-26T23:41:25.190853+0000","last_peered":"2024-04-26T23:41:25.190853+0000","last_clean":"2024-04-26T23:41:25.190853+0000","last_became_active":"2024-04-26T23:41:24.210556+0000","last_became_peered":"2024-04-26T23:41:24.210556+0000","last_unstale":"2024-04-26T23:41:25.190853+0000","last_undegraded":"2024-04-26T23:41:25.190853+0000","last_fullsized":"2024-04-26T23:41:25.190853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:08:46.957484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.198914+0000","last_change":"2024-04-26T23:41:23.217996+0000","last_active":"2024-04-26T23:41:24.198914+0000","last_peered":"2024-04-26T23:41:24.198914+0000","last_clean":"2024-04-26T23:41:24.198914+0000","last_became_active":"2024-04-26T23:41:23.217230+0000","last_became_peered":"2024-04-26T23:41:23.217230+0000","last_unstale":"2024-04-26T23:41:24.198914+0000","last_undegraded":"2024-04-26T23:41:24.198914+0000","last_fullsized":"2024-04-26T23:41:24.198914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:16.153073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192392+0000","last_change":"2024-04-26T23:41:24.209392+0000","last_active":"2024-04-26T23:41:25.192392+0000","last_peered":"2024-04-26T23:41:25.192392+0000","last_clean":"2024-04-26T23:41:25.192392+0000","last_became_active":"2024-04-26T23:41:24.208952+0000","last_became_peered":"2024-04-26T23:41:24.208952+0000","last_unstale":"2024-04-26T23:41:25.192392+0000","last_undegraded":"2024-04-26T23:41:25.192392+0000","last_fullsized":"2024-04-26T23:41:25.192392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:50.550871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215906+0000","last_change":"2024-04-26T23:41:23.209568+0000","last_active":"2024-04-26T23:41:25.215906+0000","last_peered":"2024-04-26T23:41:25.215906+0000","last_clean":"2024-04-26T23:41:25.215906+0000","last_became_active":"2024-04-26T23:41:23.208643+0000","last_became_peered":"2024-04-26T23:41:23.208643+0000","last_unstale":"2024-04-26T23:41:25.215906+0000","last_undegraded":"2024-04-26T23:41:25.215906+0000","last_fullsized":"2024-04-26T23:41:25.215906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:25:34.809716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597606+0000","last_change":"2024-04-26T23:41:24.206669+0000","last_active":"2024-04-26T23:41:25.597606+0000","last_peered":"2024-04-26T23:41:25.597606+0000","last_clean":"2024-04-26T23:41:25.597606+0000","last_became_active":"2024-04-26T23:41:24.206394+0000","last_became_peered":"2024-04-26T23:41:24.206394+0000","last_unstale":"2024-04-26T23:41:25.597606+0000","last_undegraded":"2024-04-26T23:41:25.597606+0000","last_fullsized":"2024-04-26T23:41:25.597606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:26.029165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215176+0000","last_change":"2024-04-26T23:41:23.212534+0000","last_active":"2024-04-26T23:41:25.215176+0000","last_peered":"2024-04-26T23:41:25.215176+0000","last_clean":"2024-04-26T23:41:25.215176+0000","last_became_active":"2024-04-26T23:41:23.212211+0000","last_became_peered":"2024-04-26T23:41:23.212211+0000","last_unstale":"2024-04-26T23:41:25.215176+0000","last_undegraded":"2024-04-26T23:41:25.215176+0000","last_fullsized":"2024-04-26T23:41:25.215176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:24.942324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.214065+0000","last_change":"2024-04-26T23:41:24.202665+0000","last_active":"2024-04-26T23:41:24.214065+0000","last_peered":"2024-04-26T23:41:24.214065+0000","last_clean":"2024-04-26T23:41:24.214065+0000","last_became_active":"2024-04-26T23:41:24.202391+0000","last_became_peered":"2024-04-26T23:41:24.202391+0000","last_unstale":"2024-04-26T23:41:24.214065+0000","last_undegraded":"2024-04-26T23:41:24.214065+0000","last_fullsized":"2024-04-26T23:41:24.214065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:08.162411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.196517+0000","last_change":"2024-04-26T23:41:23.216618+0000","last_active":"2024-04-26T23:41:24.196517+0000","last_peered":"2024-04-26T23:41:24.196517+0000","last_clean":"2024-04-26T23:41:24.196517+0000","last_became_active":"2024-04-26T23:41:23.216394+0000","last_became_peered":"2024-04-26T23:41:23.216394+0000","last_unstale":"2024-04-26T23:41:24.196517+0000","last_undegraded":"2024-04-26T23:41:24.196517+0000","last_fullsized":"2024-04-26T23:41:24.196517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:56.090036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190709+0000","last_change":"2024-04-26T23:41:24.213349+0000","last_active":"2024-04-26T23:41:25.190709+0000","last_peered":"2024-04-26T23:41:25.190709+0000","last_clean":"2024-04-26T23:41:25.190709+0000","last_became_active":"2024-04-26T23:41:24.212106+0000","last_became_peered":"2024-04-26T23:41:24.212106+0000","last_unstale":"2024-04-26T23:41:25.190709+0000","last_undegraded":"2024-04-26T23:41:25.190709+0000","last_fullsized":"2024-04-26T23:41:25.190709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:57.096091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192456+0000","last_change":"2024-04-26T23:41:23.216515+0000","last_active":"2024-04-26T23:41:25.192456+0000","last_peered":"2024-04-26T23:41:25.192456+0000","last_clean":"2024-04-26T23:41:25.192456+0000","last_became_active":"2024-04-26T23:41:23.216281+0000","last_became_peered":"2024-04-26T23:41:23.216281+0000","last_unstale":"2024-04-26T23:41:25.192456+0000","last_undegraded":"2024-04-26T23:41:25.192456+0000","last_fullsized":"2024-04-26T23:41:25.192456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:38.934659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597219+0000","last_change":"2024-04-26T23:41:24.199305+0000","last_active":"2024-04-26T23:41:25.597219+0000","last_peered":"2024-04-26T23:41:25.597219+0000","last_clean":"2024-04-26T23:41:25.597219+0000","last_became_active":"2024-04-26T23:41:24.199005+0000","last_became_peered":"2024-04-26T23:41:24.199005+0000","last_unstale":"2024-04-26T23:41:25.597219+0000","last_undegraded":"2024-04-26T23:41:25.597219+0000","last_fullsized":"2024-04-26T23:41:25.597219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:50.550871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192447+0000","last_change":"2024-04-26T23:41:23.215183+0000","last_active":"2024-04-26T23:41:25.192447+0000","last_peered":"2024-04-26T23:41:25.192447+0000","last_clean":"2024-04-26T23:41:25.192447+0000","last_became_active":"2024-04-26T23:41:23.214884+0000","last_became_peered":"2024-04-26T23:41:23.214884+0000","last_unstale":"2024-04-26T23:41:25.192447+0000","last_undegraded":"2024-04-26T23:41:25.192447+0000","last_fullsized":"2024-04-26T23:41:25.192447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:38.962512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597577+0000","last_change":"2024-04-26T23:41:24.200053+0000","last_active":"2024-04-26T23:41:25.597577+0000","last_peered":"2024-04-26T23:41:25.597577+0000","last_clean":"2024-04-26T23:41:25.597577+0000","last_became_active":"2024-04-26T23:41:24.199582+0000","last_became_peered":"2024-04-26T23:41:24.199582+0000","last_unstale":"2024-04-26T23:41:25.597577+0000","last_undegraded":"2024-04-26T23:41:25.597577+0000","last_fullsized":"2024-04-26T23:41:25.597577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:22:11.814233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.230376+0000","last_change":"2024-04-26T23:41:23.217680+0000","last_active":"2024-04-26T23:41:24.230376+0000","last_peered":"2024-04-26T23:41:24.230376+0000","last_clean":"2024-04-26T23:41:24.230376+0000","last_became_active":"2024-04-26T23:41:23.217310+0000","last_became_peered":"2024-04-26T23:41:23.217310+0000","last_unstale":"2024-04-26T23:41:24.230376+0000","last_undegraded":"2024-04-26T23:41:24.230376+0000","last_fullsized":"2024-04-26T23:41:24.230376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:47.997792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215087+0000","last_change":"2024-04-26T23:41:24.212308+0000","last_active":"2024-04-26T23:41:25.215087+0000","last_peered":"2024-04-26T23:41:25.215087+0000","last_clean":"2024-04-26T23:41:25.215087+0000","last_became_active":"2024-04-26T23:41:24.210877+0000","last_became_peered":"2024-04-26T23:41:24.210877+0000","last_unstale":"2024-04-26T23:41:25.215087+0000","last_undegraded":"2024-04-26T23:41:25.215087+0000","last_fullsized":"2024-04-26T23:41:25.215087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:50.550871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190698+0000","last_change":"2024-04-26T23:41:24.205082+0000","last_active":"2024-04-26T23:41:25.190698+0000","last_peered":"2024-04-26T23:41:25.190698+0000","last_clean":"2024-04-26T23:41:25.190698+0000","last_became_active":"2024-04-26T23:41:24.204829+0000","last_became_peered":"2024-04-26T23:41:24.204829+0000","last_unstale":"2024-04-26T23:41:25.190698+0000","last_undegraded":"2024-04-26T23:41:25.190698+0000","last_fullsized":"2024-04-26T23:41:25.190698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:16.493479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.232204+0000","last_change":"2024-04-26T23:41:23.216385+0000","last_active":"2024-04-26T23:41:24.232204+0000","last_peered":"2024-04-26T23:41:24.232204+0000","last_clean":"2024-04-26T23:41:24.232204+0000","last_became_active":"2024-04-26T23:41:23.215863+0000","last_became_peered":"2024-04-26T23:41:23.215863+0000","last_unstale":"2024-04-26T23:41:24.232204+0000","last_undegraded":"2024-04-26T23:41:24.232204+0000","last_fullsized":"2024-04-26T23:41:24.232204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.316812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190471+0000","last_change":"2024-04-26T23:41:24.221698+0000","last_active":"2024-04-26T23:41:25.190471+0000","last_peered":"2024-04-26T23:41:25.190471+0000","last_clean":"2024-04-26T23:41:25.190471+0000","last_became_active":"2024-04-26T23:41:24.221304+0000","last_became_peered":"2024-04-26T23:41:24.221304+0000","last_unstale":"2024-04-26T23:41:25.190471+0000","last_undegraded":"2024-04-26T23:41:25.190471+0000","last_fullsized":"2024-04-26T23:41:25.190471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:26.029165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.229287+0000","last_change":"2024-04-26T23:41:23.218166+0000","last_active":"2024-04-26T23:41:24.229287+0000","last_peered":"2024-04-26T23:41:24.229287+0000","last_clean":"2024-04-26T23:41:24.229287+0000","last_became_active":"2024-04-26T23:41:23.217699+0000","last_became_peered":"2024-04-26T23:41:23.217699+0000","last_unstale":"2024-04-26T23:41:24.229287+0000","last_undegraded":"2024-04-26T23:41:24.229287+0000","last_fullsized":"2024-04-26T23:41:24.229287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:25:34.809716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.220098+0000","last_change":"2024-04-26T23:41:24.213827+0000","last_active":"2024-04-26T23:41:24.220098+0000","last_peered":"2024-04-26T23:41:24.220098+0000","last_clean":"2024-04-26T23:41:24.220098+0000","last_became_active":"2024-04-26T23:41:24.212763+0000","last_became_peered":"2024-04-26T23:41:24.212763+0000","last_unstale":"2024-04-26T23:41:24.220098+0000","last_undegraded":"2024-04-26T23:41:24.220098+0000","last_fullsized":"2024-04-26T23:41:24.220098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:25:35.815770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597735+0000","last_change":"2024-04-26T23:41:23.204817+0000","last_active":"2024-04-26T23:41:25.597735+0000","last_peered":"2024-04-26T23:41:25.597735+0000","last_clean":"2024-04-26T23:41:25.597735+0000","last_became_active":"2024-04-26T23:41:23.204536+0000","last_became_peered":"2024-04-26T23:41:23.204536+0000","last_unstale":"2024-04-26T23:41:25.597735+0000","last_undegraded":"2024-04-26T23:41:25.597735+0000","last_fullsized":"2024-04-26T23:41:25.597735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:03.988829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597451+0000","last_change":"2024-04-26T23:41:24.209853+0000","last_active":"2024-04-26T23:41:25.597451+0000","last_peered":"2024-04-26T23:41:25.597451+0000","last_clean":"2024-04-26T23:41:25.597451+0000","last_became_active":"2024-04-26T23:41:24.208923+0000","last_became_peered":"2024-04-26T23:41:24.208923+0000","last_unstale":"2024-04-26T23:41:25.597451+0000","last_undegraded":"2024-04-26T23:41:25.597451+0000","last_fullsized":"2024-04-26T23:41:25.597451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:44.639875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:41:24.232513+0000","last_change":"2024-04-26T23:41:23.213860+0000","last_active":"2024-04-26T23:41:24.232513+0000","last_peered":"2024-04-26T23:41:24.232513+0000","last_clean":"2024-04-26T23:41:24.232513+0000","last_became_active":"2024-04-26T23:41:23.213552+0000","last_became_peered":"2024-04-26T23:41:23.213552+0000","last_unstale":"2024-04-26T23:41:24.232513+0000","last_undegraded":"2024-04-26T23:41:24.232513+0000","last_fullsized":"2024-04-26T23:41:24.232513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:45:21.419358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":196608,"data_stored":64724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":64760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":64794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:41:28.665 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T23:41:28.665 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T23:41:28.665 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T23:41:28.665 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T23:41:28.666 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T23:41:28.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.834+0000 7f00ab600640 1 Processor -- start 2024-04-26T23:41:28.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.834+0000 7f00ab600640 1 -- start start 2024-04-26T23:41:28.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.834+0000 7f00ab600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00a40725a0 0x7f00a40cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:28.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.834+0000 7f00ab600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f00a4073f30 0x7f00a4072980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:28.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.834+0000 7f00ab600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00a40cfef0 con 0x7f00a4072ec0 2024-04-26T23:41:28.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.834+0000 7f00ab600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f00a40cddc0 con 0x7f00a4073f30 2024-04-26T23:41:28.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.834+0000 7f00ab600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f00a40d01b0 con 0x7f00a40725a0 2024-04-26T23:41:28.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.834+0000 7f00a3e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f00a4073f30 0x7f00a4072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:28.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.838+0000 7f00a3e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f00a4073f30 0x7f00a4072980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33788/0 (socket says 172.21.15.137:33788) 2024-04-26T23:41:28.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.838+0000 7f00a3e00640 1 -- 172.21.15.137:0/2872156357 learned_addr learned my addr 172.21.15.137:0/2872156357 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:28.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.838+0000 7f00a8c00640 1 --2- 172.21.15.137:0/2872156357 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00a40725a0 0x7f00a40cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:28.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.838+0000 7f00a3e00640 1 -- 172.21.15.137:0/2872156357 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00a40725a0 msgr2=0x7f00a40cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:28.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.838+0000 7f00a3e00640 1 --2- 172.21.15.137:0/2872156357 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00a40725a0 0x7f00a40cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.838+0000 7f00a3e00640 1 -- 172.21.15.137:0/2872156357 >> v1:172.21.15.170:6789/0 conn(0x7f00a4072ec0 legacy=0x7f00a40b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:28.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.838+0000 7f00a3e00640 1 -- 172.21.15.137:0/2872156357 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a40d0490 con 0x7f00a4073f30 2024-04-26T23:41:28.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.838+0000 7f00a8c00640 1 --2- 172.21.15.137:0/2872156357 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00a40725a0 0x7f00a40cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:28.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.838+0000 7f00a3e00640 1 --2- 172.21.15.137:0/2872156357 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00a4073f30 0x7f00a4072980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f009000bb10 tx=0x7f009001ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a972576afdcbc0ee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:28.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.838+0000 7f00a3400640 1 -- 172.21.15.137:0/2872156357 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00900b4070 con 0x7f00a4073f30 2024-04-26T23:41:28.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.838+0000 7f00a3400640 1 -- 172.21.15.137:0/2872156357 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00900a7cf0 con 0x7f00a4073f30 2024-04-26T23:41:28.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.838+0000 7f00a3400640 1 -- 172.21.15.137:0/2872156357 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00900af660 con 0x7f00a4073f30 2024-04-26T23:41:28.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00ab600640 1 -- 172.21.15.137:0/2872156357 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00a4073f30 msgr2=0x7f00a4072980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:28.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00ab600640 1 --2- 172.21.15.137:0/2872156357 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00a4073f30 0x7f00a4072980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f009000bb10 tx=0x7f009001ec00 comp rx=0 tx=0).stop 2024-04-26T23:41:28.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00ab600640 1 -- 172.21.15.137:0/2872156357 shutdown_connections 2024-04-26T23:41:28.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00ab600640 1 --2- 172.21.15.137:0/2872156357 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00a4073f30 0x7f00a4072980 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00ab600640 1 --2- 172.21.15.137:0/2872156357 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00a40725a0 0x7f00a40cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00ab600640 1 -- 172.21.15.137:0/2872156357 >> 172.21.15.137:0/2872156357 conn(0x7f00a406c5d0 msgr2=0x7f00a406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:28.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00ab600640 1 -- 172.21.15.137:0/2872156357 shutdown_connections 2024-04-26T23:41:28.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00ab600640 1 -- 172.21.15.137:0/2872156357 wait complete. 2024-04-26T23:41:28.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00ab600640 1 Processor -- start 2024-04-26T23:41:28.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00ab600640 1 -- start start 2024-04-26T23:41:28.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00ab600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00a40725a0 0x7f00a40b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:28.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00ab600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00a4072ec0 0x7f00a4159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:28.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00ab600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00a4073f30 0x7f00a4159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:28.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00ab600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f00a40b5110 con 0x7f00a4072ec0 2024-04-26T23:41:28.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00ab600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f00a40b4f90 con 0x7f00a40725a0 2024-04-26T23:41:28.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00ab600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f00a40b5290 con 0x7f00a4073f30 2024-04-26T23:41:28.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00a3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00a4072ec0 0x7f00a4159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:28.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00a3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00a4072ec0 0x7f00a4159530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33802/0 (socket says 172.21.15.137:33802) 2024-04-26T23:41:28.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00a3e00640 1 -- 172.21.15.137:0/1080348748 learned_addr learned my addr 172.21.15.137:0/1080348748 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:28.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00a8c00640 1 --2- 172.21.15.137:0/1080348748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00a40725a0 0x7f00a40b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:28.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00a9600640 1 --2- 172.21.15.137:0/1080348748 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00a4073f30 0x7f00a4159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:28.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00a3e00640 1 -- 172.21.15.137:0/1080348748 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00a4073f30 msgr2=0x7f00a4159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:28.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00a3e00640 1 --2- 172.21.15.137:0/1080348748 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00a4073f30 0x7f00a4159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00a3e00640 1 -- 172.21.15.137:0/1080348748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00a40725a0 msgr2=0x7f00a40b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:28.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00a3e00640 1 --2- 172.21.15.137:0/1080348748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00a40725a0 0x7f00a40b0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:28.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00a3e00640 1 -- 172.21.15.137:0/1080348748 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a4072170 con 0x7f00a4072ec0 2024-04-26T23:41:28.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00a9600640 1 --2- 172.21.15.137:0/1080348748 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00a4073f30 0x7f00a4159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:28.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.842+0000 7f00a3e00640 1 --2- 172.21.15.137:0/1080348748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00a4072ec0 0x7f00a4159530 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f009000b2c0 tx=0x7f009001b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:28.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.846+0000 7f00a0c00640 1 -- 172.21.15.137:0/1080348748 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00900be020 con 0x7f00a4072ec0 2024-04-26T23:41:28.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.846+0000 7f00a0c00640 1 -- 172.21.15.137:0/1080348748 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00900afc10 con 0x7f00a4072ec0 2024-04-26T23:41:28.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.846+0000 7f00ab600640 1 -- 172.21.15.137:0/1080348748 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a40b11c0 con 0x7f00a4072ec0 2024-04-26T23:41:28.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.846+0000 7f00a0c00640 1 -- 172.21.15.137:0/1080348748 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00900b4040 con 0x7f00a4072ec0 2024-04-26T23:41:28.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.846+0000 7f00ab600640 1 -- 172.21.15.137:0/1080348748 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a4136b70 con 0x7f00a4072ec0 2024-04-26T23:41:28.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.846+0000 7f00ab600640 1 -- 172.21.15.137:0/1080348748 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00a406a4b0 con 0x7f00a4072ec0 2024-04-26T23:41:28.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.846+0000 7f00a0c00640 1 -- 172.21.15.137:0/1080348748 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f00900c1020 con 0x7f00a4072ec0 2024-04-26T23:41:28.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.846+0000 7f00a0c00640 1 --2- 172.21.15.137:0/1080348748 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0084068380 0x7f008406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:28.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.846+0000 7f00a0c00640 1 -- 172.21.15.137:0/1080348748 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0090123970 con 0x7f00a4072ec0 2024-04-26T23:41:28.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.846+0000 7f00a8c00640 1 --2- 172.21.15.137:0/1080348748 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0084068380 0x7f008406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:28.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.846+0000 7f00a8c00640 1 --2- 172.21.15.137:0/1080348748 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0084068380 0x7f008406a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0098006e90 tx=0x7f0098008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:28.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:28.850+0000 7f00a0c00640 1 -- 172.21.15.137:0/1080348748 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f00900c8030 con 0x7f00a4072ec0 2024-04-26T23:41:29.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.046+0000 7f00ab600640 1 -- 172.21.15.137:0/1080348748 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f00a4072380 con 0x7f00a4072ec0 2024-04-26T23:41:29.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.050+0000 7f00a0c00640 1 -- 172.21.15.137:0/1080348748 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168090 (secure 0 0 0) 0x7f0090018820 con 0x7f00a4072ec0 2024-04-26T23:41:29.056 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:29.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.050+0000 7f00ab600640 1 -- 172.21.15.137:0/1080348748 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0084068380 msgr2=0x7f008406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:29.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.050+0000 7f00ab600640 1 --2- 172.21.15.137:0/1080348748 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0084068380 0x7f008406a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0098006e90 tx=0x7f0098008040 comp rx=0 tx=0).stop 2024-04-26T23:41:29.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.050+0000 7f00ab600640 1 -- 172.21.15.137:0/1080348748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00a4072ec0 msgr2=0x7f00a4159530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:29.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.050+0000 7f00ab600640 1 --2- 172.21.15.137:0/1080348748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00a4072ec0 0x7f00a4159530 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f009000b2c0 tx=0x7f009001b9a0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.050+0000 7f00ab600640 1 -- 172.21.15.137:0/1080348748 shutdown_connections 2024-04-26T23:41:29.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.050+0000 7f00ab600640 1 --2- 172.21.15.137:0/1080348748 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0084068380 0x7f008406a840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.050+0000 7f00ab600640 1 --2- 172.21.15.137:0/1080348748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00a4072ec0 0x7f00a4159530 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.050+0000 7f00ab600640 1 --2- 172.21.15.137:0/1080348748 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00a4073f30 0x7f00a4159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.050+0000 7f00ab600640 1 --2- 172.21.15.137:0/1080348748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00a40725a0 0x7f00a40b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.050+0000 7f00ab600640 1 -- 172.21.15.137:0/1080348748 >> 172.21.15.137:0/1080348748 conn(0x7f00a406c5d0 msgr2=0x7f00a4143350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:29.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.050+0000 7f00ab600640 1 -- 172.21.15.137:0/1080348748 shutdown_connections 2024-04-26T23:41:29.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.050+0000 7f00ab600640 1 -- 172.21.15.137:0/1080348748 wait complete. 2024-04-26T23:41:29.076 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2210112838},{"type":"v1","addr":"172.21.15.137:6833","nonce":2210112838}]},"active_addr":"172.21.15.137:6833/2210112838","active_change":"2024-04-26T23:41:03.575014+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":109814638}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":4250541704}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":4277839491}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":677950783}]}]} 2024-04-26T23:41:29.080 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T23:41:29.080 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T23:41:29.080 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:29.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccfce00640 1 Processor -- start 2024-04-26T23:41:29.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccfce00640 1 -- start start 2024-04-26T23:41:29.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccfce00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fccf80d1ac0 0x7fccf80b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:29.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccfce00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccf80b1b30 con 0x7fccf815d2b0 2024-04-26T23:41:29.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccfce00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccf80b1e10 con 0x7fccf815ced0 2024-04-26T23:41:29.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccfce00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fccf80b23f0 con 0x7fccf80d1ac0 2024-04-26T23:41:29.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf6800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fccf815d2b0 0x7fccf80b12d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46040/0 (socket says 172.21.15.137:46040) 2024-04-26T23:41:29.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf6800640 1 -- 172.21.15.137:0/158168736 learned_addr learned my addr 172.21.15.137:0/158168736 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:29.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf5400640 1 --2- 172.21.15.137:0/158168736 >> v2:172.21.15.170:3300/0 conn(0x7fccf80d1ac0 0x7fccf80b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:29.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf4a00640 1 -- 172.21.15.137:0/158168736 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 815065308 0 0) 0x7fccf80b1b30 con 0x7fccf815d2b0 2024-04-26T23:41:29.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf4a00640 1 -- 172.21.15.137:0/158168736 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccdc003530 con 0x7fccf815d2b0 2024-04-26T23:41:29.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf4a00640 1 -- 172.21.15.137:0/158168736 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2107697856 0 0) 0x7fccdc003530 con 0x7fccf815d2b0 2024-04-26T23:41:29.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf4a00640 1 -- 172.21.15.137:0/158168736 >> v2:172.21.15.170:3300/0 conn(0x7fccf80d1ac0 msgr2=0x7fccf80b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:29.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf4a00640 1 --2- 172.21.15.137:0/158168736 >> v2:172.21.15.170:3300/0 conn(0x7fccf80d1ac0 0x7fccf80b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf4a00640 1 -- 172.21.15.137:0/158168736 >> v1:172.21.15.170:6789/0 conn(0x7fccf815ced0 legacy=0x7fccf80d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:29.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf4a00640 1 -- 172.21.15.137:0/158168736 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf80b26d0 con 0x7fccf815d2b0 2024-04-26T23:41:29.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf4a00640 1 -- 172.21.15.137:0/158168736 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fccf0001680 con 0x7fccf815d2b0 2024-04-26T23:41:29.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf4a00640 1 -- 172.21.15.137:0/158168736 >> v1:172.21.15.137:6789/0 conn(0x7fccf815d2b0 legacy=0x7fccf80b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:29.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf4a00640 1 --2- 172.21.15.137:0/158168736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccdc0039c0 0x7fccdc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:29.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf4a00640 1 --2- 172.21.15.137:0/158168736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccdc004810 0x7fccdc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:29.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf4a00640 1 --2- 172.21.15.137:0/158168736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccdc0051d0 0x7fccdc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:29.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf4a00640 1 -- 172.21.15.137:0/158168736 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fccf80b23f0 con 0x7fccdc004810 2024-04-26T23:41:29.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf4a00640 1 -- 172.21.15.137:0/158168736 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc00c070 con 0x7fccdc0039c0 2024-04-26T23:41:29.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf4a00640 1 -- 172.21.15.137:0/158168736 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fccdc00c270 con 0x7fccdc0051d0 2024-04-26T23:41:29.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf5400640 1 --2- 172.21.15.137:0/158168736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccdc004810 0x7fccdc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:29.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf5e00640 1 --2- 172.21.15.137:0/158168736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccdc0039c0 0x7fccdc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:29.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf6800640 1 --2- 172.21.15.137:0/158168736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccdc0051d0 0x7fccdc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:29.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf5400640 1 -- 172.21.15.137:0/158168736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccdc0051d0 msgr2=0x7fccdc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:29.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf5400640 1 --2- 172.21.15.137:0/158168736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccdc0051d0 0x7fccdc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf5400640 1 -- 172.21.15.137:0/158168736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccdc0039c0 msgr2=0x7fccdc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:29.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf5400640 1 --2- 172.21.15.137:0/158168736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccdc0039c0 0x7fccdc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf5400640 1 -- 172.21.15.137:0/158168736 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccdc003530 con 0x7fccdc004810 2024-04-26T23:41:29.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.210+0000 7fccf6800640 1 -- 172.21.15.137:0/158168736 reap_dead start 2024-04-26T23:41:29.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.214+0000 7fccf5400640 1 --2- 172.21.15.137:0/158168736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccdc004810 0x7fccdc004c90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009ae0 tx=0x7fcce401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f836c02f442facf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:29.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.214+0000 7fccf4a00640 1 -- 172.21.15.137:0/158168736 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce40b2070 con 0x7fccdc004810 2024-04-26T23:41:29.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.214+0000 7fccf4a00640 1 -- 172.21.15.137:0/158168736 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce40a5550 con 0x7fccdc004810 2024-04-26T23:41:29.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.214+0000 7fccf4a00640 1 -- 172.21.15.137:0/158168736 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce40096b0 con 0x7fccdc004810 2024-04-26T23:41:29.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.214+0000 7fccfce00640 1 -- 172.21.15.137:0/158168736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccdc004810 msgr2=0x7fccdc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:29.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.214+0000 7fccfce00640 1 --2- 172.21.15.137:0/158168736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccdc004810 0x7fccdc004c90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009ae0 tx=0x7fcce401ca70 comp rx=0 tx=0).stop 2024-04-26T23:41:29.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.214+0000 7fccfce00640 1 -- 172.21.15.137:0/158168736 shutdown_connections 2024-04-26T23:41:29.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.214+0000 7fccfce00640 1 --2- 172.21.15.137:0/158168736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccdc004810 0x7fccdc004c90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.214+0000 7fccfce00640 1 -- 172.21.15.137:0/158168736 >> 172.21.15.137:0/158168736 conn(0x7fccf809ba60 msgr2=0x7fccf809be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:29.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.214+0000 7fccfce00640 1 -- 172.21.15.137:0/158168736 shutdown_connections 2024-04-26T23:41:29.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.214+0000 7fccfce00640 1 -- 172.21.15.137:0/158168736 wait complete. 2024-04-26T23:41:29.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.218+0000 7fccfce00640 1 Processor -- start 2024-04-26T23:41:29.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.218+0000 7fccfce00640 1 -- start start 2024-04-26T23:41:29.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.218+0000 7fccfce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccdc004810 0x7fccf815b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:29.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.218+0000 7fccfce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccf8160780 0x7fccf80c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:29.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.218+0000 7fccfce00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccf80c8fa0 0x7fccf80c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:29.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.218+0000 7fccfce00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fccf80d1740 con 0x7fccf8160780 2024-04-26T23:41:29.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.218+0000 7fccfce00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fccf80d15c0 con 0x7fccdc004810 2024-04-26T23:41:29.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.218+0000 7fccfce00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fccf80d18c0 con 0x7fccf80c8fa0 2024-04-26T23:41:29.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.218+0000 7fccf5400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccf8160780 0x7fccf80c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:29.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.218+0000 7fccf5400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccf8160780 0x7fccf80c8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33810/0 (socket says 172.21.15.137:33810) 2024-04-26T23:41:29.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.218+0000 7fccf5400640 1 -- 172.21.15.137:0/2465282539 learned_addr learned my addr 172.21.15.137:0/2465282539 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:29.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.218+0000 7fccf5e00640 1 --2- 172.21.15.137:0/2465282539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccdc004810 0x7fccf815b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:29.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.218+0000 7fccf6800640 1 --2- 172.21.15.137:0/2465282539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccf80c8fa0 0x7fccf80c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:29.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.218+0000 7fccf5400640 1 -- 172.21.15.137:0/2465282539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccf80c8fa0 msgr2=0x7fccf80c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:29.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.218+0000 7fccf5400640 1 --2- 172.21.15.137:0/2465282539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccf80c8fa0 0x7fccf80c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.218+0000 7fccf5400640 1 -- 172.21.15.137:0/2465282539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccdc004810 msgr2=0x7fccf815b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:29.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.218+0000 7fccf5400640 1 --2- 172.21.15.137:0/2465282539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccdc004810 0x7fccf815b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.218+0000 7fccf5400640 1 -- 172.21.15.137:0/2465282539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf80c9440 con 0x7fccf8160780 2024-04-26T23:41:29.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.218+0000 7fccf5400640 1 --2- 172.21.15.137:0/2465282539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccf8160780 0x7fccf80c8a60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcce401c8a0 tx=0x7fcce4019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:29.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.222+0000 7fccee000640 1 -- 172.21.15.137:0/2465282539 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce40b2040 con 0x7fccf8160780 2024-04-26T23:41:29.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.222+0000 7fccee000640 1 -- 172.21.15.137:0/2465282539 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce400f000 con 0x7fccf8160780 2024-04-26T23:41:29.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.222+0000 7fccee000640 1 -- 172.21.15.137:0/2465282539 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce4004260 con 0x7fccf8160780 2024-04-26T23:41:29.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.222+0000 7fccfce00640 1 -- 172.21.15.137:0/2465282539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf80c9720 con 0x7fccf8160780 2024-04-26T23:41:29.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.222+0000 7fccfce00640 1 -- 172.21.15.137:0/2465282539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf815dbf0 con 0x7fccf8160780 2024-04-26T23:41:29.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.222+0000 7fccfce00640 1 -- 172.21.15.137:0/2465282539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccf806a4b0 con 0x7fccf8160780 2024-04-26T23:41:29.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.226+0000 7fccee000640 1 -- 172.21.15.137:0/2465282539 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcce40bf030 con 0x7fccf8160780 2024-04-26T23:41:29.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.226+0000 7fccee000640 1 --2- 172.21.15.137:0/2465282539 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fccd8068380 0x7fccd806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:29.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.226+0000 7fccee000640 1 -- 172.21.15.137:0/2465282539 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcce41207b0 con 0x7fccf8160780 2024-04-26T23:41:29.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.226+0000 7fccf5e00640 1 --2- 172.21.15.137:0/2465282539 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fccd8068380 0x7fccd806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:29.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.226+0000 7fccf5e00640 1 --2- 172.21.15.137:0/2465282539 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fccd8068380 0x7fccd806a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcce8001f00 tx=0x7fcce8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:29.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.230+0000 7fccee000640 1 -- 172.21.15.137:0/2465282539 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcce40c6060 con 0x7fccf8160780 2024-04-26T23:41:29.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.386+0000 7fccfce00640 1 -- 172.21.15.137:0/2465282539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fccf8070b90 con 0x7fccf8160780 2024-04-26T23:41:29.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.386+0000 7fccee000640 1 -- 172.21.15.137:0/2465282539 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16653 (secure 0 0 0) 0x7fcce4016780 con 0x7fccf8160780 2024-04-26T23:41:29.394 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:29.395 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:25.186308+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:29.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.390+0000 7fccfce00640 1 -- 172.21.15.137:0/2465282539 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fccd8068380 msgr2=0x7fccd806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:29.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.390+0000 7fccfce00640 1 --2- 172.21.15.137:0/2465282539 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fccd8068380 0x7fccd806a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcce8001f00 tx=0x7fcce8009040 comp rx=0 tx=0).stop 2024-04-26T23:41:29.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.390+0000 7fccfce00640 1 -- 172.21.15.137:0/2465282539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccf8160780 msgr2=0x7fccf80c8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:29.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.390+0000 7fccfce00640 1 --2- 172.21.15.137:0/2465282539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccf8160780 0x7fccf80c8a60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcce401c8a0 tx=0x7fcce4019810 comp rx=0 tx=0).stop 2024-04-26T23:41:29.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.390+0000 7fccfce00640 1 -- 172.21.15.137:0/2465282539 shutdown_connections 2024-04-26T23:41:29.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.390+0000 7fccfce00640 1 --2- 172.21.15.137:0/2465282539 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fccd8068380 0x7fccd806a840 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.390+0000 7fccfce00640 1 --2- 172.21.15.137:0/2465282539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccf8160780 0x7fccf80c8a60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.390+0000 7fccfce00640 1 --2- 172.21.15.137:0/2465282539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccf80c8fa0 0x7fccf80c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.390+0000 7fccfce00640 1 --2- 172.21.15.137:0/2465282539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccdc004810 0x7fccf815b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.390+0000 7fccfce00640 1 -- 172.21.15.137:0/2465282539 >> 172.21.15.137:0/2465282539 conn(0x7fccf809ba60 msgr2=0x7fccf8070db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:29.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.390+0000 7fccfce00640 1 -- 172.21.15.137:0/2465282539 shutdown_connections 2024-04-26T23:41:29.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.390+0000 7fccfce00640 1 -- 172.21.15.137:0/2465282539 wait complete. 2024-04-26T23:41:29.415 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T23:41:29.415 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:29.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.542+0000 7f8eb6600640 1 Processor -- start 2024-04-26T23:41:29.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.542+0000 7f8eb6600640 1 -- start start 2024-04-26T23:41:29.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.546+0000 7f8eb6600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8eb00b5080 0x7f8eb00cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:29.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.546+0000 7f8eb6600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8eb0072980 0x7f8eb0072e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:29.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.546+0000 7f8eb6600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8eb00cfef0 con 0x7f8eb00725a0 2024-04-26T23:41:29.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.546+0000 7f8eb6600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8eb00cddc0 con 0x7f8eb00b5080 2024-04-26T23:41:29.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.546+0000 7f8eb6600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb00d01b0 con 0x7f8eb0072980 2024-04-26T23:41:29.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.546+0000 7f8eaea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8eb00b5080 0x7f8eb00cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:29.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.546+0000 7f8eaf400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f8eb00725a0 0x7f8eb0073f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46048/0 (socket says 172.21.15.137:46048) 2024-04-26T23:41:29.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.546+0000 7f8eaf400640 1 -- 172.21.15.137:0/3174976622 learned_addr learned my addr 172.21.15.137:0/3174976622 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:29.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.546+0000 7f8eafe00640 1 --2- 172.21.15.137:0/3174976622 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8eb0072980 0x7f8eb0072e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:29.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.546+0000 7f8eaea00640 1 -- 172.21.15.137:0/3174976622 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8eb0072980 msgr2=0x7f8eb0072e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:29.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.546+0000 7f8eaea00640 1 --2- 172.21.15.137:0/3174976622 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8eb0072980 0x7f8eb0072e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.546+0000 7f8eaea00640 1 -- 172.21.15.137:0/3174976622 >> v1:172.21.15.137:6789/0 conn(0x7f8eb00725a0 legacy=0x7f8eb0073f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:29.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.546+0000 7f8eaea00640 1 -- 172.21.15.137:0/3174976622 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb00d0490 con 0x7f8eb00b5080 2024-04-26T23:41:29.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.546+0000 7f8eae000640 1 -- 172.21.15.137:0/3174976622 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2014579612 0 0) 0x7f8eb00cfef0 con 0x7f8eb00725a0 2024-04-26T23:41:29.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.550+0000 7f8eaea00640 1 --2- 172.21.15.137:0/3174976622 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8eb00b5080 0x7f8eb00cd770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00097f0 tx=0x7f8ea001e680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36b06c9016b85eb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:29.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.550+0000 7f8eae000640 1 -- 172.21.15.137:0/3174976622 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea00ab650 con 0x7f8eb00b5080 2024-04-26T23:41:29.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.550+0000 7f8eae000640 1 -- 172.21.15.137:0/3174976622 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea00ab7f0 con 0x7f8eb00b5080 2024-04-26T23:41:29.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.550+0000 7f8eae000640 1 -- 172.21.15.137:0/3174976622 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea00abbc0 con 0x7f8eb00b5080 2024-04-26T23:41:29.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.550+0000 7f8eb6600640 1 -- 172.21.15.137:0/3174976622 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8eb00b5080 msgr2=0x7f8eb00cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:29.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.550+0000 7f8eb6600640 1 --2- 172.21.15.137:0/3174976622 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8eb00b5080 0x7f8eb00cd770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00097f0 tx=0x7f8ea001e680 comp rx=0 tx=0).stop 2024-04-26T23:41:29.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.550+0000 7f8eb6600640 1 -- 172.21.15.137:0/3174976622 shutdown_connections 2024-04-26T23:41:29.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.550+0000 7f8eb6600640 1 --2- 172.21.15.137:0/3174976622 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8eb0072980 0x7f8eb0072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.550+0000 7f8eb6600640 1 --2- 172.21.15.137:0/3174976622 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8eb00b5080 0x7f8eb00cd770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.550+0000 7f8eb6600640 1 -- 172.21.15.137:0/3174976622 >> 172.21.15.137:0/3174976622 conn(0x7f8eb006c5d0 msgr2=0x7f8eb006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:29.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.550+0000 7f8eb6600640 1 -- 172.21.15.137:0/3174976622 shutdown_connections 2024-04-26T23:41:29.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.550+0000 7f8eb6600640 1 -- 172.21.15.137:0/3174976622 wait complete. 2024-04-26T23:41:29.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.550+0000 7f8eb6600640 1 Processor -- start 2024-04-26T23:41:29.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.550+0000 7f8eb6600640 1 -- start start 2024-04-26T23:41:29.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.550+0000 7f8eb6600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8eb00725a0 0x7f8eb015b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:29.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.550+0000 7f8eb6600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8eb0072980 0x7f8eb013fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:29.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.550+0000 7f8eb6600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8eb00b5080 0x7f8eb0141050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:29.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.550+0000 7f8eb6600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb006f930 con 0x7f8eb00725a0 2024-04-26T23:41:29.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.550+0000 7f8eb6600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb006f7b0 con 0x7f8eb0072980 2024-04-26T23:41:29.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.550+0000 7f8eb6600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb006fab0 con 0x7f8eb00b5080 2024-04-26T23:41:29.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.554+0000 7f8eaf400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8eb00725a0 0x7f8eb015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:29.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.554+0000 7f8eaf400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8eb00725a0 0x7f8eb015b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33832/0 (socket says 172.21.15.137:33832) 2024-04-26T23:41:29.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.554+0000 7f8eaf400640 1 -- 172.21.15.137:0/1631341308 learned_addr learned my addr 172.21.15.137:0/1631341308 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:29.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.554+0000 7f8eaea00640 1 --2- 172.21.15.137:0/1631341308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8eb0072980 0x7f8eb013fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:29.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.554+0000 7f8eafe00640 1 --2- 172.21.15.137:0/1631341308 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8eb00b5080 0x7f8eb0141050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:29.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.554+0000 7f8eaf400640 1 -- 172.21.15.137:0/1631341308 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8eb00b5080 msgr2=0x7f8eb0141050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:29.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.554+0000 7f8eaf400640 1 --2- 172.21.15.137:0/1631341308 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8eb00b5080 0x7f8eb0141050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.554+0000 7f8eaf400640 1 -- 172.21.15.137:0/1631341308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8eb0072980 msgr2=0x7f8eb013fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:29.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.554+0000 7f8eaf400640 1 --2- 172.21.15.137:0/1631341308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8eb0072980 0x7f8eb013fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.554+0000 7f8eaf400640 1 -- 172.21.15.137:0/1631341308 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb0140590 con 0x7f8eb00725a0 2024-04-26T23:41:29.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.554+0000 7f8eaf400640 1 --2- 172.21.15.137:0/1631341308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8eb00725a0 0x7f8eb015b260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800c4b0 tx=0x7f8e9800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:29.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.554+0000 7f8ea7400640 1 -- 172.21.15.137:0/1631341308 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e98018070 con 0x7f8eb00725a0 2024-04-26T23:41:29.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.554+0000 7f8ea7400640 1 -- 172.21.15.137:0/1631341308 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e98007500 con 0x7f8eb00725a0 2024-04-26T23:41:29.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.554+0000 7f8ea7400640 1 -- 172.21.15.137:0/1631341308 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e98004a30 con 0x7f8eb00725a0 2024-04-26T23:41:29.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.554+0000 7f8eb6600640 1 -- 172.21.15.137:0/1631341308 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb0140140 con 0x7f8eb00725a0 2024-04-26T23:41:29.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.554+0000 7f8eb6600640 1 -- 172.21.15.137:0/1631341308 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb0140850 con 0x7f8eb00725a0 2024-04-26T23:41:29.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.554+0000 7f8eb6600640 1 -- 172.21.15.137:0/1631341308 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eb0140370 con 0x7f8eb00725a0 2024-04-26T23:41:29.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.554+0000 7f8ea7400640 1 -- 172.21.15.137:0/1631341308 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8e9801b070 con 0x7f8eb00725a0 2024-04-26T23:41:29.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.554+0000 7f8ea7400640 1 --2- 172.21.15.137:0/1631341308 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8e8c068380 0x7f8e8c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:29.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.554+0000 7f8ea7400640 1 -- 172.21.15.137:0/1631341308 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8e98085cf0 con 0x7f8eb00725a0 2024-04-26T23:41:29.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.554+0000 7f8eaea00640 1 --2- 172.21.15.137:0/1631341308 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8e8c068380 0x7f8e8c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:29.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.558+0000 7f8eaea00640 1 --2- 172.21.15.137:0/1631341308 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8e8c068380 0x7f8e8c06a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00b0000 tx=0x7f8ea00b5040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:29.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.558+0000 7f8ea7400640 1 -- 172.21.15.137:0/1631341308 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8e98056210 con 0x7f8eb00725a0 2024-04-26T23:41:29.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.718+0000 7f8eb6600640 1 -- 172.21.15.137:0/1631341308 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8eb0072380 con 0x7f8eb00725a0 2024-04-26T23:41:29.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.718+0000 7f8ea7400640 1 -- 172.21.15.137:0/1631341308 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16653 (secure 0 0 0) 0x7f8e98055b10 con 0x7f8eb00725a0 2024-04-26T23:41:29.725 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:29.726 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:25.186308+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:29.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.722+0000 7f8eb6600640 1 -- 172.21.15.137:0/1631341308 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8e8c068380 msgr2=0x7f8e8c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:29.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.722+0000 7f8eb6600640 1 --2- 172.21.15.137:0/1631341308 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8e8c068380 0x7f8e8c06a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00b0000 tx=0x7f8ea00b5040 comp rx=0 tx=0).stop 2024-04-26T23:41:29.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.722+0000 7f8eb6600640 1 -- 172.21.15.137:0/1631341308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8eb00725a0 msgr2=0x7f8eb015b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:29.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.722+0000 7f8eb6600640 1 --2- 172.21.15.137:0/1631341308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8eb00725a0 0x7f8eb015b260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800c4b0 tx=0x7f8e9800c970 comp rx=0 tx=0).stop 2024-04-26T23:41:29.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.722+0000 7f8eb6600640 1 -- 172.21.15.137:0/1631341308 shutdown_connections 2024-04-26T23:41:29.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.722+0000 7f8eb6600640 1 --2- 172.21.15.137:0/1631341308 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8e8c068380 0x7f8e8c06a840 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.722+0000 7f8eb6600640 1 --2- 172.21.15.137:0/1631341308 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8eb00b5080 0x7f8eb0141050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.722+0000 7f8eb6600640 1 --2- 172.21.15.137:0/1631341308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8eb0072980 0x7f8eb013fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.722+0000 7f8eb6600640 1 --2- 172.21.15.137:0/1631341308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8eb00725a0 0x7f8eb015b260 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:29.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.722+0000 7f8eb6600640 1 -- 172.21.15.137:0/1631341308 >> 172.21.15.137:0/1631341308 conn(0x7f8eb006c5d0 msgr2=0x7f8eb0143c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:29.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.722+0000 7f8eb6600640 1 -- 172.21.15.137:0/1631341308 shutdown_connections 2024-04-26T23:41:29.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.722+0000 7f8eb6600640 1 -- 172.21.15.137:0/1631341308 wait complete. 2024-04-26T23:41:29.746 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T23:41:29.747 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T23:41:29.747 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T23:41:29.748 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T23:41:29.748 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-26T23:41:29.748 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-26T23:41:29.749 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-26T23:41:29.749 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-26T23:41:29.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.986+0000 7fc334a00640 1 Processor -- start 2024-04-26T23:41:29.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.986+0000 7f8a3e200640 1 Processor -- start 2024-04-26T23:41:29.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.986+0000 7f8a3e200640 1 -- start start 2024-04-26T23:41:29.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.986+0000 7fc334a00640 1 -- start start 2024-04-26T23:41:29.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.986+0000 7fc334a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc3280e3410 0x7fc328006c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:29.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.986+0000 7fc334a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc32803ec80 0x7fc328053d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:29.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.986+0000 7fc334a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc328007b90 con 0x7fc328054240 2024-04-26T23:41:29.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.986+0000 7fc334a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc328057530 con 0x7fc3280e3410 2024-04-26T23:41:29.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.986+0000 7fc334a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc3280075d0 con 0x7fc32803ec80 2024-04-26T23:41:29.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f8a3e200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a300e4800 0x7f8a30054280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:29.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f8a3e200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8a30056790 0x7f8a30051ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:29.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f8a3e200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8a30051ff0 0x7f8a300548b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:29.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f8a3e200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8a3003cc80 con 0x7f8a30051ff0 2024-04-26T23:41:29.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f8a3e200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f8a3003c9a0 con 0x7f8a30056790 2024-04-26T23:41:29.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f8a3e200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8a300559f0 con 0x7f8a300e4800 2024-04-26T23:41:29.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f8a3ce00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a300e4800 0x7f8a30054280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:29.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f8a3ce00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a300e4800 0x7f8a30054280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:41424/0 (socket says 172.21.15.137:41424) 2024-04-26T23:41:29.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f8a3ce00640 1 -- 172.21.15.137:0/3627460054 learned_addr learned my addr 172.21.15.137:0/3627460054 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:29.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7fc32ea00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc32803ec80 0x7fc328053d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:29.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7fc32ea00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc32803ec80 0x7fc328053d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:41426/0 (socket says 172.21.15.137:41426) 2024-04-26T23:41:29.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7fc32ea00640 1 -- 172.21.15.137:0/1838888442 learned_addr learned my addr 172.21.15.137:0/1838888442 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:29.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f8a3d800640 1 --2- 172.21.15.137:0/3627460054 >> v2:172.21.15.137:3300/0 conn(0x7f8a30051ff0 0x7f8a300548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:29.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7fc32f400640 1 --2- 172.21.15.137:0/1838888442 >> v2:172.21.15.137:3300/0 conn(0x7fc3280e3410 0x7fc328006c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:29.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f70f1400640 1 Processor -- start 2024-04-26T23:41:29.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f8a37e00640 1 --2- 172.21.15.137:0/3627460054 >> v2:172.21.15.170:3300/0 conn(0x7f8a30056790 0x7f8a30051ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:29.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f70f1400640 1 -- start start 2024-04-26T23:41:29.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f53a7c00640 1 Processor -- start 2024-04-26T23:41:29.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7feb82200640 1 Processor -- start 2024-04-26T23:41:29.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f53a7c00640 1 -- start start 2024-04-26T23:41:29.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7feb82200640 1 -- start start 2024-04-26T23:41:29.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7feb82200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7feb7c163670 0x7feb7c167b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:29.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7feb82200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7feb7c0d6c30 0x7feb7c163a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:29.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7feb82200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb7c163f90 0x7feb7c0bdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:29.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7feb82200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7feb7c164b50 con 0x7feb7c0d6c30 2024-04-26T23:41:30.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7feb82200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7feb7c168060 con 0x7feb7c163670 2024-04-26T23:41:30.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7feb82200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7feb7c164590 con 0x7feb7c163f90 2024-04-26T23:41:30.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f70f1400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f70ec0d0500 0x7f70ec155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f70f1400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70ec15bbc0 con 0x7f70ec0cfc10 2024-04-26T23:41:30.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f70f1400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70ec15be30 con 0x7f70ec06e2d0 2024-04-26T23:41:30.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f70f1400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f70ec15c110 con 0x7f70ec0d0500 2024-04-26T23:41:30.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f392b200640 1 Processor -- start 2024-04-26T23:41:30.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f70eb200640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f70ec06e2d0 0x7f70ec06eec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:50210/0 (socket says 172.21.15.137:50210) 2024-04-26T23:41:30.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f70eb200640 1 -- 172.21.15.137:0/630201341 learned_addr learned my addr 172.21.15.137:0/630201341 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:30.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f392b200640 1 -- start start 2024-04-26T23:41:30.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f70e9e00640 1 --2- 172.21.15.137:0/630201341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f70ec0d0500 0x7f70ec155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7feb80e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7feb7c163670 0x7feb7c167b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7feb81800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb7c163f90 0x7feb7c0bdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7feb81800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb7c163f90 0x7feb7c0bdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:41438/0 (socket says 172.21.15.137:41438) 2024-04-26T23:41:30.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7feb81800640 1 -- 172.21.15.137:0/1297722777 learned_addr learned my addr 172.21.15.137:0/1297722777 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f8a3d800640 1 -- 172.21.15.137:0/3627460054 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a300e4800 msgr2=0x7f8a30054280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:30.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f8a3d800640 1 --2- 172.21.15.137:0/3627460054 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a300e4800 0x7f8a30054280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f8a3d800640 1 -- 172.21.15.137:0/3627460054 >> v2:172.21.15.170:3300/0 conn(0x7f8a30056790 msgr2=0x7f8a30051ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:30.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f8a3d800640 1 --2- 172.21.15.137:0/3627460054 >> v2:172.21.15.170:3300/0 conn(0x7f8a30056790 0x7f8a30051ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7f8a3d800640 1 -- 172.21.15.137:0/3627460054 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a30055cd0 con 0x7f8a30051ff0 2024-04-26T23:41:30.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f8a3ce00640 1 --2- 172.21.15.137:0/3627460054 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a300e4800 0x7f8a30054280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:41:30.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f70e9400640 1 -- 172.21.15.137:0/630201341 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 884321201 0 0) 0x7f70ec15be30 con 0x7f70ec06e2d0 2024-04-26T23:41:30.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7fc32ea00640 1 -- 172.21.15.137:0/1838888442 >> v2:172.21.15.137:3300/0 conn(0x7fc3280e3410 msgr2=0x7fc328006c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:30.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7fc32ea00640 1 --2- 172.21.15.137:0/1838888442 >> v2:172.21.15.137:3300/0 conn(0x7fc3280e3410 0x7fc328006c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7fc32ea00640 1 -- 172.21.15.137:0/1838888442 >> v1:172.21.15.137:6789/0 conn(0x7fc328054240 legacy=0x7fc3280e6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.990+0000 7fc32ea00640 1 -- 172.21.15.137:0/1838888442 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3280078b0 con 0x7fc32803ec80 2024-04-26T23:41:30.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7feb80e00640 1 -- 172.21.15.137:0/1297722777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb7c163f90 msgr2=0x7feb7c0bdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:30.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7feb80e00640 1 --2- 172.21.15.137:0/1297722777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb7c163f90 0x7feb7c0bdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7feb80e00640 1 -- 172.21.15.137:0/1297722777 >> v2:172.21.15.137:3300/0 conn(0x7feb7c0d6c30 msgr2=0x7feb7c163a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:30.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f8a37e00640 1 --2- 172.21.15.137:0/3627460054 >> v2:172.21.15.170:3300/0 conn(0x7f8a30056790 0x7f8a30051ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:30.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7feb80e00640 1 --2- 172.21.15.137:0/1297722777 >> v2:172.21.15.137:3300/0 conn(0x7feb7c0d6c30 0x7feb7c163a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f53a7c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f53a00b55b0 0x7f53a015b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f53a7c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53a015ecb0 con 0x7f53a01521b0 2024-04-26T23:41:30.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f53a7c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53a015ef90 con 0x7f53a00b35b0 2024-04-26T23:41:30.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f53a7c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f53a015f270 con 0x7f53a00b55b0 2024-04-26T23:41:30.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f53a5c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f53a00b55b0 0x7f53a015b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f53a5c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f53a00b55b0 0x7f53a015b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:35854/0 (socket says 172.21.15.137:35854) 2024-04-26T23:41:30.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f53a5c00640 1 -- 172.21.15.137:0/419355935 learned_addr learned my addr 172.21.15.137:0/419355935 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f53a5c00640 1 -- 172.21.15.137:0/419355935 >> v1:172.21.15.170:6789/0 conn(0x7f53a00b35b0 legacy=0x7f53a00720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:30.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7feb80e00640 1 -- 172.21.15.137:0/1297722777 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7c164870 con 0x7feb7c163670 2024-04-26T23:41:30.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f53a5c00640 1 -- 172.21.15.137:0/419355935 >> v1:172.21.15.137:6789/0 conn(0x7f53a01521b0 legacy=0x7f53a00b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:30.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f53a5c00640 1 -- 172.21.15.137:0/419355935 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a0072e50 con 0x7f53a00b55b0 2024-04-26T23:41:30.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f392b200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f39240e32e0 0x7f392403e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f3929e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f39240e32e0 0x7f392403e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f8a3d800640 1 --2- 172.21.15.137:0/3627460054 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a30051ff0 0x7f8a300548b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8a38065f00 tx=0x7f8a3809b1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4222f1f2ffea93ae server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f3929e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f39240e32e0 0x7f392403e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:35864/0 (socket says 172.21.15.137:35864) 2024-04-26T23:41:30.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f392b200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3924053c20 0x7f3924054080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f3929e00640 1 -- 172.21.15.137:0/3010712179 learned_addr learned my addr 172.21.15.137:0/3010712179 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7f392b200640 1 -- 172.21.15.137:0/3010712179 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3924057df0 con 0x7f39240e6c40 2024-04-26T23:41:30.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7f392b200640 1 -- 172.21.15.137:0/3010712179 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f392403bfd0 con 0x7f39240e32e0 2024-04-26T23:41:30.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7f8a37400640 1 -- 172.21.15.137:0/3627460054 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3812c440 con 0x7f8a30051ff0 2024-04-26T23:41:30.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7febee200640 1 Processor -- start 2024-04-26T23:41:30.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7febee200640 1 -- start start 2024-04-26T23:41:30.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7f8a37400640 1 -- 172.21.15.137:0/3627460054 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a3812c5e0 con 0x7f8a30051ff0 2024-04-26T23:41:30.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7f8a37400640 1 -- 172.21.15.137:0/3627460054 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3812ca50 con 0x7f8a30051ff0 2024-04-26T23:41:30.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7f392b200640 1 -- 172.21.15.137:0/3010712179 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f39240545c0 con 0x7f3924053c20 2024-04-26T23:41:30.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7fc32ea00640 1 --2- 172.21.15.137:0/1838888442 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc32803ec80 0x7fc328053d00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc31c009870 tx=0x7fc31c01c5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aa75642d585a28c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7fc32e000640 1 -- 172.21.15.137:0/1838888442 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0b2070 con 0x7fc32803ec80 2024-04-26T23:41:30.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7febee200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7febe0050190 0x7febe00df130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7febee200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febe00060f0 con 0x7febe000c0b0 2024-04-26T23:41:30.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7febee200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febe00063d0 con 0x7febe004f5c0 2024-04-26T23:41:30.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7febee200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7febe0005ea0 con 0x7febe0050190 2024-04-26T23:41:30.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7fc32e000640 1 -- 172.21.15.137:0/1838888442 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc31c0ad680 con 0x7fc32803ec80 2024-04-26T23:41:30.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7fc32e000640 1 -- 172.21.15.137:0/1838888442 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0ada50 con 0x7fc32803ec80 2024-04-26T23:41:30.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7f8a3e200640 1 -- 172.21.15.137:0/3627460054 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a30051ff0 msgr2=0x7f8a300548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7f8a3e200640 1 --2- 172.21.15.137:0/3627460054 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a30051ff0 0x7f8a300548b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8a38065f00 tx=0x7f8a3809b1e0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7f8a3e200640 1 -- 172.21.15.137:0/3627460054 shutdown_connections 2024-04-26T23:41:30.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7f8a3e200640 1 --2- 172.21.15.137:0/3627460054 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a30051ff0 0x7f8a300548b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7f8a3e200640 1 --2- 172.21.15.137:0/3627460054 >> v2:172.21.15.170:3300/0 conn(0x7f8a30056790 0x7f8a30051ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7f8a3e200640 1 --2- 172.21.15.137:0/3627460054 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a300e4800 0x7f8a30054280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7f8a3e200640 1 -- 172.21.15.137:0/3627460054 >> 172.21.15.137:0/3627460054 conn(0x7f8a30053760 msgr2=0x7f8a30053b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7f8a3e200640 1 -- 172.21.15.137:0/3627460054 shutdown_connections 2024-04-26T23:41:30.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7f8a3e200640 1 -- 172.21.15.137:0/3627460054 wait complete. 2024-04-26T23:41:30.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7fc334a00640 1 -- 172.21.15.137:0/1838888442 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc32803ec80 msgr2=0x7fc328053d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7feb80e00640 1 --2- 172.21.15.137:0/1297722777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb7c163670 0x7feb7c167b20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feb7c06a050 tx=0x7feb7001c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3e67f2b73b6cacc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7febece00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7febe000c0b0 0x7febe0007190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46104/0 (socket says 172.21.15.137:46104) 2024-04-26T23:41:30.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7febece00640 1 -- 172.21.15.137:0/2588539094 learned_addr learned my addr 172.21.15.137:0/2588539094 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:30.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f70e9e00640 1 -- 172.21.15.137:0/630201341 >> v1:172.21.15.170:6789/0 conn(0x7f70ec06e2d0 legacy=0x7f70ec06eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f70e9e00640 1 -- 172.21.15.137:0/630201341 >> v1:172.21.15.137:6789/0 conn(0x7f70ec0cfc10 legacy=0x7f70ec0b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.994+0000 7f70e9e00640 1 -- 172.21.15.137:0/630201341 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ec15c3f0 con 0x7f70ec0d0500 2024-04-26T23:41:30.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7fc334a00640 1 --2- 172.21.15.137:0/1838888442 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc32803ec80 0x7fc328053d00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc31c009870 tx=0x7fc31c01c5a0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7fc334a00640 1 -- 172.21.15.137:0/1838888442 shutdown_connections 2024-04-26T23:41:30.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7febed800640 1 --2- 172.21.15.137:0/2588539094 >> v2:172.21.15.137:3300/0 conn(0x7febe0050190 0x7febe00df130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7fc334a00640 1 --2- 172.21.15.137:0/1838888442 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc32803ec80 0x7fc328053d00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7feb7b400640 1 -- 172.21.15.137:0/1297722777 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb700b0070 con 0x7feb7c163670 2024-04-26T23:41:30.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7fc334a00640 1 --2- 172.21.15.137:0/1838888442 >> v2:172.21.15.137:3300/0 conn(0x7fc3280e3410 0x7fc328006c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7fc334a00640 1 -- 172.21.15.137:0/1838888442 >> 172.21.15.137:0/1838888442 conn(0x7fc32803aa40 msgr2=0x7fc32803ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7feb7b400640 1 -- 172.21.15.137:0/1297722777 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb700ab600 con 0x7feb7c163670 2024-04-26T23:41:30.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7feb7b400640 1 -- 172.21.15.137:0/1297722777 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb700ab9d0 con 0x7feb7c163670 2024-04-26T23:41:30.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7febe7400640 1 -- 172.21.15.137:0/2588539094 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1266680480 0 0) 0x7febe00060f0 con 0x7febe000c0b0 2024-04-26T23:41:30.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7febe7400640 1 -- 172.21.15.137:0/2588539094 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febd0003530 con 0x7febe000c0b0 2024-04-26T23:41:30.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7f3929e00640 1 -- 172.21.15.137:0/3010712179 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3924053c20 msgr2=0x7f3924054080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:41:30.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7f3929e00640 1 --2- 172.21.15.137:0/3010712179 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3924053c20 0x7f3924054080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7f3929e00640 1 -- 172.21.15.137:0/3010712179 >> v1:172.21.15.137:6789/0 conn(0x7f39240e6c40 legacy=0x7f39240e70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:29.998+0000 7f3929e00640 1 -- 172.21.15.137:0/3010712179 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39240580d0 con 0x7f39240e32e0 2024-04-26T23:41:30.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7f70e9e00640 1 --2- 172.21.15.137:0/630201341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f70ec0d0500 0x7f70ec155bc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009dc0 tx=0x7f70e401c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63dd07cff8e560ce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7fc85a000640 1 Processor -- start 2024-04-26T23:41:30.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7febe7400640 1 -- 172.21.15.137:0/2588539094 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1683928019 0 0) 0x7febd0003530 con 0x7febe000c0b0 2024-04-26T23:41:30.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7feb82200640 1 -- 172.21.15.137:0/1297722777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb7c163670 msgr2=0x7feb7c167b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7fc85a000640 1 -- start start 2024-04-26T23:41:30.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7feb82200640 1 --2- 172.21.15.137:0/1297722777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb7c163670 0x7feb7c167b20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feb7c06a050 tx=0x7feb7001c380 comp rx=0 tx=0).stop 2024-04-26T23:41:30.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7feb82200640 1 -- 172.21.15.137:0/1297722777 shutdown_connections 2024-04-26T23:41:30.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7feb82200640 1 --2- 172.21.15.137:0/1297722777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb7c163f90 0x7feb7c0bdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7feb82200640 1 --2- 172.21.15.137:0/1297722777 >> v2:172.21.15.137:3300/0 conn(0x7feb7c0d6c30 0x7feb7c163a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7febe7400640 1 -- 172.21.15.137:0/2588539094 >> v2:172.21.15.137:3300/0 conn(0x7febe0050190 msgr2=0x7febe00df130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:30.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7febe7400640 1 --2- 172.21.15.137:0/2588539094 >> v2:172.21.15.137:3300/0 conn(0x7febe0050190 0x7febe00df130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7febe7400640 1 -- 172.21.15.137:0/2588539094 >> v1:172.21.15.170:6789/0 conn(0x7febe004f5c0 legacy=0x7febe004fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7febe7400640 1 -- 172.21.15.137:0/2588539094 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febe00066b0 con 0x7febe000c0b0 2024-04-26T23:41:30.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7febe7400640 1 -- 172.21.15.137:0/2588539094 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7febd4001680 con 0x7febe000c0b0 2024-04-26T23:41:30.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7febe7400640 1 -- 172.21.15.137:0/2588539094 >> v1:172.21.15.137:6789/0 conn(0x7febe000c0b0 legacy=0x7febe0007190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7febe7400640 1 --2- 172.21.15.137:0/2588539094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7febd00039c0 0x7febd0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7febe7400640 1 --2- 172.21.15.137:0/2588539094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7febd0004810 0x7febd0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7febe7400640 1 --2- 172.21.15.137:0/2588539094 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febd0005220 0x7febd00141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7febe7400640 1 -- 172.21.15.137:0/2588539094 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7febe0005ea0 con 0x7febd00039c0 2024-04-26T23:41:30.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7febe7400640 1 -- 172.21.15.137:0/2588539094 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7febd00148e0 con 0x7febd0005220 2024-04-26T23:41:30.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7febe7400640 1 -- 172.21.15.137:0/2588539094 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7febd0014ae0 con 0x7febd0004810 2024-04-26T23:41:30.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7feb82200640 1 --2- 172.21.15.137:0/1297722777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb7c163670 0x7feb7c167b20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7feb82200640 1 -- 172.21.15.137:0/1297722777 >> 172.21.15.137:0/1297722777 conn(0x7feb7c0bb040 msgr2=0x7feb7c0bb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7feb82200640 1 -- 172.21.15.137:0/1297722777 shutdown_connections 2024-04-26T23:41:30.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7feb82200640 1 -- 172.21.15.137:0/1297722777 wait complete. 2024-04-26T23:41:30.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7febe7e00640 1 --2- 172.21.15.137:0/2588539094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7febd0004810 0x7febd0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7fc334a00640 1 -- 172.21.15.137:0/1838888442 shutdown_connections 2024-04-26T23:41:30.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7f70e9400640 1 -- 172.21.15.137:0/630201341 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e40b2070 con 0x7f70ec0d0500 2024-04-26T23:41:30.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7fc334a00640 1 -- 172.21.15.137:0/1838888442 wait complete. 2024-04-26T23:41:30.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7f8a3e200640 1 Processor -- start 2024-04-26T23:41:30.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7f8a3e200640 1 -- start start 2024-04-26T23:41:30.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7f53a5c00640 1 --2- 172.21.15.137:0/419355935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53a00b55b0 0x7f53a015b620 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5398014a00 tx=0x7f53980254d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=212a48b1396c3b7b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7f539fe00640 1 -- 172.21.15.137:0/419355935 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53980112d0 con 0x7f53a00b55b0 2024-04-26T23:41:30.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7f539fe00640 1 -- 172.21.15.137:0/419355935 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53980b8070 con 0x7f53a00b55b0 2024-04-26T23:41:30.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7f539fe00640 1 -- 172.21.15.137:0/419355935 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5398011690 con 0x7f53a00b55b0 2024-04-26T23:41:30.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7f70e9400640 1 -- 172.21.15.137:0/630201341 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e40a5770 con 0x7f70ec0d0500 2024-04-26T23:41:30.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7f70e9400640 1 -- 172.21.15.137:0/630201341 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e40a5b40 con 0x7f70ec0d0500 2024-04-26T23:41:30.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7febe7e00640 1 -- 172.21.15.137:0/2588539094 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febd0005220 msgr2=0x7febd00141e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:41:30.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7fc85a000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc854159bd0 0x7fc85415cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7fc85a000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc854071290 0x7fc8540b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7fc85a000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc85406d410 0x7fc85406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7fc85a000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc8540b4d50 con 0x7fc854159bd0 2024-04-26T23:41:30.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7fc85a000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc8540b5310 con 0x7fc854071290 2024-04-26T23:41:30.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7fc85a000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc85415d460 con 0x7fc85406d410 2024-04-26T23:41:30.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7fc852a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc854071290 0x7fc8540b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7fc852a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc854071290 0x7fc8540b57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:35882/0 (socket says 172.21.15.137:35882) 2024-04-26T23:41:30.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7fc852a00640 1 -- 172.21.15.137:0/2371490699 learned_addr learned my addr 172.21.15.137:0/2371490699 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.002+0000 7fc853400640 1 --2- 172.21.15.137:0/2371490699 >> v2:172.21.15.137:3300/0 conn(0x7fc854159bd0 0x7fc85415cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7fc853e00640 1 --2- 172.21.15.137:0/2371490699 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc85406d410 0x7fc85406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7fc852a00640 1 -- 172.21.15.137:0/2371490699 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc85406d410 msgr2=0x7fc85406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:30.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7fc852a00640 1 --2- 172.21.15.137:0/2371490699 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc85406d410 0x7fc85406d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7fc852a00640 1 -- 172.21.15.137:0/2371490699 >> v2:172.21.15.137:3300/0 conn(0x7fc854159bd0 msgr2=0x7fc85415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:30.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7fc852a00640 1 --2- 172.21.15.137:0/2371490699 >> v2:172.21.15.137:3300/0 conn(0x7fc854159bd0 0x7fc85415cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7fc852a00640 1 -- 172.21.15.137:0/2371490699 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8540b66e0 con 0x7fc854071290 2024-04-26T23:41:30.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7febed800640 1 --2- 172.21.15.137:0/2588539094 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febd0005220 0x7febd00141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f53a7c00640 1 -- 172.21.15.137:0/419355935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53a00b55b0 msgr2=0x7f53a015b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f53a7c00640 1 --2- 172.21.15.137:0/419355935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53a00b55b0 0x7f53a015b620 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5398014a00 tx=0x7f53980254d0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f53a7c00640 1 -- 172.21.15.137:0/419355935 shutdown_connections 2024-04-26T23:41:30.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f53a7c00640 1 --2- 172.21.15.137:0/419355935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53a00b55b0 0x7f53a015b620 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f53a7c00640 1 -- 172.21.15.137:0/419355935 >> 172.21.15.137:0/419355935 conn(0x7f53a00b2a90 msgr2=0x7f53a00b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f53a7c00640 1 -- 172.21.15.137:0/419355935 shutdown_connections 2024-04-26T23:41:30.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f53a7c00640 1 -- 172.21.15.137:0/419355935 wait complete. 2024-04-26T23:41:30.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f8a3e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a30051ff0 0x7f8a300cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f8a3e200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a30056790 0x7f8a3004ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7feb82200640 1 Processor -- start 2024-04-26T23:41:30.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7feb82200640 1 -- start start 2024-04-26T23:41:30.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f8a3e200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a300e4800 0x7f8a3004f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f8a37e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a30056790 0x7f8a3004ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f8a37e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a30056790 0x7f8a3004ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:35898/0 (socket says 172.21.15.137:35898) 2024-04-26T23:41:30.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f8a37e00640 1 -- 172.21.15.137:0/1139111842 learned_addr learned my addr 172.21.15.137:0/1139111842 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f8a3ce00640 1 --2- 172.21.15.137:0/1139111842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a30051ff0 0x7f8a300cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f70f1400640 1 -- 172.21.15.137:0/630201341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f70ec0d0500 msgr2=0x7f70ec155bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f70f1400640 1 --2- 172.21.15.137:0/630201341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f70ec0d0500 0x7f70ec155bc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009dc0 tx=0x7f70e401c840 comp rx=0 tx=0).stop 2024-04-26T23:41:30.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f70f1400640 1 -- 172.21.15.137:0/630201341 shutdown_connections 2024-04-26T23:41:30.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f70f1400640 1 --2- 172.21.15.137:0/630201341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f70ec0d0500 0x7f70ec155bc0 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009dc0 tx=0x7f70e401c840 comp rx=0 tx=0).stop 2024-04-26T23:41:30.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f8a3d800640 1 --2- 172.21.15.137:0/1139111842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a300e4800 0x7f8a3004f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f8a3e200640 1 -- 172.21.15.137:0/1139111842 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3003c650 con 0x7f8a30051ff0 2024-04-26T23:41:30.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f8a3e200640 1 -- 172.21.15.137:0/1139111842 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8a300564d0 con 0x7f8a30056790 2024-04-26T23:41:30.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f8a3e200640 1 -- 172.21.15.137:0/1139111842 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8a30054df0 con 0x7f8a300e4800 2024-04-26T23:41:30.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f70f1400640 1 -- 172.21.15.137:0/630201341 >> 172.21.15.137:0/630201341 conn(0x7f70ec06c5d0 msgr2=0x7f70ec06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f70f1400640 1 -- 172.21.15.137:0/630201341 shutdown_connections 2024-04-26T23:41:30.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f53a7c00640 1 Processor -- start 2024-04-26T23:41:30.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7febe7e00640 1 --2- 172.21.15.137:0/2588539094 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febd0005220 0x7febd00141e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7febe7e00640 1 -- 172.21.15.137:0/2588539094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7febd00039c0 msgr2=0x7febd0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:30.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7febe7e00640 1 --2- 172.21.15.137:0/2588539094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7febd00039c0 0x7febd0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7febe7e00640 1 -- 172.21.15.137:0/2588539094 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febe00066b0 con 0x7febd0004810 2024-04-26T23:41:30.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7febed800640 1 -- 172.21.15.137:0/2588539094 reap_dead start 2024-04-26T23:41:30.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7fc852a00640 1 --2- 172.21.15.137:0/2371490699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc854071290 0x7fc8540b57a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc85406ea40 tx=0x7fc84401c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1d9eb39ec5f7063 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7fc852000640 1 -- 172.21.15.137:0/2371490699 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8440b0070 con 0x7fc854071290 2024-04-26T23:41:30.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7fc852000640 1 -- 172.21.15.137:0/2371490699 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8440ab600 con 0x7fc854071290 2024-04-26T23:41:30.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7fc852000640 1 -- 172.21.15.137:0/2371490699 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8440ab9d0 con 0x7fc854071290 2024-04-26T23:41:30.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f70f1400640 1 -- 172.21.15.137:0/630201341 wait complete. 2024-04-26T23:41:30.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f53a7c00640 1 -- start start 2024-04-26T23:41:30.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7feb82200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb7c0d6c30 0x7feb7c148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7feb82200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb7c163670 0x7feb7c1619f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7fc334a00640 1 Processor -- start 2024-04-26T23:41:30.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f8a3d800640 1 -- 172.21.15.137:0/1139111842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a30056790 msgr2=0x7f8a3004ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f8a3d800640 1 --2- 172.21.15.137:0/1139111842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a30056790 0x7f8a3004ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f8a3d800640 1 -- 172.21.15.137:0/1139111842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a30051ff0 msgr2=0x7f8a300cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f8a3d800640 1 --2- 172.21.15.137:0/1139111842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a30051ff0 0x7f8a300cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.006+0000 7f8a3d800640 1 -- 172.21.15.137:0/1139111842 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a300d9030 con 0x7f8a300e4800 2024-04-26T23:41:30.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f8a3d800640 1 --2- 172.21.15.137:0/1139111842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a300e4800 0x7f8a3004f340 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8a3806ab70 tx=0x7f8a38066280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f8a34c00640 1 -- 172.21.15.137:0/1139111842 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a38131040 con 0x7f8a300e4800 2024-04-26T23:41:30.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7feb80e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb7c0d6c30 0x7feb7c148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7feb80e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb7c0d6c30 0x7feb7c148f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:35908/0 (socket says 172.21.15.137:35908) 2024-04-26T23:41:30.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7feb7be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb7c163670 0x7feb7c1619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7feb7be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb7c163670 0x7feb7c1619f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33912/0 (socket says 172.21.15.137:33912) 2024-04-26T23:41:30.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f3929e00640 1 --2- 172.21.15.137:0/3010712179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39240e32e0 0x7f392403e850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3918009870 tx=0x7f391801c5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c759775867f2260e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7fc85a000640 1 -- 172.21.15.137:0/2371490699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc854071290 msgr2=0x7fc8540b57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7fc85a000640 1 --2- 172.21.15.137:0/2371490699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc854071290 0x7fc8540b57a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc85406ea40 tx=0x7fc84401c490 comp rx=0 tx=0).stop 2024-04-26T23:41:30.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f8a3e200640 1 -- 172.21.15.137:0/1139111842 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a300dcbf0 con 0x7f8a300e4800 2024-04-26T23:41:30.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7feb80e00640 1 -- 172.21.15.137:0/1939530894 learned_addr learned my addr 172.21.15.137:0/1939530894 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7fc334a00640 1 -- start start 2024-04-26T23:41:30.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7feb82200640 1 --2- 172.21.15.137:0/1939530894 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb7c163f90 0x7feb7c0d9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7feb82200640 1 -- 172.21.15.137:0/1939530894 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feb7c0d7e30 con 0x7feb7c163670 2024-04-26T23:41:30.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7feb82200640 1 -- 172.21.15.137:0/1939530894 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7feb7c0d7cb0 con 0x7feb7c0d6c30 2024-04-26T23:41:30.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7feb82200640 1 -- 172.21.15.137:0/1939530894 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7feb7c06edd0 con 0x7feb7c163f90 2024-04-26T23:41:30.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f8a34c00640 1 -- 172.21.15.137:0/1139111842 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a381355f0 con 0x7f8a300e4800 2024-04-26T23:41:30.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f53a7c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53a00b35b0 0x7f53a0148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f53a7c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53a00b55b0 0x7f53a01537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7fc85a000640 1 -- 172.21.15.137:0/2371490699 shutdown_connections 2024-04-26T23:41:30.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7fc85a000640 1 --2- 172.21.15.137:0/2371490699 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc85406d410 0x7fc85406d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7fc85a000640 1 --2- 172.21.15.137:0/2371490699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc854071290 0x7fc8540b57a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7fc85a000640 1 --2- 172.21.15.137:0/2371490699 >> v2:172.21.15.137:3300/0 conn(0x7fc854159bd0 0x7fc85415cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7fc85a000640 1 -- 172.21.15.137:0/2371490699 >> 172.21.15.137:0/2371490699 conn(0x7fc854073160 msgr2=0x7fc854073570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f53a7c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53a01521b0 0x7f53a00b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f53a7c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f53a01693b0 con 0x7f53a01521b0 2024-04-26T23:41:30.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f53a7c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f53a0169230 con 0x7f53a00b35b0 2024-04-26T23:41:30.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f53a7c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f53a0169530 con 0x7f53a00b55b0 2024-04-26T23:41:30.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f8a3e200640 1 -- 172.21.15.137:0/1139111842 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a300dd1b0 con 0x7f8a300e4800 2024-04-26T23:41:30.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f3928a00640 1 -- 172.21.15.137:0/3010712179 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39180aa5f0 con 0x7f39240e32e0 2024-04-26T23:41:30.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7feb7be00640 1 -- 172.21.15.137:0/1939530894 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb7c163f90 msgr2=0x7feb7c0d9260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:41:30.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7feb7be00640 1 --2- 172.21.15.137:0/1939530894 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb7c163f90 0x7feb7c0d9260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7feb7be00640 1 -- 172.21.15.137:0/1939530894 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb7c0d6c30 msgr2=0x7feb7c148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7feb7be00640 1 --2- 172.21.15.137:0/1939530894 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb7c0d6c30 0x7feb7c148f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7feb7be00640 1 -- 172.21.15.137:0/1939530894 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7c157b50 con 0x7feb7c163670 2024-04-26T23:41:30.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f53a5200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53a00b35b0 0x7f53a0148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f53a5200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53a00b35b0 0x7f53a0148050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:35924/0 (socket says 172.21.15.137:35924) 2024-04-26T23:41:30.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f53a5200640 1 -- 172.21.15.137:0/1178744816 learned_addr learned my addr 172.21.15.137:0/1178744816 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f3928a00640 1 -- 172.21.15.137:0/3010712179 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39180af070 con 0x7f39240e32e0 2024-04-26T23:41:30.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f3928a00640 1 -- 172.21.15.137:0/3010712179 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39180aa9b0 con 0x7f39240e32e0 2024-04-26T23:41:30.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f53a5200640 1 -- 172.21.15.137:0/1178744816 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53a00b55b0 msgr2=0x7f53a01537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7feb7be00640 1 --2- 172.21.15.137:0/1939530894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb7c163670 0x7feb7c1619f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feb6800b3e0 tx=0x7feb6800b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f8a34c00640 1 -- 172.21.15.137:0/1139111842 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a381359a0 con 0x7f8a300e4800 2024-04-26T23:41:30.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f8a3e200640 1 -- 172.21.15.137:0/1139111842 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8a14001040 con 0x7f8a300e4800 2024-04-26T23:41:30.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f5397e00640 1 --2- 172.21.15.137:0/1178744816 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53a00b55b0 0x7f53a01537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f53a5200640 1 --2- 172.21.15.137:0/1178744816 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53a00b55b0 0x7f53a01537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f53a5200640 1 -- 172.21.15.137:0/1178744816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53a01521b0 msgr2=0x7f53a00b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f53a5200640 1 --2- 172.21.15.137:0/1178744816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53a01521b0 0x7f53a00b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f53a5200640 1 -- 172.21.15.137:0/1178744816 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a0152750 con 0x7f53a00b35b0 2024-04-26T23:41:30.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f5397e00640 1 --2- 172.21.15.137:0/1178744816 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53a00b55b0 0x7f53a01537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:30.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f53a5200640 1 --2- 172.21.15.137:0/1178744816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53a00b35b0 0x7f53a0148050 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f538800c490 tx=0x7f5388001e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7feb78c00640 1 -- 172.21.15.137:0/1939530894 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb68015020 con 0x7feb7c163670 2024-04-26T23:41:30.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7feb78c00640 1 -- 172.21.15.137:0/1939530894 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb68011830 con 0x7feb7c163670 2024-04-26T23:41:30.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7feb78c00640 1 -- 172.21.15.137:0/1939530894 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb68011c20 con 0x7feb7c163670 2024-04-26T23:41:30.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7fc334a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc32803ec80 0x7fc3280dab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f392b200640 1 -- 172.21.15.137:0/3010712179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39240e32e0 msgr2=0x7f392403e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f392b200640 1 --2- 172.21.15.137:0/3010712179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39240e32e0 0x7f392403e850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3918009870 tx=0x7f391801c5a0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f539d600640 1 -- 172.21.15.137:0/1178744816 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5388017070 con 0x7f53a00b35b0 2024-04-26T23:41:30.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7feb82200640 1 -- 172.21.15.137:0/1939530894 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb7c157e10 con 0x7feb7c163670 2024-04-26T23:41:30.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7febe7e00640 1 --2- 172.21.15.137:0/2588539094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7febd0004810 0x7febd0004c90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7febe004fa00 tx=0x7febdc01ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2cbdcbfe0e9129 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7fc85a000640 1 -- 172.21.15.137:0/2371490699 shutdown_connections 2024-04-26T23:41:30.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7fc85a000640 1 -- 172.21.15.137:0/2371490699 wait complete. 2024-04-26T23:41:30.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7f392b200640 1 -- 172.21.15.137:0/3010712179 shutdown_connections 2024-04-26T23:41:30.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7fc334a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc328054240 0x7fc3280513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7fc334a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3280e3410 0x7fc3280e0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7fc334a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc3280f0310 con 0x7fc328054240 2024-04-26T23:41:30.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7fc334a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc3280073b0 con 0x7fc3280e3410 2024-04-26T23:41:30.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7f392b200640 1 --2- 172.21.15.137:0/3010712179 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3924053c20 0x7f3924054080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7f392b200640 1 --2- 172.21.15.137:0/3010712179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39240e32e0 0x7f392403e850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7fc334a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc3280f0490 con 0x7fc32803ec80 2024-04-26T23:41:30.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7f392b200640 1 -- 172.21.15.137:0/3010712179 >> 172.21.15.137:0/3010712179 conn(0x7f39240559f0 msgr2=0x7f3924055e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7fc32ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc328054240 0x7fc3280513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7fc32ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc328054240 0x7fc3280513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33930/0 (socket says 172.21.15.137:33930) 2024-04-26T23:41:30.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7fc32ea00640 1 -- 172.21.15.137:0/3058311583 learned_addr learned my addr 172.21.15.137:0/3058311583 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7f70f1400640 1 Processor -- start 2024-04-26T23:41:30.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7f70f1400640 1 -- start start 2024-04-26T23:41:30.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7febe7400640 1 -- 172.21.15.137:0/2588539094 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc0b5070 con 0x7febd0004810 2024-04-26T23:41:30.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7febe7400640 1 -- 172.21.15.137:0/2588539094 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febdc0a8830 con 0x7febd0004810 2024-04-26T23:41:30.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7febe7400640 1 -- 172.21.15.137:0/2588539094 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc001460 con 0x7febd0004810 2024-04-26T23:41:30.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7febee200640 1 -- 172.21.15.137:0/2588539094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7febd0004810 msgr2=0x7febd0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7febee200640 1 --2- 172.21.15.137:0/2588539094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7febd0004810 0x7febd0004c90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7febe004fa00 tx=0x7febdc01ec10 comp rx=0 tx=0).stop 2024-04-26T23:41:30.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7f392b200640 1 -- 172.21.15.137:0/3010712179 shutdown_connections 2024-04-26T23:41:30.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7fc32ea00640 1 -- 172.21.15.137:0/3058311583 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc32803ec80 msgr2=0x7fc3280dab60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:41:30.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7fc32ea00640 1 --2- 172.21.15.137:0/3058311583 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc32803ec80 0x7fc3280dab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7fc32ea00640 1 -- 172.21.15.137:0/3058311583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3280e3410 msgr2=0x7fc3280e0370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:41:30.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7fc32ea00640 1 --2- 172.21.15.137:0/3058311583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3280e3410 0x7fc3280e0370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7fc32ea00640 1 -- 172.21.15.137:0/3058311583 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3280db4a0 con 0x7fc328054240 2024-04-26T23:41:30.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7f392b200640 1 -- 172.21.15.137:0/3010712179 wait complete. 2024-04-26T23:41:30.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7fc32ea00640 1 --2- 172.21.15.137:0/3058311583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc328054240 0x7fc3280513f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0191b0 tx=0x7fc31c01ade0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7fc323400640 1 -- 172.21.15.137:0/3058311583 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0bc020 con 0x7fc328054240 2024-04-26T23:41:30.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f539d600640 1 -- 172.21.15.137:0/1178744816 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5388003600 con 0x7f53a00b35b0 2024-04-26T23:41:30.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f539d600640 1 -- 172.21.15.137:0/1178744816 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5388003a30 con 0x7f53a00b35b0 2024-04-26T23:41:30.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f53a7c00640 1 -- 172.21.15.137:0/1178744816 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53a0152a30 con 0x7f53a00b35b0 2024-04-26T23:41:30.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7f53a7c00640 1 -- 172.21.15.137:0/1178744816 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53a0152ff0 con 0x7f53a00b35b0 2024-04-26T23:41:30.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7fc85a000640 1 Processor -- start 2024-04-26T23:41:30.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7fc323400640 1 -- 172.21.15.137:0/3058311583 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc31c0adaf0 con 0x7fc328054240 2024-04-26T23:41:30.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7fc323400640 1 -- 172.21.15.137:0/3058311583 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0b2040 con 0x7fc328054240 2024-04-26T23:41:30.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7fc334a00640 1 -- 172.21.15.137:0/3058311583 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3280e0ef0 con 0x7fc328054240 2024-04-26T23:41:30.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7f70f1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70ec06e2d0 0x7f70ec149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7f70f1400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f70ec0cfc10 0x7f70ec14a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.010+0000 7feb82200640 1 -- 172.21.15.137:0/1939530894 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb7c161f30 con 0x7feb7c163670 2024-04-26T23:41:30.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7f70ea800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70ec06e2d0 0x7f70ec149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7f70ea800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70ec06e2d0 0x7f70ec149b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:35936/0 (socket says 172.21.15.137:35936) 2024-04-26T23:41:30.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7f70ea800640 1 -- 172.21.15.137:0/3290031555 learned_addr learned my addr 172.21.15.137:0/3290031555 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7feb82200640 1 -- 172.21.15.137:0/1939530894 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feb7c1634c0 con 0x7feb7c163670 2024-04-26T23:41:30.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7fc334a00640 1 -- 172.21.15.137:0/3058311583 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3280e1a10 con 0x7fc328054240 2024-04-26T23:41:30.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7fc334a00640 1 -- 172.21.15.137:0/3058311583 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc3280057f0 con 0x7fc328054240 2024-04-26T23:41:30.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f70e9e00640 1 --2- 172.21.15.137:0/3290031555 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f70ec0cfc10 0x7f70ec14a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7fc85a000640 1 -- start start 2024-04-26T23:41:30.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f70f1400640 1 --2- 172.21.15.137:0/3290031555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70ec0d0500 0x7f70ec14f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7feb78c00640 1 -- 172.21.15.137:0/1939530894 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feb68018020 con 0x7feb7c163670 2024-04-26T23:41:30.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f70f1400640 1 -- 172.21.15.137:0/3290031555 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec164cb0 con 0x7f70ec0d0500 2024-04-26T23:41:30.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f70f1400640 1 -- 172.21.15.137:0/3290031555 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec164b30 con 0x7f70ec06e2d0 2024-04-26T23:41:30.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f70f1400640 1 -- 172.21.15.137:0/3290031555 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f70ec164e30 con 0x7f70ec0cfc10 2024-04-26T23:41:30.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f70eb200640 1 --2- 172.21.15.137:0/3290031555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70ec0d0500 0x7f70ec14f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7fc323400640 1 -- 172.21.15.137:0/3058311583 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc31c0bf020 con 0x7fc328054240 2024-04-26T23:41:30.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f70ea800640 1 -- 172.21.15.137:0/3290031555 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f70ec0cfc10 msgr2=0x7f70ec14a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f70ea800640 1 --2- 172.21.15.137:0/3290031555 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f70ec0cfc10 0x7f70ec14a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f70ea800640 1 -- 172.21.15.137:0/3290031555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70ec0d0500 msgr2=0x7f70ec14f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7fc85a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc85406d410 0x7fc8540b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7febee200640 1 -- 172.21.15.137:0/2588539094 shutdown_connections 2024-04-26T23:41:30.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7feb78c00640 1 --2- 172.21.15.137:0/1939530894 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7feb5c068380 0x7feb5c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.014+0000 7f53a7c00640 1 -- 172.21.15.137:0/1178744816 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f53a006a4b0 con 0x7f53a00b35b0 2024-04-26T23:41:30.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f70ea800640 1 --2- 172.21.15.137:0/3290031555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70ec0d0500 0x7f70ec14f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f70ea800640 1 -- 172.21.15.137:0/3290031555 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ec14e430 con 0x7f70ec06e2d0 2024-04-26T23:41:30.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f539d600640 1 -- 172.21.15.137:0/1178744816 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5388003bd0 con 0x7f53a00b35b0 2024-04-26T23:41:30.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7fc85a000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc854071290 0x7fc854154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7fc323400640 1 --2- 172.21.15.137:0/3058311583 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc310068380 0x7fc31006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7febee200640 1 --2- 172.21.15.137:0/2588539094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7febd0004810 0x7febd0004c90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7fc323400640 1 -- 172.21.15.137:0/3058311583 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc31c121350 con 0x7fc328054240 2024-04-26T23:41:30.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f8a34c00640 1 -- 172.21.15.137:0/1139111842 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8a38135b40 con 0x7f8a300e4800 2024-04-26T23:41:30.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f70eb200640 1 --2- 172.21.15.137:0/3290031555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70ec0d0500 0x7f70ec14f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:41:30.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f70ea800640 1 --2- 172.21.15.137:0/3290031555 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70ec06e2d0 0x7f70ec149b90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f70d800c780 tx=0x7f70d800cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7feb78c00640 1 -- 172.21.15.137:0/1939530894 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7feb68086750 con 0x7feb7c163670 2024-04-26T23:41:30.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7fc323400640 1 --2- 172.21.15.137:0/3058311583 >> [v2:172.21.15.137:6808/4283404504,v1:172.21.15.137:6809/4283404504] conn(0x7fc310070520 0x7fc310072940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7fc323400640 1 -- 172.21.15.137:0/3058311583 --> [v2:172.21.15.137:6808/4283404504,v1:172.21.15.137:6809/4283404504] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc31c0aaec0 con 0x7fc310070520 2024-04-26T23:41:30.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7fc323400640 1 -- 172.21.15.137:0/3058311583 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc31c121700 con 0x7fc328054240 2024-04-26T23:41:30.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7febee200640 1 -- 172.21.15.137:0/2588539094 >> 172.21.15.137:0/2588539094 conn(0x7febe0009fc0 msgr2=0x7febe000a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7fc32fe00640 1 --2- 172.21.15.137:0/3058311583 >> [v2:172.21.15.137:6808/4283404504,v1:172.21.15.137:6809/4283404504] conn(0x7fc310070520 0x7fc310072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f70e2a00640 1 -- 172.21.15.137:0/3290031555 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8017070 con 0x7f70ec06e2d0 2024-04-26T23:41:30.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f70e2a00640 1 -- 172.21.15.137:0/3290031555 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d8005480 con 0x7f70ec06e2d0 2024-04-26T23:41:30.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f70e2a00640 1 -- 172.21.15.137:0/3290031555 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8003800 con 0x7f70ec06e2d0 2024-04-26T23:41:30.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7feb78c00640 1 --2- 172.21.15.137:0/1939530894 >> [v2:172.21.15.170:6800/1674488513,v1:172.21.15.170:6801/1674488513] conn(0x7feb5c070520 0x7feb5c072940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7feb78c00640 1 -- 172.21.15.137:0/1939530894 --> [v2:172.21.15.170:6800/1674488513,v1:172.21.15.170:6801/1674488513] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb6801deb0 con 0x7feb5c070520 2024-04-26T23:41:30.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7feb78c00640 1 -- 172.21.15.137:0/1939530894 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7feb6808d050 con 0x7feb7c163670 2024-04-26T23:41:30.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7febee200640 1 -- 172.21.15.137:0/2588539094 shutdown_connections 2024-04-26T23:41:30.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7febee200640 1 -- 172.21.15.137:0/2588539094 wait complete. 2024-04-26T23:41:30.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f392b200640 1 Processor -- start 2024-04-26T23:41:30.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f392b200640 1 -- start start 2024-04-26T23:41:30.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f8a34c00640 1 --2- 172.21.15.137:0/1139111842 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8a18068480 0x7f8a1806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f539d600640 1 --2- 172.21.15.137:0/1178744816 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f537c068380 0x7f537c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7fc853400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc85406d410 0x7fc8540b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7fc853400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc85406d410 0x7fc8540b0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:35940/0 (socket says 172.21.15.137:35940) 2024-04-26T23:41:30.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f8a34c00640 1 -- 172.21.15.137:0/1139111842 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8a381a4c40 con 0x7f8a300e4800 2024-04-26T23:41:30.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f70f1400640 1 -- 172.21.15.137:0/3290031555 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70ec14e710 con 0x7f70ec06e2d0 2024-04-26T23:41:30.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.018+0000 7f70f1400640 1 -- 172.21.15.137:0/3290031555 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70ec14ecd0 con 0x7f70ec06e2d0 2024-04-26T23:41:30.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7fc32f400640 1 --2- 172.21.15.137:0/3058311583 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc310068380 0x7fc31006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f8a34c00640 1 --2- 172.21.15.137:0/1139111842 >> [v2:172.21.15.137:6800/4056840582,v1:172.21.15.137:6801/4056840582] conn(0x7f8a180706a0 0x7f8a18072ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f8a34c00640 1 -- 172.21.15.137:0/1139111842 --> [v2:172.21.15.137:6800/4056840582,v1:172.21.15.137:6801/4056840582] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a3812c5e0 con 0x7f8a180706a0 2024-04-26T23:41:30.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f8a34c00640 1 -- 172.21.15.137:0/1139111842 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8a381a5030 con 0x7f8a300e4800 2024-04-26T23:41:30.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7fc852a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc854071290 0x7fc854154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7fc852a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc854071290 0x7fc854154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:41490/0 (socket says 172.21.15.137:41490) 2024-04-26T23:41:30.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7fc853400640 1 -- 172.21.15.137:0/2982341582 learned_addr learned my addr 172.21.15.137:0/2982341582 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7fc85a000640 1 --2- 172.21.15.137:0/2982341582 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc854159bd0 0x7fc8541554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7fc85a000640 1 -- 172.21.15.137:0/2982341582 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc8540703b0 con 0x7fc854159bd0 2024-04-26T23:41:30.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7fc85a000640 1 -- 172.21.15.137:0/2982341582 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc854070530 con 0x7fc85406d410 2024-04-26T23:41:30.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f539d600640 1 -- 172.21.15.137:0/1178744816 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5388053a00 con 0x7f53a00b35b0 2024-04-26T23:41:30.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f539d600640 1 --2- 172.21.15.137:0/1178744816 >> [v2:172.21.15.170:6808/2998038920,v1:172.21.15.170:6809/2998038920] conn(0x7f537c070520 0x7f537c072940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f539d600640 1 -- 172.21.15.137:0/1178744816 --> [v2:172.21.15.170:6808/2998038920,v1:172.21.15.170:6809/2998038920] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f538800ae50 con 0x7f537c070520 2024-04-26T23:41:30.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7fc85a000640 1 -- 172.21.15.137:0/2982341582 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc8540706b0 con 0x7fc854071290 2024-04-26T23:41:30.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f70f1400640 1 -- 172.21.15.137:0/3290031555 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f70ec06a4b0 con 0x7f70ec06e2d0 2024-04-26T23:41:30.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7feb80e00640 1 --2- 172.21.15.137:0/1939530894 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7feb5c068380 0x7feb5c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f539d600640 1 -- 172.21.15.137:0/1178744816 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f538808b060 con 0x7f53a00b35b0 2024-04-26T23:41:30.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7feb81800640 1 --2- 172.21.15.137:0/1939530894 >> [v2:172.21.15.170:6800/1674488513,v1:172.21.15.170:6801/1674488513] conn(0x7feb5c070520 0x7feb5c072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f5397e00640 1 --2- 172.21.15.137:0/1178744816 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f537c068380 0x7f537c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f53a5c00640 1 --2- 172.21.15.137:0/1178744816 >> [v2:172.21.15.170:6808/2998038920,v1:172.21.15.170:6809/2998038920] conn(0x7f537c070520 0x7f537c072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f8a3ce00640 1 --2- 172.21.15.137:0/1139111842 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8a18068480 0x7f8a1806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7fc853e00640 1 --2- 172.21.15.137:0/2982341582 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc854159bd0 0x7fc8541554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f392b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3924053c20 0x7f3924050250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f392b200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39240e6c40 0x7f3924050790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f392b200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39240dc8f0 0x7f3924050cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f392b200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f392403ef10 con 0x7f3924053c20 2024-04-26T23:41:30.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7fc852a00640 1 -- 172.21.15.137:0/2982341582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc85406d410 msgr2=0x7fc8540b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7fc852a00640 1 --2- 172.21.15.137:0/2982341582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc85406d410 0x7fc8540b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7fc852a00640 1 -- 172.21.15.137:0/2982341582 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc854159bd0 msgr2=0x7fc8541554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7fc852a00640 1 --2- 172.21.15.137:0/2982341582 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc854159bd0 0x7fc8541554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7fc852a00640 1 -- 172.21.15.137:0/2982341582 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc854153880 con 0x7fc854071290 2024-04-26T23:41:30.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7fc32fe00640 1 --2- 172.21.15.137:0/3058311583 >> [v2:172.21.15.137:6808/4283404504,v1:172.21.15.137:6809/4283404504] conn(0x7fc310070520 0x7fc310072940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f392b200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f392403ed90 con 0x7f39240e6c40 2024-04-26T23:41:30.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f392b200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f39240f0510 con 0x7f39240dc8f0 2024-04-26T23:41:30.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f53a5c00640 1 --2- 172.21.15.137:0/1178744816 >> [v2:172.21.15.170:6808/2998038920,v1:172.21.15.170:6809/2998038920] conn(0x7f537c070520 0x7f537c072940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7fc852a00640 1 --2- 172.21.15.137:0/2982341582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc854071290 0x7fc854154f80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc8440ab000 tx=0x7fc844019230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7fc853e00640 1 --2- 172.21.15.137:0/2982341582 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc854159bd0 0x7fc8541554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:30.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7febee200640 1 Processor -- start 2024-04-26T23:41:30.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f392a800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39240dc8f0 0x7f3924050cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f392a800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39240dc8f0 0x7f3924050cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:41492/0 (socket says 172.21.15.137:41492) 2024-04-26T23:41:30.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f392a800640 1 -- 172.21.15.137:0/2206290911 learned_addr learned my addr 172.21.15.137:0/2206290911 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7fc84b400640 1 -- 172.21.15.137:0/2982341582 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8440b0040 con 0x7fc854071290 2024-04-26T23:41:30.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7fc84b400640 1 -- 172.21.15.137:0/2982341582 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8440ab400 con 0x7fc854071290 2024-04-26T23:41:30.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7fc84b400640 1 -- 172.21.15.137:0/2982341582 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8440b4640 con 0x7fc854071290 2024-04-26T23:41:30.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f3929400640 1 --2- 172.21.15.137:0/2206290911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39240e6c40 0x7f3924050790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7feb80e00640 1 --2- 172.21.15.137:0/1939530894 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7feb5c068380 0x7feb5c06a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feb70000c10 tx=0x7feb700a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f392a800640 1 -- 172.21.15.137:0/2206290911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39240e6c40 msgr2=0x7f3924050790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f392a800640 1 --2- 172.21.15.137:0/2206290911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39240e6c40 0x7f3924050790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f392a800640 1 -- 172.21.15.137:0/2206290911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3924053c20 msgr2=0x7f3924050250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f392a800640 1 --2- 172.21.15.137:0/2206290911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3924053c20 0x7f3924050250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f392a800640 1 -- 172.21.15.137:0/2206290911 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3924181160 con 0x7f39240dc8f0 2024-04-26T23:41:30.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f539d600640 1 -- 172.21.15.137:0/1178744816 <== osd.4 v2:172.21.15.170:6808/2998038920 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f538800ae50 con 0x7f537c070520 2024-04-26T23:41:30.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7fc85a000640 1 -- 172.21.15.137:0/2982341582 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc854153b60 con 0x7fc854071290 2024-04-26T23:41:30.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7fc85a000640 1 -- 172.21.15.137:0/2982341582 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc854154120 con 0x7fc854071290 2024-04-26T23:41:30.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f392a800640 1 --2- 172.21.15.137:0/2206290911 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39240dc8f0 0x7f3924050cd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f392c051520 tx=0x7f392c069f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7feb81800640 1 --2- 172.21.15.137:0/1939530894 >> [v2:172.21.15.170:6800/1674488513,v1:172.21.15.170:6801/1674488513] conn(0x7feb5c070520 0x7feb5c072940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f3922000640 1 -- 172.21.15.137:0/2206290911 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c050c40 con 0x7f39240dc8f0 2024-04-26T23:41:30.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f3922000640 1 -- 172.21.15.137:0/2206290911 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f392c06d9c0 con 0x7f39240dc8f0 2024-04-26T23:41:30.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f3922000640 1 -- 172.21.15.137:0/2206290911 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c06dd90 con 0x7f39240dc8f0 2024-04-26T23:41:30.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.022+0000 7f392b200640 1 -- 172.21.15.137:0/2206290911 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3924181440 con 0x7f39240dc8f0 2024-04-26T23:41:30.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7fc85a000640 1 -- 172.21.15.137:0/2982341582 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc854153630 con 0x7fc854071290 2024-04-26T23:41:30.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7f392b200640 1 -- 172.21.15.137:0/2206290911 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3924181a00 con 0x7f39240dc8f0 2024-04-26T23:41:30.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7fc32f400640 1 --2- 172.21.15.137:0/3058311583 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc310068380 0x7fc31006a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc3240099f0 tx=0x7fc324009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7fc323400640 1 -- 172.21.15.137:0/3058311583 <== osd.1 v2:172.21.15.137:6808/4283404504 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc31c0aaec0 con 0x7fc310070520 2024-04-26T23:41:30.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7f8a3ce00640 1 --2- 172.21.15.137:0/1139111842 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8a18068480 0x7f8a1806a940 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8a3004d510 tx=0x7f8a2c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7f8a37e00640 1 --2- 172.21.15.137:0/1139111842 >> [v2:172.21.15.137:6800/4056840582,v1:172.21.15.137:6801/4056840582] conn(0x7f8a180706a0 0x7f8a18072ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7f5397e00640 1 --2- 172.21.15.137:0/1178744816 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f537c068380 0x7f537c06a840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f53a0151e30 tx=0x7f5390008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7f392b200640 1 -- 172.21.15.137:0/2206290911 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f39240057f0 con 0x7f39240dc8f0 2024-04-26T23:41:30.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7feb78c00640 1 -- 172.21.15.137:0/1939530894 <== osd.5 v2:172.21.15.170:6800/1674488513 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb6801deb0 con 0x7feb5c070520 2024-04-26T23:41:30.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7f70e2a00640 1 -- 172.21.15.137:0/3290031555 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f70d801a070 con 0x7f70ec06e2d0 2024-04-26T23:41:30.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7f8a37e00640 1 --2- 172.21.15.137:0/1139111842 >> [v2:172.21.15.137:6800/4056840582,v1:172.21.15.137:6801/4056840582] conn(0x7f8a180706a0 0x7f8a18072ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7f70e2a00640 1 --2- 172.21.15.137:0/3290031555 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f70cc068450 0x7f70cc06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7febee200640 1 -- start start 2024-04-26T23:41:30.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7fc84b400640 1 -- 172.21.15.137:0/2982341582 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc8440bb030 con 0x7fc854071290 2024-04-26T23:41:30.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7febee200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7febd0004810 0x7febe004acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7febee200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febe00d4f90 0x7febe00d2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7f70e2a00640 1 -- 172.21.15.137:0/3290031555 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f70d8085dc0 con 0x7f70ec06e2d0 2024-04-26T23:41:30.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7f70e2a00640 1 --2- 172.21.15.137:0/3290031555 >> [v2:172.21.15.137:6816/2945054112,v1:172.21.15.137:6817/2945054112] conn(0x7f70cc0706d0 0x7f70cc072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7f70e2a00640 1 -- 172.21.15.137:0/3290031555 --> [v2:172.21.15.137:6816/2945054112,v1:172.21.15.137:6817/2945054112] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f70d8020e50 con 0x7f70cc0706d0 2024-04-26T23:41:30.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7f70e2a00640 1 -- 172.21.15.137:0/3290031555 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f70d80883c0 con 0x7f70ec06e2d0 2024-04-26T23:41:30.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7f70e9e00640 1 --2- 172.21.15.137:0/3290031555 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f70cc068450 0x7f70cc06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7febee200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7febe00d53f0 0x7febe00d3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7febee200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7febe00531e0 con 0x7febe00d53f0 2024-04-26T23:41:30.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7febee200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7febe0006d00 con 0x7febe00d4f90 2024-04-26T23:41:30.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7febee200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7febe0053360 con 0x7febd0004810 2024-04-26T23:41:30.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.026+0000 7fc84b400640 1 --2- 172.21.15.137:0/2982341582 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc830068450 0x7fc83006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7febed800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7febe00d53f0 0x7febe00d3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7fc84b400640 1 -- 172.21.15.137:0/2982341582 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc84411feb0 con 0x7fc854071290 2024-04-26T23:41:30.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7febed800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7febe00d53f0 0x7febe00d3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33954/0 (socket says 172.21.15.137:33954) 2024-04-26T23:41:30.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7febed800640 1 -- 172.21.15.137:0/4014706591 learned_addr learned my addr 172.21.15.137:0/4014706591 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7febe7e00640 1 --2- 172.21.15.137:0/4014706591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febe00d4f90 0x7febe00d2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7fc84b400640 1 --2- 172.21.15.137:0/2982341582 >> [v2:172.21.15.170:6816/3057172683,v1:172.21.15.170:6817/3057172683] conn(0x7fc830070670 0x7fc830072a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7fc84b400640 1 -- 172.21.15.137:0/2982341582 --> [v2:172.21.15.170:6816/3057172683,v1:172.21.15.170:6817/3057172683] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc84400af30 con 0x7fc830070670 2024-04-26T23:41:30.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7fc84b400640 1 -- 172.21.15.137:0/2982341582 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc844122510 con 0x7fc854071290 2024-04-26T23:41:30.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7fc853400640 1 --2- 172.21.15.137:0/2982341582 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc830068450 0x7fc83006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7febed800640 1 -- 172.21.15.137:0/4014706591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7febd0004810 msgr2=0x7febe004acd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:41:30.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7febece00640 1 --2- 172.21.15.137:0/4014706591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7febd0004810 0x7febe004acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7febed800640 1 --2- 172.21.15.137:0/4014706591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7febd0004810 0x7febe004acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7febed800640 1 -- 172.21.15.137:0/4014706591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febe00d4f90 msgr2=0x7febe00d2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7febed800640 1 --2- 172.21.15.137:0/4014706591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febe00d4f90 0x7febe00d2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7febed800640 1 -- 172.21.15.137:0/4014706591 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febe00d3ef0 con 0x7febe00d53f0 2024-04-26T23:41:30.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7febe7e00640 1 --2- 172.21.15.137:0/4014706591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febe00d4f90 0x7febe00d2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:30.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7f70eb200640 1 --2- 172.21.15.137:0/3290031555 >> [v2:172.21.15.137:6816/2945054112,v1:172.21.15.137:6817/2945054112] conn(0x7f70cc0706d0 0x7f70cc072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7f8a34c00640 1 -- 172.21.15.137:0/1139111842 <== osd.2 v2:172.21.15.137:6800/4056840582 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8a3812c5e0 con 0x7f8a180706a0 2024-04-26T23:41:30.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7fc853400640 1 --2- 172.21.15.137:0/2982341582 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc830068450 0x7fc83006a910 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc83c007b10 tx=0x7fc83c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7febed800640 1 --2- 172.21.15.137:0/4014706591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7febe00d53f0 0x7febe00d3120 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7febe8069b10 tx=0x7febe8069f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7f70e9e00640 1 --2- 172.21.15.137:0/3290031555 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f70cc068450 0x7f70cc06a910 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f70e40af000 tx=0x7f70e40a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7febe4c00640 1 -- 172.21.15.137:0/4014706591 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe8073070 con 0x7febe00d53f0 2024-04-26T23:41:30.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7febe4c00640 1 -- 172.21.15.137:0/4014706591 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febe8074710 con 0x7febe00d53f0 2024-04-26T23:41:30.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7febe4c00640 1 -- 172.21.15.137:0/4014706591 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe8074900 con 0x7febe00d53f0 2024-04-26T23:41:30.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7febee200640 1 -- 172.21.15.137:0/4014706591 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febe00d41d0 con 0x7febe00d53f0 2024-04-26T23:41:30.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7febee200640 1 -- 172.21.15.137:0/4014706591 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febe00d4790 con 0x7febe00d53f0 2024-04-26T23:41:30.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7f70eb200640 1 --2- 172.21.15.137:0/3290031555 >> [v2:172.21.15.137:6816/2945054112,v1:172.21.15.137:6817/2945054112] conn(0x7f70cc0706d0 0x7f70cc072af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.034+0000 7febee200640 1 -- 172.21.15.137:0/4014706591 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7febe00053a0 con 0x7febe00d53f0 2024-04-26T23:41:30.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7f3922000640 1 -- 172.21.15.137:0/2206290911 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f392c0741c0 con 0x7f39240dc8f0 2024-04-26T23:41:30.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7f3922000640 1 --2- 172.21.15.137:0/2206290911 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f390c068380 0x7f390c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7f3922000640 1 -- 172.21.15.137:0/2206290911 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f392c102210 con 0x7f39240dc8f0 2024-04-26T23:41:30.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7f3922000640 1 --2- 172.21.15.137:0/2206290911 >> [v2:172.21.15.137:6824/1614749039,v1:172.21.15.137:6825/1614749039] conn(0x7f390c0705a0 0x7f390c0729c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7f3922000640 1 -- 172.21.15.137:0/2206290911 --> [v2:172.21.15.137:6824/1614749039,v1:172.21.15.137:6825/1614749039] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f392c08ee50 con 0x7f390c0705a0 2024-04-26T23:41:30.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.030+0000 7f3922000640 1 -- 172.21.15.137:0/2206290911 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f392c109050 con 0x7f39240dc8f0 2024-04-26T23:41:30.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.034+0000 7f3929e00640 1 --2- 172.21.15.137:0/2206290911 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f390c068380 0x7f390c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.034+0000 7f3929400640 1 --2- 172.21.15.137:0/2206290911 >> [v2:172.21.15.137:6824/1614749039,v1:172.21.15.137:6825/1614749039] conn(0x7f390c0705a0 0x7f390c0729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.034+0000 7fc853e00640 1 --2- 172.21.15.137:0/2982341582 >> [v2:172.21.15.170:6816/3057172683,v1:172.21.15.170:6817/3057172683] conn(0x7fc830070670 0x7fc830072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.034+0000 7f3929400640 1 --2- 172.21.15.137:0/2206290911 >> [v2:172.21.15.137:6824/1614749039,v1:172.21.15.137:6825/1614749039] conn(0x7f390c0705a0 0x7f390c0729c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.034+0000 7fc853e00640 1 --2- 172.21.15.137:0/2982341582 >> [v2:172.21.15.170:6816/3057172683,v1:172.21.15.170:6817/3057172683] conn(0x7fc830070670 0x7fc830072a90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.034+0000 7f3929e00640 1 --2- 172.21.15.137:0/2206290911 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f390c068380 0x7f390c06a840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f39180ae000 tx=0x7f3918004740 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.034+0000 7f70e2a00640 1 -- 172.21.15.137:0/3290031555 <== osd.3 v2:172.21.15.137:6816/2945054112 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f70d8020e50 con 0x7f70cc0706d0 2024-04-26T23:41:30.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.034+0000 7fc84b400640 1 -- 172.21.15.137:0/2982341582 <== osd.7 v2:172.21.15.170:6816/3057172683 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc84400af30 con 0x7fc830070670 2024-04-26T23:41:30.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.034+0000 7f3922000640 1 -- 172.21.15.137:0/2206290911 <== osd.0 v2:172.21.15.137:6824/1614749039 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f392c08ee50 con 0x7f390c0705a0 2024-04-26T23:41:30.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.038+0000 7febe4c00640 1 -- 172.21.15.137:0/4014706591 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7febe8096430 con 0x7febe00d53f0 2024-04-26T23:41:30.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.038+0000 7febe4c00640 1 --2- 172.21.15.137:0/4014706591 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7febc8068480 0x7febc806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.038+0000 7febe4c00640 1 -- 172.21.15.137:0/4014706591 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7febe8102360 con 0x7febe00d53f0 2024-04-26T23:41:30.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.038+0000 7febe4c00640 1 --2- 172.21.15.137:0/4014706591 >> [v2:172.21.15.170:6823/169019272,v1:172.21.15.170:6824/169019272] conn(0x7febc80706a0 0x7febc8072ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.038+0000 7febe4c00640 1 -- 172.21.15.137:0/4014706591 --> [v2:172.21.15.170:6823/169019272,v1:172.21.15.170:6824/169019272] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7febe8099e70 con 0x7febc80706a0 2024-04-26T23:41:30.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.038+0000 7febe4c00640 1 -- 172.21.15.137:0/4014706591 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7febe8102750 con 0x7febe00d53f0 2024-04-26T23:41:30.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.038+0000 7febece00640 1 --2- 172.21.15.137:0/4014706591 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7febc8068480 0x7febc806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.042+0000 7febe7e00640 1 --2- 172.21.15.137:0/4014706591 >> [v2:172.21.15.170:6823/169019272,v1:172.21.15.170:6824/169019272] conn(0x7febc80706a0 0x7febc8072ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.042+0000 7febece00640 1 --2- 172.21.15.137:0/4014706591 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7febc8068480 0x7febc806a940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7febe0003e90 tx=0x7febd4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.046+0000 7febe7e00640 1 --2- 172.21.15.137:0/4014706591 >> [v2:172.21.15.170:6823/169019272,v1:172.21.15.170:6824/169019272] conn(0x7febc80706a0 0x7febc8072ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.046+0000 7febe4c00640 1 -- 172.21.15.137:0/4014706591 <== osd.6 v2:172.21.15.170:6823/169019272 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7febe8099e70 con 0x7febc80706a0 2024-04-26T23:41:30.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.050+0000 7fc334a00640 1 -- 172.21.15.137:0/3058311583 --> [v2:172.21.15.137:6808/4283404504,v1:172.21.15.137:6809/4283404504] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc328056c40 con 0x7fc310070520 2024-04-26T23:41:30.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.054+0000 7fc323400640 1 -- 172.21.15.137:0/3058311583 <== osd.1 v2:172.21.15.137:6808/4283404504 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc328056c40 con 0x7fc310070520 2024-04-26T23:41:30.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.054+0000 7f53a7c00640 1 -- 172.21.15.137:0/1178744816 --> [v2:172.21.15.170:6808/2998038920,v1:172.21.15.170:6809/2998038920] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f53a014b1b0 con 0x7f537c070520 2024-04-26T23:41:30.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.054+0000 7f539d600640 1 -- 172.21.15.137:0/1178744816 <== osd.4 v2:172.21.15.170:6808/2998038920 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f53a014b1b0 con 0x7f537c070520 2024-04-26T23:41:30.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.054+0000 7fc334a00640 1 -- 172.21.15.137:0/3058311583 >> [v2:172.21.15.137:6808/4283404504,v1:172.21.15.137:6809/4283404504] conn(0x7fc310070520 msgr2=0x7fc310072940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.054+0000 7fc334a00640 1 --2- 172.21.15.137:0/3058311583 >> [v2:172.21.15.137:6808/4283404504,v1:172.21.15.137:6809/4283404504] conn(0x7fc310070520 0x7fc310072940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.054+0000 7f53a7c00640 1 -- 172.21.15.137:0/1178744816 >> [v2:172.21.15.170:6808/2998038920,v1:172.21.15.170:6809/2998038920] conn(0x7f537c070520 msgr2=0x7f537c072940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.054+0000 7f53a7c00640 1 --2- 172.21.15.137:0/1178744816 >> [v2:172.21.15.170:6808/2998038920,v1:172.21.15.170:6809/2998038920] conn(0x7f537c070520 0x7f537c072940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.054+0000 7f53a7c00640 1 -- 172.21.15.137:0/1178744816 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f537c068380 msgr2=0x7f537c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.054+0000 7f53a7c00640 1 --2- 172.21.15.137:0/1178744816 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f537c068380 0x7f537c06a840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f53a0151e30 tx=0x7f5390008040 comp rx=0 tx=0).stop 2024-04-26T23:41:30.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.054+0000 7f53a7c00640 1 -- 172.21.15.137:0/1178744816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53a00b35b0 msgr2=0x7f53a0148050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.054+0000 7f53a7c00640 1 --2- 172.21.15.137:0/1178744816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53a00b35b0 0x7f53a0148050 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f538800c490 tx=0x7f5388001e80 comp rx=0 tx=0).stop 2024-04-26T23:41:30.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.054+0000 7f53a5c00640 1 -- 172.21.15.137:0/1178744816 reap_dead start 2024-04-26T23:41:30.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.054+0000 7fc334a00640 1 -- 172.21.15.137:0/3058311583 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc310068380 msgr2=0x7fc31006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.054+0000 7fc334a00640 1 --2- 172.21.15.137:0/3058311583 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc310068380 0x7fc31006a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc3240099f0 tx=0x7fc324009190 comp rx=0 tx=0).stop 2024-04-26T23:41:30.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.054+0000 7fc334a00640 1 -- 172.21.15.137:0/3058311583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc328054240 msgr2=0x7fc3280513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.054+0000 7fc334a00640 1 --2- 172.21.15.137:0/3058311583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc328054240 0x7fc3280513f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0191b0 tx=0x7fc31c01ade0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.054+0000 7fc32fe00640 1 -- 172.21.15.137:0/3058311583 reap_dead start 2024-04-26T23:41:30.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.054+0000 7f8a3e200640 1 -- 172.21.15.137:0/1139111842 --> [v2:172.21.15.137:6800/4056840582,v1:172.21.15.137:6801/4056840582] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8a14002de0 con 0x7f8a180706a0 2024-04-26T23:41:30.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.054+0000 7f53a7c00640 1 -- 172.21.15.137:0/1178744816 shutdown_connections 2024-04-26T23:41:30.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.054+0000 7f53a7c00640 1 -- 172.21.15.137:0/1178744816 >> 172.21.15.137:0/1178744816 conn(0x7f53a00b2a90 msgr2=0x7f53a00720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.058+0000 7fc334a00640 1 -- 172.21.15.137:0/3058311583 shutdown_connections 2024-04-26T23:41:30.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.058+0000 7fc334a00640 1 -- 172.21.15.137:0/3058311583 >> 172.21.15.137:0/3058311583 conn(0x7fc32803aa40 msgr2=0x7fc32800e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.058+0000 7f8a34c00640 1 -- 172.21.15.137:0/1139111842 <== osd.2 v2:172.21.15.137:6800/4056840582 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8a14002de0 con 0x7f8a180706a0 2024-04-26T23:41:30.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.058+0000 7fc334a00640 1 -- 172.21.15.137:0/3058311583 shutdown_connections 2024-04-26T23:41:30.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.058+0000 7fc334a00640 1 -- 172.21.15.137:0/3058311583 wait complete. 2024-04-26T23:41:30.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.058+0000 7f53a7c00640 1 -- 172.21.15.137:0/1178744816 shutdown_connections 2024-04-26T23:41:30.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.058+0000 7f53a7c00640 1 -- 172.21.15.137:0/1178744816 wait complete. 2024-04-26T23:41:30.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.058+0000 7feb82200640 1 -- 172.21.15.137:0/1939530894 --> [v2:172.21.15.170:6800/1674488513,v1:172.21.15.170:6801/1674488513] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feb7c1588b0 con 0x7feb5c070520 2024-04-26T23:41:30.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.058+0000 7f8a3e200640 1 -- 172.21.15.137:0/1139111842 >> [v2:172.21.15.137:6800/4056840582,v1:172.21.15.137:6801/4056840582] conn(0x7f8a180706a0 msgr2=0x7f8a18072ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.058+0000 7f8a3e200640 1 --2- 172.21.15.137:0/1139111842 >> [v2:172.21.15.137:6800/4056840582,v1:172.21.15.137:6801/4056840582] conn(0x7f8a180706a0 0x7f8a18072ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.058+0000 7f8a3e200640 1 -- 172.21.15.137:0/1139111842 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8a18068480 msgr2=0x7f8a1806a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.058+0000 7f8a3e200640 1 --2- 172.21.15.137:0/1139111842 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8a18068480 0x7f8a1806a940 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8a3004d510 tx=0x7f8a2c008040 comp rx=0 tx=0).stop 2024-04-26T23:41:30.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.058+0000 7f8a3e200640 1 -- 172.21.15.137:0/1139111842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a300e4800 msgr2=0x7f8a3004f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.058+0000 7f8a3e200640 1 --2- 172.21.15.137:0/1139111842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a300e4800 0x7f8a3004f340 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8a3806ab70 tx=0x7f8a38066280 comp rx=0 tx=0).stop 2024-04-26T23:41:30.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.058+0000 7fc85a000640 1 -- 172.21.15.137:0/2982341582 --> [v2:172.21.15.170:6816/3057172683,v1:172.21.15.170:6817/3057172683] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc85406a4b0 con 0x7fc830070670 2024-04-26T23:41:30.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7f8a3d800640 1 -- 172.21.15.137:0/1139111842 reap_dead start 2024-04-26T23:41:30.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7f8a3e200640 1 -- 172.21.15.137:0/1139111842 shutdown_connections 2024-04-26T23:41:30.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7fc84b400640 1 -- 172.21.15.137:0/2982341582 <== osd.7 v2:172.21.15.170:6816/3057172683 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc85406a4b0 con 0x7fc830070670 2024-04-26T23:41:30.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7f8a3e200640 1 -- 172.21.15.137:0/1139111842 >> 172.21.15.137:0/1139111842 conn(0x7f8a30053760 msgr2=0x7f8a3003a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7feb78c00640 1 -- 172.21.15.137:0/1939530894 <== osd.5 v2:172.21.15.170:6800/1674488513 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7feb7c1588b0 con 0x7feb5c070520 2024-04-26T23:41:30.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7fc85a000640 1 -- 172.21.15.137:0/2982341582 >> [v2:172.21.15.170:6816/3057172683,v1:172.21.15.170:6817/3057172683] conn(0x7fc830070670 msgr2=0x7fc830072a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7fc85a000640 1 --2- 172.21.15.137:0/2982341582 >> [v2:172.21.15.170:6816/3057172683,v1:172.21.15.170:6817/3057172683] conn(0x7fc830070670 0x7fc830072a90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7f8a3e200640 1 -- 172.21.15.137:0/1139111842 shutdown_connections 2024-04-26T23:41:30.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7fc85a000640 1 -- 172.21.15.137:0/2982341582 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc830068450 msgr2=0x7fc83006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7fc85a000640 1 --2- 172.21.15.137:0/2982341582 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc830068450 0x7fc83006a910 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc83c007b10 tx=0x7fc83c008040 comp rx=0 tx=0).stop 2024-04-26T23:41:30.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7fc85a000640 1 -- 172.21.15.137:0/2982341582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc854071290 msgr2=0x7fc854154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7fc85a000640 1 --2- 172.21.15.137:0/2982341582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc854071290 0x7fc854154f80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc8440ab000 tx=0x7fc844019230 comp rx=0 tx=0).stop 2024-04-26T23:41:30.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7f8a3e200640 1 -- 172.21.15.137:0/1139111842 wait complete. 2024-04-26T23:41:30.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7f70f1400640 1 -- 172.21.15.137:0/3290031555 --> [v2:172.21.15.137:6816/2945054112,v1:172.21.15.137:6817/2945054112] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f70ec0b5ff0 con 0x7f70cc0706d0 2024-04-26T23:41:30.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7fc853e00640 1 -- 172.21.15.137:0/2982341582 reap_dead start 2024-04-26T23:41:30.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7feb82200640 1 -- 172.21.15.137:0/1939530894 >> [v2:172.21.15.170:6800/1674488513,v1:172.21.15.170:6801/1674488513] conn(0x7feb5c070520 msgr2=0x7feb5c072940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7feb82200640 1 --2- 172.21.15.137:0/1939530894 >> [v2:172.21.15.170:6800/1674488513,v1:172.21.15.170:6801/1674488513] conn(0x7feb5c070520 0x7feb5c072940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7feb82200640 1 -- 172.21.15.137:0/1939530894 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7feb5c068380 msgr2=0x7feb5c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7feb82200640 1 --2- 172.21.15.137:0/1939530894 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7feb5c068380 0x7feb5c06a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feb70000c10 tx=0x7feb700a6000 comp rx=0 tx=0).stop 2024-04-26T23:41:30.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7feb82200640 1 -- 172.21.15.137:0/1939530894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb7c163670 msgr2=0x7feb7c1619f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7feb82200640 1 --2- 172.21.15.137:0/1939530894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb7c163670 0x7feb7c1619f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feb6800b3e0 tx=0x7feb6800b7e0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7fc85a000640 1 -- 172.21.15.137:0/2982341582 shutdown_connections 2024-04-26T23:41:30.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7fc85a000640 1 -- 172.21.15.137:0/2982341582 >> 172.21.15.137:0/2982341582 conn(0x7fc854073160 msgr2=0x7fc854075bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7feb81800640 1 -- 172.21.15.137:0/1939530894 reap_dead start 2024-04-26T23:41:30.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7feb82200640 1 -- 172.21.15.137:0/1939530894 shutdown_connections 2024-04-26T23:41:30.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7feb82200640 1 -- 172.21.15.137:0/1939530894 >> 172.21.15.137:0/1939530894 conn(0x7feb7c0bb040 msgr2=0x7feb7c0b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7fc85a000640 1 -- 172.21.15.137:0/2982341582 shutdown_connections 2024-04-26T23:41:30.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.062+0000 7fc85a000640 1 -- 172.21.15.137:0/2982341582 wait complete. 2024-04-26T23:41:30.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.066+0000 7f70e2a00640 1 -- 172.21.15.137:0/3290031555 <== osd.3 v2:172.21.15.137:6816/2945054112 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f70ec0b5ff0 con 0x7f70cc0706d0 2024-04-26T23:41:30.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.066+0000 7feb82200640 1 -- 172.21.15.137:0/1939530894 shutdown_connections 2024-04-26T23:41:30.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.066+0000 7feb82200640 1 -- 172.21.15.137:0/1939530894 wait complete. 2024-04-26T23:41:30.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.066+0000 7f70f1400640 1 -- 172.21.15.137:0/3290031555 >> [v2:172.21.15.137:6816/2945054112,v1:172.21.15.137:6817/2945054112] conn(0x7f70cc0706d0 msgr2=0x7f70cc072af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.066+0000 7f70f1400640 1 --2- 172.21.15.137:0/3290031555 >> [v2:172.21.15.137:6816/2945054112,v1:172.21.15.137:6817/2945054112] conn(0x7f70cc0706d0 0x7f70cc072af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.066+0000 7f70f1400640 1 -- 172.21.15.137:0/3290031555 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f70cc068450 msgr2=0x7f70cc06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.066+0000 7f70f1400640 1 --2- 172.21.15.137:0/3290031555 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f70cc068450 0x7f70cc06a910 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f70e40af000 tx=0x7f70e40a7070 comp rx=0 tx=0).stop 2024-04-26T23:41:30.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.066+0000 7f70f1400640 1 -- 172.21.15.137:0/3290031555 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70ec06e2d0 msgr2=0x7f70ec149b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.066+0000 7f70f1400640 1 --2- 172.21.15.137:0/3290031555 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70ec06e2d0 0x7f70ec149b90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f70d800c780 tx=0x7f70d800cc40 comp rx=0 tx=0).stop 2024-04-26T23:41:30.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.066+0000 7f70eb200640 1 -- 172.21.15.137:0/3290031555 reap_dead start 2024-04-26T23:41:30.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.066+0000 7f70f1400640 1 -- 172.21.15.137:0/3290031555 shutdown_connections 2024-04-26T23:41:30.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.066+0000 7f70f1400640 1 -- 172.21.15.137:0/3290031555 >> 172.21.15.137:0/3290031555 conn(0x7f70ec06c5d0 msgr2=0x7f70ec0725b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.066+0000 7f392b200640 1 -- 172.21.15.137:0/2206290911 --> [v2:172.21.15.137:6824/1614749039,v1:172.21.15.137:6825/1614749039] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f392400df50 con 0x7f390c0705a0 2024-04-26T23:41:30.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.066+0000 7f70f1400640 1 -- 172.21.15.137:0/3290031555 shutdown_connections 2024-04-26T23:41:30.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.066+0000 7f70f1400640 1 -- 172.21.15.137:0/3290031555 wait complete. 2024-04-26T23:41:30.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.066+0000 7f3922000640 1 -- 172.21.15.137:0/2206290911 <== osd.0 v2:172.21.15.137:6824/1614749039 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f392400df50 con 0x7f390c0705a0 2024-04-26T23:41:30.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.070+0000 7f392b200640 1 -- 172.21.15.137:0/2206290911 >> [v2:172.21.15.137:6824/1614749039,v1:172.21.15.137:6825/1614749039] conn(0x7f390c0705a0 msgr2=0x7f390c0729c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.070+0000 7f392b200640 1 --2- 172.21.15.137:0/2206290911 >> [v2:172.21.15.137:6824/1614749039,v1:172.21.15.137:6825/1614749039] conn(0x7f390c0705a0 0x7f390c0729c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.070+0000 7f392b200640 1 -- 172.21.15.137:0/2206290911 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f390c068380 msgr2=0x7f390c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.070+0000 7f392b200640 1 --2- 172.21.15.137:0/2206290911 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f390c068380 0x7f390c06a840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f39180ae000 tx=0x7f3918004740 comp rx=0 tx=0).stop 2024-04-26T23:41:30.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.070+0000 7f392b200640 1 -- 172.21.15.137:0/2206290911 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39240dc8f0 msgr2=0x7f3924050cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.070+0000 7f392b200640 1 --2- 172.21.15.137:0/2206290911 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39240dc8f0 0x7f3924050cd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f392c051520 tx=0x7f392c069f40 comp rx=0 tx=0).stop 2024-04-26T23:41:30.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.070+0000 7f392a800640 1 -- 172.21.15.137:0/2206290911 reap_dead start 2024-04-26T23:41:30.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.074+0000 7f392b200640 1 -- 172.21.15.137:0/2206290911 shutdown_connections 2024-04-26T23:41:30.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.074+0000 7f392b200640 1 -- 172.21.15.137:0/2206290911 >> 172.21.15.137:0/2206290911 conn(0x7f39240559f0 msgr2=0x7f3924039ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.074+0000 7f392b200640 1 -- 172.21.15.137:0/2206290911 shutdown_connections 2024-04-26T23:41:30.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.074+0000 7f392b200640 1 -- 172.21.15.137:0/2206290911 wait complete. 2024-04-26T23:41:30.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.074+0000 7febee200640 1 -- 172.21.15.137:0/4014706591 --> [v2:172.21.15.170:6823/169019272,v1:172.21.15.170:6824/169019272] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7febe00d29c0 con 0x7febc80706a0 2024-04-26T23:41:30.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.074+0000 7febe4c00640 1 -- 172.21.15.137:0/4014706591 <== osd.6 v2:172.21.15.170:6823/169019272 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7febe00d29c0 con 0x7febc80706a0 2024-04-26T23:41:30.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.074+0000 7febee200640 1 -- 172.21.15.137:0/4014706591 >> [v2:172.21.15.170:6823/169019272,v1:172.21.15.170:6824/169019272] conn(0x7febc80706a0 msgr2=0x7febc8072ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.074+0000 7febee200640 1 --2- 172.21.15.137:0/4014706591 >> [v2:172.21.15.170:6823/169019272,v1:172.21.15.170:6824/169019272] conn(0x7febc80706a0 0x7febc8072ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.074+0000 7febee200640 1 -- 172.21.15.137:0/4014706591 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7febc8068480 msgr2=0x7febc806a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.074+0000 7febee200640 1 --2- 172.21.15.137:0/4014706591 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7febc8068480 0x7febc806a940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7febe0003e90 tx=0x7febd4009040 comp rx=0 tx=0).stop 2024-04-26T23:41:30.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.074+0000 7febee200640 1 -- 172.21.15.137:0/4014706591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7febe00d53f0 msgr2=0x7febe00d3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.074+0000 7febee200640 1 --2- 172.21.15.137:0/4014706591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7febe00d53f0 0x7febe00d3120 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7febe8069b10 tx=0x7febe8069f40 comp rx=0 tx=0).stop 2024-04-26T23:41:30.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.074+0000 7febed800640 1 -- 172.21.15.137:0/4014706591 reap_dead start 2024-04-26T23:41:30.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.078+0000 7febee200640 1 -- 172.21.15.137:0/4014706591 shutdown_connections 2024-04-26T23:41:30.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.078+0000 7febee200640 1 -- 172.21.15.137:0/4014706591 >> 172.21.15.137:0/4014706591 conn(0x7febe0009fc0 msgr2=0x7febe004e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.082+0000 7febee200640 1 -- 172.21.15.137:0/4014706591 shutdown_connections 2024-04-26T23:41:30.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.082+0000 7febee200640 1 -- 172.21.15.137:0/4014706591 wait complete. 2024-04-26T23:41:30.111 INFO:teuthology.orchestra.run.smithi137.stdout:55834574854 2024-04-26T23:41:30.111 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T23:41:30.117 INFO:teuthology.orchestra.run.smithi137.stdout:55834574853 2024-04-26T23:41:30.117 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T23:41:30.118 INFO:teuthology.orchestra.run.smithi137.stdout:55834574854 2024-04-26T23:41:30.118 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T23:41:30.119 INFO:teuthology.orchestra.run.smithi137.stdout:55834574854 2024-04-26T23:41:30.119 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T23:41:30.122 INFO:teuthology.orchestra.run.smithi137.stdout:55834574855 2024-04-26T23:41:30.123 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T23:41:30.127 INFO:teuthology.orchestra.run.smithi137.stdout:55834574854 2024-04-26T23:41:30.127 INFO:teuthology.orchestra.run.smithi137.stdout:55834574855 2024-04-26T23:41:30.128 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T23:41:30.128 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T23:41:30.131 INFO:teuthology.orchestra.run.smithi137.stdout:55834574854 2024-04-26T23:41:30.132 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T23:41:30.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.350+0000 7fad47c00640 1 Processor -- start 2024-04-26T23:41:30.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.354+0000 7fad47c00640 1 -- start start 2024-04-26T23:41:30.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.354+0000 7f1b36400640 1 Processor -- start 2024-04-26T23:41:30.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.354+0000 7fad47c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fad400b6640 0x7fad400b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.354+0000 7fad47c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad4006dbd0 con 0x7fad40070e80 2024-04-26T23:41:30.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.354+0000 7fad47c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad4015fb30 con 0x7fad4015c0a0 2024-04-26T23:41:30.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.354+0000 7fad47c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fad4009ff60 con 0x7fad400b6640 2024-04-26T23:41:30.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.354+0000 7f1b36400640 1 -- start start 2024-04-26T23:41:30.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.354+0000 7fad3fe00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fad40070e80 0x7fad400b5f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46114/0 (socket says 172.21.15.137:46114) 2024-04-26T23:41:30.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.354+0000 7fad3fe00640 1 -- 172.21.15.137:0/280047326 learned_addr learned my addr 172.21.15.137:0/280047326 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:30.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7f1b36400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1b30070520 0x7f1b300709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7f1b36400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b300d2990 0x7f1b300d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7f1b36400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b3015d430 con 0x7f1b3015d050 2024-04-26T23:41:30.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7f1b36400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f1b30070ee0 con 0x7f1b30070520 2024-04-26T23:41:30.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7f1b36400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1b300ce050 con 0x7f1b300d2990 2024-04-26T23:41:30.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7f1b2fe00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1b30070520 0x7f1b300709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7f1b2fe00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1b30070520 0x7f1b300709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:35968/0 (socket says 172.21.15.137:35968) 2024-04-26T23:41:30.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7f1b2fe00640 1 -- 172.21.15.137:0/1184671892 learned_addr learned my addr 172.21.15.137:0/1184671892 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7f1b35a00640 1 --2- 172.21.15.137:0/1184671892 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b300d2990 0x7f1b300d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7fad3f400640 1 -- 172.21.15.137:0/280047326 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1190917457 0 0) 0x7fad4006dbd0 con 0x7fad40070e80 2024-04-26T23:41:30.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7fad3f400640 1 -- 172.21.15.137:0/280047326 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad24003530 con 0x7fad40070e80 2024-04-26T23:41:30.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7fad45c00640 1 --2- 172.21.15.137:0/280047326 >> v2:172.21.15.170:3300/0 conn(0x7fad400b6640 0x7fad400b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7f1b35a00640 1 -- 172.21.15.137:0/1184671892 >> v2:172.21.15.170:3300/0 conn(0x7f1b30070520 msgr2=0x7f1b300709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:30.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7f1b35a00640 1 --2- 172.21.15.137:0/1184671892 >> v2:172.21.15.170:3300/0 conn(0x7f1b30070520 0x7f1b300709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7f1b35a00640 1 -- 172.21.15.137:0/1184671892 >> v1:172.21.15.137:6789/0 conn(0x7f1b3015d050 legacy=0x7f1b300ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7f1b35a00640 1 -- 172.21.15.137:0/1184671892 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b300d3360 con 0x7f1b300d2990 2024-04-26T23:41:30.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7fad3f400640 1 -- 172.21.15.137:0/280047326 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3793660797 0 0) 0x7fad24003530 con 0x7fad40070e80 2024-04-26T23:41:30.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7fad3f400640 1 -- 172.21.15.137:0/280047326 >> v2:172.21.15.170:3300/0 conn(0x7fad400b6640 msgr2=0x7fad400b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:30.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7fad3f400640 1 --2- 172.21.15.137:0/280047326 >> v2:172.21.15.170:3300/0 conn(0x7fad400b6640 0x7fad400b4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7fad3f400640 1 -- 172.21.15.137:0/280047326 >> v1:172.21.15.170:6789/0 conn(0x7fad4015c0a0 legacy=0x7fad4006d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7fad3f400640 1 -- 172.21.15.137:0/280047326 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad4015fe10 con 0x7fad40070e80 2024-04-26T23:41:30.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7fad3f400640 1 -- 172.21.15.137:0/280047326 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fad30001680 con 0x7fad40070e80 2024-04-26T23:41:30.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7fad3f400640 1 -- 172.21.15.137:0/280047326 >> v1:172.21.15.137:6789/0 conn(0x7fad40070e80 legacy=0x7fad400b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7fad3f400640 1 --2- 172.21.15.137:0/280047326 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad240039c0 0x7fad24003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7fad3f400640 1 --2- 172.21.15.137:0/280047326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad24004810 0x7fad24004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7fad3f400640 1 --2- 172.21.15.137:0/280047326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad240053d0 0x7fad2400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7fad3f400640 1 -- 172.21.15.137:0/280047326 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fad2400c260 con 0x7fad240053d0 2024-04-26T23:41:30.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7fad3f400640 1 -- 172.21.15.137:0/280047326 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fad24014c20 con 0x7fad24004810 2024-04-26T23:41:30.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.358+0000 7fad3f400640 1 -- 172.21.15.137:0/280047326 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fad24014e20 con 0x7fad240039c0 2024-04-26T23:41:30.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7fad3fe00640 1 --2- 172.21.15.137:0/280047326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad24004810 0x7fad24004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7fad3fe00640 1 -- 172.21.15.137:0/280047326 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad240039c0 msgr2=0x7fad24003de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:41:30.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7fad3fe00640 1 --2- 172.21.15.137:0/280047326 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad240039c0 0x7fad24003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7fad3fe00640 1 -- 172.21.15.137:0/280047326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad240053d0 msgr2=0x7fad2400b9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:41:30.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7fad3fe00640 1 --2- 172.21.15.137:0/280047326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad240053d0 0x7fad2400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7fad3fe00640 1 -- 172.21.15.137:0/280047326 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad24003530 con 0x7fad24004810 2024-04-26T23:41:30.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7fad45c00640 1 -- 172.21.15.137:0/280047326 reap_dead start 2024-04-26T23:41:30.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7f36ace00640 1 Processor -- start 2024-04-26T23:41:30.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7f36ace00640 1 -- start start 2024-04-26T23:41:30.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7fd71d800640 1 Processor -- start 2024-04-26T23:41:30.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7f1b35a00640 1 --2- 172.21.15.137:0/1184671892 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b300d2990 0x7f1b300d2e20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c0097c0 tx=0x7f1b1c01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ff9ebdac1f2001 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7fd71d800640 1 -- start start 2024-04-26T23:41:30.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7f36ace00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36a806cb10 0x7f36a80baa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7f36ace00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f36a80b3fb0 0x7f36a80b8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7f36ace00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36a8170a10 con 0x7f36a816d190 2024-04-26T23:41:30.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7f36ace00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f36a816d570 con 0x7f36a80b3fb0 2024-04-26T23:41:30.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7f36ace00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f36a80bb050 con 0x7f36a806cb10 2024-04-26T23:41:30.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7f36a6800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f36a80b3fb0 0x7f36a80b8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7f36a6800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f36a80b3fb0 0x7f36a80b8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33970/0 (socket says 172.21.15.137:33970) 2024-04-26T23:41:30.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7f36a6800640 1 -- 172.21.15.137:0/4131030216 learned_addr learned my addr 172.21.15.137:0/4131030216 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7f1b2f400640 1 -- 172.21.15.137:0/1184671892 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0b0070 con 0x7f1b300d2990 2024-04-26T23:41:30.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7f1b2f400640 1 -- 172.21.15.137:0/1184671892 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b1c0ab600 con 0x7f1b300d2990 2024-04-26T23:41:30.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7f1b2f400640 1 -- 172.21.15.137:0/1184671892 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0ab9d0 con 0x7f1b300d2990 2024-04-26T23:41:30.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7f369d400640 1 --2- 172.21.15.137:0/4131030216 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36a806cb10 0x7f36a80baa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7f1b36400640 1 -- 172.21.15.137:0/1184671892 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b300d2990 msgr2=0x7f1b300d2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7f1b36400640 1 --2- 172.21.15.137:0/1184671892 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b300d2990 0x7f1b300d2e20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c0097c0 tx=0x7f1b1c01c410 comp rx=0 tx=0).stop 2024-04-26T23:41:30.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7f1b36400640 1 -- 172.21.15.137:0/1184671892 shutdown_connections 2024-04-26T23:41:30.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7f1b36400640 1 --2- 172.21.15.137:0/1184671892 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b300d2990 0x7f1b300d2e20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7f1b36400640 1 --2- 172.21.15.137:0/1184671892 >> v2:172.21.15.170:3300/0 conn(0x7f1b30070520 0x7f1b300709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7f1b36400640 1 -- 172.21.15.137:0/1184671892 >> 172.21.15.137:0/1184671892 conn(0x7f1b3009ba60 msgr2=0x7f1b3009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7f1b36400640 1 -- 172.21.15.137:0/1184671892 shutdown_connections 2024-04-26T23:41:30.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7fd71d800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7180765d0 0x7fd71815b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7fd71d800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd71806ea70 0x7fd718072c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7fd716a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7180765d0 0x7fd71815b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7fd716a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7180765d0 0x7fd71815b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:41534/0 (socket says 172.21.15.137:41534) 2024-04-26T23:41:30.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7fd716000640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fd7180d07c0 0x7fd71806e360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:50254/0 (socket says 172.21.15.137:50254) 2024-04-26T23:41:30.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7fd717400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd71806ea70 0x7fd718072c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7fd717400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd71806ea70 0x7fd718072c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33982/0 (socket says 172.21.15.137:33982) 2024-04-26T23:41:30.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7fd716a00640 1 -- 172.21.15.137:0/1332467067 learned_addr learned my addr 172.21.15.137:0/1332467067 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7fd71d800640 1 -- 172.21.15.137:0/1332467067 --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7180cfb40 con 0x7fd7180d07c0 2024-04-26T23:41:30.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7f369d400640 1 -- 172.21.15.137:0/4131030216 >> v2:172.21.15.137:3300/0 conn(0x7f36a80b3fb0 msgr2=0x7f36a80b8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:30.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7f369d400640 1 --2- 172.21.15.137:0/4131030216 >> v2:172.21.15.137:3300/0 conn(0x7f36a80b3fb0 0x7f36a80b8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7f369d400640 1 -- 172.21.15.137:0/4131030216 >> v1:172.21.15.170:6789/0 conn(0x7f36a816d190 legacy=0x7f36a806c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.362+0000 7f369d400640 1 -- 172.21.15.137:0/4131030216 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a816fc50 con 0x7f36a806cb10 2024-04-26T23:41:30.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7fd71d800640 1 -- 172.21.15.137:0/1332467067 --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd71815b540 con 0x7fd71806ea70 2024-04-26T23:41:30.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7fd71d800640 1 -- 172.21.15.137:0/1332467067 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd7180cfe20 con 0x7fd7180765d0 2024-04-26T23:41:30.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7fd715600640 1 -- 172.21.15.137:0/1332467067 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 439822784 0 0) 0x7fd7180cfb40 con 0x7fd7180d07c0 2024-04-26T23:41:30.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7fd715600640 1 -- 172.21.15.137:0/1332467067 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6fc003530 con 0x7fd7180d07c0 2024-04-26T23:41:30.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7fd716a00640 1 -- 172.21.15.137:0/1332467067 >> v2:172.21.15.137:3300/0 conn(0x7fd71806ea70 msgr2=0x7fd718072c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:30.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7f1b36400640 1 -- 172.21.15.137:0/1184671892 wait complete. 2024-04-26T23:41:30.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7fad3fe00640 1 --2- 172.21.15.137:0/280047326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad24004810 0x7fad24004c90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fad3000c260 tx=0x7fad3001f390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8fc16db18940b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7fee0b600640 1 Processor -- start 2024-04-26T23:41:30.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7fee0b600640 1 -- start start 2024-04-26T23:41:30.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7fad3f400640 1 -- 172.21.15.137:0/280047326 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad30007d20 con 0x7fad24004810 2024-04-26T23:41:30.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7fd716a00640 1 --2- 172.21.15.137:0/1332467067 >> v2:172.21.15.137:3300/0 conn(0x7fd71806ea70 0x7fd718072c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7fd716a00640 1 -- 172.21.15.137:0/1332467067 >> v1:172.21.15.170:6789/0 conn(0x7fd7180d07c0 legacy=0x7fd71806e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7fd716a00640 1 -- 172.21.15.137:0/1332467067 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd718072460 con 0x7fd7180765d0 2024-04-26T23:41:30.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7fd717400640 1 --2- 172.21.15.137:0/1332467067 >> v2:172.21.15.137:3300/0 conn(0x7fd71806ea70 0x7fd718072c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:30.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7f1b36400640 1 Processor -- start 2024-04-26T23:41:30.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.366+0000 7f1b36400640 1 -- start start 2024-04-26T23:41:30.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fad3f400640 1 -- 172.21.15.137:0/280047326 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad30005ae0 con 0x7fad24004810 2024-04-26T23:41:30.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f369d400640 1 --2- 172.21.15.137:0/4131030216 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36a806cb10 0x7f36a80baa30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f36900097c0 tx=0x7f369001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfb2d499ec7f1457 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fad3f400640 1 -- 172.21.15.137:0/280047326 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad30007d20 con 0x7fad24004810 2024-04-26T23:41:30.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f36a5400640 1 -- 172.21.15.137:0/4131030216 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36900b1070 con 0x7f36a806cb10 2024-04-26T23:41:30.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f1b36400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b30070520 0x7f1b3006df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f1b36400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b300d2990 0x7f1b3014bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f1b36400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b3015d050 0x7f1b3006c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f1b36400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1b300d1c40 con 0x7f1b30070520 2024-04-26T23:41:30.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f1b36400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1b300cebf0 con 0x7f1b3015d050 2024-04-26T23:41:30.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f1b36400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1b300d13f0 con 0x7f1b300d2990 2024-04-26T23:41:30.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f36a5400640 1 -- 172.21.15.137:0/4131030216 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36900a8050 con 0x7f36a806cb10 2024-04-26T23:41:30.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f36a5400640 1 -- 172.21.15.137:0/4131030216 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36900ac860 con 0x7f36a806cb10 2024-04-26T23:41:30.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fad47c00640 1 -- 172.21.15.137:0/280047326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad24004810 msgr2=0x7fad24004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fad47c00640 1 --2- 172.21.15.137:0/280047326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad24004810 0x7fad24004c90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fad3000c260 tx=0x7fad3001f390 comp rx=0 tx=0).stop 2024-04-26T23:41:30.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f36ace00640 1 -- 172.21.15.137:0/4131030216 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36a806cb10 msgr2=0x7f36a80baa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f36ace00640 1 --2- 172.21.15.137:0/4131030216 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36a806cb10 0x7f36a80baa30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f36900097c0 tx=0x7f369001c400 comp rx=0 tx=0).stop 2024-04-26T23:41:30.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fad47c00640 1 -- 172.21.15.137:0/280047326 shutdown_connections 2024-04-26T23:41:30.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fad47c00640 1 --2- 172.21.15.137:0/280047326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad24004810 0x7fad24004c90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fad47c00640 1 -- 172.21.15.137:0/280047326 >> 172.21.15.137:0/280047326 conn(0x7fad40073210 msgr2=0x7fad40073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f1b2fe00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b300d2990 0x7f1b3014bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f1b35000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b30070520 0x7f1b3006df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f1b35a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b3015d050 0x7f1b3006c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f1b35000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b30070520 0x7f1b3006df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33990/0 (socket says 172.21.15.137:33990) 2024-04-26T23:41:30.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f1b35000640 1 -- 172.21.15.137:0/298175884 learned_addr learned my addr 172.21.15.137:0/298175884 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fee0b600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fee0415d9a0 0x7fee040b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fee0b600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fee04072aa0 0x7fee0406e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fee0b600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee04073150 con 0x7fee040b53e0 2024-04-26T23:41:30.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fee0b600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fee04072f10 con 0x7fee04072aa0 2024-04-26T23:41:30.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fee0b600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fee04073430 con 0x7fee0415d9a0 2024-04-26T23:41:30.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fad47c00640 1 -- 172.21.15.137:0/280047326 shutdown_connections 2024-04-26T23:41:30.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f36ace00640 1 -- 172.21.15.137:0/4131030216 shutdown_connections 2024-04-26T23:41:30.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f36ace00640 1 --2- 172.21.15.137:0/4131030216 >> v2:172.21.15.137:3300/0 conn(0x7f36a80b3fb0 0x7f36a80b8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f36ace00640 1 --2- 172.21.15.137:0/4131030216 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36a806cb10 0x7f36a80baa30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f36ace00640 1 -- 172.21.15.137:0/4131030216 >> 172.21.15.137:0/4131030216 conn(0x7f36a80d1b30 msgr2=0x7f36a80d1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fee03e00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fee040b53e0 0x7fee04072390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:50262/0 (socket says 172.21.15.137:50262) 2024-04-26T23:41:30.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fee03e00640 1 -- 172.21.15.137:0/144208926 learned_addr learned my addr 172.21.15.137:0/144208926 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:30.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fee08c00640 1 --2- 172.21.15.137:0/144208926 >> v2:172.21.15.170:3300/0 conn(0x7fee0415d9a0 0x7fee040b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f1b35a00640 1 -- 172.21.15.137:0/298175884 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b300d2990 msgr2=0x7f1b3014bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f1b35a00640 1 --2- 172.21.15.137:0/298175884 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b300d2990 0x7f1b3014bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f1b35a00640 1 -- 172.21.15.137:0/298175884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b30070520 msgr2=0x7f1b3006df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f1b35a00640 1 --2- 172.21.15.137:0/298175884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b30070520 0x7f1b3006df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7f1b35a00640 1 -- 172.21.15.137:0/298175884 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b3006cee0 con 0x7f1b3015d050 2024-04-26T23:41:30.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fee09600640 1 --2- 172.21.15.137:0/144208926 >> v2:172.21.15.137:3300/0 conn(0x7fee04072aa0 0x7fee0406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fee03400640 1 -- 172.21.15.137:0/144208926 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 241606787 0 0) 0x7fee04073150 con 0x7fee040b53e0 2024-04-26T23:41:30.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fee03400640 1 -- 172.21.15.137:0/144208926 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fede8003530 con 0x7fee040b53e0 2024-04-26T23:41:30.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fad47c00640 1 -- 172.21.15.137:0/280047326 wait complete. 2024-04-26T23:41:30.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fee08c00640 1 -- 172.21.15.137:0/144208926 >> v2:172.21.15.137:3300/0 conn(0x7fee04072aa0 msgr2=0x7fee0406e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:30.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fee08c00640 1 --2- 172.21.15.137:0/144208926 >> v2:172.21.15.137:3300/0 conn(0x7fee04072aa0 0x7fee0406e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fee08c00640 1 -- 172.21.15.137:0/144208926 >> v1:172.21.15.170:6789/0 conn(0x7fee040b53e0 legacy=0x7fee04072390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.370+0000 7fee08c00640 1 -- 172.21.15.137:0/144208926 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee04073710 con 0x7fee0415d9a0 2024-04-26T23:41:30.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7f36ace00640 1 -- 172.21.15.137:0/4131030216 shutdown_connections 2024-04-26T23:41:30.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7f36ace00640 1 -- 172.21.15.137:0/4131030216 wait complete. 2024-04-26T23:41:30.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7f0372600640 1 Processor -- start 2024-04-26T23:41:30.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7fd716a00640 1 --2- 172.21.15.137:0/1332467067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7180765d0 0x7fd71815b000 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd700009870 tx=0x7fd70001ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b892e62d06425a86 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7f1b35a00640 1 --2- 172.21.15.137:0/298175884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b3015d050 0x7f1b3006c590 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c0ab000 tx=0x7f1b1c01ac50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7f0372600640 1 -- start start 2024-04-26T23:41:30.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7fd715600640 1 -- 172.21.15.137:0/1332467067 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7000b5070 con 0x7fd7180765d0 2024-04-26T23:41:30.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7fd715600640 1 -- 172.21.15.137:0/1332467067 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7000a8a50 con 0x7fd7180765d0 2024-04-26T23:41:30.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7fd715600640 1 -- 172.21.15.137:0/1332467067 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7000a8e20 con 0x7fd7180765d0 2024-04-26T23:41:30.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7f1b2cc00640 1 -- 172.21.15.137:0/298175884 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0b0050 con 0x7f1b3015d050 2024-04-26T23:41:30.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7fad47c00640 1 Processor -- start 2024-04-26T23:41:30.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7fad47c00640 1 -- start start 2024-04-26T23:41:30.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7f1b2cc00640 1 -- 172.21.15.137:0/298175884 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b1c0bc070 con 0x7f1b3015d050 2024-04-26T23:41:30.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7f1b36400640 1 -- 172.21.15.137:0/298175884 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b3006d1c0 con 0x7f1b3015d050 2024-04-26T23:41:30.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7f1b2cc00640 1 -- 172.21.15.137:0/298175884 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0b5870 con 0x7f1b3015d050 2024-04-26T23:41:30.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7f1b36400640 1 -- 172.21.15.137:0/298175884 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b3006d780 con 0x7f1b3015d050 2024-04-26T23:41:30.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7f0372600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f036c0d5b90 0x7f036c0b7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7f0372600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f036c06c7e0 0x7f036c0d3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7f0372600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f036c0d3570 con 0x7f036c06c400 2024-04-26T23:41:30.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7f0372600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f036c0cfca0 con 0x7f036c06c7e0 2024-04-26T23:41:30.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7f0372600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f036c0d16c0 con 0x7f036c0d5b90 2024-04-26T23:41:30.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7f036aa00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f036c0d5b90 0x7f036c0b7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7f036aa00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f036c0d5b90 0x7f036c0b7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:36012/0 (socket says 172.21.15.137:36012) 2024-04-26T23:41:30.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7fd71d800640 1 -- 172.21.15.137:0/1332467067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7180765d0 msgr2=0x7fd71815b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7fd71d800640 1 --2- 172.21.15.137:0/1332467067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7180765d0 0x7fd71815b000 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd700009870 tx=0x7fd70001ed50 comp rx=0 tx=0).stop 2024-04-26T23:41:30.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7fd71d800640 1 -- 172.21.15.137:0/1332467067 shutdown_connections 2024-04-26T23:41:30.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7fd71d800640 1 --2- 172.21.15.137:0/1332467067 >> v2:172.21.15.137:3300/0 conn(0x7fd71806ea70 0x7fd718072c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7fd71d800640 1 --2- 172.21.15.137:0/1332467067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7180765d0 0x7fd71815b000 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7fd71d800640 1 -- 172.21.15.137:0/1332467067 >> 172.21.15.137:0/1332467067 conn(0x7fd71806c400 msgr2=0x7fd71806c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7fd71d800640 1 -- 172.21.15.137:0/1332467067 shutdown_connections 2024-04-26T23:41:30.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.374+0000 7fd71d800640 1 -- 172.21.15.137:0/1332467067 wait complete. 2024-04-26T23:41:30.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7f36ace00640 1 Processor -- start 2024-04-26T23:41:30.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7f036aa00640 1 -- 172.21.15.137:0/3080088375 learned_addr learned my addr 172.21.15.137:0/3080088375 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7f36ace00640 1 -- start start 2024-04-26T23:41:30.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7f1b36400640 1 -- 172.21.15.137:0/298175884 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b080052a0 con 0x7f1b3015d050 2024-04-26T23:41:30.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7ff24e800640 1 Processor -- start 2024-04-26T23:41:30.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7ff24e800640 1 -- start start 2024-04-26T23:41:30.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7fad47c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad24004810 0x7fad4015b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7fad47c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad40154290 0x7fad401546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7fd71d800640 1 Processor -- start 2024-04-26T23:41:30.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7fad45200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad24004810 0x7fad4015b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7fad45200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad24004810 0x7fad4015b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:36014/0 (socket says 172.21.15.137:36014) 2024-04-26T23:41:30.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7fad45200640 1 -- 172.21.15.137:0/459692273 learned_addr learned my addr 172.21.15.137:0/459692273 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7f036be00640 1 --2- 172.21.15.137:0/3080088375 >> v2:172.21.15.137:3300/0 conn(0x7f036c06c7e0 0x7f036c0d3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7fad47c00640 1 --2- 172.21.15.137:0/459692273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad401506f0 0x7fad40150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7fad47c00640 1 -- 172.21.15.137:0/459692273 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fad40160820 con 0x7fad401506f0 2024-04-26T23:41:30.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7fad47c00640 1 -- 172.21.15.137:0/459692273 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fad4006deb0 con 0x7fad24004810 2024-04-26T23:41:30.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7fad47c00640 1 -- 172.21.15.137:0/459692273 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fad40154c30 con 0x7fad40154290 2024-04-26T23:41:30.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7fad3fe00640 1 --2- 172.21.15.137:0/459692273 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad40154290 0x7fad401546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7f036aa00640 1 -- 172.21.15.137:0/3080088375 >> v2:172.21.15.137:3300/0 conn(0x7f036c06c7e0 msgr2=0x7f036c0d3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:30.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7f036aa00640 1 --2- 172.21.15.137:0/3080088375 >> v2:172.21.15.137:3300/0 conn(0x7f036c06c7e0 0x7f036c0d3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7f036aa00640 1 -- 172.21.15.137:0/3080088375 >> v1:172.21.15.137:6789/0 conn(0x7f036c06c400 legacy=0x7f036c0ba780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7f036aa00640 1 -- 172.21.15.137:0/3080088375 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f036c0cfef0 con 0x7f036c0d5b90 2024-04-26T23:41:30.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7fad45c00640 1 --2- 172.21.15.137:0/459692273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad401506f0 0x7fad40150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7f36ace00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36a806cb10 0x7f36a80cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7f1b2cc00640 1 -- 172.21.15.137:0/298175884 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1b1c0b5a10 con 0x7f1b3015d050 2024-04-26T23:41:30.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7f1b2cc00640 1 --2- 172.21.15.137:0/298175884 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1b10068480 0x7f1b1006a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7f1b2cc00640 1 -- 172.21.15.137:0/298175884 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1b1c121050 con 0x7f1b3015d050 2024-04-26T23:41:30.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7fad45c00640 1 -- 172.21.15.137:0/459692273 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad40154290 msgr2=0x7fad401546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7fad45c00640 1 --2- 172.21.15.137:0/459692273 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad40154290 0x7fad401546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7fad45c00640 1 -- 172.21.15.137:0/459692273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad24004810 msgr2=0x7fad4015b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7fad45c00640 1 --2- 172.21.15.137:0/459692273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad24004810 0x7fad4015b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7fad45c00640 1 -- 172.21.15.137:0/459692273 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad4014c8e0 con 0x7fad401506f0 2024-04-26T23:41:30.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7f1b35000640 1 --2- 172.21.15.137:0/298175884 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1b10068480 0x7f1b1006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fee08c00640 1 --2- 172.21.15.137:0/144208926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee0415d9a0 0x7fee040b4ea0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fedfc009d90 tx=0x7fedfc01c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a828bd7774bda4b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.378+0000 7fd71d800640 1 -- start start 2024-04-26T23:41:30.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7f36ace00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36a80b3fb0 0x7f36a8169e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7f36ace00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36a816d190 0x7f36a80ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fad45c00640 1 --2- 172.21.15.137:0/459692273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad401506f0 0x7fad40150b70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fad400b4b80 tx=0x7fad2c00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7f36ace00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f36a80d14d0 con 0x7f36a806cb10 2024-04-26T23:41:30.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7f36ace00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f36a80b9cf0 con 0x7f36a80b3fb0 2024-04-26T23:41:30.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7f36ace00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f36a80ce660 con 0x7f36a816d190 2024-04-26T23:41:30.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7f369d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36a80b3fb0 0x7f36a8169e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7f369d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36a80b3fb0 0x7f36a8169e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:36026/0 (socket says 172.21.15.137:36026) 2024-04-26T23:41:30.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7f369d400640 1 -- 172.21.15.137:0/147876706 learned_addr learned my addr 172.21.15.137:0/147876706 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7f36a6800640 1 --2- 172.21.15.137:0/147876706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36a816d190 0x7f36a80ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7f1b35000640 1 --2- 172.21.15.137:0/298175884 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1b10068480 0x7f1b1006a940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1b28001d70 tx=0x7f1b28009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7ff24e800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2480d0040 0x7ff248073d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7ff24e800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff24806e630 0x7ff2480d0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7ff246a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff24806e630 0x7ff2480d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7ff246a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff24806e630 0x7ff2480d0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:36034/0 (socket says 172.21.15.137:36034) 2024-04-26T23:41:30.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7ff247400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2480d0040 0x7ff248073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7ff247400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2480d0040 0x7ff248073d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:41560/0 (socket says 172.21.15.137:41560) 2024-04-26T23:41:30.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7ff246a00640 1 -- 172.21.15.137:0/1327289330 learned_addr learned my addr 172.21.15.137:0/1327289330 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7ff24e800640 1 -- 172.21.15.137:0/1327289330 --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff24806eab0 con 0x7ff24815b660 2024-04-26T23:41:30.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7ff24e800640 1 -- 172.21.15.137:0/1327289330 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff2480d0960 con 0x7ff24806e630 2024-04-26T23:41:30.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7ff24e800640 1 -- 172.21.15.137:0/1327289330 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff24815beb0 con 0x7ff2480d0040 2024-04-26T23:41:30.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fad3cc00640 1 -- 172.21.15.137:0/459692273 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2c015070 con 0x7fad401506f0 2024-04-26T23:41:30.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fad3cc00640 1 -- 172.21.15.137:0/459692273 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2c004220 con 0x7fad401506f0 2024-04-26T23:41:30.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fad3cc00640 1 -- 172.21.15.137:0/459692273 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2c003620 con 0x7fad401506f0 2024-04-26T23:41:30.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fad47c00640 1 -- 172.21.15.137:0/459692273 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad4014cbc0 con 0x7fad401506f0 2024-04-26T23:41:30.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7f369d400640 1 -- 172.21.15.137:0/147876706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36a816d190 msgr2=0x7f36a80ceaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7f369d400640 1 --2- 172.21.15.137:0/147876706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36a816d190 0x7f36a80ceaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7f369d400640 1 -- 172.21.15.137:0/147876706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36a806cb10 msgr2=0x7f36a80cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7f369d400640 1 --2- 172.21.15.137:0/147876706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36a806cb10 0x7f36a80cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7f369d400640 1 -- 172.21.15.137:0/147876706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a816a3b0 con 0x7f36a80b3fb0 2024-04-26T23:41:30.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fd71d800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd71806ea70 0x7fd7181f0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fd71d800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7180765d0 0x7fd71815d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fd71d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7180d07c0 0x7fd71815d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fd71d800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd7180d0c00 con 0x7fd7180d07c0 2024-04-26T23:41:30.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fd71d800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd7180d0490 con 0x7fd71806ea70 2024-04-26T23:41:30.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fd71d800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd7180d0d80 con 0x7fd7180765d0 2024-04-26T23:41:30.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fd716a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd71806ea70 0x7fd7181f0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fd717400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7180d07c0 0x7fd71815d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fd716a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd71806ea70 0x7fd7181f0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:36048/0 (socket says 172.21.15.137:36048) 2024-04-26T23:41:30.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fd716a00640 1 -- 172.21.15.137:0/1448172837 learned_addr learned my addr 172.21.15.137:0/1448172837 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7ff247400640 1 -- 172.21.15.137:0/1327289330 >> v2:172.21.15.170:3300/0 conn(0x7ff24806e630 msgr2=0x7ff2480d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:30.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7ff247400640 1 --2- 172.21.15.137:0/1327289330 >> v2:172.21.15.170:3300/0 conn(0x7ff24806e630 0x7ff2480d0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7ff247400640 1 -- 172.21.15.137:0/1327289330 >> v1:172.21.15.170:6789/0 conn(0x7ff24815b660 legacy=0x7ff2480cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7ff247400640 1 -- 172.21.15.137:0/1327289330 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff24815c190 con 0x7ff2480d0040 2024-04-26T23:41:30.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fad47c00640 1 -- 172.21.15.137:0/459692273 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad4014d180 con 0x7fad401506f0 2024-04-26T23:41:30.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fd716000640 1 --2- 172.21.15.137:0/1448172837 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7180765d0 0x7fd71815d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fd717400640 1 -- 172.21.15.137:0/1448172837 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7180765d0 msgr2=0x7fd71815d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fd717400640 1 --2- 172.21.15.137:0/1448172837 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7180765d0 0x7fd71815d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fd717400640 1 -- 172.21.15.137:0/1448172837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd71806ea70 msgr2=0x7fd7181f0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fd717400640 1 --2- 172.21.15.137:0/1448172837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd71806ea70 0x7fd7181f0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fd717400640 1 -- 172.21.15.137:0/1448172837 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd718155b00 con 0x7fd7180d07c0 2024-04-26T23:41:30.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fd716a00640 1 --2- 172.21.15.137:0/1448172837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd71806ea70 0x7fd7181f0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:30.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7f369d400640 1 --2- 172.21.15.137:0/147876706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36a80b3fb0 0x7f36a8169e70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f369001a030 tx=0x7f36900191a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fd717400640 1 --2- 172.21.15.137:0/1448172837 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7180d07c0 0x7fd71815d7c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd710007e60 tx=0x7fd71000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7f5e89600640 1 Processor -- start 2024-04-26T23:41:30.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fee03400640 1 -- 172.21.15.137:0/144208926 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0b2070 con 0x7fee0415d9a0 2024-04-26T23:41:30.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fee03400640 1 -- 172.21.15.137:0/144208926 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedfc0a5880 con 0x7fee0415d9a0 2024-04-26T23:41:30.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fee03400640 1 -- 172.21.15.137:0/144208926 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0a5c50 con 0x7fee0415d9a0 2024-04-26T23:41:30.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fd70ea00640 1 -- 172.21.15.137:0/1448172837 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71001a070 con 0x7fd7180d07c0 2024-04-26T23:41:30.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7fd70ea00640 1 -- 172.21.15.137:0/1448172837 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd710003ba0 con 0x7fd7180d07c0 2024-04-26T23:41:30.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7fad47c00640 1 -- 172.21.15.137:0/459692273 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad4006a4b0 con 0x7fad401506f0 2024-04-26T23:41:30.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f369ea00640 1 -- 172.21.15.137:0/147876706 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36900b1040 con 0x7f36a80b3fb0 2024-04-26T23:41:30.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f369ea00640 1 -- 172.21.15.137:0/147876706 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36900bd070 con 0x7f36a80b3fb0 2024-04-26T23:41:30.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f369ea00640 1 -- 172.21.15.137:0/147876706 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36900b6680 con 0x7f36a80b3fb0 2024-04-26T23:41:30.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f36ace00640 1 -- 172.21.15.137:0/147876706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36a80b6270 con 0x7f36a80b3fb0 2024-04-26T23:41:30.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f36ace00640 1 -- 172.21.15.137:0/147876706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36a80b67f0 con 0x7f36a80b3fb0 2024-04-26T23:41:30.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f036aa00640 1 --2- 172.21.15.137:0/3080088375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f036c0d5b90 0x7f036c0b7f90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f036c050e10 tx=0x7f035801c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7c8d298e3d4fb87 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7fd70ea00640 1 -- 172.21.15.137:0/1448172837 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd710004030 con 0x7fd7180d07c0 2024-04-26T23:41:30.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.382+0000 7f5e89600640 1 -- start start 2024-04-26T23:41:30.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7fee0b600640 1 -- 172.21.15.137:0/144208926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee0415d9a0 msgr2=0x7fee040b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7fee0b600640 1 --2- 172.21.15.137:0/144208926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee0415d9a0 0x7fee040b4ea0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fedfc009d90 tx=0x7fedfc01c930 comp rx=0 tx=0).stop 2024-04-26T23:41:30.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f036a000640 1 -- 172.21.15.137:0/3080088375 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03580ab400 con 0x7f036c0d5b90 2024-04-26T23:41:30.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7fd71d800640 1 -- 172.21.15.137:0/1448172837 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd718155de0 con 0x7fd7180d07c0 2024-04-26T23:41:30.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f036a000640 1 -- 172.21.15.137:0/3080088375 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03580b0070 con 0x7f036c0d5b90 2024-04-26T23:41:30.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f036a000640 1 -- 172.21.15.137:0/3080088375 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03580ab7c0 con 0x7f036c0d5b90 2024-04-26T23:41:30.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f5e89600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5e840b21c0 0x7f5e8415dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f5e89600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5e84071bc0 0x7f5e8415e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f5e89600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e8415e4e0 con 0x7f5e84072050 2024-04-26T23:41:30.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f5e89600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5e84071730 con 0x7f5e840b21c0 2024-04-26T23:41:30.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f5e89600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f5e84070b20 con 0x7f5e84071bc0 2024-04-26T23:41:30.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f36ace00640 1 -- 172.21.15.137:0/147876706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36a806a4b0 con 0x7f36a80b3fb0 2024-04-26T23:41:30.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7fee0b600640 1 -- 172.21.15.137:0/144208926 shutdown_connections 2024-04-26T23:41:30.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7fee0b600640 1 --2- 172.21.15.137:0/144208926 >> v2:172.21.15.137:3300/0 conn(0x7fee04072aa0 0x7fee0406e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7fee0b600640 1 --2- 172.21.15.137:0/144208926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee0415d9a0 0x7fee040b4ea0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7fee0b600640 1 -- 172.21.15.137:0/144208926 >> 172.21.15.137:0/144208926 conn(0x7fee040b2a90 msgr2=0x7fee040b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7fd71d800640 1 -- 172.21.15.137:0/1448172837 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7181563a0 con 0x7fd7180d07c0 2024-04-26T23:41:30.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7ff247400640 1 --2- 172.21.15.137:0/1327289330 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2480d0040 0x7ff248073d20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff238009fd0 tx=0x7ff23801cd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cce3eb3c5b4557a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7fee0b600640 1 -- 172.21.15.137:0/144208926 shutdown_connections 2024-04-26T23:41:30.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f5e82000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5e84071bc0 0x7f5e8415e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f5e82000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5e84071bc0 0x7f5e8415e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:36056/0 (socket says 172.21.15.137:36056) 2024-04-26T23:41:30.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f5e82000640 1 -- 172.21.15.137:0/1748268637 learned_addr learned my addr 172.21.15.137:0/1748268637 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7fee0b600640 1 -- 172.21.15.137:0/144208926 wait complete. 2024-04-26T23:41:30.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f0372600640 1 -- 172.21.15.137:0/3080088375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f036c0d5b90 msgr2=0x7f036c0b7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f0372600640 1 --2- 172.21.15.137:0/3080088375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f036c0d5b90 0x7f036c0b7f90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f036c050e10 tx=0x7f035801c460 comp rx=0 tx=0).stop 2024-04-26T23:41:30.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7fad3cc00640 1 -- 172.21.15.137:0/459692273 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fad2c0037c0 con 0x7fad401506f0 2024-04-26T23:41:30.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f5e82000640 1 -- 172.21.15.137:0/1748268637 >> v2:172.21.15.137:3300/0 conn(0x7f5e840b21c0 msgr2=0x7f5e8415dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:30.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f5e82000640 1 --2- 172.21.15.137:0/1748268637 >> v2:172.21.15.137:3300/0 conn(0x7f5e840b21c0 0x7f5e8415dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7f0372600640 1 -- 172.21.15.137:0/3080088375 shutdown_connections 2024-04-26T23:41:30.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7f0372600640 1 --2- 172.21.15.137:0/3080088375 >> v2:172.21.15.137:3300/0 conn(0x7f036c06c7e0 0x7f036c0d3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7f0372600640 1 --2- 172.21.15.137:0/3080088375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f036c0d5b90 0x7f036c0b7f90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7f0372600640 1 -- 172.21.15.137:0/3080088375 >> 172.21.15.137:0/3080088375 conn(0x7f036c0d4e60 msgr2=0x7f036c0d5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7ff246000640 1 -- 172.21.15.137:0/1327289330 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2380b2070 con 0x7ff2480d0040 2024-04-26T23:41:30.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7ff246000640 1 -- 172.21.15.137:0/1327289330 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2380a5cd0 con 0x7ff2480d0040 2024-04-26T23:41:30.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7ff246000640 1 -- 172.21.15.137:0/1327289330 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2380ad660 con 0x7ff2480d0040 2024-04-26T23:41:30.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7f0372600640 1 -- 172.21.15.137:0/3080088375 shutdown_connections 2024-04-26T23:41:30.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7f0372600640 1 -- 172.21.15.137:0/3080088375 wait complete. 2024-04-26T23:41:30.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7fad3cc00640 1 --2- 172.21.15.137:0/459692273 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fad200683b0 0x7fad2006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7ff24e800640 1 -- 172.21.15.137:0/1327289330 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2480d0040 msgr2=0x7ff248073d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7ff24e800640 1 --2- 172.21.15.137:0/1327289330 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2480d0040 0x7ff248073d20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff238009fd0 tx=0x7ff23801cd10 comp rx=0 tx=0).stop 2024-04-26T23:41:30.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7fad3cc00640 1 -- 172.21.15.137:0/459692273 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fad2c0862e0 con 0x7fad401506f0 2024-04-26T23:41:30.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7ff24e800640 1 -- 172.21.15.137:0/1327289330 shutdown_connections 2024-04-26T23:41:30.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7ff24e800640 1 --2- 172.21.15.137:0/1327289330 >> v2:172.21.15.170:3300/0 conn(0x7ff24806e630 0x7ff2480d0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7ff24e800640 1 --2- 172.21.15.137:0/1327289330 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2480d0040 0x7ff248073d20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7ff24e800640 1 -- 172.21.15.137:0/1327289330 >> 172.21.15.137:0/1327289330 conn(0x7ff24806c5d0 msgr2=0x7ff24806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7ff24e800640 1 -- 172.21.15.137:0/1327289330 shutdown_connections 2024-04-26T23:41:30.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7ff24e800640 1 -- 172.21.15.137:0/1327289330 wait complete. 2024-04-26T23:41:30.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7fee0b600640 1 Processor -- start 2024-04-26T23:41:30.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7fad45200640 1 --2- 172.21.15.137:0/459692273 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fad200683b0 0x7fad2006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7f369ea00640 1 -- 172.21.15.137:0/147876706 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f36900b4070 con 0x7f36a80b3fb0 2024-04-26T23:41:30.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7f369ea00640 1 --2- 172.21.15.137:0/147876706 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3684068450 0x7f368406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7f369ea00640 1 -- 172.21.15.137:0/147876706 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3690120610 con 0x7f36a80b3fb0 2024-04-26T23:41:30.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.386+0000 7f1b2cc00640 1 -- 172.21.15.137:0/298175884 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1b1c016090 con 0x7f1b3015d050 2024-04-26T23:41:30.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7f36a5e00640 1 --2- 172.21.15.137:0/147876706 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3684068450 0x7f368406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7f0372600640 1 Processor -- start 2024-04-26T23:41:30.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7fd71d800640 1 -- 172.21.15.137:0/1448172837 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd718069460 con 0x7fd7180d07c0 2024-04-26T23:41:30.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7fee0b600640 1 -- start start 2024-04-26T23:41:30.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7fad45200640 1 --2- 172.21.15.137:0/459692273 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fad200683b0 0x7fad2006a870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fad38001e20 tx=0x7fad38009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7ff24e800640 1 Processor -- start 2024-04-26T23:41:30.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7fee0b600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee04072aa0 0x7fee041567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7fee0b600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee040b53e0 0x7fee040b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7fee0b600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee0415d9a0 0x7fee040b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7fee0b600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee0406f760 con 0x7fee040b53e0 2024-04-26T23:41:30.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7fee0b600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fee0406f5e0 con 0x7fee0415d9a0 2024-04-26T23:41:30.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7fee0b600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fee0406f8e0 con 0x7fee04072aa0 2024-04-26T23:41:30.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7fee08c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee04072aa0 0x7fee041567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7fee08c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee04072aa0 0x7fee041567e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:41582/0 (socket says 172.21.15.137:41582) 2024-04-26T23:41:30.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7fee08c00640 1 -- 172.21.15.137:0/2658637130 learned_addr learned my addr 172.21.15.137:0/2658637130 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7ff24e800640 1 -- start start 2024-04-26T23:41:30.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7fee09600640 1 --2- 172.21.15.137:0/2658637130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee0415d9a0 0x7fee040b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7fee08c00640 1 -- 172.21.15.137:0/2658637130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee0415d9a0 msgr2=0x7fee040b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7fee08c00640 1 --2- 172.21.15.137:0/2658637130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee0415d9a0 0x7fee040b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7fee08c00640 1 -- 172.21.15.137:0/2658637130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee040b53e0 msgr2=0x7fee040b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7fee08c00640 1 --2- 172.21.15.137:0/2658637130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee040b53e0 0x7fee040b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7fee08c00640 1 -- 172.21.15.137:0/2658637130 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee04158200 con 0x7fee04072aa0 2024-04-26T23:41:30.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7ff24e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff24806e630 0x7ff248207df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7ff24e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2480d0040 0x7ff24814d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7ff24e800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff24815b660 0x7ff248150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7ff24e800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2480cfc10 con 0x7ff2480d0040 2024-04-26T23:41:30.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7ff24e800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff2480cfa90 con 0x7ff24806e630 2024-04-26T23:41:30.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7ff24e800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff248155920 con 0x7ff24815b660 2024-04-26T23:41:30.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7fee08c00640 1 --2- 172.21.15.137:0/2658637130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee04072aa0 0x7fee041567e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0b0040 tx=0x7fedfc0196d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7f36a5e00640 1 --2- 172.21.15.137:0/147876706 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3684068450 0x7f368406a910 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3698007fd0 tx=0x7f3698007960 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7f369ea00640 1 -- 172.21.15.137:0/147876706 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f36900c6020 con 0x7f36a80b3fb0 2024-04-26T23:41:30.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7fee00c00640 1 -- 172.21.15.137:0/2658637130 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0b2050 con 0x7fee04072aa0 2024-04-26T23:41:30.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7ff247400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff24806e630 0x7ff248207df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7ff246a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2480d0040 0x7ff24814d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7f5e82000640 1 -- 172.21.15.137:0/1748268637 >> v1:172.21.15.137:6789/0 conn(0x7f5e84072050 legacy=0x7f5e840d2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.390+0000 7f5e82000640 1 -- 172.21.15.137:0/1748268637 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e84070e00 con 0x7f5e84071bc0 2024-04-26T23:41:30.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7fee00c00640 1 -- 172.21.15.137:0/2658637130 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedfc0be070 con 0x7fee04072aa0 2024-04-26T23:41:30.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7fd70ea00640 1 -- 172.21.15.137:0/1448172837 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd71001d070 con 0x7fd7180d07c0 2024-04-26T23:41:30.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7ff247400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff24806e630 0x7ff248207df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:36078/0 (socket says 172.21.15.137:36078) 2024-04-26T23:41:30.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7fee0b600640 1 -- 172.21.15.137:0/2658637130 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee041584e0 con 0x7fee04072aa0 2024-04-26T23:41:30.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7ff246a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2480d0040 0x7ff24814d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34058/0 (socket says 172.21.15.137:34058) 2024-04-26T23:41:30.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7ff246a00640 1 -- 172.21.15.137:0/563081536 learned_addr learned my addr 172.21.15.137:0/563081536 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7ff247e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff24815b660 0x7ff248150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7fee0b600640 1 -- 172.21.15.137:0/2658637130 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fee040cf130 con 0x7fee04072aa0 2024-04-26T23:41:30.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7fee00c00640 1 -- 172.21.15.137:0/2658637130 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0ada50 con 0x7fee04072aa0 2024-04-26T23:41:30.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7ff247e00640 1 -- 172.21.15.137:0/563081536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff24806e630 msgr2=0x7ff248207df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7ff247e00640 1 --2- 172.21.15.137:0/563081536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff24806e630 0x7ff248207df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7ff247e00640 1 -- 172.21.15.137:0/563081536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2480d0040 msgr2=0x7ff24814d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7ff247e00640 1 --2- 172.21.15.137:0/563081536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2480d0040 0x7ff24814d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7ff247e00640 1 -- 172.21.15.137:0/563081536 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff24814c150 con 0x7ff24815b660 2024-04-26T23:41:30.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.394+0000 7f0372600640 1 -- start start 2024-04-26T23:41:30.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7f0372600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f036c06c400 0x7f036c0c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7f0372600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f036c06c7e0 0x7f036c06fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7f0372600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f036c0d5b90 0x7f036c070210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7f0372600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f036c0b9700 con 0x7f036c0d5b90 2024-04-26T23:41:30.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7f0372600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f036c0b9580 con 0x7f036c06c400 2024-04-26T23:41:30.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7f0372600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f036c0b9880 con 0x7f036c06c7e0 2024-04-26T23:41:30.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7fee00c00640 1 -- 172.21.15.137:0/2658637130 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fedfc0a5740 con 0x7fee04072aa0 2024-04-26T23:41:30.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7fd70ea00640 1 --2- 172.21.15.137:0/1448172837 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd6f4068450 0x7fd6f406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7fd70ea00640 1 -- 172.21.15.137:0/1448172837 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd710086ce0 con 0x7fd7180d07c0 2024-04-26T23:41:30.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7ff247e00640 1 --2- 172.21.15.137:0/563081536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff24815b660 0x7ff248150240 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff24000c760 tx=0x7ff24000cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7fee00c00640 1 --2- 172.21.15.137:0/2658637130 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fede40683d0 0x7fede406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7fee00c00640 1 -- 172.21.15.137:0/2658637130 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fedfc121a60 con 0x7fee04072aa0 2024-04-26T23:41:30.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7f036aa00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f036c06c7e0 0x7f036c06fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7f036aa00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f036c06c7e0 0x7f036c06fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:41592/0 (socket says 172.21.15.137:41592) 2024-04-26T23:41:30.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7f036aa00640 1 -- 172.21.15.137:0/960825838 learned_addr learned my addr 172.21.15.137:0/960825838 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7f036b400640 1 --2- 172.21.15.137:0/960825838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f036c06c400 0x7f036c0c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7fd716a00640 1 --2- 172.21.15.137:0/1448172837 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd6f4068450 0x7fd6f406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7f036be00640 1 --2- 172.21.15.137:0/960825838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f036c0d5b90 0x7f036c070210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7f036aa00640 1 -- 172.21.15.137:0/960825838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f036c06c400 msgr2=0x7f036c0c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7f036aa00640 1 --2- 172.21.15.137:0/960825838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f036c06c400 0x7f036c0c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7f036aa00640 1 -- 172.21.15.137:0/960825838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f036c0d5b90 msgr2=0x7f036c070210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7f036aa00640 1 --2- 172.21.15.137:0/960825838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f036c0d5b90 0x7f036c070210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7f036aa00640 1 -- 172.21.15.137:0/960825838 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f036c0bacf0 con 0x7f036c06c7e0 2024-04-26T23:41:30.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7fee0b600640 1 -- 172.21.15.137:0/2658637130 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feddc0052a0 con 0x7fee04072aa0 2024-04-26T23:41:30.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7ff23f400640 1 -- 172.21.15.137:0/563081536 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff240016020 con 0x7ff24815b660 2024-04-26T23:41:30.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7ff23f400640 1 -- 172.21.15.137:0/563081536 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff240006d60 con 0x7ff24815b660 2024-04-26T23:41:30.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7ff23f400640 1 -- 172.21.15.137:0/563081536 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff240003bc0 con 0x7ff24815b660 2024-04-26T23:41:30.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7f036aa00640 1 --2- 172.21.15.137:0/960825838 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f036c06c7e0 0x7f036c06fcd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f035801a090 tx=0x7f035801aca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7ff24e800640 1 -- 172.21.15.137:0/563081536 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff24814c430 con 0x7ff24815b660 2024-04-26T23:41:30.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7fee03e00640 1 --2- 172.21.15.137:0/2658637130 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fede40683d0 0x7fede406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7ff24e800640 1 -- 172.21.15.137:0/563081536 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff24814c9f0 con 0x7ff24815b660 2024-04-26T23:41:30.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.398+0000 7fd716a00640 1 --2- 172.21.15.137:0/1448172837 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd6f4068450 0x7fd6f406a910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd700009870 tx=0x7fd700008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.402+0000 7ff24e800640 1 -- 172.21.15.137:0/563081536 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff24806a4b0 con 0x7ff24815b660 2024-04-26T23:41:30.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.402+0000 7f5e82000640 1 --2- 172.21.15.137:0/1748268637 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e84071bc0 0x7f5e8415e6e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5e840c6590 tx=0x7f5e7001c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdb09c6c351b8ca1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.402+0000 7f5e81600640 1 -- 172.21.15.137:0/1748268637 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e700b0070 con 0x7f5e84071bc0 2024-04-26T23:41:30.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.402+0000 7f5e81600640 1 -- 172.21.15.137:0/1748268637 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e700ab600 con 0x7f5e84071bc0 2024-04-26T23:41:30.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.402+0000 7f5e81600640 1 -- 172.21.15.137:0/1748268637 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e700aba10 con 0x7f5e84071bc0 2024-04-26T23:41:30.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.402+0000 7fee03e00640 1 --2- 172.21.15.137:0/2658637130 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fede40683d0 0x7fede406a890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fedf0007fd0 tx=0x7fedf0007900 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.402+0000 7fad3cc00640 1 -- 172.21.15.137:0/459692273 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fad2c056930 con 0x7fad401506f0 2024-04-26T23:41:30.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.402+0000 7f5e89600640 1 -- 172.21.15.137:0/1748268637 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e84071bc0 msgr2=0x7f5e8415e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.402+0000 7f5e89600640 1 --2- 172.21.15.137:0/1748268637 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e84071bc0 0x7f5e8415e6e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5e840c6590 tx=0x7f5e7001c3d0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.406+0000 7f5e89600640 1 -- 172.21.15.137:0/1748268637 shutdown_connections 2024-04-26T23:41:30.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.406+0000 7f5e89600640 1 --2- 172.21.15.137:0/1748268637 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e84071bc0 0x7f5e8415e6e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.406+0000 7f5e89600640 1 --2- 172.21.15.137:0/1748268637 >> v2:172.21.15.137:3300/0 conn(0x7f5e840b21c0 0x7f5e8415dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.406+0000 7f5e89600640 1 -- 172.21.15.137:0/1748268637 >> 172.21.15.137:0/1748268637 conn(0x7f5e8406f2b0 msgr2=0x7f5e8409ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.406+0000 7f5e89600640 1 -- 172.21.15.137:0/1748268637 shutdown_connections 2024-04-26T23:41:30.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.406+0000 7f5e89600640 1 -- 172.21.15.137:0/1748268637 wait complete. 2024-04-26T23:41:30.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.406+0000 7f0363400640 1 -- 172.21.15.137:0/960825838 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03580be3f0 con 0x7f036c06c7e0 2024-04-26T23:41:30.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.406+0000 7f0363400640 1 -- 172.21.15.137:0/960825838 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03580be590 con 0x7f036c06c7e0 2024-04-26T23:41:30.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.406+0000 7f0363400640 1 -- 172.21.15.137:0/960825838 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03580be960 con 0x7f036c06c7e0 2024-04-26T23:41:30.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.406+0000 7f0372600640 1 -- 172.21.15.137:0/960825838 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f036c0acd50 con 0x7f036c06c7e0 2024-04-26T23:41:30.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.406+0000 7fee00c00640 1 -- 172.21.15.137:0/2658637130 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fedfc016520 con 0x7fee04072aa0 2024-04-26T23:41:30.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.406+0000 7f5e89600640 1 Processor -- start 2024-04-26T23:41:30.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.406+0000 7ff23f400640 1 -- 172.21.15.137:0/563081536 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff24000a850 con 0x7ff24815b660 2024-04-26T23:41:30.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.406+0000 7f5e89600640 1 -- start start 2024-04-26T23:41:30.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.406+0000 7f0372600640 1 -- 172.21.15.137:0/960825838 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f036c06ef10 con 0x7f036c06c7e0 2024-04-26T23:41:30.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.406+0000 7ff23f400640 1 --2- 172.21.15.137:0/563081536 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff2280683d0 0x7ff22806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.406+0000 7ff23f400640 1 -- 172.21.15.137:0/563081536 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff240087280 con 0x7ff24815b660 2024-04-26T23:41:30.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7ff247400640 1 --2- 172.21.15.137:0/563081536 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff2280683d0 0x7ff22806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7f5e89600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e84071bc0 0x7f5e840b7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7f5e89600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e84072050 0x7f5e840b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7f5e89600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5e840b21c0 0x7f5e840cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7f5e89600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5e840d16b0 con 0x7f5e84071bc0 2024-04-26T23:41:30.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7f5e89600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5e840713c0 con 0x7f5e84072050 2024-04-26T23:41:30.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7f5e89600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5e84070780 con 0x7f5e840b21c0 2024-04-26T23:41:30.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7ff247400640 1 --2- 172.21.15.137:0/563081536 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff2280683d0 0x7ff22806a890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff2380af000 tx=0x7ff2380a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7f0372600640 1 -- 172.21.15.137:0/960825838 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f036c0765d0 con 0x7f036c06c7e0 2024-04-26T23:41:30.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7f5e82a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e84071bc0 0x7f5e840b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7f5e82a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e84071bc0 0x7f5e840b7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34080/0 (socket says 172.21.15.137:34080) 2024-04-26T23:41:30.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7f5e82a00640 1 -- 172.21.15.137:0/2704665103 learned_addr learned my addr 172.21.15.137:0/2704665103 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:30.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7f5e82000640 1 --2- 172.21.15.137:0/2704665103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e84072050 0x7f5e840b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7f5e83400640 1 --2- 172.21.15.137:0/2704665103 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5e840b21c0 0x7f5e840cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7ff23f400640 1 -- 172.21.15.137:0/563081536 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff240020020 con 0x7ff24815b660 2024-04-26T23:41:30.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7f5e83400640 1 -- 172.21.15.137:0/2704665103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e84072050 msgr2=0x7f5e840b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7f5e83400640 1 --2- 172.21.15.137:0/2704665103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e84072050 0x7f5e840b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7f5e83400640 1 -- 172.21.15.137:0/2704665103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e84071bc0 msgr2=0x7f5e840b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7f5e83400640 1 --2- 172.21.15.137:0/2704665103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e84071bc0 0x7f5e840b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7f5e83400640 1 -- 172.21.15.137:0/2704665103 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e840b7df0 con 0x7f5e840b21c0 2024-04-26T23:41:30.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7f5e82a00640 1 --2- 172.21.15.137:0/2704665103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e84071bc0 0x7f5e840b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:30.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7fd70ea00640 1 -- 172.21.15.137:0/1448172837 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd710010070 con 0x7fd7180d07c0 2024-04-26T23:41:30.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.410+0000 7f0363400640 1 -- 172.21.15.137:0/960825838 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f03580aa070 con 0x7f036c06c7e0 2024-04-26T23:41:30.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.414+0000 7f0363400640 1 --2- 172.21.15.137:0/960825838 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f034c068450 0x7f034c06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.414+0000 7f0363400640 1 -- 172.21.15.137:0/960825838 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0358120fe0 con 0x7f036c06c7e0 2024-04-26T23:41:30.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.414+0000 7f5e83400640 1 --2- 172.21.15.137:0/2704665103 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5e840b21c0 0x7f5e840cc720 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00fca0 tx=0x7f5e7c00d430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.414+0000 7f5e7aa00640 1 -- 172.21.15.137:0/2704665103 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c01a070 con 0x7f5e840b21c0 2024-04-26T23:41:30.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.414+0000 7f5e7aa00640 1 -- 172.21.15.137:0/2704665103 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e7c0069e0 con 0x7f5e840b21c0 2024-04-26T23:41:30.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.414+0000 7f5e7aa00640 1 -- 172.21.15.137:0/2704665103 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c01a070 con 0x7f5e840b21c0 2024-04-26T23:41:30.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.414+0000 7f0363400640 1 -- 172.21.15.137:0/960825838 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f036c0acd50 con 0x7f036c06c7e0 2024-04-26T23:41:30.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.418+0000 7f5e89600640 1 -- 172.21.15.137:0/2704665103 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e840b80d0 con 0x7f5e840b21c0 2024-04-26T23:41:30.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.418+0000 7f5e89600640 1 -- 172.21.15.137:0/2704665103 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e840b8690 con 0x7f5e840b21c0 2024-04-26T23:41:30.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.422+0000 7f5e89600640 1 -- 172.21.15.137:0/2704665103 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e8406a4b0 con 0x7f5e840b21c0 2024-04-26T23:41:30.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.422+0000 7f036b400640 1 --2- 172.21.15.137:0/960825838 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f034c068450 0x7f034c06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.422+0000 7f036b400640 1 --2- 172.21.15.137:0/960825838 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f034c068450 0x7f034c06a910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f03640012f0 tx=0x7f0364009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.422+0000 7f5e7aa00640 1 -- 172.21.15.137:0/2704665103 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5e7c01d070 con 0x7f5e840b21c0 2024-04-26T23:41:30.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.422+0000 7f5e7aa00640 1 --2- 172.21.15.137:0/2704665103 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5e64068580 0x7f5e6406aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.422+0000 7f5e7aa00640 1 -- 172.21.15.137:0/2704665103 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5e7c056e70 con 0x7f5e840b21c0 2024-04-26T23:41:30.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.422+0000 7f5e82a00640 1 --2- 172.21.15.137:0/2704665103 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5e64068580 0x7f5e6406aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.422+0000 7f5e82a00640 1 --2- 172.21.15.137:0/2704665103 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5e64068580 0x7f5e6406aa40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5e74006fd0 tx=0x7f5e74008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.430+0000 7f5e7aa00640 1 -- 172.21.15.137:0/2704665103 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5e8415e4e0 con 0x7f5e840b21c0 2024-04-26T23:41:30.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.730+0000 7f1b36400640 1 -- 172.21.15.137:0/298175884 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f1b08005590 con 0x7f1b3015d050 2024-04-26T23:41:30.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.730+0000 7f1b2cc00640 1 -- 172.21.15.137:0/298175884 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1b1c0f15a0 con 0x7f1b3015d050 2024-04-26T23:41:30.738 INFO:teuthology.orchestra.run.smithi137.stdout:55834574853 2024-04-26T23:41:30.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.734+0000 7f1b36400640 1 -- 172.21.15.137:0/298175884 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1b10068480 msgr2=0x7f1b1006a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.734+0000 7f1b36400640 1 --2- 172.21.15.137:0/298175884 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1b10068480 0x7f1b1006a940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1b28001d70 tx=0x7f1b28009040 comp rx=0 tx=0).stop 2024-04-26T23:41:30.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.734+0000 7f1b36400640 1 -- 172.21.15.137:0/298175884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b3015d050 msgr2=0x7f1b3006c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.734+0000 7f1b36400640 1 --2- 172.21.15.137:0/298175884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b3015d050 0x7f1b3006c590 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c0ab000 tx=0x7f1b1c01ac50 comp rx=0 tx=0).stop 2024-04-26T23:41:30.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.738+0000 7f1b36400640 1 -- 172.21.15.137:0/298175884 shutdown_connections 2024-04-26T23:41:30.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.738+0000 7f1b36400640 1 --2- 172.21.15.137:0/298175884 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1b10068480 0x7f1b1006a940 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.738+0000 7f1b36400640 1 --2- 172.21.15.137:0/298175884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b3015d050 0x7f1b3006c590 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.738+0000 7f1b36400640 1 --2- 172.21.15.137:0/298175884 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b300d2990 0x7f1b3014bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.738+0000 7f1b36400640 1 --2- 172.21.15.137:0/298175884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b30070520 0x7f1b3006df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.738+0000 7f1b36400640 1 -- 172.21.15.137:0/298175884 >> 172.21.15.137:0/298175884 conn(0x7f1b3009ba60 msgr2=0x7f1b3015c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.738+0000 7f1b36400640 1 -- 172.21.15.137:0/298175884 shutdown_connections 2024-04-26T23:41:30.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.738+0000 7f1b36400640 1 -- 172.21.15.137:0/298175884 wait complete. 2024-04-26T23:41:30.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.746+0000 7f36ace00640 1 -- 172.21.15.137:0/147876706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f36a80d0710 con 0x7f36a80b3fb0 2024-04-26T23:41:30.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.746+0000 7fad47c00640 1 -- 172.21.15.137:0/459692273 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fad4006d8d0 con 0x7fad401506f0 2024-04-26T23:41:30.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.746+0000 7f369ea00640 1 -- 172.21.15.137:0/147876706 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f36a816a3b0 con 0x7f36a80b3fb0 2024-04-26T23:41:30.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.746+0000 7fad3cc00640 1 -- 172.21.15.137:0/459692273 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fad2c056230 con 0x7fad401506f0 2024-04-26T23:41:30.752 INFO:teuthology.orchestra.run.smithi137.stdout:55834574853 2024-04-26T23:41:30.752 INFO:teuthology.orchestra.run.smithi137.stdout:55834574852 2024-04-26T23:41:30.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7fee0b600640 1 -- 172.21.15.137:0/2658637130 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7feddc005590 con 0x7fee04072aa0 2024-04-26T23:41:30.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7fad47c00640 1 -- 172.21.15.137:0/459692273 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fad200683b0 msgr2=0x7fad2006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7fad47c00640 1 --2- 172.21.15.137:0/459692273 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fad200683b0 0x7fad2006a870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fad38001e20 tx=0x7fad38009040 comp rx=0 tx=0).stop 2024-04-26T23:41:30.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7fad47c00640 1 -- 172.21.15.137:0/459692273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad401506f0 msgr2=0x7fad40150b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7fad47c00640 1 --2- 172.21.15.137:0/459692273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad401506f0 0x7fad40150b70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fad400b4b80 tx=0x7fad2c00c7d0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7f36ace00640 1 -- 172.21.15.137:0/147876706 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3684068450 msgr2=0x7f368406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7f36ace00640 1 --2- 172.21.15.137:0/147876706 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3684068450 0x7f368406a910 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3698007fd0 tx=0x7f3698007960 comp rx=0 tx=0).stop 2024-04-26T23:41:30.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7f36ace00640 1 -- 172.21.15.137:0/147876706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36a80b3fb0 msgr2=0x7f36a8169e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7f36ace00640 1 --2- 172.21.15.137:0/147876706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36a80b3fb0 0x7f36a8169e70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f369001a030 tx=0x7f36900191a0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7f36ace00640 1 -- 172.21.15.137:0/147876706 shutdown_connections 2024-04-26T23:41:30.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7f36ace00640 1 --2- 172.21.15.137:0/147876706 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3684068450 0x7f368406a910 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7f36ace00640 1 --2- 172.21.15.137:0/147876706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36a816d190 0x7f36a80ceaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7f36ace00640 1 --2- 172.21.15.137:0/147876706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36a80b3fb0 0x7f36a8169e70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7f36ace00640 1 --2- 172.21.15.137:0/147876706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36a806cb10 0x7f36a80cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7f36ace00640 1 -- 172.21.15.137:0/147876706 >> 172.21.15.137:0/147876706 conn(0x7f36a80d1b30 msgr2=0x7f36a8163800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7fad47c00640 1 -- 172.21.15.137:0/459692273 shutdown_connections 2024-04-26T23:41:30.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7fad47c00640 1 --2- 172.21.15.137:0/459692273 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fad200683b0 0x7fad2006a870 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7fad47c00640 1 --2- 172.21.15.137:0/459692273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad401506f0 0x7fad40150b70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7fad47c00640 1 --2- 172.21.15.137:0/459692273 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad40154290 0x7fad401546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7fad47c00640 1 --2- 172.21.15.137:0/459692273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad24004810 0x7fad4015b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7fad47c00640 1 -- 172.21.15.137:0/459692273 >> 172.21.15.137:0/459692273 conn(0x7fad40073210 msgr2=0x7fad400b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7f36ace00640 1 -- 172.21.15.137:0/147876706 shutdown_connections 2024-04-26T23:41:30.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7f36ace00640 1 -- 172.21.15.137:0/147876706 wait complete. 2024-04-26T23:41:30.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7fee00c00640 1 -- 172.21.15.137:0/2658637130 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fedfc0f21b0 con 0x7fee04072aa0 2024-04-26T23:41:30.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7fad47c00640 1 -- 172.21.15.137:0/459692273 shutdown_connections 2024-04-26T23:41:30.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.750+0000 7fad47c00640 1 -- 172.21.15.137:0/459692273 wait complete. 2024-04-26T23:41:30.759 INFO:teuthology.orchestra.run.smithi137.stdout:55834574854 2024-04-26T23:41:30.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.754+0000 7fee0b600640 1 -- 172.21.15.137:0/2658637130 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fede40683d0 msgr2=0x7fede406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.754+0000 7fee0b600640 1 --2- 172.21.15.137:0/2658637130 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fede40683d0 0x7fede406a890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fedf0007fd0 tx=0x7fedf0007900 comp rx=0 tx=0).stop 2024-04-26T23:41:30.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.754+0000 7fee0b600640 1 -- 172.21.15.137:0/2658637130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee04072aa0 msgr2=0x7fee041567e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.754+0000 7fee0b600640 1 --2- 172.21.15.137:0/2658637130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee04072aa0 0x7fee041567e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0b0040 tx=0x7fedfc0196d0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.754+0000 7fd71d800640 1 -- 172.21.15.137:0/1448172837 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd71806f010 con 0x7fd7180d07c0 2024-04-26T23:41:30.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.754+0000 7fee0b600640 1 -- 172.21.15.137:0/2658637130 shutdown_connections 2024-04-26T23:41:30.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.754+0000 7fee0b600640 1 --2- 172.21.15.137:0/2658637130 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fede40683d0 0x7fede406a890 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.754+0000 7fee0b600640 1 --2- 172.21.15.137:0/2658637130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee040b53e0 0x7fee040b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.754+0000 7fee0b600640 1 --2- 172.21.15.137:0/2658637130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee0415d9a0 0x7fee040b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.754+0000 7fee0b600640 1 --2- 172.21.15.137:0/2658637130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee04072aa0 0x7fee041567e0 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0b0040 tx=0x7fedfc0196d0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.754+0000 7fee0b600640 1 -- 172.21.15.137:0/2658637130 >> 172.21.15.137:0/2658637130 conn(0x7fee040b2a90 msgr2=0x7fee04165d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.754+0000 7fee0b600640 1 -- 172.21.15.137:0/2658637130 shutdown_connections 2024-04-26T23:41:30.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.754+0000 7fee0b600640 1 -- 172.21.15.137:0/2658637130 wait complete. 2024-04-26T23:41:30.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.754+0000 7f0372600640 1 -- 172.21.15.137:0/960825838 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f036c0698f0 con 0x7f036c06c7e0 2024-04-26T23:41:30.763 INFO:teuthology.orchestra.run.smithi137.stdout:55834574853 2024-04-26T23:41:30.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.758+0000 7fd70ea00640 1 -- 172.21.15.137:0/1448172837 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd710057280 con 0x7fd7180d07c0 2024-04-26T23:41:30.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.758+0000 7ff24e800640 1 -- 172.21.15.137:0/563081536 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff24815e540 con 0x7ff24815b660 2024-04-26T23:41:30.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.758+0000 7ff23f400640 1 -- 172.21.15.137:0/563081536 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff240020020 con 0x7ff24815b660 2024-04-26T23:41:30.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.758+0000 7f0363400640 1 -- 172.21.15.137:0/960825838 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0358016110 con 0x7f036c06c7e0 2024-04-26T23:41:30.766 INFO:teuthology.orchestra.run.smithi137.stdout:55834574853 2024-04-26T23:41:30.766 INFO:teuthology.orchestra.run.smithi137.stdout:55834574854 2024-04-26T23:41:30.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7fd71d800640 1 -- 172.21.15.137:0/1448172837 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd6f4068450 msgr2=0x7fd6f406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7fd71d800640 1 --2- 172.21.15.137:0/1448172837 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd6f4068450 0x7fd6f406a910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd700009870 tx=0x7fd700008040 comp rx=0 tx=0).stop 2024-04-26T23:41:30.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7fd71d800640 1 -- 172.21.15.137:0/1448172837 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7180d07c0 msgr2=0x7fd71815d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7fd71d800640 1 --2- 172.21.15.137:0/1448172837 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7180d07c0 0x7fd71815d7c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd710007e60 tx=0x7fd71000d4a0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7fd71d800640 1 -- 172.21.15.137:0/1448172837 shutdown_connections 2024-04-26T23:41:30.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7fd71d800640 1 --2- 172.21.15.137:0/1448172837 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd6f4068450 0x7fd6f406a910 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7fd71d800640 1 --2- 172.21.15.137:0/1448172837 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7180d07c0 0x7fd71815d7c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7fd71d800640 1 --2- 172.21.15.137:0/1448172837 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7180765d0 0x7fd71815d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7fd71d800640 1 --2- 172.21.15.137:0/1448172837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd71806ea70 0x7fd7181f0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7fd71d800640 1 -- 172.21.15.137:0/1448172837 >> 172.21.15.137:0/1448172837 conn(0x7fd71806c400 msgr2=0x7fd7180b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7f0372600640 1 -- 172.21.15.137:0/960825838 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f034c068450 msgr2=0x7f034c06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7f0372600640 1 --2- 172.21.15.137:0/960825838 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f034c068450 0x7f034c06a910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f03640012f0 tx=0x7f0364009040 comp rx=0 tx=0).stop 2024-04-26T23:41:30.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7f0372600640 1 -- 172.21.15.137:0/960825838 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f036c06c7e0 msgr2=0x7f036c06fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7f0372600640 1 --2- 172.21.15.137:0/960825838 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f036c06c7e0 0x7f036c06fcd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f035801a090 tx=0x7f035801aca0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7f0372600640 1 -- 172.21.15.137:0/960825838 shutdown_connections 2024-04-26T23:41:30.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7f0372600640 1 --2- 172.21.15.137:0/960825838 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f034c068450 0x7f034c06a910 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7f0372600640 1 --2- 172.21.15.137:0/960825838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f036c0d5b90 0x7f036c070210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7f0372600640 1 --2- 172.21.15.137:0/960825838 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f036c06c7e0 0x7f036c06fcd0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7f0372600640 1 --2- 172.21.15.137:0/960825838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f036c06c400 0x7f036c0c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7f0372600640 1 -- 172.21.15.137:0/960825838 >> 172.21.15.137:0/960825838 conn(0x7f036c0d4e60 msgr2=0x7f036c0ba5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7f0372600640 1 -- 172.21.15.137:0/960825838 shutdown_connections 2024-04-26T23:41:30.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7f0372600640 1 -- 172.21.15.137:0/960825838 wait complete. 2024-04-26T23:41:30.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.762+0000 7fd71d800640 1 -- 172.21.15.137:0/1448172837 shutdown_connections 2024-04-26T23:41:30.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.766+0000 7fd71d800640 1 -- 172.21.15.137:0/1448172837 wait complete. 2024-04-26T23:41:30.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.766+0000 7ff24e800640 1 -- 172.21.15.137:0/563081536 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff2280683d0 msgr2=0x7ff22806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.766+0000 7ff24e800640 1 --2- 172.21.15.137:0/563081536 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff2280683d0 0x7ff22806a890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff2380af000 tx=0x7ff2380a7070 comp rx=0 tx=0).stop 2024-04-26T23:41:30.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.766+0000 7ff24e800640 1 -- 172.21.15.137:0/563081536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff24815b660 msgr2=0x7ff248150240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.766+0000 7ff24e800640 1 --2- 172.21.15.137:0/563081536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff24815b660 0x7ff248150240 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff24000c760 tx=0x7ff24000cc20 comp rx=0 tx=0).stop 2024-04-26T23:41:30.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.766+0000 7ff24e800640 1 -- 172.21.15.137:0/563081536 shutdown_connections 2024-04-26T23:41:30.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.766+0000 7ff24e800640 1 --2- 172.21.15.137:0/563081536 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff2280683d0 0x7ff22806a890 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.766+0000 7ff24e800640 1 --2- 172.21.15.137:0/563081536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2480d0040 0x7ff24814d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.766+0000 7ff24e800640 1 --2- 172.21.15.137:0/563081536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff24815b660 0x7ff248150240 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.766+0000 7ff24e800640 1 --2- 172.21.15.137:0/563081536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff24806e630 0x7ff248207df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.766+0000 7ff24e800640 1 -- 172.21.15.137:0/563081536 >> 172.21.15.137:0/563081536 conn(0x7ff24806c5d0 msgr2=0x7ff248151450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.766+0000 7f5e89600640 1 -- 172.21.15.137:0/2704665103 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5e8406c810 con 0x7f5e840b21c0 2024-04-26T23:41:30.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.766+0000 7f5e7aa00640 1 -- 172.21.15.137:0/2704665103 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5e7c058dd0 con 0x7f5e840b21c0 2024-04-26T23:41:30.773 INFO:teuthology.orchestra.run.smithi137.stdout:55834574853 2024-04-26T23:41:30.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.770+0000 7ff24e800640 1 -- 172.21.15.137:0/563081536 shutdown_connections 2024-04-26T23:41:30.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.770+0000 7ff24e800640 1 -- 172.21.15.137:0/563081536 wait complete. 2024-04-26T23:41:30.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.770+0000 7f5e89600640 1 -- 172.21.15.137:0/2704665103 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5e64068580 msgr2=0x7f5e6406aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.770+0000 7f5e89600640 1 --2- 172.21.15.137:0/2704665103 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5e64068580 0x7f5e6406aa40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5e74006fd0 tx=0x7f5e74008040 comp rx=0 tx=0).stop 2024-04-26T23:41:30.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.770+0000 7f5e89600640 1 -- 172.21.15.137:0/2704665103 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5e840b21c0 msgr2=0x7f5e840cc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.770+0000 7f5e89600640 1 --2- 172.21.15.137:0/2704665103 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5e840b21c0 0x7f5e840cc720 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00fca0 tx=0x7f5e7c00d430 comp rx=0 tx=0).stop 2024-04-26T23:41:30.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.770+0000 7f5e89600640 1 -- 172.21.15.137:0/2704665103 shutdown_connections 2024-04-26T23:41:30.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.770+0000 7f5e89600640 1 --2- 172.21.15.137:0/2704665103 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5e64068580 0x7f5e6406aa40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.770+0000 7f5e89600640 1 --2- 172.21.15.137:0/2704665103 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5e840b21c0 0x7f5e840cc720 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.770+0000 7f5e89600640 1 --2- 172.21.15.137:0/2704665103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e84072050 0x7f5e840b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.770+0000 7f5e89600640 1 --2- 172.21.15.137:0/2704665103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e84071bc0 0x7f5e840b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.770+0000 7f5e89600640 1 -- 172.21.15.137:0/2704665103 >> 172.21.15.137:0/2704665103 conn(0x7f5e8406f2b0 msgr2=0x7f5e84150a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.774+0000 7f5e89600640 1 -- 172.21.15.137:0/2704665103 shutdown_connections 2024-04-26T23:41:30.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:30.774+0000 7f5e89600640 1 -- 172.21.15.137:0/2704665103 wait complete. 2024-04-26T23:41:30.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-04-26T23:41:30.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2024-04-26T23:41:30.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-04-26T23:41:30.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-04-26T23:41:30.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-04-26T23:41:30.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-04-26T23:41:30.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2024-04-26T23:41:30.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-04-26T23:41:31.782 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T23:41:31.803 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T23:41:31.809 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T23:41:31.812 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T23:41:31.812 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T23:41:31.814 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T23:41:31.815 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T23:41:31.817 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T23:41:31.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:31.990+0000 7f82ee400640 1 Processor -- start 2024-04-26T23:41:31.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:31.990+0000 7f82ee400640 1 -- start start 2024-04-26T23:41:31.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:31.994+0000 7f82ee400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f82e8141700 0x7f82e80b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:31.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:31.994+0000 7f82e7400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f82e8141700 0x7f82e80b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:31.994+0000 7f82e7400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f82e8141700 0x7f82e80b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:42284/0 (socket says 172.21.15.137:42284) 2024-04-26T23:41:32.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:31.994+0000 7f82e6a00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f82e815c050 0x7f82e806e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:42508/0 (socket says 172.21.15.137:42508) 2024-04-26T23:41:32.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:31.994+0000 7f82e7400640 1 -- 172.21.15.137:0/2311798020 learned_addr learned my addr 172.21.15.137:0/2311798020 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:32.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:31.994+0000 7f82ee400640 1 -- 172.21.15.137:0/2311798020 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e80b4b20 con 0x7f82e806efc0 2024-04-26T23:41:32.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:31.994+0000 7f82ee400640 1 -- 172.21.15.137:0/2311798020 --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e80b4e00 con 0x7f82e815c050 2024-04-26T23:41:32.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:31.994+0000 7f82ee400640 1 -- 172.21.15.137:0/2311798020 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f82e80b50e0 con 0x7f82e8141700 2024-04-26T23:41:32.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:31.994+0000 7f82e6000640 1 -- 172.21.15.137:0/2311798020 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1934213454 0 0) 0x7f82e80b4e00 con 0x7f82e815c050 2024-04-26T23:41:32.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:31.994+0000 7f82e6000640 1 -- 172.21.15.137:0/2311798020 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82cc003530 con 0x7f82e815c050 2024-04-26T23:41:32.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:31.994+0000 7f82e6000640 1 -- 172.21.15.137:0/2311798020 <== mon.1 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1272781872 0 0) 0x7f82cc003530 con 0x7f82e815c050 2024-04-26T23:41:32.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:31.994+0000 7f82e7400640 1 -- 172.21.15.137:0/2311798020 >> v1:172.21.15.170:6789/0 conn(0x7f82e815c050 legacy=0x7f82e806e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:31.994+0000 7f82e7400640 1 -- 172.21.15.137:0/2311798020 >> v1:172.21.15.137:6789/0 conn(0x7f82e806efc0 legacy=0x7f82e8072410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:32.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:31.994+0000 7f82e7400640 1 -- 172.21.15.137:0/2311798020 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e80b53c0 con 0x7f82e8141700 2024-04-26T23:41:32.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.002+0000 7f82e7400640 1 --2- 172.21.15.137:0/2311798020 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82e8141700 0x7f82e80b4460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009f80 tx=0x7f82d401df00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8ce1ccac452ac60 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.002+0000 7f82e6000640 1 -- 172.21.15.137:0/2311798020 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e0001a00 con 0x7f82e8141700 2024-04-26T23:41:32.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.002+0000 7f82e6000640 1 -- 172.21.15.137:0/2311798020 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d40b0070 con 0x7f82e8141700 2024-04-26T23:41:32.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.002+0000 7f82e6000640 1 -- 172.21.15.137:0/2311798020 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d40ab690 con 0x7f82e8141700 2024-04-26T23:41:32.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.002+0000 7f82ee400640 1 -- 172.21.15.137:0/2311798020 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82e8141700 msgr2=0x7f82e80b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.002+0000 7f82ee400640 1 --2- 172.21.15.137:0/2311798020 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82e8141700 0x7f82e80b4460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009f80 tx=0x7f82d401df00 comp rx=0 tx=0).stop 2024-04-26T23:41:32.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.002+0000 7f82ee400640 1 -- 172.21.15.137:0/2311798020 shutdown_connections 2024-04-26T23:41:32.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.002+0000 7f82ee400640 1 --2- 172.21.15.137:0/2311798020 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82e8141700 0x7f82e80b4460 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.002+0000 7f82ee400640 1 -- 172.21.15.137:0/2311798020 >> 172.21.15.137:0/2311798020 conn(0x7f82e80b27c0 msgr2=0x7f82e80b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:32.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.002+0000 7f82ee400640 1 -- 172.21.15.137:0/2311798020 shutdown_connections 2024-04-26T23:41:32.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.002+0000 7f82ee400640 1 -- 172.21.15.137:0/2311798020 wait complete. 2024-04-26T23:41:32.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.006+0000 7f82ee400640 1 Processor -- start 2024-04-26T23:41:32.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.006+0000 7f82ee400640 1 -- start start 2024-04-26T23:41:32.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.006+0000 7f82ee400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82e806efc0 0x7f82e8152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.006+0000 7f82ee400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82e8141700 0x7f82e80ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.006+0000 7f82ee400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82e815c050 0x7f82e80ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.010+0000 7f82e6a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82e8141700 0x7f82e80ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.010+0000 7f82e6a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82e8141700 0x7f82e80ce3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42878/0 (socket says 172.21.15.137:42878) 2024-04-26T23:41:32.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.010+0000 7f82e7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82e806efc0 0x7f82e8152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.010+0000 7f82e7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82e806efc0 0x7f82e8152010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:42294/0 (socket says 172.21.15.137:42294) 2024-04-26T23:41:32.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.010+0000 7f82e6a00640 1 -- 172.21.15.137:0/945496954 learned_addr learned my addr 172.21.15.137:0/945496954 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:32.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.010+0000 7f82ee400640 1 -- 172.21.15.137:0/945496954 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f82e8073700 con 0x7f82e8141700 2024-04-26T23:41:32.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.010+0000 7f82ee400640 1 -- 172.21.15.137:0/945496954 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f82e8073580 con 0x7f82e806efc0 2024-04-26T23:41:32.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.010+0000 7f82ee400640 1 -- 172.21.15.137:0/945496954 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f82e8168f50 con 0x7f82e815c050 2024-04-26T23:41:32.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.010+0000 7f82e7e00640 1 --2- 172.21.15.137:0/945496954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82e815c050 0x7f82e80ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.010+0000 7f82e6a00640 1 -- 172.21.15.137:0/945496954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82e815c050 msgr2=0x7f82e80ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.010+0000 7f82e6a00640 1 --2- 172.21.15.137:0/945496954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82e815c050 0x7f82e80ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.010+0000 7f82e6a00640 1 -- 172.21.15.137:0/945496954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82e806efc0 msgr2=0x7f82e8152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.010+0000 7f82e6a00640 1 --2- 172.21.15.137:0/945496954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82e806efc0 0x7f82e8152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.010+0000 7f82e6a00640 1 -- 172.21.15.137:0/945496954 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e8150f70 con 0x7f82e8141700 2024-04-26T23:41:32.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.010+0000 7f82e6a00640 1 --2- 172.21.15.137:0/945496954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82e8141700 0x7f82e80ce3a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f82e000caa0 tx=0x7f82e000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.010+0000 7f82df400640 1 -- 172.21.15.137:0/945496954 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e0017070 con 0x7f82e8141700 2024-04-26T23:41:32.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.010+0000 7f82ee400640 1 -- 172.21.15.137:0/945496954 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e8151250 con 0x7f82e8141700 2024-04-26T23:41:32.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.010+0000 7f82ee400640 1 -- 172.21.15.137:0/945496954 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e8151810 con 0x7f82e8141700 2024-04-26T23:41:32.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.010+0000 7f82df400640 1 -- 172.21.15.137:0/945496954 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e000a6d0 con 0x7f82e8141700 2024-04-26T23:41:32.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.014+0000 7f82ee400640 1 -- 172.21.15.137:0/945496954 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82c00052a0 con 0x7f82e8141700 2024-04-26T23:41:32.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.014+0000 7f82df400640 1 -- 172.21.15.137:0/945496954 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e0017070 con 0x7f82e8141700 2024-04-26T23:41:32.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.022+0000 7f82df400640 1 -- 172.21.15.137:0/945496954 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f82e001a070 con 0x7f82e8141700 2024-04-26T23:41:32.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.026+0000 7f82df400640 1 --2- 172.21.15.137:0/945496954 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f82c80797a0 0x7f82c807bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.026+0000 7f82df400640 1 -- 172.21.15.137:0/945496954 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f82e0005db0 con 0x7f82e8141700 2024-04-26T23:41:32.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.026+0000 7f82e7400640 1 --2- 172.21.15.137:0/945496954 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f82c80797a0 0x7f82c807bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.030+0000 7f82e7400640 1 --2- 172.21.15.137:0/945496954 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f82c80797a0 0x7f82c807bc60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f82d40af000 tx=0x7f82d4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.030+0000 7f82df400640 1 -- 172.21.15.137:0/945496954 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f82e0055e80 con 0x7f82e8141700 2024-04-26T23:41:32.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.066+0000 7f1e0e000640 1 Processor -- start 2024-04-26T23:41:32.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.066+0000 7f1e0e000640 1 -- start start 2024-04-26T23:41:32.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.066+0000 7f0cc7600640 1 Processor -- start 2024-04-26T23:41:32.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.066+0000 7f0cc7600640 1 -- start start 2024-04-26T23:41:32.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.066+0000 7f1e0e000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1e0815cf50 0x7f1e08071d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.066+0000 7f1e0e000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1e080d2c00 0x7f1e080d3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.066+0000 7f0cc7600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc00b4ea0 0x7f0cc00b5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.066+0000 7f0cc7600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0cc01638b0 0x7f0cc00720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.066+0000 7f1e0d600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1e080d2c00 0x7f1e080d3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.070+0000 7f1e0d600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1e080d2c00 0x7f1e080d3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:42296/0 (socket says 172.21.15.137:42296) 2024-04-26T23:41:32.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.070+0000 7f1e0d600640 1 -- 172.21.15.137:0/2930835525 learned_addr learned my addr 172.21.15.137:0/2930835525 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:32.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.066+0000 7f0cc7600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0cc015ff20 0x7f0cc0073410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.066+0000 7f0cc7600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc015fa90 con 0x7f0cc015ff20 2024-04-26T23:41:32.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.066+0000 7f0cc7600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc00b57c0 con 0x7f0cc01638b0 2024-04-26T23:41:32.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.066+0000 7f0cc7600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc00729d0 con 0x7f0cc00b4ea0 2024-04-26T23:41:32.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.070+0000 7f1e0cc00640 1 --2- 172.21.15.137:0/2930835525 >> v2:172.21.15.137:3300/0 conn(0x7f1e0815cf50 0x7f1e08071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.070+0000 7f0cc5600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0cc015ff20 0x7f0cc0073410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.070+0000 7f0cc4c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc00b4ea0 0x7f0cc00b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.070+0000 7f0cc4c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc00b4ea0 0x7f0cc00b5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:36492/0 (socket says 172.21.15.137:36492) 2024-04-26T23:41:32.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.070+0000 7f0cc4c00640 1 -- 172.21.15.137:0/3118219631 learned_addr learned my addr 172.21.15.137:0/3118219631 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:32.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.066+0000 7f1e0e000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e080d0600 con 0x7f1e08070800 2024-04-26T23:41:32.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.070+0000 7f1e0e000640 1 -- 172.21.15.137:0/2930835525 --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1e08070c90 con 0x7f1e0815cf50 2024-04-26T23:41:32.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.070+0000 7f1e0e000640 1 -- 172.21.15.137:0/2930835525 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f1e08070f70 con 0x7f1e080d2c00 2024-04-26T23:41:32.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.070+0000 7f0cc4c00640 1 -- 172.21.15.137:0/3118219631 >> v2:172.21.15.170:3300/0 conn(0x7f0cc01638b0 msgr2=0x7f0cc00720d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:41:32.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.070+0000 7f0cc4c00640 1 --2- 172.21.15.137:0/3118219631 >> v2:172.21.15.170:3300/0 conn(0x7f0cc01638b0 0x7f0cc00720d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.070+0000 7f0cc4c00640 1 -- 172.21.15.137:0/3118219631 >> v2:172.21.15.137:3300/0 conn(0x7f0cc015ff20 msgr2=0x7f0cc0073410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:32.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.070+0000 7f9b38600640 1 Processor -- start 2024-04-26T23:41:32.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.070+0000 7f9b38600640 1 -- start start 2024-04-26T23:41:32.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.070+0000 7f1e0d600640 1 -- 172.21.15.137:0/2930835525 >> v2:172.21.15.137:3300/0 conn(0x7f1e0815cf50 msgr2=0x7f1e08071d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:32.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.070+0000 7f1e0d600640 1 --2- 172.21.15.137:0/2930835525 >> v2:172.21.15.137:3300/0 conn(0x7f1e0815cf50 0x7f1e08071d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.070+0000 7f1e0d600640 1 -- 172.21.15.137:0/2930835525 >> v1:172.21.15.170:6789/0 conn(0x7f1e08070800 legacy=0x7f1e080cfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:32.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.070+0000 7f1e0d600640 1 -- 172.21.15.137:0/2930835525 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e08071250 con 0x7f1e080d2c00 2024-04-26T23:41:32.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.070+0000 7f1e0cc00640 1 --2- 172.21.15.137:0/2930835525 >> v2:172.21.15.137:3300/0 conn(0x7f1e0815cf50 0x7f1e08071d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:32.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.074+0000 7f9b38600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9b30141700 0x7f9b300b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.074+0000 7f9b38600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b3006efc0 0x7f9b30072410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.074+0000 7f9b38600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b300b4b20 con 0x7f9b3015c050 2024-04-26T23:41:32.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.074+0000 7f9b38600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f9b300b4e00 con 0x7f9b30141700 2024-04-26T23:41:32.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.074+0000 7f9b38600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9b300b50e0 con 0x7f9b3006efc0 2024-04-26T23:41:32.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.070+0000 7f0cc4c00640 1 --2- 172.21.15.137:0/3118219631 >> v2:172.21.15.137:3300/0 conn(0x7f0cc015ff20 0x7f0cc0073410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.070+0000 7f0cc4c00640 1 -- 172.21.15.137:0/3118219631 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc0072cb0 con 0x7f0cc00b4ea0 2024-04-26T23:41:32.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.074+0000 7f9b36600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b3006efc0 0x7f9b30072410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.074+0000 7f9b36600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b3006efc0 0x7f9b30072410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:36504/0 (socket says 172.21.15.137:36504) 2024-04-26T23:41:32.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.074+0000 7f9b36600640 1 -- 172.21.15.137:0/794563271 learned_addr learned my addr 172.21.15.137:0/794563271 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:32.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.074+0000 7f0cc5600640 1 --2- 172.21.15.137:0/3118219631 >> v2:172.21.15.137:3300/0 conn(0x7f0cc015ff20 0x7f0cc0073410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:41:32.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.074+0000 7f9b36600640 1 -- 172.21.15.137:0/794563271 >> v2:172.21.15.137:3300/0 conn(0x7f9b30141700 msgr2=0x7f9b300b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:32.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.074+0000 7f9b36600640 1 --2- 172.21.15.137:0/794563271 >> v2:172.21.15.137:3300/0 conn(0x7f9b30141700 0x7f9b300b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.074+0000 7f9b36600640 1 -- 172.21.15.137:0/794563271 >> v1:172.21.15.137:6789/0 conn(0x7f9b3015c050 legacy=0x7f9b3006e8b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:41:32.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.074+0000 7f1e0d600640 1 --2- 172.21.15.137:0/2930835525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e080d2c00 0x7f1e080d3030 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1e080cd550 tx=0x7f1df801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a517f103f9436db1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.074+0000 7f9b36600640 1 -- 172.21.15.137:0/794563271 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b300b53c0 con 0x7f9b3006efc0 2024-04-26T23:41:32.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.078+0000 7f0cc4c00640 1 --2- 172.21.15.137:0/3118219631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc00b4ea0 0x7f0cc00b5280 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0cc00b35b0 tx=0x7f0cb001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52fd251e872cb20a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.078+0000 7f1e07400640 1 -- 172.21.15.137:0/2930835525 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df80b2070 con 0x7f1e080d2c00 2024-04-26T23:41:32.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.078+0000 7f1e07400640 1 -- 172.21.15.137:0/2930835525 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df80a9070 con 0x7f1e080d2c00 2024-04-26T23:41:32.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.078+0000 7f1e07400640 1 -- 172.21.15.137:0/2930835525 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df80ad880 con 0x7f1e080d2c00 2024-04-26T23:41:32.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.078+0000 7f0cbf400640 1 -- 172.21.15.137:0/3118219631 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb00aa430 con 0x7f0cc00b4ea0 2024-04-26T23:41:32.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.078+0000 7f0cbf400640 1 -- 172.21.15.137:0/3118219631 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb00af070 con 0x7f0cc00b4ea0 2024-04-26T23:41:32.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.078+0000 7f0cbf400640 1 -- 172.21.15.137:0/3118219631 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb00aa7f0 con 0x7f0cc00b4ea0 2024-04-26T23:41:32.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.078+0000 7f1e0e000640 1 -- 172.21.15.137:0/2930835525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e080d2c00 msgr2=0x7f1e080d3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.078+0000 7f1e0e000640 1 --2- 172.21.15.137:0/2930835525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e080d2c00 0x7f1e080d3030 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1e080cd550 tx=0x7f1df801c450 comp rx=0 tx=0).stop 2024-04-26T23:41:32.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.078+0000 7f1e0e000640 1 -- 172.21.15.137:0/2930835525 shutdown_connections 2024-04-26T23:41:32.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.078+0000 7f1e0e000640 1 --2- 172.21.15.137:0/2930835525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e080d2c00 0x7f1e080d3030 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.078+0000 7f1e0e000640 1 --2- 172.21.15.137:0/2930835525 >> v2:172.21.15.137:3300/0 conn(0x7f1e0815cf50 0x7f1e08071d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.078+0000 7f1e0e000640 1 -- 172.21.15.137:0/2930835525 >> 172.21.15.137:0/2930835525 conn(0x7f1e0809ba60 msgr2=0x7f1e0809be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:32.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.078+0000 7f1e0e000640 1 -- 172.21.15.137:0/2930835525 shutdown_connections 2024-04-26T23:41:32.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.078+0000 7f0cc7600640 1 -- 172.21.15.137:0/3118219631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc00b4ea0 msgr2=0x7f0cc00b5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.078+0000 7f0cc7600640 1 --2- 172.21.15.137:0/3118219631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc00b4ea0 0x7f0cc00b5280 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0cc00b35b0 tx=0x7f0cb001c530 comp rx=0 tx=0).stop 2024-04-26T23:41:32.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.078+0000 7f0cc7600640 1 -- 172.21.15.137:0/3118219631 shutdown_connections 2024-04-26T23:41:32.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.078+0000 7f0cc7600640 1 --2- 172.21.15.137:0/3118219631 >> v2:172.21.15.137:3300/0 conn(0x7f0cc015ff20 0x7f0cc0073410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.078+0000 7f0cc7600640 1 --2- 172.21.15.137:0/3118219631 >> v2:172.21.15.170:3300/0 conn(0x7f0cc01638b0 0x7f0cc00720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.078+0000 7f0cc7600640 1 --2- 172.21.15.137:0/3118219631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc00b4ea0 0x7f0cc00b5280 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.078+0000 7f0cc7600640 1 -- 172.21.15.137:0/3118219631 >> 172.21.15.137:0/3118219631 conn(0x7f0cc00b2a90 msgr2=0x7f0cc00b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:32.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.078+0000 7f1e0e000640 1 -- 172.21.15.137:0/2930835525 wait complete. 2024-04-26T23:41:32.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f0cc7600640 1 -- 172.21.15.137:0/3118219631 shutdown_connections 2024-04-26T23:41:32.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f0cc7600640 1 -- 172.21.15.137:0/3118219631 wait complete. 2024-04-26T23:41:32.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f1e0e000640 1 Processor -- start 2024-04-26T23:41:32.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f1e0e000640 1 -- start start 2024-04-26T23:41:32.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f9b36600640 1 --2- 172.21.15.137:0/794563271 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b3006efc0 0x7f9b30072410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c007040 tx=0x7f9b1c01df50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5acae8d713ceb6e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f1e0e000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e080d2c00 0x7f1e081601e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f1e0e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e0815cf50 0x7f1e080b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f0cc7600640 1 Processor -- start 2024-04-26T23:41:32.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f1e0e000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e08159730 0x7f1e080c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f1e0e000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0815d4b0 con 0x7f1e0815cf50 2024-04-26T23:41:32.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f1e0e000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0815d330 con 0x7f1e080d2c00 2024-04-26T23:41:32.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f1e0e000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1e080cdf90 con 0x7f1e08159730 2024-04-26T23:41:32.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f1e0cc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e080d2c00 0x7f1e081601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f1e0cc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e080d2c00 0x7f1e081601e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:42308/0 (socket says 172.21.15.137:42308) 2024-04-26T23:41:32.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f1e0cc00640 1 -- 172.21.15.137:0/1839568472 learned_addr learned my addr 172.21.15.137:0/1839568472 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:32.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f1e07e00640 1 --2- 172.21.15.137:0/1839568472 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e0815cf50 0x7f1e080b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f9b2fe00640 1 -- 172.21.15.137:0/794563271 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c0ad070 con 0x7f9b3006efc0 2024-04-26T23:41:32.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f1e0d600640 1 --2- 172.21.15.137:0/1839568472 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e08159730 0x7f1e080c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f9b2fe00640 1 -- 172.21.15.137:0/794563271 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b1c007ad0 con 0x7f9b3006efc0 2024-04-26T23:41:32.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f9b2fe00640 1 -- 172.21.15.137:0/794563271 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c0090d0 con 0x7f9b3006efc0 2024-04-26T23:41:32.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f0cc7600640 1 -- start start 2024-04-26T23:41:32.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f1e0cc00640 1 -- 172.21.15.137:0/1839568472 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e08159730 msgr2=0x7f1e080c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f1e0cc00640 1 --2- 172.21.15.137:0/1839568472 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e08159730 0x7f1e080c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f1e0cc00640 1 -- 172.21.15.137:0/1839568472 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e0815cf50 msgr2=0x7f1e080b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f9003200640 1 Processor -- start 2024-04-26T23:41:32.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f1e0cc00640 1 --2- 172.21.15.137:0/1839568472 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e0815cf50 0x7f1e080b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7f1e0cc00640 1 -- 172.21.15.137:0/1839568472 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e08159c80 con 0x7f1e080d2c00 2024-04-26T23:41:32.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f0cc7600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cc00b4ea0 0x7f0cc015e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f0cc7600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc015ff20 0x7f0cc00ce510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f9003200640 1 -- start start 2024-04-26T23:41:32.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f0cc7600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0cc01638b0 0x7f0cc013fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f0cc7600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc0072790 con 0x7f0cc00b4ea0 2024-04-26T23:41:32.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f0cc7600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc0072610 con 0x7f0cc01638b0 2024-04-26T23:41:32.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f0cc7600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc0148a50 con 0x7f0cc015ff20 2024-04-26T23:41:32.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f0cc4c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cc00b4ea0 0x7f0cc015e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f0cc4c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cc00b4ea0 0x7f0cc015e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42930/0 (socket says 172.21.15.137:42930) 2024-04-26T23:41:32.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f0cc4c00640 1 -- 172.21.15.137:0/4105537868 learned_addr learned my addr 172.21.15.137:0/4105537868 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:32.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f0cbfe00640 1 --2- 172.21.15.137:0/4105537868 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc015ff20 0x7f0cc00ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.082+0000 7ff6fe400640 1 Processor -- start 2024-04-26T23:41:32.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7ff6fe400640 1 -- start start 2024-04-26T23:41:32.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f9b38600640 1 -- 172.21.15.137:0/794563271 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b3006efc0 msgr2=0x7f9b30072410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f9b38600640 1 --2- 172.21.15.137:0/794563271 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b3006efc0 0x7f9b30072410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c007040 tx=0x7f9b1c01df50 comp rx=0 tx=0).stop 2024-04-26T23:41:32.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f9b38600640 1 -- 172.21.15.137:0/794563271 shutdown_connections 2024-04-26T23:41:32.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f9b38600640 1 --2- 172.21.15.137:0/794563271 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b3006efc0 0x7f9b30072410 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f9b38600640 1 --2- 172.21.15.137:0/794563271 >> v2:172.21.15.137:3300/0 conn(0x7f9b30141700 0x7f9b300b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f9b38600640 1 -- 172.21.15.137:0/794563271 >> 172.21.15.137:0/794563271 conn(0x7f9b300b27c0 msgr2=0x7f9b300b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:32.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f1e0cc00640 1 --2- 172.21.15.137:0/1839568472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e080d2c00 0x7f1e081601e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1e00007f20 tx=0x7f1e0000d560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f0cbfe00640 1 -- 172.21.15.137:0/4105537868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0cc01638b0 msgr2=0x7f0cc013fda0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:41:32.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f0cbfe00640 1 --2- 172.21.15.137:0/4105537868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0cc01638b0 0x7f0cc013fda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f0cbfe00640 1 -- 172.21.15.137:0/4105537868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cc00b4ea0 msgr2=0x7f0cc015e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f0cbfe00640 1 --2- 172.21.15.137:0/4105537868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cc00b4ea0 0x7f0cc015e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f0cbfe00640 1 -- 172.21.15.137:0/4105537868 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc00cee10 con 0x7f0cc015ff20 2024-04-26T23:41:32.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f9b38600640 1 -- 172.21.15.137:0/794563271 shutdown_connections 2024-04-26T23:41:32.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f9b38600640 1 -- 172.21.15.137:0/794563271 wait complete. 2024-04-26T23:41:32.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f9003200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8ffc163670 0x7f8ffc074370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f9003200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc0b40e0 0x7f8ffc0b4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7fd6bd400640 1 Processor -- start 2024-04-26T23:41:32.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f9003200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ffc0cd360 con 0x7f8ffc0b60f0 2024-04-26T23:41:32.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f9003200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8ffc0b10a0 con 0x7f8ffc163670 2024-04-26T23:41:32.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f9003200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8ffc0b4a90 con 0x7f8ffc0b40e0 2024-04-26T23:41:32.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f0cbfe00640 1 --2- 172.21.15.137:0/4105537868 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc015ff20 0x7f0cc00ce510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800be20 tx=0x7f0cb8009f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7fd6bd400640 1 -- start start 2024-04-26T23:41:32.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f0cbcc00640 1 -- 172.21.15.137:0/4105537868 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8019070 con 0x7f0cc015ff20 2024-04-26T23:41:32.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f0cbcc00640 1 -- 172.21.15.137:0/4105537868 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb8014440 con 0x7f0cc015ff20 2024-04-26T23:41:32.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f0cbcc00640 1 -- 172.21.15.137:0/4105537868 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8014870 con 0x7f0cc015ff20 2024-04-26T23:41:32.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f9001200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc0b40e0 0x7f8ffc0b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f0cc7600640 1 -- 172.21.15.137:0/4105537868 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc00cf0f0 con 0x7f0cc015ff20 2024-04-26T23:41:32.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f0cc7600640 1 -- 172.21.15.137:0/4105537868 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc00cf6b0 con 0x7f0cc015ff20 2024-04-26T23:41:32.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f9001200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc0b40e0 0x7f8ffc0b4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:36530/0 (socket says 172.21.15.137:36530) 2024-04-26T23:41:32.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f9001200640 1 -- 172.21.15.137:0/18901549 learned_addr learned my addr 172.21.15.137:0/18901549 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:32.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f8ffbe00640 1 --2- 172.21.15.137:0/18901549 >> v2:172.21.15.137:3300/0 conn(0x7f8ffc163670 0x7f8ffc074370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7ff6fe400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6f0054450 0x7ff6f00eb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7ff6fe400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff6f0006460 0x7ff6f0006910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7ff6fe400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6f0053800 con 0x7ff6f00e7560 2024-04-26T23:41:32.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7ff6fe400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff6f0037b30 con 0x7ff6f0006460 2024-04-26T23:41:32.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7ff6fe400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff6f0005fd0 con 0x7ff6f0054450 2024-04-26T23:41:32.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f1e04c00640 1 -- 172.21.15.137:0/1839568472 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0001a070 con 0x7f1e080d2c00 2024-04-26T23:41:32.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f1e04c00640 1 -- 172.21.15.137:0/1839568472 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e00003ba0 con 0x7f1e080d2c00 2024-04-26T23:41:32.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f1e04c00640 1 -- 172.21.15.137:0/1839568472 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e00004030 con 0x7f1e080d2c00 2024-04-26T23:41:32.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f1e0e000640 1 -- 172.21.15.137:0/1839568472 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e08159f60 con 0x7f1e080d2c00 2024-04-26T23:41:32.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f1e0e000640 1 -- 172.21.15.137:0/1839568472 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e0815aa10 con 0x7f1e080d2c00 2024-04-26T23:41:32.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.086+0000 7f9b38600640 1 Processor -- start 2024-04-26T23:41:32.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7ff6f7e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6f0054450 0x7ff6f00eb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7ff6f7e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6f0054450 0x7ff6f00eb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:36542/0 (socket says 172.21.15.137:36542) 2024-04-26T23:41:32.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7ff6f7e00640 1 -- 172.21.15.137:0/92448679 learned_addr learned my addr 172.21.15.137:0/92448679 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:32.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f9b38600640 1 -- start start 2024-04-26T23:41:32.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f0cc7600640 1 -- 172.21.15.137:0/4105537868 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c980052a0 con 0x7f0cc015ff20 2024-04-26T23:41:32.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f8ffbe00640 1 -- 172.21.15.137:0/18901549 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc0b40e0 msgr2=0x7f8ffc0b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:32.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f8ffbe00640 1 --2- 172.21.15.137:0/18901549 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc0b40e0 0x7f8ffc0b4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f8ffbe00640 1 -- 172.21.15.137:0/18901549 >> v1:172.21.15.170:6789/0 conn(0x7f8ffc0b60f0 legacy=0x7f8ffc0b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:32.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f8ffbe00640 1 -- 172.21.15.137:0/18901549 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ffc0cd640 con 0x7f8ffc163670 2024-04-26T23:41:32.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f1e0e000640 1 -- 172.21.15.137:0/1839568472 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e0815ac10 con 0x7f1e080d2c00 2024-04-26T23:41:32.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f6251a00640 1 Processor -- start 2024-04-26T23:41:32.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7fd6bd400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd6b8146920 0x7fd6b8073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7fd6b6800640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fd6b80ce3e0 0x7fd6b80d04e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:42538/0 (socket says 172.21.15.137:42538) 2024-04-26T23:41:32.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7fd6b6800640 1 -- 172.21.15.137:0/1890473495 learned_addr learned my addr 172.21.15.137:0/1890473495 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:32.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7fd6bd400640 1 -- 172.21.15.137:0/1890473495 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6b8073010 con 0x7fd6b815de80 2024-04-26T23:41:32.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7ff6f7400640 1 -- 172.21.15.137:0/92448679 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 923193787 0 0) 0x7ff6f0053800 con 0x7ff6f00e7560 2024-04-26T23:41:32.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7ff6f7400640 1 -- 172.21.15.137:0/92448679 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6e0003530 con 0x7ff6f00e7560 2024-04-26T23:41:32.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7ff6f7e00640 1 -- 172.21.15.137:0/92448679 >> v2:172.21.15.137:3300/0 conn(0x7ff6f0006460 msgr2=0x7ff6f0006910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:32.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f6251a00640 1 -- start start 2024-04-26T23:41:32.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f9b38600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b3006efc0 0x7f9b301394c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f9b38600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b30141700 0x7f9b3013e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f9b38600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b3015c050 0x7f9b30146360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7fd6bd400640 1 -- 172.21.15.137:0/1890473495 --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6b80cef90 con 0x7fd6b80ce3e0 2024-04-26T23:41:32.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7fd6bd400640 1 -- 172.21.15.137:0/1890473495 --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd6b8073280 con 0x7fd6b8146920 2024-04-26T23:41:32.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f0cbcc00640 1 -- 172.21.15.137:0/4105537868 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0cb801c070 con 0x7f0cc015ff20 2024-04-26T23:41:32.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f9b35c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b3006efc0 0x7f9b301394c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f9b35c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b3006efc0 0x7f9b301394c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:42324/0 (socket says 172.21.15.137:42324) 2024-04-26T23:41:32.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f9b36600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b3015c050 0x7f9b30146360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f9b35200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b30141700 0x7f9b3013e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f9b36600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b3015c050 0x7f9b30146360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42976/0 (socket says 172.21.15.137:42976) 2024-04-26T23:41:32.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f9b35200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b30141700 0x7f9b3013e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:36556/0 (socket says 172.21.15.137:36556) 2024-04-26T23:41:32.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f9b38600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9b300734f0 con 0x7f9b3015c050 2024-04-26T23:41:32.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f9b38600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9b30073370 con 0x7f9b3006efc0 2024-04-26T23:41:32.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f9b38600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9b30073670 con 0x7f9b30141700 2024-04-26T23:41:32.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f9b35c00640 1 -- 172.21.15.137:0/1310540319 learned_addr learned my addr 172.21.15.137:0/1310540319 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:32.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7fd6b5400640 1 -- 172.21.15.137:0/1890473495 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 30494914 0 0) 0x7fd6b80cef90 con 0x7fd6b80ce3e0 2024-04-26T23:41:32.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7fd6b7200640 1 --2- 172.21.15.137:0/1890473495 >> v2:172.21.15.137:3300/0 conn(0x7fd6b8146920 0x7fd6b8073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7fd6b5400640 1 -- 172.21.15.137:0/1890473495 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd69c003530 con 0x7fd6b80ce3e0 2024-04-26T23:41:32.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7f0cbcc00640 1 --2- 172.21.15.137:0/4105537868 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0ca0068450 0x7f0ca006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7f0cbcc00640 1 -- 172.21.15.137:0/4105537868 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0cb8086ed0 con 0x7f0cc015ff20 2024-04-26T23:41:32.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f9b36600640 1 -- 172.21.15.137:0/1310540319 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b30141700 msgr2=0x7f9b3013e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f9b36600640 1 --2- 172.21.15.137:0/1310540319 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b30141700 0x7f9b3013e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f9b36600640 1 -- 172.21.15.137:0/1310540319 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b3006efc0 msgr2=0x7f9b301394c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f9b36600640 1 --2- 172.21.15.137:0/1310540319 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b3006efc0 0x7f9b301394c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7f9b36600640 1 -- 172.21.15.137:0/1310540319 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b30157510 con 0x7f9b3015c050 2024-04-26T23:41:32.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7f9b36600640 1 --2- 172.21.15.137:0/1310540319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b3015c050 0x7f9b30146360 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9b300b5260 tx=0x7f9b1c01a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7ff6fda00640 1 --2- 172.21.15.137:0/92448679 >> v2:172.21.15.137:3300/0 conn(0x7ff6f0006460 0x7ff6f0006910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7ff6f7e00640 1 --2- 172.21.15.137:0/92448679 >> v2:172.21.15.137:3300/0 conn(0x7ff6f0006460 0x7ff6f0006910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7ff6f7e00640 1 -- 172.21.15.137:0/92448679 >> v1:172.21.15.170:6789/0 conn(0x7ff6f00e7560 legacy=0x7ff6f00eb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7ff6f7e00640 1 -- 172.21.15.137:0/92448679 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f0053ae0 con 0x7ff6f0054450 2024-04-26T23:41:32.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7f1e04c00640 1 -- 172.21.15.137:0/1839568472 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1e0001d070 con 0x7f1e080d2c00 2024-04-26T23:41:32.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7fd6b5400640 1 -- 172.21.15.137:0/1890473495 <== mon.1 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3815929622 0 0) 0x7fd69c003530 con 0x7fd6b80ce3e0 2024-04-26T23:41:32.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7fd6b5400640 1 -- 172.21.15.137:0/1890473495 >> v2:172.21.15.137:3300/0 conn(0x7fd6b8146920 msgr2=0x7fd6b8073d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:32.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7fd6b5400640 1 --2- 172.21.15.137:0/1890473495 >> v2:172.21.15.137:3300/0 conn(0x7fd6b8146920 0x7fd6b8073d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7fd6b5400640 1 -- 172.21.15.137:0/1890473495 >> v1:172.21.15.137:6789/0 conn(0x7fd6b815de80 legacy=0x7fd6b8146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:32.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7fd6b5400640 1 -- 172.21.15.137:0/1890473495 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b8073560 con 0x7fd6b80ce3e0 2024-04-26T23:41:32.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7fd6b5400640 1 -- 172.21.15.137:0/1890473495 <== mon.1 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fd6a4001680 con 0x7fd6b80ce3e0 2024-04-26T23:41:32.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.090+0000 7fd6b5400640 1 -- 172.21.15.137:0/1890473495 >> v1:172.21.15.170:6789/0 conn(0x7fd6b80ce3e0 legacy=0x7fd6b80d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7fd6b5400640 1 --2- 172.21.15.137:0/1890473495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd69c003a10 0x7fd69c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7fd6b5400640 1 --2- 172.21.15.137:0/1890473495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd69c004810 0x7fd69c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7fd6b5400640 1 --2- 172.21.15.137:0/1890473495 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd69c005220 0x7fd69c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7fd6b5400640 1 -- 172.21.15.137:0/1890473495 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b8073280 con 0x7fd69c004810 2024-04-26T23:41:32.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7fd6b5400640 1 -- 172.21.15.137:0/1890473495 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c00c150 con 0x7fd69c003a10 2024-04-26T23:41:32.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7fd6b5400640 1 -- 172.21.15.137:0/1890473495 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd69c00c350 con 0x7fd69c005220 2024-04-26T23:41:32.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7fd6b6800640 1 --2- 172.21.15.137:0/1890473495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd69c003a10 0x7fd69c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7fd6b7200640 1 --2- 172.21.15.137:0/1890473495 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd69c005220 0x7fd69c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7fd6b7200640 1 -- 172.21.15.137:0/1890473495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd69c003a10 msgr2=0x7fd69c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:32.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7fd6b7200640 1 --2- 172.21.15.137:0/1890473495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd69c003a10 0x7fd69c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7fd6b7200640 1 -- 172.21.15.137:0/1890473495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd69c004810 msgr2=0x7fd69c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:32.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7fd6b7200640 1 --2- 172.21.15.137:0/1890473495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd69c004810 0x7fd69c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7fd6b7200640 1 -- 172.21.15.137:0/1890473495 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69c003530 con 0x7fd69c005220 2024-04-26T23:41:32.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7f1e04c00640 1 --2- 172.21.15.137:0/1839568472 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1de8068450 0x7f1de806a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7f9b2d600640 1 -- 172.21.15.137:0/1310540319 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c0b6030 con 0x7f9b3015c050 2024-04-26T23:41:32.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7f9b38600640 1 -- 172.21.15.137:0/1310540319 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b301577f0 con 0x7f9b3015c050 2024-04-26T23:41:32.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7f9b38600640 1 -- 172.21.15.137:0/1310540319 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b30157db0 con 0x7f9b3015c050 2024-04-26T23:41:32.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7f6251a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f624c0b09a0 0x7f624c1613f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7f1e07e00640 1 --2- 172.21.15.137:0/1839568472 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1de8068450 0x7f1de806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7f6251a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f624c0b37c0 0x7f624c15ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7f6251a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f624c0cdd30 con 0x7f624c153d40 2024-04-26T23:41:32.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7f6251a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f624c160930 con 0x7f624c0b37c0 2024-04-26T23:41:32.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7f6251a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f624c0cdff0 con 0x7f624c0b09a0 2024-04-26T23:41:32.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7f9b2d600640 1 -- 172.21.15.137:0/1310540319 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b1c0079b0 con 0x7f9b3015c050 2024-04-26T23:41:32.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7f1e07e00640 1 --2- 172.21.15.137:0/1839568472 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1de8068450 0x7f1de806a910 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1e0816d250 tx=0x7f1df4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7f1e04c00640 1 -- 172.21.15.137:0/1839568472 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1e00086bb0 con 0x7f1e080d2c00 2024-04-26T23:41:32.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7f624be00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f624c153d40 0x7f624c0b30b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:42550/0 (socket says 172.21.15.137:42550) 2024-04-26T23:41:32.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7f624be00640 1 -- 172.21.15.137:0/2235815134 learned_addr learned my addr 172.21.15.137:0/2235815134 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:32.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7f6251000640 1 --2- 172.21.15.137:0/2235815134 >> v2:172.21.15.137:3300/0 conn(0x7f624c0b37c0 0x7f624c15ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7f624b400640 1 --2- 172.21.15.137:0/2235815134 >> v2:172.21.15.170:3300/0 conn(0x7f624c0b09a0 0x7f624c1613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7fd6b7200640 1 -- 172.21.15.137:0/1890473495 reap_dead start 2024-04-26T23:41:32.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7f9b2d600640 1 -- 172.21.15.137:0/1310540319 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c0c0060 con 0x7f9b3015c050 2024-04-26T23:41:32.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7f624b400640 1 -- 172.21.15.137:0/2235815134 >> v2:172.21.15.137:3300/0 conn(0x7f624c0b37c0 msgr2=0x7f624c15ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:32.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7f624b400640 1 --2- 172.21.15.137:0/2235815134 >> v2:172.21.15.137:3300/0 conn(0x7f624c0b37c0 0x7f624c15ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7f624b400640 1 -- 172.21.15.137:0/2235815134 >> v1:172.21.15.170:6789/0 conn(0x7f624c153d40 legacy=0x7f624c0b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7f624b400640 1 -- 172.21.15.137:0/2235815134 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624c0ce2d0 con 0x7f624c0b09a0 2024-04-26T23:41:32.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.094+0000 7f0cc4c00640 1 --2- 172.21.15.137:0/4105537868 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0ca0068450 0x7f0ca006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7fd6b7200640 1 --2- 172.21.15.137:0/1890473495 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd69c005220 0x7fd69c00b9d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0007330 tx=0x7fd6b001ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a3861aace49dac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7f8ffbe00640 1 --2- 172.21.15.137:0/18901549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ffc163670 0x7f8ffc074370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0d2230 tx=0x7f8fe801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d519e53359c90677 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7f0cbcc00640 1 -- 172.21.15.137:0/4105537868 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0cb8023020 con 0x7f0cc015ff20 2024-04-26T23:41:32.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7fd6b5400640 1 -- 172.21.15.137:0/1890473495 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0009be0 con 0x7fd69c005220 2024-04-26T23:41:32.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7fd6b5400640 1 -- 172.21.15.137:0/1890473495 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6b00a5d60 con 0x7fd69c005220 2024-04-26T23:41:32.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7f0cc4c00640 1 --2- 172.21.15.137:0/4105537868 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0ca0068450 0x7f0ca006a910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0cb001c570 tx=0x7f0cb00a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7fd6b5400640 1 -- 172.21.15.137:0/1890473495 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0003be0 con 0x7fd69c005220 2024-04-26T23:41:32.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7fd6bd400640 1 -- 172.21.15.137:0/1890473495 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd69c005220 msgr2=0x7fd69c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7fd6bd400640 1 --2- 172.21.15.137:0/1890473495 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd69c005220 0x7fd69c00b9d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0007330 tx=0x7fd6b001ce60 comp rx=0 tx=0).stop 2024-04-26T23:41:32.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7fd6bd400640 1 -- 172.21.15.137:0/1890473495 shutdown_connections 2024-04-26T23:41:32.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7fd6bd400640 1 --2- 172.21.15.137:0/1890473495 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd69c005220 0x7fd69c00b9d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7fd6bd400640 1 -- 172.21.15.137:0/1890473495 >> 172.21.15.137:0/1890473495 conn(0x7fd6b806c5d0 msgr2=0x7fd6b806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:32.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7ff6f7e00640 1 --2- 172.21.15.137:0/92448679 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6f0054450 0x7ff6f00eb820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009870 tx=0x7ff6e401c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef9e2434b0411c99 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7ff6f7400640 1 -- 172.21.15.137:0/92448679 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e40b0070 con 0x7ff6f0054450 2024-04-26T23:41:32.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7ff6f7400640 1 -- 172.21.15.137:0/92448679 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e40ab400 con 0x7ff6f0054450 2024-04-26T23:41:32.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7ff6f7400640 1 -- 172.21.15.137:0/92448679 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec001680 con 0x7ff6f0054450 2024-04-26T23:41:32.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7fd6bd400640 1 -- 172.21.15.137:0/1890473495 shutdown_connections 2024-04-26T23:41:32.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7fd6bd400640 1 -- 172.21.15.137:0/1890473495 wait complete. 2024-04-26T23:41:32.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7f1e04c00640 1 -- 172.21.15.137:0/1839568472 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1e00010070 con 0x7f1e080d2c00 2024-04-26T23:41:32.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.098+0000 7f9b38600640 1 -- 172.21.15.137:0/1310540319 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b0c0052a0 con 0x7f9b3015c050 2024-04-26T23:41:32.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7f9b2d600640 1 -- 172.21.15.137:0/1310540319 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9b1c0b9030 con 0x7f9b3015c050 2024-04-26T23:41:32.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7ff6fe400640 1 -- 172.21.15.137:0/92448679 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6f0054450 msgr2=0x7ff6f00eb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7ff6fe400640 1 --2- 172.21.15.137:0/92448679 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6f0054450 0x7ff6f00eb820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009870 tx=0x7ff6e401c390 comp rx=0 tx=0).stop 2024-04-26T23:41:32.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7ff6fe400640 1 -- 172.21.15.137:0/92448679 shutdown_connections 2024-04-26T23:41:32.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7ff6fe400640 1 --2- 172.21.15.137:0/92448679 >> v2:172.21.15.137:3300/0 conn(0x7ff6f0006460 0x7ff6f0006910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7ff6fe400640 1 --2- 172.21.15.137:0/92448679 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6f0054450 0x7ff6f00eb820 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7ff6fe400640 1 -- 172.21.15.137:0/92448679 >> 172.21.15.137:0/92448679 conn(0x7ff6f0009fc0 msgr2=0x7ff6f000a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:32.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7ff6fe400640 1 -- 172.21.15.137:0/92448679 shutdown_connections 2024-04-26T23:41:32.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7ff6fe400640 1 -- 172.21.15.137:0/92448679 wait complete. 2024-04-26T23:41:32.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7f624b400640 1 --2- 172.21.15.137:0/2235815134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f624c0b09a0 0x7f624c1613f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f624c157900 tx=0x7f623401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef4f1a2d27465f9d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7f8ffaa00640 1 -- 172.21.15.137:0/18901549 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe80b0070 con 0x7f8ffc163670 2024-04-26T23:41:32.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7f9b2d600640 1 --2- 172.21.15.137:0/1310540319 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b10068380 0x7f9b1006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7f9b2d600640 1 -- 172.21.15.137:0/1310540319 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9b1c120a00 con 0x7f9b3015c050 2024-04-26T23:41:32.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7f8ffaa00640 1 -- 172.21.15.137:0/18901549 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe80ab600 con 0x7f8ffc163670 2024-04-26T23:41:32.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7f8ffaa00640 1 -- 172.21.15.137:0/18901549 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe80ab9d0 con 0x7f8ffc163670 2024-04-26T23:41:32.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7f9003200640 1 -- 172.21.15.137:0/18901549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ffc163670 msgr2=0x7f8ffc074370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7f9003200640 1 --2- 172.21.15.137:0/18901549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ffc163670 0x7f8ffc074370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0d2230 tx=0x7f8fe801c420 comp rx=0 tx=0).stop 2024-04-26T23:41:32.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7f624aa00640 1 -- 172.21.15.137:0/2235815134 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62340b0070 con 0x7f624c0b09a0 2024-04-26T23:41:32.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7f9b35c00640 1 --2- 172.21.15.137:0/1310540319 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b10068380 0x7f9b1006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7f624aa00640 1 -- 172.21.15.137:0/2235815134 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62340ab600 con 0x7f624c0b09a0 2024-04-26T23:41:32.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7f624aa00640 1 -- 172.21.15.137:0/2235815134 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62340ab9d0 con 0x7f624c0b09a0 2024-04-26T23:41:32.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7ff6fe400640 1 Processor -- start 2024-04-26T23:41:32.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7ff6fe400640 1 -- start start 2024-04-26T23:41:32.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7f6251a00640 1 -- 172.21.15.137:0/2235815134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f624c0b09a0 msgr2=0x7f624c1613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7f6251a00640 1 --2- 172.21.15.137:0/2235815134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f624c0b09a0 0x7f624c1613f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f624c157900 tx=0x7f623401c3f0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7f9b35c00640 1 --2- 172.21.15.137:0/1310540319 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b10068380 0x7f9b1006a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9b2800f570 tx=0x7f9b28011040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.102+0000 7fd6bd400640 1 Processor -- start 2024-04-26T23:41:32.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7fd6bd400640 1 -- start start 2024-04-26T23:41:32.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7f6251a00640 1 -- 172.21.15.137:0/2235815134 shutdown_connections 2024-04-26T23:41:32.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7f6251a00640 1 --2- 172.21.15.137:0/2235815134 >> v2:172.21.15.137:3300/0 conn(0x7f624c0b37c0 0x7f624c15ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7f6251a00640 1 --2- 172.21.15.137:0/2235815134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f624c0b09a0 0x7f624c1613f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7f6251a00640 1 -- 172.21.15.137:0/2235815134 >> 172.21.15.137:0/2235815134 conn(0x7f624c075750 msgr2=0x7f624c06c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:32.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7f6251a00640 1 -- 172.21.15.137:0/2235815134 shutdown_connections 2024-04-26T23:41:32.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7f6251a00640 1 -- 172.21.15.137:0/2235815134 wait complete. 2024-04-26T23:41:32.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7f9003200640 1 -- 172.21.15.137:0/18901549 shutdown_connections 2024-04-26T23:41:32.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7f9003200640 1 --2- 172.21.15.137:0/18901549 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc0b40e0 0x7f8ffc0b4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7f9003200640 1 --2- 172.21.15.137:0/18901549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ffc163670 0x7f8ffc074370 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7f9003200640 1 -- 172.21.15.137:0/18901549 >> 172.21.15.137:0/18901549 conn(0x7f8ffc072b00 msgr2=0x7f8ffc0b2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:32.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7fd6bd400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd69c005220 0x7fd6b815c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7fd6bd400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6b8141b30 0x7fd6b8141fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7fd6bd400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6b8142ab0 0x7fd6b8142f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7fd6bd400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b815e400 con 0x7fd6b8141b30 2024-04-26T23:41:32.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7fd6bd400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b815e280 con 0x7fd6b8142ab0 2024-04-26T23:41:32.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7fd6bd400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd6b80ce7c0 con 0x7fd69c005220 2024-04-26T23:41:32.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7ff6fe400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6f0006460 0x7ff6f00ddb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7fd6b5e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6b8141b30 0x7fd6b8141fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7fd6b5e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6b8141b30 0x7fd6b8141fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43012/0 (socket says 172.21.15.137:43012) 2024-04-26T23:41:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7fd6b5e00640 1 -- 172.21.15.137:0/2198657261 learned_addr learned my addr 172.21.15.137:0/2198657261 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7ff6fe400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6f0054450 0x7ff6f00e07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7ff6fd000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6f0006460 0x7ff6f00ddb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7ff6fd000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6f0006460 0x7ff6f00ddb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:42354/0 (socket says 172.21.15.137:42354) 2024-04-26T23:41:32.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7fd6b6800640 1 --2- 172.21.15.137:0/2198657261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd69c005220 0x7fd6b815c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7fd6b5e00640 1 -- 172.21.15.137:0/2198657261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd69c005220 msgr2=0x7fd6b815c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7fd6b5e00640 1 --2- 172.21.15.137:0/2198657261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd69c005220 0x7fd6b815c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7fd6b5e00640 1 -- 172.21.15.137:0/2198657261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6b8142ab0 msgr2=0x7fd6b8142f10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:41:32.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7fd6b5e00640 1 --2- 172.21.15.137:0/2198657261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6b8142ab0 0x7fd6b8142f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7fd6b5e00640 1 -- 172.21.15.137:0/2198657261 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b81f4b50 con 0x7fd6b8141b30 2024-04-26T23:41:32.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7ff6fd000640 1 -- 172.21.15.137:0/127627131 learned_addr learned my addr 172.21.15.137:0/127627131 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:32.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7ff6fe400640 1 --2- 172.21.15.137:0/127627131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6f00e7560 0x7ff6f00def30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7fd6b5e00640 1 --2- 172.21.15.137:0/2198657261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6b8141b30 0x7fd6b8141fb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800c3c0 tx=0x7fd6a800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7f6251a00640 1 Processor -- start 2024-04-26T23:41:32.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7ff6fda00640 1 --2- 172.21.15.137:0/127627131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6f00e7560 0x7ff6f00def30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7ff6f7e00640 1 --2- 172.21.15.137:0/127627131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6f0054450 0x7ff6f00e07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7f6251a00640 1 -- start start 2024-04-26T23:41:32.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7f9003200640 1 -- 172.21.15.137:0/18901549 shutdown_connections 2024-04-26T23:41:32.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7f9003200640 1 -- 172.21.15.137:0/18901549 wait complete. 2024-04-26T23:41:32.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7ff6fe400640 1 -- 172.21.15.137:0/127627131 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f00535a0 con 0x7ff6f00e7560 2024-04-26T23:41:32.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7ff6fe400640 1 -- 172.21.15.137:0/127627131 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f0053420 con 0x7ff6f0006460 2024-04-26T23:41:32.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.106+0000 7ff6fe400640 1 -- 172.21.15.137:0/127627131 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff6f00ebd60 con 0x7ff6f0054450 2024-04-26T23:41:32.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7fd6b6800640 1 --2- 172.21.15.137:0/2198657261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd69c005220 0x7fd6b815c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:32.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7ff6fd000640 1 -- 172.21.15.137:0/127627131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6f0054450 msgr2=0x7ff6f00e07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f9003200640 1 Processor -- start 2024-04-26T23:41:32.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f9003200640 1 -- start start 2024-04-26T23:41:32.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7ff6fd000640 1 --2- 172.21.15.137:0/127627131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6f0054450 0x7ff6f00e07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7ff6fd000640 1 -- 172.21.15.137:0/127627131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6f00e7560 msgr2=0x7ff6f00def30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7ff6fd000640 1 --2- 172.21.15.137:0/127627131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6f00e7560 0x7ff6f00def30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7ff6fd000640 1 -- 172.21.15.137:0/127627131 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f00dfa20 con 0x7ff6f0006460 2024-04-26T23:41:32.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7ff6fda00640 1 --2- 172.21.15.137:0/127627131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6f00e7560 0x7ff6f00def30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:41:32.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f6251a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f624c0b09a0 0x7f624c1ffe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f6251a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f624c0b37c0 0x7f624c15c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7ff6f7e00640 1 --2- 172.21.15.137:0/127627131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6f0054450 0x7ff6f00e07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:32.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7ff6fd000640 1 --2- 172.21.15.137:0/127627131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6f0006460 0x7ff6f00ddb70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00c750 tx=0x7ff6ec00cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f6251a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f624c153d40 0x7f624c1fbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f624be00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f624c0b09a0 0x7f624c1ffe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f624be00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f624c0b09a0 0x7f624c1ffe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:36600/0 (socket says 172.21.15.137:36600) 2024-04-26T23:41:32.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f624b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f624c0b37c0 0x7f624c15c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f624be00640 1 -- 172.21.15.137:0/249380586 learned_addr learned my addr 172.21.15.137:0/249380586 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:32.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f6251000640 1 --2- 172.21.15.137:0/249380586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f624c153d40 0x7f624c1fbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f9003200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc0b40e0 0x7f8ffc161180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f9003200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ffc0b60f0 0x7f8ffc15bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f9003200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ffc163670 0x7f8ffc165880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f9003200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc163bd0 con 0x7f8ffc163670 2024-04-26T23:41:32.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f9003200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc163a50 con 0x7f8ffc0b60f0 2024-04-26T23:41:32.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f9003200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8ffc0b0540 con 0x7f8ffc0b40e0 2024-04-26T23:41:32.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f6251a00640 1 -- 172.21.15.137:0/249380586 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f624c0d0280 con 0x7f624c153d40 2024-04-26T23:41:32.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f6251a00640 1 -- 172.21.15.137:0/249380586 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f624c0d0100 con 0x7f624c0b37c0 2024-04-26T23:41:32.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f6251a00640 1 -- 172.21.15.137:0/249380586 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f624c0d0400 con 0x7f624c0b09a0 2024-04-26T23:41:32.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f9001200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ffc163670 0x7f8ffc165880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7ff6f4c00640 1 -- 172.21.15.137:0/127627131 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec017070 con 0x7ff6f0006460 2024-04-26T23:41:32.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f8ffb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ffc0b60f0 0x7f8ffc15bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f8ffb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ffc0b60f0 0x7f8ffc15bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:42376/0 (socket says 172.21.15.137:42376) 2024-04-26T23:41:32.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f8ffb400640 1 -- 172.21.15.137:0/1008439716 learned_addr learned my addr 172.21.15.137:0/1008439716 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:32.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f8ffbe00640 1 --2- 172.21.15.137:0/1008439716 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc0b40e0 0x7f8ffc161180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7ff6f4c00640 1 -- 172.21.15.137:0/127627131 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6ec00a640 con 0x7ff6f0006460 2024-04-26T23:41:32.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7ff6f4c00640 1 -- 172.21.15.137:0/127627131 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec00ce60 con 0x7ff6f0006460 2024-04-26T23:41:32.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7ff6fe400640 1 -- 172.21.15.137:0/127627131 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f00dfd00 con 0x7ff6f0006460 2024-04-26T23:41:32.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7fd6aea00640 1 -- 172.21.15.137:0/2198657261 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8011790 con 0x7fd6b8141b30 2024-04-26T23:41:32.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7fd6aea00640 1 -- 172.21.15.137:0/2198657261 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6a8017070 con 0x7fd6b8141b30 2024-04-26T23:41:32.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7fd6aea00640 1 -- 172.21.15.137:0/2198657261 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8011b30 con 0x7fd6b8141b30 2024-04-26T23:41:32.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f624be00640 1 -- 172.21.15.137:0/249380586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f624c0b37c0 msgr2=0x7f624c15c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f624be00640 1 --2- 172.21.15.137:0/249380586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f624c0b37c0 0x7f624c15c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f624be00640 1 -- 172.21.15.137:0/249380586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f624c153d40 msgr2=0x7f624c1fbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f624be00640 1 --2- 172.21.15.137:0/249380586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f624c153d40 0x7f624c1fbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f624be00640 1 -- 172.21.15.137:0/249380586 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624c1ff380 con 0x7f624c0b09a0 2024-04-26T23:41:32.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f624b400640 1 --2- 172.21.15.137:0/249380586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f624c0b37c0 0x7f624c15c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:32.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f8ffb400640 1 -- 172.21.15.137:0/1008439716 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc0b40e0 msgr2=0x7f8ffc161180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f8ffb400640 1 --2- 172.21.15.137:0/1008439716 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc0b40e0 0x7f8ffc161180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f8ffb400640 1 -- 172.21.15.137:0/1008439716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ffc163670 msgr2=0x7f8ffc165880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f8ffb400640 1 --2- 172.21.15.137:0/1008439716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ffc163670 0x7f8ffc165880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7ff6fe400640 1 -- 172.21.15.137:0/127627131 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f00e02c0 con 0x7ff6f0006460 2024-04-26T23:41:32.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7f8ffb400640 1 -- 172.21.15.137:0/1008439716 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ffc0cda40 con 0x7f8ffc0b60f0 2024-04-26T23:41:32.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.114+0000 7f624be00640 1 --2- 172.21.15.137:0/249380586 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f624c0b09a0 0x7f624c1ffe20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f623c007fd0 tx=0x7f623c00c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.114+0000 7f8ffb400640 1 --2- 172.21.15.137:0/1008439716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ffc0b60f0 0x7f8ffc15bef0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00c450 tx=0x7f8fec00c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.114+0000 7f6243e00640 1 -- 172.21.15.137:0/249380586 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c017070 con 0x7f624c0b09a0 2024-04-26T23:41:32.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.114+0000 7f6243e00640 1 -- 172.21.15.137:0/249380586 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f623c005d10 con 0x7f624c0b09a0 2024-04-26T23:41:32.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.114+0000 7f6251a00640 1 -- 172.21.15.137:0/249380586 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f624c1fc8a0 con 0x7f624c0b09a0 2024-04-26T23:41:32.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.114+0000 7f6251a00640 1 -- 172.21.15.137:0/249380586 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f624c1ff620 con 0x7f624c0b09a0 2024-04-26T23:41:32.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.114+0000 7f8ff3e00640 1 -- 172.21.15.137:0/1008439716 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec012830 con 0x7f8ffc0b60f0 2024-04-26T23:41:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.114+0000 7f8ff3e00640 1 -- 172.21.15.137:0/1008439716 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fec017070 con 0x7f8ffc0b60f0 2024-04-26T23:41:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.114+0000 7f9003200640 1 -- 172.21.15.137:0/1008439716 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ffc162d50 con 0x7f8ffc0b60f0 2024-04-26T23:41:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.114+0000 7f8ff3e00640 1 -- 172.21.15.137:0/1008439716 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec012c30 con 0x7f8ffc0b60f0 2024-04-26T23:41:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.114+0000 7f9003200640 1 -- 172.21.15.137:0/1008439716 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ffc0cdfc0 con 0x7f8ffc0b60f0 2024-04-26T23:41:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7fd6bd400640 1 -- 172.21.15.137:0/2198657261 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6b8143690 con 0x7fd6b8141b30 2024-04-26T23:41:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.110+0000 7fd6bd400640 1 -- 172.21.15.137:0/2198657261 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6b8143c50 con 0x7fd6b8141b30 2024-04-26T23:41:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.114+0000 7f6243e00640 1 -- 172.21.15.137:0/249380586 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c007310 con 0x7f624c0b09a0 2024-04-26T23:41:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.114+0000 7f9b2d600640 1 -- 172.21.15.137:0/1310540319 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9b1c017110 con 0x7f9b3015c050 2024-04-26T23:41:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.114+0000 7fd6bd400640 1 -- 172.21.15.137:0/2198657261 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6900052a0 con 0x7fd6b8141b30 2024-04-26T23:41:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.114+0000 7ff6f4c00640 1 -- 172.21.15.137:0/127627131 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff6ec01a070 con 0x7ff6f0006460 2024-04-26T23:41:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.118+0000 7ff6f4c00640 1 --2- 172.21.15.137:0/127627131 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff6d80683d0 0x7ff6d806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.118+0000 7ff6f4c00640 1 -- 172.21.15.137:0/127627131 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff6ec085f30 con 0x7ff6f0006460 2024-04-26T23:41:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.118+0000 7ff6f7e00640 1 --2- 172.21.15.137:0/127627131 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff6d80683d0 0x7ff6d806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.118+0000 7f6251a00640 1 -- 172.21.15.137:0/249380586 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f624c06a410 con 0x7f624c0b09a0 2024-04-26T23:41:32.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.118+0000 7f8ff3e00640 1 -- 172.21.15.137:0/1008439716 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8fec01c460 con 0x7f8ffc0b60f0 2024-04-26T23:41:32.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.118+0000 7f9003200640 1 -- 172.21.15.137:0/1008439716 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ffc06a4b0 con 0x7f8ffc0b60f0 2024-04-26T23:41:32.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.118+0000 7ff6fe400640 1 -- 172.21.15.137:0/127627131 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6f00053a0 con 0x7ff6f0006460 2024-04-26T23:41:32.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.118+0000 7f8ff3e00640 1 --2- 172.21.15.137:0/1008439716 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8fdc068380 0x7f8fdc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.118+0000 7ff6f7e00640 1 --2- 172.21.15.137:0/127627131 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff6d80683d0 0x7ff6d806a890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff6e40ad000 tx=0x7ff6e4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.118+0000 7f8ff3e00640 1 -- 172.21.15.137:0/1008439716 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8fec086670 con 0x7f8ffc0b60f0 2024-04-26T23:41:32.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.118+0000 7f6243e00640 1 -- 172.21.15.137:0/249380586 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f623c01a070 con 0x7f624c0b09a0 2024-04-26T23:41:32.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.118+0000 7f6243e00640 1 --2- 172.21.15.137:0/249380586 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6228068480 0x7f622806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.118+0000 7f8ffbe00640 1 --2- 172.21.15.137:0/1008439716 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8fdc068380 0x7f8fdc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.118+0000 7fd6aea00640 1 -- 172.21.15.137:0/2198657261 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd6a8011cd0 con 0x7fd6b8141b30 2024-04-26T23:41:32.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.122+0000 7f6243e00640 1 -- 172.21.15.137:0/249380586 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f623c085c60 con 0x7f624c0b09a0 2024-04-26T23:41:32.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.122+0000 7f624b400640 1 --2- 172.21.15.137:0/249380586 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6228068480 0x7f622806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.122+0000 7fd6aea00640 1 --2- 172.21.15.137:0/2198657261 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd698068450 0x7fd69806a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.122+0000 7fd6aea00640 1 -- 172.21.15.137:0/2198657261 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd6a8087150 con 0x7fd6b8141b30 2024-04-26T23:41:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.122+0000 7f8ffbe00640 1 --2- 172.21.15.137:0/1008439716 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8fdc068380 0x7f8fdc06a840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80ad000 tx=0x7f8fe80a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.122+0000 7fd6b6800640 1 --2- 172.21.15.137:0/2198657261 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd698068450 0x7fd69806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.122+0000 7f624b400640 1 --2- 172.21.15.137:0/249380586 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6228068480 0x7f622806a940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f62340ad000 tx=0x7f6234008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.122+0000 7fd6b6800640 1 --2- 172.21.15.137:0/2198657261 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd698068450 0x7fd69806a910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4001060 tx=0x7fd6a4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.126+0000 7fd6aea00640 1 -- 172.21.15.137:0/2198657261 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd6b81f4b50 con 0x7fd6b8141b30 2024-04-26T23:41:32.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.130+0000 7ff6f4c00640 1 -- 172.21.15.137:0/127627131 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff6ec055f80 con 0x7ff6f0006460 2024-04-26T23:41:32.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.130+0000 7f6243e00640 1 -- 172.21.15.137:0/249380586 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f623c055c40 con 0x7f624c0b09a0 2024-04-26T23:41:32.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.138+0000 7f8ff3e00640 1 -- 172.21.15.137:0/1008439716 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8fec056540 con 0x7f8ffc0b60f0 2024-04-26T23:41:32.382 INFO:teuthology.orchestra.run.smithi137.stdout:55834574855 2024-04-26T23:41:32.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.374+0000 7f82ee400640 1 -- 172.21.15.137:0/945496954 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f82c0005860 con 0x7f82e8141700 2024-04-26T23:41:32.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.374+0000 7f82df400640 1 -- 172.21.15.137:0/945496954 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f82e005a180 con 0x7f82e8141700 2024-04-26T23:41:32.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.378+0000 7f82ee400640 1 -- 172.21.15.137:0/945496954 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f82c80797a0 msgr2=0x7f82c807bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.378+0000 7f82ee400640 1 --2- 172.21.15.137:0/945496954 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f82c80797a0 0x7f82c807bc60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f82d40af000 tx=0x7f82d4008040 comp rx=0 tx=0).stop 2024-04-26T23:41:32.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.378+0000 7f82ee400640 1 -- 172.21.15.137:0/945496954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82e8141700 msgr2=0x7f82e80ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.378+0000 7f82ee400640 1 --2- 172.21.15.137:0/945496954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82e8141700 0x7f82e80ce3a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f82e000caa0 tx=0x7f82e000cf60 comp rx=0 tx=0).stop 2024-04-26T23:41:32.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.378+0000 7f82ee400640 1 -- 172.21.15.137:0/945496954 shutdown_connections 2024-04-26T23:41:32.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.378+0000 7f82ee400640 1 --2- 172.21.15.137:0/945496954 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f82c80797a0 0x7f82c807bc60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.378+0000 7f82ee400640 1 --2- 172.21.15.137:0/945496954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82e8141700 0x7f82e80ce3a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.378+0000 7f82ee400640 1 --2- 172.21.15.137:0/945496954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82e815c050 0x7f82e80ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.378+0000 7f82ee400640 1 --2- 172.21.15.137:0/945496954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82e806efc0 0x7f82e8152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.378+0000 7f82ee400640 1 -- 172.21.15.137:0/945496954 >> 172.21.15.137:0/945496954 conn(0x7f82e80b27c0 msgr2=0x7f82e8072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:32.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.378+0000 7f82ee400640 1 -- 172.21.15.137:0/945496954 shutdown_connections 2024-04-26T23:41:32.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.378+0000 7f82ee400640 1 -- 172.21.15.137:0/945496954 wait complete. 2024-04-26T23:41:32.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.4 2024-04-26T23:41:32.418 DEBUG:teuthology.parallel:result is None 2024-04-26T23:41:32.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.438+0000 7f1e0e000640 1 -- 172.21.15.137:0/1839568472 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1e0806a410 con 0x7f1e080d2c00 2024-04-26T23:41:32.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.446+0000 7f1e04c00640 1 -- 172.21.15.137:0/1839568472 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1e00056b00 con 0x7f1e080d2c00 2024-04-26T23:41:32.451 INFO:teuthology.orchestra.run.smithi137.stdout:55834574854 2024-04-26T23:41:32.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.446+0000 7f1e0e000640 1 -- 172.21.15.137:0/1839568472 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1de8068450 msgr2=0x7f1de806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.446+0000 7f1e0e000640 1 --2- 172.21.15.137:0/1839568472 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1de8068450 0x7f1de806a910 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1e0816d250 tx=0x7f1df4009040 comp rx=0 tx=0).stop 2024-04-26T23:41:32.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.446+0000 7f1e0e000640 1 -- 172.21.15.137:0/1839568472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e080d2c00 msgr2=0x7f1e081601e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.446+0000 7f1e0e000640 1 --2- 172.21.15.137:0/1839568472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e080d2c00 0x7f1e081601e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1e00007f20 tx=0x7f1e0000d560 comp rx=0 tx=0).stop 2024-04-26T23:41:32.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.446+0000 7f1e0e000640 1 -- 172.21.15.137:0/1839568472 shutdown_connections 2024-04-26T23:41:32.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.446+0000 7f1e0e000640 1 --2- 172.21.15.137:0/1839568472 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1de8068450 0x7f1de806a910 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.446+0000 7f1e0e000640 1 --2- 172.21.15.137:0/1839568472 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e0815cf50 0x7f1e080b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.446+0000 7f1e0e000640 1 --2- 172.21.15.137:0/1839568472 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e08159730 0x7f1e080c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.446+0000 7f1e0e000640 1 --2- 172.21.15.137:0/1839568472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e080d2c00 0x7f1e081601e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.446+0000 7f1e0e000640 1 -- 172.21.15.137:0/1839568472 >> 172.21.15.137:0/1839568472 conn(0x7f1e0809ba60 msgr2=0x7f1e080cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:32.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.450+0000 7f1e0e000640 1 -- 172.21.15.137:0/1839568472 shutdown_connections 2024-04-26T23:41:32.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.450+0000 7f1e0e000640 1 -- 172.21.15.137:0/1839568472 wait complete. 2024-04-26T23:41:32.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.450+0000 7f9003200640 1 -- 172.21.15.137:0/1008439716 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8ffc0b55a0 con 0x7f8ffc0b60f0 2024-04-26T23:41:32.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.450+0000 7f8ff3e00640 1 -- 172.21.15.137:0/1008439716 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8fec05a840 con 0x7f8ffc0b60f0 2024-04-26T23:41:32.456 INFO:teuthology.orchestra.run.smithi137.stdout:55834574855 2024-04-26T23:41:32.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.454+0000 7f9003200640 1 -- 172.21.15.137:0/1008439716 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8fdc068380 msgr2=0x7f8fdc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.454+0000 7f9003200640 1 --2- 172.21.15.137:0/1008439716 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8fdc068380 0x7f8fdc06a840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80ad000 tx=0x7f8fe80a6000 comp rx=0 tx=0).stop 2024-04-26T23:41:32.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.454+0000 7f9003200640 1 -- 172.21.15.137:0/1008439716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ffc0b60f0 msgr2=0x7f8ffc15bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.454+0000 7f9003200640 1 --2- 172.21.15.137:0/1008439716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ffc0b60f0 0x7f8ffc15bef0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00c450 tx=0x7f8fec00c910 comp rx=0 tx=0).stop 2024-04-26T23:41:32.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.454+0000 7f9003200640 1 -- 172.21.15.137:0/1008439716 shutdown_connections 2024-04-26T23:41:32.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.454+0000 7f9003200640 1 --2- 172.21.15.137:0/1008439716 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8fdc068380 0x7f8fdc06a840 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.454+0000 7f9003200640 1 --2- 172.21.15.137:0/1008439716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ffc163670 0x7f8ffc165880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.454+0000 7f9003200640 1 --2- 172.21.15.137:0/1008439716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ffc0b60f0 0x7f8ffc15bef0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.454+0000 7f9003200640 1 --2- 172.21.15.137:0/1008439716 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc0b40e0 0x7f8ffc161180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.454+0000 7f9003200640 1 -- 172.21.15.137:0/1008439716 >> 172.21.15.137:0/1008439716 conn(0x7f8ffc072b00 msgr2=0x7f8ffc0b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:32.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.454+0000 7f9003200640 1 -- 172.21.15.137:0/1008439716 shutdown_connections 2024-04-26T23:41:32.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.454+0000 7f9003200640 1 -- 172.21.15.137:0/1008439716 wait complete. 2024-04-26T23:41:32.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.462+0000 7f6251a00640 1 -- 172.21.15.137:0/249380586 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f624c068e00 con 0x7f624c0b09a0 2024-04-26T23:41:32.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.462+0000 7f6243e00640 1 -- 172.21.15.137:0/249380586 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f623c059f40 con 0x7f624c0b09a0 2024-04-26T23:41:32.468 INFO:teuthology.orchestra.run.smithi137.stdout:55834574856 2024-04-26T23:41:32.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.462+0000 7f6251a00640 1 -- 172.21.15.137:0/249380586 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6228068480 msgr2=0x7f622806a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.462+0000 7f6251a00640 1 --2- 172.21.15.137:0/249380586 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6228068480 0x7f622806a940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f62340ad000 tx=0x7f6234008040 comp rx=0 tx=0).stop 2024-04-26T23:41:32.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.462+0000 7f6251a00640 1 -- 172.21.15.137:0/249380586 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f624c0b09a0 msgr2=0x7f624c1ffe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.462+0000 7f6251a00640 1 --2- 172.21.15.137:0/249380586 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f624c0b09a0 0x7f624c1ffe20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f623c007fd0 tx=0x7f623c00c890 comp rx=0 tx=0).stop 2024-04-26T23:41:32.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.462+0000 7f6251a00640 1 -- 172.21.15.137:0/249380586 shutdown_connections 2024-04-26T23:41:32.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.462+0000 7f6251a00640 1 --2- 172.21.15.137:0/249380586 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6228068480 0x7f622806a940 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.462+0000 7f6251a00640 1 --2- 172.21.15.137:0/249380586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f624c153d40 0x7f624c1fbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.466+0000 7f6251a00640 1 --2- 172.21.15.137:0/249380586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f624c0b37c0 0x7f624c15c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.466+0000 7f6251a00640 1 --2- 172.21.15.137:0/249380586 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f624c0b09a0 0x7f624c1ffe20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.466+0000 7f6251a00640 1 -- 172.21.15.137:0/249380586 >> 172.21.15.137:0/249380586 conn(0x7f624c075750 msgr2=0x7f624c14c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:32.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.466+0000 7f6251a00640 1 -- 172.21.15.137:0/249380586 shutdown_connections 2024-04-26T23:41:32.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.466+0000 7f6251a00640 1 -- 172.21.15.137:0/249380586 wait complete. 2024-04-26T23:41:32.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.470+0000 7f9b38600640 1 -- 172.21.15.137:0/1310540319 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9b0c005590 con 0x7f9b3015c050 2024-04-26T23:41:32.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.470+0000 7fd6bd400640 1 -- 172.21.15.137:0/2198657261 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd690005860 con 0x7fd6b8141b30 2024-04-26T23:41:32.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.470+0000 7f9b2d600640 1 -- 172.21.15.137:0/1310540319 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9b1c0f0930 con 0x7f9b3015c050 2024-04-26T23:41:32.478 INFO:teuthology.orchestra.run.smithi137.stdout:55834574855 2024-04-26T23:41:32.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7fd6aea00640 1 -- 172.21.15.137:0/2198657261 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd6a8057780 con 0x7fd6b8141b30 2024-04-26T23:41:32.479 INFO:teuthology.orchestra.run.smithi137.stdout:55834574855 2024-04-26T23:41:32.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7f0cc7600640 1 -- 172.21.15.137:0/4105537868 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0c98005860 con 0x7f0cc015ff20 2024-04-26T23:41:32.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7f0cbcc00640 1 -- 172.21.15.137:0/4105537868 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0cb8056e20 con 0x7f0cc015ff20 2024-04-26T23:41:32.481 INFO:teuthology.orchestra.run.smithi137.stdout:55834574855 2024-04-26T23:41:32.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7f9b38600640 1 -- 172.21.15.137:0/1310540319 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b10068380 msgr2=0x7f9b1006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7f9b38600640 1 --2- 172.21.15.137:0/1310540319 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b10068380 0x7f9b1006a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9b2800f570 tx=0x7f9b28011040 comp rx=0 tx=0).stop 2024-04-26T23:41:32.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7f9b38600640 1 -- 172.21.15.137:0/1310540319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b3015c050 msgr2=0x7f9b30146360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7f9b38600640 1 --2- 172.21.15.137:0/1310540319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b3015c050 0x7f9b30146360 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9b300b5260 tx=0x7f9b1c01a290 comp rx=0 tx=0).stop 2024-04-26T23:41:32.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7f9b38600640 1 -- 172.21.15.137:0/1310540319 shutdown_connections 2024-04-26T23:41:32.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7f9b38600640 1 --2- 172.21.15.137:0/1310540319 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b10068380 0x7f9b1006a840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7f9b38600640 1 --2- 172.21.15.137:0/1310540319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b3015c050 0x7f9b30146360 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7f9b38600640 1 --2- 172.21.15.137:0/1310540319 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b30141700 0x7f9b3013e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7f9b38600640 1 --2- 172.21.15.137:0/1310540319 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b3006efc0 0x7f9b301394c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7f9b38600640 1 -- 172.21.15.137:0/1310540319 >> 172.21.15.137:0/1310540319 conn(0x7f9b300b27c0 msgr2=0x7f9b30154a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:32.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7fd6bd400640 1 -- 172.21.15.137:0/2198657261 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd698068450 msgr2=0x7fd69806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7fd6bd400640 1 --2- 172.21.15.137:0/2198657261 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd698068450 0x7fd69806a910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4001060 tx=0x7fd6a4009040 comp rx=0 tx=0).stop 2024-04-26T23:41:32.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7fd6bd400640 1 -- 172.21.15.137:0/2198657261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6b8141b30 msgr2=0x7fd6b8141fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7fd6bd400640 1 --2- 172.21.15.137:0/2198657261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6b8141b30 0x7fd6b8141fb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800c3c0 tx=0x7fd6a800c880 comp rx=0 tx=0).stop 2024-04-26T23:41:32.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7fd6bd400640 1 -- 172.21.15.137:0/2198657261 shutdown_connections 2024-04-26T23:41:32.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7fd6bd400640 1 --2- 172.21.15.137:0/2198657261 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd698068450 0x7fd69806a910 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7fd6bd400640 1 --2- 172.21.15.137:0/2198657261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6b8141b30 0x7fd6b8141fb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7fd6bd400640 1 --2- 172.21.15.137:0/2198657261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6b8142ab0 0x7fd6b8142f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7fd6bd400640 1 --2- 172.21.15.137:0/2198657261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd69c005220 0x7fd6b815c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.474+0000 7fd6bd400640 1 -- 172.21.15.137:0/2198657261 >> 172.21.15.137:0/2198657261 conn(0x7fd6b806c5d0 msgr2=0x7fd6b8145fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:32.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.478+0000 7fd6bd400640 1 -- 172.21.15.137:0/2198657261 shutdown_connections 2024-04-26T23:41:32.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.478+0000 7f9b38600640 1 -- 172.21.15.137:0/1310540319 shutdown_connections 2024-04-26T23:41:32.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.478+0000 7f9b38600640 1 -- 172.21.15.137:0/1310540319 wait complete. 2024-04-26T23:41:32.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.478+0000 7fd6bd400640 1 -- 172.21.15.137:0/2198657261 wait complete. 2024-04-26T23:41:32.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.478+0000 7f0cc7600640 1 -- 172.21.15.137:0/4105537868 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0ca0068450 msgr2=0x7f0ca006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.478+0000 7f0cc7600640 1 --2- 172.21.15.137:0/4105537868 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0ca0068450 0x7f0ca006a910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0cb001c570 tx=0x7f0cb00a7000 comp rx=0 tx=0).stop 2024-04-26T23:41:32.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.478+0000 7f0cc7600640 1 -- 172.21.15.137:0/4105537868 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc015ff20 msgr2=0x7f0cc00ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.478+0000 7f0cc7600640 1 --2- 172.21.15.137:0/4105537868 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc015ff20 0x7f0cc00ce510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800be20 tx=0x7f0cb8009f70 comp rx=0 tx=0).stop 2024-04-26T23:41:32.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.478+0000 7f0cc7600640 1 -- 172.21.15.137:0/4105537868 shutdown_connections 2024-04-26T23:41:32.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.478+0000 7f0cc7600640 1 --2- 172.21.15.137:0/4105537868 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0ca0068450 0x7f0ca006a910 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.478+0000 7f0cc7600640 1 --2- 172.21.15.137:0/4105537868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0cc01638b0 0x7f0cc013fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.478+0000 7f0cc7600640 1 --2- 172.21.15.137:0/4105537868 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc015ff20 0x7f0cc00ce510 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.478+0000 7f0cc7600640 1 --2- 172.21.15.137:0/4105537868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cc00b4ea0 0x7f0cc015e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.478+0000 7f0cc7600640 1 -- 172.21.15.137:0/4105537868 >> 172.21.15.137:0/4105537868 conn(0x7f0cc00b2a90 msgr2=0x7f0cc006e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:32.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.478+0000 7f0cc7600640 1 -- 172.21.15.137:0/4105537868 shutdown_connections 2024-04-26T23:41:32.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.478+0000 7f0cc7600640 1 -- 172.21.15.137:0/4105537868 wait complete. 2024-04-26T23:41:32.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.478+0000 7ff6fe400640 1 -- 172.21.15.137:0/127627131 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff6f004e0c0 con 0x7ff6f0006460 2024-04-26T23:41:32.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.482+0000 7ff6f4c00640 1 -- 172.21.15.137:0/127627131 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff6ec05a280 con 0x7ff6f0006460 2024-04-26T23:41:32.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.2 2024-04-26T23:41:32.487 INFO:teuthology.orchestra.run.smithi137.stdout:55834574856 2024-04-26T23:41:32.488 DEBUG:teuthology.parallel:result is None 2024-04-26T23:41:32.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.486+0000 7ff6fe400640 1 -- 172.21.15.137:0/127627131 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff6d80683d0 msgr2=0x7ff6d806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.486+0000 7ff6fe400640 1 --2- 172.21.15.137:0/127627131 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff6d80683d0 0x7ff6d806a890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff6e40ad000 tx=0x7ff6e4008040 comp rx=0 tx=0).stop 2024-04-26T23:41:32.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.486+0000 7ff6fe400640 1 -- 172.21.15.137:0/127627131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6f0006460 msgr2=0x7ff6f00ddb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.486+0000 7ff6fe400640 1 --2- 172.21.15.137:0/127627131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6f0006460 0x7ff6f00ddb70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00c750 tx=0x7ff6ec00cc10 comp rx=0 tx=0).stop 2024-04-26T23:41:32.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.486+0000 7ff6fe400640 1 -- 172.21.15.137:0/127627131 shutdown_connections 2024-04-26T23:41:32.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.486+0000 7ff6fe400640 1 --2- 172.21.15.137:0/127627131 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff6d80683d0 0x7ff6d806a890 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.486+0000 7ff6fe400640 1 --2- 172.21.15.137:0/127627131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6f00e7560 0x7ff6f00def30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.486+0000 7ff6fe400640 1 --2- 172.21.15.137:0/127627131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6f0054450 0x7ff6f00e07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.486+0000 7ff6fe400640 1 --2- 172.21.15.137:0/127627131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6f0006460 0x7ff6f00ddb70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.486+0000 7ff6fe400640 1 -- 172.21.15.137:0/127627131 >> 172.21.15.137:0/127627131 conn(0x7ff6f0009fc0 msgr2=0x7ff6f004e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:32.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.486+0000 7ff6fe400640 1 -- 172.21.15.137:0/127627131 shutdown_connections 2024-04-26T23:41:32.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.486+0000 7ff6fe400640 1 -- 172.21.15.137:0/127627131 wait complete. 2024-04-26T23:41:32.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.3 2024-04-26T23:41:32.497 DEBUG:teuthology.parallel:result is None 2024-04-26T23:41:32.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.6 2024-04-26T23:41:32.513 DEBUG:teuthology.parallel:result is None 2024-04-26T23:41:32.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.7 2024-04-26T23:41:32.515 DEBUG:teuthology.parallel:result is None 2024-04-26T23:41:32.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.1 2024-04-26T23:41:32.521 DEBUG:teuthology.parallel:result is None 2024-04-26T23:41:32.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.0 2024-04-26T23:41:32.525 DEBUG:teuthology.parallel:result is None 2024-04-26T23:41:32.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.5 2024-04-26T23:41:32.528 DEBUG:teuthology.parallel:result is None 2024-04-26T23:41:32.528 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T23:41:32.529 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:41:32.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.702+0000 7f6705e00640 1 Processor -- start 2024-04-26T23:41:32.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.702+0000 7f6705e00640 1 -- start start 2024-04-26T23:41:32.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.702+0000 7f6705e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f67000725a0 0x7f67000cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.702+0000 7f6705e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67000cfef0 con 0x7f67000b5080 2024-04-26T23:41:32.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.702+0000 7f6705e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67000cddc0 con 0x7f6700073f30 2024-04-26T23:41:32.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.702+0000 7f6705e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f67000d01b0 con 0x7f67000725a0 2024-04-26T23:41:32.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.706+0000 7f66ff400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f67000b5080 0x7f6700165930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42948/0 (socket says 172.21.15.137:42948) 2024-04-26T23:41:32.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.706+0000 7f66ff400640 1 -- 172.21.15.137:0/1790987268 learned_addr learned my addr 172.21.15.137:0/1790987268 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:32.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.706+0000 7f66fea00640 1 --2- 172.21.15.137:0/1790987268 >> v2:172.21.15.137:3300/0 conn(0x7f67000725a0 0x7f67000cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.706+0000 7f66fea00640 1 -- 172.21.15.137:0/1790987268 >> v1:172.21.15.170:6789/0 conn(0x7f6700073f30 legacy=0x7f6700072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:32.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.706+0000 7f66fea00640 1 -- 172.21.15.137:0/1790987268 >> v1:172.21.15.137:6789/0 conn(0x7f67000b5080 legacy=0x7f6700165930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.706+0000 7f66fea00640 1 -- 172.21.15.137:0/1790987268 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67000d0490 con 0x7f67000725a0 2024-04-26T23:41:32.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.706+0000 7f66fea00640 1 --2- 172.21.15.137:0/1790987268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67000725a0 0x7f67000cd770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009d90 tx=0x7f66f001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d39ded06ff43ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.706+0000 7f66fd600640 1 -- 172.21.15.137:0/1790987268 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f00b2070 con 0x7f67000725a0 2024-04-26T23:41:32.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.706+0000 7f66fd600640 1 -- 172.21.15.137:0/1790987268 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f00a57d0 con 0x7f67000725a0 2024-04-26T23:41:32.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.706+0000 7f66fd600640 1 -- 172.21.15.137:0/1790987268 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f00a5ba0 con 0x7f67000725a0 2024-04-26T23:41:32.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f6705e00640 1 -- 172.21.15.137:0/1790987268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67000725a0 msgr2=0x7f67000cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f6705e00640 1 --2- 172.21.15.137:0/1790987268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67000725a0 0x7f67000cd770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009d90 tx=0x7f66f001c900 comp rx=0 tx=0).stop 2024-04-26T23:41:32.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f6705e00640 1 -- 172.21.15.137:0/1790987268 shutdown_connections 2024-04-26T23:41:32.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f6705e00640 1 --2- 172.21.15.137:0/1790987268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67000725a0 0x7f67000cd770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f6705e00640 1 -- 172.21.15.137:0/1790987268 >> 172.21.15.137:0/1790987268 conn(0x7f670006c5d0 msgr2=0x7f670006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:32.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f6705e00640 1 -- 172.21.15.137:0/1790987268 shutdown_connections 2024-04-26T23:41:32.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f6705e00640 1 -- 172.21.15.137:0/1790987268 wait complete. 2024-04-26T23:41:32.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f6705e00640 1 Processor -- start 2024-04-26T23:41:32.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f6705e00640 1 -- start start 2024-04-26T23:41:32.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f6705e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67000725a0 0x7f67000aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f6705e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6700073f30 0x7f67000acf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f6705e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67000b5080 0x7f670013e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f6705e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f670006f970 con 0x7f67000725a0 2024-04-26T23:41:32.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f6705e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f670006f7f0 con 0x7f6700073f30 2024-04-26T23:41:32.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f6705e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f670006faf0 con 0x7f67000b5080 2024-04-26T23:41:32.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f66fea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67000725a0 0x7f67000aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f66fea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67000725a0 0x7f67000aa4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43050/0 (socket says 172.21.15.137:43050) 2024-04-26T23:41:32.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f66fea00640 1 -- 172.21.15.137:0/848481680 learned_addr learned my addr 172.21.15.137:0/848481680 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:32.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f66fe000640 1 --2- 172.21.15.137:0/848481680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6700073f30 0x7f67000acf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f66ff400640 1 --2- 172.21.15.137:0/848481680 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67000b5080 0x7f670013e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f66fea00640 1 -- 172.21.15.137:0/848481680 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67000b5080 msgr2=0x7f670013e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f66fea00640 1 --2- 172.21.15.137:0/848481680 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67000b5080 0x7f670013e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f66fea00640 1 -- 172.21.15.137:0/848481680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6700073f30 msgr2=0x7f67000acf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f66fea00640 1 --2- 172.21.15.137:0/848481680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6700073f30 0x7f67000acf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f66fea00640 1 -- 172.21.15.137:0/848481680 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67000aaac0 con 0x7f67000725a0 2024-04-26T23:41:32.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.710+0000 7f66fea00640 1 --2- 172.21.15.137:0/848481680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67000725a0 0x7f67000aa4c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f66f0019510 tx=0x7f66f00196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.714+0000 7f66f7400640 1 -- 172.21.15.137:0/848481680 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f00b2040 con 0x7f67000725a0 2024-04-26T23:41:32.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.714+0000 7f66f7400640 1 -- 172.21.15.137:0/848481680 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f00bf070 con 0x7f67000725a0 2024-04-26T23:41:32.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.714+0000 7f66f7400640 1 -- 172.21.15.137:0/848481680 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f00b8890 con 0x7f67000725a0 2024-04-26T23:41:32.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.714+0000 7f6705e00640 1 -- 172.21.15.137:0/848481680 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67000aada0 con 0x7f67000725a0 2024-04-26T23:41:32.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.714+0000 7f6705e00640 1 -- 172.21.15.137:0/848481680 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67000ab360 con 0x7f67000725a0 2024-04-26T23:41:32.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.714+0000 7f6705e00640 1 -- 172.21.15.137:0/848481680 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f670006a4b0 con 0x7f67000725a0 2024-04-26T23:41:32.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.714+0000 7f66f7400640 1 -- 172.21.15.137:0/848481680 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f66f00b8a30 con 0x7f67000725a0 2024-04-26T23:41:32.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.714+0000 7f66f7400640 1 --2- 172.21.15.137:0/848481680 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66e0068380 0x7f66e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:32.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.718+0000 7f66f7400640 1 -- 172.21.15.137:0/848481680 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f66f0121b50 con 0x7f67000725a0 2024-04-26T23:41:32.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.718+0000 7f66fe000640 1 --2- 172.21.15.137:0/848481680 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66e0068380 0x7f66e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:32.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.718+0000 7f66fe000640 1 --2- 172.21.15.137:0/848481680 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66e0068380 0x7f66e006a840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6700143140 tx=0x7f66ec008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:32.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.722+0000 7f66f7400640 1 -- 172.21.15.137:0/848481680 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f66f0016520 con 0x7f67000725a0 2024-04-26T23:41:32.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.874+0000 7f6705e00640 1 -- 172.21.15.137:0/848481680 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6700072380 con 0x7f66e0068380 2024-04-26T23:41:32.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.878+0000 7f66f7400640 1 -- 172.21.15.137:0/848481680 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f6700072380 con 0x7f66e0068380 2024-04-26T23:41:32.887 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:32.889 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T23:41:32.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.882+0000 7f6705e00640 1 -- 172.21.15.137:0/848481680 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66e0068380 msgr2=0x7f66e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.882+0000 7f6705e00640 1 --2- 172.21.15.137:0/848481680 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66e0068380 0x7f66e006a840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6700143140 tx=0x7f66ec008040 comp rx=0 tx=0).stop 2024-04-26T23:41:32.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.882+0000 7f6705e00640 1 -- 172.21.15.137:0/848481680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67000725a0 msgr2=0x7f67000aa4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:32.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.882+0000 7f6705e00640 1 --2- 172.21.15.137:0/848481680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67000725a0 0x7f67000aa4c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f66f0019510 tx=0x7f66f00196a0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.882+0000 7f6705e00640 1 -- 172.21.15.137:0/848481680 shutdown_connections 2024-04-26T23:41:32.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.882+0000 7f6705e00640 1 --2- 172.21.15.137:0/848481680 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66e0068380 0x7f66e006a840 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.882+0000 7f6705e00640 1 --2- 172.21.15.137:0/848481680 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67000b5080 0x7f670013e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.882+0000 7f6705e00640 1 --2- 172.21.15.137:0/848481680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6700073f30 0x7f67000acf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.882+0000 7f6705e00640 1 --2- 172.21.15.137:0/848481680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67000725a0 0x7f67000aa4c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:32.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.882+0000 7f6705e00640 1 -- 172.21.15.137:0/848481680 >> 172.21.15.137:0/848481680 conn(0x7f670006c5d0 msgr2=0x7f67001436e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:32.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.882+0000 7f6705e00640 1 -- 172.21.15.137:0/848481680 shutdown_connections 2024-04-26T23:41:32.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:32.882+0000 7f6705e00640 1 -- 172.21.15.137:0/848481680 wait complete. 2024-04-26T23:41:32.908 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-26T23:41:31.590847+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235652,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739068,"statfs":{"total":773094113280,"available":772852805632,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001779"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565979+0000","last_change":"2024-04-26T23:41:24.226081+0000","last_active":"2024-04-26T23:41:26.565979+0000","last_peered":"2024-04-26T23:41:26.565979+0000","last_clean":"2024-04-26T23:41:26.565979+0000","last_became_active":"2024-04-26T23:41:24.224081+0000","last_became_peered":"2024-04-26T23:41:24.224081+0000","last_unstale":"2024-04-26T23:41:26.565979+0000","last_undegraded":"2024-04-26T23:41:26.565979+0000","last_fullsized":"2024-04-26T23:41:26.565979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:28.775250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192782+0000","last_change":"2024-04-26T23:41:24.215201+0000","last_active":"2024-04-26T23:41:25.192782+0000","last_peered":"2024-04-26T23:41:25.192782+0000","last_clean":"2024-04-26T23:41:25.192782+0000","last_became_active":"2024-04-26T23:41:24.214743+0000","last_became_peered":"2024-04-26T23:41:24.214743+0000","last_unstale":"2024-04-26T23:41:25.192782+0000","last_undegraded":"2024-04-26T23:41:25.192782+0000","last_fullsized":"2024-04-26T23:41:25.192782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:44.639875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983493+0000","last_change":"2024-04-26T23:41:24.213419+0000","last_active":"2024-04-26T23:41:25.983493+0000","last_peered":"2024-04-26T23:41:25.983493+0000","last_clean":"2024-04-26T23:41:25.983493+0000","last_became_active":"2024-04-26T23:41:24.213156+0000","last_became_peered":"2024-04-26T23:41:24.213156+0000","last_unstale":"2024-04-26T23:41:25.983493+0000","last_undegraded":"2024-04-26T23:41:25.983493+0000","last_fullsized":"2024-04-26T23:41:25.983493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:24.389021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190322+0000","last_change":"2024-04-26T23:41:24.210450+0000","last_active":"2024-04-26T23:41:25.190322+0000","last_peered":"2024-04-26T23:41:25.190322+0000","last_clean":"2024-04-26T23:41:25.190322+0000","last_became_active":"2024-04-26T23:41:24.209075+0000","last_became_peered":"2024-04-26T23:41:24.209075+0000","last_unstale":"2024-04-26T23:41:25.190322+0000","last_undegraded":"2024-04-26T23:41:25.190322+0000","last_fullsized":"2024-04-26T23:41:25.190322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:22:11.814233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565434+0000","last_change":"2024-04-26T23:41:24.218615+0000","last_active":"2024-04-26T23:41:26.565434+0000","last_peered":"2024-04-26T23:41:26.565434+0000","last_clean":"2024-04-26T23:41:26.565434+0000","last_became_active":"2024-04-26T23:41:24.207757+0000","last_became_peered":"2024-04-26T23:41:24.207757+0000","last_unstale":"2024-04-26T23:41:26.565434+0000","last_undegraded":"2024-04-26T23:41:26.565434+0000","last_fullsized":"2024-04-26T23:41:26.565434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:22:11.814233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190989+0000","last_change":"2024-04-26T23:41:24.215319+0000","last_active":"2024-04-26T23:41:25.190989+0000","last_peered":"2024-04-26T23:41:25.190989+0000","last_clean":"2024-04-26T23:41:25.190989+0000","last_became_active":"2024-04-26T23:41:24.214101+0000","last_became_peered":"2024-04-26T23:41:24.214101+0000","last_unstale":"2024-04-26T23:41:25.190989+0000","last_undegraded":"2024-04-26T23:41:25.190989+0000","last_fullsized":"2024-04-26T23:41:25.190989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:12.164234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565384+0000","last_change":"2024-04-26T23:41:24.218275+0000","last_active":"2024-04-26T23:41:26.565384+0000","last_peered":"2024-04-26T23:41:26.565384+0000","last_clean":"2024-04-26T23:41:26.565384+0000","last_became_active":"2024-04-26T23:41:24.217914+0000","last_became_peered":"2024-04-26T23:41:24.217914+0000","last_unstale":"2024-04-26T23:41:26.565384+0000","last_undegraded":"2024-04-26T23:41:26.565384+0000","last_fullsized":"2024-04-26T23:41:26.565384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:39:55.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597030+0000","last_change":"2024-04-26T23:41:24.217179+0000","last_active":"2024-04-26T23:41:25.597030+0000","last_peered":"2024-04-26T23:41:25.597030+0000","last_clean":"2024-04-26T23:41:25.597030+0000","last_became_active":"2024-04-26T23:41:24.215768+0000","last_became_peered":"2024-04-26T23:41:24.215768+0000","last_unstale":"2024-04-26T23:41:25.597030+0000","last_undegraded":"2024-04-26T23:41:25.597030+0000","last_fullsized":"2024-04-26T23:41:25.597030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:05:07.675269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.566032+0000","last_change":"2024-04-26T23:41:24.225884+0000","last_active":"2024-04-26T23:41:26.566032+0000","last_peered":"2024-04-26T23:41:26.566032+0000","last_clean":"2024-04-26T23:41:26.566032+0000","last_became_active":"2024-04-26T23:41:24.224023+0000","last_became_peered":"2024-04-26T23:41:24.224023+0000","last_unstale":"2024-04-26T23:41:26.566032+0000","last_undegraded":"2024-04-26T23:41:26.566032+0000","last_fullsized":"2024-04-26T23:41:26.566032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:57:21.438653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215198+0000","last_change":"2024-04-26T23:41:24.219022+0000","last_active":"2024-04-26T23:41:25.215198+0000","last_peered":"2024-04-26T23:41:25.215198+0000","last_clean":"2024-04-26T23:41:25.215198+0000","last_became_active":"2024-04-26T23:41:24.218769+0000","last_became_peered":"2024-04-26T23:41:24.218769+0000","last_unstale":"2024-04-26T23:41:25.215198+0000","last_undegraded":"2024-04-26T23:41:25.215198+0000","last_fullsized":"2024-04-26T23:41:25.215198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:21.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215175+0000","last_change":"2024-04-26T23:41:24.219493+0000","last_active":"2024-04-26T23:41:25.215175+0000","last_peered":"2024-04-26T23:41:25.215175+0000","last_clean":"2024-04-26T23:41:25.215175+0000","last_became_active":"2024-04-26T23:41:24.219227+0000","last_became_peered":"2024-04-26T23:41:24.219227+0000","last_unstale":"2024-04-26T23:41:25.215175+0000","last_undegraded":"2024-04-26T23:41:25.215175+0000","last_fullsized":"2024-04-26T23:41:25.215175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:44.639875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190908+0000","last_change":"2024-04-26T23:41:24.213018+0000","last_active":"2024-04-26T23:41:25.190908+0000","last_peered":"2024-04-26T23:41:25.190908+0000","last_clean":"2024-04-26T23:41:25.190908+0000","last_became_active":"2024-04-26T23:41:24.210261+0000","last_became_peered":"2024-04-26T23:41:24.210261+0000","last_unstale":"2024-04-26T23:41:25.190908+0000","last_undegraded":"2024-04-26T23:41:25.190908+0000","last_fullsized":"2024-04-26T23:41:25.190908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:25:35.815770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597367+0000","last_change":"2024-04-26T23:41:24.208860+0000","last_active":"2024-04-26T23:41:25.597367+0000","last_peered":"2024-04-26T23:41:25.597367+0000","last_clean":"2024-04-26T23:41:25.597367+0000","last_became_active":"2024-04-26T23:41:24.208537+0000","last_became_peered":"2024-04-26T23:41:24.208537+0000","last_unstale":"2024-04-26T23:41:25.597367+0000","last_undegraded":"2024-04-26T23:41:25.597367+0000","last_fullsized":"2024-04-26T23:41:25.597367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:49:27.834697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983307+0000","last_change":"2024-04-26T23:41:24.212959+0000","last_active":"2024-04-26T23:41:25.983307+0000","last_peered":"2024-04-26T23:41:25.983307+0000","last_clean":"2024-04-26T23:41:25.983307+0000","last_became_active":"2024-04-26T23:41:24.208009+0000","last_became_peered":"2024-04-26T23:41:24.208009+0000","last_unstale":"2024-04-26T23:41:25.983307+0000","last_undegraded":"2024-04-26T23:41:25.983307+0000","last_fullsized":"2024-04-26T23:41:25.983307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:18.779130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192382+0000","last_change":"2024-04-26T23:41:24.202794+0000","last_active":"2024-04-26T23:41:25.192382+0000","last_peered":"2024-04-26T23:41:25.192382+0000","last_clean":"2024-04-26T23:41:25.192382+0000","last_became_active":"2024-04-26T23:41:24.202484+0000","last_became_peered":"2024-04-26T23:41:24.202484+0000","last_unstale":"2024-04-26T23:41:25.192382+0000","last_undegraded":"2024-04-26T23:41:25.192382+0000","last_fullsized":"2024-04-26T23:41:25.192382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:36.344325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.189800+0000","last_change":"2024-04-26T23:41:24.209356+0000","last_active":"2024-04-26T23:41:25.189800+0000","last_peered":"2024-04-26T23:41:25.189800+0000","last_clean":"2024-04-26T23:41:25.189800+0000","last_became_active":"2024-04-26T23:41:24.208427+0000","last_became_peered":"2024-04-26T23:41:24.208427+0000","last_unstale":"2024-04-26T23:41:25.189800+0000","last_undegraded":"2024-04-26T23:41:25.189800+0000","last_fullsized":"2024-04-26T23:41:25.189800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:21.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191177+0000","last_change":"2024-04-26T23:41:24.209097+0000","last_active":"2024-04-26T23:41:25.191177+0000","last_peered":"2024-04-26T23:41:25.191177+0000","last_clean":"2024-04-26T23:41:25.191177+0000","last_became_active":"2024-04-26T23:41:24.208802+0000","last_became_peered":"2024-04-26T23:41:24.208802+0000","last_unstale":"2024-04-26T23:41:25.191177+0000","last_undegraded":"2024-04-26T23:41:25.191177+0000","last_fullsized":"2024-04-26T23:41:25.191177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:28.775250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.704637+0000","last_change":"2024-04-26T23:41:24.209948+0000","last_active":"2024-04-26T23:41:25.704637+0000","last_peered":"2024-04-26T23:41:25.704637+0000","last_clean":"2024-04-26T23:41:25.704637+0000","last_became_active":"2024-04-26T23:41:24.209643+0000","last_became_peered":"2024-04-26T23:41:24.209643+0000","last_unstale":"2024-04-26T23:41:25.704637+0000","last_undegraded":"2024-04-26T23:41:25.704637+0000","last_fullsized":"2024-04-26T23:41:25.704637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:49.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565891+0000","last_change":"2024-04-26T23:41:24.223030+0000","last_active":"2024-04-26T23:41:26.565891+0000","last_peered":"2024-04-26T23:41:26.565891+0000","last_clean":"2024-04-26T23:41:26.565891+0000","last_became_active":"2024-04-26T23:41:24.221662+0000","last_became_peered":"2024-04-26T23:41:24.221662+0000","last_unstale":"2024-04-26T23:41:26.565891+0000","last_undegraded":"2024-04-26T23:41:26.565891+0000","last_fullsized":"2024-04-26T23:41:26.565891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:12.164234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215142+0000","last_change":"2024-04-26T23:41:24.218402+0000","last_active":"2024-04-26T23:41:25.215142+0000","last_peered":"2024-04-26T23:41:25.215142+0000","last_clean":"2024-04-26T23:41:25.215142+0000","last_became_active":"2024-04-26T23:41:24.217441+0000","last_became_peered":"2024-04-26T23:41:24.217441+0000","last_unstale":"2024-04-26T23:41:25.215142+0000","last_undegraded":"2024-04-26T23:41:25.215142+0000","last_fullsized":"2024-04-26T23:41:25.215142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:49:27.834697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983491+0000","last_change":"2024-04-26T23:41:24.209698+0000","last_active":"2024-04-26T23:41:25.983491+0000","last_peered":"2024-04-26T23:41:25.983491+0000","last_clean":"2024-04-26T23:41:25.983491+0000","last_became_active":"2024-04-26T23:41:24.208252+0000","last_became_peered":"2024-04-26T23:41:24.208252+0000","last_unstale":"2024-04-26T23:41:25.983491+0000","last_undegraded":"2024-04-26T23:41:25.983491+0000","last_fullsized":"2024-04-26T23:41:25.983491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:36.344325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191156+0000","last_change":"2024-04-26T23:41:24.223785+0000","last_active":"2024-04-26T23:41:25.191156+0000","last_peered":"2024-04-26T23:41:25.191156+0000","last_clean":"2024-04-26T23:41:25.191156+0000","last_became_active":"2024-04-26T23:41:24.223547+0000","last_became_peered":"2024-04-26T23:41:24.223547+0000","last_unstale":"2024-04-26T23:41:25.191156+0000","last_undegraded":"2024-04-26T23:41:25.191156+0000","last_fullsized":"2024-04-26T23:41:25.191156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:15.741774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597131+0000","last_change":"2024-04-26T23:41:24.204428+0000","last_active":"2024-04-26T23:41:25.597131+0000","last_peered":"2024-04-26T23:41:25.597131+0000","last_clean":"2024-04-26T23:41:25.597131+0000","last_became_active":"2024-04-26T23:41:24.203845+0000","last_became_peered":"2024-04-26T23:41:24.203845+0000","last_unstale":"2024-04-26T23:41:25.597131+0000","last_undegraded":"2024-04-26T23:41:25.597131+0000","last_fullsized":"2024-04-26T23:41:25.597131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:36.344325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.189964+0000","last_change":"2024-04-26T23:41:24.201596+0000","last_active":"2024-04-26T23:41:25.189964+0000","last_peered":"2024-04-26T23:41:25.189964+0000","last_clean":"2024-04-26T23:41:25.189964+0000","last_became_active":"2024-04-26T23:41:24.201257+0000","last_became_peered":"2024-04-26T23:41:24.201257+0000","last_unstale":"2024-04-26T23:41:25.189964+0000","last_undegraded":"2024-04-26T23:41:25.189964+0000","last_fullsized":"2024-04-26T23:41:25.189964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:10.486440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597494+0000","last_change":"2024-04-26T23:41:24.213190+0000","last_active":"2024-04-26T23:41:25.597494+0000","last_peered":"2024-04-26T23:41:25.597494+0000","last_clean":"2024-04-26T23:41:25.597494+0000","last_became_active":"2024-04-26T23:41:24.212878+0000","last_became_peered":"2024-04-26T23:41:24.212878+0000","last_unstale":"2024-04-26T23:41:25.597494+0000","last_undegraded":"2024-04-26T23:41:25.597494+0000","last_fullsized":"2024-04-26T23:41:25.597494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:21.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215267+0000","last_change":"2024-04-26T23:41:24.222681+0000","last_active":"2024-04-26T23:41:25.215267+0000","last_peered":"2024-04-26T23:41:25.215267+0000","last_clean":"2024-04-26T23:41:25.215267+0000","last_became_active":"2024-04-26T23:41:24.222435+0000","last_became_peered":"2024-04-26T23:41:24.222435+0000","last_unstale":"2024-04-26T23:41:25.215267+0000","last_undegraded":"2024-04-26T23:41:25.215267+0000","last_fullsized":"2024-04-26T23:41:25.215267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:10.486440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192815+0000","last_change":"2024-04-26T23:41:24.207533+0000","last_active":"2024-04-26T23:41:25.192815+0000","last_peered":"2024-04-26T23:41:25.192815+0000","last_clean":"2024-04-26T23:41:25.192815+0000","last_became_active":"2024-04-26T23:41:24.207267+0000","last_became_peered":"2024-04-26T23:41:24.207267+0000","last_unstale":"2024-04-26T23:41:25.192815+0000","last_undegraded":"2024-04-26T23:41:25.192815+0000","last_fullsized":"2024-04-26T23:41:25.192815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:21.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597519+0000","last_change":"2024-04-26T23:41:24.216811+0000","last_active":"2024-04-26T23:41:25.597519+0000","last_peered":"2024-04-26T23:41:25.597519+0000","last_clean":"2024-04-26T23:41:25.597519+0000","last_became_active":"2024-04-26T23:41:24.216532+0000","last_became_peered":"2024-04-26T23:41:24.216532+0000","last_unstale":"2024-04-26T23:41:25.597519+0000","last_undegraded":"2024-04-26T23:41:25.597519+0000","last_fullsized":"2024-04-26T23:41:25.597519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:10.486440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983542+0000","last_change":"2024-04-26T23:41:24.201499+0000","last_active":"2024-04-26T23:41:25.983542+0000","last_peered":"2024-04-26T23:41:25.983542+0000","last_clean":"2024-04-26T23:41:25.983542+0000","last_became_active":"2024-04-26T23:41:24.201217+0000","last_became_peered":"2024-04-26T23:41:24.201217+0000","last_unstale":"2024-04-26T23:41:25.983542+0000","last_undegraded":"2024-04-26T23:41:25.983542+0000","last_fullsized":"2024-04-26T23:41:25.983542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:50.550871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191338+0000","last_change":"2024-04-26T23:41:24.215543+0000","last_active":"2024-04-26T23:41:25.191338+0000","last_peered":"2024-04-26T23:41:25.191338+0000","last_clean":"2024-04-26T23:41:25.191338+0000","last_became_active":"2024-04-26T23:41:24.214468+0000","last_became_peered":"2024-04-26T23:41:24.214468+0000","last_unstale":"2024-04-26T23:41:25.191338+0000","last_undegraded":"2024-04-26T23:41:25.191338+0000","last_fullsized":"2024-04-26T23:41:25.191338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:57:21.438653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.704495+0000","last_change":"2024-04-26T23:41:24.228988+0000","last_active":"2024-04-26T23:41:25.704495+0000","last_peered":"2024-04-26T23:41:25.704495+0000","last_clean":"2024-04-26T23:41:25.704495+0000","last_became_active":"2024-04-26T23:41:24.228753+0000","last_became_peered":"2024-04-26T23:41:24.228753+0000","last_unstale":"2024-04-26T23:41:25.704495+0000","last_undegraded":"2024-04-26T23:41:25.704495+0000","last_fullsized":"2024-04-26T23:41:25.704495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:25:35.815770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.214825+0000","last_change":"2024-04-26T23:41:24.213487+0000","last_active":"2024-04-26T23:41:25.214825+0000","last_peered":"2024-04-26T23:41:25.214825+0000","last_clean":"2024-04-26T23:41:25.214825+0000","last_became_active":"2024-04-26T23:41:24.212794+0000","last_became_peered":"2024-04-26T23:41:24.212794+0000","last_unstale":"2024-04-26T23:41:25.214825+0000","last_undegraded":"2024-04-26T23:41:25.214825+0000","last_fullsized":"2024-04-26T23:41:25.214825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:36.344325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190783+0000","last_change":"2024-04-26T23:41:24.202787+0000","last_active":"2024-04-26T23:41:25.190783+0000","last_peered":"2024-04-26T23:41:25.190783+0000","last_clean":"2024-04-26T23:41:25.190783+0000","last_became_active":"2024-04-26T23:41:24.202474+0000","last_became_peered":"2024-04-26T23:41:24.202474+0000","last_unstale":"2024-04-26T23:41:25.190783+0000","last_undegraded":"2024-04-26T23:41:25.190783+0000","last_fullsized":"2024-04-26T23:41:25.190783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:25.948379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597494+0000","last_change":"2024-04-26T23:41:23.211330+0000","last_active":"2024-04-26T23:41:25.597494+0000","last_peered":"2024-04-26T23:41:25.597494+0000","last_clean":"2024-04-26T23:41:25.597494+0000","last_became_active":"2024-04-26T23:41:23.210860+0000","last_became_peered":"2024-04-26T23:41:23.210860+0000","last_unstale":"2024-04-26T23:41:25.597494+0000","last_undegraded":"2024-04-26T23:41:25.597494+0000","last_fullsized":"2024-04-26T23:41:25.597494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:07.156356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983678+0000","last_change":"2024-04-26T23:41:24.212656+0000","last_active":"2024-04-26T23:41:25.983678+0000","last_peered":"2024-04-26T23:41:25.983678+0000","last_clean":"2024-04-26T23:41:25.983678+0000","last_became_active":"2024-04-26T23:41:24.208356+0000","last_became_peered":"2024-04-26T23:41:24.208356+0000","last_unstale":"2024-04-26T23:41:25.983678+0000","last_undegraded":"2024-04-26T23:41:25.983678+0000","last_fullsized":"2024-04-26T23:41:25.983678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:10.486440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.214878+0000","last_change":"2024-04-26T23:41:23.203211+0000","last_active":"2024-04-26T23:41:25.214878+0000","last_peered":"2024-04-26T23:41:25.214878+0000","last_clean":"2024-04-26T23:41:25.214878+0000","last_became_active":"2024-04-26T23:41:23.202884+0000","last_became_peered":"2024-04-26T23:41:23.202884+0000","last_unstale":"2024-04-26T23:41:25.214878+0000","last_undegraded":"2024-04-26T23:41:25.214878+0000","last_fullsized":"2024-04-26T23:41:25.214878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:38.962512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597235+0000","last_change":"2024-04-26T23:41:23.204160+0000","last_active":"2024-04-26T23:41:25.597235+0000","last_peered":"2024-04-26T23:41:25.597235+0000","last_clean":"2024-04-26T23:41:25.597235+0000","last_became_active":"2024-04-26T23:41:23.203160+0000","last_became_peered":"2024-04-26T23:41:23.203160+0000","last_unstale":"2024-04-26T23:41:25.597235+0000","last_undegraded":"2024-04-26T23:41:25.597235+0000","last_fullsized":"2024-04-26T23:41:25.597235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:07:31.445481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597143+0000","last_change":"2024-04-26T23:41:24.199055+0000","last_active":"2024-04-26T23:41:25.597143+0000","last_peered":"2024-04-26T23:41:25.597143+0000","last_clean":"2024-04-26T23:41:25.597143+0000","last_became_active":"2024-04-26T23:41:24.198722+0000","last_became_peered":"2024-04-26T23:41:24.198722+0000","last_unstale":"2024-04-26T23:41:25.597143+0000","last_undegraded":"2024-04-26T23:41:25.597143+0000","last_fullsized":"2024-04-26T23:41:25.597143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:24.389021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190075+0000","last_change":"2024-04-26T23:41:23.201562+0000","last_active":"2024-04-26T23:41:25.190075+0000","last_peered":"2024-04-26T23:41:25.190075+0000","last_clean":"2024-04-26T23:41:25.190075+0000","last_became_active":"2024-04-26T23:41:23.200676+0000","last_became_peered":"2024-04-26T23:41:23.200676+0000","last_unstale":"2024-04-26T23:41:25.190075+0000","last_undegraded":"2024-04-26T23:41:25.190075+0000","last_fullsized":"2024-04-26T23:41:25.190075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:24.942324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192584+0000","last_change":"2024-04-26T23:41:24.204813+0000","last_active":"2024-04-26T23:41:25.192584+0000","last_peered":"2024-04-26T23:41:25.192584+0000","last_clean":"2024-04-26T23:41:25.192584+0000","last_became_active":"2024-04-26T23:41:24.204553+0000","last_became_peered":"2024-04-26T23:41:24.204553+0000","last_unstale":"2024-04-26T23:41:25.192584+0000","last_undegraded":"2024-04-26T23:41:25.192584+0000","last_fullsized":"2024-04-26T23:41:25.192584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:49:27.834697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215042+0000","last_change":"2024-04-26T23:41:23.206952+0000","last_active":"2024-04-26T23:41:25.215042+0000","last_peered":"2024-04-26T23:41:25.215042+0000","last_clean":"2024-04-26T23:41:25.215042+0000","last_became_active":"2024-04-26T23:41:23.206577+0000","last_became_peered":"2024-04-26T23:41:23.206577+0000","last_unstale":"2024-04-26T23:41:25.215042+0000","last_undegraded":"2024-04-26T23:41:25.215042+0000","last_fullsized":"2024-04-26T23:41:25.215042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:56.090036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190165+0000","last_change":"2024-04-26T23:41:24.205876+0000","last_active":"2024-04-26T23:41:25.190165+0000","last_peered":"2024-04-26T23:41:25.190165+0000","last_clean":"2024-04-26T23:41:25.190165+0000","last_became_active":"2024-04-26T23:41:24.205566+0000","last_became_peered":"2024-04-26T23:41:24.205566+0000","last_unstale":"2024-04-26T23:41:25.190165+0000","last_undegraded":"2024-04-26T23:41:25.190165+0000","last_fullsized":"2024-04-26T23:41:25.190165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:39:55.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190265+0000","last_change":"2024-04-26T23:41:23.208519+0000","last_active":"2024-04-26T23:41:25.190265+0000","last_peered":"2024-04-26T23:41:25.190265+0000","last_clean":"2024-04-26T23:41:25.190265+0000","last_became_active":"2024-04-26T23:41:23.208271+0000","last_became_peered":"2024-04-26T23:41:23.208271+0000","last_unstale":"2024-04-26T23:41:25.190265+0000","last_undegraded":"2024-04-26T23:41:25.190265+0000","last_fullsized":"2024-04-26T23:41:25.190265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:38.962512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983677+0000","last_change":"2024-04-26T23:41:24.213954+0000","last_active":"2024-04-26T23:41:25.983677+0000","last_peered":"2024-04-26T23:41:25.983677+0000","last_clean":"2024-04-26T23:41:25.983677+0000","last_became_active":"2024-04-26T23:41:24.210823+0000","last_became_peered":"2024-04-26T23:41:24.210823+0000","last_unstale":"2024-04-26T23:41:25.983677+0000","last_undegraded":"2024-04-26T23:41:25.983677+0000","last_fullsized":"2024-04-26T23:41:25.983677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:21.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192815+0000","last_change":"2024-04-26T23:41:23.208525+0000","last_active":"2024-04-26T23:41:25.192815+0000","last_peered":"2024-04-26T23:41:25.192815+0000","last_clean":"2024-04-26T23:41:25.192815+0000","last_became_active":"2024-04-26T23:41:23.208296+0000","last_became_peered":"2024-04-26T23:41:23.208296+0000","last_unstale":"2024-04-26T23:41:25.192815+0000","last_undegraded":"2024-04-26T23:41:25.192815+0000","last_fullsized":"2024-04-26T23:41:25.192815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:56.090036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191122+0000","last_change":"2024-04-26T23:41:24.214223+0000","last_active":"2024-04-26T23:41:25.191122+0000","last_peered":"2024-04-26T23:41:25.191122+0000","last_clean":"2024-04-26T23:41:25.191122+0000","last_became_active":"2024-04-26T23:41:24.212904+0000","last_became_peered":"2024-04-26T23:41:24.212904+0000","last_unstale":"2024-04-26T23:41:25.191122+0000","last_undegraded":"2024-04-26T23:41:25.191122+0000","last_fullsized":"2024-04-26T23:41:25.191122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:49.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215122+0000","last_change":"2024-04-26T23:41:23.203321+0000","last_active":"2024-04-26T23:41:25.215122+0000","last_peered":"2024-04-26T23:41:25.215122+0000","last_clean":"2024-04-26T23:41:25.215122+0000","last_became_active":"2024-04-26T23:41:23.203033+0000","last_became_peered":"2024-04-26T23:41:23.203033+0000","last_unstale":"2024-04-26T23:41:25.215122+0000","last_undegraded":"2024-04-26T23:41:25.215122+0000","last_fullsized":"2024-04-26T23:41:25.215122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.316812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565538+0000","last_change":"2024-04-26T23:41:24.206337+0000","last_active":"2024-04-26T23:41:26.565538+0000","last_peered":"2024-04-26T23:41:26.565538+0000","last_clean":"2024-04-26T23:41:26.565538+0000","last_became_active":"2024-04-26T23:41:24.206071+0000","last_became_peered":"2024-04-26T23:41:24.206071+0000","last_unstale":"2024-04-26T23:41:26.565538+0000","last_undegraded":"2024-04-26T23:41:26.565538+0000","last_fullsized":"2024-04-26T23:41:26.565538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:22.105178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983690+0000","last_change":"2024-04-26T23:41:23.209289+0000","last_active":"2024-04-26T23:41:25.983690+0000","last_peered":"2024-04-26T23:41:25.983690+0000","last_clean":"2024-04-26T23:41:25.983690+0000","last_became_active":"2024-04-26T23:41:23.209014+0000","last_became_peered":"2024-04-26T23:41:23.209014+0000","last_unstale":"2024-04-26T23:41:25.983690+0000","last_undegraded":"2024-04-26T23:41:25.983690+0000","last_fullsized":"2024-04-26T23:41:25.983690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:03.988829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983375+0000","last_change":"2024-04-26T23:41:24.213072+0000","last_active":"2024-04-26T23:41:25.983375+0000","last_peered":"2024-04-26T23:41:25.983375+0000","last_clean":"2024-04-26T23:41:25.983375+0000","last_became_active":"2024-04-26T23:41:24.208424+0000","last_became_peered":"2024-04-26T23:41:24.208424+0000","last_unstale":"2024-04-26T23:41:25.983375+0000","last_undegraded":"2024-04-26T23:41:25.983375+0000","last_fullsized":"2024-04-26T23:41:25.983375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:05:07.675269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191349+0000","last_change":"2024-04-26T23:41:23.202871+0000","last_active":"2024-04-26T23:41:25.191349+0000","last_peered":"2024-04-26T23:41:25.191349+0000","last_clean":"2024-04-26T23:41:25.191349+0000","last_became_active":"2024-04-26T23:41:23.202591+0000","last_became_peered":"2024-04-26T23:41:23.202591+0000","last_unstale":"2024-04-26T23:41:25.191349+0000","last_undegraded":"2024-04-26T23:41:25.191349+0000","last_fullsized":"2024-04-26T23:41:25.191349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.316812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565547+0000","last_change":"2024-04-26T23:41:24.224407+0000","last_active":"2024-04-26T23:41:26.565547+0000","last_peered":"2024-04-26T23:41:26.565547+0000","last_clean":"2024-04-26T23:41:26.565547+0000","last_became_active":"2024-04-26T23:41:24.224097+0000","last_became_peered":"2024-04-26T23:41:24.224097+0000","last_unstale":"2024-04-26T23:41:26.565547+0000","last_undegraded":"2024-04-26T23:41:26.565547+0000","last_fullsized":"2024-04-26T23:41:26.565547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:16.493479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.214815+0000","last_change":"2024-04-26T23:41:23.207396+0000","last_active":"2024-04-26T23:41:25.214815+0000","last_peered":"2024-04-26T23:41:25.214815+0000","last_clean":"2024-04-26T23:41:25.214815+0000","last_became_active":"2024-04-26T23:41:23.207008+0000","last_became_peered":"2024-04-26T23:41:23.207008+0000","last_unstale":"2024-04-26T23:41:25.214815+0000","last_undegraded":"2024-04-26T23:41:25.214815+0000","last_fullsized":"2024-04-26T23:41:25.214815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:38.934659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.214836+0000","last_change":"2024-04-26T23:41:24.213631+0000","last_active":"2024-04-26T23:41:25.214836+0000","last_peered":"2024-04-26T23:41:25.214836+0000","last_clean":"2024-04-26T23:41:25.214836+0000","last_became_active":"2024-04-26T23:41:24.213186+0000","last_became_peered":"2024-04-26T23:41:24.213186+0000","last_unstale":"2024-04-26T23:41:25.214836+0000","last_undegraded":"2024-04-26T23:41:25.214836+0000","last_fullsized":"2024-04-26T23:41:25.214836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:24.389021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.704396+0000","last_change":"2024-04-26T23:41:23.201745+0000","last_active":"2024-04-26T23:41:25.704396+0000","last_peered":"2024-04-26T23:41:25.704396+0000","last_clean":"2024-04-26T23:41:25.704396+0000","last_became_active":"2024-04-26T23:41:23.200889+0000","last_became_peered":"2024-04-26T23:41:23.200889+0000","last_unstale":"2024-04-26T23:41:25.704396+0000","last_undegraded":"2024-04-26T23:41:25.704396+0000","last_fullsized":"2024-04-26T23:41:25.704396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:07.156356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565438+0000","last_change":"2024-04-26T23:41:24.222601+0000","last_active":"2024-04-26T23:41:26.565438+0000","last_peered":"2024-04-26T23:41:26.565438+0000","last_clean":"2024-04-26T23:41:26.565438+0000","last_became_active":"2024-04-26T23:41:24.222239+0000","last_became_peered":"2024-04-26T23:41:24.222239+0000","last_unstale":"2024-04-26T23:41:26.565438+0000","last_undegraded":"2024-04-26T23:41:26.565438+0000","last_fullsized":"2024-04-26T23:41:26.565438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:26.029165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191163+0000","last_change":"2024-04-26T23:41:23.200281+0000","last_active":"2024-04-26T23:41:25.191163+0000","last_peered":"2024-04-26T23:41:25.191163+0000","last_clean":"2024-04-26T23:41:25.191163+0000","last_became_active":"2024-04-26T23:41:23.199967+0000","last_became_peered":"2024-04-26T23:41:23.199967+0000","last_unstale":"2024-04-26T23:41:25.191163+0000","last_undegraded":"2024-04-26T23:41:25.191163+0000","last_fullsized":"2024-04-26T23:41:25.191163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:03.988829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565943+0000","last_change":"2024-04-26T23:41:24.216444+0000","last_active":"2024-04-26T23:41:26.565943+0000","last_peered":"2024-04-26T23:41:26.565943+0000","last_clean":"2024-04-26T23:41:26.565943+0000","last_became_active":"2024-04-26T23:41:24.216284+0000","last_became_peered":"2024-04-26T23:41:24.216284+0000","last_unstale":"2024-04-26T23:41:26.565943+0000","last_undegraded":"2024-04-26T23:41:26.565943+0000","last_fullsized":"2024-04-26T23:41:26.565943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:15.741774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.704598+0000","last_change":"2024-04-26T23:41:23.201500+0000","last_active":"2024-04-26T23:41:25.704598+0000","last_peered":"2024-04-26T23:41:25.704598+0000","last_clean":"2024-04-26T23:41:25.704598+0000","last_became_active":"2024-04-26T23:41:23.200957+0000","last_became_peered":"2024-04-26T23:41:23.200957+0000","last_unstale":"2024-04-26T23:41:25.704598+0000","last_undegraded":"2024-04-26T23:41:25.704598+0000","last_fullsized":"2024-04-26T23:41:25.704598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:38.934659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.566081+0000","last_change":"2024-04-26T23:41:24.226576+0000","last_active":"2024-04-26T23:41:26.566081+0000","last_peered":"2024-04-26T23:41:26.566081+0000","last_clean":"2024-04-26T23:41:26.566081+0000","last_became_active":"2024-04-26T23:41:24.226264+0000","last_became_peered":"2024-04-26T23:41:24.226264+0000","last_unstale":"2024-04-26T23:41:26.566081+0000","last_undegraded":"2024-04-26T23:41:26.566081+0000","last_fullsized":"2024-04-26T23:41:26.566081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:22:00.727067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192896+0000","last_change":"2024-04-26T23:41:23.203818+0000","last_active":"2024-04-26T23:41:25.192896+0000","last_peered":"2024-04-26T23:41:25.192896+0000","last_clean":"2024-04-26T23:41:25.192896+0000","last_became_active":"2024-04-26T23:41:23.202837+0000","last_became_peered":"2024-04-26T23:41:23.202837+0000","last_unstale":"2024-04-26T23:41:25.192896+0000","last_undegraded":"2024-04-26T23:41:25.192896+0000","last_fullsized":"2024-04-26T23:41:25.192896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:24.942324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190624+0000","last_change":"2024-04-26T23:41:24.213182+0000","last_active":"2024-04-26T23:41:25.190624+0000","last_peered":"2024-04-26T23:41:25.190624+0000","last_clean":"2024-04-26T23:41:25.190624+0000","last_became_active":"2024-04-26T23:41:24.209618+0000","last_became_peered":"2024-04-26T23:41:24.209618+0000","last_unstale":"2024-04-26T23:41:25.190624+0000","last_undegraded":"2024-04-26T23:41:25.190624+0000","last_fullsized":"2024-04-26T23:41:25.190624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:22.105178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.704473+0000","last_change":"2024-04-26T23:41:23.205194+0000","last_active":"2024-04-26T23:41:25.704473+0000","last_peered":"2024-04-26T23:41:25.704473+0000","last_clean":"2024-04-26T23:41:25.704473+0000","last_became_active":"2024-04-26T23:41:23.204713+0000","last_became_peered":"2024-04-26T23:41:23.204713+0000","last_unstale":"2024-04-26T23:41:25.704473+0000","last_undegraded":"2024-04-26T23:41:25.704473+0000","last_fullsized":"2024-04-26T23:41:25.704473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:07:31.445481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565719+0000","last_change":"2024-04-26T23:41:24.205123+0000","last_active":"2024-04-26T23:41:26.565719+0000","last_peered":"2024-04-26T23:41:26.565719+0000","last_clean":"2024-04-26T23:41:26.565719+0000","last_became_active":"2024-04-26T23:41:24.204841+0000","last_became_peered":"2024-04-26T23:41:24.204841+0000","last_unstale":"2024-04-26T23:41:26.565719+0000","last_undegraded":"2024-04-26T23:41:26.565719+0000","last_fullsized":"2024-04-26T23:41:26.565719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:08:46.957484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565404+0000","last_change":"2024-04-26T23:41:12.783987+0000","last_active":"2024-04-26T23:41:26.565404+0000","last_peered":"2024-04-26T23:41:26.565404+0000","last_clean":"2024-04-26T23:41:26.565404+0000","last_became_active":"2024-04-26T23:41:12.782901+0000","last_became_peered":"2024-04-26T23:41:12.782901+0000","last_unstale":"2024-04-26T23:41:26.565404+0000","last_undegraded":"2024-04-26T23:41:26.565404+0000","last_fullsized":"2024-04-26T23:41:26.565404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_clean_scrub_stamp":"2024-04-26T23:41:11.626255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:16.305521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.189889+0000","last_change":"2024-04-26T23:41:23.200012+0000","last_active":"2024-04-26T23:41:25.189889+0000","last_peered":"2024-04-26T23:41:25.189889+0000","last_clean":"2024-04-26T23:41:25.189889+0000","last_became_active":"2024-04-26T23:41:23.199386+0000","last_became_peered":"2024-04-26T23:41:23.199386+0000","last_unstale":"2024-04-26T23:41:25.189889+0000","last_undegraded":"2024-04-26T23:41:25.189889+0000","last_fullsized":"2024-04-26T23:41:25.189889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:38.934659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597544+0000","last_change":"2024-04-26T23:41:24.206857+0000","last_active":"2024-04-26T23:41:25.597544+0000","last_peered":"2024-04-26T23:41:25.597544+0000","last_clean":"2024-04-26T23:41:25.597544+0000","last_became_active":"2024-04-26T23:41:24.206372+0000","last_became_peered":"2024-04-26T23:41:24.206372+0000","last_unstale":"2024-04-26T23:41:25.597544+0000","last_undegraded":"2024-04-26T23:41:25.597544+0000","last_fullsized":"2024-04-26T23:41:25.597544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:39:55.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565230+0000","last_change":"2024-04-26T23:41:23.217608+0000","last_active":"2024-04-26T23:41:26.565230+0000","last_peered":"2024-04-26T23:41:26.565230+0000","last_clean":"2024-04-26T23:41:26.565230+0000","last_became_active":"2024-04-26T23:41:23.217314+0000","last_became_peered":"2024-04-26T23:41:23.217314+0000","last_unstale":"2024-04-26T23:41:26.565230+0000","last_undegraded":"2024-04-26T23:41:26.565230+0000","last_fullsized":"2024-04-26T23:41:26.565230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:24.942324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983275+0000","last_change":"2024-04-26T23:41:24.204857+0000","last_active":"2024-04-26T23:41:25.983275+0000","last_peered":"2024-04-26T23:41:25.983275+0000","last_clean":"2024-04-26T23:41:25.983275+0000","last_became_active":"2024-04-26T23:41:24.204562+0000","last_became_peered":"2024-04-26T23:41:24.204562+0000","last_unstale":"2024-04-26T23:41:25.983275+0000","last_undegraded":"2024-04-26T23:41:25.983275+0000","last_fullsized":"2024-04-26T23:41:25.983275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:59.675062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.704512+0000","last_change":"2024-04-26T23:41:23.200698+0000","last_active":"2024-04-26T23:41:25.704512+0000","last_peered":"2024-04-26T23:41:25.704512+0000","last_clean":"2024-04-26T23:41:25.704512+0000","last_became_active":"2024-04-26T23:41:23.200370+0000","last_became_peered":"2024-04-26T23:41:23.200370+0000","last_unstale":"2024-04-26T23:41:25.704512+0000","last_undegraded":"2024-04-26T23:41:25.704512+0000","last_fullsized":"2024-04-26T23:41:25.704512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:52:46.200614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192390+0000","last_change":"2024-04-26T23:41:24.210162+0000","last_active":"2024-04-26T23:41:25.192390+0000","last_peered":"2024-04-26T23:41:25.192390+0000","last_clean":"2024-04-26T23:41:25.192390+0000","last_became_active":"2024-04-26T23:41:24.208845+0000","last_became_peered":"2024-04-26T23:41:24.208845+0000","last_unstale":"2024-04-26T23:41:25.192390+0000","last_undegraded":"2024-04-26T23:41:25.192390+0000","last_fullsized":"2024-04-26T23:41:25.192390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:24.389021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191434+0000","last_change":"2024-04-26T23:41:23.206844+0000","last_active":"2024-04-26T23:41:25.191434+0000","last_peered":"2024-04-26T23:41:25.191434+0000","last_clean":"2024-04-26T23:41:25.191434+0000","last_became_active":"2024-04-26T23:41:23.206402+0000","last_became_peered":"2024-04-26T23:41:23.206402+0000","last_unstale":"2024-04-26T23:41:25.191434+0000","last_undegraded":"2024-04-26T23:41:25.191434+0000","last_fullsized":"2024-04-26T23:41:25.191434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:56.090036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190708+0000","last_change":"2024-04-26T23:41:24.206303+0000","last_active":"2024-04-26T23:41:25.190708+0000","last_peered":"2024-04-26T23:41:25.190708+0000","last_clean":"2024-04-26T23:41:25.190708+0000","last_became_active":"2024-04-26T23:41:24.202022+0000","last_became_peered":"2024-04-26T23:41:24.202022+0000","last_unstale":"2024-04-26T23:41:25.190708+0000","last_undegraded":"2024-04-26T23:41:25.190708+0000","last_fullsized":"2024-04-26T23:41:25.190708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:59.322866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192695+0000","last_change":"2024-04-26T23:41:23.206647+0000","last_active":"2024-04-26T23:41:25.192695+0000","last_peered":"2024-04-26T23:41:25.192695+0000","last_clean":"2024-04-26T23:41:25.192695+0000","last_became_active":"2024-04-26T23:41:23.206356+0000","last_became_peered":"2024-04-26T23:41:23.206356+0000","last_unstale":"2024-04-26T23:41:25.192695+0000","last_undegraded":"2024-04-26T23:41:25.192695+0000","last_fullsized":"2024-04-26T23:41:25.192695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.316812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190853+0000","last_change":"2024-04-26T23:41:24.211005+0000","last_active":"2024-04-26T23:41:25.190853+0000","last_peered":"2024-04-26T23:41:25.190853+0000","last_clean":"2024-04-26T23:41:25.190853+0000","last_became_active":"2024-04-26T23:41:24.210556+0000","last_became_peered":"2024-04-26T23:41:24.210556+0000","last_unstale":"2024-04-26T23:41:25.190853+0000","last_undegraded":"2024-04-26T23:41:25.190853+0000","last_fullsized":"2024-04-26T23:41:25.190853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:08:46.957484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565849+0000","last_change":"2024-04-26T23:41:23.217996+0000","last_active":"2024-04-26T23:41:26.565849+0000","last_peered":"2024-04-26T23:41:26.565849+0000","last_clean":"2024-04-26T23:41:26.565849+0000","last_became_active":"2024-04-26T23:41:23.217230+0000","last_became_peered":"2024-04-26T23:41:23.217230+0000","last_unstale":"2024-04-26T23:41:26.565849+0000","last_undegraded":"2024-04-26T23:41:26.565849+0000","last_fullsized":"2024-04-26T23:41:26.565849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:16.153073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192392+0000","last_change":"2024-04-26T23:41:24.209392+0000","last_active":"2024-04-26T23:41:25.192392+0000","last_peered":"2024-04-26T23:41:25.192392+0000","last_clean":"2024-04-26T23:41:25.192392+0000","last_became_active":"2024-04-26T23:41:24.208952+0000","last_became_peered":"2024-04-26T23:41:24.208952+0000","last_unstale":"2024-04-26T23:41:25.192392+0000","last_undegraded":"2024-04-26T23:41:25.192392+0000","last_fullsized":"2024-04-26T23:41:25.192392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:50.550871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215906+0000","last_change":"2024-04-26T23:41:23.209568+0000","last_active":"2024-04-26T23:41:25.215906+0000","last_peered":"2024-04-26T23:41:25.215906+0000","last_clean":"2024-04-26T23:41:25.215906+0000","last_became_active":"2024-04-26T23:41:23.208643+0000","last_became_peered":"2024-04-26T23:41:23.208643+0000","last_unstale":"2024-04-26T23:41:25.215906+0000","last_undegraded":"2024-04-26T23:41:25.215906+0000","last_fullsized":"2024-04-26T23:41:25.215906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:25:34.809716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597606+0000","last_change":"2024-04-26T23:41:24.206669+0000","last_active":"2024-04-26T23:41:25.597606+0000","last_peered":"2024-04-26T23:41:25.597606+0000","last_clean":"2024-04-26T23:41:25.597606+0000","last_became_active":"2024-04-26T23:41:24.206394+0000","last_became_peered":"2024-04-26T23:41:24.206394+0000","last_unstale":"2024-04-26T23:41:25.597606+0000","last_undegraded":"2024-04-26T23:41:25.597606+0000","last_fullsized":"2024-04-26T23:41:25.597606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:26.029165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215176+0000","last_change":"2024-04-26T23:41:23.212534+0000","last_active":"2024-04-26T23:41:25.215176+0000","last_peered":"2024-04-26T23:41:25.215176+0000","last_clean":"2024-04-26T23:41:25.215176+0000","last_became_active":"2024-04-26T23:41:23.212211+0000","last_became_peered":"2024-04-26T23:41:23.212211+0000","last_unstale":"2024-04-26T23:41:25.215176+0000","last_undegraded":"2024-04-26T23:41:25.215176+0000","last_fullsized":"2024-04-26T23:41:25.215176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:24.942324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983552+0000","last_change":"2024-04-26T23:41:24.202665+0000","last_active":"2024-04-26T23:41:25.983552+0000","last_peered":"2024-04-26T23:41:25.983552+0000","last_clean":"2024-04-26T23:41:25.983552+0000","last_became_active":"2024-04-26T23:41:24.202391+0000","last_became_peered":"2024-04-26T23:41:24.202391+0000","last_unstale":"2024-04-26T23:41:25.983552+0000","last_undegraded":"2024-04-26T23:41:25.983552+0000","last_fullsized":"2024-04-26T23:41:25.983552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:49:27.834697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565233+0000","last_change":"2024-04-26T23:41:23.216618+0000","last_active":"2024-04-26T23:41:26.565233+0000","last_peered":"2024-04-26T23:41:26.565233+0000","last_clean":"2024-04-26T23:41:26.565233+0000","last_became_active":"2024-04-26T23:41:23.216394+0000","last_became_peered":"2024-04-26T23:41:23.216394+0000","last_unstale":"2024-04-26T23:41:26.565233+0000","last_undegraded":"2024-04-26T23:41:26.565233+0000","last_fullsized":"2024-04-26T23:41:26.565233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:56.090036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190709+0000","last_change":"2024-04-26T23:41:24.213349+0000","last_active":"2024-04-26T23:41:25.190709+0000","last_peered":"2024-04-26T23:41:25.190709+0000","last_clean":"2024-04-26T23:41:25.190709+0000","last_became_active":"2024-04-26T23:41:24.212106+0000","last_became_peered":"2024-04-26T23:41:24.212106+0000","last_unstale":"2024-04-26T23:41:25.190709+0000","last_undegraded":"2024-04-26T23:41:25.190709+0000","last_fullsized":"2024-04-26T23:41:25.190709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:57.096091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192456+0000","last_change":"2024-04-26T23:41:23.216515+0000","last_active":"2024-04-26T23:41:25.192456+0000","last_peered":"2024-04-26T23:41:25.192456+0000","last_clean":"2024-04-26T23:41:25.192456+0000","last_became_active":"2024-04-26T23:41:23.216281+0000","last_became_peered":"2024-04-26T23:41:23.216281+0000","last_unstale":"2024-04-26T23:41:25.192456+0000","last_undegraded":"2024-04-26T23:41:25.192456+0000","last_fullsized":"2024-04-26T23:41:25.192456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:38.934659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597219+0000","last_change":"2024-04-26T23:41:24.199305+0000","last_active":"2024-04-26T23:41:25.597219+0000","last_peered":"2024-04-26T23:41:25.597219+0000","last_clean":"2024-04-26T23:41:25.597219+0000","last_became_active":"2024-04-26T23:41:24.199005+0000","last_became_peered":"2024-04-26T23:41:24.199005+0000","last_unstale":"2024-04-26T23:41:25.597219+0000","last_undegraded":"2024-04-26T23:41:25.597219+0000","last_fullsized":"2024-04-26T23:41:25.597219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:50.550871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192447+0000","last_change":"2024-04-26T23:41:23.215183+0000","last_active":"2024-04-26T23:41:25.192447+0000","last_peered":"2024-04-26T23:41:25.192447+0000","last_clean":"2024-04-26T23:41:25.192447+0000","last_became_active":"2024-04-26T23:41:23.214884+0000","last_became_peered":"2024-04-26T23:41:23.214884+0000","last_unstale":"2024-04-26T23:41:25.192447+0000","last_undegraded":"2024-04-26T23:41:25.192447+0000","last_fullsized":"2024-04-26T23:41:25.192447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:38.962512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597577+0000","last_change":"2024-04-26T23:41:24.200053+0000","last_active":"2024-04-26T23:41:25.597577+0000","last_peered":"2024-04-26T23:41:25.597577+0000","last_clean":"2024-04-26T23:41:25.597577+0000","last_became_active":"2024-04-26T23:41:24.199582+0000","last_became_peered":"2024-04-26T23:41:24.199582+0000","last_unstale":"2024-04-26T23:41:25.597577+0000","last_undegraded":"2024-04-26T23:41:25.597577+0000","last_fullsized":"2024-04-26T23:41:25.597577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:22:11.814233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565677+0000","last_change":"2024-04-26T23:41:23.217680+0000","last_active":"2024-04-26T23:41:26.565677+0000","last_peered":"2024-04-26T23:41:26.565677+0000","last_clean":"2024-04-26T23:41:26.565677+0000","last_became_active":"2024-04-26T23:41:23.217310+0000","last_became_peered":"2024-04-26T23:41:23.217310+0000","last_unstale":"2024-04-26T23:41:26.565677+0000","last_undegraded":"2024-04-26T23:41:26.565677+0000","last_fullsized":"2024-04-26T23:41:26.565677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:47.997792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215087+0000","last_change":"2024-04-26T23:41:24.212308+0000","last_active":"2024-04-26T23:41:25.215087+0000","last_peered":"2024-04-26T23:41:25.215087+0000","last_clean":"2024-04-26T23:41:25.215087+0000","last_became_active":"2024-04-26T23:41:24.210877+0000","last_became_peered":"2024-04-26T23:41:24.210877+0000","last_unstale":"2024-04-26T23:41:25.215087+0000","last_undegraded":"2024-04-26T23:41:25.215087+0000","last_fullsized":"2024-04-26T23:41:25.215087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:50.550871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190698+0000","last_change":"2024-04-26T23:41:24.205082+0000","last_active":"2024-04-26T23:41:25.190698+0000","last_peered":"2024-04-26T23:41:25.190698+0000","last_clean":"2024-04-26T23:41:25.190698+0000","last_became_active":"2024-04-26T23:41:24.204829+0000","last_became_peered":"2024-04-26T23:41:24.204829+0000","last_unstale":"2024-04-26T23:41:25.190698+0000","last_undegraded":"2024-04-26T23:41:25.190698+0000","last_fullsized":"2024-04-26T23:41:25.190698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:16.493479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565564+0000","last_change":"2024-04-26T23:41:23.216385+0000","last_active":"2024-04-26T23:41:26.565564+0000","last_peered":"2024-04-26T23:41:26.565564+0000","last_clean":"2024-04-26T23:41:26.565564+0000","last_became_active":"2024-04-26T23:41:23.215863+0000","last_became_peered":"2024-04-26T23:41:23.215863+0000","last_unstale":"2024-04-26T23:41:26.565564+0000","last_undegraded":"2024-04-26T23:41:26.565564+0000","last_fullsized":"2024-04-26T23:41:26.565564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.316812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190471+0000","last_change":"2024-04-26T23:41:24.221698+0000","last_active":"2024-04-26T23:41:25.190471+0000","last_peered":"2024-04-26T23:41:25.190471+0000","last_clean":"2024-04-26T23:41:25.190471+0000","last_became_active":"2024-04-26T23:41:24.221304+0000","last_became_peered":"2024-04-26T23:41:24.221304+0000","last_unstale":"2024-04-26T23:41:25.190471+0000","last_undegraded":"2024-04-26T23:41:25.190471+0000","last_fullsized":"2024-04-26T23:41:25.190471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:26.029165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565690+0000","last_change":"2024-04-26T23:41:23.218166+0000","last_active":"2024-04-26T23:41:26.565690+0000","last_peered":"2024-04-26T23:41:26.565690+0000","last_clean":"2024-04-26T23:41:26.565690+0000","last_became_active":"2024-04-26T23:41:23.217699+0000","last_became_peered":"2024-04-26T23:41:23.217699+0000","last_unstale":"2024-04-26T23:41:26.565690+0000","last_undegraded":"2024-04-26T23:41:26.565690+0000","last_fullsized":"2024-04-26T23:41:26.565690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:25:34.809716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983637+0000","last_change":"2024-04-26T23:41:24.213827+0000","last_active":"2024-04-26T23:41:25.983637+0000","last_peered":"2024-04-26T23:41:25.983637+0000","last_clean":"2024-04-26T23:41:25.983637+0000","last_became_active":"2024-04-26T23:41:24.212763+0000","last_became_peered":"2024-04-26T23:41:24.212763+0000","last_unstale":"2024-04-26T23:41:25.983637+0000","last_undegraded":"2024-04-26T23:41:25.983637+0000","last_fullsized":"2024-04-26T23:41:25.983637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:44.639875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597735+0000","last_change":"2024-04-26T23:41:23.204817+0000","last_active":"2024-04-26T23:41:25.597735+0000","last_peered":"2024-04-26T23:41:25.597735+0000","last_clean":"2024-04-26T23:41:25.597735+0000","last_became_active":"2024-04-26T23:41:23.204536+0000","last_became_peered":"2024-04-26T23:41:23.204536+0000","last_unstale":"2024-04-26T23:41:25.597735+0000","last_undegraded":"2024-04-26T23:41:25.597735+0000","last_fullsized":"2024-04-26T23:41:25.597735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:03.988829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597451+0000","last_change":"2024-04-26T23:41:24.209853+0000","last_active":"2024-04-26T23:41:25.597451+0000","last_peered":"2024-04-26T23:41:25.597451+0000","last_clean":"2024-04-26T23:41:25.597451+0000","last_became_active":"2024-04-26T23:41:24.208923+0000","last_became_peered":"2024-04-26T23:41:24.208923+0000","last_unstale":"2024-04-26T23:41:25.597451+0000","last_undegraded":"2024-04-26T23:41:25.597451+0000","last_fullsized":"2024-04-26T23:41:25.597451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:44.639875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983765+0000","last_change":"2024-04-26T23:41:23.213860+0000","last_active":"2024-04-26T23:41:25.983765+0000","last_peered":"2024-04-26T23:41:25.983765+0000","last_clean":"2024-04-26T23:41:25.983765+0000","last_became_active":"2024-04-26T23:41:23.213552+0000","last_became_peered":"2024-04-26T23:41:23.213552+0000","last_unstale":"2024-04-26T23:41:25.983765+0000","last_undegraded":"2024-04-26T23:41:25.983765+0000","last_fullsized":"2024-04-26T23:41:25.983765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:45:21.419358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:41:32.913 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:41:33.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.078+0000 7f0897800640 1 Processor -- start 2024-04-26T23:41:33.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.078+0000 7f0897800640 1 -- start start 2024-04-26T23:41:33.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.078+0000 7f0897800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f089006eff0 0x7f089015c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:33.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.078+0000 7f0897800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0890155c20 0x7f08900ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:33.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.078+0000 7f0897800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08900b3e30 con 0x7f08900b5c90 2024-04-26T23:41:33.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.078+0000 7f0897800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f08900d0850 con 0x7f0890155c20 2024-04-26T23:41:33.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.078+0000 7f0897800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f089015ca00 con 0x7f089006eff0 2024-04-26T23:41:33.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.078+0000 7f0895800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0890155c20 0x7f08900ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:33.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.078+0000 7f0887e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f08900b5c90 0x7f0890155510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42956/0 (socket says 172.21.15.137:42956) 2024-04-26T23:41:33.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.078+0000 7f0887e00640 1 -- 172.21.15.137:0/3663971192 learned_addr learned my addr 172.21.15.137:0/3663971192 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:33.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.082+0000 7f088fe00640 1 -- 172.21.15.137:0/3663971192 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3019407421 0 0) 0x7f08900b3e30 con 0x7f08900b5c90 2024-04-26T23:41:33.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.082+0000 7f0894e00640 1 --2- 172.21.15.137:0/3663971192 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f089006eff0 0x7f089015c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:33.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.082+0000 7f088fe00640 1 -- 172.21.15.137:0/3663971192 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0874003530 con 0x7f08900b5c90 2024-04-26T23:41:33.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.082+0000 7f0895800640 1 -- 172.21.15.137:0/3663971192 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f089006eff0 msgr2=0x7f089015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:33.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.082+0000 7f0895800640 1 --2- 172.21.15.137:0/3663971192 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f089006eff0 0x7f089015c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.082+0000 7f0895800640 1 -- 172.21.15.137:0/3663971192 >> v1:172.21.15.137:6789/0 conn(0x7f08900b5c90 legacy=0x7f0890155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:33.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.082+0000 7f0895800640 1 -- 172.21.15.137:0/3663971192 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08900b40a0 con 0x7f0890155c20 2024-04-26T23:41:33.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.082+0000 7f0895800640 1 --2- 172.21.15.137:0/3663971192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0890155c20 0x7f08900ceb90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0888009dc0 tx=0x7f088801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f01993847de954a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:33.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.082+0000 7f088fe00640 1 -- 172.21.15.137:0/3663971192 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08880b2070 con 0x7f0890155c20 2024-04-26T23:41:33.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.082+0000 7f088fe00640 1 -- 172.21.15.137:0/3663971192 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08880a5850 con 0x7f0890155c20 2024-04-26T23:41:33.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.082+0000 7f088fe00640 1 -- 172.21.15.137:0/3663971192 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08880a5c20 con 0x7f0890155c20 2024-04-26T23:41:33.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.082+0000 7f0897800640 1 -- 172.21.15.137:0/3663971192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0890155c20 msgr2=0x7f08900ceb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:33.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.082+0000 7f0897800640 1 --2- 172.21.15.137:0/3663971192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0890155c20 0x7f08900ceb90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0888009dc0 tx=0x7f088801c920 comp rx=0 tx=0).stop 2024-04-26T23:41:33.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.082+0000 7f0897800640 1 -- 172.21.15.137:0/3663971192 shutdown_connections 2024-04-26T23:41:33.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.082+0000 7f0897800640 1 --2- 172.21.15.137:0/3663971192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0890155c20 0x7f08900ceb90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.082+0000 7f0897800640 1 --2- 172.21.15.137:0/3663971192 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f089006eff0 0x7f089015c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.082+0000 7f0897800640 1 -- 172.21.15.137:0/3663971192 >> 172.21.15.137:0/3663971192 conn(0x7f089006c5d0 msgr2=0x7f089006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:33.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0897800640 1 -- 172.21.15.137:0/3663971192 shutdown_connections 2024-04-26T23:41:33.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0897800640 1 -- 172.21.15.137:0/3663971192 wait complete. 2024-04-26T23:41:33.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0897800640 1 Processor -- start 2024-04-26T23:41:33.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0897800640 1 -- start start 2024-04-26T23:41:33.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0897800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f089006eff0 0x7f0890146d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:33.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0897800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08900b5c90 0x7f0890150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:33.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0897800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0890155c20 0x7f089015a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:33.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0897800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f08900cf0d0 con 0x7f08900b5c90 2024-04-26T23:41:33.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0897800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f08900b61e0 con 0x7f089006eff0 2024-04-26T23:41:33.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0897800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f08900cf250 con 0x7f0890155c20 2024-04-26T23:41:33.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0887e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08900b5c90 0x7f0890150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:33.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0887e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08900b5c90 0x7f0890150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43070/0 (socket says 172.21.15.137:43070) 2024-04-26T23:41:33.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0887e00640 1 -- 172.21.15.137:0/1097037765 learned_addr learned my addr 172.21.15.137:0/1097037765 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:33.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0894e00640 1 --2- 172.21.15.137:0/1097037765 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f089006eff0 0x7f0890146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:33.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0895800640 1 --2- 172.21.15.137:0/1097037765 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0890155c20 0x7f089015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:33.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0887e00640 1 -- 172.21.15.137:0/1097037765 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0890155c20 msgr2=0x7f089015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:33.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0887e00640 1 --2- 172.21.15.137:0/1097037765 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0890155c20 0x7f089015a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0887e00640 1 -- 172.21.15.137:0/1097037765 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f089006eff0 msgr2=0x7f0890146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:33.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0887e00640 1 --2- 172.21.15.137:0/1097037765 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f089006eff0 0x7f0890146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0887e00640 1 -- 172.21.15.137:0/1097037765 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0890154220 con 0x7f08900b5c90 2024-04-26T23:41:33.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0887e00640 1 --2- 172.21.15.137:0/1097037765 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08900b5c90 0x7f0890150330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f087800c420 tx=0x7f087800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:33.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f088d600640 1 -- 172.21.15.137:0/1097037765 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878017070 con 0x7f08900b5c90 2024-04-26T23:41:33.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f088d600640 1 -- 172.21.15.137:0/1097037765 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0878005d10 con 0x7f08900b5c90 2024-04-26T23:41:33.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f088d600640 1 -- 172.21.15.137:0/1097037765 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878007310 con 0x7f08900b5c90 2024-04-26T23:41:33.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0897800640 1 -- 172.21.15.137:0/1097037765 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0890154500 con 0x7f08900b5c90 2024-04-26T23:41:33.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.086+0000 7f0897800640 1 -- 172.21.15.137:0/1097037765 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0890154ac0 con 0x7f08900b5c90 2024-04-26T23:41:33.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.090+0000 7f0897800640 1 -- 172.21.15.137:0/1097037765 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f089006a4b0 con 0x7f08900b5c90 2024-04-26T23:41:33.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.090+0000 7f088d600640 1 -- 172.21.15.137:0/1097037765 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f087801a070 con 0x7f08900b5c90 2024-04-26T23:41:33.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.090+0000 7f088d600640 1 --2- 172.21.15.137:0/1097037765 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f086c0683b0 0x7f086c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:33.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.090+0000 7f088d600640 1 -- 172.21.15.137:0/1097037765 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0878085d40 con 0x7f08900b5c90 2024-04-26T23:41:33.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.090+0000 7f0894e00640 1 --2- 172.21.15.137:0/1097037765 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f086c0683b0 0x7f086c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:33.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.090+0000 7f0894e00640 1 --2- 172.21.15.137:0/1097037765 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f086c0683b0 0x7f086c06a870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0890150280 tx=0x7f0880008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:33.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.094+0000 7f088d600640 1 -- 172.21.15.137:0/1097037765 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0878056430 con 0x7f08900b5c90 2024-04-26T23:41:33.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.250+0000 7f0897800640 1 -- 172.21.15.137:0/1097037765 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0890072730 con 0x7f086c0683b0 2024-04-26T23:41:33.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.254+0000 7f088d600640 1 -- 172.21.15.137:0/1097037765 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f0890072730 con 0x7f086c0683b0 2024-04-26T23:41:33.263 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:33.265 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T23:41:33.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.258+0000 7f0897800640 1 -- 172.21.15.137:0/1097037765 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f086c0683b0 msgr2=0x7f086c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:33.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.258+0000 7f0897800640 1 --2- 172.21.15.137:0/1097037765 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f086c0683b0 0x7f086c06a870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0890150280 tx=0x7f0880008040 comp rx=0 tx=0).stop 2024-04-26T23:41:33.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.258+0000 7f0897800640 1 -- 172.21.15.137:0/1097037765 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08900b5c90 msgr2=0x7f0890150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:33.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.258+0000 7f0897800640 1 --2- 172.21.15.137:0/1097037765 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08900b5c90 0x7f0890150330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f087800c420 tx=0x7f087800c8e0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.258+0000 7f0897800640 1 -- 172.21.15.137:0/1097037765 shutdown_connections 2024-04-26T23:41:33.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.258+0000 7f0897800640 1 --2- 172.21.15.137:0/1097037765 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f086c0683b0 0x7f086c06a870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.258+0000 7f0897800640 1 --2- 172.21.15.137:0/1097037765 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08900b5c90 0x7f0890150330 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.258+0000 7f0897800640 1 --2- 172.21.15.137:0/1097037765 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0890155c20 0x7f089015a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.258+0000 7f0897800640 1 --2- 172.21.15.137:0/1097037765 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f089006eff0 0x7f0890146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.258+0000 7f0897800640 1 -- 172.21.15.137:0/1097037765 >> 172.21.15.137:0/1097037765 conn(0x7f089006c5d0 msgr2=0x7f0890155420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:33.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.258+0000 7f0897800640 1 -- 172.21.15.137:0/1097037765 shutdown_connections 2024-04-26T23:41:33.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.258+0000 7f0897800640 1 -- 172.21.15.137:0/1097037765 wait complete. 2024-04-26T23:41:33.284 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-26T23:41:31.590847+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235652,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739068,"statfs":{"total":773094113280,"available":772852805632,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001779"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565979+0000","last_change":"2024-04-26T23:41:24.226081+0000","last_active":"2024-04-26T23:41:26.565979+0000","last_peered":"2024-04-26T23:41:26.565979+0000","last_clean":"2024-04-26T23:41:26.565979+0000","last_became_active":"2024-04-26T23:41:24.224081+0000","last_became_peered":"2024-04-26T23:41:24.224081+0000","last_unstale":"2024-04-26T23:41:26.565979+0000","last_undegraded":"2024-04-26T23:41:26.565979+0000","last_fullsized":"2024-04-26T23:41:26.565979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:28.775250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192782+0000","last_change":"2024-04-26T23:41:24.215201+0000","last_active":"2024-04-26T23:41:25.192782+0000","last_peered":"2024-04-26T23:41:25.192782+0000","last_clean":"2024-04-26T23:41:25.192782+0000","last_became_active":"2024-04-26T23:41:24.214743+0000","last_became_peered":"2024-04-26T23:41:24.214743+0000","last_unstale":"2024-04-26T23:41:25.192782+0000","last_undegraded":"2024-04-26T23:41:25.192782+0000","last_fullsized":"2024-04-26T23:41:25.192782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:44.639875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983493+0000","last_change":"2024-04-26T23:41:24.213419+0000","last_active":"2024-04-26T23:41:25.983493+0000","last_peered":"2024-04-26T23:41:25.983493+0000","last_clean":"2024-04-26T23:41:25.983493+0000","last_became_active":"2024-04-26T23:41:24.213156+0000","last_became_peered":"2024-04-26T23:41:24.213156+0000","last_unstale":"2024-04-26T23:41:25.983493+0000","last_undegraded":"2024-04-26T23:41:25.983493+0000","last_fullsized":"2024-04-26T23:41:25.983493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:24.389021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190322+0000","last_change":"2024-04-26T23:41:24.210450+0000","last_active":"2024-04-26T23:41:25.190322+0000","last_peered":"2024-04-26T23:41:25.190322+0000","last_clean":"2024-04-26T23:41:25.190322+0000","last_became_active":"2024-04-26T23:41:24.209075+0000","last_became_peered":"2024-04-26T23:41:24.209075+0000","last_unstale":"2024-04-26T23:41:25.190322+0000","last_undegraded":"2024-04-26T23:41:25.190322+0000","last_fullsized":"2024-04-26T23:41:25.190322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:22:11.814233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565434+0000","last_change":"2024-04-26T23:41:24.218615+0000","last_active":"2024-04-26T23:41:26.565434+0000","last_peered":"2024-04-26T23:41:26.565434+0000","last_clean":"2024-04-26T23:41:26.565434+0000","last_became_active":"2024-04-26T23:41:24.207757+0000","last_became_peered":"2024-04-26T23:41:24.207757+0000","last_unstale":"2024-04-26T23:41:26.565434+0000","last_undegraded":"2024-04-26T23:41:26.565434+0000","last_fullsized":"2024-04-26T23:41:26.565434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:22:11.814233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190989+0000","last_change":"2024-04-26T23:41:24.215319+0000","last_active":"2024-04-26T23:41:25.190989+0000","last_peered":"2024-04-26T23:41:25.190989+0000","last_clean":"2024-04-26T23:41:25.190989+0000","last_became_active":"2024-04-26T23:41:24.214101+0000","last_became_peered":"2024-04-26T23:41:24.214101+0000","last_unstale":"2024-04-26T23:41:25.190989+0000","last_undegraded":"2024-04-26T23:41:25.190989+0000","last_fullsized":"2024-04-26T23:41:25.190989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:12.164234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565384+0000","last_change":"2024-04-26T23:41:24.218275+0000","last_active":"2024-04-26T23:41:26.565384+0000","last_peered":"2024-04-26T23:41:26.565384+0000","last_clean":"2024-04-26T23:41:26.565384+0000","last_became_active":"2024-04-26T23:41:24.217914+0000","last_became_peered":"2024-04-26T23:41:24.217914+0000","last_unstale":"2024-04-26T23:41:26.565384+0000","last_undegraded":"2024-04-26T23:41:26.565384+0000","last_fullsized":"2024-04-26T23:41:26.565384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:39:55.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597030+0000","last_change":"2024-04-26T23:41:24.217179+0000","last_active":"2024-04-26T23:41:25.597030+0000","last_peered":"2024-04-26T23:41:25.597030+0000","last_clean":"2024-04-26T23:41:25.597030+0000","last_became_active":"2024-04-26T23:41:24.215768+0000","last_became_peered":"2024-04-26T23:41:24.215768+0000","last_unstale":"2024-04-26T23:41:25.597030+0000","last_undegraded":"2024-04-26T23:41:25.597030+0000","last_fullsized":"2024-04-26T23:41:25.597030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:05:07.675269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.566032+0000","last_change":"2024-04-26T23:41:24.225884+0000","last_active":"2024-04-26T23:41:26.566032+0000","last_peered":"2024-04-26T23:41:26.566032+0000","last_clean":"2024-04-26T23:41:26.566032+0000","last_became_active":"2024-04-26T23:41:24.224023+0000","last_became_peered":"2024-04-26T23:41:24.224023+0000","last_unstale":"2024-04-26T23:41:26.566032+0000","last_undegraded":"2024-04-26T23:41:26.566032+0000","last_fullsized":"2024-04-26T23:41:26.566032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:57:21.438653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215198+0000","last_change":"2024-04-26T23:41:24.219022+0000","last_active":"2024-04-26T23:41:25.215198+0000","last_peered":"2024-04-26T23:41:25.215198+0000","last_clean":"2024-04-26T23:41:25.215198+0000","last_became_active":"2024-04-26T23:41:24.218769+0000","last_became_peered":"2024-04-26T23:41:24.218769+0000","last_unstale":"2024-04-26T23:41:25.215198+0000","last_undegraded":"2024-04-26T23:41:25.215198+0000","last_fullsized":"2024-04-26T23:41:25.215198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:21.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215175+0000","last_change":"2024-04-26T23:41:24.219493+0000","last_active":"2024-04-26T23:41:25.215175+0000","last_peered":"2024-04-26T23:41:25.215175+0000","last_clean":"2024-04-26T23:41:25.215175+0000","last_became_active":"2024-04-26T23:41:24.219227+0000","last_became_peered":"2024-04-26T23:41:24.219227+0000","last_unstale":"2024-04-26T23:41:25.215175+0000","last_undegraded":"2024-04-26T23:41:25.215175+0000","last_fullsized":"2024-04-26T23:41:25.215175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:44.639875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190908+0000","last_change":"2024-04-26T23:41:24.213018+0000","last_active":"2024-04-26T23:41:25.190908+0000","last_peered":"2024-04-26T23:41:25.190908+0000","last_clean":"2024-04-26T23:41:25.190908+0000","last_became_active":"2024-04-26T23:41:24.210261+0000","last_became_peered":"2024-04-26T23:41:24.210261+0000","last_unstale":"2024-04-26T23:41:25.190908+0000","last_undegraded":"2024-04-26T23:41:25.190908+0000","last_fullsized":"2024-04-26T23:41:25.190908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:25:35.815770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597367+0000","last_change":"2024-04-26T23:41:24.208860+0000","last_active":"2024-04-26T23:41:25.597367+0000","last_peered":"2024-04-26T23:41:25.597367+0000","last_clean":"2024-04-26T23:41:25.597367+0000","last_became_active":"2024-04-26T23:41:24.208537+0000","last_became_peered":"2024-04-26T23:41:24.208537+0000","last_unstale":"2024-04-26T23:41:25.597367+0000","last_undegraded":"2024-04-26T23:41:25.597367+0000","last_fullsized":"2024-04-26T23:41:25.597367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:49:27.834697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983307+0000","last_change":"2024-04-26T23:41:24.212959+0000","last_active":"2024-04-26T23:41:25.983307+0000","last_peered":"2024-04-26T23:41:25.983307+0000","last_clean":"2024-04-26T23:41:25.983307+0000","last_became_active":"2024-04-26T23:41:24.208009+0000","last_became_peered":"2024-04-26T23:41:24.208009+0000","last_unstale":"2024-04-26T23:41:25.983307+0000","last_undegraded":"2024-04-26T23:41:25.983307+0000","last_fullsized":"2024-04-26T23:41:25.983307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:18.779130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192382+0000","last_change":"2024-04-26T23:41:24.202794+0000","last_active":"2024-04-26T23:41:25.192382+0000","last_peered":"2024-04-26T23:41:25.192382+0000","last_clean":"2024-04-26T23:41:25.192382+0000","last_became_active":"2024-04-26T23:41:24.202484+0000","last_became_peered":"2024-04-26T23:41:24.202484+0000","last_unstale":"2024-04-26T23:41:25.192382+0000","last_undegraded":"2024-04-26T23:41:25.192382+0000","last_fullsized":"2024-04-26T23:41:25.192382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:36.344325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.189800+0000","last_change":"2024-04-26T23:41:24.209356+0000","last_active":"2024-04-26T23:41:25.189800+0000","last_peered":"2024-04-26T23:41:25.189800+0000","last_clean":"2024-04-26T23:41:25.189800+0000","last_became_active":"2024-04-26T23:41:24.208427+0000","last_became_peered":"2024-04-26T23:41:24.208427+0000","last_unstale":"2024-04-26T23:41:25.189800+0000","last_undegraded":"2024-04-26T23:41:25.189800+0000","last_fullsized":"2024-04-26T23:41:25.189800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:21.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191177+0000","last_change":"2024-04-26T23:41:24.209097+0000","last_active":"2024-04-26T23:41:25.191177+0000","last_peered":"2024-04-26T23:41:25.191177+0000","last_clean":"2024-04-26T23:41:25.191177+0000","last_became_active":"2024-04-26T23:41:24.208802+0000","last_became_peered":"2024-04-26T23:41:24.208802+0000","last_unstale":"2024-04-26T23:41:25.191177+0000","last_undegraded":"2024-04-26T23:41:25.191177+0000","last_fullsized":"2024-04-26T23:41:25.191177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:28.775250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.704637+0000","last_change":"2024-04-26T23:41:24.209948+0000","last_active":"2024-04-26T23:41:25.704637+0000","last_peered":"2024-04-26T23:41:25.704637+0000","last_clean":"2024-04-26T23:41:25.704637+0000","last_became_active":"2024-04-26T23:41:24.209643+0000","last_became_peered":"2024-04-26T23:41:24.209643+0000","last_unstale":"2024-04-26T23:41:25.704637+0000","last_undegraded":"2024-04-26T23:41:25.704637+0000","last_fullsized":"2024-04-26T23:41:25.704637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:49.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565891+0000","last_change":"2024-04-26T23:41:24.223030+0000","last_active":"2024-04-26T23:41:26.565891+0000","last_peered":"2024-04-26T23:41:26.565891+0000","last_clean":"2024-04-26T23:41:26.565891+0000","last_became_active":"2024-04-26T23:41:24.221662+0000","last_became_peered":"2024-04-26T23:41:24.221662+0000","last_unstale":"2024-04-26T23:41:26.565891+0000","last_undegraded":"2024-04-26T23:41:26.565891+0000","last_fullsized":"2024-04-26T23:41:26.565891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:12.164234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215142+0000","last_change":"2024-04-26T23:41:24.218402+0000","last_active":"2024-04-26T23:41:25.215142+0000","last_peered":"2024-04-26T23:41:25.215142+0000","last_clean":"2024-04-26T23:41:25.215142+0000","last_became_active":"2024-04-26T23:41:24.217441+0000","last_became_peered":"2024-04-26T23:41:24.217441+0000","last_unstale":"2024-04-26T23:41:25.215142+0000","last_undegraded":"2024-04-26T23:41:25.215142+0000","last_fullsized":"2024-04-26T23:41:25.215142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:49:27.834697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983491+0000","last_change":"2024-04-26T23:41:24.209698+0000","last_active":"2024-04-26T23:41:25.983491+0000","last_peered":"2024-04-26T23:41:25.983491+0000","last_clean":"2024-04-26T23:41:25.983491+0000","last_became_active":"2024-04-26T23:41:24.208252+0000","last_became_peered":"2024-04-26T23:41:24.208252+0000","last_unstale":"2024-04-26T23:41:25.983491+0000","last_undegraded":"2024-04-26T23:41:25.983491+0000","last_fullsized":"2024-04-26T23:41:25.983491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:36.344325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191156+0000","last_change":"2024-04-26T23:41:24.223785+0000","last_active":"2024-04-26T23:41:25.191156+0000","last_peered":"2024-04-26T23:41:25.191156+0000","last_clean":"2024-04-26T23:41:25.191156+0000","last_became_active":"2024-04-26T23:41:24.223547+0000","last_became_peered":"2024-04-26T23:41:24.223547+0000","last_unstale":"2024-04-26T23:41:25.191156+0000","last_undegraded":"2024-04-26T23:41:25.191156+0000","last_fullsized":"2024-04-26T23:41:25.191156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:15.741774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597131+0000","last_change":"2024-04-26T23:41:24.204428+0000","last_active":"2024-04-26T23:41:25.597131+0000","last_peered":"2024-04-26T23:41:25.597131+0000","last_clean":"2024-04-26T23:41:25.597131+0000","last_became_active":"2024-04-26T23:41:24.203845+0000","last_became_peered":"2024-04-26T23:41:24.203845+0000","last_unstale":"2024-04-26T23:41:25.597131+0000","last_undegraded":"2024-04-26T23:41:25.597131+0000","last_fullsized":"2024-04-26T23:41:25.597131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:36.344325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.189964+0000","last_change":"2024-04-26T23:41:24.201596+0000","last_active":"2024-04-26T23:41:25.189964+0000","last_peered":"2024-04-26T23:41:25.189964+0000","last_clean":"2024-04-26T23:41:25.189964+0000","last_became_active":"2024-04-26T23:41:24.201257+0000","last_became_peered":"2024-04-26T23:41:24.201257+0000","last_unstale":"2024-04-26T23:41:25.189964+0000","last_undegraded":"2024-04-26T23:41:25.189964+0000","last_fullsized":"2024-04-26T23:41:25.189964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:10.486440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597494+0000","last_change":"2024-04-26T23:41:24.213190+0000","last_active":"2024-04-26T23:41:25.597494+0000","last_peered":"2024-04-26T23:41:25.597494+0000","last_clean":"2024-04-26T23:41:25.597494+0000","last_became_active":"2024-04-26T23:41:24.212878+0000","last_became_peered":"2024-04-26T23:41:24.212878+0000","last_unstale":"2024-04-26T23:41:25.597494+0000","last_undegraded":"2024-04-26T23:41:25.597494+0000","last_fullsized":"2024-04-26T23:41:25.597494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:21.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215267+0000","last_change":"2024-04-26T23:41:24.222681+0000","last_active":"2024-04-26T23:41:25.215267+0000","last_peered":"2024-04-26T23:41:25.215267+0000","last_clean":"2024-04-26T23:41:25.215267+0000","last_became_active":"2024-04-26T23:41:24.222435+0000","last_became_peered":"2024-04-26T23:41:24.222435+0000","last_unstale":"2024-04-26T23:41:25.215267+0000","last_undegraded":"2024-04-26T23:41:25.215267+0000","last_fullsized":"2024-04-26T23:41:25.215267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:10.486440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192815+0000","last_change":"2024-04-26T23:41:24.207533+0000","last_active":"2024-04-26T23:41:25.192815+0000","last_peered":"2024-04-26T23:41:25.192815+0000","last_clean":"2024-04-26T23:41:25.192815+0000","last_became_active":"2024-04-26T23:41:24.207267+0000","last_became_peered":"2024-04-26T23:41:24.207267+0000","last_unstale":"2024-04-26T23:41:25.192815+0000","last_undegraded":"2024-04-26T23:41:25.192815+0000","last_fullsized":"2024-04-26T23:41:25.192815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:21.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597519+0000","last_change":"2024-04-26T23:41:24.216811+0000","last_active":"2024-04-26T23:41:25.597519+0000","last_peered":"2024-04-26T23:41:25.597519+0000","last_clean":"2024-04-26T23:41:25.597519+0000","last_became_active":"2024-04-26T23:41:24.216532+0000","last_became_peered":"2024-04-26T23:41:24.216532+0000","last_unstale":"2024-04-26T23:41:25.597519+0000","last_undegraded":"2024-04-26T23:41:25.597519+0000","last_fullsized":"2024-04-26T23:41:25.597519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:10.486440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983542+0000","last_change":"2024-04-26T23:41:24.201499+0000","last_active":"2024-04-26T23:41:25.983542+0000","last_peered":"2024-04-26T23:41:25.983542+0000","last_clean":"2024-04-26T23:41:25.983542+0000","last_became_active":"2024-04-26T23:41:24.201217+0000","last_became_peered":"2024-04-26T23:41:24.201217+0000","last_unstale":"2024-04-26T23:41:25.983542+0000","last_undegraded":"2024-04-26T23:41:25.983542+0000","last_fullsized":"2024-04-26T23:41:25.983542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:50.550871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191338+0000","last_change":"2024-04-26T23:41:24.215543+0000","last_active":"2024-04-26T23:41:25.191338+0000","last_peered":"2024-04-26T23:41:25.191338+0000","last_clean":"2024-04-26T23:41:25.191338+0000","last_became_active":"2024-04-26T23:41:24.214468+0000","last_became_peered":"2024-04-26T23:41:24.214468+0000","last_unstale":"2024-04-26T23:41:25.191338+0000","last_undegraded":"2024-04-26T23:41:25.191338+0000","last_fullsized":"2024-04-26T23:41:25.191338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:57:21.438653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.704495+0000","last_change":"2024-04-26T23:41:24.228988+0000","last_active":"2024-04-26T23:41:25.704495+0000","last_peered":"2024-04-26T23:41:25.704495+0000","last_clean":"2024-04-26T23:41:25.704495+0000","last_became_active":"2024-04-26T23:41:24.228753+0000","last_became_peered":"2024-04-26T23:41:24.228753+0000","last_unstale":"2024-04-26T23:41:25.704495+0000","last_undegraded":"2024-04-26T23:41:25.704495+0000","last_fullsized":"2024-04-26T23:41:25.704495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:25:35.815770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.214825+0000","last_change":"2024-04-26T23:41:24.213487+0000","last_active":"2024-04-26T23:41:25.214825+0000","last_peered":"2024-04-26T23:41:25.214825+0000","last_clean":"2024-04-26T23:41:25.214825+0000","last_became_active":"2024-04-26T23:41:24.212794+0000","last_became_peered":"2024-04-26T23:41:24.212794+0000","last_unstale":"2024-04-26T23:41:25.214825+0000","last_undegraded":"2024-04-26T23:41:25.214825+0000","last_fullsized":"2024-04-26T23:41:25.214825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:36.344325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190783+0000","last_change":"2024-04-26T23:41:24.202787+0000","last_active":"2024-04-26T23:41:25.190783+0000","last_peered":"2024-04-26T23:41:25.190783+0000","last_clean":"2024-04-26T23:41:25.190783+0000","last_became_active":"2024-04-26T23:41:24.202474+0000","last_became_peered":"2024-04-26T23:41:24.202474+0000","last_unstale":"2024-04-26T23:41:25.190783+0000","last_undegraded":"2024-04-26T23:41:25.190783+0000","last_fullsized":"2024-04-26T23:41:25.190783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:25.948379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597494+0000","last_change":"2024-04-26T23:41:23.211330+0000","last_active":"2024-04-26T23:41:25.597494+0000","last_peered":"2024-04-26T23:41:25.597494+0000","last_clean":"2024-04-26T23:41:25.597494+0000","last_became_active":"2024-04-26T23:41:23.210860+0000","last_became_peered":"2024-04-26T23:41:23.210860+0000","last_unstale":"2024-04-26T23:41:25.597494+0000","last_undegraded":"2024-04-26T23:41:25.597494+0000","last_fullsized":"2024-04-26T23:41:25.597494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:07.156356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983678+0000","last_change":"2024-04-26T23:41:24.212656+0000","last_active":"2024-04-26T23:41:25.983678+0000","last_peered":"2024-04-26T23:41:25.983678+0000","last_clean":"2024-04-26T23:41:25.983678+0000","last_became_active":"2024-04-26T23:41:24.208356+0000","last_became_peered":"2024-04-26T23:41:24.208356+0000","last_unstale":"2024-04-26T23:41:25.983678+0000","last_undegraded":"2024-04-26T23:41:25.983678+0000","last_fullsized":"2024-04-26T23:41:25.983678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:10.486440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.214878+0000","last_change":"2024-04-26T23:41:23.203211+0000","last_active":"2024-04-26T23:41:25.214878+0000","last_peered":"2024-04-26T23:41:25.214878+0000","last_clean":"2024-04-26T23:41:25.214878+0000","last_became_active":"2024-04-26T23:41:23.202884+0000","last_became_peered":"2024-04-26T23:41:23.202884+0000","last_unstale":"2024-04-26T23:41:25.214878+0000","last_undegraded":"2024-04-26T23:41:25.214878+0000","last_fullsized":"2024-04-26T23:41:25.214878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:38.962512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597235+0000","last_change":"2024-04-26T23:41:23.204160+0000","last_active":"2024-04-26T23:41:25.597235+0000","last_peered":"2024-04-26T23:41:25.597235+0000","last_clean":"2024-04-26T23:41:25.597235+0000","last_became_active":"2024-04-26T23:41:23.203160+0000","last_became_peered":"2024-04-26T23:41:23.203160+0000","last_unstale":"2024-04-26T23:41:25.597235+0000","last_undegraded":"2024-04-26T23:41:25.597235+0000","last_fullsized":"2024-04-26T23:41:25.597235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:07:31.445481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597143+0000","last_change":"2024-04-26T23:41:24.199055+0000","last_active":"2024-04-26T23:41:25.597143+0000","last_peered":"2024-04-26T23:41:25.597143+0000","last_clean":"2024-04-26T23:41:25.597143+0000","last_became_active":"2024-04-26T23:41:24.198722+0000","last_became_peered":"2024-04-26T23:41:24.198722+0000","last_unstale":"2024-04-26T23:41:25.597143+0000","last_undegraded":"2024-04-26T23:41:25.597143+0000","last_fullsized":"2024-04-26T23:41:25.597143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:24.389021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190075+0000","last_change":"2024-04-26T23:41:23.201562+0000","last_active":"2024-04-26T23:41:25.190075+0000","last_peered":"2024-04-26T23:41:25.190075+0000","last_clean":"2024-04-26T23:41:25.190075+0000","last_became_active":"2024-04-26T23:41:23.200676+0000","last_became_peered":"2024-04-26T23:41:23.200676+0000","last_unstale":"2024-04-26T23:41:25.190075+0000","last_undegraded":"2024-04-26T23:41:25.190075+0000","last_fullsized":"2024-04-26T23:41:25.190075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:24.942324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192584+0000","last_change":"2024-04-26T23:41:24.204813+0000","last_active":"2024-04-26T23:41:25.192584+0000","last_peered":"2024-04-26T23:41:25.192584+0000","last_clean":"2024-04-26T23:41:25.192584+0000","last_became_active":"2024-04-26T23:41:24.204553+0000","last_became_peered":"2024-04-26T23:41:24.204553+0000","last_unstale":"2024-04-26T23:41:25.192584+0000","last_undegraded":"2024-04-26T23:41:25.192584+0000","last_fullsized":"2024-04-26T23:41:25.192584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:49:27.834697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215042+0000","last_change":"2024-04-26T23:41:23.206952+0000","last_active":"2024-04-26T23:41:25.215042+0000","last_peered":"2024-04-26T23:41:25.215042+0000","last_clean":"2024-04-26T23:41:25.215042+0000","last_became_active":"2024-04-26T23:41:23.206577+0000","last_became_peered":"2024-04-26T23:41:23.206577+0000","last_unstale":"2024-04-26T23:41:25.215042+0000","last_undegraded":"2024-04-26T23:41:25.215042+0000","last_fullsized":"2024-04-26T23:41:25.215042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:56.090036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190165+0000","last_change":"2024-04-26T23:41:24.205876+0000","last_active":"2024-04-26T23:41:25.190165+0000","last_peered":"2024-04-26T23:41:25.190165+0000","last_clean":"2024-04-26T23:41:25.190165+0000","last_became_active":"2024-04-26T23:41:24.205566+0000","last_became_peered":"2024-04-26T23:41:24.205566+0000","last_unstale":"2024-04-26T23:41:25.190165+0000","last_undegraded":"2024-04-26T23:41:25.190165+0000","last_fullsized":"2024-04-26T23:41:25.190165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:39:55.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190265+0000","last_change":"2024-04-26T23:41:23.208519+0000","last_active":"2024-04-26T23:41:25.190265+0000","last_peered":"2024-04-26T23:41:25.190265+0000","last_clean":"2024-04-26T23:41:25.190265+0000","last_became_active":"2024-04-26T23:41:23.208271+0000","last_became_peered":"2024-04-26T23:41:23.208271+0000","last_unstale":"2024-04-26T23:41:25.190265+0000","last_undegraded":"2024-04-26T23:41:25.190265+0000","last_fullsized":"2024-04-26T23:41:25.190265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:38.962512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983677+0000","last_change":"2024-04-26T23:41:24.213954+0000","last_active":"2024-04-26T23:41:25.983677+0000","last_peered":"2024-04-26T23:41:25.983677+0000","last_clean":"2024-04-26T23:41:25.983677+0000","last_became_active":"2024-04-26T23:41:24.210823+0000","last_became_peered":"2024-04-26T23:41:24.210823+0000","last_unstale":"2024-04-26T23:41:25.983677+0000","last_undegraded":"2024-04-26T23:41:25.983677+0000","last_fullsized":"2024-04-26T23:41:25.983677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:21.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192815+0000","last_change":"2024-04-26T23:41:23.208525+0000","last_active":"2024-04-26T23:41:25.192815+0000","last_peered":"2024-04-26T23:41:25.192815+0000","last_clean":"2024-04-26T23:41:25.192815+0000","last_became_active":"2024-04-26T23:41:23.208296+0000","last_became_peered":"2024-04-26T23:41:23.208296+0000","last_unstale":"2024-04-26T23:41:25.192815+0000","last_undegraded":"2024-04-26T23:41:25.192815+0000","last_fullsized":"2024-04-26T23:41:25.192815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:56.090036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191122+0000","last_change":"2024-04-26T23:41:24.214223+0000","last_active":"2024-04-26T23:41:25.191122+0000","last_peered":"2024-04-26T23:41:25.191122+0000","last_clean":"2024-04-26T23:41:25.191122+0000","last_became_active":"2024-04-26T23:41:24.212904+0000","last_became_peered":"2024-04-26T23:41:24.212904+0000","last_unstale":"2024-04-26T23:41:25.191122+0000","last_undegraded":"2024-04-26T23:41:25.191122+0000","last_fullsized":"2024-04-26T23:41:25.191122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:49.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215122+0000","last_change":"2024-04-26T23:41:23.203321+0000","last_active":"2024-04-26T23:41:25.215122+0000","last_peered":"2024-04-26T23:41:25.215122+0000","last_clean":"2024-04-26T23:41:25.215122+0000","last_became_active":"2024-04-26T23:41:23.203033+0000","last_became_peered":"2024-04-26T23:41:23.203033+0000","last_unstale":"2024-04-26T23:41:25.215122+0000","last_undegraded":"2024-04-26T23:41:25.215122+0000","last_fullsized":"2024-04-26T23:41:25.215122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.316812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565538+0000","last_change":"2024-04-26T23:41:24.206337+0000","last_active":"2024-04-26T23:41:26.565538+0000","last_peered":"2024-04-26T23:41:26.565538+0000","last_clean":"2024-04-26T23:41:26.565538+0000","last_became_active":"2024-04-26T23:41:24.206071+0000","last_became_peered":"2024-04-26T23:41:24.206071+0000","last_unstale":"2024-04-26T23:41:26.565538+0000","last_undegraded":"2024-04-26T23:41:26.565538+0000","last_fullsized":"2024-04-26T23:41:26.565538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:22.105178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983690+0000","last_change":"2024-04-26T23:41:23.209289+0000","last_active":"2024-04-26T23:41:25.983690+0000","last_peered":"2024-04-26T23:41:25.983690+0000","last_clean":"2024-04-26T23:41:25.983690+0000","last_became_active":"2024-04-26T23:41:23.209014+0000","last_became_peered":"2024-04-26T23:41:23.209014+0000","last_unstale":"2024-04-26T23:41:25.983690+0000","last_undegraded":"2024-04-26T23:41:25.983690+0000","last_fullsized":"2024-04-26T23:41:25.983690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:03.988829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983375+0000","last_change":"2024-04-26T23:41:24.213072+0000","last_active":"2024-04-26T23:41:25.983375+0000","last_peered":"2024-04-26T23:41:25.983375+0000","last_clean":"2024-04-26T23:41:25.983375+0000","last_became_active":"2024-04-26T23:41:24.208424+0000","last_became_peered":"2024-04-26T23:41:24.208424+0000","last_unstale":"2024-04-26T23:41:25.983375+0000","last_undegraded":"2024-04-26T23:41:25.983375+0000","last_fullsized":"2024-04-26T23:41:25.983375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:05:07.675269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191349+0000","last_change":"2024-04-26T23:41:23.202871+0000","last_active":"2024-04-26T23:41:25.191349+0000","last_peered":"2024-04-26T23:41:25.191349+0000","last_clean":"2024-04-26T23:41:25.191349+0000","last_became_active":"2024-04-26T23:41:23.202591+0000","last_became_peered":"2024-04-26T23:41:23.202591+0000","last_unstale":"2024-04-26T23:41:25.191349+0000","last_undegraded":"2024-04-26T23:41:25.191349+0000","last_fullsized":"2024-04-26T23:41:25.191349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.316812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565547+0000","last_change":"2024-04-26T23:41:24.224407+0000","last_active":"2024-04-26T23:41:26.565547+0000","last_peered":"2024-04-26T23:41:26.565547+0000","last_clean":"2024-04-26T23:41:26.565547+0000","last_became_active":"2024-04-26T23:41:24.224097+0000","last_became_peered":"2024-04-26T23:41:24.224097+0000","last_unstale":"2024-04-26T23:41:26.565547+0000","last_undegraded":"2024-04-26T23:41:26.565547+0000","last_fullsized":"2024-04-26T23:41:26.565547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:16.493479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.214815+0000","last_change":"2024-04-26T23:41:23.207396+0000","last_active":"2024-04-26T23:41:25.214815+0000","last_peered":"2024-04-26T23:41:25.214815+0000","last_clean":"2024-04-26T23:41:25.214815+0000","last_became_active":"2024-04-26T23:41:23.207008+0000","last_became_peered":"2024-04-26T23:41:23.207008+0000","last_unstale":"2024-04-26T23:41:25.214815+0000","last_undegraded":"2024-04-26T23:41:25.214815+0000","last_fullsized":"2024-04-26T23:41:25.214815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:38.934659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.214836+0000","last_change":"2024-04-26T23:41:24.213631+0000","last_active":"2024-04-26T23:41:25.214836+0000","last_peered":"2024-04-26T23:41:25.214836+0000","last_clean":"2024-04-26T23:41:25.214836+0000","last_became_active":"2024-04-26T23:41:24.213186+0000","last_became_peered":"2024-04-26T23:41:24.213186+0000","last_unstale":"2024-04-26T23:41:25.214836+0000","last_undegraded":"2024-04-26T23:41:25.214836+0000","last_fullsized":"2024-04-26T23:41:25.214836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:24.389021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.704396+0000","last_change":"2024-04-26T23:41:23.201745+0000","last_active":"2024-04-26T23:41:25.704396+0000","last_peered":"2024-04-26T23:41:25.704396+0000","last_clean":"2024-04-26T23:41:25.704396+0000","last_became_active":"2024-04-26T23:41:23.200889+0000","last_became_peered":"2024-04-26T23:41:23.200889+0000","last_unstale":"2024-04-26T23:41:25.704396+0000","last_undegraded":"2024-04-26T23:41:25.704396+0000","last_fullsized":"2024-04-26T23:41:25.704396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:07.156356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565438+0000","last_change":"2024-04-26T23:41:24.222601+0000","last_active":"2024-04-26T23:41:26.565438+0000","last_peered":"2024-04-26T23:41:26.565438+0000","last_clean":"2024-04-26T23:41:26.565438+0000","last_became_active":"2024-04-26T23:41:24.222239+0000","last_became_peered":"2024-04-26T23:41:24.222239+0000","last_unstale":"2024-04-26T23:41:26.565438+0000","last_undegraded":"2024-04-26T23:41:26.565438+0000","last_fullsized":"2024-04-26T23:41:26.565438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:26.029165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191163+0000","last_change":"2024-04-26T23:41:23.200281+0000","last_active":"2024-04-26T23:41:25.191163+0000","last_peered":"2024-04-26T23:41:25.191163+0000","last_clean":"2024-04-26T23:41:25.191163+0000","last_became_active":"2024-04-26T23:41:23.199967+0000","last_became_peered":"2024-04-26T23:41:23.199967+0000","last_unstale":"2024-04-26T23:41:25.191163+0000","last_undegraded":"2024-04-26T23:41:25.191163+0000","last_fullsized":"2024-04-26T23:41:25.191163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:03.988829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565943+0000","last_change":"2024-04-26T23:41:24.216444+0000","last_active":"2024-04-26T23:41:26.565943+0000","last_peered":"2024-04-26T23:41:26.565943+0000","last_clean":"2024-04-26T23:41:26.565943+0000","last_became_active":"2024-04-26T23:41:24.216284+0000","last_became_peered":"2024-04-26T23:41:24.216284+0000","last_unstale":"2024-04-26T23:41:26.565943+0000","last_undegraded":"2024-04-26T23:41:26.565943+0000","last_fullsized":"2024-04-26T23:41:26.565943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:15.741774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.704598+0000","last_change":"2024-04-26T23:41:23.201500+0000","last_active":"2024-04-26T23:41:25.704598+0000","last_peered":"2024-04-26T23:41:25.704598+0000","last_clean":"2024-04-26T23:41:25.704598+0000","last_became_active":"2024-04-26T23:41:23.200957+0000","last_became_peered":"2024-04-26T23:41:23.200957+0000","last_unstale":"2024-04-26T23:41:25.704598+0000","last_undegraded":"2024-04-26T23:41:25.704598+0000","last_fullsized":"2024-04-26T23:41:25.704598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:38.934659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.566081+0000","last_change":"2024-04-26T23:41:24.226576+0000","last_active":"2024-04-26T23:41:26.566081+0000","last_peered":"2024-04-26T23:41:26.566081+0000","last_clean":"2024-04-26T23:41:26.566081+0000","last_became_active":"2024-04-26T23:41:24.226264+0000","last_became_peered":"2024-04-26T23:41:24.226264+0000","last_unstale":"2024-04-26T23:41:26.566081+0000","last_undegraded":"2024-04-26T23:41:26.566081+0000","last_fullsized":"2024-04-26T23:41:26.566081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:22:00.727067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192896+0000","last_change":"2024-04-26T23:41:23.203818+0000","last_active":"2024-04-26T23:41:25.192896+0000","last_peered":"2024-04-26T23:41:25.192896+0000","last_clean":"2024-04-26T23:41:25.192896+0000","last_became_active":"2024-04-26T23:41:23.202837+0000","last_became_peered":"2024-04-26T23:41:23.202837+0000","last_unstale":"2024-04-26T23:41:25.192896+0000","last_undegraded":"2024-04-26T23:41:25.192896+0000","last_fullsized":"2024-04-26T23:41:25.192896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:24.942324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190624+0000","last_change":"2024-04-26T23:41:24.213182+0000","last_active":"2024-04-26T23:41:25.190624+0000","last_peered":"2024-04-26T23:41:25.190624+0000","last_clean":"2024-04-26T23:41:25.190624+0000","last_became_active":"2024-04-26T23:41:24.209618+0000","last_became_peered":"2024-04-26T23:41:24.209618+0000","last_unstale":"2024-04-26T23:41:25.190624+0000","last_undegraded":"2024-04-26T23:41:25.190624+0000","last_fullsized":"2024-04-26T23:41:25.190624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:22.105178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.704473+0000","last_change":"2024-04-26T23:41:23.205194+0000","last_active":"2024-04-26T23:41:25.704473+0000","last_peered":"2024-04-26T23:41:25.704473+0000","last_clean":"2024-04-26T23:41:25.704473+0000","last_became_active":"2024-04-26T23:41:23.204713+0000","last_became_peered":"2024-04-26T23:41:23.204713+0000","last_unstale":"2024-04-26T23:41:25.704473+0000","last_undegraded":"2024-04-26T23:41:25.704473+0000","last_fullsized":"2024-04-26T23:41:25.704473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:07:31.445481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565719+0000","last_change":"2024-04-26T23:41:24.205123+0000","last_active":"2024-04-26T23:41:26.565719+0000","last_peered":"2024-04-26T23:41:26.565719+0000","last_clean":"2024-04-26T23:41:26.565719+0000","last_became_active":"2024-04-26T23:41:24.204841+0000","last_became_peered":"2024-04-26T23:41:24.204841+0000","last_unstale":"2024-04-26T23:41:26.565719+0000","last_undegraded":"2024-04-26T23:41:26.565719+0000","last_fullsized":"2024-04-26T23:41:26.565719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:08:46.957484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565404+0000","last_change":"2024-04-26T23:41:12.783987+0000","last_active":"2024-04-26T23:41:26.565404+0000","last_peered":"2024-04-26T23:41:26.565404+0000","last_clean":"2024-04-26T23:41:26.565404+0000","last_became_active":"2024-04-26T23:41:12.782901+0000","last_became_peered":"2024-04-26T23:41:12.782901+0000","last_unstale":"2024-04-26T23:41:26.565404+0000","last_undegraded":"2024-04-26T23:41:26.565404+0000","last_fullsized":"2024-04-26T23:41:26.565404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_clean_scrub_stamp":"2024-04-26T23:41:11.626255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:16.305521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.189889+0000","last_change":"2024-04-26T23:41:23.200012+0000","last_active":"2024-04-26T23:41:25.189889+0000","last_peered":"2024-04-26T23:41:25.189889+0000","last_clean":"2024-04-26T23:41:25.189889+0000","last_became_active":"2024-04-26T23:41:23.199386+0000","last_became_peered":"2024-04-26T23:41:23.199386+0000","last_unstale":"2024-04-26T23:41:25.189889+0000","last_undegraded":"2024-04-26T23:41:25.189889+0000","last_fullsized":"2024-04-26T23:41:25.189889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:38.934659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597544+0000","last_change":"2024-04-26T23:41:24.206857+0000","last_active":"2024-04-26T23:41:25.597544+0000","last_peered":"2024-04-26T23:41:25.597544+0000","last_clean":"2024-04-26T23:41:25.597544+0000","last_became_active":"2024-04-26T23:41:24.206372+0000","last_became_peered":"2024-04-26T23:41:24.206372+0000","last_unstale":"2024-04-26T23:41:25.597544+0000","last_undegraded":"2024-04-26T23:41:25.597544+0000","last_fullsized":"2024-04-26T23:41:25.597544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:39:55.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565230+0000","last_change":"2024-04-26T23:41:23.217608+0000","last_active":"2024-04-26T23:41:26.565230+0000","last_peered":"2024-04-26T23:41:26.565230+0000","last_clean":"2024-04-26T23:41:26.565230+0000","last_became_active":"2024-04-26T23:41:23.217314+0000","last_became_peered":"2024-04-26T23:41:23.217314+0000","last_unstale":"2024-04-26T23:41:26.565230+0000","last_undegraded":"2024-04-26T23:41:26.565230+0000","last_fullsized":"2024-04-26T23:41:26.565230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:24.942324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983275+0000","last_change":"2024-04-26T23:41:24.204857+0000","last_active":"2024-04-26T23:41:25.983275+0000","last_peered":"2024-04-26T23:41:25.983275+0000","last_clean":"2024-04-26T23:41:25.983275+0000","last_became_active":"2024-04-26T23:41:24.204562+0000","last_became_peered":"2024-04-26T23:41:24.204562+0000","last_unstale":"2024-04-26T23:41:25.983275+0000","last_undegraded":"2024-04-26T23:41:25.983275+0000","last_fullsized":"2024-04-26T23:41:25.983275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:59.675062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.704512+0000","last_change":"2024-04-26T23:41:23.200698+0000","last_active":"2024-04-26T23:41:25.704512+0000","last_peered":"2024-04-26T23:41:25.704512+0000","last_clean":"2024-04-26T23:41:25.704512+0000","last_became_active":"2024-04-26T23:41:23.200370+0000","last_became_peered":"2024-04-26T23:41:23.200370+0000","last_unstale":"2024-04-26T23:41:25.704512+0000","last_undegraded":"2024-04-26T23:41:25.704512+0000","last_fullsized":"2024-04-26T23:41:25.704512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:52:46.200614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192390+0000","last_change":"2024-04-26T23:41:24.210162+0000","last_active":"2024-04-26T23:41:25.192390+0000","last_peered":"2024-04-26T23:41:25.192390+0000","last_clean":"2024-04-26T23:41:25.192390+0000","last_became_active":"2024-04-26T23:41:24.208845+0000","last_became_peered":"2024-04-26T23:41:24.208845+0000","last_unstale":"2024-04-26T23:41:25.192390+0000","last_undegraded":"2024-04-26T23:41:25.192390+0000","last_fullsized":"2024-04-26T23:41:25.192390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:24.389021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.191434+0000","last_change":"2024-04-26T23:41:23.206844+0000","last_active":"2024-04-26T23:41:25.191434+0000","last_peered":"2024-04-26T23:41:25.191434+0000","last_clean":"2024-04-26T23:41:25.191434+0000","last_became_active":"2024-04-26T23:41:23.206402+0000","last_became_peered":"2024-04-26T23:41:23.206402+0000","last_unstale":"2024-04-26T23:41:25.191434+0000","last_undegraded":"2024-04-26T23:41:25.191434+0000","last_fullsized":"2024-04-26T23:41:25.191434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:56.090036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190708+0000","last_change":"2024-04-26T23:41:24.206303+0000","last_active":"2024-04-26T23:41:25.190708+0000","last_peered":"2024-04-26T23:41:25.190708+0000","last_clean":"2024-04-26T23:41:25.190708+0000","last_became_active":"2024-04-26T23:41:24.202022+0000","last_became_peered":"2024-04-26T23:41:24.202022+0000","last_unstale":"2024-04-26T23:41:25.190708+0000","last_undegraded":"2024-04-26T23:41:25.190708+0000","last_fullsized":"2024-04-26T23:41:25.190708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:59.322866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192695+0000","last_change":"2024-04-26T23:41:23.206647+0000","last_active":"2024-04-26T23:41:25.192695+0000","last_peered":"2024-04-26T23:41:25.192695+0000","last_clean":"2024-04-26T23:41:25.192695+0000","last_became_active":"2024-04-26T23:41:23.206356+0000","last_became_peered":"2024-04-26T23:41:23.206356+0000","last_unstale":"2024-04-26T23:41:25.192695+0000","last_undegraded":"2024-04-26T23:41:25.192695+0000","last_fullsized":"2024-04-26T23:41:25.192695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.316812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190853+0000","last_change":"2024-04-26T23:41:24.211005+0000","last_active":"2024-04-26T23:41:25.190853+0000","last_peered":"2024-04-26T23:41:25.190853+0000","last_clean":"2024-04-26T23:41:25.190853+0000","last_became_active":"2024-04-26T23:41:24.210556+0000","last_became_peered":"2024-04-26T23:41:24.210556+0000","last_unstale":"2024-04-26T23:41:25.190853+0000","last_undegraded":"2024-04-26T23:41:25.190853+0000","last_fullsized":"2024-04-26T23:41:25.190853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:08:46.957484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565849+0000","last_change":"2024-04-26T23:41:23.217996+0000","last_active":"2024-04-26T23:41:26.565849+0000","last_peered":"2024-04-26T23:41:26.565849+0000","last_clean":"2024-04-26T23:41:26.565849+0000","last_became_active":"2024-04-26T23:41:23.217230+0000","last_became_peered":"2024-04-26T23:41:23.217230+0000","last_unstale":"2024-04-26T23:41:26.565849+0000","last_undegraded":"2024-04-26T23:41:26.565849+0000","last_fullsized":"2024-04-26T23:41:26.565849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:16.153073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192392+0000","last_change":"2024-04-26T23:41:24.209392+0000","last_active":"2024-04-26T23:41:25.192392+0000","last_peered":"2024-04-26T23:41:25.192392+0000","last_clean":"2024-04-26T23:41:25.192392+0000","last_became_active":"2024-04-26T23:41:24.208952+0000","last_became_peered":"2024-04-26T23:41:24.208952+0000","last_unstale":"2024-04-26T23:41:25.192392+0000","last_undegraded":"2024-04-26T23:41:25.192392+0000","last_fullsized":"2024-04-26T23:41:25.192392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:50.550871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215906+0000","last_change":"2024-04-26T23:41:23.209568+0000","last_active":"2024-04-26T23:41:25.215906+0000","last_peered":"2024-04-26T23:41:25.215906+0000","last_clean":"2024-04-26T23:41:25.215906+0000","last_became_active":"2024-04-26T23:41:23.208643+0000","last_became_peered":"2024-04-26T23:41:23.208643+0000","last_unstale":"2024-04-26T23:41:25.215906+0000","last_undegraded":"2024-04-26T23:41:25.215906+0000","last_fullsized":"2024-04-26T23:41:25.215906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:25:34.809716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597606+0000","last_change":"2024-04-26T23:41:24.206669+0000","last_active":"2024-04-26T23:41:25.597606+0000","last_peered":"2024-04-26T23:41:25.597606+0000","last_clean":"2024-04-26T23:41:25.597606+0000","last_became_active":"2024-04-26T23:41:24.206394+0000","last_became_peered":"2024-04-26T23:41:24.206394+0000","last_unstale":"2024-04-26T23:41:25.597606+0000","last_undegraded":"2024-04-26T23:41:25.597606+0000","last_fullsized":"2024-04-26T23:41:25.597606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:26.029165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215176+0000","last_change":"2024-04-26T23:41:23.212534+0000","last_active":"2024-04-26T23:41:25.215176+0000","last_peered":"2024-04-26T23:41:25.215176+0000","last_clean":"2024-04-26T23:41:25.215176+0000","last_became_active":"2024-04-26T23:41:23.212211+0000","last_became_peered":"2024-04-26T23:41:23.212211+0000","last_unstale":"2024-04-26T23:41:25.215176+0000","last_undegraded":"2024-04-26T23:41:25.215176+0000","last_fullsized":"2024-04-26T23:41:25.215176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:24.942324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983552+0000","last_change":"2024-04-26T23:41:24.202665+0000","last_active":"2024-04-26T23:41:25.983552+0000","last_peered":"2024-04-26T23:41:25.983552+0000","last_clean":"2024-04-26T23:41:25.983552+0000","last_became_active":"2024-04-26T23:41:24.202391+0000","last_became_peered":"2024-04-26T23:41:24.202391+0000","last_unstale":"2024-04-26T23:41:25.983552+0000","last_undegraded":"2024-04-26T23:41:25.983552+0000","last_fullsized":"2024-04-26T23:41:25.983552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:49:27.834697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565233+0000","last_change":"2024-04-26T23:41:23.216618+0000","last_active":"2024-04-26T23:41:26.565233+0000","last_peered":"2024-04-26T23:41:26.565233+0000","last_clean":"2024-04-26T23:41:26.565233+0000","last_became_active":"2024-04-26T23:41:23.216394+0000","last_became_peered":"2024-04-26T23:41:23.216394+0000","last_unstale":"2024-04-26T23:41:26.565233+0000","last_undegraded":"2024-04-26T23:41:26.565233+0000","last_fullsized":"2024-04-26T23:41:26.565233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:56.090036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190709+0000","last_change":"2024-04-26T23:41:24.213349+0000","last_active":"2024-04-26T23:41:25.190709+0000","last_peered":"2024-04-26T23:41:25.190709+0000","last_clean":"2024-04-26T23:41:25.190709+0000","last_became_active":"2024-04-26T23:41:24.212106+0000","last_became_peered":"2024-04-26T23:41:24.212106+0000","last_unstale":"2024-04-26T23:41:25.190709+0000","last_undegraded":"2024-04-26T23:41:25.190709+0000","last_fullsized":"2024-04-26T23:41:25.190709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:57.096091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192456+0000","last_change":"2024-04-26T23:41:23.216515+0000","last_active":"2024-04-26T23:41:25.192456+0000","last_peered":"2024-04-26T23:41:25.192456+0000","last_clean":"2024-04-26T23:41:25.192456+0000","last_became_active":"2024-04-26T23:41:23.216281+0000","last_became_peered":"2024-04-26T23:41:23.216281+0000","last_unstale":"2024-04-26T23:41:25.192456+0000","last_undegraded":"2024-04-26T23:41:25.192456+0000","last_fullsized":"2024-04-26T23:41:25.192456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:38.934659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597219+0000","last_change":"2024-04-26T23:41:24.199305+0000","last_active":"2024-04-26T23:41:25.597219+0000","last_peered":"2024-04-26T23:41:25.597219+0000","last_clean":"2024-04-26T23:41:25.597219+0000","last_became_active":"2024-04-26T23:41:24.199005+0000","last_became_peered":"2024-04-26T23:41:24.199005+0000","last_unstale":"2024-04-26T23:41:25.597219+0000","last_undegraded":"2024-04-26T23:41:25.597219+0000","last_fullsized":"2024-04-26T23:41:25.597219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:50.550871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.192447+0000","last_change":"2024-04-26T23:41:23.215183+0000","last_active":"2024-04-26T23:41:25.192447+0000","last_peered":"2024-04-26T23:41:25.192447+0000","last_clean":"2024-04-26T23:41:25.192447+0000","last_became_active":"2024-04-26T23:41:23.214884+0000","last_became_peered":"2024-04-26T23:41:23.214884+0000","last_unstale":"2024-04-26T23:41:25.192447+0000","last_undegraded":"2024-04-26T23:41:25.192447+0000","last_fullsized":"2024-04-26T23:41:25.192447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:38.962512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597577+0000","last_change":"2024-04-26T23:41:24.200053+0000","last_active":"2024-04-26T23:41:25.597577+0000","last_peered":"2024-04-26T23:41:25.597577+0000","last_clean":"2024-04-26T23:41:25.597577+0000","last_became_active":"2024-04-26T23:41:24.199582+0000","last_became_peered":"2024-04-26T23:41:24.199582+0000","last_unstale":"2024-04-26T23:41:25.597577+0000","last_undegraded":"2024-04-26T23:41:25.597577+0000","last_fullsized":"2024-04-26T23:41:25.597577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:22:11.814233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565677+0000","last_change":"2024-04-26T23:41:23.217680+0000","last_active":"2024-04-26T23:41:26.565677+0000","last_peered":"2024-04-26T23:41:26.565677+0000","last_clean":"2024-04-26T23:41:26.565677+0000","last_became_active":"2024-04-26T23:41:23.217310+0000","last_became_peered":"2024-04-26T23:41:23.217310+0000","last_unstale":"2024-04-26T23:41:26.565677+0000","last_undegraded":"2024-04-26T23:41:26.565677+0000","last_fullsized":"2024-04-26T23:41:26.565677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:47.997792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.215087+0000","last_change":"2024-04-26T23:41:24.212308+0000","last_active":"2024-04-26T23:41:25.215087+0000","last_peered":"2024-04-26T23:41:25.215087+0000","last_clean":"2024-04-26T23:41:25.215087+0000","last_became_active":"2024-04-26T23:41:24.210877+0000","last_became_peered":"2024-04-26T23:41:24.210877+0000","last_unstale":"2024-04-26T23:41:25.215087+0000","last_undegraded":"2024-04-26T23:41:25.215087+0000","last_fullsized":"2024-04-26T23:41:25.215087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:50.550871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190698+0000","last_change":"2024-04-26T23:41:24.205082+0000","last_active":"2024-04-26T23:41:25.190698+0000","last_peered":"2024-04-26T23:41:25.190698+0000","last_clean":"2024-04-26T23:41:25.190698+0000","last_became_active":"2024-04-26T23:41:24.204829+0000","last_became_peered":"2024-04-26T23:41:24.204829+0000","last_unstale":"2024-04-26T23:41:25.190698+0000","last_undegraded":"2024-04-26T23:41:25.190698+0000","last_fullsized":"2024-04-26T23:41:25.190698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:06:16.493479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565564+0000","last_change":"2024-04-26T23:41:23.216385+0000","last_active":"2024-04-26T23:41:26.565564+0000","last_peered":"2024-04-26T23:41:26.565564+0000","last_clean":"2024-04-26T23:41:26.565564+0000","last_became_active":"2024-04-26T23:41:23.215863+0000","last_became_peered":"2024-04-26T23:41:23.215863+0000","last_unstale":"2024-04-26T23:41:26.565564+0000","last_undegraded":"2024-04-26T23:41:26.565564+0000","last_fullsized":"2024-04-26T23:41:26.565564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.316812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.190471+0000","last_change":"2024-04-26T23:41:24.221698+0000","last_active":"2024-04-26T23:41:25.190471+0000","last_peered":"2024-04-26T23:41:25.190471+0000","last_clean":"2024-04-26T23:41:25.190471+0000","last_became_active":"2024-04-26T23:41:24.221304+0000","last_became_peered":"2024-04-26T23:41:24.221304+0000","last_unstale":"2024-04-26T23:41:25.190471+0000","last_undegraded":"2024-04-26T23:41:25.190471+0000","last_fullsized":"2024-04-26T23:41:25.190471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:26.029165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:26.565690+0000","last_change":"2024-04-26T23:41:23.218166+0000","last_active":"2024-04-26T23:41:26.565690+0000","last_peered":"2024-04-26T23:41:26.565690+0000","last_clean":"2024-04-26T23:41:26.565690+0000","last_became_active":"2024-04-26T23:41:23.217699+0000","last_became_peered":"2024-04-26T23:41:23.217699+0000","last_unstale":"2024-04-26T23:41:26.565690+0000","last_undegraded":"2024-04-26T23:41:26.565690+0000","last_fullsized":"2024-04-26T23:41:26.565690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:25:34.809716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983637+0000","last_change":"2024-04-26T23:41:24.213827+0000","last_active":"2024-04-26T23:41:25.983637+0000","last_peered":"2024-04-26T23:41:25.983637+0000","last_clean":"2024-04-26T23:41:25.983637+0000","last_became_active":"2024-04-26T23:41:24.212763+0000","last_became_peered":"2024-04-26T23:41:24.212763+0000","last_unstale":"2024-04-26T23:41:25.983637+0000","last_undegraded":"2024-04-26T23:41:25.983637+0000","last_fullsized":"2024-04-26T23:41:25.983637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:44.639875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597735+0000","last_change":"2024-04-26T23:41:23.204817+0000","last_active":"2024-04-26T23:41:25.597735+0000","last_peered":"2024-04-26T23:41:25.597735+0000","last_clean":"2024-04-26T23:41:25.597735+0000","last_became_active":"2024-04-26T23:41:23.204536+0000","last_became_peered":"2024-04-26T23:41:23.204536+0000","last_unstale":"2024-04-26T23:41:25.597735+0000","last_undegraded":"2024-04-26T23:41:25.597735+0000","last_fullsized":"2024-04-26T23:41:25.597735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:03.988829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.597451+0000","last_change":"2024-04-26T23:41:24.209853+0000","last_active":"2024-04-26T23:41:25.597451+0000","last_peered":"2024-04-26T23:41:25.597451+0000","last_clean":"2024-04-26T23:41:25.597451+0000","last_became_active":"2024-04-26T23:41:24.208923+0000","last_became_peered":"2024-04-26T23:41:24.208923+0000","last_unstale":"2024-04-26T23:41:25.597451+0000","last_undegraded":"2024-04-26T23:41:25.597451+0000","last_fullsized":"2024-04-26T23:41:25.597451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:23.177118+0000","last_clean_scrub_stamp":"2024-04-26T23:41:23.177118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:44.639875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:41:25.983765+0000","last_change":"2024-04-26T23:41:23.213860+0000","last_active":"2024-04-26T23:41:25.983765+0000","last_peered":"2024-04-26T23:41:25.983765+0000","last_clean":"2024-04-26T23:41:25.983765+0000","last_became_active":"2024-04-26T23:41:23.213552+0000","last_became_peered":"2024-04-26T23:41:23.213552+0000","last_unstale":"2024-04-26T23:41:25.983765+0000","last_undegraded":"2024-04-26T23:41:25.983765+0000","last_fullsized":"2024-04-26T23:41:25.983765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:22.171063+0000","last_clean_scrub_stamp":"2024-04-26T23:41:22.171063+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:45:21.419358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:41:33.287 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T23:41:33.287 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T23:41:33.287 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T23:41:33.287 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T23:41:33.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.454+0000 7f4c13600640 1 Processor -- start 2024-04-26T23:41:33.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.454+0000 7f4c13600640 1 -- start start 2024-04-26T23:41:33.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.454+0000 7f4c13600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c0c073a40 0x7f4c0c073e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:33.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.454+0000 7f4c13600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4c0c0b6a50 0x7f4c0c0cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:33.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.454+0000 7f4c13600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c0c0cff80 con 0x7f4c0c0cfa70 2024-04-26T23:41:33.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.454+0000 7f4c13600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4c0c0d0260 con 0x7f4c0c0b6a50 2024-04-26T23:41:33.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.454+0000 7f4c13600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4c0c0d0540 con 0x7f4c0c073a40 2024-04-26T23:41:33.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.454+0000 7f4c0be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4c0c0b6a50 0x7f4c0c0cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:33.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.454+0000 7f4c0be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4c0c0b6a50 0x7f4c0c0cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43078/0 (socket says 172.21.15.137:43078) 2024-04-26T23:41:33.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.454+0000 7f4c0be00640 1 -- 172.21.15.137:0/3064033046 learned_addr learned my addr 172.21.15.137:0/3064033046 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:33.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.454+0000 7f4c10c00640 1 --2- 172.21.15.137:0/3064033046 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c0c073a40 0x7f4c0c073e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:33.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.454+0000 7f4c0be00640 1 -- 172.21.15.137:0/3064033046 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c0c073a40 msgr2=0x7f4c0c073e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:33.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.454+0000 7f4c0be00640 1 --2- 172.21.15.137:0/3064033046 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c0c073a40 0x7f4c0c073e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.454+0000 7f4c0be00640 1 -- 172.21.15.137:0/3064033046 >> v1:172.21.15.170:6789/0 conn(0x7f4c0c0cfa70 legacy=0x7f4c0c15fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:33.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.454+0000 7f4c0be00640 1 -- 172.21.15.137:0/3064033046 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0c0d0820 con 0x7f4c0c0b6a50 2024-04-26T23:41:33.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.454+0000 7f4c10c00640 1 --2- 172.21.15.137:0/3064033046 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c0c073a40 0x7f4c0c073e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:33.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.458+0000 7f4c0be00640 1 --2- 172.21.15.137:0/3064033046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c0c0b6a50 0x7f4c0c0cf530 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009870 tx=0x7f4bf801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e17356a531ead5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:33.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.458+0000 7f4c0b400640 1 -- 172.21.15.137:0/3064033046 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf80aa600 con 0x7f4c0c0b6a50 2024-04-26T23:41:33.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.458+0000 7f4c0b400640 1 -- 172.21.15.137:0/3064033046 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf80af070 con 0x7f4c0c0b6a50 2024-04-26T23:41:33.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.458+0000 7f4c0b400640 1 -- 172.21.15.137:0/3064033046 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf80aa9c0 con 0x7f4c0c0b6a50 2024-04-26T23:41:33.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.458+0000 7f4c13600640 1 -- 172.21.15.137:0/3064033046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c0c0b6a50 msgr2=0x7f4c0c0cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:33.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.458+0000 7f4c13600640 1 --2- 172.21.15.137:0/3064033046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c0c0b6a50 0x7f4c0c0cf530 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009870 tx=0x7f4bf801c4e0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.458+0000 7f4c13600640 1 -- 172.21.15.137:0/3064033046 shutdown_connections 2024-04-26T23:41:33.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.458+0000 7f4c13600640 1 --2- 172.21.15.137:0/3064033046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c0c0b6a50 0x7f4c0c0cf530 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.458+0000 7f4c13600640 1 --2- 172.21.15.137:0/3064033046 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c0c073a40 0x7f4c0c073e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.458+0000 7f4c13600640 1 -- 172.21.15.137:0/3064033046 >> 172.21.15.137:0/3064033046 conn(0x7f4c0c06e2d0 msgr2=0x7f4c0c06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:33.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.458+0000 7f4c13600640 1 -- 172.21.15.137:0/3064033046 shutdown_connections 2024-04-26T23:41:33.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.458+0000 7f4c13600640 1 -- 172.21.15.137:0/3064033046 wait complete. 2024-04-26T23:41:33.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c13600640 1 Processor -- start 2024-04-26T23:41:33.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c13600640 1 -- start start 2024-04-26T23:41:33.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c13600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c0c073a40 0x7f4c0c156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:33.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c13600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c0c0b6a50 0x7f4c0c13b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:33.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c13600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c0c0cfa70 0x7f4c0c168960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:33.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c13600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c166eb0 con 0x7f4c0c0cfa70 2024-04-26T23:41:33.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c13600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c166d30 con 0x7f4c0c073a40 2024-04-26T23:41:33.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c13600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4c0c167030 con 0x7f4c0c0b6a50 2024-04-26T23:41:33.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c11600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c0c0cfa70 0x7f4c0c168960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:33.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c11600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c0c0cfa70 0x7f4c0c168960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43094/0 (socket says 172.21.15.137:43094) 2024-04-26T23:41:33.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c11600640 1 -- 172.21.15.137:0/3446666662 learned_addr learned my addr 172.21.15.137:0/3446666662 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:33.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c10c00640 1 --2- 172.21.15.137:0/3446666662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c0c073a40 0x7f4c0c156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:33.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c0be00640 1 --2- 172.21.15.137:0/3446666662 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c0c0b6a50 0x7f4c0c13b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:33.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c11600640 1 -- 172.21.15.137:0/3446666662 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c0c0b6a50 msgr2=0x7f4c0c13b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:33.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c11600640 1 --2- 172.21.15.137:0/3446666662 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c0c0b6a50 0x7f4c0c13b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c11600640 1 -- 172.21.15.137:0/3446666662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c0c073a40 msgr2=0x7f4c0c156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:33.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c11600640 1 --2- 172.21.15.137:0/3446666662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c0c073a40 0x7f4c0c156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c11600640 1 -- 172.21.15.137:0/3446666662 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0c13a4d0 con 0x7f4c0c0cfa70 2024-04-26T23:41:33.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c11600640 1 --2- 172.21.15.137:0/3446666662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c0c0cfa70 0x7f4c0c168960 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4c0400b490 tx=0x7f4c0400b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:33.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c08c00640 1 -- 172.21.15.137:0/3446666662 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c04015020 con 0x7f4c0c0cfa70 2024-04-26T23:41:33.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c08c00640 1 -- 172.21.15.137:0/3446666662 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c04011830 con 0x7f4c0c0cfa70 2024-04-26T23:41:33.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c08c00640 1 -- 172.21.15.137:0/3446666662 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c04011c20 con 0x7f4c0c0cfa70 2024-04-26T23:41:33.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c13600640 1 -- 172.21.15.137:0/3446666662 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c0c156f70 con 0x7f4c0c0cfa70 2024-04-26T23:41:33.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.462+0000 7f4c13600640 1 -- 172.21.15.137:0/3446666662 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c0c13aa50 con 0x7f4c0c0cfa70 2024-04-26T23:41:33.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.466+0000 7f4c13600640 1 -- 172.21.15.137:0/3446666662 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c0c06a4b0 con 0x7f4c0c0cfa70 2024-04-26T23:41:33.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.466+0000 7f4c08c00640 1 -- 172.21.15.137:0/3446666662 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4c04018020 con 0x7f4c0c0cfa70 2024-04-26T23:41:33.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.466+0000 7f4c08c00640 1 --2- 172.21.15.137:0/3446666662 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4bec068380 0x7f4bec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:33.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.466+0000 7f4c08c00640 1 -- 172.21.15.137:0/3446666662 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4c04086490 con 0x7f4c0c0cfa70 2024-04-26T23:41:33.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.466+0000 7f4c10c00640 1 --2- 172.21.15.137:0/3446666662 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4bec068380 0x7f4bec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:33.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.466+0000 7f4c10c00640 1 --2- 172.21.15.137:0/3446666662 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4bec068380 0x7f4bec06a840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c139c70 tx=0x7f4bfc007810 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:33.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.470+0000 7f4c08c00640 1 -- 172.21.15.137:0/3446666662 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4c0401f030 con 0x7f4c0c0cfa70 2024-04-26T23:41:33.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.666+0000 7f4c13600640 1 -- 172.21.15.137:0/3446666662 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4c0c06eea0 con 0x7f4c0c0cfa70 2024-04-26T23:41:33.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.666+0000 7f4c08c00640 1 -- 172.21.15.137:0/3446666662 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f4c04056360 con 0x7f4c0c0cfa70 2024-04-26T23:41:33.671 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:33.671 INFO:teuthology.orchestra.run.smithi137.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T23:41:33.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.666+0000 7f4c13600640 1 -- 172.21.15.137:0/3446666662 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4bec068380 msgr2=0x7f4bec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:33.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.666+0000 7f4c13600640 1 --2- 172.21.15.137:0/3446666662 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4bec068380 0x7f4bec06a840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c139c70 tx=0x7f4bfc007810 comp rx=0 tx=0).stop 2024-04-26T23:41:33.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.666+0000 7f4c13600640 1 -- 172.21.15.137:0/3446666662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c0c0cfa70 msgr2=0x7f4c0c168960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:33.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.666+0000 7f4c13600640 1 --2- 172.21.15.137:0/3446666662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c0c0cfa70 0x7f4c0c168960 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4c0400b490 tx=0x7f4c0400b950 comp rx=0 tx=0).stop 2024-04-26T23:41:33.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.666+0000 7f4c13600640 1 -- 172.21.15.137:0/3446666662 shutdown_connections 2024-04-26T23:41:33.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.666+0000 7f4c13600640 1 --2- 172.21.15.137:0/3446666662 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4bec068380 0x7f4bec06a840 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.666+0000 7f4c13600640 1 --2- 172.21.15.137:0/3446666662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c0c0cfa70 0x7f4c0c168960 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.666+0000 7f4c13600640 1 --2- 172.21.15.137:0/3446666662 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c0c0b6a50 0x7f4c0c13b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.666+0000 7f4c13600640 1 --2- 172.21.15.137:0/3446666662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c0c073a40 0x7f4c0c156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.666+0000 7f4c13600640 1 -- 172.21.15.137:0/3446666662 >> 172.21.15.137:0/3446666662 conn(0x7f4c0c06e2d0 msgr2=0x7f4c0c06e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:33.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.666+0000 7f4c13600640 1 -- 172.21.15.137:0/3446666662 shutdown_connections 2024-04-26T23:41:33.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.666+0000 7f4c13600640 1 -- 172.21.15.137:0/3446666662 wait complete. 2024-04-26T23:41:33.691 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T23:41:33.692 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:33.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.822+0000 7fb6aa000640 1 Processor -- start 2024-04-26T23:41:33.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.822+0000 7fb6aa000640 1 -- start start 2024-04-26T23:41:33.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.822+0000 7fb6aa000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6a40d1ac0 0x7fb6a40b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:33.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.822+0000 7fb6aa000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb6a415d2b0 0x7fb6a40b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:33.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.822+0000 7fb6aa000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a40b1b30 con 0x7fb6a415ced0 2024-04-26T23:41:33.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.822+0000 7fb6aa000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb6a40b1e10 con 0x7fb6a415d2b0 2024-04-26T23:41:33.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.822+0000 7fb6aa000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb6a40b23f0 con 0x7fb6a40d1ac0 2024-04-26T23:41:33.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.822+0000 7fb6a3e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb6a415d2b0 0x7fb6a40b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:33.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.822+0000 7fb6a2a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6a40d1ac0 0x7fb6a40b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:33.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.822+0000 7fb6a3400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fb6a415ced0 0x7fb6a40d13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:42584/0 (socket says 172.21.15.137:42584) 2024-04-26T23:41:33.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.822+0000 7fb6a3e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb6a415d2b0 0x7fb6a40b12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:42416/0 (socket says 172.21.15.137:42416) 2024-04-26T23:41:33.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.822+0000 7fb6a3400640 1 -- 172.21.15.137:0/1448409487 learned_addr learned my addr 172.21.15.137:0/1448409487 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:33.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.822+0000 7fb6a3e00640 1 -- 172.21.15.137:0/1448409487 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6a40d1ac0 msgr2=0x7fb6a40b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:33.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.822+0000 7fb6a3e00640 1 --2- 172.21.15.137:0/1448409487 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6a40d1ac0 0x7fb6a40b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.822+0000 7fb6a3e00640 1 -- 172.21.15.137:0/1448409487 >> v1:172.21.15.170:6789/0 conn(0x7fb6a415ced0 legacy=0x7fb6a40d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:33.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.822+0000 7fb6a3e00640 1 -- 172.21.15.137:0/1448409487 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a40b26d0 con 0x7fb6a415d2b0 2024-04-26T23:41:33.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.822+0000 7fb6a2a00640 1 --2- 172.21.15.137:0/1448409487 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6a40d1ac0 0x7fb6a40b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:41:33.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.826+0000 7fb6a3e00640 1 --2- 172.21.15.137:0/1448409487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6a415d2b0 0x7fb6a40b12d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb69c0097c0 tx=0x7fb69c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63ede4249e844ecc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:33.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.826+0000 7fb6a2000640 1 -- 172.21.15.137:0/1448409487 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69c0b1070 con 0x7fb6a415d2b0 2024-04-26T23:41:33.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.826+0000 7fb6a2000640 1 -- 172.21.15.137:0/1448409487 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb69c0ac410 con 0x7fb6a415d2b0 2024-04-26T23:41:33.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.826+0000 7fb6a2000640 1 -- 172.21.15.137:0/1448409487 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69c0ac7e0 con 0x7fb6a415d2b0 2024-04-26T23:41:33.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.826+0000 7fb6aa000640 1 -- 172.21.15.137:0/1448409487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6a415d2b0 msgr2=0x7fb6a40b12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:33.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.826+0000 7fb6aa000640 1 --2- 172.21.15.137:0/1448409487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6a415d2b0 0x7fb6a40b12d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb69c0097c0 tx=0x7fb69c01c4a0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.826+0000 7fb6aa000640 1 -- 172.21.15.137:0/1448409487 shutdown_connections 2024-04-26T23:41:33.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.826+0000 7fb6aa000640 1 --2- 172.21.15.137:0/1448409487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6a415d2b0 0x7fb6a40b12d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.826+0000 7fb6aa000640 1 --2- 172.21.15.137:0/1448409487 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6a40d1ac0 0x7fb6a40b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.826+0000 7fb6aa000640 1 -- 172.21.15.137:0/1448409487 >> 172.21.15.137:0/1448409487 conn(0x7fb6a409ba60 msgr2=0x7fb6a409be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:33.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.826+0000 7fb6aa000640 1 -- 172.21.15.137:0/1448409487 shutdown_connections 2024-04-26T23:41:33.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.826+0000 7fb6aa000640 1 -- 172.21.15.137:0/1448409487 wait complete. 2024-04-26T23:41:33.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb6aa000640 1 Processor -- start 2024-04-26T23:41:33.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb6aa000640 1 -- start start 2024-04-26T23:41:33.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb6aa000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6a40d1ac0 0x7fb6a40c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:33.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb6aa000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6a415ced0 0x7fb6a406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:33.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb6aa000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6a415d2b0 0x7fb6a406d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:33.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb6aa000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a40b3790 con 0x7fb6a415ced0 2024-04-26T23:41:33.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb6aa000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a40b3610 con 0x7fb6a40d1ac0 2024-04-26T23:41:33.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb6aa000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb6a40b3910 con 0x7fb6a415d2b0 2024-04-26T23:41:33.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb6a2a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6a415ced0 0x7fb6a406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:33.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb6a2a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6a415ced0 0x7fb6a406d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43096/0 (socket says 172.21.15.137:43096) 2024-04-26T23:41:33.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb6a2a00640 1 -- 172.21.15.137:0/1205481064 learned_addr learned my addr 172.21.15.137:0/1205481064 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:33.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb6a3400640 1 --2- 172.21.15.137:0/1205481064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6a40d1ac0 0x7fb6a40c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:33.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb6a3e00640 1 --2- 172.21.15.137:0/1205481064 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6a415d2b0 0x7fb6a406d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:33.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb6a2a00640 1 -- 172.21.15.137:0/1205481064 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6a415d2b0 msgr2=0x7fb6a406d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:33.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb6a2a00640 1 --2- 172.21.15.137:0/1205481064 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6a415d2b0 0x7fb6a406d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb6a2a00640 1 -- 172.21.15.137:0/1205481064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6a40d1ac0 msgr2=0x7fb6a40c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:33.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb6a2a00640 1 --2- 172.21.15.137:0/1205481064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6a40d1ac0 0x7fb6a40c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:33.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb6a2a00640 1 -- 172.21.15.137:0/1205481064 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a4165e50 con 0x7fb6a415ced0 2024-04-26T23:41:33.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb6a2a00640 1 --2- 172.21.15.137:0/1205481064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6a415ced0 0x7fb6a406d350 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb69000ebe0 tx=0x7fb69000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:33.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb69b400640 1 -- 172.21.15.137:0/1205481064 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb690017070 con 0x7fb6a415ced0 2024-04-26T23:41:33.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb69b400640 1 -- 172.21.15.137:0/1205481064 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb69000cc30 con 0x7fb6a415ced0 2024-04-26T23:41:33.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb6aa000640 1 -- 172.21.15.137:0/1205481064 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6a4166130 con 0x7fb6a415ced0 2024-04-26T23:41:33.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.830+0000 7fb69b400640 1 -- 172.21.15.137:0/1205481064 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb690013470 con 0x7fb6a415ced0 2024-04-26T23:41:33.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.834+0000 7fb6aa000640 1 -- 172.21.15.137:0/1205481064 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6a41666f0 con 0x7fb6a415ced0 2024-04-26T23:41:33.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.834+0000 7fb6aa000640 1 -- 172.21.15.137:0/1205481064 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6a406a4b0 con 0x7fb6a415ced0 2024-04-26T23:41:33.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.834+0000 7fb69b400640 1 -- 172.21.15.137:0/1205481064 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb69001a070 con 0x7fb6a415ced0 2024-04-26T23:41:33.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.834+0000 7fb69b400640 1 --2- 172.21.15.137:0/1205481064 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb684068380 0x7fb68406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:33.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.834+0000 7fb69b400640 1 -- 172.21.15.137:0/1205481064 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb690086d90 con 0x7fb6a415ced0 2024-04-26T23:41:33.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.834+0000 7fb6a3400640 1 --2- 172.21.15.137:0/1205481064 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb684068380 0x7fb68406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:33.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.834+0000 7fb6a3400640 1 --2- 172.21.15.137:0/1205481064 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb684068380 0x7fb68406a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb6940012f0 tx=0x7fb694009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:33.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.838+0000 7fb69b400640 1 -- 172.21.15.137:0/1205481064 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb6900572b0 con 0x7fb6a415ced0 2024-04-26T23:41:34.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.998+0000 7fb6aa000640 1 -- 172.21.15.137:0/1205481064 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6a409c7a0 con 0x7fb6a415ced0 2024-04-26T23:41:34.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:33.998+0000 7fb69b400640 1 -- 172.21.15.137:0/1205481064 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16653 (secure 0 0 0) 0x7fb690056bb0 con 0x7fb6a415ced0 2024-04-26T23:41:34.005 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:34.005 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:25.186308+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:34.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.002+0000 7fb6aa000640 1 -- 172.21.15.137:0/1205481064 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb684068380 msgr2=0x7fb68406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:34.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.002+0000 7fb6aa000640 1 --2- 172.21.15.137:0/1205481064 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb684068380 0x7fb68406a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb6940012f0 tx=0x7fb694009040 comp rx=0 tx=0).stop 2024-04-26T23:41:34.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.002+0000 7fb6aa000640 1 -- 172.21.15.137:0/1205481064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6a415ced0 msgr2=0x7fb6a406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:34.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.002+0000 7fb6aa000640 1 --2- 172.21.15.137:0/1205481064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6a415ced0 0x7fb6a406d350 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb69000ebe0 tx=0x7fb69000c520 comp rx=0 tx=0).stop 2024-04-26T23:41:34.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.002+0000 7fb6aa000640 1 -- 172.21.15.137:0/1205481064 shutdown_connections 2024-04-26T23:41:34.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.002+0000 7fb6aa000640 1 --2- 172.21.15.137:0/1205481064 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb684068380 0x7fb68406a840 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.002+0000 7fb6aa000640 1 --2- 172.21.15.137:0/1205481064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6a415ced0 0x7fb6a406d350 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.002+0000 7fb6aa000640 1 --2- 172.21.15.137:0/1205481064 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6a415d2b0 0x7fb6a406d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.002+0000 7fb6aa000640 1 --2- 172.21.15.137:0/1205481064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6a40d1ac0 0x7fb6a40c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.002+0000 7fb6aa000640 1 -- 172.21.15.137:0/1205481064 >> 172.21.15.137:0/1205481064 conn(0x7fb6a409ba60 msgr2=0x7fb6a4070250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:34.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.002+0000 7fb6aa000640 1 -- 172.21.15.137:0/1205481064 shutdown_connections 2024-04-26T23:41:34.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.002+0000 7fb6aa000640 1 -- 172.21.15.137:0/1205481064 wait complete. 2024-04-26T23:41:34.026 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:41:21.810449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:41:22.533452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:41:34.027 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:41:34.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.158+0000 7f540ec00640 1 Processor -- start 2024-04-26T23:41:34.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.158+0000 7f540ec00640 1 -- start start 2024-04-26T23:41:34.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.162+0000 7f540ec00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54080ceac0 0x7f540815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:34.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.162+0000 7f540ec00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5408072860 con 0x7f5408073f20 2024-04-26T23:41:34.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.162+0000 7f540ec00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54080743b0 con 0x7f54080afbc0 2024-04-26T23:41:34.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.162+0000 7f540ec00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5408072b00 con 0x7f54080ceac0 2024-04-26T23:41:34.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.162+0000 7f53ff400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f5408073f20 0x7f54080ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42970/0 (socket says 172.21.15.137:42970) 2024-04-26T23:41:34.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.162+0000 7f53ff400640 1 -- 172.21.15.137:0/3443161018 learned_addr learned my addr 172.21.15.137:0/3443161018 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:34.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.162+0000 7f540cc00640 1 --2- 172.21.15.137:0/3443161018 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54080ceac0 0x7f540815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:34.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.162+0000 7f5407400640 1 -- 172.21.15.137:0/3443161018 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1804280385 0 0) 0x7f5408072860 con 0x7f5408073f20 2024-04-26T23:41:34.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.162+0000 7f5407400640 1 -- 172.21.15.137:0/3443161018 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53ec003530 con 0x7f5408073f20 2024-04-26T23:41:34.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.162+0000 7f5407400640 1 -- 172.21.15.137:0/3443161018 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2935975580 0 0) 0x7f54080743b0 con 0x7f54080afbc0 2024-04-26T23:41:34.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.162+0000 7f5407400640 1 -- 172.21.15.137:0/3443161018 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5408072860 con 0x7f54080afbc0 2024-04-26T23:41:34.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.162+0000 7f540cc00640 1 -- 172.21.15.137:0/3443161018 >> v1:172.21.15.170:6789/0 conn(0x7f54080afbc0 legacy=0x7f54080735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:34.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.162+0000 7f5407400640 1 -- 172.21.15.137:0/3443161018 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 587682302 0 0) 0x7f53ec003530 con 0x7f5408073f20 2024-04-26T23:41:34.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.162+0000 7f540cc00640 1 -- 172.21.15.137:0/3443161018 >> v1:172.21.15.137:6789/0 conn(0x7f5408073f20 legacy=0x7f54080ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:34.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.162+0000 7f540cc00640 1 -- 172.21.15.137:0/3443161018 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5408072de0 con 0x7f54080ceac0 2024-04-26T23:41:34.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.166+0000 7f540cc00640 1 --2- 172.21.15.137:0/3443161018 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54080ceac0 0x7f540815df90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5400009820 tx=0x7f540001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2a600895645eccf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:34.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.166+0000 7f5407400640 1 -- 172.21.15.137:0/3443161018 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54000b0070 con 0x7f54080ceac0 2024-04-26T23:41:34.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.166+0000 7f5407400640 1 -- 172.21.15.137:0/3443161018 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54000ab400 con 0x7f54080ceac0 2024-04-26T23:41:34.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.166+0000 7f5407400640 1 -- 172.21.15.137:0/3443161018 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f00016a0 con 0x7f54080ceac0 2024-04-26T23:41:34.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.166+0000 7f540ec00640 1 -- 172.21.15.137:0/3443161018 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54080ceac0 msgr2=0x7f540815df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:34.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.166+0000 7f540ec00640 1 --2- 172.21.15.137:0/3443161018 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54080ceac0 0x7f540815df90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5400009820 tx=0x7f540001c3e0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.166+0000 7f540ec00640 1 -- 172.21.15.137:0/3443161018 shutdown_connections 2024-04-26T23:41:34.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.166+0000 7f540ec00640 1 --2- 172.21.15.137:0/3443161018 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54080ceac0 0x7f540815df90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.166+0000 7f540ec00640 1 -- 172.21.15.137:0/3443161018 >> 172.21.15.137:0/3443161018 conn(0x7f540806c800 msgr2=0x7f540806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:34.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.166+0000 7f540ec00640 1 -- 172.21.15.137:0/3443161018 shutdown_connections 2024-04-26T23:41:34.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.166+0000 7f540ec00640 1 -- 172.21.15.137:0/3443161018 wait complete. 2024-04-26T23:41:34.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.166+0000 7f540ec00640 1 Processor -- start 2024-04-26T23:41:34.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.166+0000 7f540ec00640 1 -- start start 2024-04-26T23:41:34.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.166+0000 7f540ec00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54080afbc0 0x7f5408154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:34.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.166+0000 7f540ec00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54080ceac0 0x7f540814a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:34.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.166+0000 7f540ec00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54080ab280 0x7f540814f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:34.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.166+0000 7f540ec00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f540806ffe0 con 0x7f54080ceac0 2024-04-26T23:41:34.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.166+0000 7f540ec00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f54080b01f0 con 0x7f54080afbc0 2024-04-26T23:41:34.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.166+0000 7f540ec00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5408070160 con 0x7f54080ab280 2024-04-26T23:41:34.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.166+0000 7f53ff400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54080ceac0 0x7f540814a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:34.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.166+0000 7f53ff400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54080ceac0 0x7f540814a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43098/0 (socket says 172.21.15.137:43098) 2024-04-26T23:41:34.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.166+0000 7f53ff400640 1 -- 172.21.15.137:0/3134462381 learned_addr learned my addr 172.21.15.137:0/3134462381 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:34.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.170+0000 7f5407e00640 1 --2- 172.21.15.137:0/3134462381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54080afbc0 0x7f5408154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:34.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.170+0000 7f53ff400640 1 -- 172.21.15.137:0/3134462381 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54080ab280 msgr2=0x7f540814f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:34.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.170+0000 7f540cc00640 1 --2- 172.21.15.137:0/3134462381 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54080ab280 0x7f540814f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:34.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.170+0000 7f53ff400640 1 --2- 172.21.15.137:0/3134462381 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54080ab280 0x7f540814f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.170+0000 7f53ff400640 1 -- 172.21.15.137:0/3134462381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54080afbc0 msgr2=0x7f5408154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:34.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.170+0000 7f53ff400640 1 --2- 172.21.15.137:0/3134462381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54080afbc0 0x7f5408154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.170+0000 7f53ff400640 1 -- 172.21.15.137:0/3134462381 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5408155520 con 0x7f54080ceac0 2024-04-26T23:41:34.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.170+0000 7f5407e00640 1 --2- 172.21.15.137:0/3134462381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54080afbc0 0x7f5408154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:34.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.170+0000 7f540cc00640 1 --2- 172.21.15.137:0/3134462381 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54080ab280 0x7f540814f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:34.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.170+0000 7f53ff400640 1 --2- 172.21.15.137:0/3134462381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54080ceac0 0x7f540814a6a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f53f000c520 tx=0x7f53f000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:34.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.170+0000 7f5404c00640 1 -- 172.21.15.137:0/3134462381 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f0018070 con 0x7f54080ceac0 2024-04-26T23:41:34.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.170+0000 7f5404c00640 1 -- 172.21.15.137:0/3134462381 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f00074e0 con 0x7f54080ceac0 2024-04-26T23:41:34.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.170+0000 7f540ec00640 1 -- 172.21.15.137:0/3134462381 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5408155800 con 0x7f54080ceac0 2024-04-26T23:41:34.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.170+0000 7f5404c00640 1 -- 172.21.15.137:0/3134462381 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f0004a10 con 0x7f54080ceac0 2024-04-26T23:41:34.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.170+0000 7f540ec00640 1 -- 172.21.15.137:0/3134462381 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5408155dc0 con 0x7f54080ceac0 2024-04-26T23:41:34.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.170+0000 7f540ec00640 1 -- 172.21.15.137:0/3134462381 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f540806a410 con 0x7f54080ceac0 2024-04-26T23:41:34.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.170+0000 7f5404c00640 1 -- 172.21.15.137:0/3134462381 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f53f001b070 con 0x7f54080ceac0 2024-04-26T23:41:34.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.170+0000 7f5404c00640 1 --2- 172.21.15.137:0/3134462381 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f53e4068380 0x7f53e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:34.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.170+0000 7f5404c00640 1 -- 172.21.15.137:0/3134462381 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f53f0085d80 con 0x7f54080ceac0 2024-04-26T23:41:34.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.174+0000 7f5407e00640 1 --2- 172.21.15.137:0/3134462381 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f53e4068380 0x7f53e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:34.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.174+0000 7f5407e00640 1 --2- 172.21.15.137:0/3134462381 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f53e4068380 0x7f53e406a840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f53f8001570 tx=0x7f53f8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:34.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.178+0000 7f5404c00640 1 -- 172.21.15.137:0/3134462381 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f53f0056340 con 0x7f54080ceac0 2024-04-26T23:41:34.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.338+0000 7f540ec00640 1 -- 172.21.15.137:0/3134462381 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f54080744b0 con 0x7f54080ceac0 2024-04-26T23:41:34.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.338+0000 7f5404c00640 1 -- 172.21.15.137:0/3134462381 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f53f0055c40 con 0x7f54080ceac0 2024-04-26T23:41:34.343 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:41:34.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.338+0000 7f540ec00640 1 -- 172.21.15.137:0/3134462381 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f53e4068380 msgr2=0x7f53e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:34.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.338+0000 7f540ec00640 1 --2- 172.21.15.137:0/3134462381 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f53e4068380 0x7f53e406a840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f53f8001570 tx=0x7f53f8009040 comp rx=0 tx=0).stop 2024-04-26T23:41:34.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.338+0000 7f540ec00640 1 -- 172.21.15.137:0/3134462381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54080ceac0 msgr2=0x7f540814a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:34.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.338+0000 7f540ec00640 1 --2- 172.21.15.137:0/3134462381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54080ceac0 0x7f540814a6a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f53f000c520 tx=0x7f53f000c9e0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.338+0000 7f540ec00640 1 -- 172.21.15.137:0/3134462381 shutdown_connections 2024-04-26T23:41:34.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.338+0000 7f540ec00640 1 --2- 172.21.15.137:0/3134462381 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f53e4068380 0x7f53e406a840 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.338+0000 7f540ec00640 1 --2- 172.21.15.137:0/3134462381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54080ceac0 0x7f540814a6a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.338+0000 7f540ec00640 1 --2- 172.21.15.137:0/3134462381 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54080ab280 0x7f540814f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.338+0000 7f540ec00640 1 --2- 172.21.15.137:0/3134462381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54080afbc0 0x7f5408154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.338+0000 7f540ec00640 1 -- 172.21.15.137:0/3134462381 >> 172.21.15.137:0/3134462381 conn(0x7f540806c800 msgr2=0x7f54080ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:34.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.338+0000 7f540ec00640 1 -- 172.21.15.137:0/3134462381 shutdown_connections 2024-04-26T23:41:34.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.338+0000 7f540ec00640 1 -- 172.21.15.137:0/3134462381 wait complete. 2024-04-26T23:41:34.365 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:41:34.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.498+0000 7f82db000640 1 Processor -- start 2024-04-26T23:41:34.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.498+0000 7f82db000640 1 -- start start 2024-04-26T23:41:34.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.498+0000 7f82db000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82d40b6150 0x7f82d40b1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:34.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.498+0000 7f82db000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82d415f600 con 0x7f82d40b4f30 2024-04-26T23:41:34.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.498+0000 7f82db000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82d40b0a10 con 0x7f82d415f220 2024-04-26T23:41:34.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.498+0000 7f82db000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f82d4163b50 con 0x7f82d40b6150 2024-04-26T23:41:34.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.498+0000 7f82cb400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f82d40b4f30 0x7f82d40b5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42972/0 (socket says 172.21.15.137:42972) 2024-04-26T23:41:34.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.498+0000 7f82cb400640 1 -- 172.21.15.137:0/3870596078 learned_addr learned my addr 172.21.15.137:0/3870596078 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:34.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.498+0000 7f82d9000640 1 --2- 172.21.15.137:0/3870596078 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82d40b6150 0x7f82d40b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:34.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.498+0000 7f82d3400640 1 -- 172.21.15.137:0/3870596078 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1210326561 0 0) 0x7f82bc001120 con 0x7f82d40b4f30 2024-04-26T23:41:34.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.498+0000 7f82d3400640 1 -- 172.21.15.137:0/3870596078 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82b8003530 con 0x7f82d40b4f30 2024-04-26T23:41:34.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.498+0000 7f82d3400640 1 -- 172.21.15.137:0/3870596078 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3019214878 0 0) 0x7f82d40b0a10 con 0x7f82d415f220 2024-04-26T23:41:34.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.498+0000 7f82d3400640 1 -- 172.21.15.137:0/3870596078 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82bc001120 con 0x7f82d415f220 2024-04-26T23:41:34.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.498+0000 7f82d3400640 1 -- 172.21.15.137:0/3870596078 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2215494789 0 0) 0x7f82b8003530 con 0x7f82d40b4f30 2024-04-26T23:41:34.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.498+0000 7f82d9000640 1 -- 172.21.15.137:0/3870596078 >> v1:172.21.15.170:6789/0 conn(0x7f82d415f220 legacy=0x7f82d40b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:34.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.498+0000 7f82d9000640 1 -- 172.21.15.137:0/3870596078 >> v1:172.21.15.137:6789/0 conn(0x7f82d40b4f30 legacy=0x7f82d40b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:34.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.498+0000 7f82d9000640 1 -- 172.21.15.137:0/3870596078 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d40af820 con 0x7f82d40b6150 2024-04-26T23:41:34.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.502+0000 7f82d9000640 1 --2- 172.21.15.137:0/3870596078 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82d40b6150 0x7f82d40b1520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009dc0 tx=0x7f82cc01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e33801d75747e6f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:34.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.502+0000 7f82d3400640 1 -- 172.21.15.137:0/3870596078 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0b2070 con 0x7f82d40b6150 2024-04-26T23:41:34.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.502+0000 7f82d3400640 1 -- 172.21.15.137:0/3870596078 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82cc0a5600 con 0x7f82d40b6150 2024-04-26T23:41:34.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.502+0000 7f82d3400640 1 -- 172.21.15.137:0/3870596078 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc001850 con 0x7f82d40b6150 2024-04-26T23:41:34.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.502+0000 7f82db000640 1 -- 172.21.15.137:0/3870596078 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82d40b6150 msgr2=0x7f82d40b1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:34.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.502+0000 7f82db000640 1 --2- 172.21.15.137:0/3870596078 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82d40b6150 0x7f82d40b1520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009dc0 tx=0x7f82cc01c8b0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.502+0000 7f82db000640 1 -- 172.21.15.137:0/3870596078 shutdown_connections 2024-04-26T23:41:34.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.502+0000 7f82db000640 1 --2- 172.21.15.137:0/3870596078 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82d40b6150 0x7f82d40b1520 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.502+0000 7f82db000640 1 -- 172.21.15.137:0/3870596078 >> 172.21.15.137:0/3870596078 conn(0x7f82d4073f50 msgr2=0x7f82d406c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:34.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.502+0000 7f82db000640 1 -- 172.21.15.137:0/3870596078 shutdown_connections 2024-04-26T23:41:34.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.502+0000 7f82db000640 1 -- 172.21.15.137:0/3870596078 wait complete. 2024-04-26T23:41:34.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82db000640 1 Processor -- start 2024-04-26T23:41:34.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82db000640 1 -- start start 2024-04-26T23:41:34.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82db000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82d40b4f30 0x7f82d4154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:34.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82db000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82d40b6150 0x7f82d4152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:34.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82db000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82d415f220 0x7f82d406fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:34.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82db000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f82d416d290 con 0x7f82d40b4f30 2024-04-26T23:41:34.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82db000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f82d416d110 con 0x7f82d415f220 2024-04-26T23:41:34.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82db000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f82d416d410 con 0x7f82d40b6150 2024-04-26T23:41:34.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82d3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82d40b4f30 0x7f82d4154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:34.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82d3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82d40b4f30 0x7f82d4154070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43108/0 (socket says 172.21.15.137:43108) 2024-04-26T23:41:34.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82d3e00640 1 -- 172.21.15.137:0/579696314 learned_addr learned my addr 172.21.15.137:0/579696314 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:34.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82cb400640 1 --2- 172.21.15.137:0/579696314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82d40b6150 0x7f82d4152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:34.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82d9000640 1 --2- 172.21.15.137:0/579696314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82d415f220 0x7f82d406fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:34.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82d3e00640 1 -- 172.21.15.137:0/579696314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82d40b6150 msgr2=0x7f82d4152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:34.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82d3e00640 1 --2- 172.21.15.137:0/579696314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82d40b6150 0x7f82d4152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82d3e00640 1 -- 172.21.15.137:0/579696314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82d415f220 msgr2=0x7f82d406fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:34.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82d3e00640 1 --2- 172.21.15.137:0/579696314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82d415f220 0x7f82d406fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82d3e00640 1 -- 172.21.15.137:0/579696314 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d4151b70 con 0x7f82d40b4f30 2024-04-26T23:41:34.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82d3e00640 1 --2- 172.21.15.137:0/579696314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82d40b4f30 0x7f82d4154070 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f82c400c460 tx=0x7f82c400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:34.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82d0c00640 1 -- 172.21.15.137:0/579696314 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c4017070 con 0x7f82d40b4f30 2024-04-26T23:41:34.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82d0c00640 1 -- 172.21.15.137:0/579696314 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c40052f0 con 0x7f82d40b4f30 2024-04-26T23:41:34.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82d0c00640 1 -- 172.21.15.137:0/579696314 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c4003840 con 0x7f82d40b4f30 2024-04-26T23:41:34.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82db000640 1 -- 172.21.15.137:0/579696314 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d4155df0 con 0x7f82d40b4f30 2024-04-26T23:41:34.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82db000640 1 -- 172.21.15.137:0/579696314 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d41563b0 con 0x7f82d40b4f30 2024-04-26T23:41:34.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.506+0000 7f82db000640 1 -- 172.21.15.137:0/579696314 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d406a410 con 0x7f82d40b4f30 2024-04-26T23:41:34.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.510+0000 7f82d0c00640 1 -- 172.21.15.137:0/579696314 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f82c401a070 con 0x7f82d40b4f30 2024-04-26T23:41:34.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.510+0000 7f82d0c00640 1 --2- 172.21.15.137:0/579696314 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f82b00683b0 0x7f82b006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:34.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.510+0000 7f82d0c00640 1 -- 172.21.15.137:0/579696314 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f82c4085d50 con 0x7f82d40b4f30 2024-04-26T23:41:34.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.510+0000 7f82cb400640 1 --2- 172.21.15.137:0/579696314 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f82b00683b0 0x7f82b006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:34.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.510+0000 7f82cb400640 1 --2- 172.21.15.137:0/579696314 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f82b00683b0 0x7f82b006a870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f82d4157a90 tx=0x7f82bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:34.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.514+0000 7f82d0c00640 1 -- 172.21.15.137:0/579696314 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f82c4089030 con 0x7f82d40b4f30 2024-04-26T23:41:34.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.670+0000 7f82db000640 1 -- 172.21.15.137:0/579696314 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f82d4163350 con 0x7f82d40b4f30 2024-04-26T23:41:34.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.674+0000 7f82d0c00640 1 -- 172.21.15.137:0/579696314 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f82c4056310 con 0x7f82d40b4f30 2024-04-26T23:41:34.679 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:41:34.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.674+0000 7f82db000640 1 -- 172.21.15.137:0/579696314 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f82b00683b0 msgr2=0x7f82b006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:34.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.674+0000 7f82db000640 1 --2- 172.21.15.137:0/579696314 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f82b00683b0 0x7f82b006a870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f82d4157a90 tx=0x7f82bc009040 comp rx=0 tx=0).stop 2024-04-26T23:41:34.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.674+0000 7f82db000640 1 -- 172.21.15.137:0/579696314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82d40b4f30 msgr2=0x7f82d4154070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:34.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.674+0000 7f82db000640 1 --2- 172.21.15.137:0/579696314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82d40b4f30 0x7f82d4154070 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f82c400c460 tx=0x7f82c400c920 comp rx=0 tx=0).stop 2024-04-26T23:41:34.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.674+0000 7f82db000640 1 -- 172.21.15.137:0/579696314 shutdown_connections 2024-04-26T23:41:34.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.674+0000 7f82db000640 1 --2- 172.21.15.137:0/579696314 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f82b00683b0 0x7f82b006a870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.674+0000 7f82db000640 1 --2- 172.21.15.137:0/579696314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82d415f220 0x7f82d406fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.674+0000 7f82db000640 1 --2- 172.21.15.137:0/579696314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82d40b6150 0x7f82d4152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.674+0000 7f82db000640 1 --2- 172.21.15.137:0/579696314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82d40b4f30 0x7f82d4154070 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.674+0000 7f82db000640 1 -- 172.21.15.137:0/579696314 >> 172.21.15.137:0/579696314 conn(0x7f82d4073f50 msgr2=0x7f82d40b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:34.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.674+0000 7f82db000640 1 -- 172.21.15.137:0/579696314 shutdown_connections 2024-04-26T23:41:34.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.674+0000 7f82db000640 1 -- 172.21.15.137:0/579696314 wait complete. 2024-04-26T23:41:34.699 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:41:34.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.830+0000 7f4d20200640 1 Processor -- start 2024-04-26T23:41:34.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.830+0000 7f4d20200640 1 -- start start 2024-04-26T23:41:34.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.830+0000 7f4d20200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4d1806d370 0x7f4d180b2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:34.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.830+0000 7f4d20200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d1806c610 0x7f4d180cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:34.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.830+0000 7f4d20200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d180d0680 con 0x7f4d1815f4d0 2024-04-26T23:41:34.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.830+0000 7f4d20200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4d180d0f80 con 0x7f4d1806d370 2024-04-26T23:41:34.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.830+0000 7f4d20200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4d180cfbb0 con 0x7f4d1806c610 2024-04-26T23:41:34.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.830+0000 7f4d1ce00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4d1806d370 0x7f4d180b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:34.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.830+0000 7f4d1d800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4d1815f4d0 0x7f4d1806cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42984/0 (socket says 172.21.15.137:42984) 2024-04-26T23:41:34.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.830+0000 7f4d1d800640 1 -- 172.21.15.137:0/4088814180 learned_addr learned my addr 172.21.15.137:0/4088814180 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:34.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.830+0000 7f4d1e200640 1 --2- 172.21.15.137:0/4088814180 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d1806c610 0x7f4d180cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:34.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.830+0000 7f4d17e00640 1 -- 172.21.15.137:0/4088814180 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 275087225 0 0) 0x7f4d180d0680 con 0x7f4d1815f4d0 2024-04-26T23:41:34.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.830+0000 7f4d17e00640 1 -- 172.21.15.137:0/4088814180 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d00003530 con 0x7f4d1815f4d0 2024-04-26T23:41:34.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.830+0000 7f4d1ce00640 1 -- 172.21.15.137:0/4088814180 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d1806c610 msgr2=0x7f4d180cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:34.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.830+0000 7f4d1ce00640 1 --2- 172.21.15.137:0/4088814180 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d1806c610 0x7f4d180cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.830+0000 7f4d1ce00640 1 -- 172.21.15.137:0/4088814180 >> v1:172.21.15.137:6789/0 conn(0x7f4d1815f4d0 legacy=0x7f4d1806cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:34.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.830+0000 7f4d1ce00640 1 -- 172.21.15.137:0/4088814180 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d180cfde0 con 0x7f4d1806d370 2024-04-26T23:41:34.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.830+0000 7f4d1e200640 1 --2- 172.21.15.137:0/4088814180 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d1806c610 0x7f4d180cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:34.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.834+0000 7f4d1ce00640 1 --2- 172.21.15.137:0/4088814180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d1806d370 0x7f4d180b2750 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4d040097c0 tx=0x7f4d0401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a70f623529b63adf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:34.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.834+0000 7f4d17e00640 1 -- 172.21.15.137:0/4088814180 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d040b1070 con 0x7f4d1806d370 2024-04-26T23:41:34.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.834+0000 7f4d17e00640 1 -- 172.21.15.137:0/4088814180 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d040ac410 con 0x7f4d1806d370 2024-04-26T23:41:34.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.834+0000 7f4d17e00640 1 -- 172.21.15.137:0/4088814180 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d040ac7c0 con 0x7f4d1806d370 2024-04-26T23:41:34.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.834+0000 7f4d20200640 1 -- 172.21.15.137:0/4088814180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d1806d370 msgr2=0x7f4d180b2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:34.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.834+0000 7f4d20200640 1 --2- 172.21.15.137:0/4088814180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d1806d370 0x7f4d180b2750 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4d040097c0 tx=0x7f4d0401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.834+0000 7f4d20200640 1 -- 172.21.15.137:0/4088814180 shutdown_connections 2024-04-26T23:41:34.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.834+0000 7f4d20200640 1 --2- 172.21.15.137:0/4088814180 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d1806c610 0x7f4d180cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.834+0000 7f4d20200640 1 --2- 172.21.15.137:0/4088814180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d1806d370 0x7f4d180b2750 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.834+0000 7f4d20200640 1 -- 172.21.15.137:0/4088814180 >> 172.21.15.137:0/4088814180 conn(0x7f4d1809ba60 msgr2=0x7f4d1809be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:34.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.834+0000 7f4d20200640 1 -- 172.21.15.137:0/4088814180 shutdown_connections 2024-04-26T23:41:34.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.834+0000 7f4d20200640 1 -- 172.21.15.137:0/4088814180 wait complete. 2024-04-26T23:41:34.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d20200640 1 Processor -- start 2024-04-26T23:41:34.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d20200640 1 -- start start 2024-04-26T23:41:34.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d20200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d1806c610 0x7f4d1814d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:34.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d20200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d1806d370 0x7f4d18155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:34.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d20200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d1815f4d0 0x7f4d18155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:34.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d20200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4d180d2060 con 0x7f4d1806d370 2024-04-26T23:41:34.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d20200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4d180d1ee0 con 0x7f4d1815f4d0 2024-04-26T23:41:34.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d20200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4d180d21e0 con 0x7f4d1806c610 2024-04-26T23:41:34.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d1ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d1806d370 0x7f4d18155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:34.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d1ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d1806d370 0x7f4d18155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43130/0 (socket says 172.21.15.137:43130) 2024-04-26T23:41:34.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d1ce00640 1 -- 172.21.15.137:0/3713675580 learned_addr learned my addr 172.21.15.137:0/3713675580 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:34.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d1d800640 1 --2- 172.21.15.137:0/3713675580 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d1806c610 0x7f4d1814d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:34.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d1e200640 1 --2- 172.21.15.137:0/3713675580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d1815f4d0 0x7f4d18155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:34.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d1ce00640 1 -- 172.21.15.137:0/3713675580 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d1806c610 msgr2=0x7f4d1814d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:34.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d1ce00640 1 --2- 172.21.15.137:0/3713675580 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d1806c610 0x7f4d1814d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d1ce00640 1 -- 172.21.15.137:0/3713675580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d1815f4d0 msgr2=0x7f4d18155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:34.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d1ce00640 1 --2- 172.21.15.137:0/3713675580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d1815f4d0 0x7f4d18155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:34.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d1ce00640 1 -- 172.21.15.137:0/3713675580 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1814fbf0 con 0x7f4d1806d370 2024-04-26T23:41:34.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d1e200640 1 --2- 172.21.15.137:0/3713675580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d1815f4d0 0x7f4d18155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:34.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d1d800640 1 --2- 172.21.15.137:0/3713675580 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d1806c610 0x7f4d1814d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:34.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d1ce00640 1 --2- 172.21.15.137:0/3713675580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d1806d370 0x7f4d18155890 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4d040af040 tx=0x7f4d04019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:34.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d15600640 1 -- 172.21.15.137:0/3713675580 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d040b1040 con 0x7f4d1806d370 2024-04-26T23:41:34.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d15600640 1 -- 172.21.15.137:0/3713675580 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d040acd70 con 0x7f4d1806d370 2024-04-26T23:41:34.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d20200640 1 -- 172.21.15.137:0/3713675580 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d180b1080 con 0x7f4d1806d370 2024-04-26T23:41:34.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d15600640 1 -- 172.21.15.137:0/3713675580 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d040b5410 con 0x7f4d1806d370 2024-04-26T23:41:34.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.838+0000 7f4d20200640 1 -- 172.21.15.137:0/3713675580 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d180b1600 con 0x7f4d1806d370 2024-04-26T23:41:34.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.842+0000 7f4d20200640 1 -- 172.21.15.137:0/3713675580 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d1806a410 con 0x7f4d1806d370 2024-04-26T23:41:34.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.842+0000 7f4d15600640 1 -- 172.21.15.137:0/3713675580 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4d040bd020 con 0x7f4d1806d370 2024-04-26T23:41:34.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.842+0000 7f4d15600640 1 --2- 172.21.15.137:0/3713675580 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4cf8068380 0x7f4cf806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:34.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.842+0000 7f4d15600640 1 -- 172.21.15.137:0/3713675580 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4d0411fc10 con 0x7f4d1806d370 2024-04-26T23:41:34.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.842+0000 7f4d1d800640 1 --2- 172.21.15.137:0/3713675580 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4cf8068380 0x7f4cf806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:34.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.842+0000 7f4d1d800640 1 --2- 172.21.15.137:0/3713675580 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4cf8068380 0x7f4cf806a840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c005890 tx=0x7f4d0c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:34.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:34.846+0000 7f4d15600640 1 -- 172.21.15.137:0/3713675580 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4d040c4020 con 0x7f4d1806d370 2024-04-26T23:41:35.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.006+0000 7f4d20200640 1 -- 172.21.15.137:0/3713675580 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4d180706d0 con 0x7f4d1806d370 2024-04-26T23:41:35.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.006+0000 7f4d15600640 1 -- 172.21.15.137:0/3713675580 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f4d1814fbf0 con 0x7f4d1806d370 2024-04-26T23:41:35.012 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:41:35.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.006+0000 7f4d20200640 1 -- 172.21.15.137:0/3713675580 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4cf8068380 msgr2=0x7f4cf806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:35.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.006+0000 7f4d20200640 1 --2- 172.21.15.137:0/3713675580 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4cf8068380 0x7f4cf806a840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c005890 tx=0x7f4d0c009040 comp rx=0 tx=0).stop 2024-04-26T23:41:35.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.006+0000 7f4d20200640 1 -- 172.21.15.137:0/3713675580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d1806d370 msgr2=0x7f4d18155890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:35.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.006+0000 7f4d20200640 1 --2- 172.21.15.137:0/3713675580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d1806d370 0x7f4d18155890 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4d040af040 tx=0x7f4d04019240 comp rx=0 tx=0).stop 2024-04-26T23:41:35.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.006+0000 7f4d20200640 1 -- 172.21.15.137:0/3713675580 shutdown_connections 2024-04-26T23:41:35.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.006+0000 7f4d20200640 1 --2- 172.21.15.137:0/3713675580 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4cf8068380 0x7f4cf806a840 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.006+0000 7f4d20200640 1 --2- 172.21.15.137:0/3713675580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d1806d370 0x7f4d18155890 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.006+0000 7f4d20200640 1 --2- 172.21.15.137:0/3713675580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d1815f4d0 0x7f4d18155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.006+0000 7f4d20200640 1 --2- 172.21.15.137:0/3713675580 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d1806c610 0x7f4d1814d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.006+0000 7f4d20200640 1 -- 172.21.15.137:0/3713675580 >> 172.21.15.137:0/3713675580 conn(0x7f4d1809ba60 msgr2=0x7f4d1809be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:35.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.006+0000 7f4d20200640 1 -- 172.21.15.137:0/3713675580 shutdown_connections 2024-04-26T23:41:35.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.006+0000 7f4d20200640 1 -- 172.21.15.137:0/3713675580 wait complete. 2024-04-26T23:41:35.033 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:41:35.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.162+0000 7fa703600640 1 Processor -- start 2024-04-26T23:41:35.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.162+0000 7fa703600640 1 -- start start 2024-04-26T23:41:35.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.162+0000 7fa703600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa6fc0b4100 0x7fa6fc0d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:35.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.162+0000 7fa703600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6fc0d2d80 0x7fa6fc0d31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:35.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.162+0000 7fa703600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6fc160240 con 0x7fa6fc15f3d0 2024-04-26T23:41:35.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.162+0000 7fa703600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fa6fc0d3710 con 0x7fa6fc0b4100 2024-04-26T23:41:35.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.162+0000 7fa703600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa6fc0b2960 con 0x7fa6fc0d2d80 2024-04-26T23:41:35.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.162+0000 7fa6f3e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa6fc0b4100 0x7fa6fc0d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:35.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.162+0000 7fa701600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6fc0d2d80 0x7fa6fc0d31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:35.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.162+0000 7fa700c00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fa6fc15f3d0 0x7fa6fc15f7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:42618/0 (socket says 172.21.15.137:42618) 2024-04-26T23:41:35.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.162+0000 7fa701600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6fc0d2d80 0x7fa6fc0d31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:36738/0 (socket says 172.21.15.137:36738) 2024-04-26T23:41:35.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.162+0000 7fa700c00640 1 -- 172.21.15.137:0/1979257314 learned_addr learned my addr 172.21.15.137:0/1979257314 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:35.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.162+0000 7fa6f3e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa6fc0b4100 0x7fa6fc0d1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:42454/0 (socket says 172.21.15.137:42454) 2024-04-26T23:41:35.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.162+0000 7fa6f3e00640 1 -- 172.21.15.137:0/1979257314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6fc0d2d80 msgr2=0x7fa6fc0d31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:35.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.162+0000 7fa6f3e00640 1 --2- 172.21.15.137:0/1979257314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6fc0d2d80 0x7fa6fc0d31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.162+0000 7fa6f3e00640 1 -- 172.21.15.137:0/1979257314 >> v1:172.21.15.170:6789/0 conn(0x7fa6fc15f3d0 legacy=0x7fa6fc15f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:35.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.162+0000 7fa6f3e00640 1 -- 172.21.15.137:0/1979257314 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6fc160520 con 0x7fa6fc0b4100 2024-04-26T23:41:35.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.162+0000 7fa6fbe00640 1 -- 172.21.15.137:0/1979257314 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2411366040 0 0) 0x7fa6fc160240 con 0x7fa6fc15f3d0 2024-04-26T23:41:35.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.166+0000 7fa6f3e00640 1 --2- 172.21.15.137:0/1979257314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6fc0b4100 0x7fa6fc0d1030 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa6e40097c0 tx=0x7fa6e401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae66ee5315b81d13 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:35.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.166+0000 7fa6fbe00640 1 -- 172.21.15.137:0/1979257314 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e40b1070 con 0x7fa6fc0b4100 2024-04-26T23:41:35.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.166+0000 7fa6fbe00640 1 -- 172.21.15.137:0/1979257314 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6e40ac410 con 0x7fa6fc0b4100 2024-04-26T23:41:35.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.166+0000 7fa6fbe00640 1 -- 172.21.15.137:0/1979257314 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e40ac7e0 con 0x7fa6fc0b4100 2024-04-26T23:41:35.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.166+0000 7fa703600640 1 -- 172.21.15.137:0/1979257314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6fc0b4100 msgr2=0x7fa6fc0d1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:35.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.166+0000 7fa703600640 1 --2- 172.21.15.137:0/1979257314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6fc0b4100 0x7fa6fc0d1030 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa6e40097c0 tx=0x7fa6e401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.166+0000 7fa703600640 1 -- 172.21.15.137:0/1979257314 shutdown_connections 2024-04-26T23:41:35.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.166+0000 7fa703600640 1 --2- 172.21.15.137:0/1979257314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6fc0d2d80 0x7fa6fc0d31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.166+0000 7fa703600640 1 --2- 172.21.15.137:0/1979257314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6fc0b4100 0x7fa6fc0d1030 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.166+0000 7fa703600640 1 -- 172.21.15.137:0/1979257314 >> 172.21.15.137:0/1979257314 conn(0x7fa6fc09ba60 msgr2=0x7fa6fc09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:35.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.166+0000 7fa703600640 1 -- 172.21.15.137:0/1979257314 shutdown_connections 2024-04-26T23:41:35.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.166+0000 7fa703600640 1 -- 172.21.15.137:0/1979257314 wait complete. 2024-04-26T23:41:35.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa703600640 1 Processor -- start 2024-04-26T23:41:35.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa703600640 1 -- start start 2024-04-26T23:41:35.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa703600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6fc0b4100 0x7fa6fc0c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:35.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa703600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6fc0d2d80 0x7fa6fc15c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:35.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa703600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6fc15f3d0 0x7fa6fc1568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:35.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa703600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc0b39d0 con 0x7fa6fc0d2d80 2024-04-26T23:41:35.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa703600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc0b3850 con 0x7fa6fc15f3d0 2024-04-26T23:41:35.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa703600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa6fc0b3b50 con 0x7fa6fc0b4100 2024-04-26T23:41:35.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa6f3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6fc0d2d80 0x7fa6fc15c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa6f3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6fc0d2d80 0x7fa6fc15c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43132/0 (socket says 172.21.15.137:43132) 2024-04-26T23:41:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa6f3e00640 1 -- 172.21.15.137:0/397349090 learned_addr learned my addr 172.21.15.137:0/397349090 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa701600640 1 --2- 172.21.15.137:0/397349090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6fc15f3d0 0x7fa6fc1568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa700c00640 1 --2- 172.21.15.137:0/397349090 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6fc0b4100 0x7fa6fc0c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa6f3e00640 1 -- 172.21.15.137:0/397349090 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6fc0b4100 msgr2=0x7fa6fc0c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa6f3e00640 1 --2- 172.21.15.137:0/397349090 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6fc0b4100 0x7fa6fc0c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa6f3e00640 1 -- 172.21.15.137:0/397349090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6fc15f3d0 msgr2=0x7fa6fc1568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa6f3e00640 1 --2- 172.21.15.137:0/397349090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6fc15f3d0 0x7fa6fc1568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa6f3e00640 1 -- 172.21.15.137:0/397349090 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6fc0c6b30 con 0x7fa6fc0d2d80 2024-04-26T23:41:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa6f3e00640 1 --2- 172.21.15.137:0/397349090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6fc0d2d80 0x7fa6fc15c5d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa6e401a0d0 tx=0x7fa6e4019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa6f9600640 1 -- 172.21.15.137:0/397349090 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e40b9020 con 0x7fa6fc0d2d80 2024-04-26T23:41:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa6f9600640 1 -- 172.21.15.137:0/397349090 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6e40acd70 con 0x7fa6fc0d2d80 2024-04-26T23:41:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa703600640 1 -- 172.21.15.137:0/397349090 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6fc15ced0 con 0x7fa6fc0d2d80 2024-04-26T23:41:35.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.170+0000 7fa6f9600640 1 -- 172.21.15.137:0/397349090 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e40b1040 con 0x7fa6fc0d2d80 2024-04-26T23:41:35.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.174+0000 7fa703600640 1 -- 172.21.15.137:0/397349090 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6fc15d490 con 0x7fa6fc0d2d80 2024-04-26T23:41:35.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.174+0000 7fa703600640 1 -- 172.21.15.137:0/397349090 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6fc06a4b0 con 0x7fa6fc0d2d80 2024-04-26T23:41:35.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.174+0000 7fa6f9600640 1 -- 172.21.15.137:0/397349090 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa6e40bc020 con 0x7fa6fc0d2d80 2024-04-26T23:41:35.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.174+0000 7fa6f9600640 1 --2- 172.21.15.137:0/397349090 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa6d8068380 0x7fa6d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:35.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.174+0000 7fa6f9600640 1 -- 172.21.15.137:0/397349090 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa6e4120180 con 0x7fa6fc0d2d80 2024-04-26T23:41:35.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.174+0000 7fa700c00640 1 --2- 172.21.15.137:0/397349090 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa6d8068380 0x7fa6d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:35.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.174+0000 7fa700c00640 1 --2- 172.21.15.137:0/397349090 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa6d8068380 0x7fa6d806a840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec007fd0 tx=0x7fa6ec009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:35.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.178+0000 7fa6f9600640 1 -- 172.21.15.137:0/397349090 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa6e40c3030 con 0x7fa6fc0d2d80 2024-04-26T23:41:35.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.370+0000 7fa703600640 1 -- 172.21.15.137:0/397349090 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6fc0b24f0 con 0x7fa6fc0d2d80 2024-04-26T23:41:35.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.370+0000 7fa6f9600640 1 -- 172.21.15.137:0/397349090 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7fa6e4016090 con 0x7fa6fc0d2d80 2024-04-26T23:41:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:35.378 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/861150521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":861150521},{"type":"v1","addr":"172.21.15.137:6836","nonce":861150521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/980246912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":980246912},{"type":"v1","addr":"172.21.15.137:6837","nonce":980246912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3288315078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3288315078},{"type":"v1","addr":"172.21.15.170:6835","nonce":3288315078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:41:23.574363+0000","modified":"2024-04-26T23:41:26.591710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6834/2444921875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2444921875},{"type":"v1","addr":"172.21.15.170:6834","nonce":2444921875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-26T23:41:35.379 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 8 2024-04-26T23:41:35.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.374+0000 7fa703600640 1 -- 172.21.15.137:0/397349090 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa6d8068380 msgr2=0x7fa6d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:35.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.374+0000 7fa703600640 1 --2- 172.21.15.137:0/397349090 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa6d8068380 0x7fa6d806a840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec007fd0 tx=0x7fa6ec009040 comp rx=0 tx=0).stop 2024-04-26T23:41:35.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.374+0000 7fa703600640 1 -- 172.21.15.137:0/397349090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6fc0d2d80 msgr2=0x7fa6fc15c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:35.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.374+0000 7fa703600640 1 --2- 172.21.15.137:0/397349090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6fc0d2d80 0x7fa6fc15c5d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa6e401a0d0 tx=0x7fa6e4019240 comp rx=0 tx=0).stop 2024-04-26T23:41:35.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.374+0000 7fa703600640 1 -- 172.21.15.137:0/397349090 shutdown_connections 2024-04-26T23:41:35.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.374+0000 7fa703600640 1 --2- 172.21.15.137:0/397349090 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa6d8068380 0x7fa6d806a840 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.374+0000 7fa703600640 1 --2- 172.21.15.137:0/397349090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6fc0d2d80 0x7fa6fc15c5d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.374+0000 7fa703600640 1 --2- 172.21.15.137:0/397349090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6fc15f3d0 0x7fa6fc1568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.374+0000 7fa703600640 1 --2- 172.21.15.137:0/397349090 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6fc0b4100 0x7fa6fc0c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.374+0000 7fa703600640 1 -- 172.21.15.137:0/397349090 >> 172.21.15.137:0/397349090 conn(0x7fa6fc09ba60 msgr2=0x7fa6fc071810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:35.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.374+0000 7fa703600640 1 -- 172.21.15.137:0/397349090 shutdown_connections 2024-04-26T23:41:35.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.374+0000 7fa703600640 1 -- 172.21.15.137:0/397349090 wait complete. 2024-04-26T23:41:35.400 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:35.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.530+0000 7f4bc0600640 1 Processor -- start 2024-04-26T23:41:35.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.530+0000 7f4bc0600640 1 -- start start 2024-04-26T23:41:35.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.530+0000 7f4bc0600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4bb815ced0 0x7f4bb80d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:35.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.530+0000 7f4bc0600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4bb815d2b0 0x7f4bb80d18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:35.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.530+0000 7f4bc0600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bb80b1b30 con 0x7f4bb80b0d90 2024-04-26T23:41:35.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.530+0000 7f4bc0600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4bb80b18f0 con 0x7f4bb815ced0 2024-04-26T23:41:35.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.530+0000 7f4bc0600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f4bb80b1e10 con 0x7f4bb815d2b0 2024-04-26T23:41:35.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.530+0000 7f4bbdc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4bb815ced0 0x7f4bb80d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:35.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.530+0000 7f4bbe600640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4bb80b0d90 0x7f4bb80b11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42996/0 (socket says 172.21.15.137:42996) 2024-04-26T23:41:35.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.530+0000 7f4bbe600640 1 -- 172.21.15.137:0/2007628269 learned_addr learned my addr 172.21.15.137:0/2007628269 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:35.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.530+0000 7f4bbd200640 1 --2- 172.21.15.137:0/2007628269 >> v2:172.21.15.170:3300/0 conn(0x7f4bb815d2b0 0x7f4bb80d18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:35.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.530+0000 7f4bbdc00640 1 -- 172.21.15.137:0/2007628269 >> v2:172.21.15.170:3300/0 conn(0x7f4bb815d2b0 msgr2=0x7f4bb80d18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:35.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.530+0000 7f4bbdc00640 1 --2- 172.21.15.137:0/2007628269 >> v2:172.21.15.170:3300/0 conn(0x7f4bb815d2b0 0x7f4bb80d18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.530+0000 7f4bbdc00640 1 -- 172.21.15.137:0/2007628269 >> v1:172.21.15.137:6789/0 conn(0x7f4bb80b0d90 legacy=0x7f4bb80b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:35.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.530+0000 7f4bbdc00640 1 -- 172.21.15.137:0/2007628269 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb80b23f0 con 0x7f4bb815ced0 2024-04-26T23:41:35.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.530+0000 7f4bb7e00640 1 -- 172.21.15.137:0/2007628269 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3071132302 0 0) 0x7f4bb80b1b30 con 0x7f4bb80b0d90 2024-04-26T23:41:35.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.534+0000 7f4bbdc00640 1 --2- 172.21.15.137:0/2007628269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bb815ced0 0x7f4bb80d13b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8074450 tx=0x7f4bac01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4407a3e31313d4ff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:35.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.534+0000 7f4bb7e00640 1 -- 172.21.15.137:0/2007628269 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0b0070 con 0x7f4bb815ced0 2024-04-26T23:41:35.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.534+0000 7f4bb7e00640 1 -- 172.21.15.137:0/2007628269 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bac0ab600 con 0x7f4bb815ced0 2024-04-26T23:41:35.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.534+0000 7f4bb7e00640 1 -- 172.21.15.137:0/2007628269 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0ab9d0 con 0x7f4bb815ced0 2024-04-26T23:41:35.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.534+0000 7f4bc0600640 1 -- 172.21.15.137:0/2007628269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bb815ced0 msgr2=0x7f4bb80d13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:35.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.534+0000 7f4bc0600640 1 --2- 172.21.15.137:0/2007628269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bb815ced0 0x7f4bb80d13b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8074450 tx=0x7f4bac01c480 comp rx=0 tx=0).stop 2024-04-26T23:41:35.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.534+0000 7f4bc0600640 1 -- 172.21.15.137:0/2007628269 shutdown_connections 2024-04-26T23:41:35.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.534+0000 7f4bc0600640 1 --2- 172.21.15.137:0/2007628269 >> v2:172.21.15.170:3300/0 conn(0x7f4bb815d2b0 0x7f4bb80d18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.534+0000 7f4bc0600640 1 --2- 172.21.15.137:0/2007628269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bb815ced0 0x7f4bb80d13b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.534+0000 7f4bc0600640 1 -- 172.21.15.137:0/2007628269 >> 172.21.15.137:0/2007628269 conn(0x7f4bb809ba60 msgr2=0x7f4bb809be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:35.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.534+0000 7f4bc0600640 1 -- 172.21.15.137:0/2007628269 shutdown_connections 2024-04-26T23:41:35.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.534+0000 7f4bc0600640 1 -- 172.21.15.137:0/2007628269 wait complete. 2024-04-26T23:41:35.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bc0600640 1 Processor -- start 2024-04-26T23:41:35.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bc0600640 1 -- start start 2024-04-26T23:41:35.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bc0600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bb80b0d90 0x7f4bb80cea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:35.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bc0600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bb815ced0 0x7f4bb815a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:35.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bc0600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bb815d2b0 0x7f4bb80ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:35.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bc0600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb80b37d0 con 0x7f4bb815d2b0 2024-04-26T23:41:35.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bc0600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb80b3650 con 0x7f4bb815ced0 2024-04-26T23:41:35.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bc0600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb80b3950 con 0x7f4bb80b0d90 2024-04-26T23:41:35.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bbe600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bb815d2b0 0x7f4bb80ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:35.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bbe600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bb815d2b0 0x7f4bb80ca790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43138/0 (socket says 172.21.15.137:43138) 2024-04-26T23:41:35.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bbe600640 1 -- 172.21.15.137:0/1051297658 learned_addr learned my addr 172.21.15.137:0/1051297658 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:35.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bbdc00640 1 --2- 172.21.15.137:0/1051297658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bb80b0d90 0x7f4bb80cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:35.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bbd200640 1 --2- 172.21.15.137:0/1051297658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bb815ced0 0x7f4bb815a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:35.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bbe600640 1 -- 172.21.15.137:0/1051297658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bb80b0d90 msgr2=0x7f4bb80cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:35.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bbe600640 1 --2- 172.21.15.137:0/1051297658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bb80b0d90 0x7f4bb80cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bbe600640 1 -- 172.21.15.137:0/1051297658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bb815ced0 msgr2=0x7f4bb815a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:35.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bbe600640 1 --2- 172.21.15.137:0/1051297658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bb815ced0 0x7f4bb815a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bbe600640 1 -- 172.21.15.137:0/1051297658 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb80cf060 con 0x7f4bb815d2b0 2024-04-26T23:41:35.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bbe600640 1 --2- 172.21.15.137:0/1051297658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bb815d2b0 0x7f4bb80ca790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000c7a0 tx=0x7f4bb000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:35.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bb5600640 1 -- 172.21.15.137:0/1051297658 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0018070 con 0x7f4bb815d2b0 2024-04-26T23:41:35.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bb5600640 1 -- 172.21.15.137:0/1051297658 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb000a640 con 0x7f4bb815d2b0 2024-04-26T23:41:35.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bb5600640 1 -- 172.21.15.137:0/1051297658 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb000aab0 con 0x7f4bb815d2b0 2024-04-26T23:41:35.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bc0600640 1 -- 172.21.15.137:0/1051297658 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb80cf340 con 0x7f4bb815d2b0 2024-04-26T23:41:35.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bc0600640 1 -- 172.21.15.137:0/1051297658 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb80cb140 con 0x7f4bb815d2b0 2024-04-26T23:41:35.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.538+0000 7f4bc0600640 1 -- 172.21.15.137:0/1051297658 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bb80cf860 con 0x7f4bb815d2b0 2024-04-26T23:41:35.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.542+0000 7f4bb5600640 1 -- 172.21.15.137:0/1051297658 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4bb001b070 con 0x7f4bb815d2b0 2024-04-26T23:41:35.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.542+0000 7f4bb5600640 1 --2- 172.21.15.137:0/1051297658 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4b98068380 0x7f4b9806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:35.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.542+0000 7f4bb5600640 1 -- 172.21.15.137:0/1051297658 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4bb0085f60 con 0x7f4bb815d2b0 2024-04-26T23:41:35.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.542+0000 7f4bbdc00640 1 --2- 172.21.15.137:0/1051297658 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4b98068380 0x7f4b9806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:35.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.542+0000 7f4bbdc00640 1 --2- 172.21.15.137:0/1051297658 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4b98068380 0x7f4b9806a840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0ad000 tx=0x7f4bac0a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:35.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.546+0000 7f4bb5600640 1 -- 172.21.15.137:0/1051297658 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4bb80cf860 con 0x7f4bb815d2b0 2024-04-26T23:41:35.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.706+0000 7f4bc0600640 1 -- 172.21.15.137:0/1051297658 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4bb80cb310 con 0x7f4bb815d2b0 2024-04-26T23:41:35.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.710+0000 7f4bb5600640 1 -- 172.21.15.137:0/1051297658 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16653 (secure 0 0 0) 0x7f4bb0055ed0 con 0x7f4bb815d2b0 2024-04-26T23:41:35.715 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:35.715 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:25.186308+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:35.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.710+0000 7f4bc0600640 1 -- 172.21.15.137:0/1051297658 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4b98068380 msgr2=0x7f4b9806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:35.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.710+0000 7f4bc0600640 1 --2- 172.21.15.137:0/1051297658 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4b98068380 0x7f4b9806a840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0ad000 tx=0x7f4bac0a6000 comp rx=0 tx=0).stop 2024-04-26T23:41:35.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.710+0000 7f4bc0600640 1 -- 172.21.15.137:0/1051297658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bb815d2b0 msgr2=0x7f4bb80ca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:35.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.710+0000 7f4bc0600640 1 --2- 172.21.15.137:0/1051297658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bb815d2b0 0x7f4bb80ca790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000c7a0 tx=0x7f4bb000cc60 comp rx=0 tx=0).stop 2024-04-26T23:41:35.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.710+0000 7f4bc0600640 1 -- 172.21.15.137:0/1051297658 shutdown_connections 2024-04-26T23:41:35.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.710+0000 7f4bc0600640 1 --2- 172.21.15.137:0/1051297658 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4b98068380 0x7f4b9806a840 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.710+0000 7f4bc0600640 1 --2- 172.21.15.137:0/1051297658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bb815d2b0 0x7f4bb80ca790 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.710+0000 7f4bc0600640 1 --2- 172.21.15.137:0/1051297658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bb815ced0 0x7f4bb815a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.710+0000 7f4bc0600640 1 --2- 172.21.15.137:0/1051297658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bb80b0d90 0x7f4bb80cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.710+0000 7f4bc0600640 1 -- 172.21.15.137:0/1051297658 >> 172.21.15.137:0/1051297658 conn(0x7f4bb809ba60 msgr2=0x7f4bb815c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:35.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.710+0000 7f4bc0600640 1 -- 172.21.15.137:0/1051297658 shutdown_connections 2024-04-26T23:41:35.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.710+0000 7f4bc0600640 1 -- 172.21.15.137:0/1051297658 wait complete. 2024-04-26T23:41:35.736 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:41:21.810449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:41:22.533452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:41:35.736 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:41:35.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.866+0000 7fdaf3600640 1 Processor -- start 2024-04-26T23:41:35.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.866+0000 7fdaf3600640 1 -- start start 2024-04-26T23:41:35.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaf3600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdaec0b54e0 0x7fdaec0b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:35.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaf3600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fdaec160000 0x7fdaec144d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:35.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaf3600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaec0cffa0 con 0x7fdaec0cd710 2024-04-26T23:41:35.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaf3600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fdaec0b3d90 con 0x7fdaec160000 2024-04-26T23:41:35.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaf3600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdaec0d0840 con 0x7fdaec0b54e0 2024-04-26T23:41:35.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaebe00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fdaec0cd710 0x7fdaec15f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:43010/0 (socket says 172.21.15.137:43010) 2024-04-26T23:41:35.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaebe00640 1 -- 172.21.15.137:0/1810831056 learned_addr learned my addr 172.21.15.137:0/1810831056 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:35.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaf0c00640 1 --2- 172.21.15.137:0/1810831056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdaec0b54e0 0x7fdaec0b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:35.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaf1600640 1 --2- 172.21.15.137:0/1810831056 >> v2:172.21.15.170:3300/0 conn(0x7fdaec160000 0x7fdaec144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:35.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaeb400640 1 -- 172.21.15.137:0/1810831056 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1632359843 0 0) 0x7fdaec0cffa0 con 0x7fdaec0cd710 2024-04-26T23:41:35.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaeb400640 1 -- 172.21.15.137:0/1810831056 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdad0005740 con 0x7fdaec0cd710 2024-04-26T23:41:35.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaeb400640 1 -- 172.21.15.137:0/1810831056 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1107121418 0 0) 0x7fdad0005740 con 0x7fdaec0cd710 2024-04-26T23:41:35.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaeb400640 1 -- 172.21.15.137:0/1810831056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdaec0b54e0 msgr2=0x7fdaec0b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:35.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaeb400640 1 --2- 172.21.15.137:0/1810831056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdaec0b54e0 0x7fdaec0b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaeb400640 1 -- 172.21.15.137:0/1810831056 >> v2:172.21.15.170:3300/0 conn(0x7fdaec160000 msgr2=0x7fdaec144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:35.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaeb400640 1 --2- 172.21.15.137:0/1810831056 >> v2:172.21.15.170:3300/0 conn(0x7fdaec160000 0x7fdaec144d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaeb400640 1 -- 172.21.15.137:0/1810831056 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaec0d0280 con 0x7fdaec0cd710 2024-04-26T23:41:35.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaeb400640 1 -- 172.21.15.137:0/1810831056 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fdad8001680 con 0x7fdaec0cd710 2024-04-26T23:41:35.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaeb400640 1 -- 172.21.15.137:0/1810831056 >> v1:172.21.15.137:6789/0 conn(0x7fdaec0cd710 legacy=0x7fdaec15f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:35.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaeb400640 1 --2- 172.21.15.137:0/1810831056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdaec0b54e0 0x7fdad0005bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:35.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaeb400640 1 --2- 172.21.15.137:0/1810831056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdad0006150 0x7fdad0006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:35.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaeb400640 1 --2- 172.21.15.137:0/1810831056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdad0006f60 0x7fdad00073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:35.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaeb400640 1 -- 172.21.15.137:0/1810831056 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec0d0840 con 0x7fdad0006150 2024-04-26T23:41:35.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaeb400640 1 -- 172.21.15.137:0/1810831056 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdad000dbe0 con 0x7fdad0006f60 2024-04-26T23:41:35.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaeb400640 1 -- 172.21.15.137:0/1810831056 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdad000dd60 con 0x7fdaec0b54e0 2024-04-26T23:41:35.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaebe00640 1 --2- 172.21.15.137:0/1810831056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdad0006150 0x7fdad0006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:35.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaf0c00640 1 --2- 172.21.15.137:0/1810831056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdaec0b54e0 0x7fdad0005bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:35.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaf1600640 1 --2- 172.21.15.137:0/1810831056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdad0006f60 0x7fdad00073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:35.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaebe00640 1 -- 172.21.15.137:0/1810831056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdaec0b54e0 msgr2=0x7fdad0005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:35.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaebe00640 1 --2- 172.21.15.137:0/1810831056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdaec0b54e0 0x7fdad0005bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaebe00640 1 -- 172.21.15.137:0/1810831056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdad0006f60 msgr2=0x7fdad00073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:35.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaebe00640 1 --2- 172.21.15.137:0/1810831056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdad0006f60 0x7fdad00073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.870+0000 7fdaebe00640 1 -- 172.21.15.137:0/1810831056 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdad0005740 con 0x7fdad0006150 2024-04-26T23:41:35.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.874+0000 7fdaebe00640 1 --2- 172.21.15.137:0/1810831056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdad0006150 0x7fdad0006a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdad800c2c0 tx=0x7fdad801f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d47bea62d83902 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:35.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.874+0000 7fdaeb400640 1 -- 172.21.15.137:0/1810831056 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad8007d60 con 0x7fdad0006150 2024-04-26T23:41:35.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.874+0000 7fdaeb400640 1 -- 172.21.15.137:0/1810831056 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdad8005b00 con 0x7fdad0006150 2024-04-26T23:41:35.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.874+0000 7fdaeb400640 1 -- 172.21.15.137:0/1810831056 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad8007070 con 0x7fdad0006150 2024-04-26T23:41:35.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.874+0000 7fdaf3600640 1 -- 172.21.15.137:0/1810831056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdad0006150 msgr2=0x7fdad0006a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:35.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.874+0000 7fdaf3600640 1 --2- 172.21.15.137:0/1810831056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdad0006150 0x7fdad0006a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdad800c2c0 tx=0x7fdad801f450 comp rx=0 tx=0).stop 2024-04-26T23:41:35.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.874+0000 7fdaf1600640 1 -- 172.21.15.137:0/1810831056 reap_dead start 2024-04-26T23:41:35.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.874+0000 7fdaf3600640 1 -- 172.21.15.137:0/1810831056 shutdown_connections 2024-04-26T23:41:35.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.874+0000 7fdaf3600640 1 -- 172.21.15.137:0/1810831056 >> 172.21.15.137:0/1810831056 conn(0x7fdaec06c800 msgr2=0x7fdaec06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:35.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.874+0000 7fdaf3600640 1 -- 172.21.15.137:0/1810831056 shutdown_connections 2024-04-26T23:41:35.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.874+0000 7fdaf3600640 1 -- 172.21.15.137:0/1810831056 wait complete. 2024-04-26T23:41:35.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdaf3600640 1 Processor -- start 2024-04-26T23:41:35.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdaf3600640 1 -- start start 2024-04-26T23:41:35.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdaf3600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdad0006150 0x7fdaec0b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:35.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdaf3600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdaec0b2710 0x7fdaec139c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:35.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdaf3600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdaec13a170 0x7fdaec0ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:35.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdaf3600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec0cded0 con 0x7fdaec0b2710 2024-04-26T23:41:35.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdaf3600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec0b58c0 con 0x7fdaec13a170 2024-04-26T23:41:35.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdaf3600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdaec0cdb50 con 0x7fdad0006150 2024-04-26T23:41:35.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdaebe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdaec0b2710 0x7fdaec139c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:35.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdaebe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdaec0b2710 0x7fdaec139c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43146/0 (socket says 172.21.15.137:43146) 2024-04-26T23:41:35.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdaebe00640 1 -- 172.21.15.137:0/3622339058 learned_addr learned my addr 172.21.15.137:0/3622339058 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:35.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdaf0c00640 1 --2- 172.21.15.137:0/3622339058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdad0006150 0x7fdaec0b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:35.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdaf1600640 1 --2- 172.21.15.137:0/3622339058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdaec13a170 0x7fdaec0ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:35.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdaebe00640 1 -- 172.21.15.137:0/3622339058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdad0006150 msgr2=0x7fdaec0b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:35.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdaebe00640 1 --2- 172.21.15.137:0/3622339058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdad0006150 0x7fdaec0b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdaebe00640 1 -- 172.21.15.137:0/3622339058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdaec13a170 msgr2=0x7fdaec0ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:35.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdaebe00640 1 --2- 172.21.15.137:0/3622339058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdaec13a170 0x7fdaec0ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:35.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdaebe00640 1 -- 172.21.15.137:0/3622339058 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaec1f4970 con 0x7fdaec0b2710 2024-04-26T23:41:35.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdaebe00640 1 --2- 172.21.15.137:0/3622339058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdaec0b2710 0x7fdaec139c30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdad801fcf0 tx=0x7fdad0007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:35.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdae8c00640 1 -- 172.21.15.137:0/3622339058 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad8005d70 con 0x7fdaec0b2710 2024-04-26T23:41:35.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdae8c00640 1 -- 172.21.15.137:0/3622339058 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdad80047f0 con 0x7fdaec0b2710 2024-04-26T23:41:35.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdaf3600640 1 -- 172.21.15.137:0/3622339058 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaec1f8cc0 con 0x7fdaec0b2710 2024-04-26T23:41:35.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdae8c00640 1 -- 172.21.15.137:0/3622339058 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad8004ba0 con 0x7fdaec0b2710 2024-04-26T23:41:35.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdaf3600640 1 -- 172.21.15.137:0/3622339058 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaec1f4f10 con 0x7fdaec0b2710 2024-04-26T23:41:35.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.878+0000 7fdaf3600640 1 -- 172.21.15.137:0/3622339058 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaec06a410 con 0x7fdaec0b2710 2024-04-26T23:41:35.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.882+0000 7fdae8c00640 1 -- 172.21.15.137:0/3622339058 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdad80ba030 con 0x7fdaec0b2710 2024-04-26T23:41:35.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.882+0000 7fdae8c00640 1 --2- 172.21.15.137:0/3622339058 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdacc068380 0x7fdacc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:35.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.882+0000 7fdae8c00640 1 -- 172.21.15.137:0/3622339058 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdad81233c0 con 0x7fdaec0b2710 2024-04-26T23:41:35.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.882+0000 7fdaf0c00640 1 --2- 172.21.15.137:0/3622339058 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdacc068380 0x7fdacc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:35.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.882+0000 7fdaf0c00640 1 --2- 172.21.15.137:0/3622339058 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdacc068380 0x7fdacc06a840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdadc014430 tx=0x7fdadc00b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:35.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:35.886+0000 7fdae8c00640 1 -- 172.21.15.137:0/3622339058 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdad80191c0 con 0x7fdaec0b2710 2024-04-26T23:41:36.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.042+0000 7fdaf3600640 1 -- 172.21.15.137:0/3622339058 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdaec072cf0 con 0x7fdaec0b2710 2024-04-26T23:41:36.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.042+0000 7fdae8c00640 1 -- 172.21.15.137:0/3622339058 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fdad80f33c0 con 0x7fdaec0b2710 2024-04-26T23:41:36.049 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:41:36.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.042+0000 7fdaf3600640 1 -- 172.21.15.137:0/3622339058 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdacc068380 msgr2=0x7fdacc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:36.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.042+0000 7fdaf3600640 1 --2- 172.21.15.137:0/3622339058 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdacc068380 0x7fdacc06a840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdadc014430 tx=0x7fdadc00b040 comp rx=0 tx=0).stop 2024-04-26T23:41:36.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.042+0000 7fdaf3600640 1 -- 172.21.15.137:0/3622339058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdaec0b2710 msgr2=0x7fdaec139c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:36.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.042+0000 7fdaf3600640 1 --2- 172.21.15.137:0/3622339058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdaec0b2710 0x7fdaec139c30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdad801fcf0 tx=0x7fdad0007a50 comp rx=0 tx=0).stop 2024-04-26T23:41:36.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.046+0000 7fdaf3600640 1 -- 172.21.15.137:0/3622339058 shutdown_connections 2024-04-26T23:41:36.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.046+0000 7fdaf3600640 1 --2- 172.21.15.137:0/3622339058 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdacc068380 0x7fdacc06a840 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.046+0000 7fdaf3600640 1 --2- 172.21.15.137:0/3622339058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdaec0b2710 0x7fdaec139c30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.046+0000 7fdaf3600640 1 --2- 172.21.15.137:0/3622339058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdaec13a170 0x7fdaec0ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.046+0000 7fdaf3600640 1 --2- 172.21.15.137:0/3622339058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdad0006150 0x7fdaec0b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.046+0000 7fdaf3600640 1 -- 172.21.15.137:0/3622339058 >> 172.21.15.137:0/3622339058 conn(0x7fdaec06c800 msgr2=0x7fdaec072fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:36.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.046+0000 7fdaf3600640 1 -- 172.21.15.137:0/3622339058 shutdown_connections 2024-04-26T23:41:36.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.046+0000 7fdaf3600640 1 -- 172.21.15.137:0/3622339058 wait complete. 2024-04-26T23:41:36.070 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:41:36.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.202+0000 7f8c93200640 1 Processor -- start 2024-04-26T23:41:36.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.202+0000 7f8c93200640 1 -- start start 2024-04-26T23:41:36.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.202+0000 7f8c93200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8c9415f270 0x7f8c9406c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:36.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.202+0000 7f8c93200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8c940b53b0 0x7f8c9406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:36.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.202+0000 7f8c93200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c9406cf00 0x7f8c94162c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:36.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.202+0000 7f8c93200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8c940afc40 con 0x7f8c940b53b0 2024-04-26T23:41:36.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.202+0000 7f8c93200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f8c940d1dc0 con 0x7f8c9415f270 2024-04-26T23:41:36.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.202+0000 7f8c93200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8c940d20a0 con 0x7f8c9406cf00 2024-04-26T23:41:36.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.202+0000 7f8c91400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8c940b53b0 0x7f8c9406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:36.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.202+0000 7f8c91400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8c940b53b0 0x7f8c9406c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43150/0 (socket says 172.21.15.137:43150) 2024-04-26T23:41:36.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.202+0000 7f8c91400640 1 -- 172.21.15.137:0/2643818902 learned_addr learned my addr 172.21.15.137:0/2643818902 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:36.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.202+0000 7f8c91e00640 1 --2- 172.21.15.137:0/2643818902 >> v2:172.21.15.170:3300/0 conn(0x7f8c9415f270 0x7f8c9406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:36.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.202+0000 7f8c92800640 1 --2- 172.21.15.137:0/2643818902 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c9406cf00 0x7f8c94162c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:36.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.206+0000 7f8c91400640 1 -- 172.21.15.137:0/2643818902 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c9406cf00 msgr2=0x7f8c94162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:36.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.206+0000 7f8c91400640 1 --2- 172.21.15.137:0/2643818902 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c9406cf00 0x7f8c94162c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.206+0000 7f8c91400640 1 -- 172.21.15.137:0/2643818902 >> v2:172.21.15.170:3300/0 conn(0x7f8c9415f270 msgr2=0x7f8c9406c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:36.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.206+0000 7f8c91400640 1 --2- 172.21.15.137:0/2643818902 >> v2:172.21.15.170:3300/0 conn(0x7f8c9415f270 0x7f8c9406c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.206+0000 7f8c91400640 1 -- 172.21.15.137:0/2643818902 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c940aff00 con 0x7f8c940b53b0 2024-04-26T23:41:36.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.206+0000 7f8c91e00640 1 --2- 172.21.15.137:0/2643818902 >> v2:172.21.15.170:3300/0 conn(0x7f8c9415f270 0x7f8c9406c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:36.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.206+0000 7f8c91400640 1 --2- 172.21.15.137:0/2643818902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c940b53b0 0x7f8c9406c9c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8c940c6790 tx=0x7f8c8001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ecd10d9d7220b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:36.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.206+0000 7f8c90a00640 1 -- 172.21.15.137:0/2643818902 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c800b0070 con 0x7f8c940b53b0 2024-04-26T23:41:36.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.206+0000 7f8c90a00640 1 -- 172.21.15.137:0/2643818902 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c800ab600 con 0x7f8c940b53b0 2024-04-26T23:41:36.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.206+0000 7f8c90a00640 1 -- 172.21.15.137:0/2643818902 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c800ab9d0 con 0x7f8c940b53b0 2024-04-26T23:41:36.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.206+0000 7f8c93200640 1 -- 172.21.15.137:0/2643818902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c940b53b0 msgr2=0x7f8c9406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:36.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.206+0000 7f8c93200640 1 --2- 172.21.15.137:0/2643818902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c940b53b0 0x7f8c9406c9c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8c940c6790 tx=0x7f8c8001c260 comp rx=0 tx=0).stop 2024-04-26T23:41:36.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.206+0000 7f8c93200640 1 -- 172.21.15.137:0/2643818902 shutdown_connections 2024-04-26T23:41:36.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.206+0000 7f8c93200640 1 --2- 172.21.15.137:0/2643818902 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c9406cf00 0x7f8c94162c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.206+0000 7f8c93200640 1 --2- 172.21.15.137:0/2643818902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c940b53b0 0x7f8c9406c9c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.206+0000 7f8c93200640 1 --2- 172.21.15.137:0/2643818902 >> v2:172.21.15.170:3300/0 conn(0x7f8c9415f270 0x7f8c9406c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.206+0000 7f8c93200640 1 -- 172.21.15.137:0/2643818902 >> 172.21.15.137:0/2643818902 conn(0x7f8c940b47e0 msgr2=0x7f8c940b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:36.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.210+0000 7f8c93200640 1 -- 172.21.15.137:0/2643818902 shutdown_connections 2024-04-26T23:41:36.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.210+0000 7f8c93200640 1 -- 172.21.15.137:0/2643818902 wait complete. 2024-04-26T23:41:36.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.210+0000 7f8c93200640 1 Processor -- start 2024-04-26T23:41:36.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.210+0000 7f8c93200640 1 -- start start 2024-04-26T23:41:36.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.210+0000 7f8c93200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c9406cf00 0x7f8c94157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:36.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.210+0000 7f8c93200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c940b53b0 0x7f8c941581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:36.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.210+0000 7f8c93200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c9415f270 0x7f8c94151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:36.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.210+0000 7f8c93200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8c940b07b0 con 0x7f8c9415f270 2024-04-26T23:41:36.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.210+0000 7f8c93200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8c940b0630 con 0x7f8c9406cf00 2024-04-26T23:41:36.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.210+0000 7f8c93200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8c940b0930 con 0x7f8c940b53b0 2024-04-26T23:41:36.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.210+0000 7f8c92800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c9415f270 0x7f8c94151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:36.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.210+0000 7f8c92800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c9415f270 0x7f8c94151230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43160/0 (socket says 172.21.15.137:43160) 2024-04-26T23:41:36.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.210+0000 7f8c92800640 1 -- 172.21.15.137:0/1583548095 learned_addr learned my addr 172.21.15.137:0/1583548095 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:36.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.210+0000 7f8c91e00640 1 --2- 172.21.15.137:0/1583548095 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c9406cf00 0x7f8c94157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:36.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.210+0000 7f8c91400640 1 --2- 172.21.15.137:0/1583548095 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c940b53b0 0x7f8c941581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:36.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.210+0000 7f8c92800640 1 -- 172.21.15.137:0/1583548095 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c940b53b0 msgr2=0x7f8c941581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:36.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.210+0000 7f8c92800640 1 --2- 172.21.15.137:0/1583548095 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c940b53b0 0x7f8c941581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.210+0000 7f8c92800640 1 -- 172.21.15.137:0/1583548095 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c9406cf00 msgr2=0x7f8c94157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:36.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.210+0000 7f8c92800640 1 --2- 172.21.15.137:0/1583548095 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c9406cf00 0x7f8c94157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.210+0000 7f8c92800640 1 -- 172.21.15.137:0/1583548095 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c94156530 con 0x7f8c9415f270 2024-04-26T23:41:36.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.210+0000 7f8c92800640 1 --2- 172.21.15.137:0/1583548095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c9415f270 0x7f8c94151230 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00d800 tx=0x7f8c8c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:36.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.210+0000 7f8c8a000640 1 -- 172.21.15.137:0/1583548095 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c018020 con 0x7f8c9415f270 2024-04-26T23:41:36.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.214+0000 7f8c8a000640 1 -- 172.21.15.137:0/1583548095 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c8c0096c0 con 0x7f8c9415f270 2024-04-26T23:41:36.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.214+0000 7f8c93200640 1 -- 172.21.15.137:0/1583548095 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c941567f0 con 0x7f8c9415f270 2024-04-26T23:41:36.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.214+0000 7f8c8a000640 1 -- 172.21.15.137:0/1583548095 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c009ab0 con 0x7f8c9415f270 2024-04-26T23:41:36.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.214+0000 7f8c93200640 1 -- 172.21.15.137:0/1583548095 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c94156db0 con 0x7f8c9415f270 2024-04-26T23:41:36.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.214+0000 7f8c93200640 1 -- 172.21.15.137:0/1583548095 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c9406a300 con 0x7f8c9415f270 2024-04-26T23:41:36.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.214+0000 7f8c8a000640 1 -- 172.21.15.137:0/1583548095 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8c8c01b020 con 0x7f8c9415f270 2024-04-26T23:41:36.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.214+0000 7f8c8a000640 1 --2- 172.21.15.137:0/1583548095 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8c740683b0 0x7f8c7406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:36.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.214+0000 7f8c8a000640 1 -- 172.21.15.137:0/1583548095 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8c8c086df0 con 0x7f8c9415f270 2024-04-26T23:41:36.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.214+0000 7f8c91e00640 1 --2- 172.21.15.137:0/1583548095 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8c740683b0 0x7f8c7406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:36.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.214+0000 7f8c91e00640 1 --2- 172.21.15.137:0/1583548095 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8c740683b0 0x7f8c7406a870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8c84009fd0 tx=0x7f8c840097f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:36.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.218+0000 7f8c8a000640 1 -- 172.21.15.137:0/1583548095 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8c8c022020 con 0x7f8c9415f270 2024-04-26T23:41:36.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.378+0000 7f8c93200640 1 -- 172.21.15.137:0/1583548095 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8c94068cf0 con 0x7f8c9415f270 2024-04-26T23:41:36.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.378+0000 7f8c8a000640 1 -- 172.21.15.137:0/1583548095 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f8c8c056cc0 con 0x7f8c9415f270 2024-04-26T23:41:36.384 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:41:36.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.378+0000 7f8c93200640 1 -- 172.21.15.137:0/1583548095 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8c740683b0 msgr2=0x7f8c7406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:36.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.378+0000 7f8c93200640 1 --2- 172.21.15.137:0/1583548095 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8c740683b0 0x7f8c7406a870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8c84009fd0 tx=0x7f8c840097f0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.378+0000 7f8c93200640 1 -- 172.21.15.137:0/1583548095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c9415f270 msgr2=0x7f8c94151230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:36.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.378+0000 7f8c93200640 1 --2- 172.21.15.137:0/1583548095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c9415f270 0x7f8c94151230 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00d800 tx=0x7f8c8c00dcc0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.382+0000 7f8c93200640 1 -- 172.21.15.137:0/1583548095 shutdown_connections 2024-04-26T23:41:36.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.382+0000 7f8c93200640 1 --2- 172.21.15.137:0/1583548095 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8c740683b0 0x7f8c7406a870 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.382+0000 7f8c93200640 1 --2- 172.21.15.137:0/1583548095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c9415f270 0x7f8c94151230 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.382+0000 7f8c93200640 1 --2- 172.21.15.137:0/1583548095 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c940b53b0 0x7f8c941581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.382+0000 7f8c93200640 1 --2- 172.21.15.137:0/1583548095 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c9406cf00 0x7f8c94157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.382+0000 7f8c93200640 1 -- 172.21.15.137:0/1583548095 >> 172.21.15.137:0/1583548095 conn(0x7f8c940b47e0 msgr2=0x7f8c940701a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:36.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.382+0000 7f8c93200640 1 -- 172.21.15.137:0/1583548095 shutdown_connections 2024-04-26T23:41:36.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.382+0000 7f8c93200640 1 -- 172.21.15.137:0/1583548095 wait complete. 2024-04-26T23:41:36.405 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:41:36.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.538+0000 7f71f2400640 1 Processor -- start 2024-04-26T23:41:36.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.538+0000 7f71f2400640 1 -- start start 2024-04-26T23:41:36.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.538+0000 7f71f2400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f71ec0b54e0 0x7f71ec0b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:36.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.538+0000 7f71f2400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71ec160000 0x7f71ec144d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:36.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.538+0000 7f71f2400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71ec0cffa0 con 0x7f71ec0cd710 2024-04-26T23:41:36.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.538+0000 7f71f2400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f71ec0b3d90 con 0x7f71ec0b54e0 2024-04-26T23:41:36.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.538+0000 7f71f2400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f71ec0d0840 con 0x7f71ec160000 2024-04-26T23:41:36.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.538+0000 7f71e2a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f71ec0cd710 0x7f71ec15f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:43022/0 (socket says 172.21.15.137:43022) 2024-04-26T23:41:36.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.538+0000 7f71e2a00640 1 -- 172.21.15.137:0/2467309309 learned_addr learned my addr 172.21.15.137:0/2467309309 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:36.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.538+0000 7f71eb400640 1 --2- 172.21.15.137:0/2467309309 >> v2:172.21.15.170:3300/0 conn(0x7f71ec0b54e0 0x7f71ec0b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:36.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.538+0000 7f71ebe00640 1 --2- 172.21.15.137:0/2467309309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71ec160000 0x7f71ec144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:36.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.538+0000 7f71eaa00640 1 -- 172.21.15.137:0/2467309309 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4110352502 0 0) 0x7f71ec0cffa0 con 0x7f71ec0cd710 2024-04-26T23:41:36.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.538+0000 7f71eaa00640 1 -- 172.21.15.137:0/2467309309 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71d0003530 con 0x7f71ec0cd710 2024-04-26T23:41:36.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.538+0000 7f71eb400640 1 -- 172.21.15.137:0/2467309309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71ec160000 msgr2=0x7f71ec144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:36.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.538+0000 7f71eb400640 1 --2- 172.21.15.137:0/2467309309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71ec160000 0x7f71ec144d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.538+0000 7f71eaa00640 1 -- 172.21.15.137:0/2467309309 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1573587740 0 0) 0x7f71d0003530 con 0x7f71ec0cd710 2024-04-26T23:41:36.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.538+0000 7f71eb400640 1 -- 172.21.15.137:0/2467309309 >> v1:172.21.15.137:6789/0 conn(0x7f71ec0cd710 legacy=0x7f71ec15f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:36.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.538+0000 7f71eb400640 1 -- 172.21.15.137:0/2467309309 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ec0d0280 con 0x7f71ec0b54e0 2024-04-26T23:41:36.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.538+0000 7f71ebe00640 1 --2- 172.21.15.137:0/2467309309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71ec160000 0x7f71ec144d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:41:36.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.542+0000 7f71eb400640 1 --2- 172.21.15.137:0/2467309309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71ec0b54e0 0x7f71ec0b5ee0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0097c0 tx=0x7f71dc01c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8355ad68ceacfa5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:36.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.542+0000 7f71eaa00640 1 -- 172.21.15.137:0/2467309309 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc0b0070 con 0x7f71ec0b54e0 2024-04-26T23:41:36.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.542+0000 7f71eaa00640 1 -- 172.21.15.137:0/2467309309 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71ec145a70 con 0x7f71ec0b54e0 2024-04-26T23:41:36.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.542+0000 7f71eaa00640 1 -- 172.21.15.137:0/2467309309 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d4001680 con 0x7f71ec0b54e0 2024-04-26T23:41:36.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.542+0000 7f71f2400640 1 -- 172.21.15.137:0/2467309309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71ec0b54e0 msgr2=0x7f71ec0b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:36.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.542+0000 7f71f2400640 1 --2- 172.21.15.137:0/2467309309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71ec0b54e0 0x7f71ec0b5ee0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0097c0 tx=0x7f71dc01c390 comp rx=0 tx=0).stop 2024-04-26T23:41:36.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.542+0000 7f71f2400640 1 -- 172.21.15.137:0/2467309309 shutdown_connections 2024-04-26T23:41:36.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.542+0000 7f71f2400640 1 --2- 172.21.15.137:0/2467309309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71ec160000 0x7f71ec144d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.542+0000 7f71f2400640 1 --2- 172.21.15.137:0/2467309309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71ec0b54e0 0x7f71ec0b5ee0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.542+0000 7f71f2400640 1 -- 172.21.15.137:0/2467309309 >> 172.21.15.137:0/2467309309 conn(0x7f71ec06c800 msgr2=0x7f71ec06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:36.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.542+0000 7f71f2400640 1 -- 172.21.15.137:0/2467309309 shutdown_connections 2024-04-26T23:41:36.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.542+0000 7f71f2400640 1 -- 172.21.15.137:0/2467309309 wait complete. 2024-04-26T23:41:36.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71f2400640 1 Processor -- start 2024-04-26T23:41:36.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71f2400640 1 -- start start 2024-04-26T23:41:36.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71f2400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71ec0b54e0 0x7f71ec15b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:36.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71f2400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71ec0cd710 0x7f71ec0b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:36.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71f2400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71ec160000 0x7f71ec156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:36.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71f2400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f71ec06ef60 con 0x7f71ec0b54e0 2024-04-26T23:41:36.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71f2400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f71ec0cded0 con 0x7f71ec160000 2024-04-26T23:41:36.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71f2400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f71ec06f0e0 con 0x7f71ec0cd710 2024-04-26T23:41:36.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71eb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71ec0b54e0 0x7f71ec15b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:36.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71eb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71ec0b54e0 0x7f71ec15b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43174/0 (socket says 172.21.15.137:43174) 2024-04-26T23:41:36.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71eb400640 1 -- 172.21.15.137:0/1725020539 learned_addr learned my addr 172.21.15.137:0/1725020539 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:36.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71e2a00640 1 --2- 172.21.15.137:0/1725020539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71ec0cd710 0x7f71ec0b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:36.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71ebe00640 1 --2- 172.21.15.137:0/1725020539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71ec160000 0x7f71ec156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:36.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71eb400640 1 -- 172.21.15.137:0/1725020539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71ec0cd710 msgr2=0x7f71ec0b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:36.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71eb400640 1 --2- 172.21.15.137:0/1725020539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71ec0cd710 0x7f71ec0b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71eb400640 1 -- 172.21.15.137:0/1725020539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71ec160000 msgr2=0x7f71ec156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:36.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71eb400640 1 --2- 172.21.15.137:0/1725020539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71ec160000 0x7f71ec156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71eb400640 1 -- 172.21.15.137:0/1725020539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ec135200 con 0x7f71ec0b54e0 2024-04-26T23:41:36.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71eb400640 1 --2- 172.21.15.137:0/1725020539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71ec0b54e0 0x7f71ec15b250 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f71dc01aa40 tx=0x7f71dc019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:36.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71e3e00640 1 -- 172.21.15.137:0/1725020539 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc0b0040 con 0x7f71ec0b54e0 2024-04-26T23:41:36.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71e3e00640 1 -- 172.21.15.137:0/1725020539 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71dc0ba070 con 0x7f71ec0b54e0 2024-04-26T23:41:36.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71f2400640 1 -- 172.21.15.137:0/1725020539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71ec1354e0 con 0x7f71ec0b54e0 2024-04-26T23:41:36.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71e3e00640 1 -- 172.21.15.137:0/1725020539 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc0b4410 con 0x7f71ec0b54e0 2024-04-26T23:41:36.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.546+0000 7f71f2400640 1 -- 172.21.15.137:0/1725020539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71ec135aa0 con 0x7f71ec0b54e0 2024-04-26T23:41:36.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.550+0000 7f71f2400640 1 -- 172.21.15.137:0/1725020539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71ec06a410 con 0x7f71ec0b54e0 2024-04-26T23:41:36.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.550+0000 7f71e3e00640 1 -- 172.21.15.137:0/1725020539 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f71dc0b45b0 con 0x7f71ec0b54e0 2024-04-26T23:41:36.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.550+0000 7f71e3e00640 1 --2- 172.21.15.137:0/1725020539 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f71c80683b0 0x7f71c806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:36.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.550+0000 7f71e3e00640 1 -- 172.21.15.137:0/1725020539 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f71dc11ffe0 con 0x7f71ec0b54e0 2024-04-26T23:41:36.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.550+0000 7f71e2a00640 1 --2- 172.21.15.137:0/1725020539 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f71c80683b0 0x7f71c806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:36.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.550+0000 7f71e2a00640 1 --2- 172.21.15.137:0/1725020539 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f71c80683b0 0x7f71c806a870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f71ec1ff7b0 tx=0x7f71d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:36.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.554+0000 7f71e3e00640 1 -- 172.21.15.137:0/1725020539 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f71dc0c3020 con 0x7f71ec0b54e0 2024-04-26T23:41:36.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.710+0000 7f71f2400640 1 -- 172.21.15.137:0/1725020539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f71ec15eec0 con 0x7f71ec0b54e0 2024-04-26T23:41:36.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.710+0000 7f71e3e00640 1 -- 172.21.15.137:0/1725020539 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f71dc015fb0 con 0x7f71ec0b54e0 2024-04-26T23:41:36.716 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:41:36.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.710+0000 7f71f2400640 1 -- 172.21.15.137:0/1725020539 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f71c80683b0 msgr2=0x7f71c806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:36.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.710+0000 7f71f2400640 1 --2- 172.21.15.137:0/1725020539 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f71c80683b0 0x7f71c806a870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f71ec1ff7b0 tx=0x7f71d4009040 comp rx=0 tx=0).stop 2024-04-26T23:41:36.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.710+0000 7f71f2400640 1 -- 172.21.15.137:0/1725020539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71ec0b54e0 msgr2=0x7f71ec15b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:36.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.710+0000 7f71f2400640 1 --2- 172.21.15.137:0/1725020539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71ec0b54e0 0x7f71ec15b250 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f71dc01aa40 tx=0x7f71dc019130 comp rx=0 tx=0).stop 2024-04-26T23:41:36.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.710+0000 7f71f2400640 1 -- 172.21.15.137:0/1725020539 shutdown_connections 2024-04-26T23:41:36.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.710+0000 7f71f2400640 1 --2- 172.21.15.137:0/1725020539 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f71c80683b0 0x7f71c806a870 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.710+0000 7f71f2400640 1 --2- 172.21.15.137:0/1725020539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71ec160000 0x7f71ec156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.710+0000 7f71f2400640 1 --2- 172.21.15.137:0/1725020539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71ec0cd710 0x7f71ec0b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.710+0000 7f71f2400640 1 --2- 172.21.15.137:0/1725020539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71ec0b54e0 0x7f71ec15b250 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.710+0000 7f71f2400640 1 -- 172.21.15.137:0/1725020539 >> 172.21.15.137:0/1725020539 conn(0x7f71ec06c800 msgr2=0x7f71ec144840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:36.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.710+0000 7f71f2400640 1 -- 172.21.15.137:0/1725020539 shutdown_connections 2024-04-26T23:41:36.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.710+0000 7f71f2400640 1 -- 172.21.15.137:0/1725020539 wait complete. 2024-04-26T23:41:36.737 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:41:36.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.866+0000 7f00ae400640 1 Processor -- start 2024-04-26T23:41:36.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.866+0000 7f00ae400640 1 -- start start 2024-04-26T23:41:36.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.870+0000 7f00ae400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f00a81596f0 0x7f00a815f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:36.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.870+0000 7f00ae400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00a8073040 0x7f00a80afb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:36.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.870+0000 7f00ae400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00a8159ad0 con 0x7f00a80b5290 2024-04-26T23:41:36.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.870+0000 7f00ae400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f00a80b5a70 con 0x7f00a81596f0 2024-04-26T23:41:36.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.870+0000 7f00ae400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f00a80b5d50 con 0x7f00a8073040 2024-04-26T23:41:36.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.870+0000 7f00a7400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f00a81596f0 0x7f00a815f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:36.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.870+0000 7f00a6a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f00a80b5290 0x7f00a8072930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:43036/0 (socket says 172.21.15.137:43036) 2024-04-26T23:41:36.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.870+0000 7f00a6a00640 1 -- 172.21.15.137:0/4232433729 learned_addr learned my addr 172.21.15.137:0/4232433729 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:36.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.870+0000 7f00a7e00640 1 --2- 172.21.15.137:0/4232433729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00a8073040 0x7f00a80afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:36.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.870+0000 7f00a7400640 1 -- 172.21.15.137:0/4232433729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00a8073040 msgr2=0x7f00a80afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:36.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.870+0000 7f00a7400640 1 --2- 172.21.15.137:0/4232433729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00a8073040 0x7f00a80afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.870+0000 7f00a7400640 1 -- 172.21.15.137:0/4232433729 >> v1:172.21.15.137:6789/0 conn(0x7f00a80b5290 legacy=0x7f00a8072930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:36.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.870+0000 7f00a7400640 1 -- 172.21.15.137:0/4232433729 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a80b6030 con 0x7f00a81596f0 2024-04-26T23:41:36.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.870+0000 7f00a6000640 1 -- 172.21.15.137:0/4232433729 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 745235104 0 0) 0x7f00a8159ad0 con 0x7f00a80b5290 2024-04-26T23:41:36.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00a7400640 1 --2- 172.21.15.137:0/4232433729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00a81596f0 0x7f00a815f630 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f00980097c0 tx=0x7f009801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3736ca6cff9507a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:36.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00a6000640 1 -- 172.21.15.137:0/4232433729 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00980b2070 con 0x7f00a81596f0 2024-04-26T23:41:36.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00a6000640 1 -- 172.21.15.137:0/4232433729 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00980ad640 con 0x7f00a81596f0 2024-04-26T23:41:36.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00a6000640 1 -- 172.21.15.137:0/4232433729 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00980ada10 con 0x7f00a81596f0 2024-04-26T23:41:36.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00ae400640 1 -- 172.21.15.137:0/4232433729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00a81596f0 msgr2=0x7f00a815f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:36.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00ae400640 1 --2- 172.21.15.137:0/4232433729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00a81596f0 0x7f00a815f630 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f00980097c0 tx=0x7f009801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00ae400640 1 -- 172.21.15.137:0/4232433729 shutdown_connections 2024-04-26T23:41:36.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00ae400640 1 --2- 172.21.15.137:0/4232433729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00a8073040 0x7f00a80afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00ae400640 1 --2- 172.21.15.137:0/4232433729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00a81596f0 0x7f00a815f630 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00ae400640 1 -- 172.21.15.137:0/4232433729 >> 172.21.15.137:0/4232433729 conn(0x7f00a80b3370 msgr2=0x7f00a80b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:36.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00ae400640 1 -- 172.21.15.137:0/4232433729 shutdown_connections 2024-04-26T23:41:36.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00ae400640 1 -- 172.21.15.137:0/4232433729 wait complete. 2024-04-26T23:41:36.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00ae400640 1 Processor -- start 2024-04-26T23:41:36.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00ae400640 1 -- start start 2024-04-26T23:41:36.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00ae400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00a8073040 0x7f00a8157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:36.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00ae400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00a80b5290 0x7f00a815e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:36.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00ae400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00a81596f0 0x7f00a815b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:36.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00ae400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f00a80b09e0 con 0x7f00a8073040 2024-04-26T23:41:36.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00ae400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f00a80b0860 con 0x7f00a80b5290 2024-04-26T23:41:36.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00ae400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f00a80b0b60 con 0x7f00a81596f0 2024-04-26T23:41:36.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00a7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00a8073040 0x7f00a8157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:36.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00a7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00a8073040 0x7f00a8157d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43194/0 (socket says 172.21.15.137:43194) 2024-04-26T23:41:36.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.874+0000 7f00a7400640 1 -- 172.21.15.137:0/388552146 learned_addr learned my addr 172.21.15.137:0/388552146 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:36.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.878+0000 7f00a7400640 1 -- 172.21.15.137:0/388552146 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00a81596f0 msgr2=0x7f00a815b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:36.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.878+0000 7f00a7400640 1 --2- 172.21.15.137:0/388552146 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00a81596f0 0x7f00a815b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.878+0000 7f00a7400640 1 -- 172.21.15.137:0/388552146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00a80b5290 msgr2=0x7f00a815e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:36.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.878+0000 7f00a6a00640 1 --2- 172.21.15.137:0/388552146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00a80b5290 0x7f00a815e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:36.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.878+0000 7f00a7400640 1 --2- 172.21.15.137:0/388552146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00a80b5290 0x7f00a815e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:36.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.878+0000 7f00a7400640 1 -- 172.21.15.137:0/388552146 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a815d7b0 con 0x7f00a8073040 2024-04-26T23:41:36.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.878+0000 7f00a6a00640 1 --2- 172.21.15.137:0/388552146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00a80b5290 0x7f00a815e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:36.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.878+0000 7f00a7400640 1 --2- 172.21.15.137:0/388552146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00a8073040 0x7f00a8157d70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f00980b0040 tx=0x7f009801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:36.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.878+0000 7f009f400640 1 -- 172.21.15.137:0/388552146 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00980b2050 con 0x7f00a8073040 2024-04-26T23:41:36.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.878+0000 7f009f400640 1 -- 172.21.15.137:0/388552146 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00980b3040 con 0x7f00a8073040 2024-04-26T23:41:36.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.878+0000 7f009f400640 1 -- 172.21.15.137:0/388552146 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098006e20 con 0x7f00a8073040 2024-04-26T23:41:36.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.878+0000 7f00ae400640 1 -- 172.21.15.137:0/388552146 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a815daf0 con 0x7f00a8073040 2024-04-26T23:41:36.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.878+0000 7f00ae400640 1 -- 172.21.15.137:0/388552146 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a815c0c0 con 0x7f00a8073040 2024-04-26T23:41:36.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.878+0000 7f00ae400640 1 -- 172.21.15.137:0/388552146 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00a806a4b0 con 0x7f00a8073040 2024-04-26T23:41:36.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.878+0000 7f009f400640 1 -- 172.21.15.137:0/388552146 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f00980c0060 con 0x7f00a8073040 2024-04-26T23:41:36.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.878+0000 7f009f400640 1 --2- 172.21.15.137:0/388552146 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0088068380 0x7f008806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:36.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.878+0000 7f009f400640 1 -- 172.21.15.137:0/388552146 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f00981205d0 con 0x7f00a8073040 2024-04-26T23:41:36.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.878+0000 7f00a6a00640 1 --2- 172.21.15.137:0/388552146 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0088068380 0x7f008806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:36.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.882+0000 7f00a6a00640 1 --2- 172.21.15.137:0/388552146 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0088068380 0x7f008806a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f00a8169920 tx=0x7f0094009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:36.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:36.882+0000 7f009f400640 1 -- 172.21.15.137:0/388552146 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f00a815daf0 con 0x7f00a8073040 2024-04-26T23:41:37.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.074+0000 7f00ae400640 1 -- 172.21.15.137:0/388552146 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00a8169950 con 0x7f00a8073040 2024-04-26T23:41:37.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.074+0000 7f009f400640 1 -- 172.21.15.137:0/388552146 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f0098016090 con 0x7f00a8073040 2024-04-26T23:41:37.080 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:37.081 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/861150521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":861150521},{"type":"v1","addr":"172.21.15.137:6836","nonce":861150521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/980246912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":980246912},{"type":"v1","addr":"172.21.15.137:6837","nonce":980246912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3288315078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3288315078},{"type":"v1","addr":"172.21.15.170:6835","nonce":3288315078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:41:23.574363+0000","modified":"2024-04-26T23:41:26.591710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6834/2444921875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2444921875},{"type":"v1","addr":"172.21.15.170:6834","nonce":2444921875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-26T23:41:37.081 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 8 2024-04-26T23:41:37.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.074+0000 7f00ae400640 1 -- 172.21.15.137:0/388552146 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0088068380 msgr2=0x7f008806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:37.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.074+0000 7f00ae400640 1 --2- 172.21.15.137:0/388552146 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0088068380 0x7f008806a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f00a8169920 tx=0x7f0094009040 comp rx=0 tx=0).stop 2024-04-26T23:41:37.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.074+0000 7f00ae400640 1 -- 172.21.15.137:0/388552146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00a8073040 msgr2=0x7f00a8157d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:37.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.074+0000 7f00ae400640 1 --2- 172.21.15.137:0/388552146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00a8073040 0x7f00a8157d70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f00980b0040 tx=0x7f009801ace0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.078+0000 7f00ae400640 1 -- 172.21.15.137:0/388552146 shutdown_connections 2024-04-26T23:41:37.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.078+0000 7f00ae400640 1 --2- 172.21.15.137:0/388552146 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0088068380 0x7f008806a840 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.078+0000 7f00ae400640 1 --2- 172.21.15.137:0/388552146 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00a81596f0 0x7f00a815b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.078+0000 7f00ae400640 1 --2- 172.21.15.137:0/388552146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00a80b5290 0x7f00a815e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.078+0000 7f00ae400640 1 --2- 172.21.15.137:0/388552146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00a8073040 0x7f00a8157d70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.078+0000 7f00ae400640 1 -- 172.21.15.137:0/388552146 >> 172.21.15.137:0/388552146 conn(0x7f00a80b3370 msgr2=0x7f00a806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:37.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.078+0000 7f00ae400640 1 -- 172.21.15.137:0/388552146 shutdown_connections 2024-04-26T23:41:37.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.078+0000 7f00ae400640 1 -- 172.21.15.137:0/388552146 wait complete. 2024-04-26T23:41:37.103 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:37.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.230+0000 7f061a000640 1 Processor -- start 2024-04-26T23:41:37.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.230+0000 7f061a000640 1 -- start start 2024-04-26T23:41:37.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.234+0000 7f061a000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0614073090 0x7f06140cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:37.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.234+0000 7f061a000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06140cfef0 con 0x7f06140725a0 2024-04-26T23:41:37.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.234+0000 7f061a000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06140cddc0 con 0x7f06140b5080 2024-04-26T23:41:37.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.234+0000 7f061a000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f06140d01b0 con 0x7f0614073090 2024-04-26T23:41:37.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.234+0000 7f0613e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0614073090 0x7f06140cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:37.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.234+0000 7f0613400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f06140725a0 0x7f0614073f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:43042/0 (socket says 172.21.15.137:43042) 2024-04-26T23:41:37.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.234+0000 7f0613400640 1 -- 172.21.15.137:0/2904078017 learned_addr learned my addr 172.21.15.137:0/2904078017 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:37.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.234+0000 7f0613e00640 1 -- 172.21.15.137:0/2904078017 >> v1:172.21.15.170:6789/0 conn(0x7f06140b5080 legacy=0x7f0614072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:37.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.234+0000 7f0613e00640 1 -- 172.21.15.137:0/2904078017 >> v1:172.21.15.137:6789/0 conn(0x7f06140725a0 legacy=0x7f0614073f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:37.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.234+0000 7f0613e00640 1 -- 172.21.15.137:0/2904078017 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06140d0490 con 0x7f0614073090 2024-04-26T23:41:37.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.234+0000 7f0612a00640 1 -- 172.21.15.137:0/2904078017 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 636306169 0 0) 0x7f06140cfef0 con 0x7f06140725a0 2024-04-26T23:41:37.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.238+0000 7f0613e00640 1 --2- 172.21.15.137:0/2904078017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0614073090 0x7f06140cd770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f060c009dc0 tx=0x7f060c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83becf24b96144d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:37.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.238+0000 7f0612a00640 1 -- 172.21.15.137:0/2904078017 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c0b2070 con 0x7f0614073090 2024-04-26T23:41:37.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.238+0000 7f0612a00640 1 -- 172.21.15.137:0/2904078017 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f060c0a5a00 con 0x7f0614073090 2024-04-26T23:41:37.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.238+0000 7f0612a00640 1 -- 172.21.15.137:0/2904078017 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c0a5dd0 con 0x7f0614073090 2024-04-26T23:41:37.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.238+0000 7f061a000640 1 -- 172.21.15.137:0/2904078017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0614073090 msgr2=0x7f06140cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:37.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.238+0000 7f061a000640 1 --2- 172.21.15.137:0/2904078017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0614073090 0x7f06140cd770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f060c009dc0 tx=0x7f060c01c920 comp rx=0 tx=0).stop 2024-04-26T23:41:37.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.238+0000 7f061a000640 1 -- 172.21.15.137:0/2904078017 shutdown_connections 2024-04-26T23:41:37.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.238+0000 7f061a000640 1 --2- 172.21.15.137:0/2904078017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0614073090 0x7f06140cd770 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.238+0000 7f061a000640 1 -- 172.21.15.137:0/2904078017 >> 172.21.15.137:0/2904078017 conn(0x7f061406c5d0 msgr2=0x7f061406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:37.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.238+0000 7f061a000640 1 -- 172.21.15.137:0/2904078017 shutdown_connections 2024-04-26T23:41:37.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.238+0000 7f061a000640 1 -- 172.21.15.137:0/2904078017 wait complete. 2024-04-26T23:41:37.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.238+0000 7f061a000640 1 Processor -- start 2024-04-26T23:41:37.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.238+0000 7f061a000640 1 -- start start 2024-04-26T23:41:37.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.238+0000 7f061a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06140725a0 0x7f0614142b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:37.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.238+0000 7f061a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0614073090 0x7f0614137c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:37.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.238+0000 7f061a000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06140b5080 0x7f061413d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:37.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.238+0000 7f061a000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0614169900 con 0x7f06140725a0 2024-04-26T23:41:37.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.238+0000 7f061a000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0614169780 con 0x7f0614073090 2024-04-26T23:41:37.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.238+0000 7f061a000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0614169a80 con 0x7f06140b5080 2024-04-26T23:41:37.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.238+0000 7f0613400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06140725a0 0x7f0614142b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:37.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.242+0000 7f0613400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06140725a0 0x7f0614142b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43206/0 (socket says 172.21.15.137:43206) 2024-04-26T23:41:37.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.242+0000 7f0613400640 1 -- 172.21.15.137:0/3109518139 learned_addr learned my addr 172.21.15.137:0/3109518139 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:37.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.242+0000 7f0613e00640 1 --2- 172.21.15.137:0/3109518139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06140b5080 0x7f061413d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:37.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.242+0000 7f060aa00640 1 --2- 172.21.15.137:0/3109518139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0614073090 0x7f0614137c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:37.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.242+0000 7f0613400640 1 -- 172.21.15.137:0/3109518139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06140b5080 msgr2=0x7f061413d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:37.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.242+0000 7f0613400640 1 --2- 172.21.15.137:0/3109518139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06140b5080 0x7f061413d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.242+0000 7f0613400640 1 -- 172.21.15.137:0/3109518139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0614073090 msgr2=0x7f0614137c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:37.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.242+0000 7f0613400640 1 --2- 172.21.15.137:0/3109518139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0614073090 0x7f0614137c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.242+0000 7f0613400640 1 -- 172.21.15.137:0/3109518139 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06141434d0 con 0x7f06140725a0 2024-04-26T23:41:37.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.242+0000 7f0613400640 1 --2- 172.21.15.137:0/3109518139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06140725a0 0x7f0614142b30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f060400c410 tx=0x7f060400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:37.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.242+0000 7f060be00640 1 -- 172.21.15.137:0/3109518139 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06040074e0 con 0x7f06140725a0 2024-04-26T23:41:37.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.242+0000 7f060be00640 1 -- 172.21.15.137:0/3109518139 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06040047f0 con 0x7f06140725a0 2024-04-26T23:41:37.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.242+0000 7f061a000640 1 -- 172.21.15.137:0/3109518139 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06141437b0 con 0x7f06140725a0 2024-04-26T23:41:37.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.242+0000 7f060be00640 1 -- 172.21.15.137:0/3109518139 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0604007680 con 0x7f06140725a0 2024-04-26T23:41:37.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.242+0000 7f061a000640 1 -- 172.21.15.137:0/3109518139 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0614143d70 con 0x7f06140725a0 2024-04-26T23:41:37.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.242+0000 7f061a000640 1 -- 172.21.15.137:0/3109518139 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f061406a4b0 con 0x7f06140725a0 2024-04-26T23:41:37.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.242+0000 7f060be00640 1 -- 172.21.15.137:0/3109518139 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0604011070 con 0x7f06140725a0 2024-04-26T23:41:37.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.242+0000 7f060be00640 1 --2- 172.21.15.137:0/3109518139 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f05f0068380 0x7f05f006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:37.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.246+0000 7f060be00640 1 -- 172.21.15.137:0/3109518139 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f06040864a0 con 0x7f06140725a0 2024-04-26T23:41:37.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.246+0000 7f060aa00640 1 --2- 172.21.15.137:0/3109518139 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f05f0068380 0x7f05f006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:37.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.246+0000 7f060aa00640 1 --2- 172.21.15.137:0/3109518139 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f05f0068380 0x7f05f006a840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f06140cfa20 tx=0x7f05fc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:37.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.246+0000 7f060be00640 1 -- 172.21.15.137:0/3109518139 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0604056400 con 0x7f06140725a0 2024-04-26T23:41:37.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.406+0000 7f061a000640 1 -- 172.21.15.137:0/3109518139 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0614072380 con 0x7f06140725a0 2024-04-26T23:41:37.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.410+0000 7f060be00640 1 -- 172.21.15.137:0/3109518139 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16653 (secure 0 0 0) 0x7f060405a700 con 0x7f06140725a0 2024-04-26T23:41:37.415 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:37.415 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:25.186308+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:37.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.410+0000 7f061a000640 1 -- 172.21.15.137:0/3109518139 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f05f0068380 msgr2=0x7f05f006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.410+0000 7f061a000640 1 --2- 172.21.15.137:0/3109518139 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f05f0068380 0x7f05f006a840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f06140cfa20 tx=0x7f05fc009040 comp rx=0 tx=0).stop 2024-04-26T23:41:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.410+0000 7f061a000640 1 -- 172.21.15.137:0/3109518139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06140725a0 msgr2=0x7f0614142b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.410+0000 7f061a000640 1 --2- 172.21.15.137:0/3109518139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06140725a0 0x7f0614142b30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f060400c410 tx=0x7f060400c8d0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.410+0000 7f061a000640 1 -- 172.21.15.137:0/3109518139 shutdown_connections 2024-04-26T23:41:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.410+0000 7f061a000640 1 --2- 172.21.15.137:0/3109518139 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f05f0068380 0x7f05f006a840 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.410+0000 7f061a000640 1 --2- 172.21.15.137:0/3109518139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06140b5080 0x7f061413d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.410+0000 7f061a000640 1 --2- 172.21.15.137:0/3109518139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0614073090 0x7f0614137c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.410+0000 7f061a000640 1 --2- 172.21.15.137:0/3109518139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06140725a0 0x7f0614142b30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.410+0000 7f061a000640 1 -- 172.21.15.137:0/3109518139 >> 172.21.15.137:0/3109518139 conn(0x7f061406c5d0 msgr2=0x7f061406c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.410+0000 7f061a000640 1 -- 172.21.15.137:0/3109518139 shutdown_connections 2024-04-26T23:41:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.410+0000 7f061a000640 1 -- 172.21.15.137:0/3109518139 wait complete. 2024-04-26T23:41:37.436 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:41:37.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.566+0000 7f04db800640 1 Processor -- start 2024-04-26T23:41:37.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.566+0000 7f04db800640 1 -- start start 2024-04-26T23:41:37.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.566+0000 7f04db800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04d40cfce0 0x7f04d406c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:37.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.566+0000 7f04db800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f04d406c940 0x7f04d4072930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:37.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.566+0000 7f04db800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04d415d600 con 0x7f04d415a9c0 2024-04-26T23:41:37.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.566+0000 7f04db800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f04d415d8e0 con 0x7f04d406c940 2024-04-26T23:41:37.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.566+0000 7f04db800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f04d415dbc0 con 0x7f04d40cfce0 2024-04-26T23:41:37.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.566+0000 7f04d9800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f04d406c940 0x7f04d4072930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:37.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.566+0000 7f04d9800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f04d406c940 0x7f04d4072930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43210/0 (socket says 172.21.15.137:43210) 2024-04-26T23:41:37.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.566+0000 7f04d9800640 1 -- 172.21.15.137:0/4031307532 learned_addr learned my addr 172.21.15.137:0/4031307532 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:37.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.566+0000 7f04cbe00640 1 --2- 172.21.15.137:0/4031307532 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04d40cfce0 0x7f04d406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:37.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.566+0000 7f04d9800640 1 -- 172.21.15.137:0/4031307532 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04d40cfce0 msgr2=0x7f04d406c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:37.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.566+0000 7f04d9800640 1 --2- 172.21.15.137:0/4031307532 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04d40cfce0 0x7f04d406c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.566+0000 7f04d9800640 1 -- 172.21.15.137:0/4031307532 >> v1:172.21.15.170:6789/0 conn(0x7f04d415a9c0 legacy=0x7f04d406fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:37.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.566+0000 7f04d9800640 1 -- 172.21.15.137:0/4031307532 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d415dea0 con 0x7f04d406c940 2024-04-26T23:41:37.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.566+0000 7f04cbe00640 1 --2- 172.21.15.137:0/4031307532 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04d40cfce0 0x7f04d406c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:37.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.570+0000 7f04d9800640 1 --2- 172.21.15.137:0/4031307532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04d406c940 0x7f04d4072930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009e80 tx=0x7f04cc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91ce74aacb9bc49 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:37.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.570+0000 7f04d3e00640 1 -- 172.21.15.137:0/4031307532 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc0a5650 con 0x7f04d406c940 2024-04-26T23:41:37.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.570+0000 7f04d3e00640 1 -- 172.21.15.137:0/4031307532 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04cc0a57f0 con 0x7f04d406c940 2024-04-26T23:41:37.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.570+0000 7f04d3e00640 1 -- 172.21.15.137:0/4031307532 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc0a5bc0 con 0x7f04d406c940 2024-04-26T23:41:37.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.570+0000 7f04db800640 1 -- 172.21.15.137:0/4031307532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04d406c940 msgr2=0x7f04d4072930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:37.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.570+0000 7f04db800640 1 --2- 172.21.15.137:0/4031307532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04d406c940 0x7f04d4072930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009e80 tx=0x7f04cc01c9d0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.570+0000 7f04db800640 1 -- 172.21.15.137:0/4031307532 shutdown_connections 2024-04-26T23:41:37.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.570+0000 7f04db800640 1 --2- 172.21.15.137:0/4031307532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04d406c940 0x7f04d4072930 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.570+0000 7f04db800640 1 --2- 172.21.15.137:0/4031307532 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04d40cfce0 0x7f04d406c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.570+0000 7f04db800640 1 -- 172.21.15.137:0/4031307532 >> 172.21.15.137:0/4031307532 conn(0x7f04d40b3270 msgr2=0x7f04d40b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:37.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.570+0000 7f04db800640 1 -- 172.21.15.137:0/4031307532 shutdown_connections 2024-04-26T23:41:37.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.570+0000 7f04db800640 1 -- 172.21.15.137:0/4031307532 wait complete. 2024-04-26T23:41:37.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04db800640 1 Processor -- start 2024-04-26T23:41:37.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04db800640 1 -- start start 2024-04-26T23:41:37.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04db800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04d406c940 0x7f04d4166000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:37.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04db800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04d40cfce0 0x7f04d414cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:37.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04db800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04d415a9c0 0x7f04d4159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:37.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04db800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f04d4169e80 con 0x7f04d415a9c0 2024-04-26T23:41:37.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04db800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f04d415ada0 con 0x7f04d40cfce0 2024-04-26T23:41:37.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04db800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f04d416a000 con 0x7f04d406c940 2024-04-26T23:41:37.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04d8e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04d406c940 0x7f04d4166000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:37.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04cbe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04d40cfce0 0x7f04d414cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:37.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04d8e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04d406c940 0x7f04d4166000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:36852/0 (socket says 172.21.15.137:36852) 2024-04-26T23:41:37.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04cbe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04d40cfce0 0x7f04d414cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:42558/0 (socket says 172.21.15.137:42558) 2024-04-26T23:41:37.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04d8e00640 1 -- 172.21.15.137:0/3209283472 learned_addr learned my addr 172.21.15.137:0/3209283472 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:37.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04d9800640 1 --2- 172.21.15.137:0/3209283472 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04d415a9c0 0x7f04d4159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:37.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04cbe00640 1 -- 172.21.15.137:0/3209283472 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04d406c940 msgr2=0x7f04d4166000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:37.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04cbe00640 1 --2- 172.21.15.137:0/3209283472 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04d406c940 0x7f04d4166000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04cbe00640 1 -- 172.21.15.137:0/3209283472 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04d415a9c0 msgr2=0x7f04d4159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:37.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04cbe00640 1 --2- 172.21.15.137:0/3209283472 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04d415a9c0 0x7f04d4159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04cbe00640 1 -- 172.21.15.137:0/3209283472 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d40cf090 con 0x7f04d40cfce0 2024-04-26T23:41:37.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04cbe00640 1 --2- 172.21.15.137:0/3209283472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04d40cfce0 0x7f04d414cba0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00c7f0 tx=0x7f04bc00cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:37.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04d1600640 1 -- 172.21.15.137:0/3209283472 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc015070 con 0x7f04d40cfce0 2024-04-26T23:41:37.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04d1600640 1 -- 172.21.15.137:0/3209283472 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04bc004220 con 0x7f04d40cfce0 2024-04-26T23:41:37.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04d1600640 1 -- 172.21.15.137:0/3209283472 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc003620 con 0x7f04d40cfce0 2024-04-26T23:41:37.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04db800640 1 -- 172.21.15.137:0/3209283472 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d4166690 con 0x7f04d40cfce0 2024-04-26T23:41:37.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.574+0000 7f04db800640 1 -- 172.21.15.137:0/3209283472 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d4166c50 con 0x7f04d40cfce0 2024-04-26T23:41:37.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.578+0000 7f04db800640 1 -- 172.21.15.137:0/3209283472 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04d406a4b0 con 0x7f04d40cfce0 2024-04-26T23:41:37.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.578+0000 7f04d1600640 1 -- 172.21.15.137:0/3209283472 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f04bc0037c0 con 0x7f04d40cfce0 2024-04-26T23:41:37.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.578+0000 7f04d1600640 1 --2- 172.21.15.137:0/3209283472 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f04b0068380 0x7f04b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:37.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.578+0000 7f04d1600640 1 -- 172.21.15.137:0/3209283472 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f04bc0866f0 con 0x7f04d40cfce0 2024-04-26T23:41:37.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.578+0000 7f04d8e00640 1 --2- 172.21.15.137:0/3209283472 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f04b0068380 0x7f04b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:37.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.578+0000 7f04d8e00640 1 --2- 172.21.15.137:0/3209283472 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f04b0068380 0x7f04b006a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f04c40099b0 tx=0x7f04c4009110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:37.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.582+0000 7f04d1600640 1 -- 172.21.15.137:0/3209283472 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f04bc056640 con 0x7f04d40cfce0 2024-04-26T23:41:37.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.774+0000 7f04db800640 1 -- 172.21.15.137:0/3209283472 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04d406ee50 con 0x7f04d40cfce0 2024-04-26T23:41:37.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.774+0000 7f04d1600640 1 -- 172.21.15.137:0/3209283472 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f04bc05a940 con 0x7f04d40cfce0 2024-04-26T23:41:37.780 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:37.780 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/861150521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":861150521},{"type":"v1","addr":"172.21.15.137:6836","nonce":861150521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/980246912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":980246912},{"type":"v1","addr":"172.21.15.137:6837","nonce":980246912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3288315078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3288315078},{"type":"v1","addr":"172.21.15.170:6835","nonce":3288315078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:41:23.574363+0000","modified":"2024-04-26T23:41:26.591710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6834/2444921875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2444921875},{"type":"v1","addr":"172.21.15.170:6834","nonce":2444921875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-26T23:41:37.780 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 8 2024-04-26T23:41:37.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.774+0000 7f04db800640 1 -- 172.21.15.137:0/3209283472 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f04b0068380 msgr2=0x7f04b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:37.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.774+0000 7f04db800640 1 --2- 172.21.15.137:0/3209283472 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f04b0068380 0x7f04b006a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f04c40099b0 tx=0x7f04c4009110 comp rx=0 tx=0).stop 2024-04-26T23:41:37.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.774+0000 7f04db800640 1 -- 172.21.15.137:0/3209283472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04d40cfce0 msgr2=0x7f04d414cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:37.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.774+0000 7f04db800640 1 --2- 172.21.15.137:0/3209283472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04d40cfce0 0x7f04d414cba0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00c7f0 tx=0x7f04bc00cbf0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.774+0000 7f04db800640 1 -- 172.21.15.137:0/3209283472 shutdown_connections 2024-04-26T23:41:37.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.774+0000 7f04db800640 1 --2- 172.21.15.137:0/3209283472 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f04b0068380 0x7f04b006a840 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.774+0000 7f04db800640 1 --2- 172.21.15.137:0/3209283472 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04d415a9c0 0x7f04d4159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.774+0000 7f04db800640 1 --2- 172.21.15.137:0/3209283472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04d40cfce0 0x7f04d414cba0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.774+0000 7f04db800640 1 --2- 172.21.15.137:0/3209283472 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04d406c940 0x7f04d4166000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:37.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.774+0000 7f04db800640 1 -- 172.21.15.137:0/3209283472 >> 172.21.15.137:0/3209283472 conn(0x7f04d40b3270 msgr2=0x7f04d40b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:37.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.774+0000 7f04db800640 1 -- 172.21.15.137:0/3209283472 shutdown_connections 2024-04-26T23:41:37.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:37.774+0000 7f04db800640 1 -- 172.21.15.137:0/3209283472 wait complete. 2024-04-26T23:41:38.203 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T23:41:23.574363+0000', 'modified': '2024-04-26T23:41:26.591710+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4296}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4296': {'gid': 4296, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.170:6834/2444921875', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6832', 'nonce': 2444921875}, {'type': 'v1', 'addr': '172.21.15.170:6834', 'nonce': 2444921875}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4296, 'qdb_cluster': [4296]} 2024-04-26T23:41:38.203 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T23:41:38.203 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-26T23:41:38.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.338+0000 7f747a600640 1 Processor -- start 2024-04-26T23:41:38.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.338+0000 7f747a600640 1 -- start start 2024-04-26T23:41:38.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.338+0000 7f747a600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f74740b4ad0 0x7f747406f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.338+0000 7f747a600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f747406f6d0 0x7f74740ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.338+0000 7f747a600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7474148d30 con 0x7f7474148950 2024-04-26T23:41:38.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.338+0000 7f747a600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f74741604d0 con 0x7f74740b4ad0 2024-04-26T23:41:38.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.338+0000 7f747a600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f747406fb30 con 0x7f747406f6d0 2024-04-26T23:41:38.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.338+0000 7f7472a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f74740b4ad0 0x7f747406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.338+0000 7f7473400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f7474148950 0x7f747415fdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:43044/0 (socket says 172.21.15.137:43044) 2024-04-26T23:41:38.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.338+0000 7f7473400640 1 -- 172.21.15.137:0/3952871842 learned_addr learned my addr 172.21.15.137:0/3952871842 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:38.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.338+0000 7f7473e00640 1 --2- 172.21.15.137:0/3952871842 >> v2:172.21.15.170:3300/0 conn(0x7f747406f6d0 0x7f74740ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.338+0000 7f7472000640 1 -- 172.21.15.137:0/3952871842 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1852386664 0 0) 0x7f7474148d30 con 0x7f7474148950 2024-04-26T23:41:38.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.338+0000 7f7472000640 1 -- 172.21.15.137:0/3952871842 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7458003530 con 0x7f7474148950 2024-04-26T23:41:38.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.338+0000 7f7472a00640 1 -- 172.21.15.137:0/3952871842 >> v2:172.21.15.170:3300/0 conn(0x7f747406f6d0 msgr2=0x7f74740ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:38.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.338+0000 7f7472a00640 1 --2- 172.21.15.137:0/3952871842 >> v2:172.21.15.170:3300/0 conn(0x7f747406f6d0 0x7f74740ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.338+0000 7f7472a00640 1 -- 172.21.15.137:0/3952871842 >> v1:172.21.15.137:6789/0 conn(0x7f7474148950 legacy=0x7f747415fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:38.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.338+0000 7f7472a00640 1 -- 172.21.15.137:0/3952871842 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7474073540 con 0x7f74740b4ad0 2024-04-26T23:41:38.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.342+0000 7f7472a00640 1 --2- 172.21.15.137:0/3952871842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74740b4ad0 0x7f747406f190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f74740cd710 tx=0x7f746001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38d763c2a67964c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:38.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.342+0000 7f7472000640 1 -- 172.21.15.137:0/3952871842 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74600ab650 con 0x7f74740b4ad0 2024-04-26T23:41:38.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.342+0000 7f7472000640 1 -- 172.21.15.137:0/3952871842 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74600b0070 con 0x7f74740b4ad0 2024-04-26T23:41:38.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.342+0000 7f7472000640 1 -- 172.21.15.137:0/3952871842 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74600aba10 con 0x7f74740b4ad0 2024-04-26T23:41:38.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.342+0000 7f747a600640 1 -- 172.21.15.137:0/3952871842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74740b4ad0 msgr2=0x7f747406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:38.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.342+0000 7f747a600640 1 --2- 172.21.15.137:0/3952871842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74740b4ad0 0x7f747406f190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f74740cd710 tx=0x7f746001c450 comp rx=0 tx=0).stop 2024-04-26T23:41:38.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.342+0000 7f747a600640 1 -- 172.21.15.137:0/3952871842 shutdown_connections 2024-04-26T23:41:38.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.342+0000 7f747a600640 1 --2- 172.21.15.137:0/3952871842 >> v2:172.21.15.170:3300/0 conn(0x7f747406f6d0 0x7f74740ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.342+0000 7f747a600640 1 --2- 172.21.15.137:0/3952871842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74740b4ad0 0x7f747406f190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.342+0000 7f747a600640 1 -- 172.21.15.137:0/3952871842 >> 172.21.15.137:0/3952871842 conn(0x7f747406c5d0 msgr2=0x7f747406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:38.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.342+0000 7f747a600640 1 -- 172.21.15.137:0/3952871842 shutdown_connections 2024-04-26T23:41:38.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.342+0000 7f747a600640 1 -- 172.21.15.137:0/3952871842 wait complete. 2024-04-26T23:41:38.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f747a600640 1 Processor -- start 2024-04-26T23:41:38.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f747a600640 1 -- start start 2024-04-26T23:41:38.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f747a600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f747406f6d0 0x7f7474148f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f747a600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74740b4ad0 0x7f747414ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f747a600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7474148950 0x7f747415f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f747a600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7474073320 con 0x7f7474148950 2024-04-26T23:41:38.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f747a600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f74740731a0 con 0x7f74740b4ad0 2024-04-26T23:41:38.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f747a600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7474074300 con 0x7f747406f6d0 2024-04-26T23:41:38.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f7473e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7474148950 0x7f747415f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f7473e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7474148950 0x7f747415f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43238/0 (socket says 172.21.15.137:43238) 2024-04-26T23:41:38.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f7473e00640 1 -- 172.21.15.137:0/984462207 learned_addr learned my addr 172.21.15.137:0/984462207 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:38.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f7473400640 1 --2- 172.21.15.137:0/984462207 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f747406f6d0 0x7f7474148f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f7472a00640 1 --2- 172.21.15.137:0/984462207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74740b4ad0 0x7f747414ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f7473e00640 1 -- 172.21.15.137:0/984462207 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f747406f6d0 msgr2=0x7f7474148f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:38.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f7473e00640 1 --2- 172.21.15.137:0/984462207 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f747406f6d0 0x7f7474148f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f7473e00640 1 -- 172.21.15.137:0/984462207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74740b4ad0 msgr2=0x7f747414ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:38.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f7473e00640 1 --2- 172.21.15.137:0/984462207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74740b4ad0 0x7f747414ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f7473e00640 1 -- 172.21.15.137:0/984462207 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74741495e0 con 0x7f7474148950 2024-04-26T23:41:38.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f7473400640 1 --2- 172.21.15.137:0/984462207 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f747406f6d0 0x7f7474148f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:38.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f7472a00640 1 --2- 172.21.15.137:0/984462207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74740b4ad0 0x7f747414ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:38.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f7473e00640 1 --2- 172.21.15.137:0/984462207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7474148950 0x7f747415f220 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f746c007e40 tx=0x7f746c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:38.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f746b400640 1 -- 172.21.15.137:0/984462207 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746c014620 con 0x7f7474148950 2024-04-26T23:41:38.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f746b400640 1 -- 172.21.15.137:0/984462207 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f746c019070 con 0x7f7474148950 2024-04-26T23:41:38.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f746b400640 1 -- 172.21.15.137:0/984462207 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746c014a20 con 0x7f7474148950 2024-04-26T23:41:38.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f747a600640 1 -- 172.21.15.137:0/984462207 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74741498c0 con 0x7f7474148950 2024-04-26T23:41:38.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.346+0000 7f747a600640 1 -- 172.21.15.137:0/984462207 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7474149e80 con 0x7f7474148950 2024-04-26T23:41:38.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.350+0000 7f746b400640 1 -- 172.21.15.137:0/984462207 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f746c014bc0 con 0x7f7474148950 2024-04-26T23:41:38.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.350+0000 7f746b400640 1 --2- 172.21.15.137:0/984462207 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7454068380 0x7f745406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.350+0000 7f746b400640 1 -- 172.21.15.137:0/984462207 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f746c087380 con 0x7f7474148950 2024-04-26T23:41:38.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.350+0000 7f7473400640 1 --2- 172.21.15.137:0/984462207 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7454068380 0x7f745406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.350+0000 7f747db42000 1 Processor -- start 2024-04-26T23:41:38.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.350+0000 7f747db42000 1 -- start start 2024-04-26T23:41:38.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f7473400640 1 --2- 172.21.15.137:0/984462207 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7454068380 0x7f745406a840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7464005890 tx=0x7f7464009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:38.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f747db42000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86f2a700 0x561d86f2aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f747db42000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d86f2b020 0x561d86ee1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f747db42000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561d86ee1740 0x561d86ee1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f747db42000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561d86d99140 con 0x561d86f2a700 2024-04-26T23:41:38.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f747db42000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x561d86d2ee00 con 0x561d86f2b020 2024-04-26T23:41:38.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f747db42000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x561d86ce7a00 con 0x561d86ee1740 2024-04-26T23:41:38.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f7473400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86f2a700 0x561d86f2aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f7473400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86f2a700 0x561d86f2aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43250/0 (socket says 172.21.15.137:43250) 2024-04-26T23:41:38.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f7473400640 1 -- 172.21.15.137:0/3348926405 learned_addr learned my addr 172.21.15.137:0/3348926405 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:38.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f7473400640 1 -- 172.21.15.137:0/3348926405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561d86ee1740 msgr2=0x561d86ee1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:38.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f7473400640 1 --2- 172.21.15.137:0/3348926405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561d86ee1740 0x561d86ee1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f7473400640 1 -- 172.21.15.137:0/3348926405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d86f2b020 msgr2=0x561d86ee1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:38.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f7473400640 1 --2- 172.21.15.137:0/3348926405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d86f2b020 0x561d86ee1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f7473400640 1 -- 172.21.15.137:0/3348926405 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d86cec0e0 con 0x561d86f2a700 2024-04-26T23:41:38.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f7473400640 1 --2- 172.21.15.137:0/3348926405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86f2a700 0x561d86f2aae0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7464005b80 tx=0x7f7464010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f787f4621f5edc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:38.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f745fe00640 1 -- 172.21.15.137:0/3348926405 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746400d940 con 0x561d86f2a700 2024-04-26T23:41:38.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f745fe00640 1 -- 172.21.15.137:0/3348926405 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f746400dae0 con 0x561d86f2a700 2024-04-26T23:41:38.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f745fe00640 1 -- 172.21.15.137:0/3348926405 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746400de90 con 0x561d86f2a700 2024-04-26T23:41:38.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f747db42000 1 -- 172.21.15.137:0/3348926405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86f2a700 msgr2=0x561d86f2aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:38.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f747db42000 1 --2- 172.21.15.137:0/3348926405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86f2a700 0x561d86f2aae0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7464005b80 tx=0x7f7464010000 comp rx=0 tx=0).stop 2024-04-26T23:41:38.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f747db42000 1 -- 172.21.15.137:0/3348926405 shutdown_connections 2024-04-26T23:41:38.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f747db42000 1 --2- 172.21.15.137:0/3348926405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561d86ee1740 0x561d86ee1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f747db42000 1 --2- 172.21.15.137:0/3348926405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d86f2b020 0x561d86ee1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f747db42000 1 --2- 172.21.15.137:0/3348926405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86f2a700 0x561d86f2aae0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f747db42000 1 -- 172.21.15.137:0/3348926405 >> 172.21.15.137:0/3348926405 conn(0x561d86edd6f0 msgr2=0x561d86edfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:38.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f747db42000 1 -- 172.21.15.137:0/3348926405 shutdown_connections 2024-04-26T23:41:38.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f747db42000 1 -- 172.21.15.137:0/3348926405 wait complete. 2024-04-26T23:41:38.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f747db42000 1 -- start start 2024-04-26T23:41:38.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.354+0000 7f747db42000 1 Processor -- start 2024-04-26T23:41:38.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f747db42000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86ee1740 0x561d86eec0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f747db42000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561d86f2a700 0x561d86eec5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f747db42000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d86f2b020 0x561d86eecb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f747db42000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561d86d3c200 con 0x561d86ee1740 2024-04-26T23:41:38.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f747db42000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x561d86cd2e80 con 0x561d86f2b020 2024-04-26T23:41:38.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f747db42000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x561d86d29ae0 con 0x561d86f2a700 2024-04-26T23:41:38.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f747db42000 10 client.0 _ll_register_callbacks cb 0x561d86d3bda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:41:38.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f7473400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86ee1740 0x561d86eec0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f7473400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86ee1740 0x561d86eec0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43264/0 (socket says 172.21.15.137:43264) 2024-04-26T23:41:38.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f7473400640 1 -- 172.21.15.137:0/2507818917 learned_addr learned my addr 172.21.15.137:0/2507818917 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:38.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f7472a00640 1 --2- 172.21.15.137:0/2507818917 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561d86f2a700 0x561d86eec5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f7473e00640 1 --2- 172.21.15.137:0/2507818917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d86f2b020 0x561d86eecb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f7473400640 1 -- 172.21.15.137:0/2507818917 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561d86f2a700 msgr2=0x561d86eec5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:38.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f7473400640 1 --2- 172.21.15.137:0/2507818917 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561d86f2a700 0x561d86eec5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f7473400640 1 -- 172.21.15.137:0/2507818917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d86f2b020 msgr2=0x561d86eecb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:38.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f7473400640 1 --2- 172.21.15.137:0/2507818917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d86f2b020 0x561d86eecb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f7473400640 1 -- 172.21.15.137:0/2507818917 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d86cce4e0 con 0x561d86ee1740 2024-04-26T23:41:38.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f7473400640 1 --2- 172.21.15.137:0/2507818917 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86ee1740 0x561d86eec0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7464009010 tx=0x7f7464007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78fa7fd728000d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:38.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f745cc00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T23:41:38.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f745cc00640 1 -- 172.21.15.137:0/2507818917 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74640209e0 con 0x561d86ee1740 2024-04-26T23:41:38.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f747db42000 1 -- 172.21.15.137:0/2507818917 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f746400dae0 con 0x561d86ee1740 2024-04-26T23:41:38.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f745cc00640 1 -- 172.21.15.137:0/2507818917 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7464020b80 con 0x561d86ee1740 2024-04-26T23:41:38.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f745cc00640 1 -- 172.21.15.137:0/2507818917 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f7464034050 con 0x561d86ee1740 2024-04-26T23:41:38.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f747db42000 10 client.4668 fetch_fsmap learned FSMap version 8 2024-04-26T23:41:38.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f747db42000 1 -- 172.21.15.137:0/2507818917 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x561d86cb4e80 con 0x561d86ee1740 2024-04-26T23:41:38.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f745cc00640 1 -- 172.21.15.137:0/2507818917 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f746400dae0 con 0x561d86ee1740 2024-04-26T23:41:38.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f745cc00640 1 -- 172.21.15.137:0/2507818917 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f7464037020 con 0x561d86ee1740 2024-04-26T23:41:38.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f747db42000 10 client.4668 fetch_fsmap finished waiting for FSMap version 8 2024-04-26T23:41:38.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f747db42000 10 client.4668 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-26T23:41:38.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f747db42000 20 client.4668 populate_metadata read hostname 'smithi137' 2024-04-26T23:41:38.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f747db42000 1 --2- 172.21.15.137:0/2507818917 >> [v2:172.21.15.170:6832/2444921875,v1:172.21.15.170:6834/2444921875] conn(0x561d86eed530 0x561d86f3c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f747db42000 4 client.4668 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T23:41:38.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f747db42000 1 -- 172.21.15.137:0/2507818917 --> [v2:172.21.15.170:6832/2444921875,v1:172.21.15.170:6834/2444921875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d86cc7bc0 con 0x561d86eed530 2024-04-26T23:41:38.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f7472a00640 1 --2- 172.21.15.137:0/2507818917 >> [v2:172.21.15.170:6832/2444921875,v1:172.21.15.170:6834/2444921875] conn(0x561d86eed530 0x561d86f3c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f7472a00640 1 --2- 172.21.15.137:0/2507818917 >> [v2:172.21.15.170:6832/2444921875,v1:172.21.15.170:6834/2444921875] conn(0x561d86eed530 0x561d86f3c7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6c079ef320b4452 server_cookie=8f03d4b44cf637eb in_seq=0 out_seq=0 2024-04-26T23:41:38.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.358+0000 7f745cc00640 10 client.4668 ms_handle_connect on v2:172.21.15.170:6832/2444921875 2024-04-26T23:41:38.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.362+0000 7f745cc00640 1 -- 172.21.15.137:0/2507818917 <== mds.0 v2:172.21.15.170:6832/2444921875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561d86cc7bc0 con 0x561d86eed530 2024-04-26T23:41:38.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.362+0000 7f745cc00640 10 client.4668 handle_command_reply: tid=0 2024-04-26T23:41:38.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.362+0000 7f747db42000 1 client.4668 shutdown 2024-04-26T23:41:38.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.362+0000 7f747db42000 1 -- 172.21.15.137:0/2507818917 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86ee1740 msgr2=0x561d86eec0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:38.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.362+0000 7f747db42000 1 --2- 172.21.15.137:0/2507818917 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86ee1740 0x561d86eec0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7464009010 tx=0x7f7464007000 comp rx=0 tx=0).stop 2024-04-26T23:41:38.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.362+0000 7f747db42000 1 -- 172.21.15.137:0/2507818917 shutdown_connections 2024-04-26T23:41:38.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.362+0000 7f747db42000 1 --2- 172.21.15.137:0/2507818917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d86f2b020 0x561d86eecb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.362+0000 7f747db42000 1 --2- 172.21.15.137:0/2507818917 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561d86f2a700 0x561d86eec5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.362+0000 7f747db42000 1 --2- 172.21.15.137:0/2507818917 >> [v2:172.21.15.170:6832/2444921875,v1:172.21.15.170:6834/2444921875] conn(0x561d86eed530 0x561d86f3c7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.362+0000 7f747db42000 1 --2- 172.21.15.137:0/2507818917 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86ee1740 0x561d86eec0a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.362+0000 7f745cc00640 0 client.4668 ms_handle_reset on v2:172.21.15.170:6832/2444921875 2024-04-26T23:41:38.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.362+0000 7f747db42000 1 -- 172.21.15.137:0/2507818917 >> 172.21.15.137:0/2507818917 conn(0x561d86edd6f0 msgr2=0x561d86ee0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:38.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.362+0000 7f747db42000 1 -- 172.21.15.137:0/2507818917 shutdown_connections 2024-04-26T23:41:38.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.362+0000 7f747db42000 1 -- 172.21.15.137:0/2507818917 wait complete. 2024-04-26T23:41:38.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.362+0000 7f747db42000 20 client.4668 trim_cache size 0 max 16384 2024-04-26T23:41:38.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.378+0000 7f747db42000 1 Processor -- start 2024-04-26T23:41:38.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.378+0000 7f747db42000 1 -- start start 2024-04-26T23:41:38.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.378+0000 7f747db42000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d86ee1740 0x561d86edfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.378+0000 7f747db42000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561d86f2a700 0x561d86ee0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.378+0000 7f747db42000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86f2b020 0x561d86ee0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.378+0000 7f747db42000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f74742034b0 con 0x561d86f2b020 2024-04-26T23:41:38.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.378+0000 7f747db42000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f747414b050 con 0x561d86ee1740 2024-04-26T23:41:38.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.378+0000 7f747db42000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f747414b6a0 con 0x561d86f2a700 2024-04-26T23:41:38.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.378+0000 7f7473e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86f2b020 0x561d86ee0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.378+0000 7f7473e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86f2b020 0x561d86ee0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43278/0 (socket says 172.21.15.137:43278) 2024-04-26T23:41:38.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.378+0000 7f7473e00640 1 -- 172.21.15.137:0/4040118485 learned_addr learned my addr 172.21.15.137:0/4040118485 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:38.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.378+0000 7f7473400640 1 --2- 172.21.15.137:0/4040118485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d86ee1740 0x561d86edfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.378+0000 7f7472a00640 1 --2- 172.21.15.137:0/4040118485 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561d86f2a700 0x561d86ee0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.378+0000 7f7473e00640 1 -- 172.21.15.137:0/4040118485 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561d86f2a700 msgr2=0x561d86ee0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:38.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.378+0000 7f7473e00640 1 --2- 172.21.15.137:0/4040118485 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561d86f2a700 0x561d86ee0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.378+0000 7f7473e00640 1 -- 172.21.15.137:0/4040118485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d86ee1740 msgr2=0x561d86edfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:38.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.378+0000 7f7473e00640 1 --2- 172.21.15.137:0/4040118485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d86ee1740 0x561d86edfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.378+0000 7f7473e00640 1 -- 172.21.15.137:0/4040118485 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d86ce7c50 con 0x561d86f2b020 2024-04-26T23:41:38.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.378+0000 7f7473400640 1 --2- 172.21.15.137:0/4040118485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d86ee1740 0x561d86edfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:38.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.378+0000 7f7472a00640 1 --2- 172.21.15.137:0/4040118485 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561d86f2a700 0x561d86ee0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:38.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f7473e00640 1 --2- 172.21.15.137:0/4040118485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86f2b020 0x561d86ee0a30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f746c053600 tx=0x7f746c056bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68ac20ce56bd941 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:38.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f745f400640 1 -- 172.21.15.137:0/4040118485 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746c05b550 con 0x561d86f2b020 2024-04-26T23:41:38.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f745f400640 1 -- 172.21.15.137:0/4040118485 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f746c05fd80 con 0x561d86f2b020 2024-04-26T23:41:38.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f745f400640 1 -- 172.21.15.137:0/4040118485 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746c0870b0 con 0x561d86f2b020 2024-04-26T23:41:38.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f747db42000 1 -- 172.21.15.137:0/4040118485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86f2b020 msgr2=0x561d86ee0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:38.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f747db42000 1 --2- 172.21.15.137:0/4040118485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86f2b020 0x561d86ee0a30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f746c053600 tx=0x7f746c056bc0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f747db42000 1 -- 172.21.15.137:0/4040118485 shutdown_connections 2024-04-26T23:41:38.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f747db42000 1 --2- 172.21.15.137:0/4040118485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86f2b020 0x561d86ee0a30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f747db42000 1 --2- 172.21.15.137:0/4040118485 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561d86f2a700 0x561d86ee0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f747db42000 1 --2- 172.21.15.137:0/4040118485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d86ee1740 0x561d86edfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f747db42000 1 -- 172.21.15.137:0/4040118485 >> 172.21.15.137:0/4040118485 conn(0x561d86edd6f0 msgr2=0x561d86eec930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:38.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f747db42000 1 -- 172.21.15.137:0/4040118485 shutdown_connections 2024-04-26T23:41:38.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f747db42000 1 -- 172.21.15.137:0/4040118485 wait complete. 2024-04-26T23:41:38.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f747db42000 1 -- start start 2024-04-26T23:41:38.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f747db42000 1 Processor -- start 2024-04-26T23:41:38.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f747db42000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d86ee1740 0x561d86f3f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f747db42000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86f2a700 0x561d86f5eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f747db42000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561d86f2b020 0x561d86f5f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f747db42000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561d86d2e110 con 0x561d86f2a700 2024-04-26T23:41:38.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f747db42000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x561d86cc47b0 con 0x561d86ee1740 2024-04-26T23:41:38.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f747db42000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x561d86d33430 con 0x561d86f2b020 2024-04-26T23:41:38.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f747db42000 10 client.0 _ll_register_callbacks cb 0x7f7464005a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:41:38.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f7472a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86f2a700 0x561d86f5eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f7472a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86f2a700 0x561d86f5eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43292/0 (socket says 172.21.15.137:43292) 2024-04-26T23:41:38.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f7472a00640 1 -- 172.21.15.137:0/1164179297 learned_addr learned my addr 172.21.15.137:0/1164179297 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:38.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f7473400640 1 --2- 172.21.15.137:0/1164179297 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d86ee1740 0x561d86f3f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f7473e00640 1 --2- 172.21.15.137:0/1164179297 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561d86f2b020 0x561d86f5f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f7472a00640 1 -- 172.21.15.137:0/1164179297 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561d86f2b020 msgr2=0x561d86f5f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:38.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f7472a00640 1 --2- 172.21.15.137:0/1164179297 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561d86f2b020 0x561d86f5f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f7472a00640 1 -- 172.21.15.137:0/1164179297 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d86ee1740 msgr2=0x561d86f3f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:38.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f7472a00640 1 --2- 172.21.15.137:0/1164179297 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d86ee1740 0x561d86f3f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f7472a00640 1 -- 172.21.15.137:0/1164179297 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d86db1160 con 0x561d86f2a700 2024-04-26T23:41:38.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f7472a00640 1 --2- 172.21.15.137:0/1164179297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86f2a700 0x561d86f5eb50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f746001ccf0 tx=0x7f74600046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d3c8f1990f27a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:38.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f745cc00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T23:41:38.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f745cc00640 1 -- 172.21.15.137:0/1164179297 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74600be340 con 0x561d86f2a700 2024-04-26T23:41:38.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f745cc00640 1 -- 172.21.15.137:0/1164179297 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f74600be4e0 con 0x561d86f2a700 2024-04-26T23:41:38.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.382+0000 7f747db42000 1 -- 172.21.15.137:0/1164179297 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f746c05fd80 con 0x561d86f2a700 2024-04-26T23:41:38.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f745cc00640 1 -- 172.21.15.137:0/1164179297 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f74600be6e0 con 0x561d86f2a700 2024-04-26T23:41:38.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747db42000 10 client.4674 fetch_fsmap learned FSMap version 8 2024-04-26T23:41:38.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747db42000 1 -- 172.21.15.137:0/1164179297 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x561d869e80c0 con 0x561d86f2a700 2024-04-26T23:41:38.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f745cc00640 1 -- 172.21.15.137:0/1164179297 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f746c05fd80 con 0x561d86f2a700 2024-04-26T23:41:38.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f745cc00640 1 -- 172.21.15.137:0/1164179297 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f74600ab590 con 0x561d86f2a700 2024-04-26T23:41:38.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747db42000 10 client.4674 fetch_fsmap finished waiting for FSMap version 8 2024-04-26T23:41:38.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747db42000 10 client.4674 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-26T23:41:38.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747db42000 20 client.4674 populate_metadata read hostname 'smithi137' 2024-04-26T23:41:38.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747db42000 1 --2- 172.21.15.137:0/1164179297 >> [v2:172.21.15.170:6832/2444921875,v1:172.21.15.170:6834/2444921875] conn(0x561d86fa1f80 0x561d86fa2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747db42000 4 client.4674 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T23:41:38.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747db42000 1 -- 172.21.15.137:0/1164179297 --> [v2:172.21.15.170:6832/2444921875,v1:172.21.15.170:6834/2444921875] -- command(tid 0: {"prefix": "status"}) -- 0x561d86d3ca10 con 0x561d86fa1f80 2024-04-26T23:41:38.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f7473400640 1 --2- 172.21.15.137:0/1164179297 >> [v2:172.21.15.170:6832/2444921875,v1:172.21.15.170:6834/2444921875] conn(0x561d86fa1f80 0x561d86fa2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f7473400640 1 --2- 172.21.15.137:0/1164179297 >> [v2:172.21.15.170:6832/2444921875,v1:172.21.15.170:6834/2444921875] conn(0x561d86fa1f80 0x561d86fa2360 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc05ee0762887951 server_cookie=88c308185586f6c3 in_seq=0 out_seq=0 2024-04-26T23:41:38.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f745cc00640 10 client.4674 ms_handle_connect on v2:172.21.15.170:6832/2444921875 2024-04-26T23:41:38.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f745cc00640 1 -- 172.21.15.137:0/1164179297 <== mds.0 v2:172.21.15.170:6832/2444921875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x561d86d3ca10 con 0x561d86fa1f80 2024-04-26T23:41:38.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f745cc00640 10 client.4674 handle_command_reply: tid=0 2024-04-26T23:41:38.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747db42000 1 client.4674 shutdown 2024-04-26T23:41:38.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747db42000 1 -- 172.21.15.137:0/1164179297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86f2a700 msgr2=0x561d86f5eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:38.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747db42000 1 --2- 172.21.15.137:0/1164179297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86f2a700 0x561d86f5eb50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f746001ccf0 tx=0x7f74600046d0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747db42000 1 -- 172.21.15.137:0/1164179297 shutdown_connections 2024-04-26T23:41:38.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747db42000 1 --2- 172.21.15.137:0/1164179297 >> [v2:172.21.15.170:6832/2444921875,v1:172.21.15.170:6834/2444921875] conn(0x561d86fa1f80 0x561d86fa2360 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747db42000 1 --2- 172.21.15.137:0/1164179297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561d86f2a700 0x561d86f5eb50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747db42000 1 --2- 172.21.15.137:0/1164179297 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561d86f2b020 0x561d86f5f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f745cc00640 0 client.4674 ms_handle_reset on v2:172.21.15.170:6832/2444921875 2024-04-26T23:41:38.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747db42000 1 --2- 172.21.15.137:0/1164179297 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d86ee1740 0x561d86f3f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747db42000 1 -- 172.21.15.137:0/1164179297 >> 172.21.15.137:0/1164179297 conn(0x561d86edd6f0 msgr2=0x561d86f37460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:38.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747db42000 1 -- 172.21.15.137:0/1164179297 shutdown_connections 2024-04-26T23:41:38.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747db42000 1 -- 172.21.15.137:0/1164179297 wait complete. 2024-04-26T23:41:38.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747db42000 20 client.4674 trim_cache size 0 max 16384 2024-04-26T23:41:38.397 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:41:38.397 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "efde6204-be0d-4c4f-9ea0-954d26627e78", 2024-04-26T23:41:38.397 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 0, 2024-04-26T23:41:38.398 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 4296, 2024-04-26T23:41:38.398 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-26T23:41:38.398 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-26T23:41:38.398 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-26T23:41:38.398 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 14.189105036999999, 2024-04-26T23:41:38.398 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 8, 2024-04-26T23:41:38.398 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 20, 2024-04-26T23:41:38.398 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 20, 2024-04-26T23:41:38.398 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 21.058563629999998 2024-04-26T23:41:38.398 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:41:38.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747a600640 1 -- 172.21.15.137:0/984462207 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7454068380 msgr2=0x7f745406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:38.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747a600640 1 --2- 172.21.15.137:0/984462207 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7454068380 0x7f745406a840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7464005890 tx=0x7f7464009040 comp rx=0 tx=0).stop 2024-04-26T23:41:38.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747a600640 1 -- 172.21.15.137:0/984462207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7474148950 msgr2=0x7f747415f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:38.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747a600640 1 --2- 172.21.15.137:0/984462207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7474148950 0x7f747415f220 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f746c007e40 tx=0x7f746c00e4b0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747a600640 1 -- 172.21.15.137:0/984462207 shutdown_connections 2024-04-26T23:41:38.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747a600640 1 --2- 172.21.15.137:0/984462207 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7454068380 0x7f745406a840 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747a600640 1 --2- 172.21.15.137:0/984462207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7474148950 0x7f747415f220 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747a600640 1 --2- 172.21.15.137:0/984462207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74740b4ad0 0x7f747414ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747a600640 1 --2- 172.21.15.137:0/984462207 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f747406f6d0 0x7f7474148f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747a600640 1 -- 172.21.15.137:0/984462207 >> 172.21.15.137:0/984462207 conn(0x7f747406c5d0 msgr2=0x7f747406c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:38.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747a600640 1 -- 172.21.15.137:0/984462207 shutdown_connections 2024-04-26T23:41:38.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.386+0000 7f747a600640 1 -- 172.21.15.137:0/984462207 wait complete. 2024-04-26T23:41:38.413 INFO:teuthology.run_tasks:Running task sequential... 2024-04-26T23:41:38.427 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-26T23:41:38.428 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-26T23:41:38.428 INFO:teuthology.task.print:Enabling mgr modules 2024-04-26T23:41:38.428 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-26T23:41:38.453 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-26T23:41:38.454 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-26T23:41:38.454 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-26T23:41:38.454 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T23:41:38.454 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T23:41:38.454 INFO:tasks.ceph_fuse:client.2 config is {} 2024-04-26T23:41:38.454 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T23:41:38.454 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-26T23:41:38.455 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-26T23:41:38.455 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T23:41:38.455 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T23:41:38.455 INFO:tasks.ceph_fuse:client.3 config is {} 2024-04-26T23:41:38.455 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T23:41:38.455 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-26T23:41:38.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:38.455 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T23:41:38.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:38.465 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-04-26T23:41:38.532 INFO:teuthology.orchestra.run.smithi137.stderr:Cannot find device "ceph-brx" 2024-04-26T23:41:38.533 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:41:38.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:38.534 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-04-26T23:41:38.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:38.545 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link delete ceph-brx 2024-04-26T23:41:38.611 INFO:teuthology.orchestra.run.smithi170.stderr:Cannot find device "ceph-brx" 2024-04-26T23:41:38.613 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:41:38.614 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-26T23:41:38.614 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:41:38.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.742+0000 7fdfb8000640 1 Processor -- start 2024-04-26T23:41:38.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.742+0000 7fdfb8000640 1 -- start start 2024-04-26T23:41:38.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.746+0000 7fdfb8000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fdfb00725a0 0x7fdfb00cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.746+0000 7fdfb8000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdfb00b5080 0x7fdfb0165930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.746+0000 7fdfb8000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfb00cfef0 con 0x7fdfb0073f30 2024-04-26T23:41:38.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.746+0000 7fdfb8000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fdfb00cddc0 con 0x7fdfb00b5080 2024-04-26T23:41:38.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.746+0000 7fdfb8000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fdfb00d01b0 con 0x7fdfb00725a0 2024-04-26T23:41:38.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.746+0000 7fdfb6000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdfb00b5080 0x7fdfb0165930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.746+0000 7fdfb4c00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fdfb0073f30 0x7fdfb0072980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:43050/0 (socket says 172.21.15.137:43050) 2024-04-26T23:41:38.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.746+0000 7fdfb4c00640 1 -- 172.21.15.137:0/1198675746 learned_addr learned my addr 172.21.15.137:0/1198675746 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:38.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.746+0000 7fdfb5600640 1 --2- 172.21.15.137:0/1198675746 >> v2:172.21.15.170:3300/0 conn(0x7fdfb00725a0 0x7fdfb00cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.746+0000 7fdfb6000640 1 -- 172.21.15.137:0/1198675746 >> v2:172.21.15.170:3300/0 conn(0x7fdfb00725a0 msgr2=0x7fdfb00cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:38.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.746+0000 7fdfb6000640 1 --2- 172.21.15.137:0/1198675746 >> v2:172.21.15.170:3300/0 conn(0x7fdfb00725a0 0x7fdfb00cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.746+0000 7fdfb6000640 1 -- 172.21.15.137:0/1198675746 >> v1:172.21.15.137:6789/0 conn(0x7fdfb0073f30 legacy=0x7fdfb0072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:38.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.746+0000 7fdfb6000640 1 -- 172.21.15.137:0/1198675746 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb00d0490 con 0x7fdfb00b5080 2024-04-26T23:41:38.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.746+0000 7fdfb6000640 1 --2- 172.21.15.137:0/1198675746 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfb00b5080 0x7fdfb0165930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdfb006ffc0 tx=0x7fdfa801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0657f196d9e88 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:38.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.746+0000 7fdfafe00640 1 -- 172.21.15.137:0/1198675746 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa80b2070 con 0x7fdfb00b5080 2024-04-26T23:41:38.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfafe00640 1 -- 172.21.15.137:0/1198675746 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa80a9070 con 0x7fdfb00b5080 2024-04-26T23:41:38.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfafe00640 1 -- 172.21.15.137:0/1198675746 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa80ad880 con 0x7fdfb00b5080 2024-04-26T23:41:38.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfb8000640 1 -- 172.21.15.137:0/1198675746 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfb00b5080 msgr2=0x7fdfb0165930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:38.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfb8000640 1 --2- 172.21.15.137:0/1198675746 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfb00b5080 0x7fdfb0165930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdfb006ffc0 tx=0x7fdfa801c450 comp rx=0 tx=0).stop 2024-04-26T23:41:38.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfb8000640 1 -- 172.21.15.137:0/1198675746 shutdown_connections 2024-04-26T23:41:38.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfb8000640 1 --2- 172.21.15.137:0/1198675746 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfb00b5080 0x7fdfb0165930 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfb8000640 1 --2- 172.21.15.137:0/1198675746 >> v2:172.21.15.170:3300/0 conn(0x7fdfb00725a0 0x7fdfb00cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfb8000640 1 -- 172.21.15.137:0/1198675746 >> 172.21.15.137:0/1198675746 conn(0x7fdfb006c5d0 msgr2=0x7fdfb006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:38.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfb8000640 1 -- 172.21.15.137:0/1198675746 shutdown_connections 2024-04-26T23:41:38.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfb8000640 1 -- 172.21.15.137:0/1198675746 wait complete. 2024-04-26T23:41:38.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfb8000640 1 Processor -- start 2024-04-26T23:41:38.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfb8000640 1 -- start start 2024-04-26T23:41:38.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfb8000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdfb00725a0 0x7fdfb015e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfb8000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfb0073f30 0x7fdfb013b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfb8000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdfb00b5080 0x7fdfb013b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfb8000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb0168a20 con 0x7fdfb0073f30 2024-04-26T23:41:38.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfb8000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb01688a0 con 0x7fdfb00b5080 2024-04-26T23:41:38.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfb8000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb0168ba0 con 0x7fdfb00725a0 2024-04-26T23:41:38.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfb4c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfb0073f30 0x7fdfb013b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfb5600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdfb00725a0 0x7fdfb015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfb4c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfb0073f30 0x7fdfb013b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43316/0 (socket says 172.21.15.137:43316) 2024-04-26T23:41:38.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfb4c00640 1 -- 172.21.15.137:0/2092646713 learned_addr learned my addr 172.21.15.137:0/2092646713 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:38.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.750+0000 7fdfb6000640 1 --2- 172.21.15.137:0/2092646713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdfb00b5080 0x7fdfb013b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.754+0000 7fdfb4c00640 1 -- 172.21.15.137:0/2092646713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdfb00725a0 msgr2=0x7fdfb015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:38.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.754+0000 7fdfb4c00640 1 --2- 172.21.15.137:0/2092646713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdfb00725a0 0x7fdfb015e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.754+0000 7fdfb4c00640 1 -- 172.21.15.137:0/2092646713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdfb00b5080 msgr2=0x7fdfb013b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:38.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.754+0000 7fdfb4c00640 1 --2- 172.21.15.137:0/2092646713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdfb00b5080 0x7fdfb013b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.754+0000 7fdfb4c00640 1 -- 172.21.15.137:0/2092646713 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb015de20 con 0x7fdfb0073f30 2024-04-26T23:41:38.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.754+0000 7fdfb4c00640 1 --2- 172.21.15.137:0/2092646713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfb0073f30 0x7fdfb013b480 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00c450 tx=0x7fdf9c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:38.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.754+0000 7fdfad600640 1 -- 172.21.15.137:0/2092646713 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c017070 con 0x7fdfb0073f30 2024-04-26T23:41:38.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.754+0000 7fdfad600640 1 -- 172.21.15.137:0/2092646713 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf9c005cf0 con 0x7fdfb0073f30 2024-04-26T23:41:38.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.754+0000 7fdfad600640 1 -- 172.21.15.137:0/2092646713 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c007290 con 0x7fdfb0073f30 2024-04-26T23:41:38.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.754+0000 7fdfb8000640 1 -- 172.21.15.137:0/2092646713 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb013c5e0 con 0x7fdfb0073f30 2024-04-26T23:41:38.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.754+0000 7fdfb8000640 1 -- 172.21.15.137:0/2092646713 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb013a830 con 0x7fdfb0073f30 2024-04-26T23:41:38.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.754+0000 7fdfb8000640 1 -- 172.21.15.137:0/2092646713 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb006a4b0 con 0x7fdfb0073f30 2024-04-26T23:41:38.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.754+0000 7fdfad600640 1 -- 172.21.15.137:0/2092646713 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdf9c01a070 con 0x7fdfb0073f30 2024-04-26T23:41:38.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.754+0000 7fdfad600640 1 --2- 172.21.15.137:0/2092646713 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdf900683b0 0x7fdf9006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:38.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.754+0000 7fdfad600640 1 -- 172.21.15.137:0/2092646713 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdf9c085c20 con 0x7fdfb0073f30 2024-04-26T23:41:38.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.754+0000 7fdfb5600640 1 --2- 172.21.15.137:0/2092646713 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdf900683b0 0x7fdf9006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:38.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.758+0000 7fdfb5600640 1 --2- 172.21.15.137:0/2092646713 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdf900683b0 0x7fdf9006a870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4003ab0 tx=0x7fdfa4009830 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:38.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.758+0000 7fdfad600640 1 -- 172.21.15.137:0/2092646713 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdf9c055b80 con 0x7fdfb0073f30 2024-04-26T23:41:38.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.950+0000 7fdfb8000640 1 -- 172.21.15.137:0/2092646713 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdfb0141f60 con 0x7fdfb0073f30 2024-04-26T23:41:38.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.950+0000 7fdfad600640 1 -- 172.21.15.137:0/2092646713 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fdf9c059e80 con 0x7fdfb0073f30 2024-04-26T23:41:38.957 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:41:38.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.954+0000 7fdfb8000640 1 -- 172.21.15.137:0/2092646713 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdf900683b0 msgr2=0x7fdf9006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:38.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.954+0000 7fdfb8000640 1 --2- 172.21.15.137:0/2092646713 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdf900683b0 0x7fdf9006a870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4003ab0 tx=0x7fdfa4009830 comp rx=0 tx=0).stop 2024-04-26T23:41:38.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.954+0000 7fdfb8000640 1 -- 172.21.15.137:0/2092646713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfb0073f30 msgr2=0x7fdfb013b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.954+0000 7fdfb8000640 1 --2- 172.21.15.137:0/2092646713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfb0073f30 0x7fdfb013b480 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00c450 tx=0x7fdf9c00c910 comp rx=0 tx=0).stop 2024-04-26T23:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.954+0000 7fdfb8000640 1 -- 172.21.15.137:0/2092646713 shutdown_connections 2024-04-26T23:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.954+0000 7fdfb8000640 1 --2- 172.21.15.137:0/2092646713 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdf900683b0 0x7fdf9006a870 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.954+0000 7fdfb8000640 1 --2- 172.21.15.137:0/2092646713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdfb0073f30 0x7fdfb013b480 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.954+0000 7fdfb8000640 1 --2- 172.21.15.137:0/2092646713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdfb00b5080 0x7fdfb013b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.954+0000 7fdfb8000640 1 --2- 172.21.15.137:0/2092646713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdfb00725a0 0x7fdfb015e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.954+0000 7fdfb8000640 1 -- 172.21.15.137:0/2092646713 >> 172.21.15.137:0/2092646713 conn(0x7fdfb006c5d0 msgr2=0x7fdfb0143a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.954+0000 7fdfb8000640 1 -- 172.21.15.137:0/2092646713 shutdown_connections 2024-04-26T23:41:38.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:38.954+0000 7fdfb8000640 1 -- 172.21.15.137:0/2092646713 wait complete. 2024-04-26T23:41:38.979 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:41:38.979 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:41:38.979 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T23:41:38.979 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T23:41:38.979 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T23:41:38.979 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:41:38.979 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:41:38.979 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:41:38.980 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:41:38.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:38.980 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T23:41:38.989 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:41:38.989 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:41:38.989 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:41:38.989 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:38.989 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T23:41:38.989 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:38.989 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:41:38.989 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:38.989 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T23:41:38.989 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:41:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T23:41:38.990 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:41:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:38.990 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:41:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:41:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42463sec preferred_lft 42463sec 2024-04-26T23:41:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link 2024-04-26T23:41:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:38.990 INFO:teuthology.orchestra.run.smithi137.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:41:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 02:42:f4:6f:af:56 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:41:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:38.991 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T23:41:38.991 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:38.991 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T23:41:38.991 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link add name ceph-brx type bridge 2024-04-26T23:41:38.991 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip addr flush dev ceph-brx 2024-04-26T23:41:38.991 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set ceph-brx up 2024-04-26T23:41:38.991 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T23:41:38.991 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T23:41:39.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:39.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:39.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:39.143 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:41:39.161 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T23:41:39.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:39.163 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T23:41:39.242 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T23:41:39.243 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:41:39.243 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:41:39.243 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:41:39.243 INFO:teuthology.orchestra.run.smithi137.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:41:39.243 INFO:teuthology.orchestra.run.smithi137.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:41:39.243 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:41:39.243 INFO:teuthology.orchestra.run.smithi137.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:41:39.243 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:41:39.243 INFO:teuthology.orchestra.run.smithi137.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:41:39.243 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:41:39.244 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:39.244 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T23:41:39.244 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:41:39.244 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:41:39.244 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:41:39.244 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T23:41:39.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:39.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:39.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:39.380 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T23:41:39.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:39.389 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list-id 2024-04-26T23:41:39.438 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:39.438 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T23:41:39.438 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:41:39.438 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T23:41:39.438 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T23:41:39.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:39.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:39.569 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T23:41:39.569 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:39.570 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T23:41:39.570 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T23:41:39.570 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T23:41:39.570 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T23:41:39.570 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T23:41:39.570 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T23:41:39.570 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T23:41:39.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:39.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:39.734 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:39.734 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T23:41:39.735 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-26T23:41:39.735 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T23:41:39.735 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T23:41:39.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:39.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:39.818 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-26T23:41:39.819 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:41:39.819 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T23:41:39.874 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:41:39.874 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:41:39.874 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:41:39.925 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-26T23:41:39.986 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:41:40.039 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-26T23:41:40.039 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-26T23:41:40.039 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-26T23:41:40.039 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-26T23:41:40.039 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-26T23:41:40.040 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-26T23:41:40.040 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-26T23:41:40.040 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-26T23:41:40.040 INFO:teuthology.orchestra.run.smithi137.stdout:/run/lock 2024-04-26T23:41:40.040 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-26T23:41:40.040 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-26T23:41:40.040 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-26T23:41:40.040 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:41:40.040 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-26T23:41:40.040 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-26T23:41:40.040 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-26T23:41:40.040 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-26T23:41:40.040 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/fs/nfsd 2024-04-26T23:41:40.040 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-26T23:41:40.040 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-26T23:41:40.041 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:41:40.041 INFO:teuthology.orchestra.run.smithi137.stdout:/run/rpc_pipefs 2024-04-26T23:41:40.041 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-26T23:41:40.041 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-26T23:41:40.041 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:41:40.041 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:41:40.041 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:41:40.041 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:41:40.041 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-26T23:41:40.041 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:41:40.041 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:41:40.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:40.042 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-26T23:41:40.093 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T23:41:40.093 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-26T23:41:40.136 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-26T23:41:40.159 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:41:40.213 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-26T23:41:40.213 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-26T23:41:40.213 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-26T23:41:40.213 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-26T23:41:40.214 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-26T23:41:40.214 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-26T23:41:40.214 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-26T23:41:40.214 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-26T23:41:40.214 INFO:teuthology.orchestra.run.smithi137.stdout:/run/lock 2024-04-26T23:41:40.214 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-26T23:41:40.214 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-26T23:41:40.214 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-26T23:41:40.214 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:41:40.214 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-26T23:41:40.214 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-26T23:41:40.214 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-26T23:41:40.214 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-26T23:41:40.214 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/fs/nfsd 2024-04-26T23:41:40.215 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-26T23:41:40.215 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-26T23:41:40.215 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:41:40.215 INFO:teuthology.orchestra.run.smithi137.stdout:/run/rpc_pipefs 2024-04-26T23:41:40.215 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-26T23:41:40.215 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-26T23:41:40.215 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:41:40.215 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:41:40.215 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:41:40.215 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:41:40.215 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-26T23:41:40.215 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:41:40.215 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:41:40.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:40.216 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-26T23:41:40.233 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:2024-04-26T23:41:40.226+0000 7fdc72561580 -1 init, newargv = 0x562e1ec999d0 newargc=15 2024-04-26T23:41:40.233 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:ceph-fuse[34846]: starting ceph client 2024-04-26T23:41:40.243 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:ceph-fuse[34846]: starting fuse 2024-04-26T23:41:41.342 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-26T23:41:41.366 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:41:41.424 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-26T23:41:41.425 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-26T23:41:41.425 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-26T23:41:41.425 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-26T23:41:41.425 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-26T23:41:41.425 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-26T23:41:41.425 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-26T23:41:41.425 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-26T23:41:41.425 INFO:teuthology.orchestra.run.smithi137.stdout:/run/lock 2024-04-26T23:41:41.425 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-26T23:41:41.425 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-26T23:41:41.425 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-26T23:41:41.425 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:41:41.426 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-26T23:41:41.426 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-26T23:41:41.426 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-26T23:41:41.426 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-26T23:41:41.426 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/fs/nfsd 2024-04-26T23:41:41.426 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-26T23:41:41.426 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-26T23:41:41.426 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:41:41.426 INFO:teuthology.orchestra.run.smithi137.stdout:/run/rpc_pipefs 2024-04-26T23:41:41.426 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-26T23:41:41.426 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-26T23:41:41.426 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:41:41.426 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:41:41.426 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:41:41.427 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:41:41.427 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-26T23:41:41.427 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:41:41.427 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:41:41.427 INFO:teuthology.orchestra.run.smithi137.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-26T23:41:41.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:41.428 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-26T23:41:41.479 INFO:teuthology.orchestra.run.smithi137.stdout:44 2024-04-26T23:41:41.479 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T23:41:41.479 DEBUG:teuthology.orchestra.run.smithi137:> sudo stdin-killer -- python3 -c ' 2024-04-26T23:41:41.479 DEBUG:teuthology.orchestra.run.smithi137:> import glob 2024-04-26T23:41:41.479 DEBUG:teuthology.orchestra.run.smithi137:> import re 2024-04-26T23:41:41.479 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T23:41:41.479 DEBUG:teuthology.orchestra.run.smithi137:> import subprocess 2024-04-26T23:41:41.479 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:41:41.480 DEBUG:teuthology.orchestra.run.smithi137:> def _find_admin_socket(client_name): 2024-04-26T23:41:41.480 DEBUG:teuthology.orchestra.run.smithi137:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T23:41:41.480 DEBUG:teuthology.orchestra.run.smithi137:> files = glob.glob(asok_path) 2024-04-26T23:41:41.480 DEBUG:teuthology.orchestra.run.smithi137:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T23:41:41.480 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:41:41.480 DEBUG:teuthology.orchestra.run.smithi137:> # Given a non-glob path, it better be there 2024-04-26T23:41:41.480 DEBUG:teuthology.orchestra.run.smithi137:> if "*" not in asok_path: 2024-04-26T23:41:41.480 DEBUG:teuthology.orchestra.run.smithi137:> assert(len(files) == 1) 2024-04-26T23:41:41.480 DEBUG:teuthology.orchestra.run.smithi137:> return files[0] 2024-04-26T23:41:41.480 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:41:41.480 DEBUG:teuthology.orchestra.run.smithi137:> for f in files: 2024-04-26T23:41:41.480 DEBUG:teuthology.orchestra.run.smithi137:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T23:41:41.480 DEBUG:teuthology.orchestra.run.smithi137:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T23:41:41.480 DEBUG:teuthology.orchestra.run.smithi137:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T23:41:41.480 DEBUG:teuthology.orchestra.run.smithi137:> contents = proc_f.read() 2024-04-26T23:41:41.480 DEBUG:teuthology.orchestra.run.smithi137:> if mountpoint in contents: 2024-04-26T23:41:41.480 DEBUG:teuthology.orchestra.run.smithi137:> return f 2024-04-26T23:41:41.480 DEBUG:teuthology.orchestra.run.smithi137:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T23:41:41.481 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:41:41.481 DEBUG:teuthology.orchestra.run.smithi137:> print(_find_admin_socket("client.0")) 2024-04-26T23:41:41.481 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T23:41:41.612 INFO:teuthology.orchestra.run.smithi137.stdout:/var/run/ceph/ceph-client.0.34846.asok 2024-04-26T23:41:41.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:41.625 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34846.asok 2024-04-26T23:41:41.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:41.625 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34846.asok status 2024-04-26T23:41:41.798 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:41:41.799 INFO:teuthology.orchestra.run.smithi137.stdout: "metadata": { 2024-04-26T23:41:41.799 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T23:41:41.799 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T23:41:41.799 INFO:teuthology.orchestra.run.smithi137.stdout: "entity_id": "0", 2024-04-26T23:41:41.799 INFO:teuthology.orchestra.run.smithi137.stdout: "hostname": "smithi137", 2024-04-26T23:41:41.799 INFO:teuthology.orchestra.run.smithi137.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-26T23:41:41.799 INFO:teuthology.orchestra.run.smithi137.stdout: "pid": "34846", 2024-04-26T23:41:41.799 INFO:teuthology.orchestra.run.smithi137.stdout: "root": "/" 2024-04-26T23:41:41.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:41:41.799 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_count": 0, 2024-04-26T23:41:41.799 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_pinned_count": 0, 2024-04-26T23:41:41.799 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 4689, 2024-04-26T23:41:41.799 INFO:teuthology.orchestra.run.smithi137.stdout: "inst": { 2024-04-26T23:41:41.800 INFO:teuthology.orchestra.run.smithi137.stdout: "name": { 2024-04-26T23:41:41.800 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "client", 2024-04-26T23:41:41.800 INFO:teuthology.orchestra.run.smithi137.stdout: "num": 4689 2024-04-26T23:41:41.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:41:41.800 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2024-04-26T23:41:41.800 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-26T23:41:41.800 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:41:41.800 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 556414281 2024-04-26T23:41:41.800 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:41:41.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:41:41.800 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2024-04-26T23:41:41.800 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-26T23:41:41.800 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:41:41.800 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 556414281 2024-04-26T23:41:41.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:41:41.801 INFO:teuthology.orchestra.run.smithi137.stdout: "inst_str": "client.4689 192.168.0.1:0/556414281", 2024-04-26T23:41:41.801 INFO:teuthology.orchestra.run.smithi137.stdout: "addr_str": "192.168.0.1:0/556414281", 2024-04-26T23:41:41.801 INFO:teuthology.orchestra.run.smithi137.stdout: "inode_count": 1, 2024-04-26T23:41:41.801 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_epoch": 8, 2024-04-26T23:41:41.801 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch": 20, 2024-04-26T23:41:41.801 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch_barrier": 0, 2024-04-26T23:41:41.801 INFO:teuthology.orchestra.run.smithi137.stdout: "blocklisted": false, 2024-04-26T23:41:41.801 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs" 2024-04-26T23:41:41.801 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:41:41.813 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:41:41.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f0104600640 1 Processor -- start 2024-04-26T23:41:41.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f0104600640 1 -- start start 2024-04-26T23:41:41.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f0104600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00fc0725a0 0x7f00fc0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:41.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f0104600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f00fc073f30 0x7f00fc072980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:41.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f0104600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f00fc072ec0 0x7f00fc0b4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:41.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f0104600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f00fc0cfef0 con 0x7f00fc072ec0 2024-04-26T23:41:41.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f0104600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f00fc0cddc0 con 0x7f00fc073f30 2024-04-26T23:41:41.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f0104600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f00fc0d01b0 con 0x7f00fc0725a0 2024-04-26T23:41:41.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f0102600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f00fc072ec0 0x7f00fc0b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:41.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f0102600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f00fc072ec0 0x7f00fc0b4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45108/0 (socket says 172.21.15.137:45108) 2024-04-26T23:41:41.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f0102600640 1 -- 172.21.15.137:0/2184948975 learned_addr learned my addr 172.21.15.137:0/2184948975 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:41.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f0101200640 1 --2- 172.21.15.137:0/2184948975 >> v2:172.21.15.170:3300/0 conn(0x7f00fc073f30 0x7f00fc072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:41.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f0101c00640 1 --2- 172.21.15.137:0/2184948975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00fc0725a0 0x7f00fc0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:41.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f0102600640 1 -- 172.21.15.137:0/2184948975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00fc0725a0 msgr2=0x7f00fc0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:41.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f0102600640 1 --2- 172.21.15.137:0/2184948975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00fc0725a0 0x7f00fc0cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:41.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f0102600640 1 -- 172.21.15.137:0/2184948975 >> v2:172.21.15.170:3300/0 conn(0x7f00fc073f30 msgr2=0x7f00fc072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:41.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f0102600640 1 --2- 172.21.15.137:0/2184948975 >> v2:172.21.15.170:3300/0 conn(0x7f00fc073f30 0x7f00fc072980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:41.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f0102600640 1 -- 172.21.15.137:0/2184948975 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00fc0d0490 con 0x7f00fc072ec0 2024-04-26T23:41:41.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f0101c00640 1 --2- 172.21.15.137:0/2184948975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00fc0725a0 0x7f00fc0cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:41.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f0102600640 1 --2- 172.21.15.137:0/2184948975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00fc072ec0 0x7f00fc0b4070 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0700e0 tx=0x7f00f401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a71f2549403aa9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:41.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f00fbe00640 1 -- 172.21.15.137:0/2184948975 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f40a5860 con 0x7f00fc072ec0 2024-04-26T23:41:41.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f00fbe00640 1 -- 172.21.15.137:0/2184948975 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f40a5a00 con 0x7f00fc072ec0 2024-04-26T23:41:41.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.946+0000 7f00fbe00640 1 -- 172.21.15.137:0/2184948975 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f40a5dd0 con 0x7f00fc072ec0 2024-04-26T23:41:41.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0104600640 1 -- 172.21.15.137:0/2184948975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00fc072ec0 msgr2=0x7f00fc0b4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:41.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0104600640 1 --2- 172.21.15.137:0/2184948975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00fc072ec0 0x7f00fc0b4070 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0700e0 tx=0x7f00f401c9c0 comp rx=0 tx=0).stop 2024-04-26T23:41:41.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0104600640 1 -- 172.21.15.137:0/2184948975 shutdown_connections 2024-04-26T23:41:41.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0104600640 1 --2- 172.21.15.137:0/2184948975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00fc072ec0 0x7f00fc0b4070 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:41.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0104600640 1 --2- 172.21.15.137:0/2184948975 >> v2:172.21.15.170:3300/0 conn(0x7f00fc073f30 0x7f00fc072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:41.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0104600640 1 --2- 172.21.15.137:0/2184948975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00fc0725a0 0x7f00fc0cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:41.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0104600640 1 -- 172.21.15.137:0/2184948975 >> 172.21.15.137:0/2184948975 conn(0x7f00fc06c5d0 msgr2=0x7f00fc06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:41.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0104600640 1 -- 172.21.15.137:0/2184948975 shutdown_connections 2024-04-26T23:41:41.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0104600640 1 -- 172.21.15.137:0/2184948975 wait complete. 2024-04-26T23:41:41.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0104600640 1 Processor -- start 2024-04-26T23:41:41.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0104600640 1 -- start start 2024-04-26T23:41:41.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0104600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00fc0725a0 0x7f00fc0b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:41.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0104600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00fc072ec0 0x7f00fc139990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:41.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0104600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00fc073f30 0x7f00fc15f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:41.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0104600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc0b4f40 con 0x7f00fc073f30 2024-04-26T23:41:41.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0104600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc0b4dc0 con 0x7f00fc0725a0 2024-04-26T23:41:41.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0104600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f00fc0b50c0 con 0x7f00fc072ec0 2024-04-26T23:41:41.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0102600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00fc073f30 0x7f00fc15f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:41.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0102600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00fc073f30 0x7f00fc15f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45116/0 (socket says 172.21.15.137:45116) 2024-04-26T23:41:41.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0102600640 1 -- 172.21.15.137:0/1933814976 learned_addr learned my addr 172.21.15.137:0/1933814976 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:41.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0101c00640 1 --2- 172.21.15.137:0/1933814976 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00fc0725a0 0x7f00fc0b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:41.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0101200640 1 --2- 172.21.15.137:0/1933814976 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00fc072ec0 0x7f00fc139990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:41.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0102600640 1 -- 172.21.15.137:0/1933814976 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00fc072ec0 msgr2=0x7f00fc139990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:41.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0102600640 1 --2- 172.21.15.137:0/1933814976 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00fc072ec0 0x7f00fc139990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:41.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0102600640 1 -- 172.21.15.137:0/1933814976 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00fc0725a0 msgr2=0x7f00fc0b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:41.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0102600640 1 --2- 172.21.15.137:0/1933814976 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00fc0725a0 0x7f00fc0b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:41.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0102600640 1 -- 172.21.15.137:0/1933814976 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00fc139ed0 con 0x7f00fc073f30 2024-04-26T23:41:41.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0101c00640 1 --2- 172.21.15.137:0/1933814976 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00fc0725a0 0x7f00fc0b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:41.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0101200640 1 --2- 172.21.15.137:0/1933814976 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00fc072ec0 0x7f00fc139990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:41.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.950+0000 7f0102600640 1 --2- 172.21.15.137:0/1933814976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00fc073f30 0x7f00fc15f890 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f00f40af040 tx=0x7f00f4019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:41.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.954+0000 7f00f9600640 1 -- 172.21.15.137:0/1933814976 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f40b8670 con 0x7f00fc073f30 2024-04-26T23:41:41.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.954+0000 7f00f9600640 1 -- 172.21.15.137:0/1933814976 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f40be070 con 0x7f00fc073f30 2024-04-26T23:41:41.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.954+0000 7f00f9600640 1 -- 172.21.15.137:0/1933814976 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f40b8a90 con 0x7f00fc073f30 2024-04-26T23:41:41.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.954+0000 7f0104600640 1 -- 172.21.15.137:0/1933814976 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00fc0b15e0 con 0x7f00fc073f30 2024-04-26T23:41:41.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.954+0000 7f0104600640 1 -- 172.21.15.137:0/1933814976 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00fc0b1ba0 con 0x7f00fc073f30 2024-04-26T23:41:41.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.954+0000 7f0104600640 1 -- 172.21.15.137:0/1933814976 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00fc06a4b0 con 0x7f00fc073f30 2024-04-26T23:41:41.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.954+0000 7f00f9600640 1 -- 172.21.15.137:0/1933814976 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f00f40b8c30 con 0x7f00fc073f30 2024-04-26T23:41:41.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.954+0000 7f00f9600640 1 --2- 172.21.15.137:0/1933814976 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f00dc06c790 0x7f00dc06ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:41.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.954+0000 7f00f9600640 1 -- 172.21.15.137:0/1933814976 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f00f4121c80 con 0x7f00fc073f30 2024-04-26T23:41:41.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.954+0000 7f0101c00640 1 --2- 172.21.15.137:0/1933814976 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f00dc06c790 0x7f00dc06ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:41.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.954+0000 7f0101c00640 1 --2- 172.21.15.137:0/1933814976 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f00dc06c790 0x7f00dc06ec50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f00f000b990 tx=0x7f00f0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:41.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:41.958+0000 7f00f9600640 1 -- 172.21.15.137:0/1933814976 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f00f40165e0 con 0x7f00fc073f30 2024-04-26T23:41:42.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:42.150+0000 7f0104600640 1 -- 172.21.15.137:0/1933814976 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f00fc072380 con 0x7f00fc073f30 2024-04-26T23:41:42.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:42.150+0000 7f00f9600640 1 -- 172.21.15.137:0/1933814976 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f00f40f2380 con 0x7f00fc073f30 2024-04-26T23:41:42.159 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:41:42.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:42.154+0000 7f0104600640 1 -- 172.21.15.137:0/1933814976 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f00dc06c790 msgr2=0x7f00dc06ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:42.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:42.154+0000 7f0104600640 1 --2- 172.21.15.137:0/1933814976 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f00dc06c790 0x7f00dc06ec50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f00f000b990 tx=0x7f00f0008040 comp rx=0 tx=0).stop 2024-04-26T23:41:42.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:42.154+0000 7f0104600640 1 -- 172.21.15.137:0/1933814976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00fc073f30 msgr2=0x7f00fc15f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:42.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:42.154+0000 7f0104600640 1 --2- 172.21.15.137:0/1933814976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00fc073f30 0x7f00fc15f890 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f00f40af040 tx=0x7f00f4019760 comp rx=0 tx=0).stop 2024-04-26T23:41:42.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:42.154+0000 7f0104600640 1 -- 172.21.15.137:0/1933814976 shutdown_connections 2024-04-26T23:41:42.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:42.154+0000 7f0104600640 1 --2- 172.21.15.137:0/1933814976 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f00dc06c790 0x7f00dc06ec50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:42.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:42.154+0000 7f0104600640 1 --2- 172.21.15.137:0/1933814976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00fc073f30 0x7f00fc15f890 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:42.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:42.154+0000 7f0104600640 1 --2- 172.21.15.137:0/1933814976 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00fc072ec0 0x7f00fc139990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:42.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:42.154+0000 7f0104600640 1 --2- 172.21.15.137:0/1933814976 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00fc0725a0 0x7f00fc0b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:42.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:42.154+0000 7f0104600640 1 -- 172.21.15.137:0/1933814976 >> 172.21.15.137:0/1933814976 conn(0x7f00fc06c5d0 msgr2=0x7f00fc06c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:42.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:42.154+0000 7f0104600640 1 -- 172.21.15.137:0/1933814976 shutdown_connections 2024-04-26T23:41:42.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:42.154+0000 7f0104600640 1 -- 172.21.15.137:0/1933814976 wait complete. 2024-04-26T23:41:42.180 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:41:42.180 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:41:42.180 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T23:41:42.180 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-26T23:41:42.180 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-26T23:41:42.180 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:41:42.180 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:41:42.180 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:41:42.180 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-26T23:41:42.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:42.181 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T23:41:42.189 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:41:42.189 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:41:42.189 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:41:42.189 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:42.189 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T23:41:42.189 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:42.189 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:41:42.189 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:42.190 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T23:41:42.190 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:41:42.190 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:42.190 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T23:41:42.190 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:41:42.190 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:42.190 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:41:42.190 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:42.190 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:41:42.190 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42460sec preferred_lft 42460sec 2024-04-26T23:41:42.190 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link 2024-04-26T23:41:42.190 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:42.190 INFO:teuthology.orchestra.run.smithi137.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:41:42.190 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 02:42:f4:6f:af:56 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:42.191 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:41:42.191 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:42.191 INFO:teuthology.orchestra.run.smithi137.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:41:42.191 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:42.191 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:41:42.191 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:42.191 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T23:41:42.191 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:42.191 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:41:42.191 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:41:42.191 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:41:42.191 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:42.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:42.192 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:41:42.255 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T23:41:42.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:42.258 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T23:41:42.313 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T23:41:42.314 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:41:42.314 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:41:42.314 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:41:42.314 INFO:teuthology.orchestra.run.smithi137.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:41:42.314 INFO:teuthology.orchestra.run.smithi137.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:41:42.314 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:41:42.314 INFO:teuthology.orchestra.run.smithi137.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:41:42.314 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:41:42.314 INFO:teuthology.orchestra.run.smithi137.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:41:42.314 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:41:42.315 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:42.315 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T23:41:42.315 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:41:42.315 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:41:42.315 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:41:42.315 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T23:41:42.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:42.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:42.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:42.451 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T23:41:42.460 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T23:41:42.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:42.461 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list-id 2024-04-26T23:41:42.514 INFO:teuthology.orchestra.run.smithi137.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-26T23:41:42.514 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:42.514 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T23:41:42.514 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:41:42.515 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-26T23:41:42.515 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T23:41:42.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:42.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:42.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:42.642 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-26T23:41:42.663 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:41:42.663 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:41:42.663 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:41:42.664 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:42.664 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T23:41:42.664 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:42.664 INFO:teuthology.orchestra.run.smithi137.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:41:42.664 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 86:f5:05:8e:43:3f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T23:41:42.664 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T23:41:42.664 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:42.664 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::84f5:5ff:fe8e:433f/64 scope link 2024-04-26T23:41:42.664 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:42.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:42.665 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-26T23:41:42.726 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:41:42.726 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:41:42.727 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:41:42.727 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:42.727 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T23:41:42.727 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:42.727 INFO:teuthology.orchestra.run.smithi137.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:41:42.727 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 86:f5:05:8e:43:3f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T23:41:42.727 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T23:41:42.727 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:42.727 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::84f5:5ff:fe8e:433f/64 scope link 2024-04-26T23:41:42.727 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:42.728 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-26T23:41:42.729 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:42.729 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T23:41:42.729 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-26T23:41:42.729 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-26T23:41:42.729 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-26T23:41:42.729 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-26T23:41:42.729 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-26T23:41:42.729 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T23:41:42.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:42.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:42.906 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:42.906 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T23:41:42.906 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.1 up 2024-04-26T23:41:42.906 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set dev brx.1 master ceph-brx 2024-04-26T23:41:42.906 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T23:41:42.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:42.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:42.989 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-04-26T23:41:42.989 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:41:42.989 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-26T23:41:42.998 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-26T23:41:42.998 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:41:42.998 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-26T23:41:43.049 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-26T23:41:43.114 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:41:43.163 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-26T23:41:43.163 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-26T23:41:43.163 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-26T23:41:43.163 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-26T23:41:43.163 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-26T23:41:43.163 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-26T23:41:43.163 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-26T23:41:43.163 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-26T23:41:43.163 INFO:teuthology.orchestra.run.smithi137.stdout:/run/lock 2024-04-26T23:41:43.164 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-26T23:41:43.164 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-26T23:41:43.164 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-26T23:41:43.164 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:41:43.164 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-26T23:41:43.164 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-26T23:41:43.164 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-26T23:41:43.164 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-26T23:41:43.164 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/fs/nfsd 2024-04-26T23:41:43.164 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-26T23:41:43.164 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-26T23:41:43.164 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:41:43.164 INFO:teuthology.orchestra.run.smithi137.stdout:/run/rpc_pipefs 2024-04-26T23:41:43.164 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-26T23:41:43.165 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-26T23:41:43.165 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:41:43.165 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:41:43.165 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:41:43.165 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:41:43.165 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-26T23:41:43.165 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:41:43.165 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:41:43.165 INFO:teuthology.orchestra.run.smithi137.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-26T23:41:43.165 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:41:43.165 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:41:43.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:43.166 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-26T23:41:43.217 INFO:teuthology.orchestra.run.smithi137.stdout:44 2024-04-26T23:41:43.217 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [44] 2024-04-26T23:41:43.218 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-04-26T23:41:43.260 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-26T23:41:43.280 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:41:43.331 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-26T23:41:43.331 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-26T23:41:43.331 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-26T23:41:43.331 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-26T23:41:43.331 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-26T23:41:43.332 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-26T23:41:43.332 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-26T23:41:43.332 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-26T23:41:43.332 INFO:teuthology.orchestra.run.smithi137.stdout:/run/lock 2024-04-26T23:41:43.332 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-26T23:41:43.332 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-26T23:41:43.332 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-26T23:41:43.332 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:41:43.332 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-26T23:41:43.332 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-26T23:41:43.332 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-26T23:41:43.332 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-26T23:41:43.332 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/fs/nfsd 2024-04-26T23:41:43.332 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-26T23:41:43.333 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-26T23:41:43.333 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:41:43.333 INFO:teuthology.orchestra.run.smithi137.stdout:/run/rpc_pipefs 2024-04-26T23:41:43.333 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-26T23:41:43.333 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-26T23:41:43.333 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:41:43.333 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:41:43.333 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:41:43.333 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:41:43.333 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-26T23:41:43.333 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:41:43.333 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:41:43.333 INFO:teuthology.orchestra.run.smithi137.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-26T23:41:43.333 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:41:43.333 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:41:43.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:43.334 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-26T23:41:43.354 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi137.stderr:2024-04-26T23:41:43.349+0000 7f1f78846580 -1 init, newargv = 0x5638239c0940 newargc=15 2024-04-26T23:41:43.354 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi137.stderr:ceph-fuse[34991]: starting ceph client 2024-04-26T23:41:43.361 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi137.stderr:ceph-fuse[34991]: starting fuse 2024-04-26T23:41:43.362 INFO:teuthology.orchestra.run.smithi137.stdout:44 2024-04-26T23:41:43.362 INFO:teuthology.orchestra.run.smithi137.stdout:45 2024-04-26T23:41:43.362 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44, 45] 2024-04-26T23:41:43.362 DEBUG:teuthology.orchestra.run.smithi137:> sudo stdin-killer -- python3 -c ' 2024-04-26T23:41:43.362 DEBUG:teuthology.orchestra.run.smithi137:> import glob 2024-04-26T23:41:43.363 DEBUG:teuthology.orchestra.run.smithi137:> import re 2024-04-26T23:41:43.363 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T23:41:43.363 DEBUG:teuthology.orchestra.run.smithi137:> import subprocess 2024-04-26T23:41:43.363 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:41:43.363 DEBUG:teuthology.orchestra.run.smithi137:> def _find_admin_socket(client_name): 2024-04-26T23:41:43.363 DEBUG:teuthology.orchestra.run.smithi137:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-04-26T23:41:43.363 DEBUG:teuthology.orchestra.run.smithi137:> files = glob.glob(asok_path) 2024-04-26T23:41:43.363 DEBUG:teuthology.orchestra.run.smithi137:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-04-26T23:41:43.363 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:41:43.363 DEBUG:teuthology.orchestra.run.smithi137:> # Given a non-glob path, it better be there 2024-04-26T23:41:43.363 DEBUG:teuthology.orchestra.run.smithi137:> if "*" not in asok_path: 2024-04-26T23:41:43.363 DEBUG:teuthology.orchestra.run.smithi137:> assert(len(files) == 1) 2024-04-26T23:41:43.363 DEBUG:teuthology.orchestra.run.smithi137:> return files[0] 2024-04-26T23:41:43.363 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:41:43.363 DEBUG:teuthology.orchestra.run.smithi137:> for f in files: 2024-04-26T23:41:43.363 DEBUG:teuthology.orchestra.run.smithi137:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T23:41:43.363 DEBUG:teuthology.orchestra.run.smithi137:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T23:41:43.363 DEBUG:teuthology.orchestra.run.smithi137:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T23:41:43.364 DEBUG:teuthology.orchestra.run.smithi137:> contents = proc_f.read() 2024-04-26T23:41:43.364 DEBUG:teuthology.orchestra.run.smithi137:> if mountpoint in contents: 2024-04-26T23:41:43.364 DEBUG:teuthology.orchestra.run.smithi137:> return f 2024-04-26T23:41:43.364 DEBUG:teuthology.orchestra.run.smithi137:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T23:41:43.364 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:41:43.364 DEBUG:teuthology.orchestra.run.smithi137:> print(_find_admin_socket("client.2")) 2024-04-26T23:41:43.364 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T23:41:43.489 INFO:teuthology.orchestra.run.smithi137.stdout:/var/run/ceph/ceph-client.2.34991.asok 2024-04-26T23:41:43.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:43.500 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.34991.asok 2024-04-26T23:41:43.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:43.500 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.34991.asok status 2024-04-26T23:41:43.671 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:41:43.671 INFO:teuthology.orchestra.run.smithi137.stdout: "metadata": { 2024-04-26T23:41:43.671 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T23:41:43.672 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T23:41:43.672 INFO:teuthology.orchestra.run.smithi137.stdout: "entity_id": "2", 2024-04-26T23:41:43.672 INFO:teuthology.orchestra.run.smithi137.stdout: "hostname": "smithi137", 2024-04-26T23:41:43.672 INFO:teuthology.orchestra.run.smithi137.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-04-26T23:41:43.672 INFO:teuthology.orchestra.run.smithi137.stdout: "pid": "34991", 2024-04-26T23:41:43.672 INFO:teuthology.orchestra.run.smithi137.stdout: "root": "/" 2024-04-26T23:41:43.672 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:41:43.672 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_count": 0, 2024-04-26T23:41:43.672 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_pinned_count": 0, 2024-04-26T23:41:43.672 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 4701, 2024-04-26T23:41:43.672 INFO:teuthology.orchestra.run.smithi137.stdout: "inst": { 2024-04-26T23:41:43.672 INFO:teuthology.orchestra.run.smithi137.stdout: "name": { 2024-04-26T23:41:43.672 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "client", 2024-04-26T23:41:43.672 INFO:teuthology.orchestra.run.smithi137.stdout: "num": 4701 2024-04-26T23:41:43.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:41:43.673 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2024-04-26T23:41:43.673 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-26T23:41:43.673 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.2:0", 2024-04-26T23:41:43.673 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 2750831097 2024-04-26T23:41:43.673 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:41:43.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:41:43.673 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2024-04-26T23:41:43.673 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-26T23:41:43.673 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.2:0", 2024-04-26T23:41:43.673 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 2750831097 2024-04-26T23:41:43.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:41:43.673 INFO:teuthology.orchestra.run.smithi137.stdout: "inst_str": "client.4701 192.168.0.2:0/2750831097", 2024-04-26T23:41:43.673 INFO:teuthology.orchestra.run.smithi137.stdout: "addr_str": "192.168.0.2:0/2750831097", 2024-04-26T23:41:43.673 INFO:teuthology.orchestra.run.smithi137.stdout: "inode_count": 1, 2024-04-26T23:41:43.673 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_epoch": 8, 2024-04-26T23:41:43.673 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch": 20, 2024-04-26T23:41:43.674 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch_barrier": 0, 2024-04-26T23:41:43.674 INFO:teuthology.orchestra.run.smithi137.stdout: "blocklisted": false, 2024-04-26T23:41:43.674 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs" 2024-04-26T23:41:43.674 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:41:43.686 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:41:43.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.817+0000 7efd0c600640 1 Processor -- start 2024-04-26T23:41:43.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.817+0000 7efd0c600640 1 -- start start 2024-04-26T23:41:43.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.821+0000 7efd0c600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7efd0415a980 0x7efd040ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:43.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.821+0000 7efd0c600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efd0415ad60 0x7efd040cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:43.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.821+0000 7efd0c600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd0415da40 con 0x7efd040b0e90 2024-04-26T23:41:43.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.821+0000 7efd0c600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7efd0415e5c0 con 0x7efd0415ad60 2024-04-26T23:41:43.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.821+0000 7efd0c600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7efd0415dd20 con 0x7efd0415a980 2024-04-26T23:41:43.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.821+0000 7efd09200640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7efd040b0e90 0x7efd04160bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39566/0 (socket says 172.21.15.137:39566) 2024-04-26T23:41:43.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.821+0000 7efd09200640 1 -- 172.21.15.137:0/3317827389 learned_addr learned my addr 172.21.15.137:0/3317827389 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:43.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.821+0000 7efd0a600640 1 --2- 172.21.15.137:0/3317827389 >> v2:172.21.15.137:3300/0 conn(0x7efd0415ad60 0x7efd040cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:43.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.821+0000 7efd09c00640 1 --2- 172.21.15.137:0/3317827389 >> v2:172.21.15.170:3300/0 conn(0x7efd0415a980 0x7efd040ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:43.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.821+0000 7efd03e00640 1 -- 172.21.15.137:0/3317827389 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3846933422 0 0) 0x7efd0415da40 con 0x7efd040b0e90 2024-04-26T23:41:43.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.821+0000 7efd03e00640 1 -- 172.21.15.137:0/3317827389 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcec003530 con 0x7efd040b0e90 2024-04-26T23:41:43.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.821+0000 7efd0a600640 1 -- 172.21.15.137:0/3317827389 >> v2:172.21.15.170:3300/0 conn(0x7efd0415a980 msgr2=0x7efd040ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:43.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.821+0000 7efd0a600640 1 --2- 172.21.15.137:0/3317827389 >> v2:172.21.15.170:3300/0 conn(0x7efd0415a980 0x7efd040ced00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:43.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.821+0000 7efd0a600640 1 -- 172.21.15.137:0/3317827389 >> v1:172.21.15.137:6789/0 conn(0x7efd040b0e90 legacy=0x7efd04160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:43.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.821+0000 7efd0a600640 1 -- 172.21.15.137:0/3317827389 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0415e000 con 0x7efd0415ad60 2024-04-26T23:41:43.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.825+0000 7efd0a600640 1 --2- 172.21.15.137:0/3317827389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd0415ad60 0x7efd040cf240 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efd0406e850 tx=0x7efcfc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81ad185f0fbf35d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:43.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.825+0000 7efd03e00640 1 -- 172.21.15.137:0/3317827389 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0a7070 con 0x7efd0415ad60 2024-04-26T23:41:43.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.825+0000 7efd03e00640 1 -- 172.21.15.137:0/3317827389 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcfc0b0070 con 0x7efd0415ad60 2024-04-26T23:41:43.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.825+0000 7efd03e00640 1 -- 172.21.15.137:0/3317827389 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0ab890 con 0x7efd0415ad60 2024-04-26T23:41:43.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.825+0000 7efd0c600640 1 -- 172.21.15.137:0/3317827389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd0415ad60 msgr2=0x7efd040cf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:43.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.825+0000 7efd0c600640 1 --2- 172.21.15.137:0/3317827389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd0415ad60 0x7efd040cf240 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efd0406e850 tx=0x7efcfc01c450 comp rx=0 tx=0).stop 2024-04-26T23:41:43.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.825+0000 7efd0c600640 1 -- 172.21.15.137:0/3317827389 shutdown_connections 2024-04-26T23:41:43.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.825+0000 7efd0c600640 1 --2- 172.21.15.137:0/3317827389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd0415ad60 0x7efd040cf240 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:43.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.825+0000 7efd0c600640 1 --2- 172.21.15.137:0/3317827389 >> v2:172.21.15.170:3300/0 conn(0x7efd0415a980 0x7efd040ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:43.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.825+0000 7efd0c600640 1 -- 172.21.15.137:0/3317827389 >> 172.21.15.137:0/3317827389 conn(0x7efd040b3370 msgr2=0x7efd040b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:43.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.825+0000 7efd0c600640 1 -- 172.21.15.137:0/3317827389 shutdown_connections 2024-04-26T23:41:43.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.825+0000 7efd0c600640 1 -- 172.21.15.137:0/3317827389 wait complete. 2024-04-26T23:41:43.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.825+0000 7efd0c600640 1 Processor -- start 2024-04-26T23:41:43.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.825+0000 7efd0c600640 1 -- start start 2024-04-26T23:41:43.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd0c600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd040b0e90 0x7efd041fb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:43.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd0c600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd0415a980 0x7efd0415b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:43.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd0c600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd0415ad60 0x7efd040b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:43.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd0c600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efd0416a120 con 0x7efd0415ad60 2024-04-26T23:41:43.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd0c600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efd04169fa0 con 0x7efd040b0e90 2024-04-26T23:41:43.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd0c600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7efd0416a2a0 con 0x7efd0415a980 2024-04-26T23:41:43.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd0a600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd0415ad60 0x7efd040b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:43.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd0a600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd0415ad60 0x7efd040b59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45140/0 (socket says 172.21.15.137:45140) 2024-04-26T23:41:43.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd0a600640 1 -- 172.21.15.137:0/2546028656 learned_addr learned my addr 172.21.15.137:0/2546028656 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:43.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd0a600640 1 -- 172.21.15.137:0/2546028656 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd0415a980 msgr2=0x7efd0415b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:43.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd0a600640 1 --2- 172.21.15.137:0/2546028656 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd0415a980 0x7efd0415b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:43.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd0a600640 1 -- 172.21.15.137:0/2546028656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd040b0e90 msgr2=0x7efd041fb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:43.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd09c00640 1 --2- 172.21.15.137:0/2546028656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd040b0e90 0x7efd041fb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:43.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd0a600640 1 --2- 172.21.15.137:0/2546028656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd040b0e90 0x7efd041fb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:43.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd0a600640 1 -- 172.21.15.137:0/2546028656 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0415bbc0 con 0x7efd0415ad60 2024-04-26T23:41:43.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd09c00640 1 --2- 172.21.15.137:0/2546028656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd040b0e90 0x7efd041fb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:43.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd0a600640 1 --2- 172.21.15.137:0/2546028656 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd0415ad60 0x7efd040b59e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efcfc019060 tx=0x7efcfc01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:43.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd01600640 1 -- 172.21.15.137:0/2546028656 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0bf410 con 0x7efd0415ad60 2024-04-26T23:41:43.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd01600640 1 -- 172.21.15.137:0/2546028656 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcfc0bf5b0 con 0x7efd0415ad60 2024-04-26T23:41:43.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd0c600640 1 -- 172.21.15.137:0/2546028656 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd0415bea0 con 0x7efd0415ad60 2024-04-26T23:41:43.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd01600640 1 -- 172.21.15.137:0/2546028656 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0bf980 con 0x7efd0415ad60 2024-04-26T23:41:43.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd0c600640 1 -- 172.21.15.137:0/2546028656 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd0415c460 con 0x7efd0415ad60 2024-04-26T23:41:43.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd0c600640 1 -- 172.21.15.137:0/2546028656 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd0406a4b0 con 0x7efd0415ad60 2024-04-26T23:41:43.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.829+0000 7efd01600640 1 -- 172.21.15.137:0/2546028656 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efcfc0bd020 con 0x7efd0415ad60 2024-04-26T23:41:43.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.833+0000 7efd01600640 1 --2- 172.21.15.137:0/2546028656 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efce4068380 0x7efce406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:43.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.833+0000 7efd01600640 1 -- 172.21.15.137:0/2546028656 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efcfc1210d0 con 0x7efd0415ad60 2024-04-26T23:41:43.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.833+0000 7efd09c00640 1 --2- 172.21.15.137:0/2546028656 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efce4068380 0x7efce406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:43.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.833+0000 7efd09c00640 1 --2- 172.21.15.137:0/2546028656 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efce4068380 0x7efce406a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efcf8007520 tx=0x7efcf800b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:43.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:43.837+0000 7efd01600640 1 -- 172.21.15.137:0/2546028656 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efcfc016070 con 0x7efd0415ad60 2024-04-26T23:41:44.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:44.029+0000 7efd0c600640 1 -- 172.21.15.137:0/2546028656 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efd041610a0 con 0x7efd0415ad60 2024-04-26T23:41:44.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:44.029+0000 7efd01600640 1 -- 172.21.15.137:0/2546028656 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7efcfc0f1680 con 0x7efd0415ad60 2024-04-26T23:41:44.034 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:41:44.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:44.033+0000 7efd0c600640 1 -- 172.21.15.137:0/2546028656 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efce4068380 msgr2=0x7efce406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:44.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:44.033+0000 7efd0c600640 1 --2- 172.21.15.137:0/2546028656 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efce4068380 0x7efce406a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efcf8007520 tx=0x7efcf800b040 comp rx=0 tx=0).stop 2024-04-26T23:41:44.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:44.033+0000 7efd0c600640 1 -- 172.21.15.137:0/2546028656 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd0415ad60 msgr2=0x7efd040b59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:44.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:44.033+0000 7efd0c600640 1 --2- 172.21.15.137:0/2546028656 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd0415ad60 0x7efd040b59e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efcfc019060 tx=0x7efcfc01ac90 comp rx=0 tx=0).stop 2024-04-26T23:41:44.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:44.033+0000 7efd0c600640 1 -- 172.21.15.137:0/2546028656 shutdown_connections 2024-04-26T23:41:44.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:44.033+0000 7efd0c600640 1 --2- 172.21.15.137:0/2546028656 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efce4068380 0x7efce406a840 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:44.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:44.033+0000 7efd0c600640 1 --2- 172.21.15.137:0/2546028656 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd0415ad60 0x7efd040b59e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:44.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:44.033+0000 7efd0c600640 1 --2- 172.21.15.137:0/2546028656 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd0415a980 0x7efd0415b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:44.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:44.033+0000 7efd0c600640 1 --2- 172.21.15.137:0/2546028656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd040b0e90 0x7efd041fb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:44.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:44.033+0000 7efd0c600640 1 -- 172.21.15.137:0/2546028656 >> 172.21.15.137:0/2546028656 conn(0x7efd040b3370 msgr2=0x7efd0415eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:44.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:44.033+0000 7efd0c600640 1 -- 172.21.15.137:0/2546028656 shutdown_connections 2024-04-26T23:41:44.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:44.033+0000 7efd0c600640 1 -- 172.21.15.137:0/2546028656 wait complete. 2024-04-26T23:41:44.055 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:41:44.056 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:41:44.056 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi170.front.sepia.ceph.com 2024-04-26T23:41:44.056 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-26T23:41:44.056 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T23:41:44.056 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:41:44.056 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:41:44.056 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:41:44.056 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:41:44.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:44.056 DEBUG:teuthology.orchestra.run.smithi170:> ip addr 2024-04-26T23:41:44.067 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:41:44.067 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:41:44.067 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:41:44.067 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:44.067 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2024-04-26T23:41:44.067 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:44.067 INFO:teuthology.orchestra.run.smithi170.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:41:44.067 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:54 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:44.067 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f0 2024-04-26T23:41:44.068 INFO:teuthology.orchestra.run.smithi170.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:41:44.068 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:55 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:44.068 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f1 2024-04-26T23:41:44.068 INFO:teuthology.orchestra.run.smithi170.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:41:44.068 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:54 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:44.068 INFO:teuthology.orchestra.run.smithi170.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:41:44.068 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:55 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:44.068 INFO:teuthology.orchestra.run.smithi170.stdout: inet 172.21.15.170/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:41:44.068 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft 42462sec preferred_lft 42462sec 2024-04-26T23:41:44.068 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::ec4:7aff:fe88:7255/64 scope link 2024-04-26T23:41:44.068 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:44.068 INFO:teuthology.orchestra.run.smithi170.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:41:44.068 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 02:42:23:a7:19:38 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:44.068 INFO:teuthology.orchestra.run.smithi170.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:41:44.068 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:44.069 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T23:41:44.069 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:44.069 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-04-26T23:41:44.069 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link add name ceph-brx type bridge 2024-04-26T23:41:44.069 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip addr flush dev ceph-brx 2024-04-26T23:41:44.069 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set ceph-brx up 2024-04-26T23:41:44.069 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T23:41:44.069 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-04-26T23:41:44.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:44.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:44.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:44.236 DEBUG:teuthology.orchestra.run.smithi170:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:41:44.255 INFO:teuthology.orchestra.run.smithi170.stdout:1 2024-04-26T23:41:44.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:44.257 DEBUG:teuthology.orchestra.run.smithi170:> route 2024-04-26T23:41:44.330 INFO:teuthology.orchestra.run.smithi170.stdout:Kernel IP routing table 2024-04-26T23:41:44.330 INFO:teuthology.orchestra.run.smithi170.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:41:44.330 INFO:teuthology.orchestra.run.smithi170.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:41:44.330 INFO:teuthology.orchestra.run.smithi170.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:41:44.330 INFO:teuthology.orchestra.run.smithi170.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:41:44.330 INFO:teuthology.orchestra.run.smithi170.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:41:44.330 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:41:44.330 INFO:teuthology.orchestra.run.smithi170.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:41:44.330 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:41:44.330 INFO:teuthology.orchestra.run.smithi170.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:41:44.331 INFO:teuthology.orchestra.run.smithi170.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:41:44.331 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:44.331 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-04-26T23:41:44.331 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:41:44.331 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:41:44.331 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:41:44.331 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-04-26T23:41:44.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:44.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:44.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:44.471 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-04-26T23:41:44.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:44.526 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list-id 2024-04-26T23:41:44.581 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:44.582 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-04-26T23:41:44.582 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:41:44.582 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-26T23:41:44.582 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-04-26T23:41:44.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:44.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:44.714 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-26T23:41:44.714 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:44.714 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-04-26T23:41:44.714 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-26T23:41:44.714 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T23:41:44.714 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-26T23:41:44.714 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-26T23:41:44.714 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-26T23:41:44.714 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-04-26T23:41:44.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:44.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:44.871 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:44.871 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-04-26T23:41:44.871 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set brx.0 up 2024-04-26T23:41:44.872 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T23:41:44.872 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-04-26T23:41:44.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:44.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:45.001 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-26T23:41:45.001 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:41:45.001 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-26T23:41:45.009 INFO:teuthology.orchestra.run.smithi170.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:41:45.010 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:41:45.010 DEBUG:teuthology.orchestra.run.smithi170:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:41:45.061 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2024-04-26T23:41:45.125 DEBUG:teuthology.orchestra.run.smithi170:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:41:45.183 INFO:teuthology.orchestra.run.smithi170.stdout:/sys 2024-04-26T23:41:45.183 INFO:teuthology.orchestra.run.smithi170.stdout:/proc 2024-04-26T23:41:45.183 INFO:teuthology.orchestra.run.smithi170.stdout:/dev 2024-04-26T23:41:45.183 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/pts 2024-04-26T23:41:45.183 INFO:teuthology.orchestra.run.smithi170.stdout:/run 2024-04-26T23:41:45.183 INFO:teuthology.orchestra.run.smithi170.stdout:/ 2024-04-26T23:41:45.183 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/security 2024-04-26T23:41:45.183 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/shm 2024-04-26T23:41:45.183 INFO:teuthology.orchestra.run.smithi170.stdout:/run/lock 2024-04-26T23:41:45.183 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/cgroup 2024-04-26T23:41:45.183 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/pstore 2024-04-26T23:41:45.183 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/bpf 2024-04-26T23:41:45.183 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:41:45.183 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/hugepages 2024-04-26T23:41:45.184 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/mqueue 2024-04-26T23:41:45.184 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/debug 2024-04-26T23:41:45.184 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/tracing 2024-04-26T23:41:45.184 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/fs/nfsd 2024-04-26T23:41:45.184 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/fuse/connections 2024-04-26T23:41:45.184 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/config 2024-04-26T23:41:45.184 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:41:45.184 INFO:teuthology.orchestra.run.smithi170.stdout:/run/rpc_pipefs 2024-04-26T23:41:45.184 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/1000 2024-04-26T23:41:45.184 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph 2024-04-26T23:41:45.184 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:41:45.184 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:41:45.184 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:41:45.184 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:41:45.184 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns 2024-04-26T23:41:45.185 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:41:45.185 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:41:45.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:45.186 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2024-04-26T23:41:45.237 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T23:41:45.237 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-26T23:41:45.284 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2024-04-26T23:41:45.304 DEBUG:teuthology.orchestra.run.smithi170:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:41:45.355 INFO:teuthology.orchestra.run.smithi170.stdout:/sys 2024-04-26T23:41:45.355 INFO:teuthology.orchestra.run.smithi170.stdout:/proc 2024-04-26T23:41:45.355 INFO:teuthology.orchestra.run.smithi170.stdout:/dev 2024-04-26T23:41:45.355 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/pts 2024-04-26T23:41:45.355 INFO:teuthology.orchestra.run.smithi170.stdout:/run 2024-04-26T23:41:45.355 INFO:teuthology.orchestra.run.smithi170.stdout:/ 2024-04-26T23:41:45.355 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/security 2024-04-26T23:41:45.355 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/shm 2024-04-26T23:41:45.355 INFO:teuthology.orchestra.run.smithi170.stdout:/run/lock 2024-04-26T23:41:45.355 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/cgroup 2024-04-26T23:41:45.355 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/pstore 2024-04-26T23:41:45.355 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/bpf 2024-04-26T23:41:45.356 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:41:45.356 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/hugepages 2024-04-26T23:41:45.356 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/mqueue 2024-04-26T23:41:45.356 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/debug 2024-04-26T23:41:45.356 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/tracing 2024-04-26T23:41:45.356 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/fs/nfsd 2024-04-26T23:41:45.356 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/fuse/connections 2024-04-26T23:41:45.356 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/config 2024-04-26T23:41:45.356 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:41:45.356 INFO:teuthology.orchestra.run.smithi170.stdout:/run/rpc_pipefs 2024-04-26T23:41:45.356 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/1000 2024-04-26T23:41:45.356 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph 2024-04-26T23:41:45.356 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:41:45.357 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:41:45.357 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:41:45.357 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:41:45.357 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns 2024-04-26T23:41:45.357 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:41:45.357 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:41:45.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:45.358 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2024-04-26T23:41:45.379 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:2024-04-26T23:41:45.373+0000 7f76ffa1a580 -1 init, newargv = 0x55f5aad37740 newargc=15 2024-04-26T23:41:45.379 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:ceph-fuse[32127]: starting ceph client 2024-04-26T23:41:45.386 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:ceph-fuse[32127]: starting fuse 2024-04-26T23:41:45.387 INFO:teuthology.orchestra.run.smithi170.stdout:44 2024-04-26T23:41:45.387 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T23:41:45.388 DEBUG:teuthology.orchestra.run.smithi170:> sudo stdin-killer -- python3 -c ' 2024-04-26T23:41:45.388 DEBUG:teuthology.orchestra.run.smithi170:> import glob 2024-04-26T23:41:45.388 DEBUG:teuthology.orchestra.run.smithi170:> import re 2024-04-26T23:41:45.388 DEBUG:teuthology.orchestra.run.smithi170:> import os 2024-04-26T23:41:45.388 DEBUG:teuthology.orchestra.run.smithi170:> import subprocess 2024-04-26T23:41:45.388 DEBUG:teuthology.orchestra.run.smithi170:> 2024-04-26T23:41:45.388 DEBUG:teuthology.orchestra.run.smithi170:> def _find_admin_socket(client_name): 2024-04-26T23:41:45.388 DEBUG:teuthology.orchestra.run.smithi170:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-26T23:41:45.388 DEBUG:teuthology.orchestra.run.smithi170:> files = glob.glob(asok_path) 2024-04-26T23:41:45.388 DEBUG:teuthology.orchestra.run.smithi170:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-26T23:41:45.388 DEBUG:teuthology.orchestra.run.smithi170:> 2024-04-26T23:41:45.388 DEBUG:teuthology.orchestra.run.smithi170:> # Given a non-glob path, it better be there 2024-04-26T23:41:45.388 DEBUG:teuthology.orchestra.run.smithi170:> if "*" not in asok_path: 2024-04-26T23:41:45.388 DEBUG:teuthology.orchestra.run.smithi170:> assert(len(files) == 1) 2024-04-26T23:41:45.388 DEBUG:teuthology.orchestra.run.smithi170:> return files[0] 2024-04-26T23:41:45.389 DEBUG:teuthology.orchestra.run.smithi170:> 2024-04-26T23:41:45.389 DEBUG:teuthology.orchestra.run.smithi170:> for f in files: 2024-04-26T23:41:45.389 DEBUG:teuthology.orchestra.run.smithi170:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T23:41:45.389 DEBUG:teuthology.orchestra.run.smithi170:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T23:41:45.389 DEBUG:teuthology.orchestra.run.smithi170:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T23:41:45.389 DEBUG:teuthology.orchestra.run.smithi170:> contents = proc_f.read() 2024-04-26T23:41:45.389 DEBUG:teuthology.orchestra.run.smithi170:> if mountpoint in contents: 2024-04-26T23:41:45.389 DEBUG:teuthology.orchestra.run.smithi170:> return f 2024-04-26T23:41:45.389 DEBUG:teuthology.orchestra.run.smithi170:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T23:41:45.389 DEBUG:teuthology.orchestra.run.smithi170:> 2024-04-26T23:41:45.389 DEBUG:teuthology.orchestra.run.smithi170:> print(_find_admin_socket("client.1")) 2024-04-26T23:41:45.389 DEBUG:teuthology.orchestra.run.smithi170:> ' 2024-04-26T23:41:45.509 INFO:teuthology.orchestra.run.smithi170.stdout:/var/run/ceph/ceph-client.1.32127.asok 2024-04-26T23:41:45.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:45.520 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.32127.asok 2024-04-26T23:41:45.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:45.521 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.32127.asok status 2024-04-26T23:41:45.692 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-26T23:41:45.692 INFO:teuthology.orchestra.run.smithi170.stdout: "metadata": { 2024-04-26T23:41:45.692 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T23:41:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T23:41:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "entity_id": "1", 2024-04-26T23:41:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "hostname": "smithi170", 2024-04-26T23:41:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-26T23:41:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "pid": "32127", 2024-04-26T23:41:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "root": "/" 2024-04-26T23:41:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-26T23:41:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "dentry_count": 0, 2024-04-26T23:41:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "dentry_pinned_count": 0, 2024-04-26T23:41:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4657, 2024-04-26T23:41:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "inst": { 2024-04-26T23:41:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "name": { 2024-04-26T23:41:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "client", 2024-04-26T23:41:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "num": 4657 2024-04-26T23:41:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-26T23:41:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": { 2024-04-26T23:41:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2024-04-26T23:41:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:41:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 1713060100 2024-04-26T23:41:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-26T23:41:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-26T23:41:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": { 2024-04-26T23:41:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2024-04-26T23:41:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:41:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 1713060100 2024-04-26T23:41:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-26T23:41:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "inst_str": "client.4657 192.168.0.1:0/1713060100", 2024-04-26T23:41:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "addr_str": "192.168.0.1:0/1713060100", 2024-04-26T23:41:45.695 INFO:teuthology.orchestra.run.smithi170.stdout: "inode_count": 1, 2024-04-26T23:41:45.695 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_epoch": 8, 2024-04-26T23:41:45.695 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_epoch": 20, 2024-04-26T23:41:45.695 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_epoch_barrier": 0, 2024-04-26T23:41:45.695 INFO:teuthology.orchestra.run.smithi170.stdout: "blocklisted": false, 2024-04-26T23:41:45.695 INFO:teuthology.orchestra.run.smithi170.stdout: "fs_name": "cephfs" 2024-04-26T23:41:45.695 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-26T23:41:45.707 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:41:45.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.849+0000 7f1bcac00640 1 Processor -- start 2024-04-26T23:41:45.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.849+0000 7f1bcac00640 1 -- start start 2024-04-26T23:41:45.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.849+0000 7f1bcac00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bc415f560 0x7f1bc415f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:45.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.853+0000 7f1bcac00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1bc40b30b0 0x7f1bc40b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:45.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.853+0000 7f1bcac00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bc4160070 con 0x7f1bc40b4b70 2024-04-26T23:41:45.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.853+0000 7f1bcac00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f1bc4160350 con 0x7f1bc40b30b0 2024-04-26T23:41:45.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.853+0000 7f1bcac00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc4162d60 con 0x7f1bc415f560 2024-04-26T23:41:45.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.853+0000 7f1bca200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1bc40b30b0 0x7f1bc40b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:45.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.853+0000 7f1bc8e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bc415f560 0x7f1bc415f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:45.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.853+0000 7f1bca200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1bc40b30b0 0x7f1bc40b3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:35146/0 (socket says 172.21.15.137:35146) 2024-04-26T23:41:45.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.853+0000 7f1bc9800640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f1bc40b4b70 0x7f1bc4163560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:52934/0 (socket says 172.21.15.137:52934) 2024-04-26T23:41:45.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.853+0000 7f1bca200640 1 -- 172.21.15.137:0/1182295016 learned_addr learned my addr 172.21.15.137:0/1182295016 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:45.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.853+0000 7f1bc3e00640 1 -- 172.21.15.137:0/1182295016 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2556148994 0 0) 0x7f1bc4160070 con 0x7f1bc40b4b70 2024-04-26T23:41:45.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.853+0000 7f1bc3e00640 1 -- 172.21.15.137:0/1182295016 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bac003530 con 0x7f1bc40b4b70 2024-04-26T23:41:45.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.853+0000 7f1bca200640 1 -- 172.21.15.137:0/1182295016 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bc415f560 msgr2=0x7f1bc415f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:45.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.853+0000 7f1bca200640 1 --2- 172.21.15.137:0/1182295016 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bc415f560 0x7f1bc415f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:45.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.853+0000 7f1bca200640 1 -- 172.21.15.137:0/1182295016 >> v1:172.21.15.170:6789/0 conn(0x7f1bc40b4b70 legacy=0x7f1bc4163560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:45.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.853+0000 7f1bca200640 1 -- 172.21.15.137:0/1182295016 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc4163040 con 0x7f1bc40b30b0 2024-04-26T23:41:45.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.853+0000 7f1bc8e00640 1 --2- 172.21.15.137:0/1182295016 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bc415f560 0x7f1bc415f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:41:45.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.853+0000 7f1bca200640 1 --2- 172.21.15.137:0/1182295016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bc40b30b0 0x7f1bc40b3560 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009870 tx=0x7f1bbc01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c531116f1c1e31d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:45.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.857+0000 7f1bc3e00640 1 -- 172.21.15.137:0/1182295016 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0a9640 con 0x7f1bc40b30b0 2024-04-26T23:41:45.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.857+0000 7f1bc3e00640 1 -- 172.21.15.137:0/1182295016 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bbc0a97e0 con 0x7f1bc40b30b0 2024-04-26T23:41:45.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.857+0000 7f1bc3e00640 1 -- 172.21.15.137:0/1182295016 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0a9bb0 con 0x7f1bc40b30b0 2024-04-26T23:41:45.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.857+0000 7f1bcac00640 1 -- 172.21.15.137:0/1182295016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bc40b30b0 msgr2=0x7f1bc40b3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:45.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.857+0000 7f1bcac00640 1 --2- 172.21.15.137:0/1182295016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bc40b30b0 0x7f1bc40b3560 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009870 tx=0x7f1bbc01c560 comp rx=0 tx=0).stop 2024-04-26T23:41:45.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.857+0000 7f1bcac00640 1 -- 172.21.15.137:0/1182295016 shutdown_connections 2024-04-26T23:41:45.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.857+0000 7f1bcac00640 1 --2- 172.21.15.137:0/1182295016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bc40b30b0 0x7f1bc40b3560 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:45.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.857+0000 7f1bcac00640 1 --2- 172.21.15.137:0/1182295016 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bc415f560 0x7f1bc415f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:45.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.857+0000 7f1bcac00640 1 -- 172.21.15.137:0/1182295016 >> 172.21.15.137:0/1182295016 conn(0x7f1bc4075750 msgr2=0x7f1bc406c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:45.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.857+0000 7f1bcac00640 1 -- 172.21.15.137:0/1182295016 shutdown_connections 2024-04-26T23:41:45.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.857+0000 7f1bcac00640 1 -- 172.21.15.137:0/1182295016 wait complete. 2024-04-26T23:41:45.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.857+0000 7f1bcac00640 1 Processor -- start 2024-04-26T23:41:45.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.857+0000 7f1bcac00640 1 -- start start 2024-04-26T23:41:45.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.857+0000 7f1bcac00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1bc40b30b0 0x7f1bc41f8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:45.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.857+0000 7f1bcac00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bc40b4b70 0x7f1bc40af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:45.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.857+0000 7f1bcac00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bc415f560 0x7f1bc40afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:45.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.857+0000 7f1bcac00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc406f350 con 0x7f1bc40b30b0 2024-04-26T23:41:45.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.857+0000 7f1bcac00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc406f1d0 con 0x7f1bc40b4b70 2024-04-26T23:41:45.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.857+0000 7f1bcac00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc416bf40 con 0x7f1bc415f560 2024-04-26T23:41:45.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.857+0000 7f1bc9800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1bc40b30b0 0x7f1bc41f8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:45.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.857+0000 7f1bc9800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1bc40b30b0 0x7f1bc41f8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45150/0 (socket says 172.21.15.137:45150) 2024-04-26T23:41:45.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.857+0000 7f1bc9800640 1 -- 172.21.15.137:0/4162271590 learned_addr learned my addr 172.21.15.137:0/4162271590 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:45.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.861+0000 7f1bca200640 1 --2- 172.21.15.137:0/4162271590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bc415f560 0x7f1bc40afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:45.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.861+0000 7f1bc8e00640 1 --2- 172.21.15.137:0/4162271590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bc40b4b70 0x7f1bc40af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:45.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.861+0000 7f1bc9800640 1 -- 172.21.15.137:0/4162271590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bc415f560 msgr2=0x7f1bc40afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:45.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.861+0000 7f1bc9800640 1 --2- 172.21.15.137:0/4162271590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bc415f560 0x7f1bc40afb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:45.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.861+0000 7f1bc9800640 1 -- 172.21.15.137:0/4162271590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bc40b4b70 msgr2=0x7f1bc40af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:45.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.861+0000 7f1bc9800640 1 --2- 172.21.15.137:0/4162271590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bc40b4b70 0x7f1bc40af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:45.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.861+0000 7f1bc9800640 1 -- 172.21.15.137:0/4162271590 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc40b0670 con 0x7f1bc40b30b0 2024-04-26T23:41:45.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.861+0000 7f1bc9800640 1 --2- 172.21.15.137:0/4162271590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1bc40b30b0 0x7f1bc41f8f50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800c7c0 tx=0x7f1bb800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:45.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.861+0000 7f1bc1600640 1 -- 172.21.15.137:0/4162271590 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8017070 con 0x7f1bc40b30b0 2024-04-26T23:41:45.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.861+0000 7f1bc1600640 1 -- 172.21.15.137:0/4162271590 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb800a640 con 0x7f1bc40b30b0 2024-04-26T23:41:45.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.861+0000 7f1bc1600640 1 -- 172.21.15.137:0/4162271590 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb800aa30 con 0x7f1bc40b30b0 2024-04-26T23:41:45.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.861+0000 7f1bcac00640 1 -- 172.21.15.137:0/4162271590 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc413ad80 con 0x7f1bc40b30b0 2024-04-26T23:41:45.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.861+0000 7f1bcac00640 1 -- 172.21.15.137:0/4162271590 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc413b060 con 0x7f1bc40b30b0 2024-04-26T23:41:45.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.861+0000 7f1bcac00640 1 -- 172.21.15.137:0/4162271590 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc406a410 con 0x7f1bc40b30b0 2024-04-26T23:41:45.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.861+0000 7f1bc1600640 1 -- 172.21.15.137:0/4162271590 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1bb801a070 con 0x7f1bc40b30b0 2024-04-26T23:41:45.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.861+0000 7f1bc1600640 1 --2- 172.21.15.137:0/4162271590 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1ba4068380 0x7f1ba406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:45.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.861+0000 7f1bc1600640 1 -- 172.21.15.137:0/4162271590 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1bb8085ff0 con 0x7f1bc40b30b0 2024-04-26T23:41:45.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.861+0000 7f1bc8e00640 1 --2- 172.21.15.137:0/4162271590 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1ba4068380 0x7f1ba406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:45.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.865+0000 7f1bc8e00640 1 --2- 172.21.15.137:0/4162271590 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1ba4068380 0x7f1ba406a840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009580 tx=0x7f1bb0009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:45.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:45.865+0000 7f1bc1600640 1 -- 172.21.15.137:0/4162271590 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1bb8055f90 con 0x7f1bc40b30b0 2024-04-26T23:41:46.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:46.061+0000 7f1bcac00640 1 -- 172.21.15.137:0/4162271590 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1bc406cb10 con 0x7f1bc40b30b0 2024-04-26T23:41:46.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:46.061+0000 7f1bc1600640 1 -- 172.21.15.137:0/4162271590 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f1bb805a290 con 0x7f1bc40b30b0 2024-04-26T23:41:46.065 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:41:46.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:46.065+0000 7f1bcac00640 1 -- 172.21.15.137:0/4162271590 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1ba4068380 msgr2=0x7f1ba406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:46.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:46.065+0000 7f1bcac00640 1 --2- 172.21.15.137:0/4162271590 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1ba4068380 0x7f1ba406a840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009580 tx=0x7f1bb0009190 comp rx=0 tx=0).stop 2024-04-26T23:41:46.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:46.065+0000 7f1bcac00640 1 -- 172.21.15.137:0/4162271590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1bc40b30b0 msgr2=0x7f1bc41f8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:46.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:46.065+0000 7f1bcac00640 1 --2- 172.21.15.137:0/4162271590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1bc40b30b0 0x7f1bc41f8f50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800c7c0 tx=0x7f1bb800cc80 comp rx=0 tx=0).stop 2024-04-26T23:41:46.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:46.065+0000 7f1bcac00640 1 -- 172.21.15.137:0/4162271590 shutdown_connections 2024-04-26T23:41:46.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:46.065+0000 7f1bcac00640 1 --2- 172.21.15.137:0/4162271590 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1ba4068380 0x7f1ba406a840 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:46.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:46.065+0000 7f1bcac00640 1 --2- 172.21.15.137:0/4162271590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bc415f560 0x7f1bc40afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:46.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:46.065+0000 7f1bcac00640 1 --2- 172.21.15.137:0/4162271590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bc40b4b70 0x7f1bc40af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:46.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:46.065+0000 7f1bcac00640 1 --2- 172.21.15.137:0/4162271590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1bc40b30b0 0x7f1bc41f8f50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:46.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:46.065+0000 7f1bcac00640 1 -- 172.21.15.137:0/4162271590 >> 172.21.15.137:0/4162271590 conn(0x7f1bc4075750 msgr2=0x7f1bc406c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:46.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:46.065+0000 7f1bcac00640 1 -- 172.21.15.137:0/4162271590 shutdown_connections 2024-04-26T23:41:46.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:46.065+0000 7f1bcac00640 1 -- 172.21.15.137:0/4162271590 wait complete. 2024-04-26T23:41:46.085 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:41:46.085 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:41:46.085 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi170.front.sepia.ceph.com 2024-04-26T23:41:46.085 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-26T23:41:46.085 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-26T23:41:46.085 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:41:46.085 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:41:46.085 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:41:46.085 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-26T23:41:46.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:46.086 DEBUG:teuthology.orchestra.run.smithi170:> ip addr 2024-04-26T23:41:46.095 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:41:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:41:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:41:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2024-04-26T23:41:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:46.095 INFO:teuthology.orchestra.run.smithi170.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:41:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:54 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f0 2024-04-26T23:41:46.095 INFO:teuthology.orchestra.run.smithi170.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:41:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:55 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f1 2024-04-26T23:41:46.096 INFO:teuthology.orchestra.run.smithi170.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:41:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:54 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:46.096 INFO:teuthology.orchestra.run.smithi170.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:41:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:55 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: inet 172.21.15.170/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:41:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft 42460sec preferred_lft 42460sec 2024-04-26T23:41:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::ec4:7aff:fe88:7255/64 scope link 2024-04-26T23:41:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:46.096 INFO:teuthology.orchestra.run.smithi170.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:41:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 02:42:23:a7:19:38 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:41:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:46.096 INFO:teuthology.orchestra.run.smithi170.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:41:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:46.097 INFO:teuthology.orchestra.run.smithi170.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:41:46.097 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:46.097 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-04-26T23:41:46.097 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:46.097 INFO:teuthology.orchestra.run.smithi170.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:41:46.097 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:41:46.097 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-04-26T23:41:46.097 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:46.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:46.098 DEBUG:teuthology.orchestra.run.smithi170:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:41:46.158 INFO:teuthology.orchestra.run.smithi170.stdout:1 2024-04-26T23:41:46.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:46.161 DEBUG:teuthology.orchestra.run.smithi170:> route 2024-04-26T23:41:46.214 INFO:teuthology.orchestra.run.smithi170.stdout:Kernel IP routing table 2024-04-26T23:41:46.214 INFO:teuthology.orchestra.run.smithi170.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:41:46.214 INFO:teuthology.orchestra.run.smithi170.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:41:46.214 INFO:teuthology.orchestra.run.smithi170.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:41:46.214 INFO:teuthology.orchestra.run.smithi170.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:41:46.215 INFO:teuthology.orchestra.run.smithi170.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:41:46.215 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:41:46.215 INFO:teuthology.orchestra.run.smithi170.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:41:46.215 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:41:46.215 INFO:teuthology.orchestra.run.smithi170.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:41:46.215 INFO:teuthology.orchestra.run.smithi170.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:41:46.216 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:46.216 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-04-26T23:41:46.216 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:41:46.216 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:41:46.216 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:41:46.216 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-04-26T23:41:46.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:46.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:46.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:46.350 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-04-26T23:41:46.359 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T23:41:46.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:46.359 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list-id 2024-04-26T23:41:46.408 INFO:teuthology.orchestra.run.smithi170.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-26T23:41:46.409 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:46.410 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-04-26T23:41:46.410 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:41:46.410 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-26T23:41:46.410 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-04-26T23:41:46.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:46.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:46.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:46.540 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-26T23:41:46.560 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:41:46.560 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:41:46.560 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:41:46.560 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:46.560 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2024-04-26T23:41:46.561 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:46.561 INFO:teuthology.orchestra.run.smithi170.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:41:46.561 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 1a:80:2f:fe:8b:6f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T23:41:46.561 INFO:teuthology.orchestra.run.smithi170.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T23:41:46.561 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:46.561 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::1880:2fff:fefe:8b6f/64 scope link tentative 2024-04-26T23:41:46.561 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:46.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:46.562 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-26T23:41:46.625 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:41:46.625 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:41:46.625 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:41:46.625 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:46.625 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2024-04-26T23:41:46.625 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:46.625 INFO:teuthology.orchestra.run.smithi170.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:41:46.626 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 1a:80:2f:fe:8b:6f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T23:41:46.626 INFO:teuthology.orchestra.run.smithi170.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T23:41:46.626 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:46.626 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::1880:2fff:fefe:8b6f/64 scope link tentative 2024-04-26T23:41:46.626 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:46.627 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-26T23:41:46.628 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:46.628 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-04-26T23:41:46.628 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-26T23:41:46.628 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-26T23:41:46.628 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-26T23:41:46.628 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-26T23:41:46.628 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-26T23:41:46.628 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-04-26T23:41:46.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:46.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:46.808 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:46.808 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-04-26T23:41:46.808 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set brx.1 up 2024-04-26T23:41:46.808 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set dev brx.1 master ceph-brx 2024-04-26T23:41:46.808 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-04-26T23:41:46.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:46.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:46.891 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-04-26T23:41:46.891 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:41:46.891 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-26T23:41:46.899 INFO:teuthology.orchestra.run.smithi170.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-26T23:41:46.900 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:41:46.900 DEBUG:teuthology.orchestra.run.smithi170:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-26T23:41:46.948 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2024-04-26T23:41:47.009 DEBUG:teuthology.orchestra.run.smithi170:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:41:47.062 INFO:teuthology.orchestra.run.smithi170.stdout:/sys 2024-04-26T23:41:47.062 INFO:teuthology.orchestra.run.smithi170.stdout:/proc 2024-04-26T23:41:47.062 INFO:teuthology.orchestra.run.smithi170.stdout:/dev 2024-04-26T23:41:47.062 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/pts 2024-04-26T23:41:47.063 INFO:teuthology.orchestra.run.smithi170.stdout:/run 2024-04-26T23:41:47.063 INFO:teuthology.orchestra.run.smithi170.stdout:/ 2024-04-26T23:41:47.063 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/security 2024-04-26T23:41:47.063 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/shm 2024-04-26T23:41:47.063 INFO:teuthology.orchestra.run.smithi170.stdout:/run/lock 2024-04-26T23:41:47.063 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/cgroup 2024-04-26T23:41:47.063 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/pstore 2024-04-26T23:41:47.063 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/bpf 2024-04-26T23:41:47.063 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:41:47.063 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/hugepages 2024-04-26T23:41:47.063 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/mqueue 2024-04-26T23:41:47.063 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/debug 2024-04-26T23:41:47.063 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/tracing 2024-04-26T23:41:47.064 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/fs/nfsd 2024-04-26T23:41:47.064 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/fuse/connections 2024-04-26T23:41:47.064 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/config 2024-04-26T23:41:47.064 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:41:47.064 INFO:teuthology.orchestra.run.smithi170.stdout:/run/rpc_pipefs 2024-04-26T23:41:47.064 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/1000 2024-04-26T23:41:47.064 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph 2024-04-26T23:41:47.064 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:41:47.064 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:41:47.064 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:41:47.064 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:41:47.064 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns 2024-04-26T23:41:47.064 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:41:47.064 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:41:47.064 INFO:teuthology.orchestra.run.smithi170.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-26T23:41:47.065 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:41:47.065 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:41:47.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:47.066 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2024-04-26T23:41:47.122 INFO:teuthology.orchestra.run.smithi170.stdout:44 2024-04-26T23:41:47.123 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [44] 2024-04-26T23:41:47.123 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-04-26T23:41:47.168 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2024-04-26T23:41:47.259 DEBUG:teuthology.orchestra.run.smithi170:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:41:47.264 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi170.stderr:2024-04-26T23:41:47.257+0000 7f1bda39c580 -1 init, newargv = 0x561d6d03ff00 newargc=15 2024-04-26T23:41:47.264 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi170.stderr:ceph-fuse[32238]: starting ceph client 2024-04-26T23:41:47.272 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi170.stderr:ceph-fuse[32238]: starting fuse 2024-04-26T23:41:47.273 INFO:teuthology.orchestra.run.smithi170.stdout:/sys 2024-04-26T23:41:47.274 INFO:teuthology.orchestra.run.smithi170.stdout:/proc 2024-04-26T23:41:47.274 INFO:teuthology.orchestra.run.smithi170.stdout:/dev 2024-04-26T23:41:47.274 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/pts 2024-04-26T23:41:47.274 INFO:teuthology.orchestra.run.smithi170.stdout:/run 2024-04-26T23:41:47.274 INFO:teuthology.orchestra.run.smithi170.stdout:/ 2024-04-26T23:41:47.274 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/security 2024-04-26T23:41:47.274 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/shm 2024-04-26T23:41:47.274 INFO:teuthology.orchestra.run.smithi170.stdout:/run/lock 2024-04-26T23:41:47.274 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/cgroup 2024-04-26T23:41:47.274 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/pstore 2024-04-26T23:41:47.274 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/bpf 2024-04-26T23:41:47.274 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:41:47.275 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/hugepages 2024-04-26T23:41:47.275 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/mqueue 2024-04-26T23:41:47.275 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/debug 2024-04-26T23:41:47.275 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/tracing 2024-04-26T23:41:47.275 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/fs/nfsd 2024-04-26T23:41:47.275 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/fuse/connections 2024-04-26T23:41:47.275 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/config 2024-04-26T23:41:47.275 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:41:47.275 INFO:teuthology.orchestra.run.smithi170.stdout:/run/rpc_pipefs 2024-04-26T23:41:47.275 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/1000 2024-04-26T23:41:47.275 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph 2024-04-26T23:41:47.275 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:41:47.275 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:41:47.275 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:41:47.276 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:41:47.276 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns 2024-04-26T23:41:47.276 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:41:47.276 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:41:47.276 INFO:teuthology.orchestra.run.smithi170.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-26T23:41:47.276 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:41:47.276 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:41:47.276 INFO:teuthology.orchestra.run.smithi170.stdout:/home/ubuntu/cephtest/mnt.3 2024-04-26T23:41:47.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:47.277 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2024-04-26T23:41:47.330 INFO:teuthology.orchestra.run.smithi170.stdout:44 2024-04-26T23:41:47.330 INFO:teuthology.orchestra.run.smithi170.stdout:45 2024-04-26T23:41:47.330 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44, 45] 2024-04-26T23:41:47.330 DEBUG:teuthology.orchestra.run.smithi170:> sudo stdin-killer -- python3 -c ' 2024-04-26T23:41:47.330 DEBUG:teuthology.orchestra.run.smithi170:> import glob 2024-04-26T23:41:47.331 DEBUG:teuthology.orchestra.run.smithi170:> import re 2024-04-26T23:41:47.331 DEBUG:teuthology.orchestra.run.smithi170:> import os 2024-04-26T23:41:47.331 DEBUG:teuthology.orchestra.run.smithi170:> import subprocess 2024-04-26T23:41:47.331 DEBUG:teuthology.orchestra.run.smithi170:> 2024-04-26T23:41:47.331 DEBUG:teuthology.orchestra.run.smithi170:> def _find_admin_socket(client_name): 2024-04-26T23:41:47.331 DEBUG:teuthology.orchestra.run.smithi170:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-04-26T23:41:47.331 DEBUG:teuthology.orchestra.run.smithi170:> files = glob.glob(asok_path) 2024-04-26T23:41:47.331 DEBUG:teuthology.orchestra.run.smithi170:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-04-26T23:41:47.331 DEBUG:teuthology.orchestra.run.smithi170:> 2024-04-26T23:41:47.331 DEBUG:teuthology.orchestra.run.smithi170:> # Given a non-glob path, it better be there 2024-04-26T23:41:47.331 DEBUG:teuthology.orchestra.run.smithi170:> if "*" not in asok_path: 2024-04-26T23:41:47.331 DEBUG:teuthology.orchestra.run.smithi170:> assert(len(files) == 1) 2024-04-26T23:41:47.331 DEBUG:teuthology.orchestra.run.smithi170:> return files[0] 2024-04-26T23:41:47.331 DEBUG:teuthology.orchestra.run.smithi170:> 2024-04-26T23:41:47.331 DEBUG:teuthology.orchestra.run.smithi170:> for f in files: 2024-04-26T23:41:47.331 DEBUG:teuthology.orchestra.run.smithi170:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T23:41:47.331 DEBUG:teuthology.orchestra.run.smithi170:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T23:41:47.332 DEBUG:teuthology.orchestra.run.smithi170:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T23:41:47.332 DEBUG:teuthology.orchestra.run.smithi170:> contents = proc_f.read() 2024-04-26T23:41:47.332 DEBUG:teuthology.orchestra.run.smithi170:> if mountpoint in contents: 2024-04-26T23:41:47.332 DEBUG:teuthology.orchestra.run.smithi170:> return f 2024-04-26T23:41:47.332 DEBUG:teuthology.orchestra.run.smithi170:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T23:41:47.332 DEBUG:teuthology.orchestra.run.smithi170:> 2024-04-26T23:41:47.332 DEBUG:teuthology.orchestra.run.smithi170:> print(_find_admin_socket("client.3")) 2024-04-26T23:41:47.332 DEBUG:teuthology.orchestra.run.smithi170:> ' 2024-04-26T23:41:47.452 INFO:teuthology.orchestra.run.smithi170.stdout:/var/run/ceph/ceph-client.3.32238.asok 2024-04-26T23:41:47.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:41:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:47.463 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.32238.asok 2024-04-26T23:41:47.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:47.463 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.32238.asok status 2024-04-26T23:41:47.633 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-26T23:41:47.633 INFO:teuthology.orchestra.run.smithi170.stdout: "metadata": { 2024-04-26T23:41:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T23:41:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T23:41:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: "entity_id": "3", 2024-04-26T23:41:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: "hostname": "smithi170", 2024-04-26T23:41:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-04-26T23:41:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: "pid": "32238", 2024-04-26T23:41:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: "root": "/" 2024-04-26T23:41:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-26T23:41:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: "dentry_count": 0, 2024-04-26T23:41:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: "dentry_pinned_count": 0, 2024-04-26T23:41:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4672, 2024-04-26T23:41:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: "inst": { 2024-04-26T23:41:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: "name": { 2024-04-26T23:41:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "client", 2024-04-26T23:41:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: "num": 4672 2024-04-26T23:41:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-26T23:41:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": { 2024-04-26T23:41:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2024-04-26T23:41:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "192.168.0.2:0", 2024-04-26T23:41:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 1489371720 2024-04-26T23:41:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-26T23:41:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-26T23:41:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": { 2024-04-26T23:41:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2024-04-26T23:41:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "192.168.0.2:0", 2024-04-26T23:41:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 1489371720 2024-04-26T23:41:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-26T23:41:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: "inst_str": "client.4672 192.168.0.2:0/1489371720", 2024-04-26T23:41:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: "addr_str": "192.168.0.2:0/1489371720", 2024-04-26T23:41:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: "inode_count": 1, 2024-04-26T23:41:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_epoch": 8, 2024-04-26T23:41:47.636 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_epoch": 20, 2024-04-26T23:41:47.636 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_epoch_barrier": 0, 2024-04-26T23:41:47.636 INFO:teuthology.orchestra.run.smithi170.stdout: "blocklisted": false, 2024-04-26T23:41:47.636 INFO:teuthology.orchestra.run.smithi170.stdout: "fs_name": "cephfs" 2024-04-26T23:41:47.636 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-26T23:41:47.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:47.649 DEBUG:teuthology.orchestra.run.smithi137:> stat --file-system '--printf=%T 2024-04-26T23:41:47.649 DEBUG:teuthology.orchestra.run.smithi137:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-26T23:41:47.659 INFO:teuthology.orchestra.run.smithi137.stdout:fuseblk 2024-04-26T23:41:47.659 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-26T23:41:47.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:47.659 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:41:47.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:47.726 DEBUG:teuthology.orchestra.run.smithi137:> stat --file-system '--printf=%T 2024-04-26T23:41:47.726 DEBUG:teuthology.orchestra.run.smithi137:> ' -- /home/ubuntu/cephtest/mnt.2 2024-04-26T23:41:47.779 INFO:teuthology.orchestra.run.smithi137.stdout:fuseblk 2024-04-26T23:41:47.779 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-04-26T23:41:47.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:47.780 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-26T23:41:47.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:47.847 DEBUG:teuthology.orchestra.run.smithi170:> stat --file-system '--printf=%T 2024-04-26T23:41:47.847 DEBUG:teuthology.orchestra.run.smithi170:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-26T23:41:47.857 INFO:teuthology.orchestra.run.smithi170.stdout:fuseblk 2024-04-26T23:41:47.858 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-26T23:41:47.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:47.858 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:41:47.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:47.920 DEBUG:teuthology.orchestra.run.smithi170:> stat --file-system '--printf=%T 2024-04-26T23:41:47.921 DEBUG:teuthology.orchestra.run.smithi170:> ' -- /home/ubuntu/cephtest/mnt.3 2024-04-26T23:41:47.970 INFO:teuthology.orchestra.run.smithi170.stdout:fuseblk 2024-04-26T23:41:47.970 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-04-26T23:41:47.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:47.971 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-26T23:41:48.032 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-26T23:41:48.048 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:48.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.189+0000 7f64ace00640 1 Processor -- start 2024-04-26T23:41:48.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.193+0000 7f64ace00640 1 -- start start 2024-04-26T23:41:48.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.193+0000 7f64ace00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64a80725a0 0x7f64a80cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:48.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.193+0000 7f64ace00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f64a8073f30 0x7f64a8072980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:48.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.193+0000 7f64ace00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64a80cfef0 con 0x7f64a8072ec0 2024-04-26T23:41:48.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.193+0000 7f64ace00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f64a80cddc0 con 0x7f64a8073f30 2024-04-26T23:41:48.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.193+0000 7f64ace00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f64a80d01b0 con 0x7f64a80725a0 2024-04-26T23:41:48.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.193+0000 7f649d400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f64a8073f30 0x7f64a8072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:48.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.193+0000 7f64a6800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f64a8072ec0 0x7f64a80b4070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39582/0 (socket says 172.21.15.137:39582) 2024-04-26T23:41:48.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.193+0000 7f64a6800640 1 -- 172.21.15.137:0/3629270715 learned_addr learned my addr 172.21.15.137:0/3629270715 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:48.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.193+0000 7f64a5e00640 1 --2- 172.21.15.137:0/3629270715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64a80725a0 0x7f64a80cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:48.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.193+0000 7f649d400640 1 -- 172.21.15.137:0/3629270715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64a80725a0 msgr2=0x7f64a80cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:48.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.193+0000 7f649d400640 1 --2- 172.21.15.137:0/3629270715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64a80725a0 0x7f64a80cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.193+0000 7f649d400640 1 -- 172.21.15.137:0/3629270715 >> v1:172.21.15.137:6789/0 conn(0x7f64a8072ec0 legacy=0x7f64a80b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:48.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.193+0000 7f649d400640 1 -- 172.21.15.137:0/3629270715 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a80d0490 con 0x7f64a8073f30 2024-04-26T23:41:48.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.197+0000 7f649d400640 1 --2- 172.21.15.137:0/3629270715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64a8073f30 0x7f64a8072980 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6490009d90 tx=0x7f649001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b71ba092113010d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:48.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.197+0000 7f64a5400640 1 -- 172.21.15.137:0/3629270715 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64900b2070 con 0x7f64a8073f30 2024-04-26T23:41:48.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.197+0000 7f64a5400640 1 -- 172.21.15.137:0/3629270715 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64900a5a20 con 0x7f64a8073f30 2024-04-26T23:41:48.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.197+0000 7f64a5400640 1 -- 172.21.15.137:0/3629270715 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64900a5df0 con 0x7f64a8073f30 2024-04-26T23:41:48.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.197+0000 7f64ace00640 1 -- 172.21.15.137:0/3629270715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64a8073f30 msgr2=0x7f64a8072980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:48.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.197+0000 7f64ace00640 1 --2- 172.21.15.137:0/3629270715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64a8073f30 0x7f64a8072980 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6490009d90 tx=0x7f649001c940 comp rx=0 tx=0).stop 2024-04-26T23:41:48.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.197+0000 7f64ace00640 1 -- 172.21.15.137:0/3629270715 shutdown_connections 2024-04-26T23:41:48.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.197+0000 7f64ace00640 1 --2- 172.21.15.137:0/3629270715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64a8073f30 0x7f64a8072980 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.197+0000 7f64ace00640 1 --2- 172.21.15.137:0/3629270715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64a80725a0 0x7f64a80cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.197+0000 7f64ace00640 1 -- 172.21.15.137:0/3629270715 >> 172.21.15.137:0/3629270715 conn(0x7f64a806c5d0 msgr2=0x7f64a806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:48.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.197+0000 7f64ace00640 1 -- 172.21.15.137:0/3629270715 shutdown_connections 2024-04-26T23:41:48.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.197+0000 7f64ace00640 1 -- 172.21.15.137:0/3629270715 wait complete. 2024-04-26T23:41:48.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.197+0000 7f64ace00640 1 Processor -- start 2024-04-26T23:41:48.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.197+0000 7f64ace00640 1 -- start start 2024-04-26T23:41:48.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f64ace00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64a80725a0 0x7f64a81390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:48.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f64ace00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64a8072ec0 0x7f64a815b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:48.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f64ace00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64a8073f30 0x7f64a815a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:48.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f64ace00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f64a80b5110 con 0x7f64a80725a0 2024-04-26T23:41:48.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f64ace00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f64a80b4f90 con 0x7f64a8072ec0 2024-04-26T23:41:48.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f64ace00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f64a80b5290 con 0x7f64a8073f30 2024-04-26T23:41:48.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f64a5e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64a80725a0 0x7f64a81390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:48.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f64a5e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64a80725a0 0x7f64a81390c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45162/0 (socket says 172.21.15.137:45162) 2024-04-26T23:41:48.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f64a5e00640 1 -- 172.21.15.137:0/114109604 learned_addr learned my addr 172.21.15.137:0/114109604 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:48.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f64a6800640 1 --2- 172.21.15.137:0/114109604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64a8073f30 0x7f64a815a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:48.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f649d400640 1 --2- 172.21.15.137:0/114109604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64a8072ec0 0x7f64a815b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:48.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f64a5e00640 1 -- 172.21.15.137:0/114109604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64a8073f30 msgr2=0x7f64a815a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:48.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f64a5e00640 1 --2- 172.21.15.137:0/114109604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64a8073f30 0x7f64a815a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f64a5e00640 1 -- 172.21.15.137:0/114109604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64a8072ec0 msgr2=0x7f64a815b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:48.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f64a5e00640 1 --2- 172.21.15.137:0/114109604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64a8072ec0 0x7f64a815b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f64a5e00640 1 -- 172.21.15.137:0/114109604 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a8140060 con 0x7f64a80725a0 2024-04-26T23:41:48.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f64a6800640 1 --2- 172.21.15.137:0/114109604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64a8073f30 0x7f64a815a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:48.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f649d400640 1 --2- 172.21.15.137:0/114109604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64a8072ec0 0x7f64a815b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:48.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f64a5e00640 1 --2- 172.21.15.137:0/114109604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64a80725a0 0x7f64a81390c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f649800e870 tx=0x7f649800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:48.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f649ea00640 1 -- 172.21.15.137:0/114109604 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6498017070 con 0x7f64a80725a0 2024-04-26T23:41:48.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f649ea00640 1 -- 172.21.15.137:0/114109604 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f649800c940 con 0x7f64a80725a0 2024-04-26T23:41:48.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f64ace00640 1 -- 172.21.15.137:0/114109604 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a81f58f0 con 0x7f64a80725a0 2024-04-26T23:41:48.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f649ea00640 1 -- 172.21.15.137:0/114109604 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649800ccf0 con 0x7f64a80725a0 2024-04-26T23:41:48.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f64ace00640 1 -- 172.21.15.137:0/114109604 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a80b1a00 con 0x7f64a80725a0 2024-04-26T23:41:48.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f64ace00640 1 -- 172.21.15.137:0/114109604 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64a806a4b0 con 0x7f64a80725a0 2024-04-26T23:41:48.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.201+0000 7f649ea00640 1 -- 172.21.15.137:0/114109604 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f649801a070 con 0x7f64a80725a0 2024-04-26T23:41:48.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.205+0000 7f649ea00640 1 --2- 172.21.15.137:0/114109604 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6484068380 0x7f648406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:48.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.205+0000 7f649ea00640 1 -- 172.21.15.137:0/114109604 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6498086800 con 0x7f64a80725a0 2024-04-26T23:41:48.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.205+0000 7f649d400640 1 --2- 172.21.15.137:0/114109604 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6484068380 0x7f648406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:48.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.205+0000 7f649d400640 1 --2- 172.21.15.137:0/114109604 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6484068380 0x7f648406a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f64900af000 tx=0x7f64900a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:48.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.209+0000 7f649ea00640 1 -- 172.21.15.137:0/114109604 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6498056e50 con 0x7f64a80725a0 2024-04-26T23:41:48.296 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:41:48.299 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:41:48.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.373+0000 7f64ace00640 1 -- 172.21.15.137:0/114109604 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f64a8072380 con 0x7f64a80725a0 2024-04-26T23:41:48.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.373+0000 7f649ea00640 1 -- 172.21.15.137:0/114109604 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16653 (secure 0 0 0) 0x7f6498056750 con 0x7f64a80725a0 2024-04-26T23:41:48.378 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:48.379 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:25.186308+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:48.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.377+0000 7f64ace00640 1 -- 172.21.15.137:0/114109604 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6484068380 msgr2=0x7f648406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:48.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.377+0000 7f64ace00640 1 --2- 172.21.15.137:0/114109604 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6484068380 0x7f648406a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f64900af000 tx=0x7f64900a7070 comp rx=0 tx=0).stop 2024-04-26T23:41:48.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.377+0000 7f64ace00640 1 -- 172.21.15.137:0/114109604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64a80725a0 msgr2=0x7f64a81390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:48.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.377+0000 7f64ace00640 1 --2- 172.21.15.137:0/114109604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64a80725a0 0x7f64a81390c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f649800e870 tx=0x7f649800ec70 comp rx=0 tx=0).stop 2024-04-26T23:41:48.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.377+0000 7f64ace00640 1 -- 172.21.15.137:0/114109604 shutdown_connections 2024-04-26T23:41:48.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.377+0000 7f64ace00640 1 --2- 172.21.15.137:0/114109604 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6484068380 0x7f648406a840 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.377+0000 7f64ace00640 1 --2- 172.21.15.137:0/114109604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64a8073f30 0x7f64a815a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.377+0000 7f64ace00640 1 --2- 172.21.15.137:0/114109604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64a8072ec0 0x7f64a815b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.377+0000 7f64ace00640 1 --2- 172.21.15.137:0/114109604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64a80725a0 0x7f64a81390c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.377+0000 7f64ace00640 1 -- 172.21.15.137:0/114109604 >> 172.21.15.137:0/114109604 conn(0x7f64a806c5d0 msgr2=0x7f64a8141af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:48.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.377+0000 7f64ace00640 1 -- 172.21.15.137:0/114109604 shutdown_connections 2024-04-26T23:41:48.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.377+0000 7f64ace00640 1 -- 172.21.15.137:0/114109604 wait complete. 2024-04-26T23:41:48.400 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:41:21.810449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:41:22.533452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:41:48.400 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:41:48.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.577+0000 7f1a7dc00640 1 Processor -- start 2024-04-26T23:41:48.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.577+0000 7f1a7dc00640 1 -- start start 2024-04-26T23:41:48.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.577+0000 7f1a7dc00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1a7815f270 0x7f1a7806c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:48.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.577+0000 7f1a7dc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a780b53b0 0x7f1a7806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:48.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.577+0000 7f1a7dc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1a7806cf00 0x7f1a78162c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:48.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.577+0000 7f1a7dc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1a780afc40 con 0x7f1a7806cf00 2024-04-26T23:41:48.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.577+0000 7f1a7dc00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f1a780d1dc0 con 0x7f1a7815f270 2024-04-26T23:41:48.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.577+0000 7f1a7dc00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1a780d20a0 con 0x7f1a780b53b0 2024-04-26T23:41:48.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.577+0000 7f1a7d200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1a7806cf00 0x7f1a78162c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:48.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.577+0000 7f1a7d200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1a7806cf00 0x7f1a78162c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45176/0 (socket says 172.21.15.137:45176) 2024-04-26T23:41:48.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.577+0000 7f1a7d200640 1 -- 172.21.15.137:0/1698162478 learned_addr learned my addr 172.21.15.137:0/1698162478 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:48.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.577+0000 7f1a77e00640 1 --2- 172.21.15.137:0/1698162478 >> v2:172.21.15.170:3300/0 conn(0x7f1a7815f270 0x7f1a7806c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:48.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.577+0000 7f1a6f400640 1 --2- 172.21.15.137:0/1698162478 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a780b53b0 0x7f1a7806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:48.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.577+0000 7f1a7d200640 1 -- 172.21.15.137:0/1698162478 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a780b53b0 msgr2=0x7f1a7806c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:48.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.577+0000 7f1a7d200640 1 --2- 172.21.15.137:0/1698162478 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a780b53b0 0x7f1a7806c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.577+0000 7f1a7d200640 1 -- 172.21.15.137:0/1698162478 >> v2:172.21.15.170:3300/0 conn(0x7f1a7815f270 msgr2=0x7f1a7806c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:48.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.577+0000 7f1a7d200640 1 --2- 172.21.15.137:0/1698162478 >> v2:172.21.15.170:3300/0 conn(0x7f1a7815f270 0x7f1a7806c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.577+0000 7f1a7d200640 1 -- 172.21.15.137:0/1698162478 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a780aff00 con 0x7f1a7806cf00 2024-04-26T23:41:48.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.581+0000 7f1a7d200640 1 --2- 172.21.15.137:0/1698162478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a7806cf00 0x7f1a78162c00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1a780c6790 tx=0x7f1a7001c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c9f51558cb432e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:48.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.581+0000 7f1a77400640 1 -- 172.21.15.137:0/1698162478 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a700a64d0 con 0x7f1a7806cf00 2024-04-26T23:41:48.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.581+0000 7f1a77400640 1 -- 172.21.15.137:0/1698162478 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a700a6670 con 0x7f1a7806cf00 2024-04-26T23:41:48.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.581+0000 7f1a77400640 1 -- 172.21.15.137:0/1698162478 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a700a6a40 con 0x7f1a7806cf00 2024-04-26T23:41:48.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.581+0000 7f1a7dc00640 1 -- 172.21.15.137:0/1698162478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a7806cf00 msgr2=0x7f1a78162c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:48.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.581+0000 7f1a7dc00640 1 --2- 172.21.15.137:0/1698162478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a7806cf00 0x7f1a78162c00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1a780c6790 tx=0x7f1a7001c730 comp rx=0 tx=0).stop 2024-04-26T23:41:48.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.581+0000 7f1a7dc00640 1 -- 172.21.15.137:0/1698162478 shutdown_connections 2024-04-26T23:41:48.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.581+0000 7f1a7dc00640 1 --2- 172.21.15.137:0/1698162478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a7806cf00 0x7f1a78162c00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.581+0000 7f1a7dc00640 1 --2- 172.21.15.137:0/1698162478 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a780b53b0 0x7f1a7806c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.581+0000 7f1a7dc00640 1 --2- 172.21.15.137:0/1698162478 >> v2:172.21.15.170:3300/0 conn(0x7f1a7815f270 0x7f1a7806c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.581+0000 7f1a7dc00640 1 -- 172.21.15.137:0/1698162478 >> 172.21.15.137:0/1698162478 conn(0x7f1a780b47e0 msgr2=0x7f1a780b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:48.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.581+0000 7f1a7dc00640 1 -- 172.21.15.137:0/1698162478 shutdown_connections 2024-04-26T23:41:48.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.581+0000 7f1a7dc00640 1 -- 172.21.15.137:0/1698162478 wait complete. 2024-04-26T23:41:48.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a7dc00640 1 Processor -- start 2024-04-26T23:41:48.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a7dc00640 1 -- start start 2024-04-26T23:41:48.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a7dc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a7806cf00 0x7f1a780ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:48.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a7dc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a780b53b0 0x7f1a781fbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:48.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a7dc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a7815f270 0x7f1a781fc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:48.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a7dc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1a780b0fc0 con 0x7f1a7806cf00 2024-04-26T23:41:48.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a7dc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1a780b0e40 con 0x7f1a780b53b0 2024-04-26T23:41:48.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a7dc00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1a780b1140 con 0x7f1a7815f270 2024-04-26T23:41:48.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a77e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a7806cf00 0x7f1a780ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:48.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a77e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a7806cf00 0x7f1a780ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45192/0 (socket says 172.21.15.137:45192) 2024-04-26T23:41:48.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a77e00640 1 -- 172.21.15.137:0/1611109922 learned_addr learned my addr 172.21.15.137:0/1611109922 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:48.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a7d200640 1 --2- 172.21.15.137:0/1611109922 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a7815f270 0x7f1a781fc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:48.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a6f400640 1 --2- 172.21.15.137:0/1611109922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a780b53b0 0x7f1a781fbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:48.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a77e00640 1 -- 172.21.15.137:0/1611109922 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a7815f270 msgr2=0x7f1a781fc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:48.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a77e00640 1 --2- 172.21.15.137:0/1611109922 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a7815f270 0x7f1a781fc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a77e00640 1 -- 172.21.15.137:0/1611109922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a780b53b0 msgr2=0x7f1a781fbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:48.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a77e00640 1 --2- 172.21.15.137:0/1611109922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a780b53b0 0x7f1a781fbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a77e00640 1 -- 172.21.15.137:0/1611109922 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a780b5da0 con 0x7f1a7806cf00 2024-04-26T23:41:48.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a77e00640 1 --2- 172.21.15.137:0/1611109922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a7806cf00 0x7f1a780ceb60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800e8a0 tx=0x7f1a6800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:48.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a74c00640 1 -- 172.21.15.137:0/1611109922 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68017070 con 0x7f1a7806cf00 2024-04-26T23:41:48.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a74c00640 1 -- 172.21.15.137:0/1611109922 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a6800c940 con 0x7f1a7806cf00 2024-04-26T23:41:48.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a7dc00640 1 -- 172.21.15.137:0/1611109922 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a78160eb0 con 0x7f1a7806cf00 2024-04-26T23:41:48.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a74c00640 1 -- 172.21.15.137:0/1611109922 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6800ccf0 con 0x7f1a7806cf00 2024-04-26T23:41:48.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.585+0000 7f1a7dc00640 1 -- 172.21.15.137:0/1611109922 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a780b6340 con 0x7f1a7806cf00 2024-04-26T23:41:48.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.589+0000 7f1a7dc00640 1 -- 172.21.15.137:0/1611109922 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a7806a300 con 0x7f1a7806cf00 2024-04-26T23:41:48.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.589+0000 7f1a74c00640 1 -- 172.21.15.137:0/1611109922 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1a6801a070 con 0x7f1a7806cf00 2024-04-26T23:41:48.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.589+0000 7f1a74c00640 1 --2- 172.21.15.137:0/1611109922 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1a540683b0 0x7f1a5406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:48.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.589+0000 7f1a74c00640 1 -- 172.21.15.137:0/1611109922 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1a68086770 con 0x7f1a7806cf00 2024-04-26T23:41:48.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.589+0000 7f1a6f400640 1 --2- 172.21.15.137:0/1611109922 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1a540683b0 0x7f1a5406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:48.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.589+0000 7f1a6f400640 1 --2- 172.21.15.137:0/1611109922 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1a540683b0 0x7f1a5406a870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1a78161cd0 tx=0x7f1a60009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:48.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.593+0000 7f1a74c00640 1 -- 172.21.15.137:0/1611109922 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1a680566d0 con 0x7f1a7806cf00 2024-04-26T23:41:48.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.753+0000 7f1a7dc00640 1 -- 172.21.15.137:0/1611109922 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1a780b8c10 con 0x7f1a7806cf00 2024-04-26T23:41:48.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.753+0000 7f1a74c00640 1 -- 172.21.15.137:0/1611109922 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f1a6805a9d0 con 0x7f1a7806cf00 2024-04-26T23:41:48.758 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:41:48.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.757+0000 7f1a7dc00640 1 -- 172.21.15.137:0/1611109922 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1a540683b0 msgr2=0x7f1a5406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:48.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.757+0000 7f1a7dc00640 1 --2- 172.21.15.137:0/1611109922 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1a540683b0 0x7f1a5406a870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1a78161cd0 tx=0x7f1a60009190 comp rx=0 tx=0).stop 2024-04-26T23:41:48.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.757+0000 7f1a7dc00640 1 -- 172.21.15.137:0/1611109922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a7806cf00 msgr2=0x7f1a780ceb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:48.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.757+0000 7f1a7dc00640 1 --2- 172.21.15.137:0/1611109922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a7806cf00 0x7f1a780ceb60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800e8a0 tx=0x7f1a6800eca0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.757+0000 7f1a7dc00640 1 -- 172.21.15.137:0/1611109922 shutdown_connections 2024-04-26T23:41:48.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.757+0000 7f1a7dc00640 1 --2- 172.21.15.137:0/1611109922 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1a540683b0 0x7f1a5406a870 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.757+0000 7f1a7dc00640 1 --2- 172.21.15.137:0/1611109922 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a7815f270 0x7f1a781fc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.757+0000 7f1a7dc00640 1 --2- 172.21.15.137:0/1611109922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a780b53b0 0x7f1a781fbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.757+0000 7f1a7dc00640 1 --2- 172.21.15.137:0/1611109922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a7806cf00 0x7f1a780ceb60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.757+0000 7f1a7dc00640 1 -- 172.21.15.137:0/1611109922 >> 172.21.15.137:0/1611109922 conn(0x7f1a780b47e0 msgr2=0x7f1a780b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:48.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.757+0000 7f1a7dc00640 1 -- 172.21.15.137:0/1611109922 shutdown_connections 2024-04-26T23:41:48.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.757+0000 7f1a7dc00640 1 -- 172.21.15.137:0/1611109922 wait complete. 2024-04-26T23:41:48.780 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:41:48.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.913+0000 7f3674c00640 1 Processor -- start 2024-04-26T23:41:48.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.913+0000 7f3674c00640 1 -- start start 2024-04-26T23:41:48.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.917+0000 7f3674c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3670159560 0x7f36700b5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:48.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.917+0000 7f3674c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f36700b57d0 0x7f3670072930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:48.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.917+0000 7f3674c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3670072e70 0x7f3670162c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:48.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.917+0000 7f3674c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f36700732e0 con 0x7f36700b57d0 2024-04-26T23:41:48.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.917+0000 7f3674c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f36700b5c50 con 0x7f3670072e70 2024-04-26T23:41:48.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.917+0000 7f3674c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f36700b5f30 con 0x7f3670159560 2024-04-26T23:41:48.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.917+0000 7f3665400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f36700b57d0 0x7f3670072930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:48.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.917+0000 7f3665400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f36700b57d0 0x7f3670072930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45198/0 (socket says 172.21.15.137:45198) 2024-04-26T23:41:48.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.917+0000 7f3665400640 1 -- 172.21.15.137:0/3484843145 learned_addr learned my addr 172.21.15.137:0/3484843145 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:48.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.917+0000 7f366de00640 1 --2- 172.21.15.137:0/3484843145 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3670159560 0x7f36700b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:48.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.917+0000 7f366e800640 1 --2- 172.21.15.137:0/3484843145 >> v2:172.21.15.170:3300/0 conn(0x7f3670072e70 0x7f3670162c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:48.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.917+0000 7f3665400640 1 -- 172.21.15.137:0/3484843145 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3670159560 msgr2=0x7f36700b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:48.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.917+0000 7f3665400640 1 --2- 172.21.15.137:0/3484843145 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3670159560 0x7f36700b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.917+0000 7f3665400640 1 -- 172.21.15.137:0/3484843145 >> v2:172.21.15.170:3300/0 conn(0x7f3670072e70 msgr2=0x7f3670162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:48.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.917+0000 7f3665400640 1 --2- 172.21.15.137:0/3484843145 >> v2:172.21.15.170:3300/0 conn(0x7f3670072e70 0x7f3670162c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.917+0000 7f3665400640 1 -- 172.21.15.137:0/3484843145 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36700b6210 con 0x7f36700b57d0 2024-04-26T23:41:48.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.921+0000 7f3665400640 1 --2- 172.21.15.137:0/3484843145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36700b57d0 0x7f3670072930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f367006d480 tx=0x7f365801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc081c4600d3d2e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:48.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.921+0000 7f366d400640 1 -- 172.21.15.137:0/3484843145 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36580b0070 con 0x7f36700b57d0 2024-04-26T23:41:48.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.921+0000 7f366d400640 1 -- 172.21.15.137:0/3484843145 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36580ab600 con 0x7f36700b57d0 2024-04-26T23:41:48.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.921+0000 7f366d400640 1 -- 172.21.15.137:0/3484843145 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36580ab9d0 con 0x7f36700b57d0 2024-04-26T23:41:48.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.921+0000 7f3674c00640 1 -- 172.21.15.137:0/3484843145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36700b57d0 msgr2=0x7f3670072930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:48.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.921+0000 7f3674c00640 1 --2- 172.21.15.137:0/3484843145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36700b57d0 0x7f3670072930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f367006d480 tx=0x7f365801c260 comp rx=0 tx=0).stop 2024-04-26T23:41:48.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.921+0000 7f3674c00640 1 -- 172.21.15.137:0/3484843145 shutdown_connections 2024-04-26T23:41:48.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.921+0000 7f3674c00640 1 --2- 172.21.15.137:0/3484843145 >> v2:172.21.15.170:3300/0 conn(0x7f3670072e70 0x7f3670162c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.921+0000 7f3674c00640 1 --2- 172.21.15.137:0/3484843145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36700b57d0 0x7f3670072930 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.921+0000 7f3674c00640 1 --2- 172.21.15.137:0/3484843145 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3670159560 0x7f36700b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.921+0000 7f3674c00640 1 -- 172.21.15.137:0/3484843145 >> 172.21.15.137:0/3484843145 conn(0x7f36700b3370 msgr2=0x7f36700b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:48.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.921+0000 7f3674c00640 1 -- 172.21.15.137:0/3484843145 shutdown_connections 2024-04-26T23:41:48.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.921+0000 7f3674c00640 1 -- 172.21.15.137:0/3484843145 wait complete. 2024-04-26T23:41:48.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.921+0000 7f3674c00640 1 Processor -- start 2024-04-26T23:41:48.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.921+0000 7f3674c00640 1 -- start start 2024-04-26T23:41:48.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f3674c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3670072e70 0x7f36701f8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:48.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f3674c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36700b57d0 0x7f367014b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:48.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f3674c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3670159560 0x7f36701560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:48.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f3674c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f367015f950 con 0x7f36700b57d0 2024-04-26T23:41:48.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f3674c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f367015f7d0 con 0x7f3670072e70 2024-04-26T23:41:48.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f3674c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f36700afc80 con 0x7f3670159560 2024-04-26T23:41:48.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f3665400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36700b57d0 0x7f367014b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:48.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f3665400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36700b57d0 0x7f367014b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45212/0 (socket says 172.21.15.137:45212) 2024-04-26T23:41:48.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f3665400640 1 -- 172.21.15.137:0/2764225367 learned_addr learned my addr 172.21.15.137:0/2764225367 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:48.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f366de00640 1 --2- 172.21.15.137:0/2764225367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3670072e70 0x7f36701f8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:48.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f366e800640 1 --2- 172.21.15.137:0/2764225367 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3670159560 0x7f36701560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:48.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f3665400640 1 -- 172.21.15.137:0/2764225367 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3670159560 msgr2=0x7f36701560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:48.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f3665400640 1 --2- 172.21.15.137:0/2764225367 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3670159560 0x7f36701560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f3665400640 1 -- 172.21.15.137:0/2764225367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3670072e70 msgr2=0x7f36701f8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:48.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f3665400640 1 --2- 172.21.15.137:0/2764225367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3670072e70 0x7f36701f8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:48.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f3665400640 1 -- 172.21.15.137:0/2764225367 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36701565f0 con 0x7f36700b57d0 2024-04-26T23:41:48.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f3665400640 1 --2- 172.21.15.137:0/2764225367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36700b57d0 0x7f367014b0a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f365801a910 tx=0x7f3658019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:48.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f3666a00640 1 -- 172.21.15.137:0/2764225367 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36580ba070 con 0x7f36700b57d0 2024-04-26T23:41:48.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f3666a00640 1 -- 172.21.15.137:0/2764225367 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36580b4420 con 0x7f36700b57d0 2024-04-26T23:41:48.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f3674c00640 1 -- 172.21.15.137:0/2764225367 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3670156890 con 0x7f36700b57d0 2024-04-26T23:41:48.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f3666a00640 1 -- 172.21.15.137:0/2764225367 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36580b0040 con 0x7f36700b57d0 2024-04-26T23:41:48.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f3674c00640 1 -- 172.21.15.137:0/2764225367 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f367006ed10 con 0x7f36700b57d0 2024-04-26T23:41:48.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f3674c00640 1 -- 172.21.15.137:0/2764225367 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f367006a410 con 0x7f36700b57d0 2024-04-26T23:41:48.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.925+0000 7f3666a00640 1 -- 172.21.15.137:0/2764225367 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f36580bd070 con 0x7f36700b57d0 2024-04-26T23:41:48.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.929+0000 7f3666a00640 1 --2- 172.21.15.137:0/2764225367 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f364c0683b0 0x7f364c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:48.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.929+0000 7f3666a00640 1 -- 172.21.15.137:0/2764225367 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f365811fb90 con 0x7f36700b57d0 2024-04-26T23:41:48.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.929+0000 7f366de00640 1 --2- 172.21.15.137:0/2764225367 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f364c0683b0 0x7f364c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:48.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.929+0000 7f366de00640 1 --2- 172.21.15.137:0/2764225367 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f364c0683b0 0x7f364c06a870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3670161f90 tx=0x7f366000b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:48.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:48.933+0000 7f3666a00640 1 -- 172.21.15.137:0/2764225367 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3658016110 con 0x7f36700b57d0 2024-04-26T23:41:49.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.085+0000 7f3674c00640 1 -- 172.21.15.137:0/2764225367 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3670162dd0 con 0x7f36700b57d0 2024-04-26T23:41:49.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.085+0000 7f3666a00640 1 -- 172.21.15.137:0/2764225367 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f36580f00b0 con 0x7f36700b57d0 2024-04-26T23:41:49.090 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:41:49.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.089+0000 7f3674c00640 1 -- 172.21.15.137:0/2764225367 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f364c0683b0 msgr2=0x7f364c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:49.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.089+0000 7f3674c00640 1 --2- 172.21.15.137:0/2764225367 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f364c0683b0 0x7f364c06a870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3670161f90 tx=0x7f366000b040 comp rx=0 tx=0).stop 2024-04-26T23:41:49.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.089+0000 7f3674c00640 1 -- 172.21.15.137:0/2764225367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36700b57d0 msgr2=0x7f367014b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:49.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.089+0000 7f3674c00640 1 --2- 172.21.15.137:0/2764225367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36700b57d0 0x7f367014b0a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f365801a910 tx=0x7f3658019000 comp rx=0 tx=0).stop 2024-04-26T23:41:49.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.089+0000 7f3674c00640 1 -- 172.21.15.137:0/2764225367 shutdown_connections 2024-04-26T23:41:49.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.089+0000 7f3674c00640 1 --2- 172.21.15.137:0/2764225367 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f364c0683b0 0x7f364c06a870 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.089+0000 7f3674c00640 1 --2- 172.21.15.137:0/2764225367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36700b57d0 0x7f367014b0a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.089+0000 7f3674c00640 1 --2- 172.21.15.137:0/2764225367 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3670159560 0x7f36701560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.089+0000 7f3674c00640 1 --2- 172.21.15.137:0/2764225367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3670072e70 0x7f36701f8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.089+0000 7f3674c00640 1 -- 172.21.15.137:0/2764225367 >> 172.21.15.137:0/2764225367 conn(0x7f36700b3370 msgr2=0x7f367015fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:49.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.089+0000 7f3674c00640 1 -- 172.21.15.137:0/2764225367 shutdown_connections 2024-04-26T23:41:49.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.089+0000 7f3674c00640 1 -- 172.21.15.137:0/2764225367 wait complete. 2024-04-26T23:41:49.111 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:41:49.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.245+0000 7fdf81a00640 1 Processor -- start 2024-04-26T23:41:49.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.245+0000 7fdf81a00640 1 -- start start 2024-04-26T23:41:49.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf81a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fdf7c152510 0x7fdf7c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf81a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdf7c073fe0 0x7fdf7c06f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf81a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf7c15baf0 con 0x7fdf7c0ceb00 2024-04-26T23:41:49.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf81a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fdf7c15bdb0 con 0x7fdf7c152510 2024-04-26T23:41:49.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf81a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdf7c15c090 con 0x7fdf7c073fe0 2024-04-26T23:41:49.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf72000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fdf7c0ceb00 0x7fdf7c0738d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39586/0 (socket says 172.21.15.137:39586) 2024-04-26T23:41:49.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf72000640 1 -- 172.21.15.137:0/1005992073 learned_addr learned my addr 172.21.15.137:0/1005992073 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:49.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf7b400640 1 --2- 172.21.15.137:0/1005992073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdf7c073fe0 0x7fdf7c06f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf7a000640 1 -- 172.21.15.137:0/1005992073 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1996583138 0 0) 0x7fdf7c15baf0 con 0x7fdf7c0ceb00 2024-04-26T23:41:49.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf7a000640 1 -- 172.21.15.137:0/1005992073 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf60003530 con 0x7fdf7c0ceb00 2024-04-26T23:41:49.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf7aa00640 1 --2- 172.21.15.137:0/1005992073 >> v2:172.21.15.170:3300/0 conn(0x7fdf7c152510 0x7fdf7c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf7a000640 1 -- 172.21.15.137:0/1005992073 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 770555803 0 0) 0x7fdf60003530 con 0x7fdf7c0ceb00 2024-04-26T23:41:49.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf7a000640 1 -- 172.21.15.137:0/1005992073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdf7c073fe0 msgr2=0x7fdf7c06f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:49.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf7a000640 1 --2- 172.21.15.137:0/1005992073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdf7c073fe0 0x7fdf7c06f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf7a000640 1 -- 172.21.15.137:0/1005992073 >> v2:172.21.15.170:3300/0 conn(0x7fdf7c152510 msgr2=0x7fdf7c06ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:49.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf7a000640 1 --2- 172.21.15.137:0/1005992073 >> v2:172.21.15.170:3300/0 conn(0x7fdf7c152510 0x7fdf7c06ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf7a000640 1 -- 172.21.15.137:0/1005992073 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7c15c370 con 0x7fdf7c0ceb00 2024-04-26T23:41:49.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf7a000640 1 -- 172.21.15.137:0/1005992073 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fdf64001680 con 0x7fdf7c0ceb00 2024-04-26T23:41:49.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf7a000640 1 -- 172.21.15.137:0/1005992073 >> v1:172.21.15.137:6789/0 conn(0x7fdf7c0ceb00 legacy=0x7fdf7c0738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:49.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf7a000640 1 --2- 172.21.15.137:0/1005992073 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf600039c0 0x7fdf60003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf7a000640 1 --2- 172.21.15.137:0/1005992073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf60004810 0x7fdf60004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf7a000640 1 --2- 172.21.15.137:0/1005992073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdf7c073fe0 0x7fdf600051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf7a000640 1 -- 172.21.15.137:0/1005992073 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7c15bdb0 con 0x7fdf60004810 2024-04-26T23:41:49.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf7a000640 1 -- 172.21.15.137:0/1005992073 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7c15c090 con 0x7fdf600039c0 2024-04-26T23:41:49.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf7a000640 1 -- 172.21.15.137:0/1005992073 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdf6000bab0 con 0x7fdf7c073fe0 2024-04-26T23:41:49.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf72000640 1 --2- 172.21.15.137:0/1005992073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf60004810 0x7fdf60004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf7b400640 1 --2- 172.21.15.137:0/1005992073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdf7c073fe0 0x7fdf600051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf7aa00640 1 --2- 172.21.15.137:0/1005992073 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf600039c0 0x7fdf60003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf72000640 1 -- 172.21.15.137:0/1005992073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdf7c073fe0 msgr2=0x7fdf600051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:49.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf72000640 1 --2- 172.21.15.137:0/1005992073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdf7c073fe0 0x7fdf600051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf72000640 1 -- 172.21.15.137:0/1005992073 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf600039c0 msgr2=0x7fdf60003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:49.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf72000640 1 --2- 172.21.15.137:0/1005992073 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf600039c0 0x7fdf60003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.249+0000 7fdf72000640 1 -- 172.21.15.137:0/1005992073 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf60003530 con 0x7fdf60004810 2024-04-26T23:41:49.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.253+0000 7fdf72000640 1 --2- 172.21.15.137:0/1005992073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf60004810 0x7fdf60004c90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400c210 tx=0x7fdf6401cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b970d99bd9fc8680 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:49.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.253+0000 7fdf7a000640 1 -- 172.21.15.137:0/1005992073 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf64007d40 con 0x7fdf60004810 2024-04-26T23:41:49.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.253+0000 7fdf7a000640 1 -- 172.21.15.137:0/1005992073 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf640a9020 con 0x7fdf60004810 2024-04-26T23:41:49.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.253+0000 7fdf7a000640 1 -- 172.21.15.137:0/1005992073 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf64005b00 con 0x7fdf60004810 2024-04-26T23:41:49.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.253+0000 7fdf81a00640 1 -- 172.21.15.137:0/1005992073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf60004810 msgr2=0x7fdf60004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:49.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.253+0000 7fdf81a00640 1 --2- 172.21.15.137:0/1005992073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf60004810 0x7fdf60004c90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400c210 tx=0x7fdf6401cb70 comp rx=0 tx=0).stop 2024-04-26T23:41:49.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.253+0000 7fdf7b400640 1 -- 172.21.15.137:0/1005992073 reap_dead start 2024-04-26T23:41:49.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.253+0000 7fdf81a00640 1 -- 172.21.15.137:0/1005992073 shutdown_connections 2024-04-26T23:41:49.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.253+0000 7fdf81a00640 1 -- 172.21.15.137:0/1005992073 >> 172.21.15.137:0/1005992073 conn(0x7fdf7c06c800 msgr2=0x7fdf7c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:49.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.253+0000 7fdf81a00640 1 -- 172.21.15.137:0/1005992073 shutdown_connections 2024-04-26T23:41:49.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.253+0000 7fdf81a00640 1 -- 172.21.15.137:0/1005992073 wait complete. 2024-04-26T23:41:49.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.253+0000 7fdf81a00640 1 Processor -- start 2024-04-26T23:41:49.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.253+0000 7fdf81a00640 1 -- start start 2024-04-26T23:41:49.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf81a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdf60004810 0x7fdf7c160d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf81a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf7c14c220 0x7fdf7c0ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf81a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf7c15d1a0 0x7fdf7c15d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf81a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7c0b4120 con 0x7fdf7c14c220 2024-04-26T23:41:49.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf81a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7c0b3fa0 con 0x7fdf7c15d1a0 2024-04-26T23:41:49.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf81a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdf7c0b42a0 con 0x7fdf60004810 2024-04-26T23:41:49.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf72000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf7c14c220 0x7fdf7c0ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf72000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf7c14c220 0x7fdf7c0ca6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45240/0 (socket says 172.21.15.137:45240) 2024-04-26T23:41:49.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf72000640 1 -- 172.21.15.137:0/2433433655 learned_addr learned my addr 172.21.15.137:0/2433433655 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:49.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf7b400640 1 --2- 172.21.15.137:0/2433433655 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf7c15d1a0 0x7fdf7c15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf7aa00640 1 --2- 172.21.15.137:0/2433433655 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdf60004810 0x7fdf7c160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf72000640 1 -- 172.21.15.137:0/2433433655 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdf60004810 msgr2=0x7fdf7c160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:49.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf72000640 1 --2- 172.21.15.137:0/2433433655 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdf60004810 0x7fdf7c160d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf72000640 1 -- 172.21.15.137:0/2433433655 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf7c15d1a0 msgr2=0x7fdf7c15d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:49.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf72000640 1 --2- 172.21.15.137:0/2433433655 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf7c15d1a0 0x7fdf7c15d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf72000640 1 -- 172.21.15.137:0/2433433655 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7c0cafa0 con 0x7fdf7c14c220 2024-04-26T23:41:49.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf72000640 1 --2- 172.21.15.137:0/2433433655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf7c14c220 0x7fdf7c0ca6e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdf64007040 tx=0x7fdf60005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:49.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf73400640 1 -- 172.21.15.137:0/2433433655 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf64004ab0 con 0x7fdf7c14c220 2024-04-26T23:41:49.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf73400640 1 -- 172.21.15.137:0/2433433655 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf64004c50 con 0x7fdf7c14c220 2024-04-26T23:41:49.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf73400640 1 -- 172.21.15.137:0/2433433655 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf640070d0 con 0x7fdf7c14c220 2024-04-26T23:41:49.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf81a00640 1 -- 172.21.15.137:0/2433433655 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf7c0cb280 con 0x7fdf7c14c220 2024-04-26T23:41:49.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf81a00640 1 -- 172.21.15.137:0/2433433655 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf7c161510 con 0x7fdf7c14c220 2024-04-26T23:41:49.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf81a00640 1 -- 172.21.15.137:0/2433433655 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf7c06a410 con 0x7fdf7c14c220 2024-04-26T23:41:49.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.257+0000 7fdf73400640 1 -- 172.21.15.137:0/2433433655 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdf64007270 con 0x7fdf7c14c220 2024-04-26T23:41:49.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.261+0000 7fdf73400640 1 --2- 172.21.15.137:0/2433433655 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdf58068380 0x7fdf5806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.261+0000 7fdf73400640 1 -- 172.21.15.137:0/2433433655 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdf64120280 con 0x7fdf7c14c220 2024-04-26T23:41:49.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.261+0000 7fdf7aa00640 1 --2- 172.21.15.137:0/2433433655 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdf58068380 0x7fdf5806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.261+0000 7fdf7aa00640 1 --2- 172.21.15.137:0/2433433655 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdf58068380 0x7fdf5806a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c003ab0 tx=0x7fdf6c009760 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:49.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.265+0000 7fdf73400640 1 -- 172.21.15.137:0/2433433655 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdf640168b0 con 0x7fdf7c14c220 2024-04-26T23:41:49.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.421+0000 7fdf81a00640 1 -- 172.21.15.137:0/2433433655 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdf7c0cb7a0 con 0x7fdf7c14c220 2024-04-26T23:41:49.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.421+0000 7fdf73400640 1 -- 172.21.15.137:0/2433433655 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fdf640c03a0 con 0x7fdf7c14c220 2024-04-26T23:41:49.424 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:41:49.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.421+0000 7fdf81a00640 1 -- 172.21.15.137:0/2433433655 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdf58068380 msgr2=0x7fdf5806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:49.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.421+0000 7fdf81a00640 1 --2- 172.21.15.137:0/2433433655 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdf58068380 0x7fdf5806a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c003ab0 tx=0x7fdf6c009760 comp rx=0 tx=0).stop 2024-04-26T23:41:49.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.421+0000 7fdf81a00640 1 -- 172.21.15.137:0/2433433655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf7c14c220 msgr2=0x7fdf7c0ca6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:49.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.421+0000 7fdf81a00640 1 --2- 172.21.15.137:0/2433433655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf7c14c220 0x7fdf7c0ca6e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdf64007040 tx=0x7fdf60005840 comp rx=0 tx=0).stop 2024-04-26T23:41:49.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.421+0000 7fdf81a00640 1 -- 172.21.15.137:0/2433433655 shutdown_connections 2024-04-26T23:41:49.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.421+0000 7fdf81a00640 1 --2- 172.21.15.137:0/2433433655 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdf58068380 0x7fdf5806a840 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.421+0000 7fdf81a00640 1 --2- 172.21.15.137:0/2433433655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf7c14c220 0x7fdf7c0ca6e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.421+0000 7fdf81a00640 1 --2- 172.21.15.137:0/2433433655 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf7c15d1a0 0x7fdf7c15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.421+0000 7fdf81a00640 1 --2- 172.21.15.137:0/2433433655 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdf60004810 0x7fdf7c160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.421+0000 7fdf81a00640 1 -- 172.21.15.137:0/2433433655 >> 172.21.15.137:0/2433433655 conn(0x7fdf7c06c800 msgr2=0x7fdf7c15f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:49.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.421+0000 7fdf81a00640 1 -- 172.21.15.137:0/2433433655 shutdown_connections 2024-04-26T23:41:49.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.421+0000 7fdf81a00640 1 -- 172.21.15.137:0/2433433655 wait complete. 2024-04-26T23:41:49.446 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:49.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.577+0000 7f56e9800640 1 Processor -- start 2024-04-26T23:41:49.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.577+0000 7f56e9800640 1 -- start start 2024-04-26T23:41:49.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.581+0000 7f56e9800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f56e406f670 0x7f56e4160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.581+0000 7f56e9800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e40cfa50 0x7f56e406c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.581+0000 7f56e9800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56e40cf3c0 con 0x7f56e415f890 2024-04-26T23:41:49.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.581+0000 7f56e9800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f56e4070ec0 con 0x7f56e406f670 2024-04-26T23:41:49.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.581+0000 7f56e9800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f56e406fb00 con 0x7f56e40cfa50 2024-04-26T23:41:49.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.581+0000 7f56e3e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f56e415f890 0x7f56e415fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39592/0 (socket says 172.21.15.137:39592) 2024-04-26T23:41:49.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.581+0000 7f56e3e00640 1 -- 172.21.15.137:0/3322603967 learned_addr learned my addr 172.21.15.137:0/3322603967 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:49.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.581+0000 7f56e3400640 1 --2- 172.21.15.137:0/3322603967 >> v2:172.21.15.137:3300/0 conn(0x7f56e406f670 0x7f56e4160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.581+0000 7f56e8e00640 1 --2- 172.21.15.137:0/3322603967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e40cfa50 0x7f56e406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.581+0000 7f56e2a00640 1 -- 172.21.15.137:0/3322603967 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2150364922 0 0) 0x7f56e40cf3c0 con 0x7f56e415f890 2024-04-26T23:41:49.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.581+0000 7f56e2a00640 1 -- 172.21.15.137:0/3322603967 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56c8005740 con 0x7f56e415f890 2024-04-26T23:41:49.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.581+0000 7f56e3400640 1 -- 172.21.15.137:0/3322603967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e40cfa50 msgr2=0x7f56e406c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:49.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.581+0000 7f56e3400640 1 --2- 172.21.15.137:0/3322603967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e40cfa50 0x7f56e406c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.581+0000 7f56e3400640 1 -- 172.21.15.137:0/3322603967 >> v1:172.21.15.137:6789/0 conn(0x7f56e415f890 legacy=0x7f56e415fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:49.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.581+0000 7f56e3400640 1 -- 172.21.15.137:0/3322603967 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e406fde0 con 0x7f56e406f670 2024-04-26T23:41:49.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.585+0000 7f56e3400640 1 --2- 172.21.15.137:0/3322603967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56e406f670 0x7f56e4160380 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f56cc0097c0 tx=0x7f56cc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b51375674d24b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:49.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.585+0000 7f56e2a00640 1 -- 172.21.15.137:0/3322603967 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc0b1070 con 0x7f56e406f670 2024-04-26T23:41:49.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.585+0000 7f56e2a00640 1 -- 172.21.15.137:0/3322603967 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56cc0ac410 con 0x7f56e406f670 2024-04-26T23:41:49.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.585+0000 7f56e2a00640 1 -- 172.21.15.137:0/3322603967 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc0ac7e0 con 0x7f56e406f670 2024-04-26T23:41:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.585+0000 7f56e9800640 1 -- 172.21.15.137:0/3322603967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56e406f670 msgr2=0x7f56e4160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.585+0000 7f56e9800640 1 --2- 172.21.15.137:0/3322603967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56e406f670 0x7f56e4160380 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f56cc0097c0 tx=0x7f56cc01c4a0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.585+0000 7f56e9800640 1 -- 172.21.15.137:0/3322603967 shutdown_connections 2024-04-26T23:41:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.585+0000 7f56e9800640 1 --2- 172.21.15.137:0/3322603967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e40cfa50 0x7f56e406c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.585+0000 7f56e9800640 1 --2- 172.21.15.137:0/3322603967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56e406f670 0x7f56e4160380 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.585+0000 7f56e9800640 1 -- 172.21.15.137:0/3322603967 >> 172.21.15.137:0/3322603967 conn(0x7f56e40ce5d0 msgr2=0x7f56e40ce9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.585+0000 7f56e9800640 1 -- 172.21.15.137:0/3322603967 shutdown_connections 2024-04-26T23:41:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.585+0000 7f56e9800640 1 -- 172.21.15.137:0/3322603967 wait complete. 2024-04-26T23:41:49.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.585+0000 7f56e9800640 1 Processor -- start 2024-04-26T23:41:49.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.585+0000 7f56e9800640 1 -- start start 2024-04-26T23:41:49.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.585+0000 7f56e9800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56e40cfa50 0x7f56e413b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.585+0000 7f56e9800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e415f890 0x7f56e415d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.585+0000 7f56e9800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56e415d6e0 0x7f56e40b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.585+0000 7f56e9800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f56e406d560 con 0x7f56e415d6e0 2024-04-26T23:41:49.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.585+0000 7f56e9800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f56e406d3e0 con 0x7f56e40cfa50 2024-04-26T23:41:49.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.585+0000 7f56e9800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f56e4075380 con 0x7f56e415f890 2024-04-26T23:41:49.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.589+0000 7f56e8e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56e415d6e0 0x7f56e40b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.589+0000 7f56e8e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56e415d6e0 0x7f56e40b63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45262/0 (socket says 172.21.15.137:45262) 2024-04-26T23:41:49.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.589+0000 7f56e8e00640 1 -- 172.21.15.137:0/1502963694 learned_addr learned my addr 172.21.15.137:0/1502963694 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:49.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.589+0000 7f56e3400640 1 --2- 172.21.15.137:0/1502963694 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e415f890 0x7f56e415d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.589+0000 7f56e3e00640 1 --2- 172.21.15.137:0/1502963694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56e40cfa50 0x7f56e413b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.589+0000 7f56e8e00640 1 -- 172.21.15.137:0/1502963694 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e415f890 msgr2=0x7f56e415d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:49.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.589+0000 7f56e8e00640 1 --2- 172.21.15.137:0/1502963694 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e415f890 0x7f56e415d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.589+0000 7f56e8e00640 1 -- 172.21.15.137:0/1502963694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56e40cfa50 msgr2=0x7f56e413b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:49.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.589+0000 7f56e8e00640 1 --2- 172.21.15.137:0/1502963694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56e40cfa50 0x7f56e413b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.589+0000 7f56e8e00640 1 -- 172.21.15.137:0/1502963694 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e4154900 con 0x7f56e415d6e0 2024-04-26T23:41:49.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.589+0000 7f56e8e00640 1 --2- 172.21.15.137:0/1502963694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56e415d6e0 0x7f56e40b63c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f56dc007e70 tx=0x7f56dc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:49.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.589+0000 7f56dbe00640 1 -- 172.21.15.137:0/1502963694 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc014620 con 0x7f56e415d6e0 2024-04-26T23:41:49.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.589+0000 7f56dbe00640 1 -- 172.21.15.137:0/1502963694 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56dc019070 con 0x7f56e415d6e0 2024-04-26T23:41:49.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.589+0000 7f56e9800640 1 -- 172.21.15.137:0/1502963694 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e4154be0 con 0x7f56e415d6e0 2024-04-26T23:41:49.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.589+0000 7f56dbe00640 1 -- 172.21.15.137:0/1502963694 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc014a20 con 0x7f56e415d6e0 2024-04-26T23:41:49.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.589+0000 7f56e9800640 1 -- 172.21.15.137:0/1502963694 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e41551a0 con 0x7f56e415d6e0 2024-04-26T23:41:49.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.589+0000 7f56e9800640 1 -- 172.21.15.137:0/1502963694 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e406a410 con 0x7f56e415d6e0 2024-04-26T23:41:49.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.589+0000 7f56dbe00640 1 -- 172.21.15.137:0/1502963694 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f56dc014bc0 con 0x7f56e415d6e0 2024-04-26T23:41:49.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.589+0000 7f56dbe00640 1 --2- 172.21.15.137:0/1502963694 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f56c0068380 0x7f56c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.593+0000 7f56dbe00640 1 -- 172.21.15.137:0/1502963694 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f56dc0873b0 con 0x7f56e415d6e0 2024-04-26T23:41:49.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.593+0000 7f56e3e00640 1 --2- 172.21.15.137:0/1502963694 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f56c0068380 0x7f56c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.593+0000 7f56e3e00640 1 --2- 172.21.15.137:0/1502963694 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f56c0068380 0x7f56c006a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f56d4005890 tx=0x7f56d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:49.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.597+0000 7f56dbe00640 1 -- 172.21.15.137:0/1502963694 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f56dc011260 con 0x7f56e415d6e0 2024-04-26T23:41:49.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.753+0000 7f56e9800640 1 -- 172.21.15.137:0/1502963694 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f56e40b27a0 con 0x7f56e415d6e0 2024-04-26T23:41:49.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.757+0000 7f56dbe00640 1 -- 172.21.15.137:0/1502963694 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16653 (secure 0 0 0) 0x7f56dc057840 con 0x7f56e415d6e0 2024-04-26T23:41:49.759 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:49.760 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:25.186308+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:49.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.757+0000 7f56e9800640 1 -- 172.21.15.137:0/1502963694 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f56c0068380 msgr2=0x7f56c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:49.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.757+0000 7f56e9800640 1 --2- 172.21.15.137:0/1502963694 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f56c0068380 0x7f56c006a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f56d4005890 tx=0x7f56d4009040 comp rx=0 tx=0).stop 2024-04-26T23:41:49.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.757+0000 7f56e9800640 1 -- 172.21.15.137:0/1502963694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56e415d6e0 msgr2=0x7f56e40b63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:49.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.757+0000 7f56e9800640 1 --2- 172.21.15.137:0/1502963694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56e415d6e0 0x7f56e40b63c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f56dc007e70 tx=0x7f56dc00e4b0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.757+0000 7f56e9800640 1 -- 172.21.15.137:0/1502963694 shutdown_connections 2024-04-26T23:41:49.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.757+0000 7f56e9800640 1 --2- 172.21.15.137:0/1502963694 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f56c0068380 0x7f56c006a840 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.757+0000 7f56e9800640 1 --2- 172.21.15.137:0/1502963694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56e415d6e0 0x7f56e40b63c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.757+0000 7f56e9800640 1 --2- 172.21.15.137:0/1502963694 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e415f890 0x7f56e415d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.757+0000 7f56e9800640 1 --2- 172.21.15.137:0/1502963694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56e40cfa50 0x7f56e413b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.757+0000 7f56e9800640 1 -- 172.21.15.137:0/1502963694 >> 172.21.15.137:0/1502963694 conn(0x7f56e40ce5d0 msgr2=0x7f56e415fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:49.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.757+0000 7f56e9800640 1 -- 172.21.15.137:0/1502963694 shutdown_connections 2024-04-26T23:41:49.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.757+0000 7f56e9800640 1 -- 172.21.15.137:0/1502963694 wait complete. 2024-04-26T23:41:49.780 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:41:21.810449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:41:22.533452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:41:49.781 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:41:49.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2111400640 1 Processor -- start 2024-04-26T23:41:49.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2111400640 1 -- start start 2024-04-26T23:41:49.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2111400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f210c160450 0x7f210c0d3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2111400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f210c0b0cb0 con 0x7f210c0b0470 2024-04-26T23:41:49.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2111400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f210c0b0f90 con 0x7f210c0d19c0 2024-04-26T23:41:49.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2111400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f210c0b1270 con 0x7f210c160450 2024-04-26T23:41:49.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2109e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f210c0b0470 0x7f210c0d12b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39606/0 (socket says 172.21.15.137:39606) 2024-04-26T23:41:49.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2109e00640 1 -- 172.21.15.137:0/3672835708 learned_addr learned my addr 172.21.15.137:0/3672835708 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:49.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f210a800640 1 --2- 172.21.15.137:0/3672835708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f210c160450 0x7f210c0d3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2109400640 1 -- 172.21.15.137:0/3672835708 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1675444037 0 0) 0x7f210c0b0cb0 con 0x7f210c0b0470 2024-04-26T23:41:49.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2109400640 1 -- 172.21.15.137:0/3672835708 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20f0003530 con 0x7f210c0b0470 2024-04-26T23:41:49.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2109400640 1 -- 172.21.15.137:0/3672835708 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2647646530 0 0) 0x7f20f0003530 con 0x7f210c0b0470 2024-04-26T23:41:49.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2109400640 1 -- 172.21.15.137:0/3672835708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f210c160450 msgr2=0x7f210c0d3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:49.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2109400640 1 --2- 172.21.15.137:0/3672835708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f210c160450 0x7f210c0d3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2109400640 1 -- 172.21.15.137:0/3672835708 >> v1:172.21.15.170:6789/0 conn(0x7f210c0d19c0 legacy=0x7f210c0b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:49.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2109400640 1 -- 172.21.15.137:0/3672835708 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210c0b1550 con 0x7f210c0b0470 2024-04-26T23:41:49.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2109400640 1 -- 172.21.15.137:0/3672835708 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f20f8001680 con 0x7f210c0b0470 2024-04-26T23:41:49.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2109400640 1 -- 172.21.15.137:0/3672835708 >> v1:172.21.15.137:6789/0 conn(0x7f210c0b0470 legacy=0x7f210c0d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:49.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2109400640 1 --2- 172.21.15.137:0/3672835708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00039f0 0x7f20f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2109400640 1 --2- 172.21.15.137:0/3672835708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f210c160450 0x7f20f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2109400640 1 --2- 172.21.15.137:0/3672835708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f0004d50 0x7f20f00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2109400640 1 -- 172.21.15.137:0/3672835708 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f210c0b1270 con 0x7f20f00039f0 2024-04-26T23:41:49.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2109400640 1 -- 172.21.15.137:0/3672835708 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f20f000b9d0 con 0x7f20f0004d50 2024-04-26T23:41:49.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.917+0000 7f2109400640 1 -- 172.21.15.137:0/3672835708 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f20f000bbd0 con 0x7f210c160450 2024-04-26T23:41:49.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.921+0000 7f210a800640 1 --2- 172.21.15.137:0/3672835708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00039f0 0x7f20f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.921+0000 7f2109e00640 1 --2- 172.21.15.137:0/3672835708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f210c160450 0x7f20f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.921+0000 7f210b200640 1 --2- 172.21.15.137:0/3672835708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f0004d50 0x7f20f00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.921+0000 7f210a800640 1 -- 172.21.15.137:0/3672835708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f210c160450 msgr2=0x7f20f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:49.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.921+0000 7f210a800640 1 --2- 172.21.15.137:0/3672835708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f210c160450 0x7f20f0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.921+0000 7f210a800640 1 -- 172.21.15.137:0/3672835708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f0004d50 msgr2=0x7f20f00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:49.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.921+0000 7f210a800640 1 --2- 172.21.15.137:0/3672835708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f0004d50 0x7f20f00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.921+0000 7f210a800640 1 -- 172.21.15.137:0/3672835708 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f0003530 con 0x7f20f00039f0 2024-04-26T23:41:49.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.921+0000 7f210b200640 1 --2- 172.21.15.137:0/3672835708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f0004d50 0x7f20f00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:49.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.921+0000 7f210a800640 1 --2- 172.21.15.137:0/3672835708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00039f0 0x7f20f0003dd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f20fc009fc0 tx=0x7f20fc01cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d8674c216c68ea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:49.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.921+0000 7f2109400640 1 -- 172.21.15.137:0/3672835708 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20fc0b2070 con 0x7f20f00039f0 2024-04-26T23:41:49.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.921+0000 7f2109400640 1 -- 172.21.15.137:0/3672835708 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20fc0a5bd0 con 0x7f20f00039f0 2024-04-26T23:41:49.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.921+0000 7f2109400640 1 -- 172.21.15.137:0/3672835708 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20fc009c10 con 0x7f20f00039f0 2024-04-26T23:41:49.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.921+0000 7f2111400640 1 -- 172.21.15.137:0/3672835708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00039f0 msgr2=0x7f20f0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:49.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.921+0000 7f2111400640 1 --2- 172.21.15.137:0/3672835708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00039f0 0x7f20f0003dd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f20fc009fc0 tx=0x7f20fc01cbc0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f210b200640 1 -- 172.21.15.137:0/3672835708 reap_dead start 2024-04-26T23:41:49.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f2111400640 1 -- 172.21.15.137:0/3672835708 shutdown_connections 2024-04-26T23:41:49.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f2111400640 1 -- 172.21.15.137:0/3672835708 >> 172.21.15.137:0/3672835708 conn(0x7f210c09ba60 msgr2=0x7f210c09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:49.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f2111400640 1 -- 172.21.15.137:0/3672835708 shutdown_connections 2024-04-26T23:41:49.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f2111400640 1 -- 172.21.15.137:0/3672835708 wait complete. 2024-04-26T23:41:49.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f2111400640 1 Processor -- start 2024-04-26T23:41:49.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f2111400640 1 -- start start 2024-04-26T23:41:49.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f2111400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20f00039f0 0x7f210c0b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f2111400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f210c0c90c0 0x7f210c09c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f2111400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f210c0b5c40 0x7f210c15af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f2111400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f210c0b1d50 con 0x7f210c0b5c40 2024-04-26T23:41:49.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f2111400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f210c0b08d0 con 0x7f210c0c90c0 2024-04-26T23:41:49.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f2111400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f210c0b3100 con 0x7f20f00039f0 2024-04-26T23:41:49.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f210b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f210c0b5c40 0x7f210c15af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f2109e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f210c0c90c0 0x7f210c09c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f210a800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20f00039f0 0x7f210c0b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f2109e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f210c0c90c0 0x7f210c09c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:35240/0 (socket says 172.21.15.137:35240) 2024-04-26T23:41:49.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f2109e00640 1 -- 172.21.15.137:0/2775099177 learned_addr learned my addr 172.21.15.137:0/2775099177 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:49.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f210b200640 1 -- 172.21.15.137:0/2775099177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20f00039f0 msgr2=0x7f210c0b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:49.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f210b200640 1 --2- 172.21.15.137:0/2775099177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20f00039f0 0x7f210c0b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f210b200640 1 -- 172.21.15.137:0/2775099177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f210c0c90c0 msgr2=0x7f210c09c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:49.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f210b200640 1 --2- 172.21.15.137:0/2775099177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f210c0c90c0 0x7f210c09c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:49.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.925+0000 7f210b200640 1 -- 172.21.15.137:0/2775099177 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210c0b33e0 con 0x7f210c0b5c40 2024-04-26T23:41:49.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.929+0000 7f210b200640 1 --2- 172.21.15.137:0/2775099177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f210c0b5c40 0x7f210c15af50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f20f000bda0 tx=0x7f2104010f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:49.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.929+0000 7f2102a00640 1 -- 172.21.15.137:0/2775099177 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2104005480 con 0x7f210c0b5c40 2024-04-26T23:41:49.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.929+0000 7f2102a00640 1 -- 172.21.15.137:0/2775099177 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2104019070 con 0x7f210c0b5c40 2024-04-26T23:41:49.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.929+0000 7f2111400640 1 -- 172.21.15.137:0/2775099177 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f210c0b36c0 con 0x7f210c0b5c40 2024-04-26T23:41:49.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.929+0000 7f2102a00640 1 -- 172.21.15.137:0/2775099177 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210400ea30 con 0x7f210c0b5c40 2024-04-26T23:41:49.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.929+0000 7f2111400640 1 -- 172.21.15.137:0/2775099177 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f210c0b3c80 con 0x7f210c0b5c40 2024-04-26T23:41:49.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.929+0000 7f2111400640 1 -- 172.21.15.137:0/2775099177 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f210c06a410 con 0x7f210c0b5c40 2024-04-26T23:41:49.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.929+0000 7f2102a00640 1 -- 172.21.15.137:0/2775099177 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2104013070 con 0x7f210c0b5c40 2024-04-26T23:41:49.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.929+0000 7f2102a00640 1 --2- 172.21.15.137:0/2775099177 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f20ec068380 0x7f20ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:49.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.929+0000 7f2102a00640 1 -- 172.21.15.137:0/2775099177 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2104089780 con 0x7f210c0b5c40 2024-04-26T23:41:49.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.929+0000 7f210a800640 1 --2- 172.21.15.137:0/2775099177 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f20ec068380 0x7f20ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:49.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.933+0000 7f210a800640 1 --2- 172.21.15.137:0/2775099177 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f20ec068380 0x7f20ec06a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f20fc0af000 tx=0x7f20fc004ac0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:49.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:49.933+0000 7f2102a00640 1 -- 172.21.15.137:0/2775099177 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2104059650 con 0x7f210c0b5c40 2024-04-26T23:41:50.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.093+0000 7f2111400640 1 -- 172.21.15.137:0/2775099177 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f210c0b1ed0 con 0x7f210c0b5c40 2024-04-26T23:41:50.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.093+0000 7f2102a00640 1 -- 172.21.15.137:0/2775099177 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f210405d950 con 0x7f210c0b5c40 2024-04-26T23:41:50.097 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:41:50.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.097+0000 7f2111400640 1 -- 172.21.15.137:0/2775099177 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f20ec068380 msgr2=0x7f20ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:50.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.097+0000 7f2111400640 1 --2- 172.21.15.137:0/2775099177 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f20ec068380 0x7f20ec06a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f20fc0af000 tx=0x7f20fc004ac0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.097+0000 7f2111400640 1 -- 172.21.15.137:0/2775099177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f210c0b5c40 msgr2=0x7f210c15af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:50.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.097+0000 7f2111400640 1 --2- 172.21.15.137:0/2775099177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f210c0b5c40 0x7f210c15af50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f20f000bda0 tx=0x7f2104010f20 comp rx=0 tx=0).stop 2024-04-26T23:41:50.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.097+0000 7f2111400640 1 -- 172.21.15.137:0/2775099177 shutdown_connections 2024-04-26T23:41:50.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.097+0000 7f2111400640 1 --2- 172.21.15.137:0/2775099177 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f20ec068380 0x7f20ec06a840 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.097+0000 7f2111400640 1 --2- 172.21.15.137:0/2775099177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f210c0b5c40 0x7f210c15af50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.097+0000 7f2111400640 1 --2- 172.21.15.137:0/2775099177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f210c0c90c0 0x7f210c09c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.097+0000 7f2111400640 1 --2- 172.21.15.137:0/2775099177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20f00039f0 0x7f210c0b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.097+0000 7f2111400640 1 -- 172.21.15.137:0/2775099177 >> 172.21.15.137:0/2775099177 conn(0x7f210c09ba60 msgr2=0x7f210c0cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:50.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.097+0000 7f2111400640 1 -- 172.21.15.137:0/2775099177 shutdown_connections 2024-04-26T23:41:50.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.097+0000 7f2111400640 1 -- 172.21.15.137:0/2775099177 wait complete. 2024-04-26T23:41:50.118 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:41:50.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.253+0000 7fe656800640 1 Processor -- start 2024-04-26T23:41:50.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.253+0000 7fe656800640 1 -- start start 2024-04-26T23:41:50.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.257+0000 7fe656800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe65015ce80 0x7fe6500d1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:50.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.257+0000 7fe656800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6500d19d0 con 0x7fe65006f8c0 2024-04-26T23:41:50.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.257+0000 7fe656800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6500d1200 con 0x7fe650075a90 2024-04-26T23:41:50.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.257+0000 7fe656800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe65006fd50 con 0x7fe65015ce80 2024-04-26T23:41:50.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.257+0000 7fe654a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fe65006f8c0 0x7fe650075380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39612/0 (socket says 172.21.15.137:39612) 2024-04-26T23:41:50.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.257+0000 7fe654a00640 1 -- 172.21.15.137:0/1802572144 learned_addr learned my addr 172.21.15.137:0/1802572144 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:50.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.257+0000 7fe655400640 1 --2- 172.21.15.137:0/1802572144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe65015ce80 0x7fe6500d1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:50.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.257+0000 7fe64fe00640 1 -- 172.21.15.137:0/1802572144 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 773384892 0 0) 0x7fe6500d19d0 con 0x7fe65006f8c0 2024-04-26T23:41:50.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.257+0000 7fe64fe00640 1 -- 172.21.15.137:0/1802572144 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe638003530 con 0x7fe65006f8c0 2024-04-26T23:41:50.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.257+0000 7fe64fe00640 1 -- 172.21.15.137:0/1802572144 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3872226373 0 0) 0x7fe6500d1200 con 0x7fe650075a90 2024-04-26T23:41:50.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.257+0000 7fe64fe00640 1 -- 172.21.15.137:0/1802572144 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6500d19d0 con 0x7fe650075a90 2024-04-26T23:41:50.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.257+0000 7fe64fe00640 1 -- 172.21.15.137:0/1802572144 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2826568261 0 0) 0x7fe638003530 con 0x7fe65006f8c0 2024-04-26T23:41:50.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.257+0000 7fe655400640 1 -- 172.21.15.137:0/1802572144 >> v1:172.21.15.170:6789/0 conn(0x7fe650075a90 legacy=0x7fe6500ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:50.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.257+0000 7fe655400640 1 -- 172.21.15.137:0/1802572144 >> v1:172.21.15.137:6789/0 conn(0x7fe65006f8c0 legacy=0x7fe650075380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:50.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.257+0000 7fe655400640 1 -- 172.21.15.137:0/1802572144 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe650070030 con 0x7fe65015ce80 2024-04-26T23:41:50.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.261+0000 7fe655400640 1 --2- 172.21.15.137:0/1802572144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe65015ce80 0x7fe6500d1490 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe6440097f0 tx=0x7fe64401c340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1c5042a9418ad81 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:50.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.261+0000 7fe64fe00640 1 -- 172.21.15.137:0/1802572144 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6440b0070 con 0x7fe65015ce80 2024-04-26T23:41:50.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.261+0000 7fe64fe00640 1 -- 172.21.15.137:0/1802572144 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6440ab400 con 0x7fe65015ce80 2024-04-26T23:41:50.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.261+0000 7fe64fe00640 1 -- 172.21.15.137:0/1802572144 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c001680 con 0x7fe65015ce80 2024-04-26T23:41:50.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.261+0000 7fe656800640 1 -- 172.21.15.137:0/1802572144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe65015ce80 msgr2=0x7fe6500d1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:50.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.261+0000 7fe656800640 1 --2- 172.21.15.137:0/1802572144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe65015ce80 0x7fe6500d1490 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe6440097f0 tx=0x7fe64401c340 comp rx=0 tx=0).stop 2024-04-26T23:41:50.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.261+0000 7fe656800640 1 -- 172.21.15.137:0/1802572144 shutdown_connections 2024-04-26T23:41:50.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.261+0000 7fe656800640 1 --2- 172.21.15.137:0/1802572144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe65015ce80 0x7fe6500d1490 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.261+0000 7fe656800640 1 -- 172.21.15.137:0/1802572144 >> 172.21.15.137:0/1802572144 conn(0x7fe650073e20 msgr2=0x7fe65006c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:50.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.261+0000 7fe656800640 1 -- 172.21.15.137:0/1802572144 shutdown_connections 2024-04-26T23:41:50.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.261+0000 7fe656800640 1 -- 172.21.15.137:0/1802572144 wait complete. 2024-04-26T23:41:50.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.261+0000 7fe656800640 1 Processor -- start 2024-04-26T23:41:50.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.261+0000 7fe656800640 1 -- start start 2024-04-26T23:41:50.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.261+0000 7fe656800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe650075a90 0x7fe650140550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:50.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.261+0000 7fe656800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe65015ce80 0x7fe650158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:50.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.261+0000 7fe656800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe650158f60 0x7fe65015ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:50.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.261+0000 7fe656800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe65016a900 con 0x7fe65015ce80 2024-04-26T23:41:50.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.261+0000 7fe656800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe650070df0 con 0x7fe650158f60 2024-04-26T23:41:50.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.261+0000 7fe656800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe65016aa80 con 0x7fe650075a90 2024-04-26T23:41:50.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.261+0000 7fe654a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe65015ce80 0x7fe650158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:50.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.265+0000 7fe654a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe65015ce80 0x7fe650158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45286/0 (socket says 172.21.15.137:45286) 2024-04-26T23:41:50.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.265+0000 7fe654a00640 1 -- 172.21.15.137:0/146968026 learned_addr learned my addr 172.21.15.137:0/146968026 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:50.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.265+0000 7fe655400640 1 --2- 172.21.15.137:0/146968026 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe650075a90 0x7fe650140550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:50.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.265+0000 7fe655e00640 1 --2- 172.21.15.137:0/146968026 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe650158f60 0x7fe65015ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:50.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.265+0000 7fe654a00640 1 -- 172.21.15.137:0/146968026 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe650075a90 msgr2=0x7fe650140550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:50.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.265+0000 7fe654a00640 1 --2- 172.21.15.137:0/146968026 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe650075a90 0x7fe650140550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.265+0000 7fe654a00640 1 -- 172.21.15.137:0/146968026 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe650158f60 msgr2=0x7fe65015ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:50.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.265+0000 7fe654a00640 1 --2- 172.21.15.137:0/146968026 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe650158f60 0x7fe65015ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.265+0000 7fe654a00640 1 -- 172.21.15.137:0/146968026 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe650151b50 con 0x7fe65015ce80 2024-04-26T23:41:50.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.265+0000 7fe654a00640 1 --2- 172.21.15.137:0/146968026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe65015ce80 0x7fe650158a20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00c7b0 tx=0x7fe63c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:50.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.265+0000 7fe64d600640 1 -- 172.21.15.137:0/146968026 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c017070 con 0x7fe65015ce80 2024-04-26T23:41:50.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.265+0000 7fe64d600640 1 -- 172.21.15.137:0/146968026 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe63c005b00 con 0x7fe65015ce80 2024-04-26T23:41:50.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.265+0000 7fe656800640 1 -- 172.21.15.137:0/146968026 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe650159590 con 0x7fe65015ce80 2024-04-26T23:41:50.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.265+0000 7fe64d600640 1 -- 172.21.15.137:0/146968026 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c007070 con 0x7fe65015ce80 2024-04-26T23:41:50.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.265+0000 7fe656800640 1 -- 172.21.15.137:0/146968026 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe650159b50 con 0x7fe65015ce80 2024-04-26T23:41:50.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.265+0000 7fe656800640 1 -- 172.21.15.137:0/146968026 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe65006a300 con 0x7fe65015ce80 2024-04-26T23:41:50.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.265+0000 7fe64d600640 1 -- 172.21.15.137:0/146968026 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe63c01a070 con 0x7fe65015ce80 2024-04-26T23:41:50.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.265+0000 7fe64d600640 1 --2- 172.21.15.137:0/146968026 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6300683b0 0x7fe63006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:50.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.265+0000 7fe64d600640 1 -- 172.21.15.137:0/146968026 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe63c085ef0 con 0x7fe65015ce80 2024-04-26T23:41:50.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.269+0000 7fe655400640 1 --2- 172.21.15.137:0/146968026 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6300683b0 0x7fe63006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:50.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.269+0000 7fe655400640 1 --2- 172.21.15.137:0/146968026 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6300683b0 0x7fe63006a870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe6440ad000 tx=0x7fe6440a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:50.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.269+0000 7fe64d600640 1 -- 172.21.15.137:0/146968026 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe63c055dc0 con 0x7fe65015ce80 2024-04-26T23:41:50.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.429+0000 7fe656800640 1 -- 172.21.15.137:0/146968026 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe6500b3290 con 0x7fe65015ce80 2024-04-26T23:41:50.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.429+0000 7fe64d600640 1 -- 172.21.15.137:0/146968026 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fe63c05a0c0 con 0x7fe65015ce80 2024-04-26T23:41:50.433 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:41:50.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.433+0000 7fe656800640 1 -- 172.21.15.137:0/146968026 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6300683b0 msgr2=0x7fe63006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:50.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.433+0000 7fe656800640 1 --2- 172.21.15.137:0/146968026 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6300683b0 0x7fe63006a870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe6440ad000 tx=0x7fe6440a6000 comp rx=0 tx=0).stop 2024-04-26T23:41:50.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.433+0000 7fe656800640 1 -- 172.21.15.137:0/146968026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe65015ce80 msgr2=0x7fe650158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:50.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.433+0000 7fe656800640 1 --2- 172.21.15.137:0/146968026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe65015ce80 0x7fe650158a20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00c7b0 tx=0x7fe63c00cc70 comp rx=0 tx=0).stop 2024-04-26T23:41:50.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.433+0000 7fe656800640 1 -- 172.21.15.137:0/146968026 shutdown_connections 2024-04-26T23:41:50.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.433+0000 7fe656800640 1 --2- 172.21.15.137:0/146968026 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6300683b0 0x7fe63006a870 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.433+0000 7fe656800640 1 --2- 172.21.15.137:0/146968026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe65015ce80 0x7fe650158a20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.433+0000 7fe656800640 1 --2- 172.21.15.137:0/146968026 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe650158f60 0x7fe65015ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.433+0000 7fe656800640 1 --2- 172.21.15.137:0/146968026 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe650075a90 0x7fe650140550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.433+0000 7fe656800640 1 -- 172.21.15.137:0/146968026 >> 172.21.15.137:0/146968026 conn(0x7fe650073e20 msgr2=0x7fe6500b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:50.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.433+0000 7fe656800640 1 -- 172.21.15.137:0/146968026 shutdown_connections 2024-04-26T23:41:50.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.433+0000 7fe656800640 1 -- 172.21.15.137:0/146968026 wait complete. 2024-04-26T23:41:50.455 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:41:50.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.593+0000 7f38cb800640 1 Processor -- start 2024-04-26T23:41:50.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.593+0000 7f38cb800640 1 -- start start 2024-04-26T23:41:50.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.593+0000 7f38cb800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f38c40d0f60 0x7f38c40d13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:50.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.593+0000 7f38cb800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f38c415d6c0 0x7f38c415db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:50.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.593+0000 7f38cb800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38c40d1c90 con 0x7f38c4069b70 2024-04-26T23:41:50.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.593+0000 7f38cb800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f38c40d1f70 con 0x7f38c415d6c0 2024-04-26T23:41:50.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.593+0000 7f38cb800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f38c415cbe0 con 0x7f38c40d0f60 2024-04-26T23:41:50.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.593+0000 7f38c8e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f38c4069b70 0x7f38c41558a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39626/0 (socket says 172.21.15.137:39626) 2024-04-26T23:41:50.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.593+0000 7f38c8e00640 1 -- 172.21.15.137:0/2093882425 learned_addr learned my addr 172.21.15.137:0/2093882425 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:50.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.593+0000 7f38c9800640 1 --2- 172.21.15.137:0/2093882425 >> v2:172.21.15.137:3300/0 conn(0x7f38c415d6c0 0x7f38c415db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:50.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.593+0000 7f38c3e00640 1 --2- 172.21.15.137:0/2093882425 >> v2:172.21.15.170:3300/0 conn(0x7f38c40d0f60 0x7f38c40d13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:50.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.593+0000 7f38c3400640 1 -- 172.21.15.137:0/2093882425 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2790682535 0 0) 0x7f38c40d1c90 con 0x7f38c4069b70 2024-04-26T23:41:50.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.593+0000 7f38c3400640 1 -- 172.21.15.137:0/2093882425 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38ac005740 con 0x7f38c4069b70 2024-04-26T23:41:50.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.593+0000 7f38c9800640 1 -- 172.21.15.137:0/2093882425 >> v2:172.21.15.170:3300/0 conn(0x7f38c40d0f60 msgr2=0x7f38c40d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:50.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.593+0000 7f38c9800640 1 --2- 172.21.15.137:0/2093882425 >> v2:172.21.15.170:3300/0 conn(0x7f38c40d0f60 0x7f38c40d13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.593+0000 7f38c9800640 1 -- 172.21.15.137:0/2093882425 >> v1:172.21.15.137:6789/0 conn(0x7f38c4069b70 legacy=0x7f38c41558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:50.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.593+0000 7f38c9800640 1 -- 172.21.15.137:0/2093882425 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c415cec0 con 0x7f38c415d6c0 2024-04-26T23:41:50.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.593+0000 7f38c3e00640 1 --2- 172.21.15.137:0/2093882425 >> v2:172.21.15.170:3300/0 conn(0x7f38c40d0f60 0x7f38c40d13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:50.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.597+0000 7f38c9800640 1 --2- 172.21.15.137:0/2093882425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38c415d6c0 0x7f38c415db50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f38c40b66c0 tx=0x7f38bc01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f1bfe4771410cc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:50.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.597+0000 7f38c3400640 1 -- 172.21.15.137:0/2093882425 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc0b2070 con 0x7f38c415d6c0 2024-04-26T23:41:50.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.597+0000 7f38c3400640 1 -- 172.21.15.137:0/2093882425 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38bc0a5980 con 0x7f38c415d6c0 2024-04-26T23:41:50.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.597+0000 7f38c3400640 1 -- 172.21.15.137:0/2093882425 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc0a5d30 con 0x7f38c415d6c0 2024-04-26T23:41:50.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.597+0000 7f38cb800640 1 -- 172.21.15.137:0/2093882425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38c415d6c0 msgr2=0x7f38c415db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:50.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.597+0000 7f38cb800640 1 --2- 172.21.15.137:0/2093882425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38c415d6c0 0x7f38c415db50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f38c40b66c0 tx=0x7f38bc01c8a0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.597+0000 7f38cb800640 1 -- 172.21.15.137:0/2093882425 shutdown_connections 2024-04-26T23:41:50.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.597+0000 7f38cb800640 1 --2- 172.21.15.137:0/2093882425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38c415d6c0 0x7f38c415db50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.597+0000 7f38cb800640 1 --2- 172.21.15.137:0/2093882425 >> v2:172.21.15.170:3300/0 conn(0x7f38c40d0f60 0x7f38c40d13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.597+0000 7f38cb800640 1 -- 172.21.15.137:0/2093882425 >> 172.21.15.137:0/2093882425 conn(0x7f38c40b6710 msgr2=0x7f38c40b6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:50.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.597+0000 7f38cb800640 1 -- 172.21.15.137:0/2093882425 shutdown_connections 2024-04-26T23:41:50.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.597+0000 7f38cb800640 1 -- 172.21.15.137:0/2093882425 wait complete. 2024-04-26T23:41:50.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38cb800640 1 Processor -- start 2024-04-26T23:41:50.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38cb800640 1 -- start start 2024-04-26T23:41:50.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38cb800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38c4069b70 0x7f38c414a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:50.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38cb800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38c40d0f60 0x7f38c414aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:50.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38cb800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38c415d6c0 0x7f38c4152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:50.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38cb800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f38c41681d0 con 0x7f38c415d6c0 2024-04-26T23:41:50.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38cb800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f38c4168050 con 0x7f38c4069b70 2024-04-26T23:41:50.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38cb800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f38c4168350 con 0x7f38c40d0f60 2024-04-26T23:41:50.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38c9800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38c415d6c0 0x7f38c4152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:50.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38c9800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38c415d6c0 0x7f38c4152da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45306/0 (socket says 172.21.15.137:45306) 2024-04-26T23:41:50.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38c9800640 1 -- 172.21.15.137:0/2295625567 learned_addr learned my addr 172.21.15.137:0/2295625567 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:50.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38c8e00640 1 --2- 172.21.15.137:0/2295625567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38c4069b70 0x7f38c414a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:50.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38c3e00640 1 --2- 172.21.15.137:0/2295625567 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38c40d0f60 0x7f38c414aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:50.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38c9800640 1 -- 172.21.15.137:0/2295625567 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38c40d0f60 msgr2=0x7f38c414aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:50.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38c9800640 1 --2- 172.21.15.137:0/2295625567 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38c40d0f60 0x7f38c414aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38c9800640 1 -- 172.21.15.137:0/2295625567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38c4069b70 msgr2=0x7f38c414a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:50.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38c9800640 1 --2- 172.21.15.137:0/2295625567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38c4069b70 0x7f38c414a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38c9800640 1 -- 172.21.15.137:0/2295625567 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c414b890 con 0x7f38c415d6c0 2024-04-26T23:41:50.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38c9800640 1 --2- 172.21.15.137:0/2295625567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38c415d6c0 0x7f38c4152da0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0194b0 tx=0x7f38bc019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:50.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38c0c00640 1 -- 172.21.15.137:0/2295625567 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc0bd020 con 0x7f38c415d6c0 2024-04-26T23:41:50.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38c0c00640 1 -- 172.21.15.137:0/2295625567 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38bc0ad870 con 0x7f38c415d6c0 2024-04-26T23:41:50.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38cb800640 1 -- 172.21.15.137:0/2295625567 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c414bb70 con 0x7f38c415d6c0 2024-04-26T23:41:50.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38c0c00640 1 -- 172.21.15.137:0/2295625567 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc0b2040 con 0x7f38c415d6c0 2024-04-26T23:41:50.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38cb800640 1 -- 172.21.15.137:0/2295625567 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c414c130 con 0x7f38c415d6c0 2024-04-26T23:41:50.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.601+0000 7f38cb800640 1 -- 172.21.15.137:0/2295625567 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38c406a410 con 0x7f38c415d6c0 2024-04-26T23:41:50.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.605+0000 7f38c0c00640 1 -- 172.21.15.137:0/2295625567 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f38bc0c0020 con 0x7f38c415d6c0 2024-04-26T23:41:50.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.605+0000 7f38c0c00640 1 --2- 172.21.15.137:0/2295625567 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f38a4068380 0x7f38a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:50.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.605+0000 7f38c0c00640 1 -- 172.21.15.137:0/2295625567 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f38bc1219d0 con 0x7f38c415d6c0 2024-04-26T23:41:50.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.605+0000 7f38c8e00640 1 --2- 172.21.15.137:0/2295625567 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f38a4068380 0x7f38a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:50.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.605+0000 7f38c8e00640 1 --2- 172.21.15.137:0/2295625567 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f38a4068380 0x7f38a406a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f38b8007fd0 tx=0x7f38b8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:50.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.609+0000 7f38c0c00640 1 -- 172.21.15.137:0/2295625567 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f38bc0c7030 con 0x7f38c415d6c0 2024-04-26T23:41:50.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.769+0000 7f38cb800640 1 -- 172.21.15.137:0/2295625567 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f38c40d0910 con 0x7f38c415d6c0 2024-04-26T23:41:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.769+0000 7f38c0c00640 1 -- 172.21.15.137:0/2295625567 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f38bc016520 con 0x7f38c415d6c0 2024-04-26T23:41:50.771 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:41:50.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.769+0000 7f38cb800640 1 -- 172.21.15.137:0/2295625567 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f38a4068380 msgr2=0x7f38a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:50.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.769+0000 7f38cb800640 1 --2- 172.21.15.137:0/2295625567 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f38a4068380 0x7f38a406a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f38b8007fd0 tx=0x7f38b8009040 comp rx=0 tx=0).stop 2024-04-26T23:41:50.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.769+0000 7f38cb800640 1 -- 172.21.15.137:0/2295625567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38c415d6c0 msgr2=0x7f38c4152da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:50.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.769+0000 7f38cb800640 1 --2- 172.21.15.137:0/2295625567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38c415d6c0 0x7f38c4152da0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0194b0 tx=0x7f38bc019640 comp rx=0 tx=0).stop 2024-04-26T23:41:50.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.769+0000 7f38cb800640 1 -- 172.21.15.137:0/2295625567 shutdown_connections 2024-04-26T23:41:50.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.769+0000 7f38cb800640 1 --2- 172.21.15.137:0/2295625567 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f38a4068380 0x7f38a406a840 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.769+0000 7f38cb800640 1 --2- 172.21.15.137:0/2295625567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38c415d6c0 0x7f38c4152da0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.769+0000 7f38cb800640 1 --2- 172.21.15.137:0/2295625567 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38c40d0f60 0x7f38c414aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.769+0000 7f38cb800640 1 --2- 172.21.15.137:0/2295625567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38c4069b70 0x7f38c414a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.769+0000 7f38cb800640 1 -- 172.21.15.137:0/2295625567 >> 172.21.15.137:0/2295625567 conn(0x7f38c40b6710 msgr2=0x7f38c415b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:50.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.769+0000 7f38cb800640 1 -- 172.21.15.137:0/2295625567 shutdown_connections 2024-04-26T23:41:50.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.769+0000 7f38cb800640 1 -- 172.21.15.137:0/2295625567 wait complete. 2024-04-26T23:41:50.792 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:50.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.925+0000 7f668ac00640 1 Processor -- start 2024-04-26T23:41:50.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.925+0000 7f668ac00640 1 -- start start 2024-04-26T23:41:50.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.925+0000 7f668ac00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f66840725a0 0x7f66840cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:50.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.925+0000 7f668ac00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f66840b5080 0x7f6684165930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:50.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.925+0000 7f668ac00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66840cfef0 con 0x7f6684073f30 2024-04-26T23:41:50.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.925+0000 7f668ac00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f66840cddc0 con 0x7f66840725a0 2024-04-26T23:41:50.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.925+0000 7f668ac00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f66840d01b0 con 0x7f66840b5080 2024-04-26T23:41:50.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.929+0000 7f667b400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f6684073f30 0x7f6684072980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49110/0 (socket says 172.21.15.137:49110) 2024-04-26T23:41:50.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.929+0000 7f667b400640 1 -- 172.21.15.137:0/3235269892 learned_addr learned my addr 172.21.15.137:0/3235269892 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:50.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.929+0000 7f6683e00640 1 --2- 172.21.15.137:0/3235269892 >> v2:172.21.15.137:3300/0 conn(0x7f66840725a0 0x7f66840cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:50.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.929+0000 7f6688c00640 1 --2- 172.21.15.137:0/3235269892 >> v2:172.21.15.170:3300/0 conn(0x7f66840b5080 0x7f6684165930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:50.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.929+0000 7f6683e00640 1 -- 172.21.15.137:0/3235269892 >> v2:172.21.15.170:3300/0 conn(0x7f66840b5080 msgr2=0x7f6684165930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:50.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.929+0000 7f6683e00640 1 --2- 172.21.15.137:0/3235269892 >> v2:172.21.15.170:3300/0 conn(0x7f66840b5080 0x7f6684165930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.929+0000 7f6683e00640 1 -- 172.21.15.137:0/3235269892 >> v1:172.21.15.137:6789/0 conn(0x7f6684073f30 legacy=0x7f6684072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:50.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.929+0000 7f6683e00640 1 -- 172.21.15.137:0/3235269892 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66840d0490 con 0x7f66840725a0 2024-04-26T23:41:50.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.929+0000 7f6683400640 1 -- 172.21.15.137:0/3235269892 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1522545633 0 0) 0x7f66840cfef0 con 0x7f6684073f30 2024-04-26T23:41:50.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.929+0000 7f6683e00640 1 --2- 172.21.15.137:0/3235269892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66840725a0 0x7f66840cd770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f66840cdcb0 tx=0x7f666c01e660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6160ab559d9ff358 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:50.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.929+0000 7f6683400640 1 -- 172.21.15.137:0/3235269892 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666c0ad680 con 0x7f66840725a0 2024-04-26T23:41:50.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.929+0000 7f6683400640 1 -- 172.21.15.137:0/3235269892 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f666c0b2070 con 0x7f66840725a0 2024-04-26T23:41:50.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.929+0000 7f6683400640 1 -- 172.21.15.137:0/3235269892 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666c0ada40 con 0x7f66840725a0 2024-04-26T23:41:50.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f668ac00640 1 -- 172.21.15.137:0/3235269892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66840725a0 msgr2=0x7f66840cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:50.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f668ac00640 1 --2- 172.21.15.137:0/3235269892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66840725a0 0x7f66840cd770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f66840cdcb0 tx=0x7f666c01e660 comp rx=0 tx=0).stop 2024-04-26T23:41:50.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f668ac00640 1 -- 172.21.15.137:0/3235269892 shutdown_connections 2024-04-26T23:41:50.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f668ac00640 1 --2- 172.21.15.137:0/3235269892 >> v2:172.21.15.170:3300/0 conn(0x7f66840b5080 0x7f6684165930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f668ac00640 1 --2- 172.21.15.137:0/3235269892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66840725a0 0x7f66840cd770 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f668ac00640 1 -- 172.21.15.137:0/3235269892 >> 172.21.15.137:0/3235269892 conn(0x7f668406c5d0 msgr2=0x7f668406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:50.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f668ac00640 1 -- 172.21.15.137:0/3235269892 shutdown_connections 2024-04-26T23:41:50.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f668ac00640 1 -- 172.21.15.137:0/3235269892 wait complete. 2024-04-26T23:41:50.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f668ac00640 1 Processor -- start 2024-04-26T23:41:50.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f668ac00640 1 -- start start 2024-04-26T23:41:50.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f668ac00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66840725a0 0x7f668415b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:50.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f668ac00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6684073f30 0x7f668413bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:50.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f668ac00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66840b5080 0x7f668413c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:50.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f668ac00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f668406f930 con 0x7f66840b5080 2024-04-26T23:41:50.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f668ac00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f668406f7b0 con 0x7f66840725a0 2024-04-26T23:41:50.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f668ac00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f668406fab0 con 0x7f6684073f30 2024-04-26T23:41:50.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f6688c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66840b5080 0x7f668413c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:50.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f6688c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66840b5080 0x7f668413c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59786/0 (socket says 172.21.15.137:59786) 2024-04-26T23:41:50.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f6688c00640 1 -- 172.21.15.137:0/3910335383 learned_addr learned my addr 172.21.15.137:0/3910335383 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:50.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f6683e00640 1 --2- 172.21.15.137:0/3910335383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66840725a0 0x7f668415b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:50.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f667b400640 1 --2- 172.21.15.137:0/3910335383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6684073f30 0x7f668413bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:50.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f6688c00640 1 -- 172.21.15.137:0/3910335383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6684073f30 msgr2=0x7f668413bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:50.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f6688c00640 1 --2- 172.21.15.137:0/3910335383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6684073f30 0x7f668413bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f6688c00640 1 -- 172.21.15.137:0/3910335383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66840725a0 msgr2=0x7f668415b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:50.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f6688c00640 1 --2- 172.21.15.137:0/3910335383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66840725a0 0x7f668415b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:50.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f6688c00640 1 -- 172.21.15.137:0/3910335383 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f668413a470 con 0x7f66840b5080 2024-04-26T23:41:50.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.933+0000 7f667b400640 1 --2- 172.21.15.137:0/3910335383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6684073f30 0x7f668413bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:50.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.937+0000 7f6688c00640 1 --2- 172.21.15.137:0/3910335383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66840b5080 0x7f668413c250 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f667c00efc0 tx=0x7f667c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:50.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.937+0000 7f6680c00640 1 -- 172.21.15.137:0/3910335383 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f667c018020 con 0x7f66840b5080 2024-04-26T23:41:50.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.937+0000 7f6680c00640 1 -- 172.21.15.137:0/3910335383 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f667c014480 con 0x7f66840b5080 2024-04-26T23:41:50.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.937+0000 7f668ac00640 1 -- 172.21.15.137:0/3910335383 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f668413a750 con 0x7f66840b5080 2024-04-26T23:41:50.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.937+0000 7f6680c00640 1 -- 172.21.15.137:0/3910335383 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f667c014870 con 0x7f66840b5080 2024-04-26T23:41:50.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.937+0000 7f668ac00640 1 -- 172.21.15.137:0/3910335383 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f668413ad10 con 0x7f66840b5080 2024-04-26T23:41:50.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.937+0000 7f668ac00640 1 -- 172.21.15.137:0/3910335383 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f668406a4b0 con 0x7f66840b5080 2024-04-26T23:41:50.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.937+0000 7f6680c00640 1 -- 172.21.15.137:0/3910335383 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f667c01b020 con 0x7f66840b5080 2024-04-26T23:41:50.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.937+0000 7f6680c00640 1 --2- 172.21.15.137:0/3910335383 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6660068380 0x7f666006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:50.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.937+0000 7f6680c00640 1 -- 172.21.15.137:0/3910335383 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f667c087990 con 0x7f66840b5080 2024-04-26T23:41:50.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.937+0000 7f6683e00640 1 --2- 172.21.15.137:0/3910335383 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6660068380 0x7f666006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:50.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.937+0000 7f6683e00640 1 --2- 172.21.15.137:0/3910335383 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6660068380 0x7f666006a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f666c0b1000 tx=0x7f666c0a9000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:50.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:50.941+0000 7f6680c00640 1 -- 172.21.15.137:0/3910335383 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f667c022030 con 0x7f66840b5080 2024-04-26T23:41:51.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.097+0000 7f668ac00640 1 -- 172.21.15.137:0/3910335383 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66840cd3a0 con 0x7f66840b5080 2024-04-26T23:41:51.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.101+0000 7f6680c00640 1 -- 172.21.15.137:0/3910335383 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16653 (secure 0 0 0) 0x7f667c010040 con 0x7f66840b5080 2024-04-26T23:41:51.103 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:51.103 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:25.186308+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:51.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.101+0000 7f668ac00640 1 -- 172.21.15.137:0/3910335383 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6660068380 msgr2=0x7f666006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:51.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.101+0000 7f668ac00640 1 --2- 172.21.15.137:0/3910335383 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6660068380 0x7f666006a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f666c0b1000 tx=0x7f666c0a9000 comp rx=0 tx=0).stop 2024-04-26T23:41:51.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.101+0000 7f668ac00640 1 -- 172.21.15.137:0/3910335383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66840b5080 msgr2=0x7f668413c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:51.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.101+0000 7f668ac00640 1 --2- 172.21.15.137:0/3910335383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66840b5080 0x7f668413c250 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f667c00efc0 tx=0x7f667c00c490 comp rx=0 tx=0).stop 2024-04-26T23:41:51.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.101+0000 7f668ac00640 1 -- 172.21.15.137:0/3910335383 shutdown_connections 2024-04-26T23:41:51.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.101+0000 7f668ac00640 1 --2- 172.21.15.137:0/3910335383 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6660068380 0x7f666006a840 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.101+0000 7f668ac00640 1 --2- 172.21.15.137:0/3910335383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66840b5080 0x7f668413c250 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.101+0000 7f668ac00640 1 --2- 172.21.15.137:0/3910335383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6684073f30 0x7f668413bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.101+0000 7f668ac00640 1 --2- 172.21.15.137:0/3910335383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66840725a0 0x7f668415b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.101+0000 7f668ac00640 1 -- 172.21.15.137:0/3910335383 >> 172.21.15.137:0/3910335383 conn(0x7f668406c5d0 msgr2=0x7f6684142510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:51.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.101+0000 7f668ac00640 1 -- 172.21.15.137:0/3910335383 shutdown_connections 2024-04-26T23:41:51.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.101+0000 7f668ac00640 1 -- 172.21.15.137:0/3910335383 wait complete. 2024-04-26T23:41:51.124 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:41:21.810449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:41:22.533452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:41:51.124 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:41:51.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.257+0000 7faed1600640 1 Processor -- start 2024-04-26T23:41:51.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.257+0000 7faed1600640 1 -- start start 2024-04-26T23:41:51.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faed1600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7faecc1560c0 0x7faecc0cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faed1600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faecc0cfb60 con 0x7faecc141b40 2024-04-26T23:41:51.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faed1600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faecc0cfe40 con 0x7faecc1564a0 2024-04-26T23:41:51.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faed1600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7faecc0cf900 con 0x7faecc1560c0 2024-04-26T23:41:51.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faecb400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7faecc141b40 0x7faecc0b4000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49112/0 (socket says 172.21.15.137:49112) 2024-04-26T23:41:51.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faecb400640 1 -- 172.21.15.137:0/2521500886 learned_addr learned my addr 172.21.15.137:0/2521500886 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:51.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faec9600640 1 -- 172.21.15.137:0/2521500886 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277624247 0 0) 0x7faecc0cfb60 con 0x7faecc141b40 2024-04-26T23:41:51.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faecaa00640 1 --2- 172.21.15.137:0/2521500886 >> v2:172.21.15.170:3300/0 conn(0x7faecc1560c0 0x7faecc0cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faec9600640 1 -- 172.21.15.137:0/2521500886 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faeb0005740 con 0x7faecc141b40 2024-04-26T23:41:51.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faec9600640 1 -- 172.21.15.137:0/2521500886 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3170724964 0 0) 0x7faeb0005740 con 0x7faecc141b40 2024-04-26T23:41:51.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faec9600640 1 -- 172.21.15.137:0/2521500886 >> v2:172.21.15.170:3300/0 conn(0x7faecc1560c0 msgr2=0x7faecc0cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:51.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faec9600640 1 --2- 172.21.15.137:0/2521500886 >> v2:172.21.15.170:3300/0 conn(0x7faecc1560c0 0x7faecc0cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faec9600640 1 -- 172.21.15.137:0/2521500886 >> v1:172.21.15.170:6789/0 conn(0x7faecc1564a0 legacy=0x7faecc141430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:51.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faec9600640 1 -- 172.21.15.137:0/2521500886 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faecc0d0120 con 0x7faecc141b40 2024-04-26T23:41:51.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faec9600640 1 -- 172.21.15.137:0/2521500886 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7faec4001a00 con 0x7faecc141b40 2024-04-26T23:41:51.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faec9600640 1 -- 172.21.15.137:0/2521500886 >> v1:172.21.15.137:6789/0 conn(0x7faecc141b40 legacy=0x7faecc0b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:51.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faec9600640 1 --2- 172.21.15.137:0/2521500886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faeb0005bd0 0x7faeb0005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faec9600640 1 --2- 172.21.15.137:0/2521500886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb0006a20 0x7faeb0006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faec9600640 1 --2- 172.21.15.137:0/2521500886 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faeb00073e0 0x7faeb000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faec9600640 1 -- 172.21.15.137:0/2521500886 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faecc0cf900 con 0x7faeb0006a20 2024-04-26T23:41:51.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faec9600640 1 -- 172.21.15.137:0/2521500886 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faeb000e280 con 0x7faeb0005bd0 2024-04-26T23:41:51.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faec9600640 1 -- 172.21.15.137:0/2521500886 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faeb000e480 con 0x7faeb00073e0 2024-04-26T23:41:51.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faeca000640 1 --2- 172.21.15.137:0/2521500886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb0006a20 0x7faeb0006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faecaa00640 1 --2- 172.21.15.137:0/2521500886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faeb0005bd0 0x7faeb0005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faecb400640 1 --2- 172.21.15.137:0/2521500886 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faeb00073e0 0x7faeb000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faeca000640 1 -- 172.21.15.137:0/2521500886 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faeb00073e0 msgr2=0x7faeb000dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:51.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faeca000640 1 --2- 172.21.15.137:0/2521500886 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faeb00073e0 0x7faeb000dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faeca000640 1 -- 172.21.15.137:0/2521500886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faeb0005bd0 msgr2=0x7faeb0005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:51.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faeca000640 1 --2- 172.21.15.137:0/2521500886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faeb0005bd0 0x7faeb0005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faeca000640 1 -- 172.21.15.137:0/2521500886 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb0005740 con 0x7faeb0006a20 2024-04-26T23:41:51.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.261+0000 7faecb400640 1 -- 172.21.15.137:0/2521500886 reap_dead start 2024-04-26T23:41:51.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.265+0000 7faeca000640 1 --2- 172.21.15.137:0/2521500886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb0006a20 0x7faeb0006ea0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faeb8001780 tx=0x7faeb801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18829cf56c135a42 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:51.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.265+0000 7faec9600640 1 -- 172.21.15.137:0/2521500886 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb80013a0 con 0x7faeb0006a20 2024-04-26T23:41:51.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.265+0000 7faec9600640 1 -- 172.21.15.137:0/2521500886 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb80a9070 con 0x7faeb0006a20 2024-04-26T23:41:51.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.265+0000 7faec9600640 1 -- 172.21.15.137:0/2521500886 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb8003600 con 0x7faeb0006a20 2024-04-26T23:41:51.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.265+0000 7faed1600640 1 -- 172.21.15.137:0/2521500886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb0006a20 msgr2=0x7faeb0006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:51.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.265+0000 7faed1600640 1 --2- 172.21.15.137:0/2521500886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb0006a20 0x7faeb0006ea0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faeb8001780 tx=0x7faeb801c420 comp rx=0 tx=0).stop 2024-04-26T23:41:51.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.265+0000 7faed1600640 1 -- 172.21.15.137:0/2521500886 shutdown_connections 2024-04-26T23:41:51.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.265+0000 7faed1600640 1 --2- 172.21.15.137:0/2521500886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb0006a20 0x7faeb0006ea0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.265+0000 7faed1600640 1 -- 172.21.15.137:0/2521500886 >> 172.21.15.137:0/2521500886 conn(0x7faecc06c800 msgr2=0x7faecc06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:51.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.265+0000 7faed1600640 1 -- 172.21.15.137:0/2521500886 shutdown_connections 2024-04-26T23:41:51.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.265+0000 7faed1600640 1 -- 172.21.15.137:0/2521500886 wait complete. 2024-04-26T23:41:51.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faed1600640 1 Processor -- start 2024-04-26T23:41:51.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faed1600640 1 -- start start 2024-04-26T23:41:51.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faed1600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faeb0006a20 0x7faecc13b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faed1600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faecc151630 0x7faecc159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faed1600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faecc153520 0x7faecc15a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faed1600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faecc0cf3c0 con 0x7faecc151630 2024-04-26T23:41:51.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faed1600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faecc0d06e0 con 0x7faeb0006a20 2024-04-26T23:41:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faed1600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faecc0cf540 con 0x7faecc153520 2024-04-26T23:41:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faeca000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faecc151630 0x7faecc159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faeca000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faecc151630 0x7faecc159f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59810/0 (socket says 172.21.15.137:59810) 2024-04-26T23:41:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faeca000640 1 -- 172.21.15.137:0/2523397396 learned_addr learned my addr 172.21.15.137:0/2523397396 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faecaa00640 1 --2- 172.21.15.137:0/2523397396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faeb0006a20 0x7faecc13b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faecb400640 1 --2- 172.21.15.137:0/2523397396 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faecc153520 0x7faecc15a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faeca000640 1 -- 172.21.15.137:0/2523397396 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faecc153520 msgr2=0x7faecc15a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faeca000640 1 --2- 172.21.15.137:0/2523397396 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faecc153520 0x7faecc15a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faeca000640 1 -- 172.21.15.137:0/2523397396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faeb0006a20 msgr2=0x7faecc13b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faeca000640 1 --2- 172.21.15.137:0/2523397396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faeb0006a20 0x7faecc13b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faeca000640 1 -- 172.21.15.137:0/2523397396 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faecc13bbc0 con 0x7faecc151630 2024-04-26T23:41:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faeca000640 1 --2- 172.21.15.137:0/2523397396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faecc151630 0x7faecc159f10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faeb8005040 tx=0x7faeb0007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faec2a00640 1 -- 172.21.15.137:0/2523397396 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb8007a40 con 0x7faecc151630 2024-04-26T23:41:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faec2a00640 1 -- 172.21.15.137:0/2523397396 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb80bb070 con 0x7faecc151630 2024-04-26T23:41:51.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faed1600640 1 -- 172.21.15.137:0/2523397396 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faecc0b50f0 con 0x7faecc151630 2024-04-26T23:41:51.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faec2a00640 1 -- 172.21.15.137:0/2523397396 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb8007440 con 0x7faecc151630 2024-04-26T23:41:51.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faed1600640 1 -- 172.21.15.137:0/2523397396 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faecc15ecd0 con 0x7faecc151630 2024-04-26T23:41:51.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.269+0000 7faed1600640 1 -- 172.21.15.137:0/2523397396 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faecc06a410 con 0x7faecc151630 2024-04-26T23:41:51.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.273+0000 7faec2a00640 1 -- 172.21.15.137:0/2523397396 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faeb80b5070 con 0x7faecc151630 2024-04-26T23:41:51.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.273+0000 7faec2a00640 1 --2- 172.21.15.137:0/2523397396 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7faeac068380 0x7faeac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.273+0000 7faec2a00640 1 -- 172.21.15.137:0/2523397396 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faeb8120450 con 0x7faecc151630 2024-04-26T23:41:51.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.273+0000 7faecaa00640 1 --2- 172.21.15.137:0/2523397396 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7faeac068380 0x7faeac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.273+0000 7faecaa00640 1 --2- 172.21.15.137:0/2523397396 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7faeac068380 0x7faeac06a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faecc074ff0 tx=0x7faebc009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:51.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.277+0000 7faec2a00640 1 -- 172.21.15.137:0/2523397396 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7faeb80c5020 con 0x7faecc151630 2024-04-26T23:41:51.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.433+0000 7faed1600640 1 -- 172.21.15.137:0/2523397396 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faecc13dfc0 con 0x7faecc151630 2024-04-26T23:41:51.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.433+0000 7faec2a00640 1 -- 172.21.15.137:0/2523397396 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7faeb8016130 con 0x7faecc151630 2024-04-26T23:41:51.437 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:41:51.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.437+0000 7faed1600640 1 -- 172.21.15.137:0/2523397396 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7faeac068380 msgr2=0x7faeac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:51.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.437+0000 7faed1600640 1 --2- 172.21.15.137:0/2523397396 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7faeac068380 0x7faeac06a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faecc074ff0 tx=0x7faebc009190 comp rx=0 tx=0).stop 2024-04-26T23:41:51.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.437+0000 7faed1600640 1 -- 172.21.15.137:0/2523397396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faecc151630 msgr2=0x7faecc159f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:51.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.437+0000 7faed1600640 1 --2- 172.21.15.137:0/2523397396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faecc151630 0x7faecc159f10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faeb8005040 tx=0x7faeb0007a50 comp rx=0 tx=0).stop 2024-04-26T23:41:51.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.437+0000 7faed1600640 1 -- 172.21.15.137:0/2523397396 shutdown_connections 2024-04-26T23:41:51.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.437+0000 7faed1600640 1 --2- 172.21.15.137:0/2523397396 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7faeac068380 0x7faeac06a840 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.437+0000 7faed1600640 1 --2- 172.21.15.137:0/2523397396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faecc151630 0x7faecc159f10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.437+0000 7faed1600640 1 --2- 172.21.15.137:0/2523397396 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faecc153520 0x7faecc15a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.437+0000 7faed1600640 1 --2- 172.21.15.137:0/2523397396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faeb0006a20 0x7faecc13b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.437+0000 7faed1600640 1 -- 172.21.15.137:0/2523397396 >> 172.21.15.137:0/2523397396 conn(0x7faecc06c800 msgr2=0x7faecc13cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:51.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.437+0000 7faed1600640 1 -- 172.21.15.137:0/2523397396 shutdown_connections 2024-04-26T23:41:51.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.437+0000 7faed1600640 1 -- 172.21.15.137:0/2523397396 wait complete. 2024-04-26T23:41:51.458 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:41:51.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.593+0000 7f7c27c00640 1 Processor -- start 2024-04-26T23:41:51.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.593+0000 7f7c27c00640 1 -- start start 2024-04-26T23:41:51.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.597+0000 7f7c27c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c20073f20 0x7f7c2015df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.597+0000 7f7c27c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7c200affa0 0x7f7c200ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.597+0000 7f7c27c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c20072860 con 0x7f7c200afbc0 2024-04-26T23:41:51.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.597+0000 7f7c27c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7c200743b0 con 0x7f7c200affa0 2024-04-26T23:41:51.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.597+0000 7f7c27c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7c20072b00 con 0x7f7c20073f20 2024-04-26T23:41:51.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.597+0000 7f7c25c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7c200affa0 0x7f7c200ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.597+0000 7f7c25200640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f7c200afbc0 0x7f7c200735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49114/0 (socket says 172.21.15.137:49114) 2024-04-26T23:41:51.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.597+0000 7f7c25200640 1 -- 172.21.15.137:0/3336774804 learned_addr learned my addr 172.21.15.137:0/3336774804 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:51.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.597+0000 7f7c17e00640 1 --2- 172.21.15.137:0/3336774804 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c20073f20 0x7f7c2015df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.597+0000 7f7c25c00640 1 -- 172.21.15.137:0/3336774804 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c20073f20 msgr2=0x7f7c2015df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:51.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.597+0000 7f7c25c00640 1 --2- 172.21.15.137:0/3336774804 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c20073f20 0x7f7c2015df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.597+0000 7f7c25c00640 1 -- 172.21.15.137:0/3336774804 >> v1:172.21.15.137:6789/0 conn(0x7f7c200afbc0 legacy=0x7f7c200735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:51.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.597+0000 7f7c25c00640 1 -- 172.21.15.137:0/3336774804 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c20072de0 con 0x7f7c200affa0 2024-04-26T23:41:51.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.597+0000 7f7c17e00640 1 --2- 172.21.15.137:0/3336774804 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c20073f20 0x7f7c2015df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:51.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c25c00640 1 --2- 172.21.15.137:0/3336774804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c200affa0 0x7f7c200ce3b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7c18009d90 tx=0x7f7c1801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdcb19a64ad97418 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:51.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c1fe00640 1 -- 172.21.15.137:0/3336774804 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c180b2070 con 0x7f7c200affa0 2024-04-26T23:41:51.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c1fe00640 1 -- 172.21.15.137:0/3336774804 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c180a5830 con 0x7f7c200affa0 2024-04-26T23:41:51.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c1fe00640 1 -- 172.21.15.137:0/3336774804 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c180a5c00 con 0x7f7c200affa0 2024-04-26T23:41:51.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c27c00640 1 -- 172.21.15.137:0/3336774804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c200affa0 msgr2=0x7f7c200ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:51.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c27c00640 1 --2- 172.21.15.137:0/3336774804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c200affa0 0x7f7c200ce3b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7c18009d90 tx=0x7f7c1801c970 comp rx=0 tx=0).stop 2024-04-26T23:41:51.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c27c00640 1 -- 172.21.15.137:0/3336774804 shutdown_connections 2024-04-26T23:41:51.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c27c00640 1 --2- 172.21.15.137:0/3336774804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c200affa0 0x7f7c200ce3b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c27c00640 1 --2- 172.21.15.137:0/3336774804 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c20073f20 0x7f7c2015df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c27c00640 1 -- 172.21.15.137:0/3336774804 >> 172.21.15.137:0/3336774804 conn(0x7f7c2006c800 msgr2=0x7f7c2006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:51.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c27c00640 1 -- 172.21.15.137:0/3336774804 shutdown_connections 2024-04-26T23:41:51.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c27c00640 1 -- 172.21.15.137:0/3336774804 wait complete. 2024-04-26T23:41:51.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c27c00640 1 Processor -- start 2024-04-26T23:41:51.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c27c00640 1 -- start start 2024-04-26T23:41:51.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c27c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c200afbc0 0x7f7c20147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c27c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c200affa0 0x7f7c2014b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c27c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c201363c0 0x7f7c20150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c27c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2006f3a0 con 0x7f7c200afbc0 2024-04-26T23:41:51.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c27c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2006f220 con 0x7f7c200affa0 2024-04-26T23:41:51.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c27c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7c2006f520 con 0x7f7c201363c0 2024-04-26T23:41:51.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c25200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c200afbc0 0x7f7c20147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c25200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c200afbc0 0x7f7c20147ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59824/0 (socket says 172.21.15.137:59824) 2024-04-26T23:41:51.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.601+0000 7f7c25200640 1 -- 172.21.15.137:0/1817345755 learned_addr learned my addr 172.21.15.137:0/1817345755 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:51.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.605+0000 7f7c17e00640 1 --2- 172.21.15.137:0/1817345755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c200affa0 0x7f7c2014b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.605+0000 7f7c25c00640 1 --2- 172.21.15.137:0/1817345755 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c201363c0 0x7f7c20150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.605+0000 7f7c25200640 1 -- 172.21.15.137:0/1817345755 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c201363c0 msgr2=0x7f7c20150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:51.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.605+0000 7f7c25200640 1 --2- 172.21.15.137:0/1817345755 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c201363c0 0x7f7c20150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.605+0000 7f7c25200640 1 -- 172.21.15.137:0/1817345755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c200affa0 msgr2=0x7f7c2014b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:51.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.605+0000 7f7c25200640 1 --2- 172.21.15.137:0/1817345755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c200affa0 0x7f7c2014b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.605+0000 7f7c25200640 1 -- 172.21.15.137:0/1817345755 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c2014e6b0 con 0x7f7c200afbc0 2024-04-26T23:41:51.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.605+0000 7f7c17e00640 1 --2- 172.21.15.137:0/1817345755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c200affa0 0x7f7c2014b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:51.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.605+0000 7f7c25c00640 1 --2- 172.21.15.137:0/1817345755 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c201363c0 0x7f7c20150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:51.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.605+0000 7f7c25200640 1 --2- 172.21.15.137:0/1817345755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c200afbc0 0x7f7c20147ac0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000c450 tx=0x7f7c1000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:51.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.605+0000 7f7c1d600640 1 -- 172.21.15.137:0/1817345755 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c10017070 con 0x7f7c200afbc0 2024-04-26T23:41:51.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.605+0000 7f7c1d600640 1 -- 172.21.15.137:0/1817345755 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c10005cf0 con 0x7f7c200afbc0 2024-04-26T23:41:51.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.605+0000 7f7c1d600640 1 -- 172.21.15.137:0/1817345755 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c10007290 con 0x7f7c200afbc0 2024-04-26T23:41:51.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.605+0000 7f7c27c00640 1 -- 172.21.15.137:0/1817345755 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c2014e990 con 0x7f7c200afbc0 2024-04-26T23:41:51.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.605+0000 7f7c27c00640 1 -- 172.21.15.137:0/1817345755 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c2014ef50 con 0x7f7c200afbc0 2024-04-26T23:41:51.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.605+0000 7f7c27c00640 1 -- 172.21.15.137:0/1817345755 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c2006a410 con 0x7f7c200afbc0 2024-04-26T23:41:51.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.605+0000 7f7c1d600640 1 -- 172.21.15.137:0/1817345755 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7c1001a070 con 0x7f7c200afbc0 2024-04-26T23:41:51.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.609+0000 7f7c1d600640 1 --2- 172.21.15.137:0/1817345755 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7bfc0683b0 0x7f7bfc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.609+0000 7f7c1d600640 1 -- 172.21.15.137:0/1817345755 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7c10085c40 con 0x7f7c200afbc0 2024-04-26T23:41:51.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.609+0000 7f7c17e00640 1 --2- 172.21.15.137:0/1817345755 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7bfc0683b0 0x7f7bfc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.609+0000 7f7c17e00640 1 --2- 172.21.15.137:0/1817345755 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7bfc0683b0 0x7f7bfc06a870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009970 tx=0x7f7c08008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:51.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.613+0000 7f7c1d600640 1 -- 172.21.15.137:0/1817345755 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7c100561f0 con 0x7f7c200afbc0 2024-04-26T23:41:51.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.769+0000 7f7c27c00640 1 -- 172.21.15.137:0/1817345755 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7c20160870 con 0x7f7c200afbc0 2024-04-26T23:41:51.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.769+0000 7f7c1d600640 1 -- 172.21.15.137:0/1817345755 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f7c10055af0 con 0x7f7c200afbc0 2024-04-26T23:41:51.774 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:41:51.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.773+0000 7f7c27c00640 1 -- 172.21.15.137:0/1817345755 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7bfc0683b0 msgr2=0x7f7bfc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:51.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.773+0000 7f7c27c00640 1 --2- 172.21.15.137:0/1817345755 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7bfc0683b0 0x7f7bfc06a870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009970 tx=0x7f7c08008040 comp rx=0 tx=0).stop 2024-04-26T23:41:51.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.773+0000 7f7c27c00640 1 -- 172.21.15.137:0/1817345755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c200afbc0 msgr2=0x7f7c20147ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:51.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.773+0000 7f7c27c00640 1 --2- 172.21.15.137:0/1817345755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c200afbc0 0x7f7c20147ac0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000c450 tx=0x7f7c1000c910 comp rx=0 tx=0).stop 2024-04-26T23:41:51.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.773+0000 7f7c27c00640 1 -- 172.21.15.137:0/1817345755 shutdown_connections 2024-04-26T23:41:51.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.773+0000 7f7c27c00640 1 --2- 172.21.15.137:0/1817345755 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7bfc0683b0 0x7f7bfc06a870 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.773+0000 7f7c27c00640 1 --2- 172.21.15.137:0/1817345755 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c201363c0 0x7f7c20150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.773+0000 7f7c27c00640 1 --2- 172.21.15.137:0/1817345755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c200affa0 0x7f7c2014b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.773+0000 7f7c27c00640 1 --2- 172.21.15.137:0/1817345755 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c200afbc0 0x7f7c20147ac0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.773+0000 7f7c27c00640 1 -- 172.21.15.137:0/1817345755 >> 172.21.15.137:0/1817345755 conn(0x7f7c2006c800 msgr2=0x7f7c200b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:51.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.773+0000 7f7c27c00640 1 -- 172.21.15.137:0/1817345755 shutdown_connections 2024-04-26T23:41:51.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.773+0000 7f7c27c00640 1 -- 172.21.15.137:0/1817345755 wait complete. 2024-04-26T23:41:51.795 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:41:51.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.929+0000 7faeb0200640 1 Processor -- start 2024-04-26T23:41:51.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.929+0000 7faeb0200640 1 -- start start 2024-04-26T23:41:51.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.929+0000 7faeb0200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faea80afbc0 0x7faea815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.929+0000 7faeb0200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7faea80affa0 0x7faea80ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.929+0000 7faeb0200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faea8072860 con 0x7faea8073f20 2024-04-26T23:41:51.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.929+0000 7faeb0200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7faea80743b0 con 0x7faea80affa0 2024-04-26T23:41:51.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.929+0000 7faeb0200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faea8072b00 con 0x7faea80afbc0 2024-04-26T23:41:51.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.929+0000 7faeace00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7faea8073f20 0x7faea80735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49124/0 (socket says 172.21.15.137:49124) 2024-04-26T23:41:51.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.929+0000 7faeace00640 1 -- 172.21.15.137:0/3494754851 learned_addr learned my addr 172.21.15.137:0/3494754851 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:51.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.929+0000 7faead800640 1 --2- 172.21.15.137:0/3494754851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faea80afbc0 0x7faea815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.929+0000 7faeae200640 1 --2- 172.21.15.137:0/3494754851 >> v2:172.21.15.170:3300/0 conn(0x7faea80affa0 0x7faea80ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.929+0000 7faea7e00640 1 -- 172.21.15.137:0/3494754851 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3690174636 0 0) 0x7faea8072860 con 0x7faea8073f20 2024-04-26T23:41:51.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.929+0000 7faea7e00640 1 -- 172.21.15.137:0/3494754851 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae90003530 con 0x7faea8073f20 2024-04-26T23:41:51.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.929+0000 7faea7e00640 1 -- 172.21.15.137:0/3494754851 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2516963164 0 0) 0x7fae90003530 con 0x7faea8073f20 2024-04-26T23:41:51.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.929+0000 7faea7e00640 1 -- 172.21.15.137:0/3494754851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faea80afbc0 msgr2=0x7faea815df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:51.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.929+0000 7faea7e00640 1 --2- 172.21.15.137:0/3494754851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faea80afbc0 0x7faea815df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.929+0000 7faea7e00640 1 -- 172.21.15.137:0/3494754851 >> v2:172.21.15.170:3300/0 conn(0x7faea80affa0 msgr2=0x7faea80ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:51.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.929+0000 7faea7e00640 1 --2- 172.21.15.137:0/3494754851 >> v2:172.21.15.170:3300/0 conn(0x7faea80affa0 0x7faea80ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.929+0000 7faea7e00640 1 -- 172.21.15.137:0/3494754851 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea8072de0 con 0x7faea8073f20 2024-04-26T23:41:51.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.929+0000 7faea7e00640 1 -- 172.21.15.137:0/3494754851 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fae94001680 con 0x7faea8073f20 2024-04-26T23:41:51.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.929+0000 7faea7e00640 1 -- 172.21.15.137:0/3494754851 >> v1:172.21.15.137:6789/0 conn(0x7faea8073f20 legacy=0x7faea80735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:51.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.933+0000 7faea7e00640 1 --2- 172.21.15.137:0/3494754851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae900039c0 0x7fae90003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.933+0000 7faea7e00640 1 --2- 172.21.15.137:0/3494754851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae90004810 0x7fae90004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.933+0000 7faea7e00640 1 --2- 172.21.15.137:0/3494754851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faea80afbc0 0x7fae900051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.933+0000 7faea7e00640 1 -- 172.21.15.137:0/3494754851 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faea80743b0 con 0x7fae90004810 2024-04-26T23:41:51.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.933+0000 7faea7e00640 1 -- 172.21.15.137:0/3494754851 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faea8072b00 con 0x7fae900039c0 2024-04-26T23:41:51.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.933+0000 7faea7e00640 1 -- 172.21.15.137:0/3494754851 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fae9000b9d0 con 0x7faea80afbc0 2024-04-26T23:41:51.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.933+0000 7faeace00640 1 --2- 172.21.15.137:0/3494754851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae90004810 0x7fae90004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.933+0000 7faead800640 1 --2- 172.21.15.137:0/3494754851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae900039c0 0x7fae90003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.933+0000 7faeae200640 1 --2- 172.21.15.137:0/3494754851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faea80afbc0 0x7fae900051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.933+0000 7faeace00640 1 -- 172.21.15.137:0/3494754851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faea80afbc0 msgr2=0x7fae900051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:51.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.933+0000 7faeace00640 1 --2- 172.21.15.137:0/3494754851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faea80afbc0 0x7fae900051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.933+0000 7faeace00640 1 -- 172.21.15.137:0/3494754851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae900039c0 msgr2=0x7fae90003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:51.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.933+0000 7faeace00640 1 --2- 172.21.15.137:0/3494754851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae900039c0 0x7fae90003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.933+0000 7faeace00640 1 -- 172.21.15.137:0/3494754851 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae90003530 con 0x7fae90004810 2024-04-26T23:41:51.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.933+0000 7faead800640 1 --2- 172.21.15.137:0/3494754851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae900039c0 0x7fae90003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:41:51.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.933+0000 7faeace00640 1 --2- 172.21.15.137:0/3494754851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae90004810 0x7fae90004c90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fae9400c240 tx=0x7fae9401f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f4433eaf07d36a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:51.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.933+0000 7faea7e00640 1 -- 172.21.15.137:0/3494754851 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae94007d40 con 0x7fae90004810 2024-04-26T23:41:51.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.933+0000 7faea7e00640 1 -- 172.21.15.137:0/3494754851 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae94005b00 con 0x7fae90004810 2024-04-26T23:41:51.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.933+0000 7faea7e00640 1 -- 172.21.15.137:0/3494754851 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae94007070 con 0x7fae90004810 2024-04-26T23:41:51.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeb0200640 1 -- 172.21.15.137:0/3494754851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae90004810 msgr2=0x7fae90004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:51.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeb0200640 1 --2- 172.21.15.137:0/3494754851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae90004810 0x7fae90004c90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fae9400c240 tx=0x7fae9401f410 comp rx=0 tx=0).stop 2024-04-26T23:41:51.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeae200640 1 -- 172.21.15.137:0/3494754851 reap_dead start 2024-04-26T23:41:51.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeb0200640 1 -- 172.21.15.137:0/3494754851 shutdown_connections 2024-04-26T23:41:51.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeb0200640 1 -- 172.21.15.137:0/3494754851 >> 172.21.15.137:0/3494754851 conn(0x7faea806c800 msgr2=0x7faea806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:51.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeb0200640 1 -- 172.21.15.137:0/3494754851 shutdown_connections 2024-04-26T23:41:51.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeb0200640 1 -- 172.21.15.137:0/3494754851 wait complete. 2024-04-26T23:41:51.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeb0200640 1 Processor -- start 2024-04-26T23:41:51.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeb0200640 1 -- start start 2024-04-26T23:41:51.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeb0200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae90004810 0x7faea8142b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeb0200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faea80b52c0 0x7faea813f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeb0200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faea80ae8d0 0x7faea80aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeb0200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faea80ce8f0 con 0x7faea80ae8d0 2024-04-26T23:41:51.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeb0200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faea80d0850 con 0x7fae90004810 2024-04-26T23:41:51.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeb0200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faea80cea70 con 0x7faea80b52c0 2024-04-26T23:41:51.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeae200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faea80ae8d0 0x7faea80aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeae200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faea80ae8d0 0x7faea80aed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59842/0 (socket says 172.21.15.137:59842) 2024-04-26T23:41:51.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeae200640 1 -- 172.21.15.137:0/3969474287 learned_addr learned my addr 172.21.15.137:0/3969474287 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:51.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faead800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae90004810 0x7faea8142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeace00640 1 --2- 172.21.15.137:0/3969474287 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faea80b52c0 0x7faea813f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeae200640 1 -- 172.21.15.137:0/3969474287 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faea80b52c0 msgr2=0x7faea813f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:51.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeae200640 1 --2- 172.21.15.137:0/3969474287 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faea80b52c0 0x7faea813f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeae200640 1 -- 172.21.15.137:0/3969474287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae90004810 msgr2=0x7faea8142b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:51.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeae200640 1 --2- 172.21.15.137:0/3969474287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae90004810 0x7faea8142b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:51.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.937+0000 7faeae200640 1 -- 172.21.15.137:0/3969474287 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea80b5740 con 0x7faea80ae8d0 2024-04-26T23:41:51.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.941+0000 7faeae200640 1 --2- 172.21.15.137:0/3969474287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faea80ae8d0 0x7faea80aed80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faea80cd690 tx=0x7faea000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:51.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.941+0000 7faea5600640 1 -- 172.21.15.137:0/3969474287 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c0096b0 con 0x7faea80ae8d0 2024-04-26T23:41:51.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.941+0000 7faea5600640 1 -- 172.21.15.137:0/3969474287 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faea001c070 con 0x7faea80ae8d0 2024-04-26T23:41:51.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.941+0000 7faeb0200640 1 -- 172.21.15.137:0/3969474287 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea80b5a10 con 0x7faea80ae8d0 2024-04-26T23:41:51.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.941+0000 7faea5600640 1 -- 172.21.15.137:0/3969474287 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea000fb10 con 0x7faea80ae8d0 2024-04-26T23:41:51.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.941+0000 7faeb0200640 1 -- 172.21.15.137:0/3969474287 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea814e8f0 con 0x7faea80ae8d0 2024-04-26T23:41:51.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.941+0000 7faeb0200640 1 -- 172.21.15.137:0/3969474287 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faea814e6e0 con 0x7faea80ae8d0 2024-04-26T23:41:51.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.941+0000 7faea5600640 1 -- 172.21.15.137:0/3969474287 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faea000fcb0 con 0x7faea80ae8d0 2024-04-26T23:41:51.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.941+0000 7faea5600640 1 --2- 172.21.15.137:0/3969474287 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fae880683b0 0x7fae8806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:51.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.941+0000 7faea5600640 1 -- 172.21.15.137:0/3969474287 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faea0087150 con 0x7faea80ae8d0 2024-04-26T23:41:51.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.941+0000 7faead800640 1 --2- 172.21.15.137:0/3969474287 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fae880683b0 0x7fae8806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:51.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.945+0000 7faead800640 1 --2- 172.21.15.137:0/3969474287 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fae880683b0 0x7fae8806a870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faea815f230 tx=0x7fae9c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:51.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:51.945+0000 7faea5600640 1 -- 172.21.15.137:0/3969474287 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7faea0010040 con 0x7faea80ae8d0 2024-04-26T23:41:52.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.101+0000 7faeb0200640 1 -- 172.21.15.137:0/3969474287 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7faea806a410 con 0x7faea80ae8d0 2024-04-26T23:41:52.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.105+0000 7faea5600640 1 -- 172.21.15.137:0/3969474287 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7faea0057670 con 0x7faea80ae8d0 2024-04-26T23:41:52.107 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:41:52.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.105+0000 7faeb0200640 1 -- 172.21.15.137:0/3969474287 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fae880683b0 msgr2=0x7fae8806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:52.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.105+0000 7faeb0200640 1 --2- 172.21.15.137:0/3969474287 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fae880683b0 0x7fae8806a870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faea815f230 tx=0x7fae9c009190 comp rx=0 tx=0).stop 2024-04-26T23:41:52.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.105+0000 7faeb0200640 1 -- 172.21.15.137:0/3969474287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faea80ae8d0 msgr2=0x7faea80aed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:52.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.105+0000 7faeb0200640 1 --2- 172.21.15.137:0/3969474287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faea80ae8d0 0x7faea80aed80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faea80cd690 tx=0x7faea000f1b0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.105+0000 7faeb0200640 1 -- 172.21.15.137:0/3969474287 shutdown_connections 2024-04-26T23:41:52.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.105+0000 7faeb0200640 1 --2- 172.21.15.137:0/3969474287 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fae880683b0 0x7fae8806a870 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.105+0000 7faeb0200640 1 --2- 172.21.15.137:0/3969474287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faea80ae8d0 0x7faea80aed80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.105+0000 7faeb0200640 1 --2- 172.21.15.137:0/3969474287 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faea80b52c0 0x7faea813f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.105+0000 7faeb0200640 1 --2- 172.21.15.137:0/3969474287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae90004810 0x7faea8142b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.105+0000 7faeb0200640 1 -- 172.21.15.137:0/3969474287 >> 172.21.15.137:0/3969474287 conn(0x7faea806c800 msgr2=0x7faea815fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:52.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.105+0000 7faeb0200640 1 -- 172.21.15.137:0/3969474287 shutdown_connections 2024-04-26T23:41:52.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.105+0000 7faeb0200640 1 -- 172.21.15.137:0/3969474287 wait complete. 2024-04-26T23:41:52.129 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:52.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.261+0000 7fbdd9800640 1 Processor -- start 2024-04-26T23:41:52.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.261+0000 7fbdd9800640 1 -- start start 2024-04-26T23:41:52.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.261+0000 7fbdd9800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbdd40ce3e0 0x7fbdd4073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:52.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.261+0000 7fbdd9800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbdd40ce7c0 0x7fbdd4146210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:52.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.261+0000 7fbdd9800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdd4073010 con 0x7fbdd415de80 2024-04-26T23:41:52.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.261+0000 7fbdd9800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fbdd40cef90 con 0x7fbdd40ce7c0 2024-04-26T23:41:52.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.261+0000 7fbdd9800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd4073280 con 0x7fbdd40ce3e0 2024-04-26T23:41:52.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.261+0000 7fbdd3400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbdd40ce7c0 0x7fbdd4146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:52.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.261+0000 7fbdd2a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbdd40ce3e0 0x7fbdd4073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:52.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.261+0000 7fbdca000640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fbdd415de80 0x7fbdd40d04e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:52460/0 (socket says 172.21.15.137:52460) 2024-04-26T23:41:52.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.261+0000 7fbdca000640 1 -- 172.21.15.137:0/1747600808 learned_addr learned my addr 172.21.15.137:0/1747600808 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:52.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.265+0000 7fbdd3400640 1 -- 172.21.15.137:0/1747600808 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbdd40ce3e0 msgr2=0x7fbdd4073d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:52.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.265+0000 7fbdd3400640 1 --2- 172.21.15.137:0/1747600808 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbdd40ce3e0 0x7fbdd4073d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.265+0000 7fbdd3400640 1 -- 172.21.15.137:0/1747600808 >> v1:172.21.15.170:6789/0 conn(0x7fbdd415de80 legacy=0x7fbdd40d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:52.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.265+0000 7fbdd3400640 1 -- 172.21.15.137:0/1747600808 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd4073560 con 0x7fbdd40ce7c0 2024-04-26T23:41:52.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.265+0000 7fbdd3400640 1 --2- 172.21.15.137:0/1747600808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbdd40ce7c0 0x7fbdd4146210 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009d90 tx=0x7fbdcc01c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5774452c470324ab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:52.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.265+0000 7fbdd2000640 1 -- 172.21.15.137:0/1747600808 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc0b2070 con 0x7fbdd40ce7c0 2024-04-26T23:41:52.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.265+0000 7fbdd2000640 1 -- 172.21.15.137:0/1747600808 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdcc0a5910 con 0x7fbdd40ce7c0 2024-04-26T23:41:52.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.265+0000 7fbdd2000640 1 -- 172.21.15.137:0/1747600808 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc0a5ce0 con 0x7fbdd40ce7c0 2024-04-26T23:41:52.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd9800640 1 -- 172.21.15.137:0/1747600808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbdd40ce7c0 msgr2=0x7fbdd4146210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:52.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd9800640 1 --2- 172.21.15.137:0/1747600808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbdd40ce7c0 0x7fbdd4146210 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009d90 tx=0x7fbdcc01c940 comp rx=0 tx=0).stop 2024-04-26T23:41:52.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd9800640 1 -- 172.21.15.137:0/1747600808 shutdown_connections 2024-04-26T23:41:52.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd9800640 1 --2- 172.21.15.137:0/1747600808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbdd40ce7c0 0x7fbdd4146210 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd9800640 1 --2- 172.21.15.137:0/1747600808 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbdd40ce3e0 0x7fbdd4073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd9800640 1 -- 172.21.15.137:0/1747600808 >> 172.21.15.137:0/1747600808 conn(0x7fbdd406c5d0 msgr2=0x7fbdd406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:52.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd9800640 1 -- 172.21.15.137:0/1747600808 shutdown_connections 2024-04-26T23:41:52.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd9800640 1 -- 172.21.15.137:0/1747600808 wait complete. 2024-04-26T23:41:52.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd9800640 1 Processor -- start 2024-04-26T23:41:52.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd9800640 1 -- start start 2024-04-26T23:41:52.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd9800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbdd40ce3e0 0x7fbdd413d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:52.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd9800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbdd40ce7c0 0x7fbdd40b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:52.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd9800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbdd415de80 0x7fbdd414ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:52.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd9800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd406f0a0 con 0x7fbdd415de80 2024-04-26T23:41:52.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd9800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd406ef20 con 0x7fbdd40ce7c0 2024-04-26T23:41:52.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd9800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd406f220 con 0x7fbdd40ce3e0 2024-04-26T23:41:52.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbdd415de80 0x7fbdd414ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:52.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbdd415de80 0x7fbdd414ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59848/0 (socket says 172.21.15.137:59848) 2024-04-26T23:41:52.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd3400640 1 -- 172.21.15.137:0/3246781147 learned_addr learned my addr 172.21.15.137:0/3246781147 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:52.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd2a00640 1 --2- 172.21.15.137:0/3246781147 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbdd40ce3e0 0x7fbdd413d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:52.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdca000640 1 --2- 172.21.15.137:0/3246781147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbdd40ce7c0 0x7fbdd40b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:52.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd3400640 1 -- 172.21.15.137:0/3246781147 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbdd40ce3e0 msgr2=0x7fbdd413d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:52.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd3400640 1 --2- 172.21.15.137:0/3246781147 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbdd40ce3e0 0x7fbdd413d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd3400640 1 -- 172.21.15.137:0/3246781147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbdd40ce7c0 msgr2=0x7fbdd40b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:52.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd3400640 1 --2- 172.21.15.137:0/3246781147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbdd40ce7c0 0x7fbdd40b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.269+0000 7fbdd3400640 1 -- 172.21.15.137:0/3246781147 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd4140b80 con 0x7fbdd415de80 2024-04-26T23:41:52.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.273+0000 7fbdd3400640 1 --2- 172.21.15.137:0/3246781147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbdd415de80 0x7fbdd414ce20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0b0040 tx=0x7fbdcc0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:52.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.273+0000 7fbdcb400640 1 -- 172.21.15.137:0/3246781147 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc0b2050 con 0x7fbdd415de80 2024-04-26T23:41:52.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.273+0000 7fbdcb400640 1 -- 172.21.15.137:0/3246781147 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdcc0be070 con 0x7fbdd415de80 2024-04-26T23:41:52.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.273+0000 7fbdd9800640 1 -- 172.21.15.137:0/3246781147 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd40b2a70 con 0x7fbdd415de80 2024-04-26T23:41:52.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.273+0000 7fbdcb400640 1 -- 172.21.15.137:0/3246781147 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc0ada70 con 0x7fbdd415de80 2024-04-26T23:41:52.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.273+0000 7fbdd9800640 1 -- 172.21.15.137:0/3246781147 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd40b3030 con 0x7fbdd415de80 2024-04-26T23:41:52.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.273+0000 7fbdd9800640 1 -- 172.21.15.137:0/3246781147 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdd406a4b0 con 0x7fbdd415de80 2024-04-26T23:41:52.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.273+0000 7fbdcb400640 1 -- 172.21.15.137:0/3246781147 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbdcc0adc10 con 0x7fbdd415de80 2024-04-26T23:41:52.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.273+0000 7fbdcb400640 1 --2- 172.21.15.137:0/3246781147 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbdb0068380 0x7fbdb006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:52.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.273+0000 7fbdcb400640 1 -- 172.21.15.137:0/3246781147 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbdcc121b60 con 0x7fbdd415de80 2024-04-26T23:41:52.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.273+0000 7fbdd2a00640 1 --2- 172.21.15.137:0/3246781147 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbdb0068380 0x7fbdb006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:52.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.277+0000 7fbdd2a00640 1 --2- 172.21.15.137:0/3246781147 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbdb0068380 0x7fbdb006a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009ac0 tx=0x7fbdc4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:52.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.277+0000 7fbdcb400640 1 -- 172.21.15.137:0/3246781147 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbdcc016560 con 0x7fbdd415de80 2024-04-26T23:41:52.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.437+0000 7fbdd9800640 1 -- 172.21.15.137:0/3246781147 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbdd4146110 con 0x7fbdd415de80 2024-04-26T23:41:52.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.437+0000 7fbdcb400640 1 -- 172.21.15.137:0/3246781147 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16653 (secure 0 0 0) 0x7fbdcc0f1a30 con 0x7fbdd415de80 2024-04-26T23:41:52.442 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:52.442 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:25.186308+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:52.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.441+0000 7fbdd9800640 1 -- 172.21.15.137:0/3246781147 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbdb0068380 msgr2=0x7fbdb006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:52.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.441+0000 7fbdd9800640 1 --2- 172.21.15.137:0/3246781147 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbdb0068380 0x7fbdb006a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009ac0 tx=0x7fbdc4009190 comp rx=0 tx=0).stop 2024-04-26T23:41:52.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.441+0000 7fbdd9800640 1 -- 172.21.15.137:0/3246781147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbdd415de80 msgr2=0x7fbdd414ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:52.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.441+0000 7fbdd9800640 1 --2- 172.21.15.137:0/3246781147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbdd415de80 0x7fbdd414ce20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0b0040 tx=0x7fbdcc0196e0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.441+0000 7fbdd9800640 1 -- 172.21.15.137:0/3246781147 shutdown_connections 2024-04-26T23:41:52.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.441+0000 7fbdd9800640 1 --2- 172.21.15.137:0/3246781147 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbdb0068380 0x7fbdb006a840 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.441+0000 7fbdd9800640 1 --2- 172.21.15.137:0/3246781147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbdd415de80 0x7fbdd414ce20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.441+0000 7fbdd9800640 1 --2- 172.21.15.137:0/3246781147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbdd40ce7c0 0x7fbdd40b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.441+0000 7fbdd9800640 1 --2- 172.21.15.137:0/3246781147 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbdd40ce3e0 0x7fbdd413d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.441+0000 7fbdd9800640 1 -- 172.21.15.137:0/3246781147 >> 172.21.15.137:0/3246781147 conn(0x7fbdd406c5d0 msgr2=0x7fbdd415f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:52.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.441+0000 7fbdd9800640 1 -- 172.21.15.137:0/3246781147 shutdown_connections 2024-04-26T23:41:52.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.441+0000 7fbdd9800640 1 -- 172.21.15.137:0/3246781147 wait complete. 2024-04-26T23:41:52.464 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:41:21.810449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:41:22.533452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:41:52.464 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:41:52.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.601+0000 7fd0ece00640 1 Processor -- start 2024-04-26T23:41:52.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.601+0000 7fd0ece00640 1 -- start start 2024-04-26T23:41:52.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.601+0000 7fd0ece00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0e80b4390 0x7fd0e80b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:52.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.601+0000 7fd0ece00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd0e80cd660 0x7fd0e80d1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:52.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.601+0000 7fd0ece00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e80b0700 con 0x7fd0e81607e0 2024-04-26T23:41:52.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.601+0000 7fd0ece00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fd0e80b1030 con 0x7fd0e80cd660 2024-04-26T23:41:52.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.601+0000 7fd0ece00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e80b09e0 con 0x7fd0e80b4390 2024-04-26T23:41:52.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.601+0000 7fd0e7e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd0e80cd660 0x7fd0e80d1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:52.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.601+0000 7fd0e6a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0e80b4390 0x7fd0e80b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:52.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.601+0000 7fd0e7e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd0e80cd660 0x7fd0e80d1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:36074/0 (socket says 172.21.15.137:36074) 2024-04-26T23:41:52.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.601+0000 7fd0e7e00640 1 -- 172.21.15.137:0/281633353 learned_addr learned my addr 172.21.15.137:0/281633353 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:52.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.601+0000 7fd0e7e00640 1 -- 172.21.15.137:0/281633353 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0e80b4390 msgr2=0x7fd0e80b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:52.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.601+0000 7fd0e7e00640 1 --2- 172.21.15.137:0/281633353 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0e80b4390 0x7fd0e80b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.601+0000 7fd0e7e00640 1 -- 172.21.15.137:0/281633353 >> v1:172.21.15.170:6789/0 conn(0x7fd0e81607e0 legacy=0x7fd0e80d0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:52.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.601+0000 7fd0e7e00640 1 -- 172.21.15.137:0/281633353 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e80b0cc0 con 0x7fd0e80cd660 2024-04-26T23:41:52.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.605+0000 7fd0e7e00640 1 --2- 172.21.15.137:0/281633353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0e80cd660 0x7fd0e80d1340 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0009e50 tx=0x7fd0e001ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9716bcf04f44158b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:52.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.605+0000 7fd0e6000640 1 -- 172.21.15.137:0/281633353 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00a5810 con 0x7fd0e80cd660 2024-04-26T23:41:52.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.605+0000 7fd0e6000640 1 -- 172.21.15.137:0/281633353 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e00a59b0 con 0x7fd0e80cd660 2024-04-26T23:41:52.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.605+0000 7fd0e6000640 1 -- 172.21.15.137:0/281633353 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00a5d80 con 0x7fd0e80cd660 2024-04-26T23:41:52.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.605+0000 7fd0ece00640 1 -- 172.21.15.137:0/281633353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0e80cd660 msgr2=0x7fd0e80d1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:52.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.605+0000 7fd0ece00640 1 --2- 172.21.15.137:0/281633353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0e80cd660 0x7fd0e80d1340 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0009e50 tx=0x7fd0e001ca30 comp rx=0 tx=0).stop 2024-04-26T23:41:52.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.605+0000 7fd0ece00640 1 -- 172.21.15.137:0/281633353 shutdown_connections 2024-04-26T23:41:52.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.605+0000 7fd0ece00640 1 --2- 172.21.15.137:0/281633353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0e80cd660 0x7fd0e80d1340 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.605+0000 7fd0ece00640 1 --2- 172.21.15.137:0/281633353 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0e80b4390 0x7fd0e80b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.605+0000 7fd0ece00640 1 -- 172.21.15.137:0/281633353 >> 172.21.15.137:0/281633353 conn(0x7fd0e80b4870 msgr2=0x7fd0e80b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:52.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.605+0000 7fd0ece00640 1 -- 172.21.15.137:0/281633353 shutdown_connections 2024-04-26T23:41:52.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.605+0000 7fd0ece00640 1 -- 172.21.15.137:0/281633353 wait complete. 2024-04-26T23:41:52.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0ece00640 1 Processor -- start 2024-04-26T23:41:52.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0ece00640 1 -- start start 2024-04-26T23:41:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0ece00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0e80cd660 0x7fd0e8157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0ece00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0e80711f0 0x7fd0e8071650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0ece00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0e80cb690 0x7fd0e80cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0ece00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e8169830 con 0x7fd0e80cb690 2024-04-26T23:41:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0ece00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e81696b0 con 0x7fd0e80cd660 2024-04-26T23:41:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0ece00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e81699b0 con 0x7fd0e80711f0 2024-04-26T23:41:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0e7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0e80cb690 0x7fd0e80cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0e7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0e80cb690 0x7fd0e80cbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59860/0 (socket says 172.21.15.137:59860) 2024-04-26T23:41:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0e7e00640 1 -- 172.21.15.137:0/3557104634 learned_addr learned my addr 172.21.15.137:0/3557104634 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0e6a00640 1 --2- 172.21.15.137:0/3557104634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0e80711f0 0x7fd0e8071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0e7400640 1 --2- 172.21.15.137:0/3557104634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0e80cd660 0x7fd0e8157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:52.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0e7e00640 1 -- 172.21.15.137:0/3557104634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0e80711f0 msgr2=0x7fd0e8071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:52.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0e7e00640 1 --2- 172.21.15.137:0/3557104634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0e80711f0 0x7fd0e8071650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0e7e00640 1 -- 172.21.15.137:0/3557104634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0e80cd660 msgr2=0x7fd0e8157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:52.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0e7e00640 1 --2- 172.21.15.137:0/3557104634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0e80cd660 0x7fd0e8157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0e7e00640 1 -- 172.21.15.137:0/3557104634 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e80c9f30 con 0x7fd0e80cb690 2024-04-26T23:41:52.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0e7400640 1 --2- 172.21.15.137:0/3557104634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0e80cd660 0x7fd0e8157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:52.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0e7e00640 1 --2- 172.21.15.137:0/3557104634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0e80cb690 0x7fd0e80cbb10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0009e50 tx=0x7fd0e00197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:52.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0df400640 1 -- 172.21.15.137:0/3557104634 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00a5810 con 0x7fd0e80cb690 2024-04-26T23:41:52.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0df400640 1 -- 172.21.15.137:0/3557104634 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e00079b0 con 0x7fd0e80cb690 2024-04-26T23:41:52.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0ece00640 1 -- 172.21.15.137:0/3557104634 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e80ca1d0 con 0x7fd0e80cb690 2024-04-26T23:41:52.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0df400640 1 -- 172.21.15.137:0/3557104634 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0009510 con 0x7fd0e80cb690 2024-04-26T23:41:52.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0ece00640 1 -- 172.21.15.137:0/3557104634 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e80ca790 con 0x7fd0e80cb690 2024-04-26T23:41:52.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.609+0000 7fd0ece00640 1 -- 172.21.15.137:0/3557104634 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0e8071b90 con 0x7fd0e80cb690 2024-04-26T23:41:52.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.613+0000 7fd0df400640 1 -- 172.21.15.137:0/3557104634 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd0e00c0020 con 0x7fd0e80cb690 2024-04-26T23:41:52.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.613+0000 7fd0df400640 1 --2- 172.21.15.137:0/3557104634 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd0c8068380 0x7fd0c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:52.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.613+0000 7fd0df400640 1 -- 172.21.15.137:0/3557104634 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd0e0121b40 con 0x7fd0e80cb690 2024-04-26T23:41:52.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.613+0000 7fd0e7400640 1 --2- 172.21.15.137:0/3557104634 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd0c8068380 0x7fd0c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:52.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.613+0000 7fd0e7400640 1 --2- 172.21.15.137:0/3557104634 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd0c8068380 0x7fd0c806a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8001710 tx=0x7fd0d8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:52.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.617+0000 7fd0df400640 1 -- 172.21.15.137:0/3557104634 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd0e0016620 con 0x7fd0e80cb690 2024-04-26T23:41:52.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.773+0000 7fd0ece00640 1 -- 172.21.15.137:0/3557104634 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd0e8071fb0 con 0x7fd0e80cb690 2024-04-26T23:41:52.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.773+0000 7fd0df400640 1 -- 172.21.15.137:0/3557104634 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fd0e00f2180 con 0x7fd0e80cb690 2024-04-26T23:41:52.778 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:41:52.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.777+0000 7fd0ece00640 1 -- 172.21.15.137:0/3557104634 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd0c8068380 msgr2=0x7fd0c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:52.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.777+0000 7fd0ece00640 1 --2- 172.21.15.137:0/3557104634 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd0c8068380 0x7fd0c806a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8001710 tx=0x7fd0d8009040 comp rx=0 tx=0).stop 2024-04-26T23:41:52.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.777+0000 7fd0ece00640 1 -- 172.21.15.137:0/3557104634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0e80cb690 msgr2=0x7fd0e80cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:52.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.777+0000 7fd0ece00640 1 --2- 172.21.15.137:0/3557104634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0e80cb690 0x7fd0e80cbb10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0009e50 tx=0x7fd0e00197d0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.777+0000 7fd0ece00640 1 -- 172.21.15.137:0/3557104634 shutdown_connections 2024-04-26T23:41:52.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.777+0000 7fd0ece00640 1 --2- 172.21.15.137:0/3557104634 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd0c8068380 0x7fd0c806a840 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.777+0000 7fd0ece00640 1 --2- 172.21.15.137:0/3557104634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0e80cb690 0x7fd0e80cbb10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.777+0000 7fd0ece00640 1 --2- 172.21.15.137:0/3557104634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0e80711f0 0x7fd0e8071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.777+0000 7fd0ece00640 1 --2- 172.21.15.137:0/3557104634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0e80cd660 0x7fd0e8157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.777+0000 7fd0ece00640 1 -- 172.21.15.137:0/3557104634 >> 172.21.15.137:0/3557104634 conn(0x7fd0e80b4870 msgr2=0x7fd0e815e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:52.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.777+0000 7fd0ece00640 1 -- 172.21.15.137:0/3557104634 shutdown_connections 2024-04-26T23:41:52.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.777+0000 7fd0ece00640 1 -- 172.21.15.137:0/3557104634 wait complete. 2024-04-26T23:41:52.799 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:41:52.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.933+0000 7fedf4e00640 1 Processor -- start 2024-04-26T23:41:52.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.933+0000 7fedf4e00640 1 -- start start 2024-04-26T23:41:52.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.933+0000 7fedf4e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fedf00b54e0 0x7fedf00b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:52.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7fedf4e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedf00cffa0 con 0x7fedf0160000 2024-04-26T23:41:52.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7fedf4e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedf00d0280 con 0x7fedf00cd710 2024-04-26T23:41:52.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7fedf4e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fedf00b3d90 con 0x7fedf00b54e0 2024-04-26T23:41:52.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7fedee800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fedf0160000 0x7fedf0144d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49140/0 (socket says 172.21.15.137:49140) 2024-04-26T23:41:52.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7fedee800640 1 -- 172.21.15.137:0/2162911393 learned_addr learned my addr 172.21.15.137:0/2162911393 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:52.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7fedede00640 1 --2- 172.21.15.137:0/2162911393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fedf00b54e0 0x7fedf00b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:52.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7feded400640 1 -- 172.21.15.137:0/2162911393 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4025829868 0 0) 0x7fedf00cffa0 con 0x7fedf0160000 2024-04-26T23:41:52.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7feded400640 1 -- 172.21.15.137:0/2162911393 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedd4003530 con 0x7fedf0160000 2024-04-26T23:41:52.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7feded400640 1 -- 172.21.15.137:0/2162911393 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1732372781 0 0) 0x7fedd4003530 con 0x7fedf0160000 2024-04-26T23:41:52.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7feded400640 1 -- 172.21.15.137:0/2162911393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fedf00b54e0 msgr2=0x7fedf00b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:52.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7feded400640 1 --2- 172.21.15.137:0/2162911393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fedf00b54e0 0x7fedf00b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7feded400640 1 -- 172.21.15.137:0/2162911393 >> v1:172.21.15.170:6789/0 conn(0x7fedf00cd710 legacy=0x7fedf015f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:52.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7feded400640 1 -- 172.21.15.137:0/2162911393 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf00d0560 con 0x7fedf0160000 2024-04-26T23:41:52.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7feded400640 1 -- 172.21.15.137:0/2162911393 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fede8001680 con 0x7fedf0160000 2024-04-26T23:41:52.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7feded400640 1 -- 172.21.15.137:0/2162911393 >> v1:172.21.15.137:6789/0 conn(0x7fedf0160000 legacy=0x7fedf0144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:52.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7feded400640 1 --2- 172.21.15.137:0/2162911393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd40039f0 0x7fedd4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:52.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7feded400640 1 --2- 172.21.15.137:0/2162911393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fedf00b54e0 0x7fedd4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:52.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7feded400640 1 --2- 172.21.15.137:0/2162911393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedd4004d50 0x7fedd40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:52.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7feded400640 1 -- 172.21.15.137:0/2162911393 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fedd400b9d0 con 0x7fedd40039f0 2024-04-26T23:41:52.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7feded400640 1 -- 172.21.15.137:0/2162911393 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fedd400bb50 con 0x7fedd4004d50 2024-04-26T23:41:52.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7feded400640 1 -- 172.21.15.137:0/2162911393 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fedd400bd50 con 0x7fedf00b54e0 2024-04-26T23:41:52.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7fedede00640 1 --2- 172.21.15.137:0/2162911393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd40039f0 0x7fedd4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:52.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7fedee800640 1 --2- 172.21.15.137:0/2162911393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedd4004d50 0x7fedd40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:52.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7fede5400640 1 --2- 172.21.15.137:0/2162911393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fedf00b54e0 0x7fedd4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:52.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7fedede00640 1 -- 172.21.15.137:0/2162911393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fedf00b54e0 msgr2=0x7fedd4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:52.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7fedede00640 1 --2- 172.21.15.137:0/2162911393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fedf00b54e0 0x7fedd4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7fedede00640 1 -- 172.21.15.137:0/2162911393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedd4004d50 msgr2=0x7fedd40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:52.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7fedede00640 1 --2- 172.21.15.137:0/2162911393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedd4004d50 0x7fedd40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7fedede00640 1 -- 172.21.15.137:0/2162911393 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd4003530 con 0x7fedd40039f0 2024-04-26T23:41:52.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.937+0000 7fedee800640 1 --2- 172.21.15.137:0/2162911393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedd4004d50 0x7fedd40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:52.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.941+0000 7fedede00640 1 --2- 172.21.15.137:0/2162911393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd40039f0 0x7fedd4003dd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fede0009fc0 tx=0x7fede001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74bf3f639cf267f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:52.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.941+0000 7feded400640 1 -- 172.21.15.137:0/2162911393 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede00b2070 con 0x7fedd40039f0 2024-04-26T23:41:52.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.941+0000 7feded400640 1 -- 172.21.15.137:0/2162911393 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede00a5bd0 con 0x7fedd40039f0 2024-04-26T23:41:52.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.941+0000 7feded400640 1 -- 172.21.15.137:0/2162911393 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede0009c10 con 0x7fedd40039f0 2024-04-26T23:41:52.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.941+0000 7fedf4e00640 1 -- 172.21.15.137:0/2162911393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd40039f0 msgr2=0x7fedd4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:52.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.941+0000 7fedf4e00640 1 --2- 172.21.15.137:0/2162911393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd40039f0 0x7fedd4003dd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fede0009fc0 tx=0x7fede001cbc0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.941+0000 7fedee800640 1 -- 172.21.15.137:0/2162911393 reap_dead start 2024-04-26T23:41:52.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.941+0000 7fedf4e00640 1 -- 172.21.15.137:0/2162911393 shutdown_connections 2024-04-26T23:41:52.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.941+0000 7fedf4e00640 1 -- 172.21.15.137:0/2162911393 >> 172.21.15.137:0/2162911393 conn(0x7fedf006c800 msgr2=0x7fedf006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:52.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.941+0000 7fedf4e00640 1 -- 172.21.15.137:0/2162911393 shutdown_connections 2024-04-26T23:41:52.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.941+0000 7fedf4e00640 1 -- 172.21.15.137:0/2162911393 wait complete. 2024-04-26T23:41:52.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.941+0000 7fedf4e00640 1 Processor -- start 2024-04-26T23:41:52.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.941+0000 7fedf4e00640 1 -- start start 2024-04-26T23:41:52.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fedf4e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd40039f0 0x7fedf0141750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:52.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fedf4e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedf0153390 0x7fedf0154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:52.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fedf4e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fedf013f7d0 0x7fedf0155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:52.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fedf4e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fedf00cded0 con 0x7fedd40039f0 2024-04-26T23:41:52.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fedf4e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fedf00d0840 con 0x7fedf0153390 2024-04-26T23:41:52.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fedf4e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fedf00cdb50 con 0x7fedf013f7d0 2024-04-26T23:41:52.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fedede00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd40039f0 0x7fedf0141750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:52.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fedede00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd40039f0 0x7fedf0141750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59886/0 (socket says 172.21.15.137:59886) 2024-04-26T23:41:52.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fedede00640 1 -- 172.21.15.137:0/1450441800 learned_addr learned my addr 172.21.15.137:0/1450441800 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:52.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fedee800640 1 --2- 172.21.15.137:0/1450441800 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fedf013f7d0 0x7fedf0155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:52.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fede5400640 1 --2- 172.21.15.137:0/1450441800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedf0153390 0x7fedf0154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:52.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fedede00640 1 -- 172.21.15.137:0/1450441800 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fedf013f7d0 msgr2=0x7fedf0155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:52.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fedede00640 1 --2- 172.21.15.137:0/1450441800 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fedf013f7d0 0x7fedf0155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fedede00640 1 -- 172.21.15.137:0/1450441800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedf0153390 msgr2=0x7fedf0154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:52.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fedede00640 1 --2- 172.21.15.137:0/1450441800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedf0153390 0x7fedf0154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:52.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fedede00640 1 -- 172.21.15.137:0/1450441800 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf013fc50 con 0x7fedd40039f0 2024-04-26T23:41:52.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fedede00640 1 --2- 172.21.15.137:0/1450441800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd40039f0 0x7fedf0141750 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fede001c630 tx=0x7fede0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:52.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fede6a00640 1 -- 172.21.15.137:0/1450441800 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede00ba070 con 0x7fedd40039f0 2024-04-26T23:41:52.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fede6a00640 1 -- 172.21.15.137:0/1450441800 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede00adbd0 con 0x7fedd40039f0 2024-04-26T23:41:52.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fedf4e00640 1 -- 172.21.15.137:0/1450441800 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf0154940 con 0x7fedd40039f0 2024-04-26T23:41:52.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fede6a00640 1 -- 172.21.15.137:0/1450441800 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede00b2040 con 0x7fedd40039f0 2024-04-26T23:41:52.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fedf4e00640 1 -- 172.21.15.137:0/1450441800 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf00b0d80 con 0x7fedd40039f0 2024-04-26T23:41:52.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fedf4e00640 1 -- 172.21.15.137:0/1450441800 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf006a410 con 0x7fedd40039f0 2024-04-26T23:41:52.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.945+0000 7fede6a00640 1 -- 172.21.15.137:0/1450441800 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fede00b6410 con 0x7fedd40039f0 2024-04-26T23:41:52.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.949+0000 7fede6a00640 1 --2- 172.21.15.137:0/1450441800 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fedcc0683b0 0x7fedcc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:52.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.949+0000 7fede6a00640 1 -- 172.21.15.137:0/1450441800 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fede01212a0 con 0x7fedd40039f0 2024-04-26T23:41:52.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.949+0000 7fede5400640 1 --2- 172.21.15.137:0/1450441800 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fedcc0683b0 0x7fedcc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:52.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.949+0000 7fede5400640 1 --2- 172.21.15.137:0/1450441800 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fedcc0683b0 0x7fedcc06a870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fedf01f8260 tx=0x7fedd8007cd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:52.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:52.953+0000 7fede6a00640 1 -- 172.21.15.137:0/1450441800 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fedf013fc50 con 0x7fedd40039f0 2024-04-26T23:41:53.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.109+0000 7fedf4e00640 1 -- 172.21.15.137:0/1450441800 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fedf0072ef0 con 0x7fedd40039f0 2024-04-26T23:41:53.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.109+0000 7fede6a00640 1 -- 172.21.15.137:0/1450441800 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fede00168d0 con 0x7fedd40039f0 2024-04-26T23:41:53.112 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:41:53.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.109+0000 7fedf4e00640 1 -- 172.21.15.137:0/1450441800 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fedcc0683b0 msgr2=0x7fedcc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:53.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.109+0000 7fedf4e00640 1 --2- 172.21.15.137:0/1450441800 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fedcc0683b0 0x7fedcc06a870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fedf01f8260 tx=0x7fedd8007cd0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.109+0000 7fedf4e00640 1 -- 172.21.15.137:0/1450441800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd40039f0 msgr2=0x7fedf0141750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:53.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.109+0000 7fedf4e00640 1 --2- 172.21.15.137:0/1450441800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd40039f0 0x7fedf0141750 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fede001c630 tx=0x7fede0009750 comp rx=0 tx=0).stop 2024-04-26T23:41:53.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.109+0000 7fedf4e00640 1 -- 172.21.15.137:0/1450441800 shutdown_connections 2024-04-26T23:41:53.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.109+0000 7fedf4e00640 1 --2- 172.21.15.137:0/1450441800 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fedcc0683b0 0x7fedcc06a870 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.109+0000 7fedf4e00640 1 --2- 172.21.15.137:0/1450441800 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fedf013f7d0 0x7fedf0155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.109+0000 7fedf4e00640 1 --2- 172.21.15.137:0/1450441800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedf0153390 0x7fedf0154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.109+0000 7fedf4e00640 1 --2- 172.21.15.137:0/1450441800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd40039f0 0x7fedf0141750 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.109+0000 7fedf4e00640 1 -- 172.21.15.137:0/1450441800 >> 172.21.15.137:0/1450441800 conn(0x7fedf006c800 msgr2=0x7fedf00723b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:53.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.109+0000 7fedf4e00640 1 -- 172.21.15.137:0/1450441800 shutdown_connections 2024-04-26T23:41:53.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.109+0000 7fedf4e00640 1 -- 172.21.15.137:0/1450441800 wait complete. 2024-04-26T23:41:53.135 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:41:53.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.269+0000 7f53c1a00640 1 Processor -- start 2024-04-26T23:41:53.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.269+0000 7f53c1a00640 1 -- start start 2024-04-26T23:41:53.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.269+0000 7f53c1a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f53bc073f20 0x7f53bc15df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:53.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.269+0000 7f53c1a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53bc0affa0 0x7f53bc0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:53.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.269+0000 7f53c1a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53bc072860 con 0x7f53bc0afbc0 2024-04-26T23:41:53.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.269+0000 7f53c1a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f53bc0743b0 con 0x7f53bc073f20 2024-04-26T23:41:53.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.269+0000 7f53c1a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f53bc072b00 con 0x7f53bc0affa0 2024-04-26T23:41:53.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.273+0000 7f53b2000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f53bc073f20 0x7f53bc15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:53.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.273+0000 7f53b2000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f53bc073f20 0x7f53bc15df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59900/0 (socket says 172.21.15.137:59900) 2024-04-26T23:41:53.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.273+0000 7f53b2000640 1 -- 172.21.15.137:0/271737260 learned_addr learned my addr 172.21.15.137:0/271737260 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:53.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.273+0000 7f53bb400640 1 --2- 172.21.15.137:0/271737260 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53bc0affa0 0x7f53bc0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:53.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.273+0000 7f53b2000640 1 -- 172.21.15.137:0/271737260 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53bc0affa0 msgr2=0x7f53bc0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:53.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.273+0000 7f53b2000640 1 --2- 172.21.15.137:0/271737260 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53bc0affa0 0x7f53bc0ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.273+0000 7f53b2000640 1 -- 172.21.15.137:0/271737260 >> v1:172.21.15.170:6789/0 conn(0x7f53bc0afbc0 legacy=0x7f53bc0735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:53.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.273+0000 7f53b2000640 1 -- 172.21.15.137:0/271737260 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53bc072de0 con 0x7f53bc073f20 2024-04-26T23:41:53.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.273+0000 7f53b2000640 1 --2- 172.21.15.137:0/271737260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53bc073f20 0x7f53bc15df90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f53a40098a0 tx=0x7f53a401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37685ff86d84639 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:53.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.273+0000 7f53ba000640 1 -- 172.21.15.137:0/271737260 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a40b0070 con 0x7f53bc073f20 2024-04-26T23:41:53.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.273+0000 7f53ba000640 1 -- 172.21.15.137:0/271737260 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53a40ab600 con 0x7f53bc073f20 2024-04-26T23:41:53.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.273+0000 7f53ba000640 1 -- 172.21.15.137:0/271737260 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a40ab9d0 con 0x7f53bc073f20 2024-04-26T23:41:53.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53c1a00640 1 -- 172.21.15.137:0/271737260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53bc073f20 msgr2=0x7f53bc15df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:53.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53c1a00640 1 --2- 172.21.15.137:0/271737260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53bc073f20 0x7f53bc15df90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f53a40098a0 tx=0x7f53a401c540 comp rx=0 tx=0).stop 2024-04-26T23:41:53.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53c1a00640 1 -- 172.21.15.137:0/271737260 shutdown_connections 2024-04-26T23:41:53.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53c1a00640 1 --2- 172.21.15.137:0/271737260 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53bc0affa0 0x7f53bc0ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53c1a00640 1 --2- 172.21.15.137:0/271737260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53bc073f20 0x7f53bc15df90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53c1a00640 1 -- 172.21.15.137:0/271737260 >> 172.21.15.137:0/271737260 conn(0x7f53bc06c800 msgr2=0x7f53bc06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:53.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53c1a00640 1 -- 172.21.15.137:0/271737260 shutdown_connections 2024-04-26T23:41:53.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53c1a00640 1 -- 172.21.15.137:0/271737260 wait complete. 2024-04-26T23:41:53.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53c1a00640 1 Processor -- start 2024-04-26T23:41:53.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53c1a00640 1 -- start start 2024-04-26T23:41:53.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53c1a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53bc0afbc0 0x7f53bc15c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:53.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53c1a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53bc0affa0 0x7f53bc0b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:53.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53c1a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53bc0b1a00 0x7f53bc159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:53.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53c1a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f53bc06f360 con 0x7f53bc0afbc0 2024-04-26T23:41:53.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53c1a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f53bc06f1e0 con 0x7f53bc0b1a00 2024-04-26T23:41:53.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53c1a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f53bc06f4e0 con 0x7f53bc0affa0 2024-04-26T23:41:53.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53baa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53bc0afbc0 0x7f53bc15c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:53.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53baa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53bc0afbc0 0x7f53bc15c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59908/0 (socket says 172.21.15.137:59908) 2024-04-26T23:41:53.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53baa00640 1 -- 172.21.15.137:0/2398028225 learned_addr learned my addr 172.21.15.137:0/2398028225 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:53.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53bb400640 1 --2- 172.21.15.137:0/2398028225 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53bc0b1a00 0x7f53bc159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:53.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53b2000640 1 --2- 172.21.15.137:0/2398028225 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53bc0affa0 0x7f53bc0b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:53.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53baa00640 1 -- 172.21.15.137:0/2398028225 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53bc0affa0 msgr2=0x7f53bc0b14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:53.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53baa00640 1 --2- 172.21.15.137:0/2398028225 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53bc0affa0 0x7f53bc0b14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53baa00640 1 -- 172.21.15.137:0/2398028225 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53bc0b1a00 msgr2=0x7f53bc159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:53.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53baa00640 1 --2- 172.21.15.137:0/2398028225 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53bc0b1a00 0x7f53bc159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.277+0000 7f53baa00640 1 -- 172.21.15.137:0/2398028225 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53bc13ff90 con 0x7f53bc0afbc0 2024-04-26T23:41:53.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.281+0000 7f53baa00640 1 --2- 172.21.15.137:0/2398028225 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53bc0afbc0 0x7f53bc15c040 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f53ac007fd0 tx=0x7f53ac00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:53.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.281+0000 7f53b3400640 1 -- 172.21.15.137:0/2398028225 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac017070 con 0x7f53bc0afbc0 2024-04-26T23:41:53.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.281+0000 7f53b3400640 1 -- 172.21.15.137:0/2398028225 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53ac0052d0 con 0x7f53bc0afbc0 2024-04-26T23:41:53.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.281+0000 7f53b3400640 1 -- 172.21.15.137:0/2398028225 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac003840 con 0x7f53bc0afbc0 2024-04-26T23:41:53.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.281+0000 7f53c1a00640 1 -- 172.21.15.137:0/2398028225 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53bc140270 con 0x7f53bc0afbc0 2024-04-26T23:41:53.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.281+0000 7f53c1a00640 1 -- 172.21.15.137:0/2398028225 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53bc140830 con 0x7f53bc0afbc0 2024-04-26T23:41:53.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.281+0000 7f53c1a00640 1 -- 172.21.15.137:0/2398028225 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53bc0b1e10 con 0x7f53bc0afbc0 2024-04-26T23:41:53.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.281+0000 7f53b3400640 1 -- 172.21.15.137:0/2398028225 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f53ac01a070 con 0x7f53bc0afbc0 2024-04-26T23:41:53.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.281+0000 7f53b3400640 1 --2- 172.21.15.137:0/2398028225 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5398068380 0x7f539806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:53.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.281+0000 7f53b3400640 1 -- 172.21.15.137:0/2398028225 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f53ac085cc0 con 0x7f53bc0afbc0 2024-04-26T23:41:53.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.281+0000 7f53b2000640 1 --2- 172.21.15.137:0/2398028225 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5398068380 0x7f539806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:53.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.285+0000 7f53b2000640 1 --2- 172.21.15.137:0/2398028225 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5398068380 0x7f539806a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f53bc0727f0 tx=0x7f53a4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:53.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.285+0000 7f53b3400640 1 -- 172.21.15.137:0/2398028225 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f53bc0b1e10 con 0x7f53bc0afbc0 2024-04-26T23:41:53.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.441+0000 7f53c1a00640 1 -- 172.21.15.137:0/2398028225 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f53bc06a410 con 0x7f53bc0afbc0 2024-04-26T23:41:53.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.445+0000 7f53b3400640 1 -- 172.21.15.137:0/2398028225 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f53ac005480 con 0x7f53bc0afbc0 2024-04-26T23:41:53.447 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:41:53.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.445+0000 7f53c1a00640 1 -- 172.21.15.137:0/2398028225 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5398068380 msgr2=0x7f539806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:53.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.445+0000 7f53c1a00640 1 --2- 172.21.15.137:0/2398028225 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5398068380 0x7f539806a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f53bc0727f0 tx=0x7f53a4008040 comp rx=0 tx=0).stop 2024-04-26T23:41:53.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.445+0000 7f53c1a00640 1 -- 172.21.15.137:0/2398028225 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53bc0afbc0 msgr2=0x7f53bc15c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:53.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.445+0000 7f53c1a00640 1 --2- 172.21.15.137:0/2398028225 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53bc0afbc0 0x7f53bc15c040 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f53ac007fd0 tx=0x7f53ac00c890 comp rx=0 tx=0).stop 2024-04-26T23:41:53.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.445+0000 7f53c1a00640 1 -- 172.21.15.137:0/2398028225 shutdown_connections 2024-04-26T23:41:53.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.445+0000 7f53c1a00640 1 --2- 172.21.15.137:0/2398028225 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5398068380 0x7f539806a840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.445+0000 7f53c1a00640 1 --2- 172.21.15.137:0/2398028225 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53bc0b1a00 0x7f53bc159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.445+0000 7f53c1a00640 1 --2- 172.21.15.137:0/2398028225 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53bc0affa0 0x7f53bc0b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.445+0000 7f53c1a00640 1 --2- 172.21.15.137:0/2398028225 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53bc0afbc0 0x7f53bc15c040 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.445+0000 7f53c1a00640 1 -- 172.21.15.137:0/2398028225 >> 172.21.15.137:0/2398028225 conn(0x7f53bc06c800 msgr2=0x7f53bc15fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:53.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.445+0000 7f53c1a00640 1 -- 172.21.15.137:0/2398028225 shutdown_connections 2024-04-26T23:41:53.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.445+0000 7f53c1a00640 1 -- 172.21.15.137:0/2398028225 wait complete. 2024-04-26T23:41:53.477 INFO:tasks.cephfs_test_runner:Starting test: test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) That when a client unmounts, the thread count on the MDS goes back 2024-04-26T23:41:53.477 INFO:tasks.cephfs_test_runner:test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-04-26T23:41:53.477 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:53.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.609+0000 7f5409c00640 1 Processor -- start 2024-04-26T23:41:53.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.609+0000 7f5409c00640 1 -- start start 2024-04-26T23:41:53.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.609+0000 7f5409c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f540415de80 0x7f5404073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:53.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.609+0000 7f5409c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f54040ce7c0 0x7f5404146210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:53.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.609+0000 7f5409c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5404073010 con 0x7f54040ce3e0 2024-04-26T23:41:53.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.609+0000 7f5409c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f54040cef90 con 0x7f54040ce7c0 2024-04-26T23:41:53.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.609+0000 7f5409c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5404073280 con 0x7f540415de80 2024-04-26T23:41:53.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.609+0000 7f5402a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f54040ce3e0 0x7f54040d04e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49150/0 (socket says 172.21.15.137:49150) 2024-04-26T23:41:53.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.609+0000 7f5402a00640 1 -- 172.21.15.137:0/712670935 learned_addr learned my addr 172.21.15.137:0/712670935 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:53.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.613+0000 7f53fa000640 1 --2- 172.21.15.137:0/712670935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f540415de80 0x7f5404073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:53.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.613+0000 7f5403400640 1 --2- 172.21.15.137:0/712670935 >> v2:172.21.15.170:3300/0 conn(0x7f54040ce7c0 0x7f5404146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:53.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.613+0000 7f5402000640 1 -- 172.21.15.137:0/712670935 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1058995656 0 0) 0x7f5404073010 con 0x7f54040ce3e0 2024-04-26T23:41:53.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.613+0000 7f5402000640 1 -- 172.21.15.137:0/712670935 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53e8003530 con 0x7f54040ce3e0 2024-04-26T23:41:53.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.613+0000 7f53fa000640 1 -- 172.21.15.137:0/712670935 >> v2:172.21.15.170:3300/0 conn(0x7f54040ce7c0 msgr2=0x7f5404146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:53.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.613+0000 7f53fa000640 1 --2- 172.21.15.137:0/712670935 >> v2:172.21.15.170:3300/0 conn(0x7f54040ce7c0 0x7f5404146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.613+0000 7f53fa000640 1 -- 172.21.15.137:0/712670935 >> v1:172.21.15.137:6789/0 conn(0x7f54040ce3e0 legacy=0x7f54040d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:53.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.613+0000 7f5402000640 1 -- 172.21.15.137:0/712670935 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1629454527 0 0) 0x7f53e8003530 con 0x7f54040ce3e0 2024-04-26T23:41:53.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.613+0000 7f53fa000640 1 -- 172.21.15.137:0/712670935 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5404073560 con 0x7f540415de80 2024-04-26T23:41:53.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.613+0000 7f53fa000640 1 --2- 172.21.15.137:0/712670935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f540415de80 0x7f5404073d60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0097c0 tx=0x7f53ec01c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b8ba209ca490755 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:53.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.613+0000 7f5402000640 1 -- 172.21.15.137:0/712670935 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec0b0070 con 0x7f540415de80 2024-04-26T23:41:53.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.613+0000 7f5402000640 1 -- 172.21.15.137:0/712670935 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53ec0ab400 con 0x7f540415de80 2024-04-26T23:41:53.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.613+0000 7f5402000640 1 -- 172.21.15.137:0/712670935 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f4001680 con 0x7f540415de80 2024-04-26T23:41:53.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5409c00640 1 -- 172.21.15.137:0/712670935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f540415de80 msgr2=0x7f5404073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:53.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5409c00640 1 --2- 172.21.15.137:0/712670935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f540415de80 0x7f5404073d60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0097c0 tx=0x7f53ec01c390 comp rx=0 tx=0).stop 2024-04-26T23:41:53.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5409c00640 1 -- 172.21.15.137:0/712670935 shutdown_connections 2024-04-26T23:41:53.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5409c00640 1 --2- 172.21.15.137:0/712670935 >> v2:172.21.15.170:3300/0 conn(0x7f54040ce7c0 0x7f5404146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5409c00640 1 --2- 172.21.15.137:0/712670935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f540415de80 0x7f5404073d60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5409c00640 1 -- 172.21.15.137:0/712670935 >> 172.21.15.137:0/712670935 conn(0x7f540406c5d0 msgr2=0x7f540406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:53.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5409c00640 1 -- 172.21.15.137:0/712670935 shutdown_connections 2024-04-26T23:41:53.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5409c00640 1 -- 172.21.15.137:0/712670935 wait complete. 2024-04-26T23:41:53.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5409c00640 1 Processor -- start 2024-04-26T23:41:53.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5409c00640 1 -- start start 2024-04-26T23:41:53.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5409c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54040ce3e0 0x7f540415b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:53.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5409c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54040ce7c0 0x7f54040b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:53.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5409c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f540415de80 0x7f54040b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:53.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5409c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f540406f0e0 con 0x7f540415de80 2024-04-26T23:41:53.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5409c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f540406ef60 con 0x7f54040ce7c0 2024-04-26T23:41:53.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5409c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f540406f260 con 0x7f54040ce3e0 2024-04-26T23:41:53.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5403400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f540415de80 0x7f54040b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:53.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5403400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f540415de80 0x7f54040b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59918/0 (socket says 172.21.15.137:59918) 2024-04-26T23:41:53.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5403400640 1 -- 172.21.15.137:0/2561721695 learned_addr learned my addr 172.21.15.137:0/2561721695 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:53.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f53fa000640 1 --2- 172.21.15.137:0/2561721695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54040ce7c0 0x7f54040b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:53.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5402a00640 1 --2- 172.21.15.137:0/2561721695 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54040ce3e0 0x7f540415b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:53.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5403400640 1 -- 172.21.15.137:0/2561721695 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54040ce3e0 msgr2=0x7f540415b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:53.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5403400640 1 --2- 172.21.15.137:0/2561721695 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54040ce3e0 0x7f540415b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5403400640 1 -- 172.21.15.137:0/2561721695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54040ce7c0 msgr2=0x7f54040b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:53.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5403400640 1 --2- 172.21.15.137:0/2561721695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54040ce7c0 0x7f54040b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.617+0000 7f5403400640 1 -- 172.21.15.137:0/2561721695 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54040b4f00 con 0x7f540415de80 2024-04-26T23:41:53.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.621+0000 7f5403400640 1 --2- 172.21.15.137:0/2561721695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f540415de80 0x7f54040b45e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00efc0 tx=0x7f53fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:53.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.621+0000 7f53fb400640 1 -- 172.21.15.137:0/2561721695 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc018020 con 0x7f540415de80 2024-04-26T23:41:53.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.621+0000 7f53fb400640 1 -- 172.21.15.137:0/2561721695 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53fc014480 con 0x7f540415de80 2024-04-26T23:41:53.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.621+0000 7f5409c00640 1 -- 172.21.15.137:0/2561721695 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54040af6a0 con 0x7f540415de80 2024-04-26T23:41:53.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.621+0000 7f53fb400640 1 -- 172.21.15.137:0/2561721695 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc014870 con 0x7f540415de80 2024-04-26T23:41:53.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.621+0000 7f5409c00640 1 -- 172.21.15.137:0/2561721695 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54040afc60 con 0x7f540415de80 2024-04-26T23:41:53.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.621+0000 7f5409c00640 1 -- 172.21.15.137:0/2561721695 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f540406a4b0 con 0x7f540415de80 2024-04-26T23:41:53.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.621+0000 7f53fb400640 1 -- 172.21.15.137:0/2561721695 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f53fc01b020 con 0x7f540415de80 2024-04-26T23:41:53.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.621+0000 7f53fb400640 1 --2- 172.21.15.137:0/2561721695 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f53e0068380 0x7f53e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:53.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.621+0000 7f53fb400640 1 -- 172.21.15.137:0/2561721695 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f53fc0873f0 con 0x7f540415de80 2024-04-26T23:41:53.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.621+0000 7f5402a00640 1 --2- 172.21.15.137:0/2561721695 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f53e0068380 0x7f53e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:53.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.625+0000 7f5402a00640 1 --2- 172.21.15.137:0/2561721695 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f53e0068380 0x7f53e006a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5404143200 tx=0x7f53f4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:53.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.625+0000 7f53fb400640 1 -- 172.21.15.137:0/2561721695 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f53fc022070 con 0x7f540415de80 2024-04-26T23:41:53.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.789+0000 7f5409c00640 1 -- 172.21.15.137:0/2561721695 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f54040b0900 con 0x7f540415de80 2024-04-26T23:41:53.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.789+0000 7f53fb400640 1 -- 172.21.15.137:0/2561721695 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16653 (secure 0 0 0) 0x7f54040b4f00 con 0x7f540415de80 2024-04-26T23:41:53.793 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:53.793 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:25.186308+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:53.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.789+0000 7f5409c00640 1 -- 172.21.15.137:0/2561721695 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f53e0068380 msgr2=0x7f53e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:53.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.793+0000 7f5409c00640 1 --2- 172.21.15.137:0/2561721695 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f53e0068380 0x7f53e006a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5404143200 tx=0x7f53f4009040 comp rx=0 tx=0).stop 2024-04-26T23:41:53.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.793+0000 7f5409c00640 1 -- 172.21.15.137:0/2561721695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f540415de80 msgr2=0x7f54040b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:53.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.793+0000 7f5409c00640 1 --2- 172.21.15.137:0/2561721695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f540415de80 0x7f54040b45e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00efc0 tx=0x7f53fc00c490 comp rx=0 tx=0).stop 2024-04-26T23:41:53.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.793+0000 7f5409c00640 1 -- 172.21.15.137:0/2561721695 shutdown_connections 2024-04-26T23:41:53.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.793+0000 7f5409c00640 1 --2- 172.21.15.137:0/2561721695 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f53e0068380 0x7f53e006a840 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.793+0000 7f5409c00640 1 --2- 172.21.15.137:0/2561721695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f540415de80 0x7f54040b45e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.793+0000 7f5409c00640 1 --2- 172.21.15.137:0/2561721695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54040ce7c0 0x7f54040b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.793+0000 7f5409c00640 1 --2- 172.21.15.137:0/2561721695 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54040ce3e0 0x7f540415b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.793+0000 7f5409c00640 1 -- 172.21.15.137:0/2561721695 >> 172.21.15.137:0/2561721695 conn(0x7f540406c5d0 msgr2=0x7f54040b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:53.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.793+0000 7f5409c00640 1 -- 172.21.15.137:0/2561721695 shutdown_connections 2024-04-26T23:41:53.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.793+0000 7f5409c00640 1 -- 172.21.15.137:0/2561721695 wait complete. 2024-04-26T23:41:53.815 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:41:21.810449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:41:22.533452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:41:53.815 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:41:53.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.949+0000 7fef57e00640 1 Processor -- start 2024-04-26T23:41:53.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.949+0000 7fef57e00640 1 -- start start 2024-04-26T23:41:53.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.953+0000 7fef57e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fef580d27e0 0x7fef580cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:53.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.953+0000 7fef57e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef580cfa80 0x7fef580cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:53.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.953+0000 7fef57e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef580b4340 con 0x7fef580b3330 2024-04-26T23:41:53.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.953+0000 7fef57e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fef580cfef0 con 0x7fef580d27e0 2024-04-26T23:41:53.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.953+0000 7fef57e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fef580d20c0 con 0x7fef580cfa80 2024-04-26T23:41:53.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.953+0000 7fef56000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fef580d27e0 0x7fef580cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:53.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.953+0000 7fef56000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fef580d27e0 0x7fef580cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59930/0 (socket says 172.21.15.137:59930) 2024-04-26T23:41:53.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.953+0000 7fef56000640 1 -- 172.21.15.137:0/1218218151 learned_addr learned my addr 172.21.15.137:0/1218218151 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:53.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.953+0000 7fef57400640 1 --2- 172.21.15.137:0/1218218151 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef580cfa80 0x7fef580cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:53.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.953+0000 7fef56000640 1 -- 172.21.15.137:0/1218218151 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef580cfa80 msgr2=0x7fef580cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:53.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.953+0000 7fef56000640 1 --2- 172.21.15.137:0/1218218151 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef580cfa80 0x7fef580cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.953+0000 7fef56000640 1 -- 172.21.15.137:0/1218218151 >> v1:172.21.15.170:6789/0 conn(0x7fef580b3330 legacy=0x7fef580b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:53.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.953+0000 7fef56000640 1 -- 172.21.15.137:0/1218218151 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef580d1a70 con 0x7fef580d27e0 2024-04-26T23:41:53.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.953+0000 7fef56000640 1 --2- 172.21.15.137:0/1218218151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef580d27e0 0x7fef580cf540 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fef44009870 tx=0x7fef4401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631ed75def20c771 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:53.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef55600640 1 -- 172.21.15.137:0/1218218151 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef440a7070 con 0x7fef580d27e0 2024-04-26T23:41:53.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef55600640 1 -- 172.21.15.137:0/1218218151 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef440b0070 con 0x7fef580d27e0 2024-04-26T23:41:53.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef55600640 1 -- 172.21.15.137:0/1218218151 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef440ab890 con 0x7fef580d27e0 2024-04-26T23:41:53.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef57e00640 1 -- 172.21.15.137:0/1218218151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef580d27e0 msgr2=0x7fef580cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef57e00640 1 --2- 172.21.15.137:0/1218218151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef580d27e0 0x7fef580cf540 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fef44009870 tx=0x7fef4401c560 comp rx=0 tx=0).stop 2024-04-26T23:41:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef57e00640 1 -- 172.21.15.137:0/1218218151 shutdown_connections 2024-04-26T23:41:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef57e00640 1 --2- 172.21.15.137:0/1218218151 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef580cfa80 0x7fef580cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef57e00640 1 --2- 172.21.15.137:0/1218218151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef580d27e0 0x7fef580cf540 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef57e00640 1 -- 172.21.15.137:0/1218218151 >> 172.21.15.137:0/1218218151 conn(0x7fef580b4870 msgr2=0x7fef580b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef57e00640 1 -- 172.21.15.137:0/1218218151 shutdown_connections 2024-04-26T23:41:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef57e00640 1 -- 172.21.15.137:0/1218218151 wait complete. 2024-04-26T23:41:53.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef57e00640 1 Processor -- start 2024-04-26T23:41:53.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef57e00640 1 -- start start 2024-04-26T23:41:53.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef57e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef580b3330 0x7fef5815efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:53.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef57e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef580cfa80 0x7fef58154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:53.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef57e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef580d27e0 0x7fef58071290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:53.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef57e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fef580ce430 con 0x7fef580b3330 2024-04-26T23:41:53.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef57e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fef580ce2b0 con 0x7fef580d27e0 2024-04-26T23:41:53.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef57e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fef580ce5b0 con 0x7fef580cfa80 2024-04-26T23:41:53.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef56a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef580b3330 0x7fef5815efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:53.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef56a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef580b3330 0x7fef5815efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59934/0 (socket says 172.21.15.137:59934) 2024-04-26T23:41:53.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef56a00640 1 -- 172.21.15.137:0/479697757 learned_addr learned my addr 172.21.15.137:0/479697757 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:53.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.961+0000 7fef56000640 1 --2- 172.21.15.137:0/479697757 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef580cfa80 0x7fef58154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:53.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.957+0000 7fef57400640 1 --2- 172.21.15.137:0/479697757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef580d27e0 0x7fef58071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:53.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.961+0000 7fef56a00640 1 -- 172.21.15.137:0/479697757 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef580cfa80 msgr2=0x7fef58154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:53.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.961+0000 7fef56a00640 1 --2- 172.21.15.137:0/479697757 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef580cfa80 0x7fef58154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.961+0000 7fef56a00640 1 -- 172.21.15.137:0/479697757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef580d27e0 msgr2=0x7fef58071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:53.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.961+0000 7fef56a00640 1 --2- 172.21.15.137:0/479697757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef580d27e0 0x7fef58071290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:53.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.961+0000 7fef56a00640 1 -- 172.21.15.137:0/479697757 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef580b0280 con 0x7fef580b3330 2024-04-26T23:41:53.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.961+0000 7fef57400640 1 --2- 172.21.15.137:0/479697757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef580d27e0 0x7fef58071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:53.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.961+0000 7fef56a00640 1 --2- 172.21.15.137:0/479697757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef580b3330 0x7fef5815efb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fef4800c370 tx=0x7fef4800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:53.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.961+0000 7fef4ea00640 1 -- 172.21.15.137:0/479697757 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef480052d0 con 0x7fef580b3330 2024-04-26T23:41:53.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.961+0000 7fef4ea00640 1 -- 172.21.15.137:0/479697757 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef48005470 con 0x7fef580b3330 2024-04-26T23:41:53.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.961+0000 7fef4ea00640 1 -- 172.21.15.137:0/479697757 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef48007260 con 0x7fef580b3330 2024-04-26T23:41:53.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.961+0000 7fef57e00640 1 -- 172.21.15.137:0/479697757 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef580b0560 con 0x7fef580b3330 2024-04-26T23:41:53.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.961+0000 7fef57e00640 1 -- 172.21.15.137:0/479697757 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef580b0b20 con 0x7fef580b3330 2024-04-26T23:41:53.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.961+0000 7fef57e00640 1 -- 172.21.15.137:0/479697757 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef5806a300 con 0x7fef580b3330 2024-04-26T23:41:53.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.961+0000 7fef4ea00640 1 -- 172.21.15.137:0/479697757 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fef48007400 con 0x7fef580b3330 2024-04-26T23:41:53.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.961+0000 7fef4ea00640 1 --2- 172.21.15.137:0/479697757 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fef38068380 0x7fef3806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:53.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.961+0000 7fef4ea00640 1 -- 172.21.15.137:0/479697757 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fef48085db0 con 0x7fef580b3330 2024-04-26T23:41:53.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.961+0000 7fef56000640 1 --2- 172.21.15.137:0/479697757 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fef38068380 0x7fef3806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:53.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.965+0000 7fef56000640 1 --2- 172.21.15.137:0/479697757 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fef38068380 0x7fef3806a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fef440af000 tx=0x7fef440a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:53.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:53.965+0000 7fef4ea00640 1 -- 172.21.15.137:0/479697757 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fef4808a070 con 0x7fef580b3330 2024-04-26T23:41:54.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.121+0000 7fef57e00640 1 -- 172.21.15.137:0/479697757 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fef580cf110 con 0x7fef580b3330 2024-04-26T23:41:54.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.121+0000 7fef4ea00640 1 -- 172.21.15.137:0/479697757 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fef48055d10 con 0x7fef580b3330 2024-04-26T23:41:54.127 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:41:54.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.125+0000 7fef57e00640 1 -- 172.21.15.137:0/479697757 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fef38068380 msgr2=0x7fef3806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:54.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.125+0000 7fef57e00640 1 --2- 172.21.15.137:0/479697757 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fef38068380 0x7fef3806a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fef440af000 tx=0x7fef440a7000 comp rx=0 tx=0).stop 2024-04-26T23:41:54.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.125+0000 7fef57e00640 1 -- 172.21.15.137:0/479697757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef580b3330 msgr2=0x7fef5815efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:54.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.125+0000 7fef57e00640 1 --2- 172.21.15.137:0/479697757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef580b3330 0x7fef5815efb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fef4800c370 tx=0x7fef4800c830 comp rx=0 tx=0).stop 2024-04-26T23:41:54.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.125+0000 7fef57e00640 1 -- 172.21.15.137:0/479697757 shutdown_connections 2024-04-26T23:41:54.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.125+0000 7fef57e00640 1 --2- 172.21.15.137:0/479697757 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fef38068380 0x7fef3806a840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.125+0000 7fef57e00640 1 --2- 172.21.15.137:0/479697757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef580d27e0 0x7fef58071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.125+0000 7fef57e00640 1 --2- 172.21.15.137:0/479697757 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef580cfa80 0x7fef58154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.125+0000 7fef57e00640 1 --2- 172.21.15.137:0/479697757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef580b3330 0x7fef5815efb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.125+0000 7fef57e00640 1 -- 172.21.15.137:0/479697757 >> 172.21.15.137:0/479697757 conn(0x7fef580b4870 msgr2=0x7fef580b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:54.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.125+0000 7fef57e00640 1 -- 172.21.15.137:0/479697757 shutdown_connections 2024-04-26T23:41:54.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.125+0000 7fef57e00640 1 -- 172.21.15.137:0/479697757 wait complete. 2024-04-26T23:41:54.148 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:41:54.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.281+0000 7fc379600640 1 Processor -- start 2024-04-26T23:41:54.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc379600640 1 -- start start 2024-04-26T23:41:54.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc379600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc3740afbc0 0x7fc37415df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:54.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc379600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc374073f20 0x7fc3740735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:54.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc379600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc374073b20 con 0x7fc3740affa0 2024-04-26T23:41:54.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc379600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc374072860 con 0x7fc3740afbc0 2024-04-26T23:41:54.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc379600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc3740743b0 con 0x7fc374073f20 2024-04-26T23:41:54.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc373400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc3740affa0 0x7fc3740ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49166/0 (socket says 172.21.15.137:49166) 2024-04-26T23:41:54.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc373400640 1 -- 172.21.15.137:0/796705487 learned_addr learned my addr 172.21.15.137:0/796705487 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:54.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc372a00640 1 --2- 172.21.15.137:0/796705487 >> v2:172.21.15.170:3300/0 conn(0x7fc3740afbc0 0x7fc37415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:54.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc372000640 1 --2- 172.21.15.137:0/796705487 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc374073f20 0x7fc3740735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:54.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc371600640 1 -- 172.21.15.137:0/796705487 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3474373950 0 0) 0x7fc374073b20 con 0x7fc3740affa0 2024-04-26T23:41:54.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc371600640 1 -- 172.21.15.137:0/796705487 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc358003530 con 0x7fc3740affa0 2024-04-26T23:41:54.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc371600640 1 -- 172.21.15.137:0/796705487 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2450157494 0 0) 0x7fc358003530 con 0x7fc3740affa0 2024-04-26T23:41:54.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc371600640 1 -- 172.21.15.137:0/796705487 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc374073f20 msgr2=0x7fc3740735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:54.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc371600640 1 --2- 172.21.15.137:0/796705487 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc374073f20 0x7fc3740735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc371600640 1 -- 172.21.15.137:0/796705487 >> v2:172.21.15.170:3300/0 conn(0x7fc3740afbc0 msgr2=0x7fc37415df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:54.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc371600640 1 --2- 172.21.15.137:0/796705487 >> v2:172.21.15.170:3300/0 conn(0x7fc3740afbc0 0x7fc37415df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc371600640 1 -- 172.21.15.137:0/796705487 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc374072b00 con 0x7fc3740affa0 2024-04-26T23:41:54.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc371600640 1 -- 172.21.15.137:0/796705487 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fc36c001a00 con 0x7fc3740affa0 2024-04-26T23:41:54.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc371600640 1 -- 172.21.15.137:0/796705487 >> v1:172.21.15.137:6789/0 conn(0x7fc3740affa0 legacy=0x7fc3740ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:54.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc371600640 1 --2- 172.21.15.137:0/796705487 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc3580039c0 0x7fc358003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:54.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc371600640 1 --2- 172.21.15.137:0/796705487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3580043b0 0x7fc358004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:54.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc371600640 1 --2- 172.21.15.137:0/796705487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc358004f00 0x7fc35800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:54.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc371600640 1 -- 172.21.15.137:0/796705487 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc374072860 con 0x7fc3580043b0 2024-04-26T23:41:54.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc371600640 1 -- 172.21.15.137:0/796705487 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc3740743b0 con 0x7fc358004f00 2024-04-26T23:41:54.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc371600640 1 -- 172.21.15.137:0/796705487 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc35800bf10 con 0x7fc3580039c0 2024-04-26T23:41:54.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc372a00640 1 --2- 172.21.15.137:0/796705487 >> v2:172.21.15.170:3300/0 conn(0x7fc3740afbc0 0x7fc37415df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:41:54.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc372000640 1 --2- 172.21.15.137:0/796705487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3580043b0 0x7fc358004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:54.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc373400640 1 --2- 172.21.15.137:0/796705487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc358004f00 0x7fc35800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:54.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc372a00640 1 --2- 172.21.15.137:0/796705487 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc3580039c0 0x7fc358003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:54.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc372000640 1 -- 172.21.15.137:0/796705487 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc3580039c0 msgr2=0x7fc358003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:54.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc372000640 1 --2- 172.21.15.137:0/796705487 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc3580039c0 0x7fc358003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc372000640 1 -- 172.21.15.137:0/796705487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc358004f00 msgr2=0x7fc35800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:54.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc372000640 1 --2- 172.21.15.137:0/796705487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc358004f00 0x7fc35800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.285+0000 7fc372000640 1 -- 172.21.15.137:0/796705487 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc358003530 con 0x7fc3580043b0 2024-04-26T23:41:54.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.289+0000 7fc372000640 1 --2- 172.21.15.137:0/796705487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3580043b0 0x7fc358004890 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc3600099a0 tx=0x7fc36001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a85f66717d24868 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:54.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.289+0000 7fc371600640 1 -- 172.21.15.137:0/796705487 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3600b2070 con 0x7fc3580043b0 2024-04-26T23:41:54.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.289+0000 7fc371600640 1 -- 172.21.15.137:0/796705487 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3600a5520 con 0x7fc3580043b0 2024-04-26T23:41:54.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.289+0000 7fc371600640 1 -- 172.21.15.137:0/796705487 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360009670 con 0x7fc3580043b0 2024-04-26T23:41:54.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.289+0000 7fc379600640 1 -- 172.21.15.137:0/796705487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3580043b0 msgr2=0x7fc358004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:54.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.289+0000 7fc379600640 1 --2- 172.21.15.137:0/796705487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3580043b0 0x7fc358004890 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc3600099a0 tx=0x7fc36001c930 comp rx=0 tx=0).stop 2024-04-26T23:41:54.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.289+0000 7fc373400640 1 -- 172.21.15.137:0/796705487 reap_dead start 2024-04-26T23:41:54.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.289+0000 7fc379600640 1 -- 172.21.15.137:0/796705487 shutdown_connections 2024-04-26T23:41:54.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.289+0000 7fc379600640 1 -- 172.21.15.137:0/796705487 >> 172.21.15.137:0/796705487 conn(0x7fc37406c800 msgr2=0x7fc37406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:54.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.289+0000 7fc379600640 1 -- 172.21.15.137:0/796705487 shutdown_connections 2024-04-26T23:41:54.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.289+0000 7fc379600640 1 -- 172.21.15.137:0/796705487 wait complete. 2024-04-26T23:41:54.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc379600640 1 Processor -- start 2024-04-26T23:41:54.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc379600640 1 -- start start 2024-04-26T23:41:54.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc379600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc3580043b0 0x7fc3741e5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:54.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc379600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc37414f240 0x7fc374154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:54.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc379600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3741547a0 0x7fc374150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:54.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc379600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc3740d0850 con 0x7fc3741547a0 2024-04-26T23:41:54.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc379600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc3740730c0 con 0x7fc37414f240 2024-04-26T23:41:54.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc379600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc3740ceac0 con 0x7fc3580043b0 2024-04-26T23:41:54.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc373400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3741547a0 0x7fc374150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:54.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc373400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3741547a0 0x7fc374150fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59958/0 (socket says 172.21.15.137:59958) 2024-04-26T23:41:54.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc373400640 1 -- 172.21.15.137:0/1429266169 learned_addr learned my addr 172.21.15.137:0/1429266169 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:54.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc372000640 1 --2- 172.21.15.137:0/1429266169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc37414f240 0x7fc374154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:54.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc372a00640 1 --2- 172.21.15.137:0/1429266169 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc3580043b0 0x7fc3741e5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:54.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc372000640 1 -- 172.21.15.137:0/1429266169 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc3580043b0 msgr2=0x7fc3741e5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:54.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc372000640 1 --2- 172.21.15.137:0/1429266169 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc3580043b0 0x7fc3741e5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc372000640 1 -- 172.21.15.137:0/1429266169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3741547a0 msgr2=0x7fc374150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:54.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc372000640 1 --2- 172.21.15.137:0/1429266169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3741547a0 0x7fc374150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc372000640 1 -- 172.21.15.137:0/1429266169 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37413c170 con 0x7fc37414f240 2024-04-26T23:41:54.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc373400640 1 --2- 172.21.15.137:0/1429266169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3741547a0 0x7fc374150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:41:54.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc372000640 1 --2- 172.21.15.137:0/1429266169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc37414f240 0x7fc374154260 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc3600ac000 tx=0x7fc358005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:54.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc36aa00640 1 -- 172.21.15.137:0/1429266169 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3600b2040 con 0x7fc37414f240 2024-04-26T23:41:54.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc36aa00640 1 -- 172.21.15.137:0/1429266169 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3600a56d0 con 0x7fc37414f240 2024-04-26T23:41:54.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc379600640 1 -- 172.21.15.137:0/1429266169 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc37413c450 con 0x7fc37414f240 2024-04-26T23:41:54.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc36aa00640 1 -- 172.21.15.137:0/1429266169 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3600a5aa0 con 0x7fc37414f240 2024-04-26T23:41:54.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.293+0000 7fc379600640 1 -- 172.21.15.137:0/1429266169 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc37413ca10 con 0x7fc37414f240 2024-04-26T23:41:54.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.297+0000 7fc379600640 1 -- 172.21.15.137:0/1429266169 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc37406a410 con 0x7fc37414f240 2024-04-26T23:41:54.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.297+0000 7fc36aa00640 1 -- 172.21.15.137:0/1429266169 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc3600bf020 con 0x7fc37414f240 2024-04-26T23:41:54.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.297+0000 7fc36aa00640 1 --2- 172.21.15.137:0/1429266169 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc354068380 0x7fc35406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:54.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.297+0000 7fc36aa00640 1 -- 172.21.15.137:0/1429266169 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc3601200f0 con 0x7fc37414f240 2024-04-26T23:41:54.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.297+0000 7fc372a00640 1 --2- 172.21.15.137:0/1429266169 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc354068380 0x7fc35406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:54.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.297+0000 7fc372a00640 1 --2- 172.21.15.137:0/1429266169 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc354068380 0x7fc35406a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc3640093f0 tx=0x7fc364008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:54.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.301+0000 7fc36aa00640 1 -- 172.21.15.137:0/1429266169 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc360016680 con 0x7fc37414f240 2024-04-26T23:41:54.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.457+0000 7fc379600640 1 -- 172.21.15.137:0/1429266169 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc37406cc10 con 0x7fc37414f240 2024-04-26T23:41:54.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.457+0000 7fc36aa00640 1 -- 172.21.15.137:0/1429266169 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fc3600effd0 con 0x7fc37414f240 2024-04-26T23:41:54.462 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:41:54.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.461+0000 7fc379600640 1 -- 172.21.15.137:0/1429266169 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc354068380 msgr2=0x7fc35406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:54.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.461+0000 7fc379600640 1 --2- 172.21.15.137:0/1429266169 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc354068380 0x7fc35406a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc3640093f0 tx=0x7fc364008040 comp rx=0 tx=0).stop 2024-04-26T23:41:54.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.461+0000 7fc379600640 1 -- 172.21.15.137:0/1429266169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc37414f240 msgr2=0x7fc374154260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:54.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.461+0000 7fc379600640 1 --2- 172.21.15.137:0/1429266169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc37414f240 0x7fc374154260 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc3600ac000 tx=0x7fc358005840 comp rx=0 tx=0).stop 2024-04-26T23:41:54.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.461+0000 7fc379600640 1 -- 172.21.15.137:0/1429266169 shutdown_connections 2024-04-26T23:41:54.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.461+0000 7fc379600640 1 --2- 172.21.15.137:0/1429266169 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc354068380 0x7fc35406a840 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.461+0000 7fc379600640 1 --2- 172.21.15.137:0/1429266169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3741547a0 0x7fc374150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.461+0000 7fc379600640 1 --2- 172.21.15.137:0/1429266169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc37414f240 0x7fc374154260 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.461+0000 7fc379600640 1 --2- 172.21.15.137:0/1429266169 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc3580043b0 0x7fc3741e5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.461+0000 7fc379600640 1 -- 172.21.15.137:0/1429266169 >> 172.21.15.137:0/1429266169 conn(0x7fc37406c800 msgr2=0x7fc3740b04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:54.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.461+0000 7fc379600640 1 -- 172.21.15.137:0/1429266169 shutdown_connections 2024-04-26T23:41:54.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.461+0000 7fc379600640 1 -- 172.21.15.137:0/1429266169 wait complete. 2024-04-26T23:41:54.483 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:41:54.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.617+0000 7f4e83600640 1 Processor -- start 2024-04-26T23:41:54.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.617+0000 7f4e83600640 1 -- start start 2024-04-26T23:41:54.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.617+0000 7f4e83600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4e7c072930 0x7f4e7c072de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:54.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.617+0000 7f4e83600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7c0b59a0 con 0x7f4e7c0afc80 2024-04-26T23:41:54.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.617+0000 7f4e83600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7c0b5c50 con 0x7f4e7c159560 2024-04-26T23:41:54.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.617+0000 7f4e83600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4e7c0b5f30 con 0x7f4e7c072930 2024-04-26T23:41:54.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.617+0000 7f4e81600640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4e7c0afc80 0x7f4e7c0b00d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49172/0 (socket says 172.21.15.137:49172) 2024-04-26T23:41:54.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.617+0000 7f4e81600640 1 -- 172.21.15.137:0/2697840915 learned_addr learned my addr 172.21.15.137:0/2697840915 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:54.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.617+0000 7f4e7be00640 1 --2- 172.21.15.137:0/2697840915 >> v2:172.21.15.137:3300/0 conn(0x7f4e7c072930 0x7f4e7c072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:54.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.621+0000 7f4e7b400640 1 -- 172.21.15.137:0/2697840915 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1926499984 0 0) 0x7f4e7c0b59a0 con 0x7f4e7c0afc80 2024-04-26T23:41:54.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.621+0000 7f4e7b400640 1 -- 172.21.15.137:0/2697840915 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e60003530 con 0x7f4e7c0afc80 2024-04-26T23:41:54.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.621+0000 7f4e7be00640 1 -- 172.21.15.137:0/2697840915 >> v1:172.21.15.170:6789/0 conn(0x7f4e7c159560 legacy=0x7f4e7c0b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:54.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.621+0000 7f4e7b400640 1 -- 172.21.15.137:0/2697840915 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2435817446 0 0) 0x7f4e7c0b5c50 con 0x7f4e7c159560 2024-04-26T23:41:54.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.621+0000 7f4e7be00640 1 -- 172.21.15.137:0/2697840915 >> v1:172.21.15.137:6789/0 conn(0x7f4e7c0afc80 legacy=0x7f4e7c0b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:54.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.621+0000 7f4e7be00640 1 -- 172.21.15.137:0/2697840915 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7c0b6210 con 0x7f4e7c072930 2024-04-26T23:41:54.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.621+0000 7f4e7be00640 1 --2- 172.21.15.137:0/2697840915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c072930 0x7f4e7c072de0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4e680097c0 tx=0x7f4e6801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb680c52ea64d66a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:54.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.621+0000 7f4e7b400640 1 -- 172.21.15.137:0/2697840915 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e680b0070 con 0x7f4e7c072930 2024-04-26T23:41:54.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.621+0000 7f4e7b400640 1 -- 172.21.15.137:0/2697840915 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e680ab600 con 0x7f4e7c072930 2024-04-26T23:41:54.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.621+0000 7f4e7b400640 1 -- 172.21.15.137:0/2697840915 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e680ab9d0 con 0x7f4e7c072930 2024-04-26T23:41:54.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e83600640 1 -- 172.21.15.137:0/2697840915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c072930 msgr2=0x7f4e7c072de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:54.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e83600640 1 --2- 172.21.15.137:0/2697840915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c072930 0x7f4e7c072de0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4e680097c0 tx=0x7f4e6801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e83600640 1 -- 172.21.15.137:0/2697840915 shutdown_connections 2024-04-26T23:41:54.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e83600640 1 --2- 172.21.15.137:0/2697840915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c072930 0x7f4e7c072de0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e83600640 1 -- 172.21.15.137:0/2697840915 >> 172.21.15.137:0/2697840915 conn(0x7f4e7c0b3370 msgr2=0x7f4e7c0b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:54.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e83600640 1 -- 172.21.15.137:0/2697840915 shutdown_connections 2024-04-26T23:41:54.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e83600640 1 -- 172.21.15.137:0/2697840915 wait complete. 2024-04-26T23:41:54.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e83600640 1 Processor -- start 2024-04-26T23:41:54.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e83600640 1 -- start start 2024-04-26T23:41:54.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e83600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e7c072930 0x7f4e7c155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:54.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e83600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e7c0afc80 0x7f4e7c14a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:54.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e83600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c159560 0x7f4e7c14d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:54.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e83600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7c15f950 con 0x7f4e7c159560 2024-04-26T23:41:54.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e83600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7c15f7d0 con 0x7f4e7c0afc80 2024-04-26T23:41:54.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e83600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4e7c16cd80 con 0x7f4e7c072930 2024-04-26T23:41:54.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e81600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c159560 0x7f4e7c14d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:54.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e81600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c159560 0x7f4e7c14d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59974/0 (socket says 172.21.15.137:59974) 2024-04-26T23:41:54.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e81600640 1 -- 172.21.15.137:0/3168479884 learned_addr learned my addr 172.21.15.137:0/3168479884 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:54.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e7be00640 1 --2- 172.21.15.137:0/3168479884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e7c0afc80 0x7f4e7c14a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:54.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e80c00640 1 --2- 172.21.15.137:0/3168479884 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e7c072930 0x7f4e7c155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:54.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e81600640 1 -- 172.21.15.137:0/3168479884 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e7c072930 msgr2=0x7f4e7c155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:54.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e81600640 1 --2- 172.21.15.137:0/3168479884 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e7c072930 0x7f4e7c155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e81600640 1 -- 172.21.15.137:0/3168479884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e7c0afc80 msgr2=0x7f4e7c14a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:54.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e81600640 1 --2- 172.21.15.137:0/3168479884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e7c0afc80 0x7f4e7c14a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e81600640 1 -- 172.21.15.137:0/3168479884 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7c151fd0 con 0x7f4e7c159560 2024-04-26T23:41:54.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e80c00640 1 --2- 172.21.15.137:0/3168479884 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e7c072930 0x7f4e7c155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:54.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e7be00640 1 --2- 172.21.15.137:0/3168479884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e7c0afc80 0x7f4e7c14a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:54.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e81600640 1 --2- 172.21.15.137:0/3168479884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c159560 0x7f4e7c14d880 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400c450 tx=0x7f4e7400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:54.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.625+0000 7f4e78c00640 1 -- 172.21.15.137:0/3168479884 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e74017070 con 0x7f4e7c159560 2024-04-26T23:41:54.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.629+0000 7f4e78c00640 1 -- 172.21.15.137:0/3168479884 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e74005cf0 con 0x7f4e7c159560 2024-04-26T23:41:54.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.629+0000 7f4e83600640 1 -- 172.21.15.137:0/3168479884 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e7c162370 con 0x7f4e7c159560 2024-04-26T23:41:54.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.629+0000 7f4e78c00640 1 -- 172.21.15.137:0/3168479884 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e740072b0 con 0x7f4e7c159560 2024-04-26T23:41:54.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.629+0000 7f4e83600640 1 -- 172.21.15.137:0/3168479884 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e7c152520 con 0x7f4e7c159560 2024-04-26T23:41:54.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.629+0000 7f4e83600640 1 -- 172.21.15.137:0/3168479884 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e7c06a410 con 0x7f4e7c159560 2024-04-26T23:41:54.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.629+0000 7f4e78c00640 1 -- 172.21.15.137:0/3168479884 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4e7401a070 con 0x7f4e7c159560 2024-04-26T23:41:54.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.629+0000 7f4e78c00640 1 --2- 172.21.15.137:0/3168479884 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4e5c068380 0x7f4e5c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:54.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.629+0000 7f4e78c00640 1 -- 172.21.15.137:0/3168479884 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4e74085e00 con 0x7f4e7c159560 2024-04-26T23:41:54.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.629+0000 7f4e80c00640 1 --2- 172.21.15.137:0/3168479884 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4e5c068380 0x7f4e5c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:54.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.633+0000 7f4e80c00640 1 --2- 172.21.15.137:0/3168479884 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4e5c068380 0x7f4e5c06a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c007fd0 tx=0x7f4e6c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:54.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.633+0000 7f4e78c00640 1 -- 172.21.15.137:0/3168479884 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4e74056320 con 0x7f4e7c159560 2024-04-26T23:41:54.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.793+0000 7f4e83600640 1 -- 172.21.15.137:0/3168479884 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4e7c1583e0 con 0x7f4e7c159560 2024-04-26T23:41:54.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.793+0000 7f4e78c00640 1 -- 172.21.15.137:0/3168479884 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f4e74055c20 con 0x7f4e7c159560 2024-04-26T23:41:54.798 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:41:54.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.797+0000 7f4e83600640 1 -- 172.21.15.137:0/3168479884 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4e5c068380 msgr2=0x7f4e5c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:54.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.797+0000 7f4e83600640 1 --2- 172.21.15.137:0/3168479884 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4e5c068380 0x7f4e5c06a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c007fd0 tx=0x7f4e6c009040 comp rx=0 tx=0).stop 2024-04-26T23:41:54.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.797+0000 7f4e83600640 1 -- 172.21.15.137:0/3168479884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c159560 msgr2=0x7f4e7c14d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:54.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.797+0000 7f4e83600640 1 --2- 172.21.15.137:0/3168479884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c159560 0x7f4e7c14d880 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400c450 tx=0x7f4e7400c910 comp rx=0 tx=0).stop 2024-04-26T23:41:54.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.797+0000 7f4e83600640 1 -- 172.21.15.137:0/3168479884 shutdown_connections 2024-04-26T23:41:54.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.797+0000 7f4e83600640 1 --2- 172.21.15.137:0/3168479884 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4e5c068380 0x7f4e5c06a840 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.797+0000 7f4e83600640 1 --2- 172.21.15.137:0/3168479884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c159560 0x7f4e7c14d880 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.797+0000 7f4e83600640 1 --2- 172.21.15.137:0/3168479884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e7c0afc80 0x7f4e7c14a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.797+0000 7f4e83600640 1 --2- 172.21.15.137:0/3168479884 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e7c072930 0x7f4e7c155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.797+0000 7f4e83600640 1 -- 172.21.15.137:0/3168479884 >> 172.21.15.137:0/3168479884 conn(0x7f4e7c0b3370 msgr2=0x7f4e7c0b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:54.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.797+0000 7f4e83600640 1 -- 172.21.15.137:0/3168479884 shutdown_connections 2024-04-26T23:41:54.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.797+0000 7f4e83600640 1 -- 172.21.15.137:0/3168479884 wait complete. 2024-04-26T23:41:54.820 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close' 2024-04-26T23:41:54.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.953+0000 7f8282e00640 1 Processor -- start 2024-04-26T23:41:54.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.953+0000 7f8282e00640 1 -- start start 2024-04-26T23:41:54.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.953+0000 7f8282e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f827c148950 0x7f827c15fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:54.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.953+0000 7f8282e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f827c148d30 con 0x7f827c0b4ad0 2024-04-26T23:41:54.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.953+0000 7f8282e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f827c073540 con 0x7f827c06f8a0 2024-04-26T23:41:54.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.953+0000 7f8282e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f827c073820 con 0x7f827c148950 2024-04-26T23:41:54.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.953+0000 7f8273400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f827c0b4ad0 0x7f827c06f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49186/0 (socket says 172.21.15.137:49186) 2024-04-26T23:41:54.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.953+0000 7f8273400640 1 -- 172.21.15.137:0/2836676227 learned_addr learned my addr 172.21.15.137:0/2836676227 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:54.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.953+0000 7f827be00640 1 --2- 172.21.15.137:0/2836676227 >> v2:172.21.15.170:3300/0 conn(0x7f827c148950 0x7f827c15fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:54.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.957+0000 7f827b400640 1 -- 172.21.15.137:0/2836676227 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4027596520 0 0) 0x7f827c148d30 con 0x7f827c0b4ad0 2024-04-26T23:41:54.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.957+0000 7f827b400640 1 -- 172.21.15.137:0/2836676227 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8260003530 con 0x7f827c0b4ad0 2024-04-26T23:41:54.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.957+0000 7f827b400640 1 -- 172.21.15.137:0/2836676227 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3834727930 0 0) 0x7f827c073540 con 0x7f827c06f8a0 2024-04-26T23:41:54.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.957+0000 7f827b400640 1 -- 172.21.15.137:0/2836676227 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f827c148d30 con 0x7f827c06f8a0 2024-04-26T23:41:54.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.957+0000 7f827be00640 1 -- 172.21.15.137:0/2836676227 >> v1:172.21.15.170:6789/0 conn(0x7f827c06f8a0 legacy=0x7f827c0ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:54.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.957+0000 7f827be00640 1 -- 172.21.15.137:0/2836676227 >> v1:172.21.15.137:6789/0 conn(0x7f827c0b4ad0 legacy=0x7f827c06f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:54.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.957+0000 7f827b400640 1 -- 172.21.15.137:0/2836676227 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2416384430 0 0) 0x7f8260003530 con 0x7f827c0b4ad0 2024-04-26T23:41:54.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.957+0000 7f827be00640 1 -- 172.21.15.137:0/2836676227 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827c073b00 con 0x7f827c148950 2024-04-26T23:41:54.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.957+0000 7f827be00640 1 --2- 172.21.15.137:0/2836676227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f827c148950 0x7f827c15fdc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f826c0097c0 tx=0x7f826c01c1b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c80fa10ed3f25764 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:54.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.957+0000 7f827b400640 1 -- 172.21.15.137:0/2836676227 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c0b0070 con 0x7f827c148950 2024-04-26T23:41:54.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.957+0000 7f827b400640 1 -- 172.21.15.137:0/2836676227 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f826c0ab400 con 0x7f827c148950 2024-04-26T23:41:54.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.957+0000 7f827b400640 1 -- 172.21.15.137:0/2836676227 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8264001680 con 0x7f827c148950 2024-04-26T23:41:54.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f8282e00640 1 -- 172.21.15.137:0/2836676227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f827c148950 msgr2=0x7f827c15fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:54.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f8282e00640 1 --2- 172.21.15.137:0/2836676227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f827c148950 0x7f827c15fdc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f826c0097c0 tx=0x7f826c01c1b0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f8282e00640 1 -- 172.21.15.137:0/2836676227 shutdown_connections 2024-04-26T23:41:54.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f8282e00640 1 --2- 172.21.15.137:0/2836676227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f827c148950 0x7f827c15fdc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f8282e00640 1 -- 172.21.15.137:0/2836676227 >> 172.21.15.137:0/2836676227 conn(0x7f827c06c5d0 msgr2=0x7f827c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:54.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f8282e00640 1 -- 172.21.15.137:0/2836676227 shutdown_connections 2024-04-26T23:41:54.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f8282e00640 1 -- 172.21.15.137:0/2836676227 wait complete. 2024-04-26T23:41:54.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f8282e00640 1 Processor -- start 2024-04-26T23:41:54.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f8282e00640 1 -- start start 2024-04-26T23:41:54.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f8282e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f827c06f8a0 0x7f827c15d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:54.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f8282e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f827c0b4ad0 0x7f827c15ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:54.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f8282e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f827c148950 0x7f827c146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:54.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f8282e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f827c160480 con 0x7f827c06f8a0 2024-04-26T23:41:54.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f8282e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f827c160300 con 0x7f827c148950 2024-04-26T23:41:54.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f8282e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f827c16cc60 con 0x7f827c0b4ad0 2024-04-26T23:41:54.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f827be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f827c06f8a0 0x7f827c15d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:54.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f827be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f827c06f8a0 0x7f827c15d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59978/0 (socket says 172.21.15.137:59978) 2024-04-26T23:41:54.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f827be00640 1 -- 172.21.15.137:0/4100132537 learned_addr learned my addr 172.21.15.137:0/4100132537 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:54.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f8280e00640 1 --2- 172.21.15.137:0/4100132537 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f827c148950 0x7f827c146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:54.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f8273400640 1 --2- 172.21.15.137:0/4100132537 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f827c0b4ad0 0x7f827c15ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:54.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f827be00640 1 -- 172.21.15.137:0/4100132537 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f827c0b4ad0 msgr2=0x7f827c15ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:54.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f827be00640 1 --2- 172.21.15.137:0/4100132537 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f827c0b4ad0 0x7f827c15ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f827be00640 1 -- 172.21.15.137:0/4100132537 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f827c148950 msgr2=0x7f827c146c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:54.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f827be00640 1 --2- 172.21.15.137:0/4100132537 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f827c148950 0x7f827c146c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:54.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f827be00640 1 -- 172.21.15.137:0/4100132537 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827c15dc70 con 0x7f827c06f8a0 2024-04-26T23:41:54.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f8280e00640 1 --2- 172.21.15.137:0/4100132537 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f827c148950 0x7f827c146c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:54.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.961+0000 7f827be00640 1 --2- 172.21.15.137:0/4100132537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f827c06f8a0 0x7f827c15d5b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f826c0ae040 tx=0x7f826c01a9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:54.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.965+0000 7f8278c00640 1 -- 172.21.15.137:0/4100132537 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c0bb020 con 0x7f827c06f8a0 2024-04-26T23:41:54.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.965+0000 7f8278c00640 1 -- 172.21.15.137:0/4100132537 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f826c0b1040 con 0x7f827c06f8a0 2024-04-26T23:41:54.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.965+0000 7f8282e00640 1 -- 172.21.15.137:0/4100132537 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f827c15df50 con 0x7f827c06f8a0 2024-04-26T23:41:54.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.965+0000 7f8278c00640 1 -- 172.21.15.137:0/4100132537 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c0b0050 con 0x7f827c06f8a0 2024-04-26T23:41:54.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.965+0000 7f8282e00640 1 -- 172.21.15.137:0/4100132537 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f827c15e510 con 0x7f827c06f8a0 2024-04-26T23:41:54.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.965+0000 7f8282e00640 1 -- 172.21.15.137:0/4100132537 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f827c06a4b0 con 0x7f827c06f8a0 2024-04-26T23:41:54.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.965+0000 7f8278c00640 1 -- 172.21.15.137:0/4100132537 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f826c0be070 con 0x7f827c06f8a0 2024-04-26T23:41:54.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.965+0000 7f8278c00640 1 --2- 172.21.15.137:0/4100132537 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8258068380 0x7f825806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:54.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.965+0000 7f8278c00640 1 -- 172.21.15.137:0/4100132537 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f826c11ffe0 con 0x7f827c06f8a0 2024-04-26T23:41:54.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.965+0000 7f8273400640 1 --2- 172.21.15.137:0/4100132537 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8258068380 0x7f825806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:54.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.965+0000 7f8273400640 1 --2- 172.21.15.137:0/4100132537 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8258068380 0x7f825806a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f827c1442b0 tx=0x7f8264009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:54.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:54.969+0000 7f8278c00640 1 -- 172.21.15.137:0/4100132537 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f827c0af7f0 con 0x7f827c06f8a0 2024-04-26T23:41:55.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.181+0000 7f8282e00640 1 -- 172.21.15.137:0/4100132537 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]} v 0) -- 0x7f827c144320 con 0x7f827c06f8a0 2024-04-26T23:41:55.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.717+0000 7f8278c00640 1 -- 172.21.15.137:0/4100132537 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]}]=0 v56) ==== 147+0+0 (secure 0 0 0) 0x7f826c0f0560 con 0x7f827c06f8a0 2024-04-26T23:41:55.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.721+0000 7f8282e00640 1 -- 172.21.15.137:0/4100132537 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8258068380 msgr2=0x7f825806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:55.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.721+0000 7f8282e00640 1 --2- 172.21.15.137:0/4100132537 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8258068380 0x7f825806a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f827c1442b0 tx=0x7f8264009040 comp rx=0 tx=0).stop 2024-04-26T23:41:55.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.721+0000 7f8282e00640 1 -- 172.21.15.137:0/4100132537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f827c06f8a0 msgr2=0x7f827c15d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:55.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.721+0000 7f8282e00640 1 --2- 172.21.15.137:0/4100132537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f827c06f8a0 0x7f827c15d5b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f826c0ae040 tx=0x7f826c01a9f0 comp rx=0 tx=0).stop 2024-04-26T23:41:55.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.721+0000 7f8282e00640 1 -- 172.21.15.137:0/4100132537 shutdown_connections 2024-04-26T23:41:55.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.721+0000 7f8282e00640 1 --2- 172.21.15.137:0/4100132537 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8258068380 0x7f825806a840 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:55.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.721+0000 7f8282e00640 1 --2- 172.21.15.137:0/4100132537 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f827c148950 0x7f827c146c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:55.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.721+0000 7f8282e00640 1 --2- 172.21.15.137:0/4100132537 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f827c0b4ad0 0x7f827c15ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:55.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.721+0000 7f8282e00640 1 --2- 172.21.15.137:0/4100132537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f827c06f8a0 0x7f827c15d5b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:55.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.721+0000 7f8282e00640 1 -- 172.21.15.137:0/4100132537 >> 172.21.15.137:0/4100132537 conn(0x7f827c06c5d0 msgr2=0x7f827c15fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:55.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.721+0000 7f8282e00640 1 -- 172.21.15.137:0/4100132537 shutdown_connections 2024-04-26T23:41:55.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.721+0000 7f8282e00640 1 -- 172.21.15.137:0/4100132537 wait complete. 2024-04-26T23:41:55.746 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T23:41:55.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.885+0000 7fc992e00640 1 Processor -- start 2024-04-26T23:41:55.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.885+0000 7fc992e00640 1 -- start start 2024-04-26T23:41:55.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.885+0000 7fc992e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc98c072930 0x7fc98c072db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:55.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.885+0000 7fc992e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc98c0b59a0 con 0x7fc98c159560 2024-04-26T23:41:55.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.885+0000 7fc992e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc98c0b5c50 con 0x7fc98c0afc80 2024-04-26T23:41:55.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.885+0000 7fc992e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc98c0b5f30 con 0x7fc98c072930 2024-04-26T23:41:55.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.889+0000 7fc98be00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc98c159560 0x7fc98c0b5290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49190/0 (socket says 172.21.15.137:49190) 2024-04-26T23:41:55.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.889+0000 7fc98be00640 1 -- 172.21.15.137:0/3610541246 learned_addr learned my addr 172.21.15.137:0/3610541246 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:55.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.889+0000 7fc983400640 1 --2- 172.21.15.137:0/3610541246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc98c072930 0x7fc98c072db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:55.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.889+0000 7fc98b400640 1 -- 172.21.15.137:0/3610541246 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2653672525 0 0) 0x7fc98c0b59a0 con 0x7fc98c159560 2024-04-26T23:41:55.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.889+0000 7fc98b400640 1 -- 172.21.15.137:0/3610541246 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc970003530 con 0x7fc98c159560 2024-04-26T23:41:55.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.889+0000 7fc98b400640 1 -- 172.21.15.137:0/3610541246 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2907972128 0 0) 0x7fc98c0b5c50 con 0x7fc98c0afc80 2024-04-26T23:41:55.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.889+0000 7fc98b400640 1 -- 172.21.15.137:0/3610541246 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc98c0b59a0 con 0x7fc98c0afc80 2024-04-26T23:41:55.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.889+0000 7fc983400640 1 -- 172.21.15.137:0/3610541246 >> v1:172.21.15.170:6789/0 conn(0x7fc98c0afc80 legacy=0x7fc98c0b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:55.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.889+0000 7fc983400640 1 -- 172.21.15.137:0/3610541246 >> v1:172.21.15.137:6789/0 conn(0x7fc98c159560 legacy=0x7fc98c0b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:55.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.889+0000 7fc983400640 1 -- 172.21.15.137:0/3610541246 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98c0b6210 con 0x7fc98c072930 2024-04-26T23:41:55.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.889+0000 7fc983400640 1 --2- 172.21.15.137:0/3610541246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc98c072930 0x7fc98c072db0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc9740097f0 tx=0x7fc97401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5627353a7793b161 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:55.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc98b400640 1 -- 172.21.15.137:0/3610541246 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9740b0070 con 0x7fc98c072930 2024-04-26T23:41:55.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc98b400640 1 -- 172.21.15.137:0/3610541246 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9740ab600 con 0x7fc98c072930 2024-04-26T23:41:55.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc98b400640 1 -- 172.21.15.137:0/3610541246 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9740ab9b0 con 0x7fc98c072930 2024-04-26T23:41:55.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc992e00640 1 -- 172.21.15.137:0/3610541246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc98c072930 msgr2=0x7fc98c072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:55.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc992e00640 1 --2- 172.21.15.137:0/3610541246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc98c072930 0x7fc98c072db0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc9740097f0 tx=0x7fc97401c4e0 comp rx=0 tx=0).stop 2024-04-26T23:41:55.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc992e00640 1 -- 172.21.15.137:0/3610541246 shutdown_connections 2024-04-26T23:41:55.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc992e00640 1 --2- 172.21.15.137:0/3610541246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc98c072930 0x7fc98c072db0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:55.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc992e00640 1 -- 172.21.15.137:0/3610541246 >> 172.21.15.137:0/3610541246 conn(0x7fc98c0b3370 msgr2=0x7fc98c0b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:55.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc992e00640 1 -- 172.21.15.137:0/3610541246 shutdown_connections 2024-04-26T23:41:55.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc992e00640 1 -- 172.21.15.137:0/3610541246 wait complete. 2024-04-26T23:41:55.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc992e00640 1 Processor -- start 2024-04-26T23:41:55.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc992e00640 1 -- start start 2024-04-26T23:41:55.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc992e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc98c072930 0x7fc98c155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:55.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc992e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc98c0afc80 0x7fc98c13ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:55.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc992e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc98c159560 0x7fc98c14d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:55.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc992e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c15f7d0 con 0x7fc98c159560 2024-04-26T23:41:55.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc992e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c159b50 con 0x7fc98c0afc80 2024-04-26T23:41:55.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc992e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc98c15f950 con 0x7fc98c072930 2024-04-26T23:41:55.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc990e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc98c159560 0x7fc98c14d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:55.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc990e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc98c159560 0x7fc98c14d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59990/0 (socket says 172.21.15.137:59990) 2024-04-26T23:41:55.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc990e00640 1 -- 172.21.15.137:0/2085370006 learned_addr learned my addr 172.21.15.137:0/2085370006 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:55.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc98be00640 1 --2- 172.21.15.137:0/2085370006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc98c072930 0x7fc98c155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:55.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.893+0000 7fc983400640 1 --2- 172.21.15.137:0/2085370006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc98c0afc80 0x7fc98c13ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:55.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.897+0000 7fc990e00640 1 -- 172.21.15.137:0/2085370006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc98c072930 msgr2=0x7fc98c155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:55.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.897+0000 7fc990e00640 1 --2- 172.21.15.137:0/2085370006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc98c072930 0x7fc98c155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:55.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.897+0000 7fc990e00640 1 -- 172.21.15.137:0/2085370006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc98c0afc80 msgr2=0x7fc98c13ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:55.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.897+0000 7fc990e00640 1 --2- 172.21.15.137:0/2085370006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc98c0afc80 0x7fc98c13ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:55.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.897+0000 7fc990e00640 1 -- 172.21.15.137:0/2085370006 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98c14dd30 con 0x7fc98c159560 2024-04-26T23:41:55.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.897+0000 7fc990e00640 1 --2- 172.21.15.137:0/2085370006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc98c159560 0x7fc98c14d7f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc98400c440 tx=0x7fc98400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:55.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.897+0000 7fc988c00640 1 -- 172.21.15.137:0/2085370006 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9840052d0 con 0x7fc98c159560 2024-04-26T23:41:55.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.897+0000 7fc988c00640 1 -- 172.21.15.137:0/2085370006 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc984005470 con 0x7fc98c159560 2024-04-26T23:41:55.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.897+0000 7fc988c00640 1 -- 172.21.15.137:0/2085370006 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc984012850 con 0x7fc98c159560 2024-04-26T23:41:55.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.897+0000 7fc992e00640 1 -- 172.21.15.137:0/2085370006 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc98c14dfd0 con 0x7fc98c159560 2024-04-26T23:41:55.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.897+0000 7fc992e00640 1 -- 172.21.15.137:0/2085370006 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc98c14e590 con 0x7fc98c159560 2024-04-26T23:41:55.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.897+0000 7fc992e00640 1 -- 172.21.15.137:0/2085370006 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc98c06a410 con 0x7fc98c159560 2024-04-26T23:41:55.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.897+0000 7fc988c00640 1 -- 172.21.15.137:0/2085370006 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc9840129f0 con 0x7fc98c159560 2024-04-26T23:41:55.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.897+0000 7fc988c00640 1 --2- 172.21.15.137:0/2085370006 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc968068380 0x7fc96806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:55.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.897+0000 7fc988c00640 1 -- 172.21.15.137:0/2085370006 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc984086490 con 0x7fc98c159560 2024-04-26T23:41:55.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.897+0000 7fc98be00640 1 --2- 172.21.15.137:0/2085370006 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc968068380 0x7fc96806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:55.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.901+0000 7fc98be00640 1 --2- 172.21.15.137:0/2085370006 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc968068380 0x7fc96806a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc97c0012f0 tx=0x7fc97c001aa0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:55.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:55.905+0000 7fc988c00640 1 -- 172.21.15.137:0/2085370006 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc9840563f0 con 0x7fc98c159560 2024-04-26T23:41:56.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.061+0000 7fc992e00640 1 -- 172.21.15.137:0/2085370006 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc98c0b2350 con 0x7fc98c159560 2024-04-26T23:41:56.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.065+0000 7fc988c00640 1 -- 172.21.15.137:0/2085370006 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fc98405a6f0 con 0x7fc98c159560 2024-04-26T23:41:56.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.065+0000 7fc992e00640 1 -- 172.21.15.137:0/2085370006 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc968068380 msgr2=0x7fc96806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:56.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.065+0000 7fc992e00640 1 --2- 172.21.15.137:0/2085370006 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc968068380 0x7fc96806a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc97c0012f0 tx=0x7fc97c001aa0 comp rx=0 tx=0).stop 2024-04-26T23:41:56.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.065+0000 7fc992e00640 1 -- 172.21.15.137:0/2085370006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc98c159560 msgr2=0x7fc98c14d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:56.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.065+0000 7fc992e00640 1 --2- 172.21.15.137:0/2085370006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc98c159560 0x7fc98c14d7f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc98400c440 tx=0x7fc98400c900 comp rx=0 tx=0).stop 2024-04-26T23:41:56.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.065+0000 7fc992e00640 1 -- 172.21.15.137:0/2085370006 shutdown_connections 2024-04-26T23:41:56.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.065+0000 7fc992e00640 1 --2- 172.21.15.137:0/2085370006 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc968068380 0x7fc96806a840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:56.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.065+0000 7fc992e00640 1 --2- 172.21.15.137:0/2085370006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc98c159560 0x7fc98c14d7f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:56.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.065+0000 7fc992e00640 1 --2- 172.21.15.137:0/2085370006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc98c0afc80 0x7fc98c13ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:56.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.065+0000 7fc992e00640 1 --2- 172.21.15.137:0/2085370006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc98c072930 0x7fc98c155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:56.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.065+0000 7fc992e00640 1 -- 172.21.15.137:0/2085370006 >> 172.21.15.137:0/2085370006 conn(0x7fc98c0b3370 msgr2=0x7fc98c068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:56.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.065+0000 7fc992e00640 1 -- 172.21.15.137:0/2085370006 shutdown_connections 2024-04-26T23:41:56.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.065+0000 7fc992e00640 1 -- 172.21.15.137:0/2085370006 wait complete. 2024-04-26T23:41:56.089 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T23:41:56.089 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:41:56.177 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:41:56.269 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T23:41:56.269 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:41:56.269 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:41:56.278 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:41:56.278 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:41:56.327 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:56.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.501+0000 7fd03d600640 1 Processor -- start 2024-04-26T23:41:56.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.501+0000 7fd03d600640 1 -- start start 2024-04-26T23:41:56.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.505+0000 7fd03d600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd0380725a0 0x7fd0380cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:56.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.505+0000 7fd03d600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd038073f30 0x7fd038072980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:56.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.505+0000 7fd03d600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0380cfef0 con 0x7fd038072ec0 2024-04-26T23:41:56.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.505+0000 7fd03d600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd0380cddc0 con 0x7fd0380725a0 2024-04-26T23:41:56.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.505+0000 7fd03d600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd0380d01b0 con 0x7fd038073f30 2024-04-26T23:41:56.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.505+0000 7fd036a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd0380725a0 0x7fd0380cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:56.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.505+0000 7fd036a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd0380725a0 0x7fd0380cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59994/0 (socket says 172.21.15.137:59994) 2024-04-26T23:41:56.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.505+0000 7fd036a00640 1 -- 172.21.15.137:0/1696306921 learned_addr learned my addr 172.21.15.137:0/1696306921 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:56.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.505+0000 7fd02e000640 1 --2- 172.21.15.137:0/1696306921 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd038073f30 0x7fd038072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:56.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.505+0000 7fd036a00640 1 -- 172.21.15.137:0/1696306921 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd038073f30 msgr2=0x7fd038072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:56.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.505+0000 7fd036a00640 1 --2- 172.21.15.137:0/1696306921 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd038073f30 0x7fd038072980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:56.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.505+0000 7fd036a00640 1 -- 172.21.15.137:0/1696306921 >> v1:172.21.15.137:6789/0 conn(0x7fd038072ec0 legacy=0x7fd0380b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:56.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.505+0000 7fd036a00640 1 -- 172.21.15.137:0/1696306921 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0380d0490 con 0x7fd0380725a0 2024-04-26T23:41:56.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.505+0000 7fd02e000640 1 --2- 172.21.15.137:0/1696306921 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd038073f30 0x7fd038072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:56.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.509+0000 7fd036a00640 1 --2- 172.21.15.137:0/1696306921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0380725a0 0x7fd0380cd770 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd028009870 tx=0x7fd02801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228b5cb6ccbad6fc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:56.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.509+0000 7fd036000640 1 -- 172.21.15.137:0/1696306921 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0280a9610 con 0x7fd0380725a0 2024-04-26T23:41:56.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.509+0000 7fd036000640 1 -- 172.21.15.137:0/1696306921 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0280a97b0 con 0x7fd0380725a0 2024-04-26T23:41:56.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.509+0000 7fd036000640 1 -- 172.21.15.137:0/1696306921 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0280a9b80 con 0x7fd0380725a0 2024-04-26T23:41:56.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.509+0000 7fd03d600640 1 -- 172.21.15.137:0/1696306921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0380725a0 msgr2=0x7fd0380cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:56.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.509+0000 7fd03d600640 1 --2- 172.21.15.137:0/1696306921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0380725a0 0x7fd0380cd770 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd028009870 tx=0x7fd02801c530 comp rx=0 tx=0).stop 2024-04-26T23:41:56.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.509+0000 7fd03d600640 1 -- 172.21.15.137:0/1696306921 shutdown_connections 2024-04-26T23:41:56.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.509+0000 7fd03d600640 1 --2- 172.21.15.137:0/1696306921 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd038073f30 0x7fd038072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:56.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.509+0000 7fd03d600640 1 --2- 172.21.15.137:0/1696306921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0380725a0 0x7fd0380cd770 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:56.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.509+0000 7fd03d600640 1 -- 172.21.15.137:0/1696306921 >> 172.21.15.137:0/1696306921 conn(0x7fd03806c5d0 msgr2=0x7fd03806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:56.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.509+0000 7fd03d600640 1 -- 172.21.15.137:0/1696306921 shutdown_connections 2024-04-26T23:41:56.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.509+0000 7fd03d600640 1 -- 172.21.15.137:0/1696306921 wait complete. 2024-04-26T23:41:56.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.509+0000 7fd03d600640 1 Processor -- start 2024-04-26T23:41:56.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.509+0000 7fd03d600640 1 -- start start 2024-04-26T23:41:56.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.509+0000 7fd03d600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0380725a0 0x7fd03813f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:56.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.509+0000 7fd03d600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd038072ec0 0x7fd038144210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:56.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.509+0000 7fd03d600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd038073f30 0x7fd03815a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:56.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.509+0000 7fd03d600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd0380b5110 con 0x7fd0380725a0 2024-04-26T23:41:56.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.509+0000 7fd03d600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd0380b4f90 con 0x7fd038073f30 2024-04-26T23:41:56.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.509+0000 7fd03d600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd0380b5290 con 0x7fd038072ec0 2024-04-26T23:41:56.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.509+0000 7fd036a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0380725a0 0x7fd03813f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:56.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.513+0000 7fd036a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0380725a0 0x7fd03813f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60002/0 (socket says 172.21.15.137:60002) 2024-04-26T23:41:56.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.513+0000 7fd036a00640 1 -- 172.21.15.137:0/1778684383 learned_addr learned my addr 172.21.15.137:0/1778684383 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:56.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.513+0000 7fd036a00640 1 -- 172.21.15.137:0/1778684383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd038072ec0 msgr2=0x7fd038144210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:56.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.513+0000 7fd036a00640 1 --2- 172.21.15.137:0/1778684383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd038072ec0 0x7fd038144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:56.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.513+0000 7fd036a00640 1 -- 172.21.15.137:0/1778684383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd038073f30 msgr2=0x7fd03815a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:56.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.513+0000 7fd036a00640 1 --2- 172.21.15.137:0/1778684383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd038073f30 0x7fd03815a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:56.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.513+0000 7fd036a00640 1 -- 172.21.15.137:0/1778684383 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0380696d0 con 0x7fd0380725a0 2024-04-26T23:41:56.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.513+0000 7fd036a00640 1 --2- 172.21.15.137:0/1778684383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0380725a0 0x7fd03813f7c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd02801abe0 tx=0x7fd0280192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:56.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.513+0000 7fd02f400640 1 -- 172.21.15.137:0/1778684383 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0280bb5f0 con 0x7fd0380725a0 2024-04-26T23:41:56.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.513+0000 7fd02f400640 1 -- 172.21.15.137:0/1778684383 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0280bb7b0 con 0x7fd0380725a0 2024-04-26T23:41:56.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.513+0000 7fd03d600640 1 -- 172.21.15.137:0/1778684383 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd038142660 con 0x7fd0380725a0 2024-04-26T23:41:56.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.513+0000 7fd02f400640 1 -- 172.21.15.137:0/1778684383 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0280bbba0 con 0x7fd0380725a0 2024-04-26T23:41:56.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.513+0000 7fd03d600640 1 -- 172.21.15.137:0/1778684383 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd038142c20 con 0x7fd0380725a0 2024-04-26T23:41:56.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.513+0000 7fd03d600640 1 -- 172.21.15.137:0/1778684383 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd03806a4b0 con 0x7fd0380725a0 2024-04-26T23:41:56.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.513+0000 7fd02f400640 1 -- 172.21.15.137:0/1778684383 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd0280c43f0 con 0x7fd0380725a0 2024-04-26T23:41:56.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.517+0000 7fd02f400640 1 --2- 172.21.15.137:0/1778684383 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd014068380 0x7fd01406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:56.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.517+0000 7fd02f400640 1 -- 172.21.15.137:0/1778684383 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd028121180 con 0x7fd0380725a0 2024-04-26T23:41:56.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.517+0000 7fd02e000640 1 --2- 172.21.15.137:0/1778684383 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd014068380 0x7fd01406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:56.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.517+0000 7fd02e000640 1 --2- 172.21.15.137:0/1778684383 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd014068380 0x7fd01406a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd0380b04a0 tx=0x7fd020008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:56.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.521+0000 7fd02f400640 1 -- 172.21.15.137:0/1778684383 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd0280ad020 con 0x7fd0380725a0 2024-04-26T23:41:56.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.681+0000 7fd03d600640 1 -- 172.21.15.137:0/1778684383 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd0380ccde0 con 0x7fd0380725a0 2024-04-26T23:41:56.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.681+0000 7fd02f400640 1 -- 172.21.15.137:0/1778684383 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16653 (secure 0 0 0) 0x7fd028016150 con 0x7fd0380725a0 2024-04-26T23:41:56.686 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:56.686 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:25.186308+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:56.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.685+0000 7fd03d600640 1 -- 172.21.15.137:0/1778684383 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd014068380 msgr2=0x7fd01406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:56.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.685+0000 7fd03d600640 1 --2- 172.21.15.137:0/1778684383 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd014068380 0x7fd01406a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd0380b04a0 tx=0x7fd020008040 comp rx=0 tx=0).stop 2024-04-26T23:41:56.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.685+0000 7fd03d600640 1 -- 172.21.15.137:0/1778684383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0380725a0 msgr2=0x7fd03813f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:56.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.685+0000 7fd03d600640 1 --2- 172.21.15.137:0/1778684383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0380725a0 0x7fd03813f7c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd02801abe0 tx=0x7fd0280192d0 comp rx=0 tx=0).stop 2024-04-26T23:41:56.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.685+0000 7fd03d600640 1 -- 172.21.15.137:0/1778684383 shutdown_connections 2024-04-26T23:41:56.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.685+0000 7fd03d600640 1 --2- 172.21.15.137:0/1778684383 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd014068380 0x7fd01406a840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:56.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.685+0000 7fd03d600640 1 --2- 172.21.15.137:0/1778684383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd038073f30 0x7fd03815a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:56.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.685+0000 7fd03d600640 1 --2- 172.21.15.137:0/1778684383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd038072ec0 0x7fd038144210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:56.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.685+0000 7fd03d600640 1 --2- 172.21.15.137:0/1778684383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0380725a0 0x7fd03813f7c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:56.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.685+0000 7fd03d600640 1 -- 172.21.15.137:0/1778684383 >> 172.21.15.137:0/1778684383 conn(0x7fd03806c5d0 msgr2=0x7fd03815c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:56.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.685+0000 7fd03d600640 1 -- 172.21.15.137:0/1778684383 shutdown_connections 2024-04-26T23:41:56.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.685+0000 7fd03d600640 1 -- 172.21.15.137:0/1778684383 wait complete. 2024-04-26T23:41:56.706 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:41:21.810449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:41:22.533452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:41:56.707 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:41:56.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.845+0000 7f649f600640 1 Processor -- start 2024-04-26T23:41:56.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.845+0000 7f649f600640 1 -- start start 2024-04-26T23:41:56.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.845+0000 7f649f600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64980afbc0 0x7f649815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:56.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.845+0000 7f649f600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f64980affa0 0x7f64980ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:56.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.845+0000 7f649f600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6498072860 con 0x7f6498073f20 2024-04-26T23:41:56.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.845+0000 7f649f600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f64980743b0 con 0x7f64980affa0 2024-04-26T23:41:56.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.845+0000 7f649f600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6498072b00 con 0x7f64980afbc0 2024-04-26T23:41:56.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.845+0000 7f6497e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f6498073f20 0x7f64980735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49204/0 (socket says 172.21.15.137:49204) 2024-04-26T23:41:56.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.845+0000 7f6497e00640 1 -- 172.21.15.137:0/3923584611 learned_addr learned my addr 172.21.15.137:0/3923584611 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:56.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.845+0000 7f649d600640 1 --2- 172.21.15.137:0/3923584611 >> v2:172.21.15.170:3300/0 conn(0x7f64980affa0 0x7f64980ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:56.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.845+0000 7f649cc00640 1 --2- 172.21.15.137:0/3923584611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64980afbc0 0x7f649815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:56.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.845+0000 7f6497400640 1 -- 172.21.15.137:0/3923584611 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3721558063 0 0) 0x7f6498072860 con 0x7f6498073f20 2024-04-26T23:41:56.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.845+0000 7f6497400640 1 -- 172.21.15.137:0/3923584611 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6480003530 con 0x7f6498073f20 2024-04-26T23:41:56.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.845+0000 7f649d600640 1 -- 172.21.15.137:0/3923584611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64980afbc0 msgr2=0x7f649815df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:56.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.845+0000 7f649d600640 1 --2- 172.21.15.137:0/3923584611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64980afbc0 0x7f649815df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:56.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.845+0000 7f649d600640 1 -- 172.21.15.137:0/3923584611 >> v1:172.21.15.137:6789/0 conn(0x7f6498073f20 legacy=0x7f64980735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:56.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.845+0000 7f649d600640 1 -- 172.21.15.137:0/3923584611 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6498072de0 con 0x7f64980affa0 2024-04-26T23:41:56.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.849+0000 7f649d600640 1 --2- 172.21.15.137:0/3923584611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64980affa0 0x7f64980ce3b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6490009d90 tx=0x7f649001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1b574c9393aa8d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:56.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.849+0000 7f6497400640 1 -- 172.21.15.137:0/3923584611 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64900b2070 con 0x7f64980affa0 2024-04-26T23:41:56.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.849+0000 7f6497400640 1 -- 172.21.15.137:0/3923584611 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64900a5830 con 0x7f64980affa0 2024-04-26T23:41:56.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.849+0000 7f6497400640 1 -- 172.21.15.137:0/3923584611 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64900a5c00 con 0x7f64980affa0 2024-04-26T23:41:56.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.849+0000 7f649f600640 1 -- 172.21.15.137:0/3923584611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64980affa0 msgr2=0x7f64980ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:56.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.849+0000 7f649f600640 1 --2- 172.21.15.137:0/3923584611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64980affa0 0x7f64980ce3b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6490009d90 tx=0x7f649001c970 comp rx=0 tx=0).stop 2024-04-26T23:41:56.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.849+0000 7f649f600640 1 -- 172.21.15.137:0/3923584611 shutdown_connections 2024-04-26T23:41:56.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.849+0000 7f649f600640 1 --2- 172.21.15.137:0/3923584611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64980affa0 0x7f64980ce3b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:56.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.849+0000 7f649f600640 1 --2- 172.21.15.137:0/3923584611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64980afbc0 0x7f649815df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:56.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.849+0000 7f649f600640 1 -- 172.21.15.137:0/3923584611 >> 172.21.15.137:0/3923584611 conn(0x7f649806c800 msgr2=0x7f649806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:56.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.849+0000 7f649f600640 1 -- 172.21.15.137:0/3923584611 shutdown_connections 2024-04-26T23:41:56.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.849+0000 7f649f600640 1 -- 172.21.15.137:0/3923584611 wait complete. 2024-04-26T23:41:56.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.849+0000 7f649f600640 1 Processor -- start 2024-04-26T23:41:56.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f649f600640 1 -- start start 2024-04-26T23:41:56.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f649f600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64980afbc0 0x7f649814f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:56.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f649f600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64980affa0 0x7f6498154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:56.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f649f600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6498154f80 0x7f64980b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:56.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f649f600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f649806f3e0 con 0x7f64980afbc0 2024-04-26T23:41:56.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f649f600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f649806f260 con 0x7f64980affa0 2024-04-26T23:41:56.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f649f600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f649806f560 con 0x7f6498154f80 2024-04-26T23:41:56.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f649cc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64980afbc0 0x7f649814f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:56.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f649cc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64980afbc0 0x7f649814f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60012/0 (socket says 172.21.15.137:60012) 2024-04-26T23:41:56.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f649cc00640 1 -- 172.21.15.137:0/1857341127 learned_addr learned my addr 172.21.15.137:0/1857341127 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:56.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f6497e00640 1 --2- 172.21.15.137:0/1857341127 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64980affa0 0x7f6498154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:56.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f649d600640 1 --2- 172.21.15.137:0/1857341127 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6498154f80 0x7f64980b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:56.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f649cc00640 1 -- 172.21.15.137:0/1857341127 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6498154f80 msgr2=0x7f64980b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:56.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f649cc00640 1 --2- 172.21.15.137:0/1857341127 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6498154f80 0x7f64980b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:56.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f649cc00640 1 -- 172.21.15.137:0/1857341127 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64980affa0 msgr2=0x7f6498154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:56.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f649cc00640 1 --2- 172.21.15.137:0/1857341127 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64980affa0 0x7f6498154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:56.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f649cc00640 1 -- 172.21.15.137:0/1857341127 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6498070250 con 0x7f64980afbc0 2024-04-26T23:41:56.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f649cc00640 1 --2- 172.21.15.137:0/1857341127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64980afbc0 0x7f649814f930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f648c00e930 tx=0x7f648c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:56.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f6494c00640 1 -- 172.21.15.137:0/1857341127 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c017070 con 0x7f64980afbc0 2024-04-26T23:41:56.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f6494c00640 1 -- 172.21.15.137:0/1857341127 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f648c00ca00 con 0x7f64980afbc0 2024-04-26T23:41:56.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f649f600640 1 -- 172.21.15.137:0/1857341127 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6498155fa0 con 0x7f64980afbc0 2024-04-26T23:41:56.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f6494c00640 1 -- 172.21.15.137:0/1857341127 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c00cdb0 con 0x7f64980afbc0 2024-04-26T23:41:56.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f649f600640 1 -- 172.21.15.137:0/1857341127 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6498155700 con 0x7f64980afbc0 2024-04-26T23:41:56.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.853+0000 7f649f600640 1 -- 172.21.15.137:0/1857341127 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f649806a410 con 0x7f64980afbc0 2024-04-26T23:41:56.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.857+0000 7f6494c00640 1 -- 172.21.15.137:0/1857341127 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f648c01a070 con 0x7f64980afbc0 2024-04-26T23:41:56.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.857+0000 7f6494c00640 1 --2- 172.21.15.137:0/1857341127 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6478068380 0x7f647806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:56.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.857+0000 7f6494c00640 1 -- 172.21.15.137:0/1857341127 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f648c086a10 con 0x7f64980afbc0 2024-04-26T23:41:56.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.857+0000 7f6497e00640 1 --2- 172.21.15.137:0/1857341127 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6478068380 0x7f647806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:56.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.857+0000 7f6497e00640 1 --2- 172.21.15.137:0/1857341127 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6478068380 0x7f647806a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f64980aea60 tx=0x7f6484009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:56.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:56.861+0000 7f6494c00640 1 -- 172.21.15.137:0/1857341127 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f648c0569a0 con 0x7f64980afbc0 2024-04-26T23:41:57.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.017+0000 7f649f600640 1 -- 172.21.15.137:0/1857341127 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6498160870 con 0x7f64980afbc0 2024-04-26T23:41:57.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.017+0000 7f6494c00640 1 -- 172.21.15.137:0/1857341127 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f648c05aca0 con 0x7f64980afbc0 2024-04-26T23:41:57.023 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:41:57.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.021+0000 7f649f600640 1 -- 172.21.15.137:0/1857341127 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6478068380 msgr2=0x7f647806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:57.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.021+0000 7f649f600640 1 --2- 172.21.15.137:0/1857341127 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6478068380 0x7f647806a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f64980aea60 tx=0x7f6484009040 comp rx=0 tx=0).stop 2024-04-26T23:41:57.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.021+0000 7f649f600640 1 -- 172.21.15.137:0/1857341127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64980afbc0 msgr2=0x7f649814f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:57.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.021+0000 7f649f600640 1 --2- 172.21.15.137:0/1857341127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64980afbc0 0x7f649814f930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f648c00e930 tx=0x7f648c00edf0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.021+0000 7f649f600640 1 -- 172.21.15.137:0/1857341127 shutdown_connections 2024-04-26T23:41:57.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.021+0000 7f649f600640 1 --2- 172.21.15.137:0/1857341127 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6478068380 0x7f647806a840 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.021+0000 7f649f600640 1 --2- 172.21.15.137:0/1857341127 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6498154f80 0x7f64980b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.021+0000 7f649f600640 1 --2- 172.21.15.137:0/1857341127 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64980affa0 0x7f6498154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.021+0000 7f649f600640 1 --2- 172.21.15.137:0/1857341127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64980afbc0 0x7f649814f930 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.021+0000 7f649f600640 1 -- 172.21.15.137:0/1857341127 >> 172.21.15.137:0/1857341127 conn(0x7f649806c800 msgr2=0x7f649815d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:57.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.021+0000 7f649f600640 1 -- 172.21.15.137:0/1857341127 shutdown_connections 2024-04-26T23:41:57.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.021+0000 7f649f600640 1 -- 172.21.15.137:0/1857341127 wait complete. 2024-04-26T23:41:57.043 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:41:57.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.177+0000 7f6ec3200640 1 Processor -- start 2024-04-26T23:41:57.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.177+0000 7f6ec3200640 1 -- start start 2024-04-26T23:41:57.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.177+0000 7f6ec3200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6ebc1607e0 0x7f6ebc0b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:57.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.177+0000 7f6ec3200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6ebc0b4390 0x7f6ebc0d0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:57.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.177+0000 7f6ec3200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ebc0b0700 con 0x7f6ebc0cd660 2024-04-26T23:41:57.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.177+0000 7f6ec3200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6ebc0b1030 con 0x7f6ebc1607e0 2024-04-26T23:41:57.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.177+0000 7f6ec3200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f6ebc0b09e0 con 0x7f6ebc0b4390 2024-04-26T23:41:57.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.177+0000 7f6ec1e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6ebc1607e0 0x7f6ebc0b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:57.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.177+0000 7f6ec1e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6ebc1607e0 0x7f6ebc0b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60014/0 (socket says 172.21.15.137:60014) 2024-04-26T23:41:57.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.177+0000 7f6ec1e00640 1 -- 172.21.15.137:0/1784585078 learned_addr learned my addr 172.21.15.137:0/1784585078 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:57.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.181+0000 7f6ec1400640 1 --2- 172.21.15.137:0/1784585078 >> v2:172.21.15.170:3300/0 conn(0x7f6ebc0b4390 0x7f6ebc0d0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.181+0000 7f6ec1e00640 1 -- 172.21.15.137:0/1784585078 >> v2:172.21.15.170:3300/0 conn(0x7f6ebc0b4390 msgr2=0x7f6ebc0d0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.181+0000 7f6ec1e00640 1 --2- 172.21.15.137:0/1784585078 >> v2:172.21.15.170:3300/0 conn(0x7f6ebc0b4390 0x7f6ebc0d0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.181+0000 7f6ec1e00640 1 -- 172.21.15.137:0/1784585078 >> v1:172.21.15.170:6789/0 conn(0x7f6ebc0cd660 legacy=0x7f6ebc0d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.181+0000 7f6ec1e00640 1 -- 172.21.15.137:0/1784585078 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ebc0b0cc0 con 0x7f6ebc1607e0 2024-04-26T23:41:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.181+0000 7f6ec1400640 1 --2- 172.21.15.137:0/1784585078 >> v2:172.21.15.170:3300/0 conn(0x7f6ebc0b4390 0x7f6ebc0d0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:57.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.181+0000 7f6ec1e00640 1 --2- 172.21.15.137:0/1784585078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ebc1607e0 0x7f6ebc0b34d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0734a0 tx=0x7f6eb001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe89c62e147a5d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:57.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.181+0000 7f6ec0a00640 1 -- 172.21.15.137:0/1784585078 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00ab430 con 0x7f6ebc1607e0 2024-04-26T23:41:57.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.181+0000 7f6ec0a00640 1 -- 172.21.15.137:0/1784585078 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb00b0070 con 0x7f6ebc1607e0 2024-04-26T23:41:57.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.181+0000 7f6ec0a00640 1 -- 172.21.15.137:0/1784585078 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00ab7f0 con 0x7f6ebc1607e0 2024-04-26T23:41:57.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.181+0000 7f6ec3200640 1 -- 172.21.15.137:0/1784585078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ebc1607e0 msgr2=0x7f6ebc0b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:57.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.181+0000 7f6ec3200640 1 --2- 172.21.15.137:0/1784585078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ebc1607e0 0x7f6ebc0b34d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0734a0 tx=0x7f6eb001c520 comp rx=0 tx=0).stop 2024-04-26T23:41:57.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec3200640 1 -- 172.21.15.137:0/1784585078 shutdown_connections 2024-04-26T23:41:57.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec3200640 1 --2- 172.21.15.137:0/1784585078 >> v2:172.21.15.170:3300/0 conn(0x7f6ebc0b4390 0x7f6ebc0d0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec3200640 1 --2- 172.21.15.137:0/1784585078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ebc1607e0 0x7f6ebc0b34d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec3200640 1 -- 172.21.15.137:0/1784585078 >> 172.21.15.137:0/1784585078 conn(0x7f6ebc0b4870 msgr2=0x7f6ebc0b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:57.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec3200640 1 -- 172.21.15.137:0/1784585078 shutdown_connections 2024-04-26T23:41:57.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec3200640 1 -- 172.21.15.137:0/1784585078 wait complete. 2024-04-26T23:41:57.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec3200640 1 Processor -- start 2024-04-26T23:41:57.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec3200640 1 -- start start 2024-04-26T23:41:57.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec3200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ebc0cd660 0x7f6ebc15b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:57.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec3200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ebc0cecf0 0x7f6ebc0cf170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:57.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec3200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ebc0b5b00 0x7f6ebc0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:57.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec3200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6ebc169830 con 0x7f6ebc0cecf0 2024-04-26T23:41:57.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec3200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6ebc1696b0 con 0x7f6ebc0b5b00 2024-04-26T23:41:57.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec3200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6ebc1699b0 con 0x7f6ebc0cd660 2024-04-26T23:41:57.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec1400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ebc0cecf0 0x7f6ebc0cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:57.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec1400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ebc0cecf0 0x7f6ebc0cf170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60018/0 (socket says 172.21.15.137:60018) 2024-04-26T23:41:57.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec1400640 1 -- 172.21.15.137:0/3344493713 learned_addr learned my addr 172.21.15.137:0/3344493713 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:57.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec2800640 1 --2- 172.21.15.137:0/3344493713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ebc0b5b00 0x7f6ebc0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:57.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec1e00640 1 --2- 172.21.15.137:0/3344493713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ebc0cd660 0x7f6ebc15b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:57.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec1400640 1 -- 172.21.15.137:0/3344493713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ebc0cd660 msgr2=0x7f6ebc15b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:57.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec1400640 1 --2- 172.21.15.137:0/3344493713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ebc0cd660 0x7f6ebc15b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec1400640 1 -- 172.21.15.137:0/3344493713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ebc0b5b00 msgr2=0x7f6ebc0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:57.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec1400640 1 --2- 172.21.15.137:0/3344493713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ebc0b5b00 0x7f6ebc0b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec1400640 1 -- 172.21.15.137:0/3344493713 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ebc0b6880 con 0x7f6ebc0cecf0 2024-04-26T23:41:57.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.185+0000 7f6ec1400640 1 --2- 172.21.15.137:0/3344493713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ebc0cecf0 0x7f6ebc0cf170 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00e810 tx=0x7f6eac00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:57.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.189+0000 7f6eb6000640 1 -- 172.21.15.137:0/3344493713 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac017070 con 0x7f6ebc0cecf0 2024-04-26T23:41:57.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.189+0000 7f6eb6000640 1 -- 172.21.15.137:0/3344493713 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eac00c6d0 con 0x7f6ebc0cecf0 2024-04-26T23:41:57.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.189+0000 7f6ec3200640 1 -- 172.21.15.137:0/3344493713 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ebc0b6b60 con 0x7f6ebc0cecf0 2024-04-26T23:41:57.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.189+0000 7f6eb6000640 1 -- 172.21.15.137:0/3344493713 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac00f040 con 0x7f6ebc0cecf0 2024-04-26T23:41:57.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.189+0000 7f6ec3200640 1 -- 172.21.15.137:0/3344493713 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ebc0b7120 con 0x7f6ebc0cecf0 2024-04-26T23:41:57.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.189+0000 7f6ec3200640 1 -- 172.21.15.137:0/3344493713 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ebc06a300 con 0x7f6ebc0cecf0 2024-04-26T23:41:57.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.189+0000 7f6eb6000640 1 -- 172.21.15.137:0/3344493713 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6eac01a070 con 0x7f6ebc0cecf0 2024-04-26T23:41:57.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.189+0000 7f6eb6000640 1 --2- 172.21.15.137:0/3344493713 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6ea0068380 0x7f6ea006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:57.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.189+0000 7f6eb6000640 1 -- 172.21.15.137:0/3344493713 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6eac0866c0 con 0x7f6ebc0cecf0 2024-04-26T23:41:57.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.189+0000 7f6ec1e00640 1 --2- 172.21.15.137:0/3344493713 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6ea0068380 0x7f6ea006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:57.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.189+0000 7f6ec1e00640 1 --2- 172.21.15.137:0/3344493713 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6ea0068380 0x7f6ea006a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00af000 tx=0x7f6eb00a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:57.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.193+0000 7f6eb6000640 1 -- 172.21.15.137:0/3344493713 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6eac056590 con 0x7f6ebc0cecf0 2024-04-26T23:41:57.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.353+0000 7f6ec3200640 1 -- 172.21.15.137:0/3344493713 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6ebc0d0620 con 0x7f6ebc0cecf0 2024-04-26T23:41:57.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.353+0000 7f6eb6000640 1 -- 172.21.15.137:0/3344493713 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f6eac05a890 con 0x7f6ebc0cecf0 2024-04-26T23:41:57.357 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:41:57.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.357+0000 7f6ec3200640 1 -- 172.21.15.137:0/3344493713 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6ea0068380 msgr2=0x7f6ea006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:57.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.357+0000 7f6ec3200640 1 --2- 172.21.15.137:0/3344493713 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6ea0068380 0x7f6ea006a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00af000 tx=0x7f6eb00a7000 comp rx=0 tx=0).stop 2024-04-26T23:41:57.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.357+0000 7f6ec3200640 1 -- 172.21.15.137:0/3344493713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ebc0cecf0 msgr2=0x7f6ebc0cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:57.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.357+0000 7f6ec3200640 1 --2- 172.21.15.137:0/3344493713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ebc0cecf0 0x7f6ebc0cf170 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00e810 tx=0x7f6eac00ecd0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.357+0000 7f6ec3200640 1 -- 172.21.15.137:0/3344493713 shutdown_connections 2024-04-26T23:41:57.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.357+0000 7f6ec3200640 1 --2- 172.21.15.137:0/3344493713 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6ea0068380 0x7f6ea006a840 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.357+0000 7f6ec3200640 1 --2- 172.21.15.137:0/3344493713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ebc0cecf0 0x7f6ebc0cf170 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.357+0000 7f6ec3200640 1 --2- 172.21.15.137:0/3344493713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ebc0b5b00 0x7f6ebc0b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.357+0000 7f6ec3200640 1 --2- 172.21.15.137:0/3344493713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ebc0cd660 0x7f6ebc15b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.357+0000 7f6ec3200640 1 -- 172.21.15.137:0/3344493713 >> 172.21.15.137:0/3344493713 conn(0x7f6ebc0b4870 msgr2=0x7f6ebc06c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:57.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.357+0000 7f6ec3200640 1 -- 172.21.15.137:0/3344493713 shutdown_connections 2024-04-26T23:41:57.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.357+0000 7f6ec3200640 1 -- 172.21.15.137:0/3344493713 wait complete. 2024-04-26T23:41:57.379 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:41:57.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.513+0000 7fc8fe600640 1 Processor -- start 2024-04-26T23:41:57.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.513+0000 7fc8fe600640 1 -- start start 2024-04-26T23:41:57.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.513+0000 7fc8fe600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc8f80b54e0 0x7fc8f80b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:57.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.513+0000 7fc8fe600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8f80cd710 0x7fc8f815f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:57.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.513+0000 7fc8fe600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8f80cffa0 con 0x7fc8f815fe30 2024-04-26T23:41:57.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.513+0000 7fc8fe600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc8f80b3d90 con 0x7fc8f80b54e0 2024-04-26T23:41:57.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.513+0000 7fc8fe600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f80d0840 con 0x7fc8f80cd710 2024-04-26T23:41:57.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f7e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc8f815fe30 0x7fc8f8144d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49214/0 (socket says 172.21.15.137:49214) 2024-04-26T23:41:57.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f7e00640 1 -- 172.21.15.137:0/775186983 learned_addr learned my addr 172.21.15.137:0/775186983 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:57.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f7400640 1 --2- 172.21.15.137:0/775186983 >> v2:172.21.15.170:3300/0 conn(0x7fc8f80b54e0 0x7fc8f80b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:57.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8efe00640 1 --2- 172.21.15.137:0/775186983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8f80cd710 0x7fc8f815f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:57.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f6a00640 1 -- 172.21.15.137:0/775186983 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 710434103 0 0) 0x7fc8f80cffa0 con 0x7fc8f815fe30 2024-04-26T23:41:57.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f6a00640 1 -- 172.21.15.137:0/775186983 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8dc003530 con 0x7fc8f815fe30 2024-04-26T23:41:57.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f6a00640 1 -- 172.21.15.137:0/775186983 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1812496988 0 0) 0x7fc8dc003530 con 0x7fc8f815fe30 2024-04-26T23:41:57.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f6a00640 1 -- 172.21.15.137:0/775186983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8f80cd710 msgr2=0x7fc8f815f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:57.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f6a00640 1 --2- 172.21.15.137:0/775186983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8f80cd710 0x7fc8f815f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f6a00640 1 -- 172.21.15.137:0/775186983 >> v2:172.21.15.170:3300/0 conn(0x7fc8f80b54e0 msgr2=0x7fc8f80b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:57.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f6a00640 1 --2- 172.21.15.137:0/775186983 >> v2:172.21.15.170:3300/0 conn(0x7fc8f80b54e0 0x7fc8f80b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f6a00640 1 -- 172.21.15.137:0/775186983 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f80d0280 con 0x7fc8f815fe30 2024-04-26T23:41:57.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f6a00640 1 -- 172.21.15.137:0/775186983 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fc8f0001a00 con 0x7fc8f815fe30 2024-04-26T23:41:57.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f6a00640 1 -- 172.21.15.137:0/775186983 >> v1:172.21.15.137:6789/0 conn(0x7fc8f815fe30 legacy=0x7fc8f8144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:57.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f6a00640 1 --2- 172.21.15.137:0/775186983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8dc0039c0 0x7fc8dc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:57.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f6a00640 1 --2- 172.21.15.137:0/775186983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8f80cd710 0x7fc8dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:57.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f6a00640 1 --2- 172.21.15.137:0/775186983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8dc004d50 0x7fc8dc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:57.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f6a00640 1 -- 172.21.15.137:0/775186983 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f80d0840 con 0x7fc8dc004d50 2024-04-26T23:41:57.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f6a00640 1 -- 172.21.15.137:0/775186983 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc00b9d0 con 0x7fc8dc0039c0 2024-04-26T23:41:57.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f6a00640 1 -- 172.21.15.137:0/775186983 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc8dc00bb50 con 0x7fc8f80cd710 2024-04-26T23:41:57.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f7e00640 1 --2- 172.21.15.137:0/775186983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8dc004d50 0x7fc8dc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:57.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f7400640 1 --2- 172.21.15.137:0/775186983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8dc0039c0 0x7fc8dc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:57.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8efe00640 1 --2- 172.21.15.137:0/775186983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8f80cd710 0x7fc8dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:57.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f7e00640 1 -- 172.21.15.137:0/775186983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8f80cd710 msgr2=0x7fc8dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:57.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f7e00640 1 --2- 172.21.15.137:0/775186983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8f80cd710 0x7fc8dc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f7e00640 1 -- 172.21.15.137:0/775186983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8dc0039c0 msgr2=0x7fc8dc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:57.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f7e00640 1 --2- 172.21.15.137:0/775186983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8dc0039c0 0x7fc8dc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.517+0000 7fc8f7e00640 1 -- 172.21.15.137:0/775186983 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8dc003530 con 0x7fc8dc004d50 2024-04-26T23:41:57.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.521+0000 7fc8f7e00640 1 --2- 172.21.15.137:0/775186983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8dc004d50 0x7fc8dc0051d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000a8b0 tx=0x7fc8f001d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10cbfd5cbd9e26c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:57.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.521+0000 7fc8f6a00640 1 -- 172.21.15.137:0/775186983 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f000a4a0 con 0x7fc8dc004d50 2024-04-26T23:41:57.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.521+0000 7fc8f6a00640 1 -- 172.21.15.137:0/775186983 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f00ad630 con 0x7fc8dc004d50 2024-04-26T23:41:57.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.521+0000 7fc8f6a00640 1 -- 172.21.15.137:0/775186983 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f00ada60 con 0x7fc8dc004d50 2024-04-26T23:41:57.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.521+0000 7fc8fe600640 1 -- 172.21.15.137:0/775186983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8dc004d50 msgr2=0x7fc8dc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:57.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.521+0000 7fc8fe600640 1 --2- 172.21.15.137:0/775186983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8dc004d50 0x7fc8dc0051d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000a8b0 tx=0x7fc8f001d3a0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.521+0000 7fc8f7e00640 1 -- 172.21.15.137:0/775186983 reap_dead start 2024-04-26T23:41:57.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.521+0000 7fc8fe600640 1 -- 172.21.15.137:0/775186983 shutdown_connections 2024-04-26T23:41:57.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.521+0000 7fc8fe600640 1 -- 172.21.15.137:0/775186983 >> 172.21.15.137:0/775186983 conn(0x7fc8f806c800 msgr2=0x7fc8f806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:57.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.521+0000 7fc8fe600640 1 -- 172.21.15.137:0/775186983 shutdown_connections 2024-04-26T23:41:57.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.521+0000 7fc8fe600640 1 -- 172.21.15.137:0/775186983 wait complete. 2024-04-26T23:41:57.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.521+0000 7fc8fe600640 1 Processor -- start 2024-04-26T23:41:57.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.521+0000 7fc8fe600640 1 -- start start 2024-04-26T23:41:57.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.521+0000 7fc8fe600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8dc004d50 0x7fc8f8140940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:57.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.521+0000 7fc8fe600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8f81f8130 0x7fc8f81f85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:57.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.521+0000 7fc8fe600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8f81f8af0 0x7fc8f80b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:57.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.521+0000 7fc8fe600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f80b58c0 con 0x7fc8dc004d50 2024-04-26T23:41:57.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.521+0000 7fc8fe600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f8160280 con 0x7fc8f81f8130 2024-04-26T23:41:57.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.521+0000 7fc8fe600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f80cdb80 con 0x7fc8f81f8af0 2024-04-26T23:41:57.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.525+0000 7fc8f7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8dc004d50 0x7fc8f8140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:57.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.525+0000 7fc8f7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8dc004d50 0x7fc8f8140940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60036/0 (socket says 172.21.15.137:60036) 2024-04-26T23:41:57.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.525+0000 7fc8f7400640 1 -- 172.21.15.137:0/1636110862 learned_addr learned my addr 172.21.15.137:0/1636110862 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:57.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.525+0000 7fc8efe00640 1 --2- 172.21.15.137:0/1636110862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8f81f8130 0x7fc8f81f85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:57.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.525+0000 7fc8f7e00640 1 --2- 172.21.15.137:0/1636110862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8f81f8af0 0x7fc8f80b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:57.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.525+0000 7fc8f7400640 1 -- 172.21.15.137:0/1636110862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8f81f8af0 msgr2=0x7fc8f80b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:57.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.525+0000 7fc8f7400640 1 --2- 172.21.15.137:0/1636110862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8f81f8af0 0x7fc8f80b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.525+0000 7fc8f7400640 1 -- 172.21.15.137:0/1636110862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8f81f8130 msgr2=0x7fc8f81f85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:57.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.525+0000 7fc8f7400640 1 --2- 172.21.15.137:0/1636110862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8f81f8130 0x7fc8f81f85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.525+0000 7fc8f7400640 1 -- 172.21.15.137:0/1636110862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f80afe50 con 0x7fc8dc004d50 2024-04-26T23:41:57.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.525+0000 7fc8f7e00640 1 --2- 172.21.15.137:0/1636110862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8f81f8af0 0x7fc8f80b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:57.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.525+0000 7fc8f7400640 1 --2- 172.21.15.137:0/1636110862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8dc004d50 0x7fc8f8140940 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8011990 tx=0x7fc8e8011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:57.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.525+0000 7fc8ef400640 1 -- 172.21.15.137:0/1636110862 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e800fa70 con 0x7fc8dc004d50 2024-04-26T23:41:57.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.525+0000 7fc8ef400640 1 -- 172.21.15.137:0/1636110862 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e800fc10 con 0x7fc8dc004d50 2024-04-26T23:41:57.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.525+0000 7fc8ef400640 1 -- 172.21.15.137:0/1636110862 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8014440 con 0x7fc8dc004d50 2024-04-26T23:41:57.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.525+0000 7fc8fe600640 1 -- 172.21.15.137:0/1636110862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f80b0130 con 0x7fc8dc004d50 2024-04-26T23:41:57.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.525+0000 7fc8fe600640 1 -- 172.21.15.137:0/1636110862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f80b2e90 con 0x7fc8dc004d50 2024-04-26T23:41:57.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.525+0000 7fc8fe600640 1 -- 172.21.15.137:0/1636110862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8f806a410 con 0x7fc8dc004d50 2024-04-26T23:41:57.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.525+0000 7fc8ef400640 1 -- 172.21.15.137:0/1636110862 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc8e8012040 con 0x7fc8dc004d50 2024-04-26T23:41:57.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.525+0000 7fc8ef400640 1 --2- 172.21.15.137:0/1636110862 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc8d40682f0 0x7fc8d406a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:57.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.529+0000 7fc8ef400640 1 -- 172.21.15.137:0/1636110862 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc8e8087160 con 0x7fc8dc004d50 2024-04-26T23:41:57.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.529+0000 7fc8efe00640 1 --2- 172.21.15.137:0/1636110862 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc8d40682f0 0x7fc8d406a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:57.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.529+0000 7fc8efe00640 1 --2- 172.21.15.137:0/1636110862 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc8d40682f0 0x7fc8d406a7b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80b2ae0 tx=0x7fc8e0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:57.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.533+0000 7fc8ef400640 1 -- 172.21.15.137:0/1636110862 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc8e8019030 con 0x7fc8dc004d50 2024-04-26T23:41:57.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.689+0000 7fc8fe600640 1 -- 172.21.15.137:0/1636110862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc8f806cfc0 con 0x7fc8dc004d50 2024-04-26T23:41:57.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.689+0000 7fc8ef400640 1 -- 172.21.15.137:0/1636110862 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fc8e8057680 con 0x7fc8dc004d50 2024-04-26T23:41:57.694 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:41:57.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.693+0000 7fc8fe600640 1 -- 172.21.15.137:0/1636110862 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc8d40682f0 msgr2=0x7fc8d406a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:57.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.693+0000 7fc8fe600640 1 --2- 172.21.15.137:0/1636110862 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc8d40682f0 0x7fc8d406a7b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80b2ae0 tx=0x7fc8e0008040 comp rx=0 tx=0).stop 2024-04-26T23:41:57.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.693+0000 7fc8fe600640 1 -- 172.21.15.137:0/1636110862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8dc004d50 msgr2=0x7fc8f8140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:57.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.693+0000 7fc8fe600640 1 --2- 172.21.15.137:0/1636110862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8dc004d50 0x7fc8f8140940 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8011990 tx=0x7fc8e8011e50 comp rx=0 tx=0).stop 2024-04-26T23:41:57.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.693+0000 7fc8fe600640 1 -- 172.21.15.137:0/1636110862 shutdown_connections 2024-04-26T23:41:57.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.693+0000 7fc8fe600640 1 --2- 172.21.15.137:0/1636110862 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc8d40682f0 0x7fc8d406a7b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.693+0000 7fc8fe600640 1 --2- 172.21.15.137:0/1636110862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8f81f8af0 0x7fc8f80b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.693+0000 7fc8fe600640 1 --2- 172.21.15.137:0/1636110862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8f81f8130 0x7fc8f81f85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.693+0000 7fc8fe600640 1 --2- 172.21.15.137:0/1636110862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8dc004d50 0x7fc8f8140940 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.693+0000 7fc8fe600640 1 -- 172.21.15.137:0/1636110862 >> 172.21.15.137:0/1636110862 conn(0x7fc8f806c800 msgr2=0x7fc8f806ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:57.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.693+0000 7fc8fe600640 1 -- 172.21.15.137:0/1636110862 shutdown_connections 2024-04-26T23:41:57.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.693+0000 7fc8fe600640 1 -- 172.21.15.137:0/1636110862 wait complete. 2024-04-26T23:41:57.716 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:41:57.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.849+0000 7fd634400640 1 Processor -- start 2024-04-26T23:41:57.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.849+0000 7fd634400640 1 -- start start 2024-04-26T23:41:57.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.849+0000 7fd634400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd62c0725a0 0x7fd62c0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:57.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.853+0000 7fd634400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd62c073f30 0x7fd62c072980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:57.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.853+0000 7fd634400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd62c0cfef0 con 0x7fd62c072ec0 2024-04-26T23:41:57.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.853+0000 7fd634400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd62c0cddc0 con 0x7fd62c0725a0 2024-04-26T23:41:57.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.853+0000 7fd634400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd62c0d01b0 con 0x7fd62c073f30 2024-04-26T23:41:57.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.853+0000 7fd631a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd62c0725a0 0x7fd62c0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:57.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.853+0000 7fd631a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd62c0725a0 0x7fd62c0cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60046/0 (socket says 172.21.15.137:60046) 2024-04-26T23:41:57.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.853+0000 7fd631a00640 1 -- 172.21.15.137:0/31509313 learned_addr learned my addr 172.21.15.137:0/31509313 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:57.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.853+0000 7fd631000640 1 --2- 172.21.15.137:0/31509313 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd62c073f30 0x7fd62c072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:57.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.853+0000 7fd631a00640 1 -- 172.21.15.137:0/31509313 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd62c073f30 msgr2=0x7fd62c072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:57.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.853+0000 7fd631a00640 1 --2- 172.21.15.137:0/31509313 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd62c073f30 0x7fd62c072980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.853+0000 7fd631a00640 1 -- 172.21.15.137:0/31509313 >> v1:172.21.15.137:6789/0 conn(0x7fd62c072ec0 legacy=0x7fd62c0b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:57.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.853+0000 7fd631a00640 1 -- 172.21.15.137:0/31509313 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62c0d0490 con 0x7fd62c0725a0 2024-04-26T23:41:57.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.853+0000 7fd631a00640 1 --2- 172.21.15.137:0/31509313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd62c0725a0 0x7fd62c0cd770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd620009870 tx=0x7fd62001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ac00e2fc2f23cc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:57.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.853+0000 7fd62be00640 1 -- 172.21.15.137:0/31509313 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6200a9610 con 0x7fd62c0725a0 2024-04-26T23:41:57.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.853+0000 7fd62be00640 1 -- 172.21.15.137:0/31509313 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6200a97b0 con 0x7fd62c0725a0 2024-04-26T23:41:57.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.853+0000 7fd62be00640 1 -- 172.21.15.137:0/31509313 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6200a9b80 con 0x7fd62c0725a0 2024-04-26T23:41:57.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd634400640 1 -- 172.21.15.137:0/31509313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd62c0725a0 msgr2=0x7fd62c0cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:57.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd634400640 1 --2- 172.21.15.137:0/31509313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd62c0725a0 0x7fd62c0cd770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd620009870 tx=0x7fd62001c530 comp rx=0 tx=0).stop 2024-04-26T23:41:57.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd634400640 1 -- 172.21.15.137:0/31509313 shutdown_connections 2024-04-26T23:41:57.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd634400640 1 --2- 172.21.15.137:0/31509313 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd62c073f30 0x7fd62c072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd634400640 1 --2- 172.21.15.137:0/31509313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd62c0725a0 0x7fd62c0cd770 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd634400640 1 -- 172.21.15.137:0/31509313 >> 172.21.15.137:0/31509313 conn(0x7fd62c06c5d0 msgr2=0x7fd62c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:57.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd634400640 1 -- 172.21.15.137:0/31509313 shutdown_connections 2024-04-26T23:41:57.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd634400640 1 -- 172.21.15.137:0/31509313 wait complete. 2024-04-26T23:41:57.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd634400640 1 Processor -- start 2024-04-26T23:41:57.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd634400640 1 -- start start 2024-04-26T23:41:57.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd634400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd62c0725a0 0x7fd62c13a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:57.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd634400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd62c072ec0 0x7fd62c0aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:57.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd634400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd62c073f30 0x7fd62c142460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:57.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd634400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c0b5110 con 0x7fd62c072ec0 2024-04-26T23:41:57.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd634400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c0b4f90 con 0x7fd62c073f30 2024-04-26T23:41:57.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd634400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd62c0b5290 con 0x7fd62c0725a0 2024-04-26T23:41:57.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd631000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd62c072ec0 0x7fd62c0aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:57.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd631a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd62c0725a0 0x7fd62c13a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:57.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd631000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd62c072ec0 0x7fd62c0aeb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60060/0 (socket says 172.21.15.137:60060) 2024-04-26T23:41:57.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd631000640 1 -- 172.21.15.137:0/3915898938 learned_addr learned my addr 172.21.15.137:0/3915898938 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:57.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd632400640 1 --2- 172.21.15.137:0/3915898938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd62c073f30 0x7fd62c142460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:57.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd631000640 1 -- 172.21.15.137:0/3915898938 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd62c0725a0 msgr2=0x7fd62c13a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:57.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd631000640 1 --2- 172.21.15.137:0/3915898938 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd62c0725a0 0x7fd62c13a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd631000640 1 -- 172.21.15.137:0/3915898938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd62c073f30 msgr2=0x7fd62c142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:57.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd631000640 1 --2- 172.21.15.137:0/3915898938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd62c073f30 0x7fd62c142460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:57.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.857+0000 7fd631000640 1 -- 172.21.15.137:0/3915898938 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62c13af80 con 0x7fd62c072ec0 2024-04-26T23:41:57.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.861+0000 7fd631000640 1 --2- 172.21.15.137:0/3915898938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd62c072ec0 0x7fd62c0aeb30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd61800d800 tx=0x7fd61800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:57.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.861+0000 7fd629600640 1 -- 172.21.15.137:0/3915898938 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61800b6c0 con 0x7fd62c072ec0 2024-04-26T23:41:57.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.861+0000 7fd629600640 1 -- 172.21.15.137:0/3915898938 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd618019070 con 0x7fd62c072ec0 2024-04-26T23:41:57.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.861+0000 7fd629600640 1 -- 172.21.15.137:0/3915898938 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61800ba60 con 0x7fd62c072ec0 2024-04-26T23:41:57.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.861+0000 7fd634400640 1 -- 172.21.15.137:0/3915898938 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd62c13b260 con 0x7fd62c072ec0 2024-04-26T23:41:57.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.861+0000 7fd634400640 1 -- 172.21.15.137:0/3915898938 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd62c13b820 con 0x7fd62c072ec0 2024-04-26T23:41:57.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.861+0000 7fd634400640 1 -- 172.21.15.137:0/3915898938 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd62c06a4b0 con 0x7fd62c072ec0 2024-04-26T23:41:57.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.861+0000 7fd629600640 1 -- 172.21.15.137:0/3915898938 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd61800bc00 con 0x7fd62c072ec0 2024-04-26T23:41:57.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.861+0000 7fd629600640 1 --2- 172.21.15.137:0/3915898938 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd60c0683b0 0x7fd60c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:57.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.861+0000 7fd629600640 1 -- 172.21.15.137:0/3915898938 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd618086da0 con 0x7fd62c072ec0 2024-04-26T23:41:57.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.861+0000 7fd631a00640 1 --2- 172.21.15.137:0/3915898938 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd60c0683b0 0x7fd60c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:57.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.865+0000 7fd631a00640 1 --2- 172.21.15.137:0/3915898938 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd60c0683b0 0x7fd60c06a870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd6200ae000 tx=0x7fd6200b3040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:57.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:57.865+0000 7fd629600640 1 -- 172.21.15.137:0/3915898938 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd618056d00 con 0x7fd62c072ec0 2024-04-26T23:41:58.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.033+0000 7fd634400640 1 -- 172.21.15.137:0/3915898938 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd62c072380 con 0x7fd62c072ec0 2024-04-26T23:41:58.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.033+0000 7fd629600640 1 -- 172.21.15.137:0/3915898938 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fd61805b000 con 0x7fd62c072ec0 2024-04-26T23:41:58.039 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T23:41:58.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.037+0000 7fd634400640 1 -- 172.21.15.137:0/3915898938 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd60c0683b0 msgr2=0x7fd60c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:58.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.037+0000 7fd634400640 1 --2- 172.21.15.137:0/3915898938 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd60c0683b0 0x7fd60c06a870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd6200ae000 tx=0x7fd6200b3040 comp rx=0 tx=0).stop 2024-04-26T23:41:58.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.037+0000 7fd634400640 1 -- 172.21.15.137:0/3915898938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd62c072ec0 msgr2=0x7fd62c0aeb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:58.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.037+0000 7fd634400640 1 --2- 172.21.15.137:0/3915898938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd62c072ec0 0x7fd62c0aeb30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd61800d800 tx=0x7fd61800dcc0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.037+0000 7fd634400640 1 -- 172.21.15.137:0/3915898938 shutdown_connections 2024-04-26T23:41:58.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.037+0000 7fd634400640 1 --2- 172.21.15.137:0/3915898938 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd60c0683b0 0x7fd60c06a870 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.037+0000 7fd634400640 1 --2- 172.21.15.137:0/3915898938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd62c072ec0 0x7fd62c0aeb30 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.037+0000 7fd634400640 1 --2- 172.21.15.137:0/3915898938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd62c073f30 0x7fd62c142460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.037+0000 7fd634400640 1 --2- 172.21.15.137:0/3915898938 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd62c0725a0 0x7fd62c13a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.037+0000 7fd634400640 1 -- 172.21.15.137:0/3915898938 >> 172.21.15.137:0/3915898938 conn(0x7fd62c06c5d0 msgr2=0x7fd62c06c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:58.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.037+0000 7fd634400640 1 -- 172.21.15.137:0/3915898938 shutdown_connections 2024-04-26T23:41:58.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.037+0000 7fd634400640 1 -- 172.21.15.137:0/3915898938 wait complete. 2024-04-26T23:41:58.060 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:41:58.060 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:41:58.068 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:58.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.245+0000 7f0ab9e00640 1 Processor -- start 2024-04-26T23:41:58.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.245+0000 7f0ab9e00640 1 -- start start 2024-04-26T23:41:58.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.245+0000 7f0ab9e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0ab415de80 0x7f0ab4073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:58.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.245+0000 7f0ab9e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ab4073010 con 0x7f0ab40ce7c0 2024-04-26T23:41:58.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.245+0000 7f0ab9e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ab40cef90 con 0x7f0ab40ce3e0 2024-04-26T23:41:58.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.245+0000 7f0ab9e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0ab4073280 con 0x7f0ab415de80 2024-04-26T23:41:58.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.249+0000 7f0aaa000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0ab415de80 0x7f0ab4073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:58.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.249+0000 7f0aaa000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0ab415de80 0x7f0ab4073d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60066/0 (socket says 172.21.15.137:60066) 2024-04-26T23:41:58.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.249+0000 7f0aaa000640 1 -- 172.21.15.137:0/4086627645 learned_addr learned my addr 172.21.15.137:0/4086627645 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:58.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.249+0000 7f0aaa000640 1 -- 172.21.15.137:0/4086627645 >> v1:172.21.15.170:6789/0 conn(0x7f0ab40ce3e0 legacy=0x7f0ab40d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:58.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.249+0000 7f0aaa000640 1 -- 172.21.15.137:0/4086627645 >> v1:172.21.15.137:6789/0 conn(0x7f0ab40ce7c0 legacy=0x7f0ab4146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:58.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.249+0000 7f0aaa000640 1 -- 172.21.15.137:0/4086627645 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab4073560 con 0x7f0ab415de80 2024-04-26T23:41:58.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.249+0000 7f0aaa000640 1 --2- 172.21.15.137:0/4086627645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ab415de80 0x7f0ab4073d60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0098a0 tx=0x7f0a9c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283142c9d36b1745 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:58.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.249+0000 7f0ab2000640 1 -- 172.21.15.137:0/4086627645 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0aa650 con 0x7f0ab415de80 2024-04-26T23:41:58.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.249+0000 7f0ab2000640 1 -- 172.21.15.137:0/4086627645 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a9c0af070 con 0x7f0ab415de80 2024-04-26T23:41:58.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.249+0000 7f0ab2000640 1 -- 172.21.15.137:0/4086627645 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0aaa10 con 0x7f0ab415de80 2024-04-26T23:41:58.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab9e00640 1 -- 172.21.15.137:0/4086627645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ab415de80 msgr2=0x7f0ab4073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:58.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab9e00640 1 --2- 172.21.15.137:0/4086627645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ab415de80 0x7f0ab4073d60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0098a0 tx=0x7f0a9c01c4d0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab9e00640 1 -- 172.21.15.137:0/4086627645 shutdown_connections 2024-04-26T23:41:58.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab9e00640 1 --2- 172.21.15.137:0/4086627645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ab415de80 0x7f0ab4073d60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab9e00640 1 -- 172.21.15.137:0/4086627645 >> 172.21.15.137:0/4086627645 conn(0x7f0ab406c5d0 msgr2=0x7f0ab406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:58.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab9e00640 1 -- 172.21.15.137:0/4086627645 shutdown_connections 2024-04-26T23:41:58.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab9e00640 1 -- 172.21.15.137:0/4086627645 wait complete. 2024-04-26T23:41:58.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab9e00640 1 Processor -- start 2024-04-26T23:41:58.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab9e00640 1 -- start start 2024-04-26T23:41:58.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab9e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ab40ce3e0 0x7f0ab413cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:58.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab9e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ab40ce7c0 0x7f0ab4140b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:58.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab9e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ab415de80 0x7f0ab40b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:58.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab9e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab406ed10 con 0x7f0ab415de80 2024-04-26T23:41:58.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab9e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab406ee90 con 0x7f0ab40ce7c0 2024-04-26T23:41:58.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab9e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0ab406f010 con 0x7f0ab40ce3e0 2024-04-26T23:41:58.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ab415de80 0x7f0ab40b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:58.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0aaa000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ab40ce7c0 0x7f0ab4140b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:58.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ab415de80 0x7f0ab40b4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60076/0 (socket says 172.21.15.137:60076) 2024-04-26T23:41:58.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab3400640 1 -- 172.21.15.137:0/2318630201 learned_addr learned my addr 172.21.15.137:0/2318630201 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:58.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab2a00640 1 --2- 172.21.15.137:0/2318630201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ab40ce3e0 0x7f0ab413cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:58.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab3400640 1 -- 172.21.15.137:0/2318630201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ab40ce3e0 msgr2=0x7f0ab413cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:58.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab3400640 1 --2- 172.21.15.137:0/2318630201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ab40ce3e0 0x7f0ab413cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab3400640 1 -- 172.21.15.137:0/2318630201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ab40ce7c0 msgr2=0x7f0ab4140b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:58.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab3400640 1 --2- 172.21.15.137:0/2318630201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ab40ce7c0 0x7f0ab4140b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.253+0000 7f0ab3400640 1 -- 172.21.15.137:0/2318630201 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab406ce90 con 0x7f0ab415de80 2024-04-26T23:41:58.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.257+0000 7f0ab3400640 1 --2- 172.21.15.137:0/2318630201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ab415de80 0x7f0ab40b4e60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00c7a0 tx=0x7f0aac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:58.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.257+0000 7f0aabe00640 1 -- 172.21.15.137:0/2318630201 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac003b80 con 0x7f0ab415de80 2024-04-26T23:41:58.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.257+0000 7f0aabe00640 1 -- 172.21.15.137:0/2318630201 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aac003d20 con 0x7f0ab415de80 2024-04-26T23:41:58.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.257+0000 7f0aabe00640 1 -- 172.21.15.137:0/2318630201 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac00aa90 con 0x7f0ab415de80 2024-04-26T23:41:58.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.257+0000 7f0ab9e00640 1 -- 172.21.15.137:0/2318630201 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab40b4a40 con 0x7f0ab415de80 2024-04-26T23:41:58.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.257+0000 7f0ab9e00640 1 -- 172.21.15.137:0/2318630201 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab4140300 con 0x7f0ab415de80 2024-04-26T23:41:58.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.257+0000 7f0ab9e00640 1 -- 172.21.15.137:0/2318630201 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ab4068950 con 0x7f0ab415de80 2024-04-26T23:41:58.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.257+0000 7f0aabe00640 1 -- 172.21.15.137:0/2318630201 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0aac00ac30 con 0x7f0ab415de80 2024-04-26T23:41:58.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.257+0000 7f0aabe00640 1 --2- 172.21.15.137:0/2318630201 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0a90068380 0x7f0a9006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:58.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.257+0000 7f0aabe00640 1 -- 172.21.15.137:0/2318630201 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0aac086800 con 0x7f0ab415de80 2024-04-26T23:41:58.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.257+0000 7f0ab2a00640 1 --2- 172.21.15.137:0/2318630201 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0a90068380 0x7f0a9006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:58.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.261+0000 7f0ab2a00640 1 --2- 172.21.15.137:0/2318630201 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0a90068380 0x7f0a9006a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4007fd0 tx=0x7f0aa4007e40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:58.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.261+0000 7f0aabe00640 1 -- 172.21.15.137:0/2318630201 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0ab406ce90 con 0x7f0ab415de80 2024-04-26T23:41:58.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.421+0000 7f0ab9e00640 1 -- 172.21.15.137:0/2318630201 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ab406a4b0 con 0x7f0ab415de80 2024-04-26T23:41:58.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.421+0000 7f0aabe00640 1 -- 172.21.15.137:0/2318630201 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16653 (secure 0 0 0) 0x7f0aac0566d0 con 0x7f0ab415de80 2024-04-26T23:41:58.426 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:41:58.427 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:25.186308+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:58.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.425+0000 7f0ab9e00640 1 -- 172.21.15.137:0/2318630201 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0a90068380 msgr2=0x7f0a9006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:58.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.425+0000 7f0ab9e00640 1 --2- 172.21.15.137:0/2318630201 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0a90068380 0x7f0a9006a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4007fd0 tx=0x7f0aa4007e40 comp rx=0 tx=0).stop 2024-04-26T23:41:58.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.425+0000 7f0ab9e00640 1 -- 172.21.15.137:0/2318630201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ab415de80 msgr2=0x7f0ab40b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:58.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.425+0000 7f0ab9e00640 1 --2- 172.21.15.137:0/2318630201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ab415de80 0x7f0ab40b4e60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00c7a0 tx=0x7f0aac00cc60 comp rx=0 tx=0).stop 2024-04-26T23:41:58.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.425+0000 7f0ab9e00640 1 -- 172.21.15.137:0/2318630201 shutdown_connections 2024-04-26T23:41:58.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.425+0000 7f0ab9e00640 1 --2- 172.21.15.137:0/2318630201 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0a90068380 0x7f0a9006a840 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.425+0000 7f0ab9e00640 1 --2- 172.21.15.137:0/2318630201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ab415de80 0x7f0ab40b4e60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.425+0000 7f0ab9e00640 1 --2- 172.21.15.137:0/2318630201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ab40ce7c0 0x7f0ab4140b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.425+0000 7f0ab9e00640 1 --2- 172.21.15.137:0/2318630201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ab40ce3e0 0x7f0ab413cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.425+0000 7f0ab9e00640 1 -- 172.21.15.137:0/2318630201 >> 172.21.15.137:0/2318630201 conn(0x7f0ab406c5d0 msgr2=0x7f0ab4141b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:58.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.425+0000 7f0ab9e00640 1 -- 172.21.15.137:0/2318630201 shutdown_connections 2024-04-26T23:41:58.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.425+0000 7f0ab9e00640 1 -- 172.21.15.137:0/2318630201 wait complete. 2024-04-26T23:41:58.448 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:41:21.810449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:41:22.533452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:41:58.448 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:41:58.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.581+0000 7f7c31c00640 1 Processor -- start 2024-04-26T23:41:58.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.581+0000 7f7c31c00640 1 -- start start 2024-04-26T23:41:58.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.585+0000 7f7c31c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7c2c0b54e0 0x7f7c2c0b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:58.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.585+0000 7f7c31c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7c2c160000 0x7f7c2c144d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:58.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.585+0000 7f7c31c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c2c0cffa0 con 0x7f7c2c0cd710 2024-04-26T23:41:58.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.585+0000 7f7c31c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7c2c0b3d90 con 0x7f7c2c0b54e0 2024-04-26T23:41:58.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.585+0000 7f7c31c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f7c2c0d0840 con 0x7f7c2c160000 2024-04-26T23:41:58.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.585+0000 7f7c2aa00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7c2c0b54e0 0x7f7c2c0b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:58.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.585+0000 7f7c2aa00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7c2c0b54e0 0x7f7c2c0b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60080/0 (socket says 172.21.15.137:60080) 2024-04-26T23:41:58.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.585+0000 7f7c2aa00640 1 -- 172.21.15.137:0/2823547182 learned_addr learned my addr 172.21.15.137:0/2823547182 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:58.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.585+0000 7f7c2b400640 1 --2- 172.21.15.137:0/2823547182 >> v2:172.21.15.170:3300/0 conn(0x7f7c2c160000 0x7f7c2c144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:58.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.585+0000 7f7c2aa00640 1 -- 172.21.15.137:0/2823547182 >> v2:172.21.15.170:3300/0 conn(0x7f7c2c160000 msgr2=0x7f7c2c144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:58.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.585+0000 7f7c2aa00640 1 --2- 172.21.15.137:0/2823547182 >> v2:172.21.15.170:3300/0 conn(0x7f7c2c160000 0x7f7c2c144d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.585+0000 7f7c2aa00640 1 -- 172.21.15.137:0/2823547182 >> v1:172.21.15.170:6789/0 conn(0x7f7c2c0cd710 legacy=0x7f7c2c15f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:58.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.585+0000 7f7c2aa00640 1 -- 172.21.15.137:0/2823547182 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c2c0d0280 con 0x7f7c2c0b54e0 2024-04-26T23:41:58.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.585+0000 7f7c2b400640 1 --2- 172.21.15.137:0/2823547182 >> v2:172.21.15.170:3300/0 conn(0x7f7c2c160000 0x7f7c2c144d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:58.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.589+0000 7f7c2aa00640 1 --2- 172.21.15.137:0/2823547182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c2c0b54e0 0x7f7c2c0b5ee0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00bb10 tx=0x7f7c1c01eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d256d98740bb28 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:58.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.589+0000 7f7c2a000640 1 -- 172.21.15.137:0/2823547182 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0b4070 con 0x7f7c2c0b54e0 2024-04-26T23:41:58.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.589+0000 7f7c2a000640 1 -- 172.21.15.137:0/2823547182 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c2c145a70 con 0x7f7c2c0b54e0 2024-04-26T23:41:58.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.589+0000 7f7c2a000640 1 -- 172.21.15.137:0/2823547182 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0af440 con 0x7f7c2c0b54e0 2024-04-26T23:41:58.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.589+0000 7f7c31c00640 1 -- 172.21.15.137:0/2823547182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c2c0b54e0 msgr2=0x7f7c2c0b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:58.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.589+0000 7f7c31c00640 1 --2- 172.21.15.137:0/2823547182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c2c0b54e0 0x7f7c2c0b5ee0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00bb10 tx=0x7f7c1c01eb80 comp rx=0 tx=0).stop 2024-04-26T23:41:58.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.589+0000 7f7c31c00640 1 -- 172.21.15.137:0/2823547182 shutdown_connections 2024-04-26T23:41:58.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.589+0000 7f7c31c00640 1 --2- 172.21.15.137:0/2823547182 >> v2:172.21.15.170:3300/0 conn(0x7f7c2c160000 0x7f7c2c144d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.589+0000 7f7c31c00640 1 --2- 172.21.15.137:0/2823547182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c2c0b54e0 0x7f7c2c0b5ee0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.589+0000 7f7c31c00640 1 -- 172.21.15.137:0/2823547182 >> 172.21.15.137:0/2823547182 conn(0x7f7c2c06c800 msgr2=0x7f7c2c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:58.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.589+0000 7f7c31c00640 1 -- 172.21.15.137:0/2823547182 shutdown_connections 2024-04-26T23:41:58.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.589+0000 7f7c31c00640 1 -- 172.21.15.137:0/2823547182 wait complete. 2024-04-26T23:41:58.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.589+0000 7f7c31c00640 1 Processor -- start 2024-04-26T23:41:58.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.589+0000 7f7c31c00640 1 -- start start 2024-04-26T23:41:58.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.589+0000 7f7c31c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c2c0b54e0 0x7f7c2c1417f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:58.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.589+0000 7f7c31c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c2c0cd710 0x7f7c2c0b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:58.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.589+0000 7f7c31c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c2c160000 0x7f7c2c167280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:58.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.589+0000 7f7c31c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c06ef60 con 0x7f7c2c160000 2024-04-26T23:41:58.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.589+0000 7f7c31c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c0cded0 con 0x7f7c2c0cd710 2024-04-26T23:41:58.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.589+0000 7f7c31c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7c2c06f0e0 con 0x7f7c2c0b54e0 2024-04-26T23:41:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.589+0000 7f7c2b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c2c160000 0x7f7c2c167280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.593+0000 7f7c2b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c2c160000 0x7f7c2c167280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60090/0 (socket says 172.21.15.137:60090) 2024-04-26T23:41:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.593+0000 7f7c2b400640 1 -- 172.21.15.137:0/1308920525 learned_addr learned my addr 172.21.15.137:0/1308920525 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.593+0000 7f7c2aa00640 1 --2- 172.21.15.137:0/1308920525 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c2c0b54e0 0x7f7c2c1417f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.593+0000 7f7c22000640 1 --2- 172.21.15.137:0/1308920525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c2c0cd710 0x7f7c2c0b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.593+0000 7f7c2b400640 1 -- 172.21.15.137:0/1308920525 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c2c0b54e0 msgr2=0x7f7c2c1417f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.593+0000 7f7c2b400640 1 --2- 172.21.15.137:0/1308920525 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c2c0b54e0 0x7f7c2c1417f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.593+0000 7f7c2b400640 1 -- 172.21.15.137:0/1308920525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c2c0cd710 msgr2=0x7f7c2c0b2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.593+0000 7f7c2b400640 1 --2- 172.21.15.137:0/1308920525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c2c0cd710 0x7f7c2c0b2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.593+0000 7f7c2b400640 1 -- 172.21.15.137:0/1308920525 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c2c0aff70 con 0x7f7c2c160000 2024-04-26T23:41:58.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.593+0000 7f7c2b400640 1 --2- 172.21.15.137:0/1308920525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c2c160000 0x7f7c2c167280 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400cd50 tx=0x7f7c2400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:58.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.593+0000 7f7c23400640 1 -- 172.21.15.137:0/1308920525 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2400f680 con 0x7f7c2c160000 2024-04-26T23:41:58.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.593+0000 7f7c23400640 1 -- 172.21.15.137:0/1308920525 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c2400f840 con 0x7f7c2c160000 2024-04-26T23:41:58.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.593+0000 7f7c31c00640 1 -- 172.21.15.137:0/1308920525 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c2c0b0250 con 0x7f7c2c160000 2024-04-26T23:41:58.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.593+0000 7f7c23400640 1 -- 172.21.15.137:0/1308920525 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2400fc30 con 0x7f7c2c160000 2024-04-26T23:41:58.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.593+0000 7f7c31c00640 1 -- 172.21.15.137:0/1308920525 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c2c1677c0 con 0x7f7c2c160000 2024-04-26T23:41:58.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.593+0000 7f7c31c00640 1 -- 172.21.15.137:0/1308920525 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c2c06a410 con 0x7f7c2c160000 2024-04-26T23:41:58.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.593+0000 7f7c23400640 1 -- 172.21.15.137:0/1308920525 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7c240213f0 con 0x7f7c2c160000 2024-04-26T23:41:58.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.597+0000 7f7c23400640 1 --2- 172.21.15.137:0/1308920525 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c08068380 0x7f7c0806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:58.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.597+0000 7f7c23400640 1 -- 172.21.15.137:0/1308920525 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7c24087690 con 0x7f7c2c160000 2024-04-26T23:41:58.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.597+0000 7f7c2aa00640 1 --2- 172.21.15.137:0/1308920525 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c08068380 0x7f7c0806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:58.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.597+0000 7f7c2aa00640 1 --2- 172.21.15.137:0/1308920525 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c08068380 0x7f7c0806a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0b1000 tx=0x7f7c1c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:58.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.601+0000 7f7c23400640 1 -- 172.21.15.137:0/1308920525 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7c24014030 con 0x7f7c2c160000 2024-04-26T23:41:58.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.761+0000 7f7c31c00640 1 -- 172.21.15.137:0/1308920525 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7c2c0688c0 con 0x7f7c2c160000 2024-04-26T23:41:58.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.761+0000 7f7c23400640 1 -- 172.21.15.137:0/1308920525 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f7c24057560 con 0x7f7c2c160000 2024-04-26T23:41:58.764 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:41:58.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.761+0000 7f7c31c00640 1 -- 172.21.15.137:0/1308920525 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c08068380 msgr2=0x7f7c0806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:58.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.761+0000 7f7c31c00640 1 --2- 172.21.15.137:0/1308920525 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c08068380 0x7f7c0806a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0b1000 tx=0x7f7c1c008040 comp rx=0 tx=0).stop 2024-04-26T23:41:58.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.761+0000 7f7c31c00640 1 -- 172.21.15.137:0/1308920525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c2c160000 msgr2=0x7f7c2c167280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:58.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.761+0000 7f7c31c00640 1 --2- 172.21.15.137:0/1308920525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c2c160000 0x7f7c2c167280 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400cd50 tx=0x7f7c2400a650 comp rx=0 tx=0).stop 2024-04-26T23:41:58.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.761+0000 7f7c31c00640 1 -- 172.21.15.137:0/1308920525 shutdown_connections 2024-04-26T23:41:58.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.761+0000 7f7c31c00640 1 --2- 172.21.15.137:0/1308920525 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c08068380 0x7f7c0806a840 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.761+0000 7f7c31c00640 1 --2- 172.21.15.137:0/1308920525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c2c160000 0x7f7c2c167280 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.761+0000 7f7c31c00640 1 --2- 172.21.15.137:0/1308920525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c2c0cd710 0x7f7c2c0b2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.761+0000 7f7c31c00640 1 --2- 172.21.15.137:0/1308920525 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c2c0b54e0 0x7f7c2c1417f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.761+0000 7f7c31c00640 1 -- 172.21.15.137:0/1308920525 >> 172.21.15.137:0/1308920525 conn(0x7f7c2c06c800 msgr2=0x7f7c2c0cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:58.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.761+0000 7f7c31c00640 1 -- 172.21.15.137:0/1308920525 shutdown_connections 2024-04-26T23:41:58.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.761+0000 7f7c31c00640 1 -- 172.21.15.137:0/1308920525 wait complete. 2024-04-26T23:41:58.785 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:41:58.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.921+0000 7f24c6200640 1 Processor -- start 2024-04-26T23:41:58.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.921+0000 7f24c6200640 1 -- start start 2024-04-26T23:41:58.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.921+0000 7f24c6200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f24c015cfe0 0x7f24c00d0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:58.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.921+0000 7f24c6200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f24c0073040 0x7f24c006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:58.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.921+0000 7f24c6200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24c00cdc00 con 0x7f24c00cd770 2024-04-26T23:41:58.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.921+0000 7f24c6200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f24c00d1340 con 0x7f24c0073040 2024-04-26T23:41:58.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.921+0000 7f24c6200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f24c00cdee0 con 0x7f24c015cfe0 2024-04-26T23:41:58.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.921+0000 7f24bfe00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f24c0073040 0x7f24c006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:58.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.921+0000 7f24bf400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f24c015cfe0 0x7f24c00d0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:58.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.921+0000 7f24bea00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f24c00cd770 0x7f24c0072930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:52540/0 (socket says 172.21.15.137:52540) 2024-04-26T23:41:58.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.921+0000 7f24bea00640 1 -- 172.21.15.137:0/124828004 learned_addr learned my addr 172.21.15.137:0/124828004 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:58.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.921+0000 7f24bf400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f24c015cfe0 0x7f24c00d0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:36932/0 (socket says 172.21.15.137:36932) 2024-04-26T23:41:58.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.925+0000 7f24bf400640 1 -- 172.21.15.137:0/124828004 >> v2:172.21.15.170:3300/0 conn(0x7f24c0073040 msgr2=0x7f24c006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:58.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.925+0000 7f24bf400640 1 --2- 172.21.15.137:0/124828004 >> v2:172.21.15.170:3300/0 conn(0x7f24c0073040 0x7f24c006ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.925+0000 7f24bf400640 1 -- 172.21.15.137:0/124828004 >> v1:172.21.15.170:6789/0 conn(0x7f24c00cd770 legacy=0x7f24c0072930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:58.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.925+0000 7f24bf400640 1 -- 172.21.15.137:0/124828004 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24c00ce1c0 con 0x7f24c015cfe0 2024-04-26T23:41:58.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.925+0000 7f24bfe00640 1 --2- 172.21.15.137:0/124828004 >> v2:172.21.15.170:3300/0 conn(0x7f24c0073040 0x7f24c006ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:41:58.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.925+0000 7f24bf400640 1 --2- 172.21.15.137:0/124828004 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f24c015cfe0 0x7f24c00d0e00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f24b0009d90 tx=0x7f24b001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b84e66e0655168a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:58.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.925+0000 7f24be000640 1 -- 172.21.15.137:0/124828004 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b00b2070 con 0x7f24c015cfe0 2024-04-26T23:41:58.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.925+0000 7f24be000640 1 -- 172.21.15.137:0/124828004 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b00a5a00 con 0x7f24c015cfe0 2024-04-26T23:41:58.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.925+0000 7f24be000640 1 -- 172.21.15.137:0/124828004 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b00a5dd0 con 0x7f24c015cfe0 2024-04-26T23:41:58.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24c6200640 1 -- 172.21.15.137:0/124828004 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f24c015cfe0 msgr2=0x7f24c00d0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:58.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24c6200640 1 --2- 172.21.15.137:0/124828004 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f24c015cfe0 0x7f24c00d0e00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f24b0009d90 tx=0x7f24b001c940 comp rx=0 tx=0).stop 2024-04-26T23:41:58.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24c6200640 1 -- 172.21.15.137:0/124828004 shutdown_connections 2024-04-26T23:41:58.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24c6200640 1 --2- 172.21.15.137:0/124828004 >> v2:172.21.15.170:3300/0 conn(0x7f24c0073040 0x7f24c006ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24c6200640 1 --2- 172.21.15.137:0/124828004 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f24c015cfe0 0x7f24c00d0e00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24c6200640 1 -- 172.21.15.137:0/124828004 >> 172.21.15.137:0/124828004 conn(0x7f24c00b3370 msgr2=0x7f24c00b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:58.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24c6200640 1 -- 172.21.15.137:0/124828004 shutdown_connections 2024-04-26T23:41:58.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24c6200640 1 -- 172.21.15.137:0/124828004 wait complete. 2024-04-26T23:41:58.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24c6200640 1 Processor -- start 2024-04-26T23:41:58.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24c6200640 1 -- start start 2024-04-26T23:41:58.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24c6200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24c0073040 0x7f24c0145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:58.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24c6200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24c015cfe0 0x7f24c015f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:58.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24c6200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f24c0156420 0x7f24c0156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:58.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24c6200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f24c00b10f0 con 0x7f24c015cfe0 2024-04-26T23:41:58.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24c6200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f24c00b0f70 con 0x7f24c0073040 2024-04-26T23:41:58.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24c6200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f24c006f770 con 0x7f24c0156420 2024-04-26T23:41:58.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24bea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24c015cfe0 0x7f24c015f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:58.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24bea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24c015cfe0 0x7f24c015f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60092/0 (socket says 172.21.15.137:60092) 2024-04-26T23:41:58.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24bf400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24c0073040 0x7f24c0145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:58.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24bea00640 1 -- 172.21.15.137:0/2965535326 learned_addr learned my addr 172.21.15.137:0/2965535326 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:58.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24bfe00640 1 --2- 172.21.15.137:0/2965535326 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f24c0156420 0x7f24c0156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:58.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24bea00640 1 -- 172.21.15.137:0/2965535326 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f24c0156420 msgr2=0x7f24c0156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:58.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24bea00640 1 --2- 172.21.15.137:0/2965535326 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f24c0156420 0x7f24c0156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24bea00640 1 -- 172.21.15.137:0/2965535326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24c0073040 msgr2=0x7f24c0145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:58.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24bea00640 1 --2- 172.21.15.137:0/2965535326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24c0073040 0x7f24c0145ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:58.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24bea00640 1 -- 172.21.15.137:0/2965535326 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24c0146400 con 0x7f24c015cfe0 2024-04-26T23:41:58.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.929+0000 7f24bea00640 1 --2- 172.21.15.137:0/2965535326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24c015cfe0 0x7f24c015f2c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00c450 tx=0x7f24ac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:58.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.933+0000 7f24b7400640 1 -- 172.21.15.137:0/2965535326 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ac017070 con 0x7f24c015cfe0 2024-04-26T23:41:58.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.933+0000 7f24b7400640 1 -- 172.21.15.137:0/2965535326 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ac005cf0 con 0x7f24c015cfe0 2024-04-26T23:41:58.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.933+0000 7f24b7400640 1 -- 172.21.15.137:0/2965535326 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ac007290 con 0x7f24c015cfe0 2024-04-26T23:41:58.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.933+0000 7f24c6200640 1 -- 172.21.15.137:0/2965535326 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24c015d5d0 con 0x7f24c015cfe0 2024-04-26T23:41:58.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.933+0000 7f24c6200640 1 -- 172.21.15.137:0/2965535326 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24c015db90 con 0x7f24c015cfe0 2024-04-26T23:41:58.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.933+0000 7f24c6200640 1 -- 172.21.15.137:0/2965535326 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24c006a410 con 0x7f24c015cfe0 2024-04-26T23:41:58.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.933+0000 7f24b7400640 1 -- 172.21.15.137:0/2965535326 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f24ac01a070 con 0x7f24c015cfe0 2024-04-26T23:41:58.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.933+0000 7f24b7400640 1 --2- 172.21.15.137:0/2965535326 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f24a0068380 0x7f24a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:58.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.933+0000 7f24b7400640 1 -- 172.21.15.137:0/2965535326 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f24ac085cd0 con 0x7f24c015cfe0 2024-04-26T23:41:58.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.933+0000 7f24bf400640 1 --2- 172.21.15.137:0/2965535326 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f24a0068380 0x7f24a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:58.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.933+0000 7f24bf400640 1 --2- 172.21.15.137:0/2965535326 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f24a0068380 0x7f24a006a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f24b00af000 tx=0x7f24b00a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:58.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:58.937+0000 7f24b7400640 1 -- 172.21.15.137:0/2965535326 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f24ac055ba0 con 0x7f24c015cfe0 2024-04-26T23:41:59.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.093+0000 7f24c6200640 1 -- 172.21.15.137:0/2965535326 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f24c00af520 con 0x7f24c015cfe0 2024-04-26T23:41:59.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.093+0000 7f24b7400640 1 -- 172.21.15.137:0/2965535326 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f24ac059ea0 con 0x7f24c015cfe0 2024-04-26T23:41:59.099 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:41:59.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.097+0000 7f24c6200640 1 -- 172.21.15.137:0/2965535326 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f24a0068380 msgr2=0x7f24a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:59.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.097+0000 7f24c6200640 1 --2- 172.21.15.137:0/2965535326 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f24a0068380 0x7f24a006a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f24b00af000 tx=0x7f24b00a7070 comp rx=0 tx=0).stop 2024-04-26T23:41:59.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.097+0000 7f24c6200640 1 -- 172.21.15.137:0/2965535326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24c015cfe0 msgr2=0x7f24c015f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:59.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.097+0000 7f24c6200640 1 --2- 172.21.15.137:0/2965535326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24c015cfe0 0x7f24c015f2c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00c450 tx=0x7f24ac00c910 comp rx=0 tx=0).stop 2024-04-26T23:41:59.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.097+0000 7f24c6200640 1 -- 172.21.15.137:0/2965535326 shutdown_connections 2024-04-26T23:41:59.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.097+0000 7f24c6200640 1 --2- 172.21.15.137:0/2965535326 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f24a0068380 0x7f24a006a840 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:59.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.097+0000 7f24c6200640 1 --2- 172.21.15.137:0/2965535326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24c015cfe0 0x7f24c015f2c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:59.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.097+0000 7f24c6200640 1 --2- 172.21.15.137:0/2965535326 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f24c0156420 0x7f24c0156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:59.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.097+0000 7f24c6200640 1 --2- 172.21.15.137:0/2965535326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24c0073040 0x7f24c0145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:59.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.097+0000 7f24c6200640 1 -- 172.21.15.137:0/2965535326 >> 172.21.15.137:0/2965535326 conn(0x7f24c00b3370 msgr2=0x7f24c006fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:59.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.097+0000 7f24c6200640 1 -- 172.21.15.137:0/2965535326 shutdown_connections 2024-04-26T23:41:59.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.097+0000 7f24c6200640 1 -- 172.21.15.137:0/2965535326 wait complete. 2024-04-26T23:41:59.119 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:41:59.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.253+0000 7fcea3000640 1 Processor -- start 2024-04-26T23:41:59.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.253+0000 7fcea3000640 1 -- start start 2024-04-26T23:41:59.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.253+0000 7fcea3000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce9c15f910 0x7fce9c0b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:59.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.253+0000 7fcea3000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce9c0b21e0 con 0x7fce9c0b3180 2024-04-26T23:41:59.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.253+0000 7fcea3000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce9c0b3600 con 0x7fce9c0b6290 2024-04-26T23:41:59.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.253+0000 7fcea3000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fce9c0b38e0 con 0x7fce9c15f910 2024-04-26T23:41:59.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.253+0000 7fce93400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fce9c0b3180 0x7fce9c15fcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49244/0 (socket says 172.21.15.137:49244) 2024-04-26T23:41:59.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.253+0000 7fce93400640 1 -- 172.21.15.137:0/4058438142 learned_addr learned my addr 172.21.15.137:0/4058438142 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:41:59.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.257+0000 7fce9be00640 1 --2- 172.21.15.137:0/4058438142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce9c15f910 0x7fce9c0b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:59.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.257+0000 7fce9b400640 1 -- 172.21.15.137:0/4058438142 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3598961307 0 0) 0x7fce9c0b21e0 con 0x7fce9c0b3180 2024-04-26T23:41:59.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.257+0000 7fce9b400640 1 -- 172.21.15.137:0/4058438142 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce80003530 con 0x7fce9c0b3180 2024-04-26T23:41:59.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.257+0000 7fce9b400640 1 -- 172.21.15.137:0/4058438142 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2420503511 0 0) 0x7fce9c0b3600 con 0x7fce9c0b6290 2024-04-26T23:41:59.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.257+0000 7fce9b400640 1 -- 172.21.15.137:0/4058438142 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce9c0b21e0 con 0x7fce9c0b6290 2024-04-26T23:41:59.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.257+0000 7fce9b400640 1 -- 172.21.15.137:0/4058438142 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2099919272 0 0) 0x7fce80003530 con 0x7fce9c0b3180 2024-04-26T23:41:59.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.257+0000 7fce9be00640 1 -- 172.21.15.137:0/4058438142 >> v1:172.21.15.170:6789/0 conn(0x7fce9c0b6290 legacy=0x7fce9c168ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:59.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.257+0000 7fce9be00640 1 -- 172.21.15.137:0/4058438142 >> v1:172.21.15.137:6789/0 conn(0x7fce9c0b3180 legacy=0x7fce9c15fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:59.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.257+0000 7fce9be00640 1 -- 172.21.15.137:0/4058438142 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9c0b3bc0 con 0x7fce9c15f910 2024-04-26T23:41:59.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.257+0000 7fce9be00640 1 --2- 172.21.15.137:0/4058438142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce9c15f910 0x7fce9c0b5d50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fce8c009dc0 tx=0x7fce8c01c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e70685931e61260 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:59.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fce9b400640 1 -- 172.21.15.137:0/4058438142 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c0b2070 con 0x7fce9c15f910 2024-04-26T23:41:59.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fce9b400640 1 -- 172.21.15.137:0/4058438142 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce8c0a5570 con 0x7fce9c15f910 2024-04-26T23:41:59.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fce9b400640 1 -- 172.21.15.137:0/4058438142 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce840016a0 con 0x7fce9c15f910 2024-04-26T23:41:59.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fcea3000640 1 -- 172.21.15.137:0/4058438142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce9c15f910 msgr2=0x7fce9c0b5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:59.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fcea3000640 1 --2- 172.21.15.137:0/4058438142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce9c15f910 0x7fce9c0b5d50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fce8c009dc0 tx=0x7fce8c01c820 comp rx=0 tx=0).stop 2024-04-26T23:41:59.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fcea3000640 1 -- 172.21.15.137:0/4058438142 shutdown_connections 2024-04-26T23:41:59.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fcea3000640 1 --2- 172.21.15.137:0/4058438142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce9c15f910 0x7fce9c0b5d50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:59.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fcea3000640 1 -- 172.21.15.137:0/4058438142 >> 172.21.15.137:0/4058438142 conn(0x7fce9c0b6710 msgr2=0x7fce9c0b6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:59.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fcea3000640 1 -- 172.21.15.137:0/4058438142 shutdown_connections 2024-04-26T23:41:59.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fcea3000640 1 -- 172.21.15.137:0/4058438142 wait complete. 2024-04-26T23:41:59.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fcea3000640 1 Processor -- start 2024-04-26T23:41:59.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fcea3000640 1 -- start start 2024-04-26T23:41:59.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fcea3000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce9c0b3180 0x7fce9c150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:59.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fcea3000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce9c0b6290 0x7fce9c15c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:59.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fcea3000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce9c15f910 0x7fce9c15c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:59.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fcea3000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c16d190 con 0x7fce9c0b6290 2024-04-26T23:41:59.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fcea3000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c16d010 con 0x7fce9c15f910 2024-04-26T23:41:59.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fcea3000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fce9c16d310 con 0x7fce9c0b3180 2024-04-26T23:41:59.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fce93400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce9c0b6290 0x7fce9c15c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:59.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fce93400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce9c0b6290 0x7fce9c15c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60096/0 (socket says 172.21.15.137:60096) 2024-04-26T23:41:59.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fce93400640 1 -- 172.21.15.137:0/3447322768 learned_addr learned my addr 172.21.15.137:0/3447322768 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:59.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fcea1000640 1 --2- 172.21.15.137:0/3447322768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce9c15f910 0x7fce9c15c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:59.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.261+0000 7fce9be00640 1 --2- 172.21.15.137:0/3447322768 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce9c0b3180 0x7fce9c150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:59.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.265+0000 7fce93400640 1 -- 172.21.15.137:0/3447322768 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce9c0b3180 msgr2=0x7fce9c150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:59.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.265+0000 7fce93400640 1 --2- 172.21.15.137:0/3447322768 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce9c0b3180 0x7fce9c150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:59.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.265+0000 7fce93400640 1 -- 172.21.15.137:0/3447322768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce9c15f910 msgr2=0x7fce9c15c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:59.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.265+0000 7fce93400640 1 --2- 172.21.15.137:0/3447322768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce9c15f910 0x7fce9c15c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:59.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.265+0000 7fce93400640 1 -- 172.21.15.137:0/3447322768 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9c154440 con 0x7fce9c0b6290 2024-04-26T23:41:59.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.265+0000 7fce93400640 1 --2- 172.21.15.137:0/3447322768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce9c0b6290 0x7fce9c15c140 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fce8400c700 tx=0x7fce8400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:59.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.265+0000 7fce98c00640 1 -- 172.21.15.137:0/3447322768 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84018070 con 0x7fce9c0b6290 2024-04-26T23:41:59.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.265+0000 7fce98c00640 1 -- 172.21.15.137:0/3447322768 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce840072d0 con 0x7fce9c0b6290 2024-04-26T23:41:59.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.265+0000 7fce98c00640 1 -- 172.21.15.137:0/3447322768 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce840047f0 con 0x7fce9c0b6290 2024-04-26T23:41:59.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.265+0000 7fcea3000640 1 -- 172.21.15.137:0/3447322768 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce9c15af60 con 0x7fce9c0b6290 2024-04-26T23:41:59.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.265+0000 7fcea3000640 1 -- 172.21.15.137:0/3447322768 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce9c15b520 con 0x7fce9c0b6290 2024-04-26T23:41:59.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.265+0000 7fcea3000640 1 -- 172.21.15.137:0/3447322768 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce9c06a410 con 0x7fce9c0b6290 2024-04-26T23:41:59.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.265+0000 7fce98c00640 1 -- 172.21.15.137:0/3447322768 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fce84004990 con 0x7fce9c0b6290 2024-04-26T23:41:59.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.265+0000 7fce98c00640 1 --2- 172.21.15.137:0/3447322768 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fce78068380 0x7fce7806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:59.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.265+0000 7fce98c00640 1 -- 172.21.15.137:0/3447322768 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fce84085dd0 con 0x7fce9c0b6290 2024-04-26T23:41:59.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.269+0000 7fce9be00640 1 --2- 172.21.15.137:0/3447322768 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fce78068380 0x7fce7806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:59.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.269+0000 7fce9be00640 1 --2- 172.21.15.137:0/3447322768 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fce78068380 0x7fce7806a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0af000 tx=0x7fce8c0a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:59.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.269+0000 7fce98c00640 1 -- 172.21.15.137:0/3447322768 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fce84055ca0 con 0x7fce9c0b6290 2024-04-26T23:41:59.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.425+0000 7fcea3000640 1 -- 172.21.15.137:0/3447322768 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fce9c15fd90 con 0x7fce9c0b6290 2024-04-26T23:41:59.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.425+0000 7fce98c00640 1 -- 172.21.15.137:0/3447322768 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fce84059fa0 con 0x7fce9c0b6290 2024-04-26T23:41:59.431 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:41:59.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.429+0000 7fcea3000640 1 -- 172.21.15.137:0/3447322768 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fce78068380 msgr2=0x7fce7806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:59.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.429+0000 7fcea3000640 1 --2- 172.21.15.137:0/3447322768 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fce78068380 0x7fce7806a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0af000 tx=0x7fce8c0a7070 comp rx=0 tx=0).stop 2024-04-26T23:41:59.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.429+0000 7fcea3000640 1 -- 172.21.15.137:0/3447322768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce9c0b6290 msgr2=0x7fce9c15c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:59.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.429+0000 7fcea3000640 1 --2- 172.21.15.137:0/3447322768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce9c0b6290 0x7fce9c15c140 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fce8400c700 tx=0x7fce8400cbc0 comp rx=0 tx=0).stop 2024-04-26T23:41:59.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.429+0000 7fcea3000640 1 -- 172.21.15.137:0/3447322768 shutdown_connections 2024-04-26T23:41:59.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.429+0000 7fcea3000640 1 --2- 172.21.15.137:0/3447322768 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fce78068380 0x7fce7806a840 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:59.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.429+0000 7fcea3000640 1 --2- 172.21.15.137:0/3447322768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce9c0b6290 0x7fce9c15c140 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:59.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.429+0000 7fcea3000640 1 --2- 172.21.15.137:0/3447322768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce9c15f910 0x7fce9c15c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:59.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.429+0000 7fcea3000640 1 --2- 172.21.15.137:0/3447322768 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce9c0b3180 0x7fce9c150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:59.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.429+0000 7fcea3000640 1 -- 172.21.15.137:0/3447322768 >> 172.21.15.137:0/3447322768 conn(0x7fce9c0b6710 msgr2=0x7fce9c0738d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:59.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.429+0000 7fcea3000640 1 -- 172.21.15.137:0/3447322768 shutdown_connections 2024-04-26T23:41:59.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.429+0000 7fcea3000640 1 -- 172.21.15.137:0/3447322768 wait complete. 2024-04-26T23:41:59.452 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:41:59.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.585+0000 7f82ff200640 1 Processor -- start 2024-04-26T23:41:59.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.585+0000 7f82ff200640 1 -- start start 2024-04-26T23:41:59.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.585+0000 7f82ff200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83000b30b0 0x7f83000b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:59.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.585+0000 7f82ff200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f83000703f0 0x7f83000b3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:59.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.585+0000 7f82ff200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83000b39d0 con 0x7f830015d3a0 2024-04-26T23:41:59.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.585+0000 7f82ff200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f83000b58c0 con 0x7f83000703f0 2024-04-26T23:41:59.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.585+0000 7f82ff200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f83000b5350 con 0x7f83000b30b0 2024-04-26T23:41:59.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.585+0000 7f82f5400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f83000703f0 0x7f83000b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:59.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.585+0000 7f82f5400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f83000703f0 0x7f83000b3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60102/0 (socket says 172.21.15.137:60102) 2024-04-26T23:41:59.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.585+0000 7f82f5400640 1 -- 172.21.15.137:0/4011940891 learned_addr learned my addr 172.21.15.137:0/4011940891 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:59.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.585+0000 7f82fde00640 1 --2- 172.21.15.137:0/4011940891 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83000b30b0 0x7f83000b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:59.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.585+0000 7f82f5400640 1 -- 172.21.15.137:0/4011940891 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83000b30b0 msgr2=0x7f83000b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:59.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.585+0000 7f82f5400640 1 --2- 172.21.15.137:0/4011940891 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83000b30b0 0x7f83000b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:59.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.585+0000 7f82f5400640 1 -- 172.21.15.137:0/4011940891 >> v1:172.21.15.170:6789/0 conn(0x7f830015d3a0 legacy=0x7f830015c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:59.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.585+0000 7f82f5400640 1 -- 172.21.15.137:0/4011940891 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83000b4ab0 con 0x7f83000703f0 2024-04-26T23:41:59.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.589+0000 7f82f5400640 1 --2- 172.21.15.137:0/4011940891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83000703f0 0x7f83000b3490 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009870 tx=0x7f82e801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eeb861295b0ec46 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:59.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.589+0000 7f82fd400640 1 -- 172.21.15.137:0/4011940891 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e80b2070 con 0x7f83000703f0 2024-04-26T23:41:59.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.589+0000 7f82fd400640 1 -- 172.21.15.137:0/4011940891 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e80a9070 con 0x7f83000703f0 2024-04-26T23:41:59.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.589+0000 7f82fd400640 1 -- 172.21.15.137:0/4011940891 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e80ad880 con 0x7f83000703f0 2024-04-26T23:41:59.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.589+0000 7f82ff200640 1 -- 172.21.15.137:0/4011940891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83000703f0 msgr2=0x7f83000b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:59.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.589+0000 7f82ff200640 1 --2- 172.21.15.137:0/4011940891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83000703f0 0x7f83000b3490 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009870 tx=0x7f82e801c560 comp rx=0 tx=0).stop 2024-04-26T23:41:59.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.589+0000 7f82ff200640 1 -- 172.21.15.137:0/4011940891 shutdown_connections 2024-04-26T23:41:59.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.589+0000 7f82ff200640 1 --2- 172.21.15.137:0/4011940891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83000703f0 0x7f83000b3490 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:59.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.589+0000 7f82ff200640 1 --2- 172.21.15.137:0/4011940891 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83000b30b0 0x7f83000b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:59.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.589+0000 7f82ff200640 1 -- 172.21.15.137:0/4011940891 >> 172.21.15.137:0/4011940891 conn(0x7f83000d1540 msgr2=0x7f83000d1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:59.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.589+0000 7f82ff200640 1 -- 172.21.15.137:0/4011940891 shutdown_connections 2024-04-26T23:41:59.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.589+0000 7f82ff200640 1 -- 172.21.15.137:0/4011940891 wait complete. 2024-04-26T23:41:59.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82ff200640 1 Processor -- start 2024-04-26T23:41:59.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82ff200640 1 -- start start 2024-04-26T23:41:59.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82ff200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83000703f0 0x7f830015a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:59.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82ff200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83000b30b0 0x7f8300154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:59.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82ff200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f830015d3a0 0x7f8300149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:59.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82ff200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f830015dbc0 con 0x7f83000b30b0 2024-04-26T23:41:59.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82ff200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8300070870 con 0x7f83000703f0 2024-04-26T23:41:59.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82ff200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f83000d1060 con 0x7f830015d3a0 2024-04-26T23:41:59.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82f5400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83000b30b0 0x7f8300154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:59.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82f5400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83000b30b0 0x7f8300154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60112/0 (socket says 172.21.15.137:60112) 2024-04-26T23:41:59.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82f5400640 1 -- 172.21.15.137:0/1130953169 learned_addr learned my addr 172.21.15.137:0/1130953169 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:41:59.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82fde00640 1 --2- 172.21.15.137:0/1130953169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83000703f0 0x7f830015a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:59.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82fe800640 1 --2- 172.21.15.137:0/1130953169 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f830015d3a0 0x7f8300149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:59.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82f5400640 1 -- 172.21.15.137:0/1130953169 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f830015d3a0 msgr2=0x7f8300149750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:59.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82f5400640 1 --2- 172.21.15.137:0/1130953169 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f830015d3a0 0x7f8300149750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:59.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82f5400640 1 -- 172.21.15.137:0/1130953169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83000703f0 msgr2=0x7f830015a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:59.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82f5400640 1 --2- 172.21.15.137:0/1130953169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83000703f0 0x7f830015a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:59.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82f5400640 1 -- 172.21.15.137:0/1130953169 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83000d0690 con 0x7f83000b30b0 2024-04-26T23:41:59.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82fde00640 1 --2- 172.21.15.137:0/1130953169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83000703f0 0x7f830015a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:59.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82f5400640 1 --2- 172.21.15.137:0/1130953169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83000b30b0 0x7f8300154a60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f82e80b0040 tx=0x7f82e8019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:59.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82f6a00640 1 -- 172.21.15.137:0/1130953169 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e80bb070 con 0x7f83000b30b0 2024-04-26T23:41:59.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82f6a00640 1 -- 172.21.15.137:0/1130953169 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e80add00 con 0x7f83000b30b0 2024-04-26T23:41:59.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82ff200640 1 -- 172.21.15.137:0/1130953169 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f830015b160 con 0x7f83000b30b0 2024-04-26T23:41:59.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82f6a00640 1 -- 172.21.15.137:0/1130953169 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e80b2040 con 0x7f83000b30b0 2024-04-26T23:41:59.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.593+0000 7f82ff200640 1 -- 172.21.15.137:0/1130953169 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f830014e620 con 0x7f83000b30b0 2024-04-26T23:41:59.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.597+0000 7f82ff200640 1 -- 172.21.15.137:0/1130953169 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f830006a410 con 0x7f83000b30b0 2024-04-26T23:41:59.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.597+0000 7f82f6a00640 1 -- 172.21.15.137:0/1130953169 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f82e80be070 con 0x7f83000b30b0 2024-04-26T23:41:59.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.597+0000 7f82f6a00640 1 --2- 172.21.15.137:0/1130953169 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f82dc068380 0x7f82dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:59.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.597+0000 7f82f6a00640 1 -- 172.21.15.137:0/1130953169 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f82e811f9b0 con 0x7f83000b30b0 2024-04-26T23:41:59.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.597+0000 7f82fde00640 1 --2- 172.21.15.137:0/1130953169 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f82dc068380 0x7f82dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:59.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.597+0000 7f82fde00640 1 --2- 172.21.15.137:0/1130953169 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f82dc068380 0x7f82dc06a840 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009bb0 tx=0x7f82f0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:59.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.601+0000 7f82f6a00640 1 -- 172.21.15.137:0/1130953169 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f82e8016150 con 0x7f83000b30b0 2024-04-26T23:41:59.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.773+0000 7f82ff200640 1 -- 172.21.15.137:0/1130953169 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f83001544b0 con 0x7f83000b30b0 2024-04-26T23:41:59.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.773+0000 7f82f6a00640 1 -- 172.21.15.137:0/1130953169 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f82e80eff60 con 0x7f83000b30b0 2024-04-26T23:41:59.776 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T23:41:59.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.773+0000 7f82ff200640 1 -- 172.21.15.137:0/1130953169 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f82dc068380 msgr2=0x7f82dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:59.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.773+0000 7f82ff200640 1 --2- 172.21.15.137:0/1130953169 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f82dc068380 0x7f82dc06a840 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009bb0 tx=0x7f82f0008040 comp rx=0 tx=0).stop 2024-04-26T23:41:59.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.773+0000 7f82ff200640 1 -- 172.21.15.137:0/1130953169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83000b30b0 msgr2=0x7f8300154a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:59.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.773+0000 7f82ff200640 1 --2- 172.21.15.137:0/1130953169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83000b30b0 0x7f8300154a60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f82e80b0040 tx=0x7f82e8019300 comp rx=0 tx=0).stop 2024-04-26T23:41:59.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.773+0000 7f82ff200640 1 -- 172.21.15.137:0/1130953169 shutdown_connections 2024-04-26T23:41:59.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.773+0000 7f82ff200640 1 --2- 172.21.15.137:0/1130953169 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f82dc068380 0x7f82dc06a840 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:59.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.773+0000 7f82ff200640 1 --2- 172.21.15.137:0/1130953169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83000b30b0 0x7f8300154a60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:59.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.773+0000 7f82ff200640 1 --2- 172.21.15.137:0/1130953169 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f830015d3a0 0x7f8300149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:59.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.773+0000 7f82ff200640 1 --2- 172.21.15.137:0/1130953169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83000703f0 0x7f830015a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:59.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.773+0000 7f82ff200640 1 -- 172.21.15.137:0/1130953169 >> 172.21.15.137:0/1130953169 conn(0x7f83000d1540 msgr2=0x7f8300153600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:59.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.773+0000 7f82ff200640 1 -- 172.21.15.137:0/1130953169 shutdown_connections 2024-04-26T23:41:59.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:41:59.773+0000 7f82ff200640 1 -- 172.21.15.137:0/1130953169 wait complete. 2024-04-26T23:41:59.798 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi137.front.sepia.ceph.com... 2024-04-26T23:41:59.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:59.798 DEBUG:teuthology.orchestra.run.smithi137:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-26T23:41:59.832 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:41:59.832 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T23:41:59.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:59.832 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T23:41:59.893 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:41:59.893 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:41:59.903 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:41:59.903 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:41:59.954 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:42:00.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.085+0000 7f4442600640 1 Processor -- start 2024-04-26T23:42:00.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.085+0000 7f4442600640 1 -- start start 2024-04-26T23:42:00.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.085+0000 7f4442600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f443c148950 0x7f443c15fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:00.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.085+0000 7f4442600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f443c148d30 con 0x7f443c0b4ad0 2024-04-26T23:42:00.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.085+0000 7f4442600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f443c073540 con 0x7f443c06f8a0 2024-04-26T23:42:00.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.085+0000 7f4442600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f443c073820 con 0x7f443c148950 2024-04-26T23:42:00.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.085+0000 7f4432a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f443c0b4ad0 0x7f443c06f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49260/0 (socket says 172.21.15.137:49260) 2024-04-26T23:42:00.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.085+0000 7f4432a00640 1 -- 172.21.15.137:0/2274108671 learned_addr learned my addr 172.21.15.137:0/2274108671 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:00.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.085+0000 7f443b400640 1 --2- 172.21.15.137:0/2274108671 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f443c148950 0x7f443c15fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:00.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443aa00640 1 -- 172.21.15.137:0/2274108671 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4179326939 0 0) 0x7f443c148d30 con 0x7f443c0b4ad0 2024-04-26T23:42:00.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443aa00640 1 -- 172.21.15.137:0/2274108671 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4420003530 con 0x7f443c0b4ad0 2024-04-26T23:42:00.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443aa00640 1 -- 172.21.15.137:0/2274108671 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1551140137 0 0) 0x7f443c073540 con 0x7f443c06f8a0 2024-04-26T23:42:00.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443aa00640 1 -- 172.21.15.137:0/2274108671 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f443c148d30 con 0x7f443c06f8a0 2024-04-26T23:42:00.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443aa00640 1 -- 172.21.15.137:0/2274108671 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1682615998 0 0) 0x7f4420003530 con 0x7f443c0b4ad0 2024-04-26T23:42:00.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443aa00640 1 -- 172.21.15.137:0/2274108671 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f443c148950 msgr2=0x7f443c15fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:00.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443aa00640 1 --2- 172.21.15.137:0/2274108671 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f443c148950 0x7f443c15fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443aa00640 1 -- 172.21.15.137:0/2274108671 >> v1:172.21.15.170:6789/0 conn(0x7f443c06f8a0 legacy=0x7f443c0ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:00.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443aa00640 1 -- 172.21.15.137:0/2274108671 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f443c073b00 con 0x7f443c0b4ad0 2024-04-26T23:42:00.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443aa00640 1 -- 172.21.15.137:0/2274108671 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f4424001680 con 0x7f443c0b4ad0 2024-04-26T23:42:00.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443aa00640 1 -- 172.21.15.137:0/2274108671 >> v1:172.21.15.137:6789/0 conn(0x7f443c0b4ad0 legacy=0x7f443c06f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:00.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443aa00640 1 --2- 172.21.15.137:0/2274108671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4420003b80 0x7f4420003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:00.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443aa00640 1 --2- 172.21.15.137:0/2274108671 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4420004810 0x7f4420004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:00.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443aa00640 1 --2- 172.21.15.137:0/2274108671 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f443c148950 0x7f44200051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:00.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443aa00640 1 -- 172.21.15.137:0/2274108671 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f443c073820 con 0x7f4420003b80 2024-04-26T23:42:00.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443aa00640 1 -- 172.21.15.137:0/2274108671 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f442000ba80 con 0x7f4420004810 2024-04-26T23:42:00.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443aa00640 1 -- 172.21.15.137:0/2274108671 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f442000bc50 con 0x7f443c148950 2024-04-26T23:42:00.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443b400640 1 --2- 172.21.15.137:0/2274108671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4420003b80 0x7f4420003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:00.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f4432a00640 1 --2- 172.21.15.137:0/2274108671 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4420004810 0x7f4420004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:00.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443be00640 1 --2- 172.21.15.137:0/2274108671 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f443c148950 0x7f44200051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:00.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443b400640 1 -- 172.21.15.137:0/2274108671 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f443c148950 msgr2=0x7f44200051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:00.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443b400640 1 --2- 172.21.15.137:0/2274108671 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f443c148950 0x7f44200051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443b400640 1 -- 172.21.15.137:0/2274108671 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4420004810 msgr2=0x7f4420004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:00.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443b400640 1 --2- 172.21.15.137:0/2274108671 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4420004810 0x7f4420004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443b400640 1 -- 172.21.15.137:0/2274108671 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4420003530 con 0x7f4420003b80 2024-04-26T23:42:00.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.089+0000 7f443b400640 1 --2- 172.21.15.137:0/2274108671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4420003b80 0x7f4420003f80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f442c009ae0 tx=0x7f442c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3c72b0762ae0ce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:00.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.093+0000 7f443aa00640 1 -- 172.21.15.137:0/2274108671 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c0096b0 con 0x7f4420003b80 2024-04-26T23:42:00.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.093+0000 7f443aa00640 1 -- 172.21.15.137:0/2274108671 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f442c0a8450 con 0x7f4420003b80 2024-04-26T23:42:00.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.093+0000 7f443aa00640 1 -- 172.21.15.137:0/2274108671 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c0a8840 con 0x7f4420003b80 2024-04-26T23:42:00.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.093+0000 7f4442600640 1 -- 172.21.15.137:0/2274108671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4420003b80 msgr2=0x7f4420003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:00.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.093+0000 7f4442600640 1 --2- 172.21.15.137:0/2274108671 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4420003b80 0x7f4420003f80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f442c009ae0 tx=0x7f442c01c9e0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.093+0000 7f443be00640 1 -- 172.21.15.137:0/2274108671 reap_dead start 2024-04-26T23:42:00.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.093+0000 7f4442600640 1 -- 172.21.15.137:0/2274108671 shutdown_connections 2024-04-26T23:42:00.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.093+0000 7f4442600640 1 -- 172.21.15.137:0/2274108671 >> 172.21.15.137:0/2274108671 conn(0x7f443c06c5d0 msgr2=0x7f443c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:00.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.093+0000 7f4442600640 1 -- 172.21.15.137:0/2274108671 shutdown_connections 2024-04-26T23:42:00.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.093+0000 7f4442600640 1 -- 172.21.15.137:0/2274108671 wait complete. 2024-04-26T23:42:00.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.093+0000 7f4442600640 1 Processor -- start 2024-04-26T23:42:00.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.093+0000 7f4442600640 1 -- start start 2024-04-26T23:42:00.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.093+0000 7f4442600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4420003b80 0x7f443c143dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:00.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.093+0000 7f4442600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f443c0c8160 0x7f443c0cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:00.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.093+0000 7f4442600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f443c0c85e0 0x7f443c0c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:00.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.093+0000 7f4442600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f443c0aefe0 con 0x7f443c0c85e0 2024-04-26T23:42:00.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.093+0000 7f4442600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f443c074510 con 0x7f4420003b80 2024-04-26T23:42:00.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.093+0000 7f4442600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f443c0af160 con 0x7f443c0c8160 2024-04-26T23:42:00.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.093+0000 7f443be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f443c0c85e0 0x7f443c0c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:00.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.093+0000 7f443be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f443c0c85e0 0x7f443c0c5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60130/0 (socket says 172.21.15.137:60130) 2024-04-26T23:42:00.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.093+0000 7f443be00640 1 -- 172.21.15.137:0/1931040285 learned_addr learned my addr 172.21.15.137:0/1931040285 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:00.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.097+0000 7f443b400640 1 --2- 172.21.15.137:0/1931040285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4420003b80 0x7f443c143dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:00.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.097+0000 7f4432a00640 1 --2- 172.21.15.137:0/1931040285 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f443c0c8160 0x7f443c0cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:00.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.097+0000 7f443be00640 1 -- 172.21.15.137:0/1931040285 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f443c0c8160 msgr2=0x7f443c0cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:00.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.097+0000 7f443be00640 1 --2- 172.21.15.137:0/1931040285 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f443c0c8160 0x7f443c0cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.097+0000 7f443be00640 1 -- 172.21.15.137:0/1931040285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4420003b80 msgr2=0x7f443c143dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:00.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.097+0000 7f443be00640 1 --2- 172.21.15.137:0/1931040285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4420003b80 0x7f443c143dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.097+0000 7f443be00640 1 -- 172.21.15.137:0/1931040285 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f443c1f8720 con 0x7f443c0c85e0 2024-04-26T23:42:00.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.097+0000 7f4432a00640 1 --2- 172.21.15.137:0/1931040285 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f443c0c8160 0x7f443c0cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:00.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.097+0000 7f443b400640 1 --2- 172.21.15.137:0/1931040285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4420003b80 0x7f443c143dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:00.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.097+0000 7f443be00640 1 --2- 172.21.15.137:0/1931040285 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f443c0c85e0 0x7f443c0c5d00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f443c0cd740 tx=0x7f443400ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:00.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.097+0000 7f4433e00640 1 -- 172.21.15.137:0/1931040285 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4434019070 con 0x7f443c0c85e0 2024-04-26T23:42:00.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.097+0000 7f4433e00640 1 -- 172.21.15.137:0/1931040285 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4434006d70 con 0x7f443c0c85e0 2024-04-26T23:42:00.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.097+0000 7f4433e00640 1 -- 172.21.15.137:0/1931040285 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4434003bc0 con 0x7f443c0c85e0 2024-04-26T23:42:00.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.097+0000 7f4442600640 1 -- 172.21.15.137:0/1931040285 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f443c0c70c0 con 0x7f443c0c85e0 2024-04-26T23:42:00.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.097+0000 7f4442600640 1 -- 172.21.15.137:0/1931040285 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f443c0c7680 con 0x7f443c0c85e0 2024-04-26T23:42:00.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.097+0000 7f4442600640 1 -- 172.21.15.137:0/1931040285 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f443c06a4b0 con 0x7f443c0c85e0 2024-04-26T23:42:00.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.097+0000 7f4433e00640 1 -- 172.21.15.137:0/1931040285 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f443401c070 con 0x7f443c0c85e0 2024-04-26T23:42:00.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.097+0000 7f4433e00640 1 --2- 172.21.15.137:0/1931040285 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4418068380 0x7f441806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:00.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.097+0000 7f4433e00640 1 -- 172.21.15.137:0/1931040285 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4434085f40 con 0x7f443c0c85e0 2024-04-26T23:42:00.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.097+0000 7f443b400640 1 --2- 172.21.15.137:0/1931040285 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4418068380 0x7f441806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:00.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.101+0000 7f443b400640 1 --2- 172.21.15.137:0/1931040285 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4418068380 0x7f441806a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f442c0af000 tx=0x7f442c0aa040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:00.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.101+0000 7f4433e00640 1 -- 172.21.15.137:0/1931040285 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f44340564e0 con 0x7f443c0c85e0 2024-04-26T23:42:00.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.261+0000 7f4442600640 1 -- 172.21.15.137:0/1931040285 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f443c06d410 con 0x7f443c0c85e0 2024-04-26T23:42:00.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.261+0000 7f4433e00640 1 -- 172.21.15.137:0/1931040285 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16653 (secure 0 0 0) 0x7f4434055de0 con 0x7f443c0c85e0 2024-04-26T23:42:00.267 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:00.267 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:25.186308+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:42:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.265+0000 7f4442600640 1 -- 172.21.15.137:0/1931040285 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4418068380 msgr2=0x7f441806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.265+0000 7f4442600640 1 --2- 172.21.15.137:0/1931040285 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4418068380 0x7f441806a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f442c0af000 tx=0x7f442c0aa040 comp rx=0 tx=0).stop 2024-04-26T23:42:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.265+0000 7f4442600640 1 -- 172.21.15.137:0/1931040285 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f443c0c85e0 msgr2=0x7f443c0c5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.265+0000 7f4442600640 1 --2- 172.21.15.137:0/1931040285 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f443c0c85e0 0x7f443c0c5d00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f443c0cd740 tx=0x7f443400ff70 comp rx=0 tx=0).stop 2024-04-26T23:42:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.265+0000 7f4442600640 1 -- 172.21.15.137:0/1931040285 shutdown_connections 2024-04-26T23:42:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.265+0000 7f4442600640 1 --2- 172.21.15.137:0/1931040285 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4418068380 0x7f441806a840 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.265+0000 7f4442600640 1 --2- 172.21.15.137:0/1931040285 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f443c0c85e0 0x7f443c0c5d00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.265+0000 7f4442600640 1 --2- 172.21.15.137:0/1931040285 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f443c0c8160 0x7f443c0cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.265+0000 7f4442600640 1 --2- 172.21.15.137:0/1931040285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4420003b80 0x7f443c143dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.265+0000 7f4442600640 1 -- 172.21.15.137:0/1931040285 >> 172.21.15.137:0/1931040285 conn(0x7f443c06c5d0 msgr2=0x7f443c1466f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:00.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.265+0000 7f4442600640 1 -- 172.21.15.137:0/1931040285 shutdown_connections 2024-04-26T23:42:00.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.265+0000 7f4442600640 1 -- 172.21.15.137:0/1931040285 wait complete. 2024-04-26T23:42:00.288 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:41:21.810449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:41:22.533452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:42:00.288 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:42:00.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.421+0000 7f2c91000640 1 Processor -- start 2024-04-26T23:42:00.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.421+0000 7f2c91000640 1 -- start start 2024-04-26T23:42:00.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.425+0000 7f2c91000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c8c160000 0x7f2c8c144d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:00.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.425+0000 7f2c91000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c8c0cffa0 con 0x7f2c8c0b5ee0 2024-04-26T23:42:00.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.425+0000 7f2c91000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c8c0d0280 con 0x7f2c8c0b54e0 2024-04-26T23:42:00.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.425+0000 7f2c91000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2c8c0b3d90 con 0x7f2c8c160000 2024-04-26T23:42:00.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.425+0000 7f2c89400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f2c8c0b5ee0 0x7f2c8c15f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49268/0 (socket says 172.21.15.137:49268) 2024-04-26T23:42:00.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.425+0000 7f2c89400640 1 -- 172.21.15.137:0/2042502032 learned_addr learned my addr 172.21.15.137:0/2042502032 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:00.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.425+0000 7f2c8a800640 1 --2- 172.21.15.137:0/2042502032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c8c160000 0x7f2c8c144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:00.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.425+0000 7f2c88a00640 1 -- 172.21.15.137:0/2042502032 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3142771559 0 0) 0x7f2c8c0cffa0 con 0x7f2c8c0b5ee0 2024-04-26T23:42:00.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.425+0000 7f2c88a00640 1 -- 172.21.15.137:0/2042502032 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c70003530 con 0x7f2c8c0b5ee0 2024-04-26T23:42:00.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.425+0000 7f2c88a00640 1 -- 172.21.15.137:0/2042502032 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 478850406 0 0) 0x7f2c70003530 con 0x7f2c8c0b5ee0 2024-04-26T23:42:00.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.425+0000 7f2c8a800640 1 -- 172.21.15.137:0/2042502032 >> v1:172.21.15.170:6789/0 conn(0x7f2c8c0b54e0 legacy=0x7f2c8c0cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:00.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.425+0000 7f2c8a800640 1 -- 172.21.15.137:0/2042502032 >> v1:172.21.15.137:6789/0 conn(0x7f2c8c0b5ee0 legacy=0x7f2c8c15f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:00.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.425+0000 7f2c8a800640 1 -- 172.21.15.137:0/2042502032 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c8c0d0560 con 0x7f2c8c160000 2024-04-26T23:42:00.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.429+0000 7f2c8a800640 1 --2- 172.21.15.137:0/2042502032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c8c160000 0x7f2c8c144d20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009dc0 tx=0x7f2c8401c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c7557fe85f472f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:00.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.429+0000 7f2c88a00640 1 -- 172.21.15.137:0/2042502032 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c840ad070 con 0x7f2c8c160000 2024-04-26T23:42:00.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.429+0000 7f2c88a00640 1 -- 172.21.15.137:0/2042502032 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c8c145a70 con 0x7f2c8c160000 2024-04-26T23:42:00.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.429+0000 7f2c88a00640 1 -- 172.21.15.137:0/2042502032 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78001680 con 0x7f2c8c160000 2024-04-26T23:42:00.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.429+0000 7f2c91000640 1 -- 172.21.15.137:0/2042502032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c8c160000 msgr2=0x7f2c8c144d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:00.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.429+0000 7f2c91000640 1 --2- 172.21.15.137:0/2042502032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c8c160000 0x7f2c8c144d20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009dc0 tx=0x7f2c8401c760 comp rx=0 tx=0).stop 2024-04-26T23:42:00.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.429+0000 7f2c91000640 1 -- 172.21.15.137:0/2042502032 shutdown_connections 2024-04-26T23:42:00.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.429+0000 7f2c91000640 1 --2- 172.21.15.137:0/2042502032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c8c160000 0x7f2c8c144d20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.429+0000 7f2c91000640 1 -- 172.21.15.137:0/2042502032 >> 172.21.15.137:0/2042502032 conn(0x7f2c8c06c800 msgr2=0x7f2c8c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:00.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.429+0000 7f2c91000640 1 -- 172.21.15.137:0/2042502032 shutdown_connections 2024-04-26T23:42:00.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.429+0000 7f2c91000640 1 -- 172.21.15.137:0/2042502032 wait complete. 2024-04-26T23:42:00.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.429+0000 7f2c91000640 1 Processor -- start 2024-04-26T23:42:00.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c91000640 1 -- start start 2024-04-26T23:42:00.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c91000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c8c0b54e0 0x7f2c8c1369d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:00.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c91000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c8c0b5ee0 0x7f2c8c13a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:00.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c91000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c8c160000 0x7f2c8c0b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:00.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c91000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c169bd0 con 0x7f2c8c0b54e0 2024-04-26T23:42:00.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c91000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c169a50 con 0x7f2c8c0b5ee0 2024-04-26T23:42:00.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c91000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2c8c169d50 con 0x7f2c8c160000 2024-04-26T23:42:00.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c89e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c8c0b54e0 0x7f2c8c1369d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:00.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c89e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c8c0b54e0 0x7f2c8c1369d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60132/0 (socket says 172.21.15.137:60132) 2024-04-26T23:42:00.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c89e00640 1 -- 172.21.15.137:0/3664797031 learned_addr learned my addr 172.21.15.137:0/3664797031 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:00.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c89400640 1 --2- 172.21.15.137:0/3664797031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c8c0b5ee0 0x7f2c8c13a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:00.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c8a800640 1 --2- 172.21.15.137:0/3664797031 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c8c160000 0x7f2c8c0b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:00.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c89e00640 1 -- 172.21.15.137:0/3664797031 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c8c160000 msgr2=0x7f2c8c0b13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:00.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c89e00640 1 --2- 172.21.15.137:0/3664797031 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c8c160000 0x7f2c8c0b13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c89e00640 1 -- 172.21.15.137:0/3664797031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c8c0b5ee0 msgr2=0x7f2c8c13a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:00.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c89e00640 1 --2- 172.21.15.137:0/3664797031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c8c0b5ee0 0x7f2c8c13a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c89e00640 1 -- 172.21.15.137:0/3664797031 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c8c138ce0 con 0x7f2c8c0b54e0 2024-04-26T23:42:00.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c89400640 1 --2- 172.21.15.137:0/3664797031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c8c0b5ee0 0x7f2c8c13a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:00.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c89e00640 1 --2- 172.21.15.137:0/3664797031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c8c0b54e0 0x7f2c8c1369d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00c780 tx=0x7f2c7c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:00.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c82000640 1 -- 172.21.15.137:0/3664797031 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c017070 con 0x7f2c8c0b54e0 2024-04-26T23:42:00.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c82000640 1 -- 172.21.15.137:0/3664797031 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c7c005270 con 0x7f2c8c0b54e0 2024-04-26T23:42:00.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c91000640 1 -- 172.21.15.137:0/3664797031 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c8c137130 con 0x7f2c8c0b54e0 2024-04-26T23:42:00.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c82000640 1 -- 172.21.15.137:0/3664797031 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c00a640 con 0x7f2c8c0b54e0 2024-04-26T23:42:00.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c91000640 1 -- 172.21.15.137:0/3664797031 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c8c1373d0 con 0x7f2c8c0b54e0 2024-04-26T23:42:00.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.433+0000 7f2c91000640 1 -- 172.21.15.137:0/3664797031 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c8c06a410 con 0x7f2c8c0b54e0 2024-04-26T23:42:00.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.437+0000 7f2c82000640 1 -- 172.21.15.137:0/3664797031 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2c7c01a070 con 0x7f2c8c0b54e0 2024-04-26T23:42:00.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.437+0000 7f2c82000640 1 --2- 172.21.15.137:0/3664797031 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2c6c068380 0x7f2c6c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:00.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.437+0000 7f2c82000640 1 -- 172.21.15.137:0/3664797031 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2c7c085eb0 con 0x7f2c8c0b54e0 2024-04-26T23:42:00.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.437+0000 7f2c89400640 1 --2- 172.21.15.137:0/3664797031 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2c6c068380 0x7f2c6c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:00.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.437+0000 7f2c89400640 1 --2- 172.21.15.137:0/3664797031 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2c6c068380 0x7f2c6c06a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2c78001ec0 tx=0x7f2c78001d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:00.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.441+0000 7f2c82000640 1 -- 172.21.15.137:0/3664797031 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2c7c055d90 con 0x7f2c8c0b54e0 2024-04-26T23:42:00.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.597+0000 7f2c91000640 1 -- 172.21.15.137:0/3664797031 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2c8c15cbc0 con 0x7f2c8c0b54e0 2024-04-26T23:42:00.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.597+0000 7f2c82000640 1 -- 172.21.15.137:0/3664797031 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f2c7c05a090 con 0x7f2c8c0b54e0 2024-04-26T23:42:00.602 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:42:00.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.601+0000 7f2c91000640 1 -- 172.21.15.137:0/3664797031 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2c6c068380 msgr2=0x7f2c6c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:00.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.601+0000 7f2c91000640 1 --2- 172.21.15.137:0/3664797031 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2c6c068380 0x7f2c6c06a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2c78001ec0 tx=0x7f2c78001d50 comp rx=0 tx=0).stop 2024-04-26T23:42:00.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.601+0000 7f2c91000640 1 -- 172.21.15.137:0/3664797031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c8c0b54e0 msgr2=0x7f2c8c1369d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:00.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.601+0000 7f2c91000640 1 --2- 172.21.15.137:0/3664797031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c8c0b54e0 0x7f2c8c1369d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00c780 tx=0x7f2c7c00cc40 comp rx=0 tx=0).stop 2024-04-26T23:42:00.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.601+0000 7f2c91000640 1 -- 172.21.15.137:0/3664797031 shutdown_connections 2024-04-26T23:42:00.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.601+0000 7f2c91000640 1 --2- 172.21.15.137:0/3664797031 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2c6c068380 0x7f2c6c06a840 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.601+0000 7f2c91000640 1 --2- 172.21.15.137:0/3664797031 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c8c160000 0x7f2c8c0b13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.601+0000 7f2c91000640 1 --2- 172.21.15.137:0/3664797031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c8c0b5ee0 0x7f2c8c13a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.601+0000 7f2c91000640 1 --2- 172.21.15.137:0/3664797031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c8c0b54e0 0x7f2c8c1369d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.601+0000 7f2c91000640 1 -- 172.21.15.137:0/3664797031 >> 172.21.15.137:0/3664797031 conn(0x7f2c8c06c800 msgr2=0x7f2c8c0b3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:00.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.601+0000 7f2c91000640 1 -- 172.21.15.137:0/3664797031 shutdown_connections 2024-04-26T23:42:00.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.601+0000 7f2c91000640 1 -- 172.21.15.137:0/3664797031 wait complete. 2024-04-26T23:42:00.623 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:42:00.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.757+0000 7f3231400640 1 Processor -- start 2024-04-26T23:42:00.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.761+0000 7f3231400640 1 -- start start 2024-04-26T23:42:00.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.761+0000 7f3231400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f322c0afbc0 0x7f322c15df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:00.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.761+0000 7f3231400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f322c072860 con 0x7f322c073f20 2024-04-26T23:42:00.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.761+0000 7f3231400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f322c0743b0 con 0x7f322c0affa0 2024-04-26T23:42:00.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.761+0000 7f3231400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f322c072b00 con 0x7f322c0afbc0 2024-04-26T23:42:00.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.761+0000 7f3229e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f322c073f20 0x7f322c0735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52546/0 (socket says 172.21.15.137:52546) 2024-04-26T23:42:00.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.761+0000 7f3229e00640 1 -- 172.21.15.137:0/3066369702 learned_addr learned my addr 172.21.15.137:0/3066369702 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:00.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.761+0000 7f322a800640 1 --2- 172.21.15.137:0/3066369702 >> v2:172.21.15.170:3300/0 conn(0x7f322c0afbc0 0x7f322c15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:00.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.761+0000 7f3229400640 1 -- 172.21.15.137:0/3066369702 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2821720061 0 0) 0x7f322c072860 con 0x7f322c073f20 2024-04-26T23:42:00.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.761+0000 7f3229400640 1 -- 172.21.15.137:0/3066369702 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3210003530 con 0x7f322c073f20 2024-04-26T23:42:00.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.761+0000 7f322a800640 1 -- 172.21.15.137:0/3066369702 >> v1:172.21.15.170:6789/0 conn(0x7f322c0affa0 legacy=0x7f322c0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:00.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.761+0000 7f322a800640 1 -- 172.21.15.137:0/3066369702 >> v1:172.21.15.137:6789/0 conn(0x7f322c073f20 legacy=0x7f322c0735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:00.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.761+0000 7f322a800640 1 -- 172.21.15.137:0/3066369702 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f322c072de0 con 0x7f322c0afbc0 2024-04-26T23:42:00.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.765+0000 7f322a800640 1 --2- 172.21.15.137:0/3066369702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f322c0afbc0 0x7f322c15df90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f321c009dc0 tx=0x7f321c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a84d4a8a33850b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:00.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.765+0000 7f3229400640 1 -- 172.21.15.137:0/3066369702 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321c0b2070 con 0x7f322c0afbc0 2024-04-26T23:42:00.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.765+0000 7f3229400640 1 -- 172.21.15.137:0/3066369702 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f321c0a58c0 con 0x7f322c0afbc0 2024-04-26T23:42:00.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.765+0000 7f3229400640 1 -- 172.21.15.137:0/3066369702 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321c0a5c90 con 0x7f322c0afbc0 2024-04-26T23:42:00.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.765+0000 7f3231400640 1 -- 172.21.15.137:0/3066369702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f322c0afbc0 msgr2=0x7f322c15df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:00.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.765+0000 7f3231400640 1 --2- 172.21.15.137:0/3066369702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f322c0afbc0 0x7f322c15df90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f321c009dc0 tx=0x7f321c01c950 comp rx=0 tx=0).stop 2024-04-26T23:42:00.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.765+0000 7f3231400640 1 -- 172.21.15.137:0/3066369702 shutdown_connections 2024-04-26T23:42:00.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.765+0000 7f3231400640 1 --2- 172.21.15.137:0/3066369702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f322c0afbc0 0x7f322c15df90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.765+0000 7f3231400640 1 -- 172.21.15.137:0/3066369702 >> 172.21.15.137:0/3066369702 conn(0x7f322c06c800 msgr2=0x7f322c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:00.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.765+0000 7f3231400640 1 -- 172.21.15.137:0/3066369702 shutdown_connections 2024-04-26T23:42:00.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.765+0000 7f3231400640 1 -- 172.21.15.137:0/3066369702 wait complete. 2024-04-26T23:42:00.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.765+0000 7f3231400640 1 Processor -- start 2024-04-26T23:42:00.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.769+0000 7f3231400640 1 -- start start 2024-04-26T23:42:00.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.769+0000 7f3231400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f322c0afbc0 0x7f322c14e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:00.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.769+0000 7f3231400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f322c0affa0 0x7f322c148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:00.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.769+0000 7f3231400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f322c0ae070 0x7f322c15f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:00.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.769+0000 7f3231400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f322c06ffe0 con 0x7f322c0afbc0 2024-04-26T23:42:00.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.769+0000 7f3231400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f322c0cecd0 con 0x7f322c0affa0 2024-04-26T23:42:00.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.769+0000 7f3231400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f322c070160 con 0x7f322c0ae070 2024-04-26T23:42:00.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.769+0000 7f322a800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f322c0afbc0 0x7f322c14e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:00.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.769+0000 7f322a800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f322c0afbc0 0x7f322c14e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38146/0 (socket says 172.21.15.137:38146) 2024-04-26T23:42:00.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.769+0000 7f322a800640 1 -- 172.21.15.137:0/151018601 learned_addr learned my addr 172.21.15.137:0/151018601 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:00.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.769+0000 7f322a800640 1 -- 172.21.15.137:0/151018601 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f322c0ae070 msgr2=0x7f322c15f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:00.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.769+0000 7f322a800640 1 --2- 172.21.15.137:0/151018601 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f322c0ae070 0x7f322c15f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.769+0000 7f322a800640 1 -- 172.21.15.137:0/151018601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f322c0affa0 msgr2=0x7f322c148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:00.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.769+0000 7f322a800640 1 --2- 172.21.15.137:0/151018601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f322c0affa0 0x7f322c148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.769+0000 7f322a800640 1 -- 172.21.15.137:0/151018601 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f322c14f2a0 con 0x7f322c0afbc0 2024-04-26T23:42:00.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.769+0000 7f322a800640 1 --2- 172.21.15.137:0/151018601 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f322c0afbc0 0x7f322c14e700 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f321c0b0040 tx=0x7f321c0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:00.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.769+0000 7f3222a00640 1 -- 172.21.15.137:0/151018601 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321c0bd020 con 0x7f322c0afbc0 2024-04-26T23:42:00.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.769+0000 7f3222a00640 1 -- 172.21.15.137:0/151018601 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f321c0b8670 con 0x7f322c0afbc0 2024-04-26T23:42:00.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.769+0000 7f3222a00640 1 -- 172.21.15.137:0/151018601 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321c0b2040 con 0x7f322c0afbc0 2024-04-26T23:42:00.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.769+0000 7f3231400640 1 -- 172.21.15.137:0/151018601 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f322c14ece0 con 0x7f322c0afbc0 2024-04-26T23:42:00.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.769+0000 7f3231400640 1 -- 172.21.15.137:0/151018601 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f322c0ad870 con 0x7f322c0afbc0 2024-04-26T23:42:00.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.769+0000 7f3231400640 1 -- 172.21.15.137:0/151018601 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f322c06a410 con 0x7f322c0afbc0 2024-04-26T23:42:00.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.773+0000 7f3222a00640 1 -- 172.21.15.137:0/151018601 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f321c0c0020 con 0x7f322c0afbc0 2024-04-26T23:42:00.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.773+0000 7f3222a00640 1 --2- 172.21.15.137:0/151018601 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f320c068380 0x7f320c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:00.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.773+0000 7f3222a00640 1 -- 172.21.15.137:0/151018601 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f321c1219d0 con 0x7f322c0afbc0 2024-04-26T23:42:00.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.773+0000 7f3229e00640 1 --2- 172.21.15.137:0/151018601 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f320c068380 0x7f320c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:00.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.773+0000 7f3229e00640 1 --2- 172.21.15.137:0/151018601 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f320c068380 0x7f320c06a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3218007fd0 tx=0x7f3218007980 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:00.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.777+0000 7f3222a00640 1 -- 172.21.15.137:0/151018601 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f321c0c7030 con 0x7f322c0afbc0 2024-04-26T23:42:00.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.937+0000 7f3231400640 1 -- 172.21.15.137:0/151018601 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f322c160870 con 0x7f322c0afbc0 2024-04-26T23:42:00.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.937+0000 7f3222a00640 1 -- 172.21.15.137:0/151018601 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f321c016540 con 0x7f322c0afbc0 2024-04-26T23:42:00.940 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:42:00.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.937+0000 7f3231400640 1 -- 172.21.15.137:0/151018601 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f320c068380 msgr2=0x7f320c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:00.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.937+0000 7f3231400640 1 --2- 172.21.15.137:0/151018601 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f320c068380 0x7f320c06a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3218007fd0 tx=0x7f3218007980 comp rx=0 tx=0).stop 2024-04-26T23:42:00.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.937+0000 7f3231400640 1 -- 172.21.15.137:0/151018601 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f322c0afbc0 msgr2=0x7f322c14e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:00.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.937+0000 7f3231400640 1 --2- 172.21.15.137:0/151018601 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f322c0afbc0 0x7f322c14e700 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f321c0b0040 tx=0x7f321c0196f0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.937+0000 7f3231400640 1 -- 172.21.15.137:0/151018601 shutdown_connections 2024-04-26T23:42:00.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.937+0000 7f3231400640 1 --2- 172.21.15.137:0/151018601 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f320c068380 0x7f320c06a840 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.937+0000 7f3231400640 1 --2- 172.21.15.137:0/151018601 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f322c0ae070 0x7f322c15f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.937+0000 7f3231400640 1 --2- 172.21.15.137:0/151018601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f322c0affa0 0x7f322c148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.937+0000 7f3231400640 1 --2- 172.21.15.137:0/151018601 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f322c0afbc0 0x7f322c14e700 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:00.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.937+0000 7f3231400640 1 -- 172.21.15.137:0/151018601 >> 172.21.15.137:0/151018601 conn(0x7f322c06c800 msgr2=0x7f322c0735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:00.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.937+0000 7f3231400640 1 -- 172.21.15.137:0/151018601 shutdown_connections 2024-04-26T23:42:00.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:00.937+0000 7f3231400640 1 -- 172.21.15.137:0/151018601 wait complete. 2024-04-26T23:42:00.961 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:42:01.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.097+0000 7f7c73200640 1 Processor -- start 2024-04-26T23:42:01.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.097+0000 7f7c73200640 1 -- start start 2024-04-26T23:42:01.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.097+0000 7f7c73200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c6c160450 0x7f7c6c0d3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:01.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.097+0000 7f7c73200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c6c0b0cb0 con 0x7f7c6c0b0470 2024-04-26T23:42:01.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.097+0000 7f7c73200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c6c0b0f90 con 0x7f7c6c0d19c0 2024-04-26T23:42:01.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.097+0000 7f7c73200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7c6c0b1270 con 0x7f7c6c160450 2024-04-26T23:42:01.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.097+0000 7f7c6b400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f7c6c0b0470 0x7f7c6c0d12b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52550/0 (socket says 172.21.15.137:52550) 2024-04-26T23:42:01.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.097+0000 7f7c6b400640 1 -- 172.21.15.137:0/2002962205 learned_addr learned my addr 172.21.15.137:0/2002962205 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:01.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.097+0000 7f7c6be00640 1 --2- 172.21.15.137:0/2002962205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c6c160450 0x7f7c6c0d3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:01.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.097+0000 7f7c6aa00640 1 -- 172.21.15.137:0/2002962205 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 833568045 0 0) 0x7f7c6c0b0cb0 con 0x7f7c6c0b0470 2024-04-26T23:42:01.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.097+0000 7f7c6be00640 1 -- 172.21.15.137:0/2002962205 >> v1:172.21.15.170:6789/0 conn(0x7f7c6c0d19c0 legacy=0x7f7c6c0b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:01.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.097+0000 7f7c6be00640 1 -- 172.21.15.137:0/2002962205 >> v1:172.21.15.137:6789/0 conn(0x7f7c6c0b0470 legacy=0x7f7c6c0d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:01.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.097+0000 7f7c6be00640 1 -- 172.21.15.137:0/2002962205 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6c0b1550 con 0x7f7c6c160450 2024-04-26T23:42:01.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.101+0000 7f7c6be00640 1 --2- 172.21.15.137:0/2002962205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c6c160450 0x7f7c6c0d3360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009dc0 tx=0x7f7c5c01c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8797fc8bf8639a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:01.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.101+0000 7f7c6aa00640 1 -- 172.21.15.137:0/2002962205 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c0b2070 con 0x7f7c6c160450 2024-04-26T23:42:01.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.101+0000 7f7c6aa00640 1 -- 172.21.15.137:0/2002962205 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c5c0a5740 con 0x7f7c6c160450 2024-04-26T23:42:01.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.101+0000 7f7c6aa00640 1 -- 172.21.15.137:0/2002962205 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c0a5b10 con 0x7f7c6c160450 2024-04-26T23:42:01.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.101+0000 7f7c73200640 1 -- 172.21.15.137:0/2002962205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c6c160450 msgr2=0x7f7c6c0d3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:01.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.101+0000 7f7c73200640 1 --2- 172.21.15.137:0/2002962205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c6c160450 0x7f7c6c0d3360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009dc0 tx=0x7f7c5c01c960 comp rx=0 tx=0).stop 2024-04-26T23:42:01.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.101+0000 7f7c73200640 1 -- 172.21.15.137:0/2002962205 shutdown_connections 2024-04-26T23:42:01.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.101+0000 7f7c73200640 1 --2- 172.21.15.137:0/2002962205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c6c160450 0x7f7c6c0d3360 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.101+0000 7f7c73200640 1 -- 172.21.15.137:0/2002962205 >> 172.21.15.137:0/2002962205 conn(0x7f7c6c09ba60 msgr2=0x7f7c6c09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:01.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.101+0000 7f7c73200640 1 -- 172.21.15.137:0/2002962205 shutdown_connections 2024-04-26T23:42:01.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.101+0000 7f7c73200640 1 -- 172.21.15.137:0/2002962205 wait complete. 2024-04-26T23:42:01.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c73200640 1 Processor -- start 2024-04-26T23:42:01.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c73200640 1 -- start start 2024-04-26T23:42:01.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c73200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c6c0b0470 0x7f7c6c0c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:01.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c73200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c6c0d19c0 0x7f7c6c157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:01.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c73200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c6c160450 0x7f7c6c15e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:01.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c73200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c1609b0 con 0x7f7c6c0d19c0 2024-04-26T23:42:01.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c73200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c160830 con 0x7f7c6c0b0470 2024-04-26T23:42:01.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c73200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7c6c16ade0 con 0x7f7c6c160450 2024-04-26T23:42:01.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c6b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c6c0d19c0 0x7f7c6c157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:01.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c6b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c6c0d19c0 0x7f7c6c157df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38156/0 (socket says 172.21.15.137:38156) 2024-04-26T23:42:01.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c6b400640 1 -- 172.21.15.137:0/4170071042 learned_addr learned my addr 172.21.15.137:0/4170071042 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:01.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c6b400640 1 -- 172.21.15.137:0/4170071042 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c6c160450 msgr2=0x7f7c6c15e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:01.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c71200640 1 --2- 172.21.15.137:0/4170071042 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c6c160450 0x7f7c6c15e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:01.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c6be00640 1 --2- 172.21.15.137:0/4170071042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c6c0b0470 0x7f7c6c0c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:01.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c6b400640 1 --2- 172.21.15.137:0/4170071042 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c6c160450 0x7f7c6c15e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c6b400640 1 -- 172.21.15.137:0/4170071042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c6c0b0470 msgr2=0x7f7c6c0c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:01.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c6b400640 1 --2- 172.21.15.137:0/4170071042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c6c0b0470 0x7f7c6c0c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c6b400640 1 -- 172.21.15.137:0/4170071042 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6c1663f0 con 0x7f7c6c0d19c0 2024-04-26T23:42:01.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c71200640 1 --2- 172.21.15.137:0/4170071042 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c6c160450 0x7f7c6c15e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:01.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c6be00640 1 --2- 172.21.15.137:0/4170071042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c6c0b0470 0x7f7c6c0c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:01.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c6b400640 1 --2- 172.21.15.137:0/4170071042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c6c0d19c0 0x7f7c6c157df0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800c4d0 tx=0x7f7c5800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:01.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c63e00640 1 -- 172.21.15.137:0/4170071042 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c58018070 con 0x7f7c6c0d19c0 2024-04-26T23:42:01.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c63e00640 1 -- 172.21.15.137:0/4170071042 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c580074e0 con 0x7f7c6c0d19c0 2024-04-26T23:42:01.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c73200640 1 -- 172.21.15.137:0/4170071042 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c6c1666d0 con 0x7f7c6c0d19c0 2024-04-26T23:42:01.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c63e00640 1 -- 172.21.15.137:0/4170071042 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c58004a30 con 0x7f7c6c0d19c0 2024-04-26T23:42:01.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c73200640 1 -- 172.21.15.137:0/4170071042 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c6c1671b0 con 0x7f7c6c0d19c0 2024-04-26T23:42:01.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.105+0000 7f7c73200640 1 -- 172.21.15.137:0/4170071042 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c6c06a410 con 0x7f7c6c0d19c0 2024-04-26T23:42:01.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.109+0000 7f7c63e00640 1 -- 172.21.15.137:0/4170071042 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7c5801b070 con 0x7f7c6c0d19c0 2024-04-26T23:42:01.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.109+0000 7f7c63e00640 1 --2- 172.21.15.137:0/4170071042 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c4c068380 0x7f7c4c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:01.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.109+0000 7f7c63e00640 1 -- 172.21.15.137:0/4170071042 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7c58085cd0 con 0x7f7c6c0d19c0 2024-04-26T23:42:01.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.109+0000 7f7c6be00640 1 --2- 172.21.15.137:0/4170071042 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c4c068380 0x7f7c4c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:01.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.109+0000 7f7c6be00640 1 --2- 172.21.15.137:0/4170071042 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c4c068380 0x7f7c4c06a840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0af000 tx=0x7f7c5c0a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:01.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.113+0000 7f7c63e00640 1 -- 172.21.15.137:0/4170071042 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7c58056280 con 0x7f7c6c0d19c0 2024-04-26T23:42:01.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.273+0000 7f7c73200640 1 -- 172.21.15.137:0/4170071042 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7c6c071da0 con 0x7f7c6c0d19c0 2024-04-26T23:42:01.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.273+0000 7f7c63e00640 1 -- 172.21.15.137:0/4170071042 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f7c58055b80 con 0x7f7c6c0d19c0 2024-04-26T23:42:01.276 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:42:01.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.273+0000 7f7c73200640 1 -- 172.21.15.137:0/4170071042 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c4c068380 msgr2=0x7f7c4c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:01.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.273+0000 7f7c73200640 1 --2- 172.21.15.137:0/4170071042 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c4c068380 0x7f7c4c06a840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0af000 tx=0x7f7c5c0a7070 comp rx=0 tx=0).stop 2024-04-26T23:42:01.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.273+0000 7f7c73200640 1 -- 172.21.15.137:0/4170071042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c6c0d19c0 msgr2=0x7f7c6c157df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:01.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.273+0000 7f7c73200640 1 --2- 172.21.15.137:0/4170071042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c6c0d19c0 0x7f7c6c157df0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800c4d0 tx=0x7f7c5800c990 comp rx=0 tx=0).stop 2024-04-26T23:42:01.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.273+0000 7f7c73200640 1 -- 172.21.15.137:0/4170071042 shutdown_connections 2024-04-26T23:42:01.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.273+0000 7f7c73200640 1 --2- 172.21.15.137:0/4170071042 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c4c068380 0x7f7c4c06a840 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.273+0000 7f7c73200640 1 --2- 172.21.15.137:0/4170071042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c6c0d19c0 0x7f7c6c157df0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.273+0000 7f7c73200640 1 --2- 172.21.15.137:0/4170071042 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c6c160450 0x7f7c6c15e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.273+0000 7f7c73200640 1 --2- 172.21.15.137:0/4170071042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c6c0b0470 0x7f7c6c0c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.273+0000 7f7c73200640 1 -- 172.21.15.137:0/4170071042 >> 172.21.15.137:0/4170071042 conn(0x7f7c6c09ba60 msgr2=0x7f7c6c0b2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:01.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.273+0000 7f7c73200640 1 -- 172.21.15.137:0/4170071042 shutdown_connections 2024-04-26T23:42:01.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.273+0000 7f7c73200640 1 -- 172.21.15.137:0/4170071042 wait complete. 2024-04-26T23:42:01.298 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:42:01.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.429+0000 7f66b8c00640 1 Processor -- start 2024-04-26T23:42:01.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.429+0000 7f66b8c00640 1 -- start start 2024-04-26T23:42:01.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.429+0000 7f66b8c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f66b4146920 0x7f66b4073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:01.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.429+0000 7f66b8c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66b4073010 con 0x7f66b40ce3e0 2024-04-26T23:42:01.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.429+0000 7f66b8c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66b40cef90 con 0x7f66b415de80 2024-04-26T23:42:01.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.429+0000 7f66b8c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f66b4073280 con 0x7f66b4146920 2024-04-26T23:42:01.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.429+0000 7f66b1e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f66b40ce3e0 0x7f66b40d04e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52556/0 (socket says 172.21.15.137:52556) 2024-04-26T23:42:01.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.429+0000 7f66b1e00640 1 -- 172.21.15.137:0/3172783906 learned_addr learned my addr 172.21.15.137:0/3172783906 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:01.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b2800640 1 --2- 172.21.15.137:0/3172783906 >> v2:172.21.15.170:3300/0 conn(0x7f66b4146920 0x7f66b4073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:01.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b1400640 1 -- 172.21.15.137:0/3172783906 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 47084468 0 0) 0x7f66b4073010 con 0x7f66b40ce3e0 2024-04-26T23:42:01.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b1400640 1 -- 172.21.15.137:0/3172783906 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6698003530 con 0x7f66b40ce3e0 2024-04-26T23:42:01.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b1400640 1 -- 172.21.15.137:0/3172783906 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2555614051 0 0) 0x7f6698003530 con 0x7f66b40ce3e0 2024-04-26T23:42:01.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b1400640 1 -- 172.21.15.137:0/3172783906 >> v2:172.21.15.170:3300/0 conn(0x7f66b4146920 msgr2=0x7f66b4073d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:01.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b1400640 1 --2- 172.21.15.137:0/3172783906 >> v2:172.21.15.170:3300/0 conn(0x7f66b4146920 0x7f66b4073d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b1400640 1 -- 172.21.15.137:0/3172783906 >> v1:172.21.15.170:6789/0 conn(0x7f66b415de80 legacy=0x7f66b4146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:01.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b1400640 1 -- 172.21.15.137:0/3172783906 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b4073560 con 0x7f66b40ce3e0 2024-04-26T23:42:01.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b1400640 1 -- 172.21.15.137:0/3172783906 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f66a4001680 con 0x7f66b40ce3e0 2024-04-26T23:42:01.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b1400640 1 -- 172.21.15.137:0/3172783906 >> v1:172.21.15.137:6789/0 conn(0x7f66b40ce3e0 legacy=0x7f66b40d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:01.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b1400640 1 --2- 172.21.15.137:0/3172783906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66980039c0 0x7f6698003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:01.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b1400640 1 --2- 172.21.15.137:0/3172783906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6698004810 0x7f6698004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:01.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b1400640 1 --2- 172.21.15.137:0/3172783906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66980051d0 0x7f669800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:01.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b1400640 1 -- 172.21.15.137:0/3172783906 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f66b4073280 con 0x7f66980039c0 2024-04-26T23:42:01.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b1400640 1 -- 172.21.15.137:0/3172783906 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f669800c070 con 0x7f66980051d0 2024-04-26T23:42:01.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b1400640 1 -- 172.21.15.137:0/3172783906 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f669800c270 con 0x7f6698004810 2024-04-26T23:42:01.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b1e00640 1 --2- 172.21.15.137:0/3172783906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66980039c0 0x7f6698003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:01.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b2800640 1 --2- 172.21.15.137:0/3172783906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66980051d0 0x7f669800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:01.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66a9400640 1 --2- 172.21.15.137:0/3172783906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6698004810 0x7f6698004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:01.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b1e00640 1 -- 172.21.15.137:0/3172783906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6698004810 msgr2=0x7f6698004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:01.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b1e00640 1 --2- 172.21.15.137:0/3172783906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6698004810 0x7f6698004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b1e00640 1 -- 172.21.15.137:0/3172783906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66980051d0 msgr2=0x7f669800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:01.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b1e00640 1 --2- 172.21.15.137:0/3172783906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66980051d0 0x7f669800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b1e00640 1 -- 172.21.15.137:0/3172783906 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6698003530 con 0x7f66980039c0 2024-04-26T23:42:01.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66b2800640 1 -- 172.21.15.137:0/3172783906 reap_dead start 2024-04-26T23:42:01.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.433+0000 7f66a9400640 1 --2- 172.21.15.137:0/3172783906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6698004810 0x7f6698004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:01.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.437+0000 7f66b1e00640 1 --2- 172.21.15.137:0/3172783906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66980039c0 0x7f6698003de0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f66a400c240 tx=0x7f66a401cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e13d28a1679851b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:01.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.437+0000 7f66b1400640 1 -- 172.21.15.137:0/3172783906 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a4007d20 con 0x7f66980039c0 2024-04-26T23:42:01.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.437+0000 7f66b1400640 1 -- 172.21.15.137:0/3172783906 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66a40a9070 con 0x7f66980039c0 2024-04-26T23:42:01.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.437+0000 7f66b1400640 1 -- 172.21.15.137:0/3172783906 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a4005d80 con 0x7f66980039c0 2024-04-26T23:42:01.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.437+0000 7f66b8c00640 1 -- 172.21.15.137:0/3172783906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66980039c0 msgr2=0x7f6698003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:01.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.437+0000 7f66b8c00640 1 --2- 172.21.15.137:0/3172783906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66980039c0 0x7f6698003de0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f66a400c240 tx=0x7f66a401cbd0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.437+0000 7f66b8c00640 1 -- 172.21.15.137:0/3172783906 shutdown_connections 2024-04-26T23:42:01.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.437+0000 7f66b8c00640 1 --2- 172.21.15.137:0/3172783906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66980039c0 0x7f6698003de0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.437+0000 7f66b8c00640 1 -- 172.21.15.137:0/3172783906 >> 172.21.15.137:0/3172783906 conn(0x7f66b406c5d0 msgr2=0x7f66b406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:01.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.437+0000 7f66b8c00640 1 -- 172.21.15.137:0/3172783906 shutdown_connections 2024-04-26T23:42:01.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.437+0000 7f66b8c00640 1 -- 172.21.15.137:0/3172783906 wait complete. 2024-04-26T23:42:01.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.437+0000 7f66b8c00640 1 Processor -- start 2024-04-26T23:42:01.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.437+0000 7f66b8c00640 1 -- start start 2024-04-26T23:42:01.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.437+0000 7f66b8c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f66980039c0 0x7f66b413dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:01.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.437+0000 7f66b8c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66b413e5a0 0x7f66b4138e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:01.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.437+0000 7f66b8c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66b40b1990 0x7f66b40b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:01.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.437+0000 7f66b8c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f66b4073ee0 con 0x7f66b40b1990 2024-04-26T23:42:01.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.437+0000 7f66b8c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f66b4073d60 con 0x7f66b413e5a0 2024-04-26T23:42:01.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.437+0000 7f66b8c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f66b4074060 con 0x7f66980039c0 2024-04-26T23:42:01.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.441+0000 7f66b2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66b40b1990 0x7f66b40b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:01.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.441+0000 7f66b2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66b40b1990 0x7f66b40b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38164/0 (socket says 172.21.15.137:38164) 2024-04-26T23:42:01.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.441+0000 7f66b2800640 1 -- 172.21.15.137:0/556431841 learned_addr learned my addr 172.21.15.137:0/556431841 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:01.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.441+0000 7f66b1e00640 1 --2- 172.21.15.137:0/556431841 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f66980039c0 0x7f66b413dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:01.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.441+0000 7f66a9400640 1 --2- 172.21.15.137:0/556431841 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66b413e5a0 0x7f66b4138e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:01.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.441+0000 7f66b2800640 1 -- 172.21.15.137:0/556431841 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f66980039c0 msgr2=0x7f66b413dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:01.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.441+0000 7f66b2800640 1 --2- 172.21.15.137:0/556431841 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f66980039c0 0x7f66b413dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.441+0000 7f66b2800640 1 -- 172.21.15.137:0/556431841 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66b413e5a0 msgr2=0x7f66b4138e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:01.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.441+0000 7f66b2800640 1 --2- 172.21.15.137:0/556431841 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66b413e5a0 0x7f66b4138e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.441+0000 7f66b2800640 1 -- 172.21.15.137:0/556431841 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b4142750 con 0x7f66b40b1990 2024-04-26T23:42:01.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.441+0000 7f66b2800640 1 --2- 172.21.15.137:0/556431841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66b40b1990 0x7f66b40b1e10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f66ac011b40 tx=0x7f66ac00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:01.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.441+0000 7f66aaa00640 1 -- 172.21.15.137:0/556431841 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ac00fd10 con 0x7f66b40b1990 2024-04-26T23:42:01.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.441+0000 7f66aaa00640 1 -- 172.21.15.137:0/556431841 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66ac015430 con 0x7f66b40b1990 2024-04-26T23:42:01.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.441+0000 7f66b8c00640 1 -- 172.21.15.137:0/556431841 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66b413ed40 con 0x7f66b40b1990 2024-04-26T23:42:01.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.441+0000 7f66aaa00640 1 -- 172.21.15.137:0/556431841 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ac015820 con 0x7f66b40b1990 2024-04-26T23:42:01.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.441+0000 7f66b8c00640 1 -- 172.21.15.137:0/556431841 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66b4140ca0 con 0x7f66b40b1990 2024-04-26T23:42:01.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.441+0000 7f66b8c00640 1 -- 172.21.15.137:0/556431841 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66b406a4b0 con 0x7f66b40b1990 2024-04-26T23:42:01.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.441+0000 7f66aaa00640 1 -- 172.21.15.137:0/556431841 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f66ac0159c0 con 0x7f66b40b1990 2024-04-26T23:42:01.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.445+0000 7f66aaa00640 1 --2- 172.21.15.137:0/556431841 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66900683b0 0x7f669006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:01.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.445+0000 7f66aaa00640 1 -- 172.21.15.137:0/556431841 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f66ac0876a0 con 0x7f66b40b1990 2024-04-26T23:42:01.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.445+0000 7f66b1e00640 1 --2- 172.21.15.137:0/556431841 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66900683b0 0x7f669006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:01.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.445+0000 7f66b1e00640 1 --2- 172.21.15.137:0/556431841 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66900683b0 0x7f669006a870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f66a40ab000 tx=0x7f66a40b1040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:01.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.449+0000 7f66aaa00640 1 -- 172.21.15.137:0/556431841 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f66ac019030 con 0x7f66b40b1990 2024-04-26T23:42:01.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.617+0000 7f66b8c00640 1 -- 172.21.15.137:0/556431841 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f66b406d410 con 0x7f66b40b1990 2024-04-26T23:42:01.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.617+0000 7f66aaa00640 1 -- 172.21.15.137:0/556431841 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f66ac010040 con 0x7f66b40b1990 2024-04-26T23:42:01.621 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T23:42:01.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.621+0000 7f66b8c00640 1 -- 172.21.15.137:0/556431841 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66900683b0 msgr2=0x7f669006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:01.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.621+0000 7f66b8c00640 1 --2- 172.21.15.137:0/556431841 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66900683b0 0x7f669006a870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f66a40ab000 tx=0x7f66a40b1040 comp rx=0 tx=0).stop 2024-04-26T23:42:01.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.621+0000 7f66b8c00640 1 -- 172.21.15.137:0/556431841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66b40b1990 msgr2=0x7f66b40b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:01.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.621+0000 7f66b8c00640 1 --2- 172.21.15.137:0/556431841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66b40b1990 0x7f66b40b1e10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f66ac011b40 tx=0x7f66ac00f1b0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.621+0000 7f66b8c00640 1 -- 172.21.15.137:0/556431841 shutdown_connections 2024-04-26T23:42:01.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.621+0000 7f66b8c00640 1 --2- 172.21.15.137:0/556431841 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66900683b0 0x7f669006a870 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.621+0000 7f66b8c00640 1 --2- 172.21.15.137:0/556431841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66b40b1990 0x7f66b40b1e10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.621+0000 7f66b8c00640 1 --2- 172.21.15.137:0/556431841 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66b413e5a0 0x7f66b4138e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.621+0000 7f66b8c00640 1 --2- 172.21.15.137:0/556431841 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f66980039c0 0x7f66b413dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.621+0000 7f66b8c00640 1 -- 172.21.15.137:0/556431841 >> 172.21.15.137:0/556431841 conn(0x7f66b406c5d0 msgr2=0x7f66b406f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:01.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.621+0000 7f66b8c00640 1 -- 172.21.15.137:0/556431841 shutdown_connections 2024-04-26T23:42:01.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.621+0000 7f66b8c00640 1 -- 172.21.15.137:0/556431841 wait complete. 2024-04-26T23:42:01.642 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:42:01.642 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:42:01.652 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:42:01.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.785+0000 7fa8b4e00640 1 Processor -- start 2024-04-26T23:42:01.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.785+0000 7fa8b4e00640 1 -- start start 2024-04-26T23:42:01.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.785+0000 7fa8b4e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa8b0073090 0x7fa8b00cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:01.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.785+0000 7fa8b4e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8b00cfef0 con 0x7fa8b00725a0 2024-04-26T23:42:01.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.785+0000 7fa8b4e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8b00cddc0 con 0x7fa8b00b5080 2024-04-26T23:42:01.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.785+0000 7fa8b4e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fa8b00d01b0 con 0x7fa8b0073090 2024-04-26T23:42:01.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.785+0000 7fa8ade00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa8b00725a0 0x7fa8b0073f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52566/0 (socket says 172.21.15.137:52566) 2024-04-26T23:42:01.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.785+0000 7fa8ade00640 1 -- 172.21.15.137:0/3445164071 learned_addr learned my addr 172.21.15.137:0/3445164071 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:01.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.785+0000 7fa8ae800640 1 --2- 172.21.15.137:0/3445164071 >> v2:172.21.15.170:3300/0 conn(0x7fa8b0073090 0x7fa8b00cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:01.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.789+0000 7fa8ad400640 1 -- 172.21.15.137:0/3445164071 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 595095862 0 0) 0x7fa8b00cfef0 con 0x7fa8b00725a0 2024-04-26T23:42:01.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.789+0000 7fa8ad400640 1 -- 172.21.15.137:0/3445164071 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa894003530 con 0x7fa8b00725a0 2024-04-26T23:42:01.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.789+0000 7fa8ae800640 1 -- 172.21.15.137:0/3445164071 >> v1:172.21.15.170:6789/0 conn(0x7fa8b00b5080 legacy=0x7fa8b0072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:01.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.789+0000 7fa8ae800640 1 -- 172.21.15.137:0/3445164071 >> v1:172.21.15.137:6789/0 conn(0x7fa8b00725a0 legacy=0x7fa8b0073f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:01.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.789+0000 7fa8ae800640 1 -- 172.21.15.137:0/3445164071 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b00d0490 con 0x7fa8b0073090 2024-04-26T23:42:01.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.789+0000 7fa8ae800640 1 --2- 172.21.15.137:0/3445164071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b0073090 0x7fa8b00cd770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8009dc0 tx=0x7fa8a801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edce9ff179969660 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:01.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.789+0000 7fa8ad400640 1 -- 172.21.15.137:0/3445164071 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a80b2070 con 0x7fa8b0073090 2024-04-26T23:42:01.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.789+0000 7fa8ad400640 1 -- 172.21.15.137:0/3445164071 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8a80a5a00 con 0x7fa8b0073090 2024-04-26T23:42:01.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.789+0000 7fa8ad400640 1 -- 172.21.15.137:0/3445164071 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a80a5dd0 con 0x7fa8b0073090 2024-04-26T23:42:01.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8b4e00640 1 -- 172.21.15.137:0/3445164071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b0073090 msgr2=0x7fa8b00cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:01.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8b4e00640 1 --2- 172.21.15.137:0/3445164071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b0073090 0x7fa8b00cd770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8009dc0 tx=0x7fa8a801c920 comp rx=0 tx=0).stop 2024-04-26T23:42:01.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8b4e00640 1 -- 172.21.15.137:0/3445164071 shutdown_connections 2024-04-26T23:42:01.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8b4e00640 1 --2- 172.21.15.137:0/3445164071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b0073090 0x7fa8b00cd770 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8b4e00640 1 -- 172.21.15.137:0/3445164071 >> 172.21.15.137:0/3445164071 conn(0x7fa8b006c5d0 msgr2=0x7fa8b006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:01.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8b4e00640 1 -- 172.21.15.137:0/3445164071 shutdown_connections 2024-04-26T23:42:01.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8b4e00640 1 -- 172.21.15.137:0/3445164071 wait complete. 2024-04-26T23:42:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8b4e00640 1 Processor -- start 2024-04-26T23:42:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8b4e00640 1 -- start start 2024-04-26T23:42:01.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8b4e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8b00725a0 0x7fa8b013ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:01.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8b4e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8b0073090 0x7fa8b0141c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:01.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8b4e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b00b5080 0x7fa8b015af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:01.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8b4e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b0169900 con 0x7fa8b00725a0 2024-04-26T23:42:01.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8b4e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b0169780 con 0x7fa8b00b5080 2024-04-26T23:42:01.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8b4e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa8b0169a80 con 0x7fa8b0073090 2024-04-26T23:42:01.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8ade00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8b00725a0 0x7fa8b013ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8ade00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8b00725a0 0x7fa8b013ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38166/0 (socket says 172.21.15.137:38166) 2024-04-26T23:42:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8ade00640 1 -- 172.21.15.137:0/2144564906 learned_addr learned my addr 172.21.15.137:0/2144564906 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8ae800640 1 --2- 172.21.15.137:0/2144564906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b00b5080 0x7fa8b015af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8a5400640 1 --2- 172.21.15.137:0/2144564906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8b0073090 0x7fa8b0141c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8ade00640 1 -- 172.21.15.137:0/2144564906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8b0073090 msgr2=0x7fa8b0141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8ade00640 1 --2- 172.21.15.137:0/2144564906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8b0073090 0x7fa8b0141c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8ade00640 1 -- 172.21.15.137:0/2144564906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b00b5080 msgr2=0x7fa8b015af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8ade00640 1 --2- 172.21.15.137:0/2144564906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b00b5080 0x7fa8b015af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8ade00640 1 -- 172.21.15.137:0/2144564906 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b00b08f0 con 0x7fa8b00725a0 2024-04-26T23:42:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8a5400640 1 --2- 172.21.15.137:0/2144564906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8b0073090 0x7fa8b0141c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.793+0000 7fa8ade00640 1 --2- 172.21.15.137:0/2144564906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8b00725a0 0x7fa8b013ef20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c420 tx=0x7fa8a000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.797+0000 7fa8a6a00640 1 -- 172.21.15.137:0/2144564906 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0017070 con 0x7fa8b00725a0 2024-04-26T23:42:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.797+0000 7fa8a6a00640 1 -- 172.21.15.137:0/2144564906 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8a0005cf0 con 0x7fa8b00725a0 2024-04-26T23:42:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.797+0000 7fa8a6a00640 1 -- 172.21.15.137:0/2144564906 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a00072d0 con 0x7fa8b00725a0 2024-04-26T23:42:01.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.797+0000 7fa8b4e00640 1 -- 172.21.15.137:0/2144564906 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8b00b0bd0 con 0x7fa8b00725a0 2024-04-26T23:42:01.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.797+0000 7fa8b4e00640 1 -- 172.21.15.137:0/2144564906 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8b00b1190 con 0x7fa8b00725a0 2024-04-26T23:42:01.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.797+0000 7fa8b4e00640 1 -- 172.21.15.137:0/2144564906 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8b006a4b0 con 0x7fa8b00725a0 2024-04-26T23:42:01.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.797+0000 7fa8a6a00640 1 -- 172.21.15.137:0/2144564906 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa8a001a070 con 0x7fa8b00725a0 2024-04-26T23:42:01.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.797+0000 7fa8a6a00640 1 --2- 172.21.15.137:0/2144564906 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa88c068380 0x7fa88c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:01.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.797+0000 7fa8a6a00640 1 -- 172.21.15.137:0/2144564906 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa8a0085da0 con 0x7fa8b00725a0 2024-04-26T23:42:01.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.797+0000 7fa8a5400640 1 --2- 172.21.15.137:0/2144564906 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa88c068380 0x7fa88c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:01.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.801+0000 7fa8a5400640 1 --2- 172.21.15.137:0/2144564906 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa88c068380 0x7fa88c06a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa8b01414f0 tx=0x7fa898009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:01.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.801+0000 7fa8a6a00640 1 -- 172.21.15.137:0/2144564906 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa8a0055c70 con 0x7fa8b00725a0 2024-04-26T23:42:01.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.961+0000 7fa8b4e00640 1 -- 172.21.15.137:0/2144564906 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8b0072380 con 0x7fa8b00725a0 2024-04-26T23:42:01.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.961+0000 7fa8a6a00640 1 -- 172.21.15.137:0/2144564906 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16653 (secure 0 0 0) 0x7fa8a0059f70 con 0x7fa8b00725a0 2024-04-26T23:42:01.966 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:01.966 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:41:25.186308+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:42:01.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.965+0000 7fa8b4e00640 1 -- 172.21.15.137:0/2144564906 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa88c068380 msgr2=0x7fa88c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:01.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.965+0000 7fa8b4e00640 1 --2- 172.21.15.137:0/2144564906 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa88c068380 0x7fa88c06a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa8b01414f0 tx=0x7fa898009040 comp rx=0 tx=0).stop 2024-04-26T23:42:01.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.965+0000 7fa8b4e00640 1 -- 172.21.15.137:0/2144564906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8b00725a0 msgr2=0x7fa8b013ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:01.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.965+0000 7fa8b4e00640 1 --2- 172.21.15.137:0/2144564906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8b00725a0 0x7fa8b013ef20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c420 tx=0x7fa8a000c8e0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.965+0000 7fa8b4e00640 1 -- 172.21.15.137:0/2144564906 shutdown_connections 2024-04-26T23:42:01.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.965+0000 7fa8b4e00640 1 --2- 172.21.15.137:0/2144564906 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa88c068380 0x7fa88c06a840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.965+0000 7fa8b4e00640 1 --2- 172.21.15.137:0/2144564906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b00b5080 0x7fa8b015af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.965+0000 7fa8b4e00640 1 --2- 172.21.15.137:0/2144564906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8b0073090 0x7fa8b0141c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.965+0000 7fa8b4e00640 1 --2- 172.21.15.137:0/2144564906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8b00725a0 0x7fa8b013ef20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:01.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.965+0000 7fa8b4e00640 1 -- 172.21.15.137:0/2144564906 >> 172.21.15.137:0/2144564906 conn(0x7fa8b006c5d0 msgr2=0x7fa8b0072980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:01.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.965+0000 7fa8b4e00640 1 -- 172.21.15.137:0/2144564906 shutdown_connections 2024-04-26T23:42:01.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:01.965+0000 7fa8b4e00640 1 -- 172.21.15.137:0/2144564906 wait complete. 2024-04-26T23:42:01.988 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:41:21.810449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:41:22.533452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:42:01.989 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:42:02.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.121+0000 7fbce4800640 1 Processor -- start 2024-04-26T23:42:02.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.121+0000 7fbce4800640 1 -- start start 2024-04-26T23:42:02.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce4800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbcdc0b3180 0x7fbcdc15fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce4800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcdc0af8a0 0x7fbcdc160230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce4800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcdc0b21e0 con 0x7fbcdc15f910 2024-04-26T23:42:02.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce4800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fbcdc160770 con 0x7fbcdc0b3180 2024-04-26T23:42:02.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce4800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbcdc0b3600 con 0x7fbcdc0af8a0 2024-04-26T23:42:02.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce1e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fbcdc15f910 0x7fbcdc0b5d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52582/0 (socket says 172.21.15.137:52582) 2024-04-26T23:42:02.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce1e00640 1 -- 172.21.15.137:0/388369825 learned_addr learned my addr 172.21.15.137:0/388369825 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:02.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce2800640 1 --2- 172.21.15.137:0/388369825 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcdc0af8a0 0x7fbcdc160230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce0a00640 1 -- 172.21.15.137:0/388369825 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1234164104 0 0) 0x7fbcdc0b21e0 con 0x7fbcdc15f910 2024-04-26T23:42:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce1400640 1 --2- 172.21.15.137:0/388369825 >> v2:172.21.15.170:3300/0 conn(0x7fbcdc0b3180 0x7fbcdc15fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce0a00640 1 -- 172.21.15.137:0/388369825 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcc4003530 con 0x7fbcdc15f910 2024-04-26T23:42:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce0a00640 1 -- 172.21.15.137:0/388369825 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3093660466 0 0) 0x7fbcc4003530 con 0x7fbcdc15f910 2024-04-26T23:42:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce0a00640 1 -- 172.21.15.137:0/388369825 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcdc0af8a0 msgr2=0x7fbcdc160230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce0a00640 1 --2- 172.21.15.137:0/388369825 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcdc0af8a0 0x7fbcdc160230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce0a00640 1 -- 172.21.15.137:0/388369825 >> v2:172.21.15.170:3300/0 conn(0x7fbcdc0b3180 msgr2=0x7fbcdc15fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce0a00640 1 --2- 172.21.15.137:0/388369825 >> v2:172.21.15.170:3300/0 conn(0x7fbcdc0b3180 0x7fbcdc15fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce0a00640 1 -- 172.21.15.137:0/388369825 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcdc0b38e0 con 0x7fbcdc15f910 2024-04-26T23:42:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce0a00640 1 -- 172.21.15.137:0/388369825 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fbcd0001680 con 0x7fbcdc15f910 2024-04-26T23:42:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce0a00640 1 -- 172.21.15.137:0/388369825 >> v1:172.21.15.137:6789/0 conn(0x7fbcdc15f910 legacy=0x7fbcdc0b5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce0a00640 1 --2- 172.21.15.137:0/388369825 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcc40039c0 0x7fbcc4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce0a00640 1 --2- 172.21.15.137:0/388369825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcc4004810 0x7fbcc4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce0a00640 1 --2- 172.21.15.137:0/388369825 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcdc0af8a0 0x7fbcc40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce0a00640 1 -- 172.21.15.137:0/388369825 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc160770 con 0x7fbcc4004810 2024-04-26T23:42:02.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce0a00640 1 -- 172.21.15.137:0/388369825 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc0b3600 con 0x7fbcc40039c0 2024-04-26T23:42:02.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce0a00640 1 -- 172.21.15.137:0/388369825 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbcc400ba00 con 0x7fbcdc0af8a0 2024-04-26T23:42:02.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce1400640 1 --2- 172.21.15.137:0/388369825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcc4004810 0x7fbcc4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce1e00640 1 --2- 172.21.15.137:0/388369825 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcc40039c0 0x7fbcc4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce2800640 1 --2- 172.21.15.137:0/388369825 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcdc0af8a0 0x7fbcc40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce1400640 1 -- 172.21.15.137:0/388369825 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcdc0af8a0 msgr2=0x7fbcc40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:02.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce1400640 1 --2- 172.21.15.137:0/388369825 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcdc0af8a0 0x7fbcc40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce1400640 1 -- 172.21.15.137:0/388369825 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcc40039c0 msgr2=0x7fbcc4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:02.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce1400640 1 --2- 172.21.15.137:0/388369825 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcc40039c0 0x7fbcc4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce1400640 1 -- 172.21.15.137:0/388369825 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc4003530 con 0x7fbcc4004810 2024-04-26T23:42:02.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.125+0000 7fbce2800640 1 --2- 172.21.15.137:0/388369825 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcdc0af8a0 0x7fbcc40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:02.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.129+0000 7fbce1400640 1 --2- 172.21.15.137:0/388369825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcc4004810 0x7fbcc4004c90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbccc009ab0 tx=0x7fbccc01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4263056ddc9e840 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:02.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.129+0000 7fbce0a00640 1 -- 172.21.15.137:0/388369825 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc0096b0 con 0x7fbcc4004810 2024-04-26T23:42:02.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.129+0000 7fbce0a00640 1 -- 172.21.15.137:0/388369825 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbccc0b0400 con 0x7fbcc4004810 2024-04-26T23:42:02.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.129+0000 7fbce0a00640 1 -- 172.21.15.137:0/388369825 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc0b07b0 con 0x7fbcc4004810 2024-04-26T23:42:02.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.129+0000 7fbce4800640 1 -- 172.21.15.137:0/388369825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcc4004810 msgr2=0x7fbcc4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:02.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.129+0000 7fbce4800640 1 --2- 172.21.15.137:0/388369825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcc4004810 0x7fbcc4004c90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbccc009ab0 tx=0x7fbccc01ca90 comp rx=0 tx=0).stop 2024-04-26T23:42:02.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.129+0000 7fbce2800640 1 -- 172.21.15.137:0/388369825 reap_dead start 2024-04-26T23:42:02.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.129+0000 7fbce4800640 1 -- 172.21.15.137:0/388369825 shutdown_connections 2024-04-26T23:42:02.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.129+0000 7fbce4800640 1 -- 172.21.15.137:0/388369825 >> 172.21.15.137:0/388369825 conn(0x7fbcdc0b6710 msgr2=0x7fbcdc0b6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:02.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.129+0000 7fbce4800640 1 -- 172.21.15.137:0/388369825 shutdown_connections 2024-04-26T23:42:02.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.129+0000 7fbce4800640 1 -- 172.21.15.137:0/388369825 wait complete. 2024-04-26T23:42:02.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce4800640 1 Processor -- start 2024-04-26T23:42:02.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce4800640 1 -- start start 2024-04-26T23:42:02.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce4800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcc4004810 0x7fbcdc163cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce4800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcdc154ed0 0x7fbcdc152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce4800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcdc161900 0x7fbcdc161db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce4800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc169850 con 0x7fbcdc161900 2024-04-26T23:42:02.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce4800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1696d0 con 0x7fbcc4004810 2024-04-26T23:42:02.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce4800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbcdc1699d0 con 0x7fbcdc154ed0 2024-04-26T23:42:02.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcdc161900 0x7fbcdc161db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcdc161900 0x7fbcdc161db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38192/0 (socket says 172.21.15.137:38192) 2024-04-26T23:42:02.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce2800640 1 -- 172.21.15.137:0/416398056 learned_addr learned my addr 172.21.15.137:0/416398056 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:02.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce1e00640 1 --2- 172.21.15.137:0/416398056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcc4004810 0x7fbcdc163cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce2800640 1 -- 172.21.15.137:0/416398056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcdc154ed0 msgr2=0x7fbcdc152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:02.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce1400640 1 --2- 172.21.15.137:0/416398056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcdc154ed0 0x7fbcdc152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce2800640 1 --2- 172.21.15.137:0/416398056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcdc154ed0 0x7fbcdc152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce2800640 1 -- 172.21.15.137:0/416398056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcc4004810 msgr2=0x7fbcdc163cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:02.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce2800640 1 --2- 172.21.15.137:0/416398056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcc4004810 0x7fbcdc163cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce2800640 1 -- 172.21.15.137:0/416398056 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcdc1f86b0 con 0x7fbcdc161900 2024-04-26T23:42:02.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce1e00640 1 --2- 172.21.15.137:0/416398056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcc4004810 0x7fbcdc163cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:02.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce1400640 1 --2- 172.21.15.137:0/416398056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcdc154ed0 0x7fbcdc152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:02.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce2800640 1 --2- 172.21.15.137:0/416398056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcdc161900 0x7fbcdc161db0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc0b7430 tx=0x7fbcd8010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:02.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbcd6000640 1 -- 172.21.15.137:0/416398056 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd801a030 con 0x7fbcdc161900 2024-04-26T23:42:02.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbcd6000640 1 -- 172.21.15.137:0/416398056 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd80039a0 con 0x7fbcdc161900 2024-04-26T23:42:02.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbcd6000640 1 -- 172.21.15.137:0/416398056 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8003d90 con 0x7fbcdc161900 2024-04-26T23:42:02.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce4800640 1 -- 172.21.15.137:0/416398056 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcdc1f8990 con 0x7fbcdc161900 2024-04-26T23:42:02.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce4800640 1 -- 172.21.15.137:0/416398056 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcdc1f8f50 con 0x7fbcdc161900 2024-04-26T23:42:02.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.133+0000 7fbce4800640 1 -- 172.21.15.137:0/416398056 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcdc06a410 con 0x7fbcdc161900 2024-04-26T23:42:02.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.137+0000 7fbcd6000640 1 -- 172.21.15.137:0/416398056 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbcd801d070 con 0x7fbcdc161900 2024-04-26T23:42:02.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.137+0000 7fbcd6000640 1 --2- 172.21.15.137:0/416398056 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbcc0068380 0x7fbcc006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.137+0000 7fbcd6000640 1 -- 172.21.15.137:0/416398056 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbcd8086fd0 con 0x7fbcdc161900 2024-04-26T23:42:02.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.137+0000 7fbce1e00640 1 --2- 172.21.15.137:0/416398056 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbcc0068380 0x7fbcc006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.137+0000 7fbce1e00640 1 --2- 172.21.15.137:0/416398056 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbcc0068380 0x7fbcc006a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc152de0 tx=0x7fbcd0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:02.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.141+0000 7fbcd6000640 1 -- 172.21.15.137:0/416398056 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbcd8057580 con 0x7fbcdc161900 2024-04-26T23:42:02.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.297+0000 7fbce4800640 1 -- 172.21.15.137:0/416398056 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbcdc0b4290 con 0x7fbcdc161900 2024-04-26T23:42:02.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.297+0000 7fbcd6000640 1 -- 172.21.15.137:0/416398056 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fbcd8056e80 con 0x7fbcdc161900 2024-04-26T23:42:02.301 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:42:02.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.297+0000 7fbce4800640 1 -- 172.21.15.137:0/416398056 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbcc0068380 msgr2=0x7fbcc006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:02.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.297+0000 7fbce4800640 1 --2- 172.21.15.137:0/416398056 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbcc0068380 0x7fbcc006a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc152de0 tx=0x7fbcd0009040 comp rx=0 tx=0).stop 2024-04-26T23:42:02.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.297+0000 7fbce4800640 1 -- 172.21.15.137:0/416398056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcdc161900 msgr2=0x7fbcdc161db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:02.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.297+0000 7fbce4800640 1 --2- 172.21.15.137:0/416398056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcdc161900 0x7fbcdc161db0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc0b7430 tx=0x7fbcd8010590 comp rx=0 tx=0).stop 2024-04-26T23:42:02.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.297+0000 7fbce4800640 1 -- 172.21.15.137:0/416398056 shutdown_connections 2024-04-26T23:42:02.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.297+0000 7fbce4800640 1 --2- 172.21.15.137:0/416398056 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbcc0068380 0x7fbcc006a840 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.297+0000 7fbce4800640 1 --2- 172.21.15.137:0/416398056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcdc161900 0x7fbcdc161db0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.297+0000 7fbce4800640 1 --2- 172.21.15.137:0/416398056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcdc154ed0 0x7fbcdc152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.297+0000 7fbce4800640 1 --2- 172.21.15.137:0/416398056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcc4004810 0x7fbcdc163cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.297+0000 7fbce4800640 1 -- 172.21.15.137:0/416398056 >> 172.21.15.137:0/416398056 conn(0x7fbcdc0b6710 msgr2=0x7fbcdc06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:02.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.301+0000 7fbce4800640 1 -- 172.21.15.137:0/416398056 shutdown_connections 2024-04-26T23:42:02.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.301+0000 7fbce4800640 1 -- 172.21.15.137:0/416398056 wait complete. 2024-04-26T23:42:02.322 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:42:02.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.457+0000 7f64ef600640 1 Processor -- start 2024-04-26T23:42:02.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.457+0000 7f64ef600640 1 -- start start 2024-04-26T23:42:02.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.457+0000 7f64ef600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f64e80afbc0 0x7f64e815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.457+0000 7f64ef600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f64e80affa0 0x7f64e80ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.457+0000 7f64ef600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64e8072860 con 0x7f64e8073f20 2024-04-26T23:42:02.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.457+0000 7f64ef600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f64e80743b0 con 0x7f64e80afbc0 2024-04-26T23:42:02.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.457+0000 7f64ef600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f64e8072b00 con 0x7f64e80affa0 2024-04-26T23:42:02.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.457+0000 7f64ecc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f64e80afbc0 0x7f64e815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.457+0000 7f64ecc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f64e80afbc0 0x7f64e815df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38202/0 (socket says 172.21.15.137:38202) 2024-04-26T23:42:02.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.457+0000 7f64ecc00640 1 -- 172.21.15.137:0/1549957220 learned_addr learned my addr 172.21.15.137:0/1549957220 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:02.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.457+0000 7f64ed600640 1 --2- 172.21.15.137:0/1549957220 >> v2:172.21.15.170:3300/0 conn(0x7f64e80affa0 0x7f64e80ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.457+0000 7f64ecc00640 1 -- 172.21.15.137:0/1549957220 >> v2:172.21.15.170:3300/0 conn(0x7f64e80affa0 msgr2=0x7f64e80ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:02.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.457+0000 7f64ecc00640 1 --2- 172.21.15.137:0/1549957220 >> v2:172.21.15.170:3300/0 conn(0x7f64e80affa0 0x7f64e80ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.457+0000 7f64ecc00640 1 -- 172.21.15.137:0/1549957220 >> v1:172.21.15.137:6789/0 conn(0x7f64e8073f20 legacy=0x7f64e80735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:02.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.457+0000 7f64ecc00640 1 -- 172.21.15.137:0/1549957220 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e8072de0 con 0x7f64e80afbc0 2024-04-26T23:42:02.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.461+0000 7f64ecc00640 1 --2- 172.21.15.137:0/1549957220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64e80afbc0 0x7f64e815df90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009870 tx=0x7f64dc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd9b1495aa9b452 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:02.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.461+0000 7f64e7400640 1 -- 172.21.15.137:0/1549957220 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc0b0070 con 0x7f64e80afbc0 2024-04-26T23:42:02.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.461+0000 7f64e7400640 1 -- 172.21.15.137:0/1549957220 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64dc0ab600 con 0x7f64e80afbc0 2024-04-26T23:42:02.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.461+0000 7f64e7400640 1 -- 172.21.15.137:0/1549957220 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc0ab9d0 con 0x7f64e80afbc0 2024-04-26T23:42:02.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.461+0000 7f64ef600640 1 -- 172.21.15.137:0/1549957220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64e80afbc0 msgr2=0x7f64e815df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:02.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.461+0000 7f64ef600640 1 --2- 172.21.15.137:0/1549957220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64e80afbc0 0x7f64e815df90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009870 tx=0x7f64dc01c520 comp rx=0 tx=0).stop 2024-04-26T23:42:02.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.461+0000 7f64ef600640 1 -- 172.21.15.137:0/1549957220 shutdown_connections 2024-04-26T23:42:02.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.461+0000 7f64ef600640 1 --2- 172.21.15.137:0/1549957220 >> v2:172.21.15.170:3300/0 conn(0x7f64e80affa0 0x7f64e80ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.461+0000 7f64ef600640 1 --2- 172.21.15.137:0/1549957220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64e80afbc0 0x7f64e815df90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.461+0000 7f64ef600640 1 -- 172.21.15.137:0/1549957220 >> 172.21.15.137:0/1549957220 conn(0x7f64e806c800 msgr2=0x7f64e806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:02.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.461+0000 7f64ef600640 1 -- 172.21.15.137:0/1549957220 shutdown_connections 2024-04-26T23:42:02.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.461+0000 7f64ef600640 1 -- 172.21.15.137:0/1549957220 wait complete. 2024-04-26T23:42:02.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64ef600640 1 Processor -- start 2024-04-26T23:42:02.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64ef600640 1 -- start start 2024-04-26T23:42:02.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64ef600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64e80afbc0 0x7f64e80b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64ef600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64e80affa0 0x7f64e8158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64ef600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64e815b6e0 0x7f64e80ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64ef600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f64e806f360 con 0x7f64e815b6e0 2024-04-26T23:42:02.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64ef600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f64e806f1e0 con 0x7f64e80afbc0 2024-04-26T23:42:02.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64ef600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f64e806f4e0 con 0x7f64e80affa0 2024-04-26T23:42:02.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64ed600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64e815b6e0 0x7f64e80ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64ed600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64e815b6e0 0x7f64e80ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38208/0 (socket says 172.21.15.137:38208) 2024-04-26T23:42:02.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64ed600640 1 -- 172.21.15.137:0/108587032 learned_addr learned my addr 172.21.15.137:0/108587032 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:02.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64ecc00640 1 --2- 172.21.15.137:0/108587032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64e80afbc0 0x7f64e80b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64e7e00640 1 --2- 172.21.15.137:0/108587032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64e80affa0 0x7f64e8158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64ed600640 1 -- 172.21.15.137:0/108587032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64e80affa0 msgr2=0x7f64e8158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:02.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64ed600640 1 --2- 172.21.15.137:0/108587032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64e80affa0 0x7f64e8158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64ed600640 1 -- 172.21.15.137:0/108587032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64e80afbc0 msgr2=0x7f64e80b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:02.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64ed600640 1 --2- 172.21.15.137:0/108587032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64e80afbc0 0x7f64e80b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64ed600640 1 -- 172.21.15.137:0/108587032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e8159190 con 0x7f64e815b6e0 2024-04-26T23:42:02.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64ed600640 1 --2- 172.21.15.137:0/108587032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64e815b6e0 0x7f64e80ae8d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f64e0007d80 tx=0x7f64e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:02.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64e4c00640 1 -- 172.21.15.137:0/108587032 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e0014420 con 0x7f64e815b6e0 2024-04-26T23:42:02.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64e4c00640 1 -- 172.21.15.137:0/108587032 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e0019070 con 0x7f64e815b6e0 2024-04-26T23:42:02.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64ef600640 1 -- 172.21.15.137:0/108587032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e815c580 con 0x7f64e815b6e0 2024-04-26T23:42:02.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64e4c00640 1 -- 172.21.15.137:0/108587032 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e0014800 con 0x7f64e815b6e0 2024-04-26T23:42:02.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64ef600640 1 -- 172.21.15.137:0/108587032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e815c2a0 con 0x7f64e815b6e0 2024-04-26T23:42:02.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.465+0000 7f64ef600640 1 -- 172.21.15.137:0/108587032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64e806a410 con 0x7f64e815b6e0 2024-04-26T23:42:02.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.469+0000 7f64e4c00640 1 -- 172.21.15.137:0/108587032 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f64e00149a0 con 0x7f64e815b6e0 2024-04-26T23:42:02.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.469+0000 7f64e4c00640 1 --2- 172.21.15.137:0/108587032 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f64c80683b0 0x7f64c806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.469+0000 7f64e4c00640 1 -- 172.21.15.137:0/108587032 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f64e00871b0 con 0x7f64e815b6e0 2024-04-26T23:42:02.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.469+0000 7f64ecc00640 1 --2- 172.21.15.137:0/108587032 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f64c80683b0 0x7f64c806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.469+0000 7f64ecc00640 1 --2- 172.21.15.137:0/108587032 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f64c80683b0 0x7f64c806a870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0ad000 tx=0x7f64dc0a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:02.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.473+0000 7f64e4c00640 1 -- 172.21.15.137:0/108587032 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f64e8159190 con 0x7f64e815b6e0 2024-04-26T23:42:02.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.629+0000 7f64ef600640 1 -- 172.21.15.137:0/108587032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f64e8070040 con 0x7f64e815b6e0 2024-04-26T23:42:02.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.629+0000 7f64e4c00640 1 -- 172.21.15.137:0/108587032 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f64e0057760 con 0x7f64e815b6e0 2024-04-26T23:42:02.635 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:42:02.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.633+0000 7f64ef600640 1 -- 172.21.15.137:0/108587032 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f64c80683b0 msgr2=0x7f64c806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:02.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.633+0000 7f64ef600640 1 --2- 172.21.15.137:0/108587032 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f64c80683b0 0x7f64c806a870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0ad000 tx=0x7f64dc0a6000 comp rx=0 tx=0).stop 2024-04-26T23:42:02.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.633+0000 7f64ef600640 1 -- 172.21.15.137:0/108587032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64e815b6e0 msgr2=0x7f64e80ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:02.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.633+0000 7f64ef600640 1 --2- 172.21.15.137:0/108587032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64e815b6e0 0x7f64e80ae8d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f64e0007d80 tx=0x7f64e000e4b0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.633+0000 7f64ef600640 1 -- 172.21.15.137:0/108587032 shutdown_connections 2024-04-26T23:42:02.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.633+0000 7f64ef600640 1 --2- 172.21.15.137:0/108587032 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f64c80683b0 0x7f64c806a870 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.633+0000 7f64ef600640 1 --2- 172.21.15.137:0/108587032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64e815b6e0 0x7f64e80ae8d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.633+0000 7f64ef600640 1 --2- 172.21.15.137:0/108587032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64e80affa0 0x7f64e8158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.633+0000 7f64ef600640 1 --2- 172.21.15.137:0/108587032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64e80afbc0 0x7f64e80b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.633+0000 7f64ef600640 1 -- 172.21.15.137:0/108587032 >> 172.21.15.137:0/108587032 conn(0x7f64e806c800 msgr2=0x7f64e806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:02.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.633+0000 7f64ef600640 1 -- 172.21.15.137:0/108587032 shutdown_connections 2024-04-26T23:42:02.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.633+0000 7f64ef600640 1 -- 172.21.15.137:0/108587032 wait complete. 2024-04-26T23:42:02.655 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:42:02.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.789+0000 7eff8b800640 1 Processor -- start 2024-04-26T23:42:02.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.789+0000 7eff8b800640 1 -- start start 2024-04-26T23:42:02.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff8b800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff84148a10 0x7eff840b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff8b800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff840b5c70 con 0x7eff840b5810 2024-04-26T23:42:02.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff8b800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff84073290 con 0x7eff840afc40 2024-04-26T23:42:02.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff8b800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7eff840b00b0 con 0x7eff84148a10 2024-04-26T23:42:02.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff7be00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7eff840b5810 0x7eff840af530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52604/0 (socket says 172.21.15.137:52604) 2024-04-26T23:42:02.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff7be00640 1 -- 172.21.15.137:0/1155492743 learned_addr learned my addr 172.21.15.137:0/1155492743 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:02.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff83e00640 1 -- 172.21.15.137:0/1155492743 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1023076618 0 0) 0x7eff840b5c70 con 0x7eff840b5810 2024-04-26T23:42:02.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff83e00640 1 -- 172.21.15.137:0/1155492743 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff68003530 con 0x7eff840b5810 2024-04-26T23:42:02.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff88e00640 1 --2- 172.21.15.137:0/1155492743 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff84148a10 0x7eff840b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff83e00640 1 -- 172.21.15.137:0/1155492743 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 39066467 0 0) 0x7eff68003530 con 0x7eff840b5810 2024-04-26T23:42:02.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff83e00640 1 -- 172.21.15.137:0/1155492743 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff84148a10 msgr2=0x7eff840b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:02.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff83e00640 1 --2- 172.21.15.137:0/1155492743 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff84148a10 0x7eff840b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff83e00640 1 -- 172.21.15.137:0/1155492743 >> v1:172.21.15.170:6789/0 conn(0x7eff840afc40 legacy=0x7eff8406e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:02.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff83e00640 1 -- 172.21.15.137:0/1155492743 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff84073570 con 0x7eff840b5810 2024-04-26T23:42:02.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff83e00640 1 -- 172.21.15.137:0/1155492743 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7eff6c001680 con 0x7eff840b5810 2024-04-26T23:42:02.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff83e00640 1 -- 172.21.15.137:0/1155492743 >> v1:172.21.15.137:6789/0 conn(0x7eff840b5810 legacy=0x7eff840af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:02.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff83e00640 1 --2- 172.21.15.137:0/1155492743 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff680039f0 0x7eff68003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff83e00640 1 --2- 172.21.15.137:0/1155492743 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff84148a10 0x7eff68004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff83e00640 1 --2- 172.21.15.137:0/1155492743 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff68004d50 0x7eff680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff83e00640 1 -- 172.21.15.137:0/1155492743 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7eff840b00b0 con 0x7eff680039f0 2024-04-26T23:42:02.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff83e00640 1 -- 172.21.15.137:0/1155492743 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7eff6800ba80 con 0x7eff68004d50 2024-04-26T23:42:02.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff83e00640 1 -- 172.21.15.137:0/1155492743 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7eff6800bc80 con 0x7eff84148a10 2024-04-26T23:42:02.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff88e00640 1 --2- 172.21.15.137:0/1155492743 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff680039f0 0x7eff68003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff7be00640 1 --2- 172.21.15.137:0/1155492743 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff84148a10 0x7eff68004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff89800640 1 --2- 172.21.15.137:0/1155492743 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff68004d50 0x7eff680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff88e00640 1 -- 172.21.15.137:0/1155492743 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff84148a10 msgr2=0x7eff68004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:02.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff88e00640 1 --2- 172.21.15.137:0/1155492743 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff84148a10 0x7eff68004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff88e00640 1 -- 172.21.15.137:0/1155492743 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff68004d50 msgr2=0x7eff680051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:02.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff88e00640 1 --2- 172.21.15.137:0/1155492743 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff68004d50 0x7eff680051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff88e00640 1 -- 172.21.15.137:0/1155492743 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff68003530 con 0x7eff680039f0 2024-04-26T23:42:02.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.793+0000 7eff7be00640 1 --2- 172.21.15.137:0/1155492743 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff84148a10 0x7eff68004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:02.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.797+0000 7eff88e00640 1 --2- 172.21.15.137:0/1155492743 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff680039f0 0x7eff68003e10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7eff74009ab0 tx=0x7eff7401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bff52e81f3d0a35 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:02.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.797+0000 7eff83e00640 1 -- 172.21.15.137:0/1155492743 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff740096b0 con 0x7eff680039f0 2024-04-26T23:42:02.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.797+0000 7eff83e00640 1 -- 172.21.15.137:0/1155492743 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff740a6430 con 0x7eff680039f0 2024-04-26T23:42:02.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.797+0000 7eff83e00640 1 -- 172.21.15.137:0/1155492743 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff740a6820 con 0x7eff680039f0 2024-04-26T23:42:02.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.797+0000 7eff8b800640 1 -- 172.21.15.137:0/1155492743 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff680039f0 msgr2=0x7eff68003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:02.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.797+0000 7eff8b800640 1 --2- 172.21.15.137:0/1155492743 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff680039f0 0x7eff68003e10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7eff74009ab0 tx=0x7eff7401ca50 comp rx=0 tx=0).stop 2024-04-26T23:42:02.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.797+0000 7eff89800640 1 -- 172.21.15.137:0/1155492743 reap_dead start 2024-04-26T23:42:02.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.797+0000 7eff8b800640 1 -- 172.21.15.137:0/1155492743 shutdown_connections 2024-04-26T23:42:02.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.797+0000 7eff8b800640 1 -- 172.21.15.137:0/1155492743 >> 172.21.15.137:0/1155492743 conn(0x7eff8406c800 msgr2=0x7eff8406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:02.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.797+0000 7eff8b800640 1 -- 172.21.15.137:0/1155492743 shutdown_connections 2024-04-26T23:42:02.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.797+0000 7eff8b800640 1 -- 172.21.15.137:0/1155492743 wait complete. 2024-04-26T23:42:02.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff8b800640 1 Processor -- start 2024-04-26T23:42:02.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff8b800640 1 -- start start 2024-04-26T23:42:02.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff8b800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff680039f0 0x7eff84147310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff8b800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff8413bb20 0x7eff840b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff8b800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff84144a00 0x7eff840b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff8b800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7eff84074330 con 0x7eff84144a00 2024-04-26T23:42:02.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff8b800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7eff8416ad30 con 0x7eff8413bb20 2024-04-26T23:42:02.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff8b800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7eff840b20c0 con 0x7eff680039f0 2024-04-26T23:42:02.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff89800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff84144a00 0x7eff840b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff88e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff680039f0 0x7eff84147310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff89800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff84144a00 0x7eff840b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38234/0 (socket says 172.21.15.137:38234) 2024-04-26T23:42:02.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff7be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff8413bb20 0x7eff840b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff89800640 1 -- 172.21.15.137:0/1841095900 learned_addr learned my addr 172.21.15.137:0/1841095900 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:02.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff89800640 1 -- 172.21.15.137:0/1841095900 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff680039f0 msgr2=0x7eff84147310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:02.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff89800640 1 --2- 172.21.15.137:0/1841095900 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff680039f0 0x7eff84147310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff89800640 1 -- 172.21.15.137:0/1841095900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff8413bb20 msgr2=0x7eff840b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:02.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff89800640 1 --2- 172.21.15.137:0/1841095900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff8413bb20 0x7eff840b2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff89800640 1 -- 172.21.15.137:0/1841095900 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff840b23a0 con 0x7eff84144a00 2024-04-26T23:42:02.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff88e00640 1 --2- 172.21.15.137:0/1841095900 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff680039f0 0x7eff84147310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:42:02.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff89800640 1 --2- 172.21.15.137:0/1841095900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff84144a00 0x7eff840b2fa0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7eff8406de80 tx=0x7eff7c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:02.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff81600640 1 -- 172.21.15.137:0/1841095900 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c003980 con 0x7eff84144a00 2024-04-26T23:42:02.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff81600640 1 -- 172.21.15.137:0/1841095900 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c018070 con 0x7eff84144a00 2024-04-26T23:42:02.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff81600640 1 -- 172.21.15.137:0/1841095900 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c003d60 con 0x7eff84144a00 2024-04-26T23:42:02.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff8b800640 1 -- 172.21.15.137:0/1841095900 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff840b2680 con 0x7eff84144a00 2024-04-26T23:42:02.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff8b800640 1 -- 172.21.15.137:0/1841095900 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff840ceda0 con 0x7eff84144a00 2024-04-26T23:42:02.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.801+0000 7eff8b800640 1 -- 172.21.15.137:0/1841095900 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff8406a410 con 0x7eff84144a00 2024-04-26T23:42:02.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.805+0000 7eff81600640 1 -- 172.21.15.137:0/1841095900 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7eff7c0050d0 con 0x7eff84144a00 2024-04-26T23:42:02.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.805+0000 7eff81600640 1 --2- 172.21.15.137:0/1841095900 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7eff60068380 0x7eff6006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:02.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.805+0000 7eff81600640 1 -- 172.21.15.137:0/1841095900 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7eff7c086500 con 0x7eff84144a00 2024-04-26T23:42:02.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.805+0000 7eff88e00640 1 --2- 172.21.15.137:0/1841095900 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7eff60068380 0x7eff6006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:02.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.805+0000 7eff88e00640 1 --2- 172.21.15.137:0/1841095900 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7eff60068380 0x7eff6006a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7eff740ad000 tx=0x7eff740b3040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:02.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.809+0000 7eff81600640 1 -- 172.21.15.137:0/1841095900 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7eff7c056460 con 0x7eff84144a00 2024-04-26T23:42:02.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.965+0000 7eff8b800640 1 -- 172.21.15.137:0/1841095900 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7eff840af860 con 0x7eff84144a00 2024-04-26T23:42:02.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.965+0000 7eff81600640 1 -- 172.21.15.137:0/1841095900 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7eff7c05a760 con 0x7eff84144a00 2024-04-26T23:42:02.969 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:42:02.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.969+0000 7eff8b800640 1 -- 172.21.15.137:0/1841095900 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7eff60068380 msgr2=0x7eff6006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:02.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.969+0000 7eff8b800640 1 --2- 172.21.15.137:0/1841095900 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7eff60068380 0x7eff6006a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7eff740ad000 tx=0x7eff740b3040 comp rx=0 tx=0).stop 2024-04-26T23:42:02.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.969+0000 7eff8b800640 1 -- 172.21.15.137:0/1841095900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff84144a00 msgr2=0x7eff840b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:02.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.969+0000 7eff8b800640 1 --2- 172.21.15.137:0/1841095900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff84144a00 0x7eff840b2fa0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7eff8406de80 tx=0x7eff7c00eb90 comp rx=0 tx=0).stop 2024-04-26T23:42:02.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.969+0000 7eff8b800640 1 -- 172.21.15.137:0/1841095900 shutdown_connections 2024-04-26T23:42:02.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.969+0000 7eff8b800640 1 --2- 172.21.15.137:0/1841095900 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7eff60068380 0x7eff6006a840 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.969+0000 7eff8b800640 1 --2- 172.21.15.137:0/1841095900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff84144a00 0x7eff840b2fa0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.969+0000 7eff8b800640 1 --2- 172.21.15.137:0/1841095900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff8413bb20 0x7eff840b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.969+0000 7eff8b800640 1 --2- 172.21.15.137:0/1841095900 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff680039f0 0x7eff84147310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:02.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.969+0000 7eff8b800640 1 -- 172.21.15.137:0/1841095900 >> 172.21.15.137:0/1841095900 conn(0x7eff8406c800 msgr2=0x7eff84142200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:02.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.969+0000 7eff8b800640 1 -- 172.21.15.137:0/1841095900 shutdown_connections 2024-04-26T23:42:02.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:02.969+0000 7eff8b800640 1 -- 172.21.15.137:0/1841095900 wait complete. 2024-04-26T23:42:02.990 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:42:03.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.121+0000 7f4547600640 1 Processor -- start 2024-04-26T23:42:03.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f4547600640 1 -- start start 2024-04-26T23:42:03.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f4547600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f45400b5c90 0x7f454015c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:03.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f4547600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45400b3e30 con 0x7f454006eff0 2024-04-26T23:42:03.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f4547600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45400b40a0 con 0x7f4540155c20 2024-04-26T23:42:03.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f4547600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f45400d0850 con 0x7f45400b5c90 2024-04-26T23:42:03.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f4544c00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f454006eff0 0x7f4540155510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52616/0 (socket says 172.21.15.137:52616) 2024-04-26T23:42:03.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f4544c00640 1 -- 172.21.15.137:0/2552110147 learned_addr learned my addr 172.21.15.137:0/2552110147 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:03.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f4545600640 1 --2- 172.21.15.137:0/2552110147 >> v2:172.21.15.170:3300/0 conn(0x7f45400b5c90 0x7f454015c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:03.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f453f400640 1 -- 172.21.15.137:0/2552110147 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3907105561 0 0) 0x7f45400b3e30 con 0x7f454006eff0 2024-04-26T23:42:03.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f453f400640 1 -- 172.21.15.137:0/2552110147 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4524003530 con 0x7f454006eff0 2024-04-26T23:42:03.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f453f400640 1 -- 172.21.15.137:0/2552110147 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4273526374 0 0) 0x7f4524003530 con 0x7f454006eff0 2024-04-26T23:42:03.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f453f400640 1 -- 172.21.15.137:0/2552110147 >> v2:172.21.15.170:3300/0 conn(0x7f45400b5c90 msgr2=0x7f454015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:03.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f453f400640 1 --2- 172.21.15.137:0/2552110147 >> v2:172.21.15.170:3300/0 conn(0x7f45400b5c90 0x7f454015c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:03.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f453f400640 1 -- 172.21.15.137:0/2552110147 >> v1:172.21.15.170:6789/0 conn(0x7f4540155c20 legacy=0x7f45400ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:03.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f453f400640 1 -- 172.21.15.137:0/2552110147 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45400b4380 con 0x7f454006eff0 2024-04-26T23:42:03.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f453f400640 1 -- 172.21.15.137:0/2552110147 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f4530001680 con 0x7f454006eff0 2024-04-26T23:42:03.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f453f400640 1 -- 172.21.15.137:0/2552110147 >> v1:172.21.15.137:6789/0 conn(0x7f454006eff0 legacy=0x7f4540155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:03.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f453f400640 1 --2- 172.21.15.137:0/2552110147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45240039c0 0x7f4524003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:03.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f453f400640 1 --2- 172.21.15.137:0/2552110147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4524004810 0x7f4524004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:03.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f453f400640 1 --2- 172.21.15.137:0/2552110147 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45240051d0 0x7f452400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:03.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f453f400640 1 -- 172.21.15.137:0/2552110147 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f452400c040 con 0x7f4524004810 2024-04-26T23:42:03.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f453f400640 1 -- 172.21.15.137:0/2552110147 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f452400c1f0 con 0x7f45240039c0 2024-04-26T23:42:03.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f453f400640 1 -- 172.21.15.137:0/2552110147 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f452400c3f0 con 0x7f45240051d0 2024-04-26T23:42:03.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f453fe00640 1 --2- 172.21.15.137:0/2552110147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4524004810 0x7f4524004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:03.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f4544c00640 1 --2- 172.21.15.137:0/2552110147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45240039c0 0x7f4524003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:03.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f4545600640 1 --2- 172.21.15.137:0/2552110147 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45240051d0 0x7f452400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:03.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f453fe00640 1 -- 172.21.15.137:0/2552110147 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45240051d0 msgr2=0x7f452400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:03.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f453fe00640 1 --2- 172.21.15.137:0/2552110147 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45240051d0 0x7f452400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:03.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f453fe00640 1 -- 172.21.15.137:0/2552110147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45240039c0 msgr2=0x7f4524003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:03.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f453fe00640 1 --2- 172.21.15.137:0/2552110147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45240039c0 0x7f4524003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:03.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f453fe00640 1 -- 172.21.15.137:0/2552110147 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4524003530 con 0x7f4524004810 2024-04-26T23:42:03.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.125+0000 7f4545600640 1 -- 172.21.15.137:0/2552110147 reap_dead start 2024-04-26T23:42:03.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.129+0000 7f453fe00640 1 --2- 172.21.15.137:0/2552110147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4524004810 0x7f4524004c90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4528001750 tx=0x7f452801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37df426065814e01 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:03.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.129+0000 7f453f400640 1 -- 172.21.15.137:0/2552110147 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45280013a0 con 0x7f4524004810 2024-04-26T23:42:03.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.129+0000 7f453f400640 1 -- 172.21.15.137:0/2552110147 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45280052f0 con 0x7f4524004810 2024-04-26T23:42:03.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.129+0000 7f453f400640 1 -- 172.21.15.137:0/2552110147 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45280a4e60 con 0x7f4524004810 2024-04-26T23:42:03.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.129+0000 7f4547600640 1 -- 172.21.15.137:0/2552110147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4524004810 msgr2=0x7f4524004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:03.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.129+0000 7f4547600640 1 --2- 172.21.15.137:0/2552110147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4524004810 0x7f4524004c90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4528001750 tx=0x7f452801c3a0 comp rx=0 tx=0).stop 2024-04-26T23:42:03.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.129+0000 7f4547600640 1 -- 172.21.15.137:0/2552110147 shutdown_connections 2024-04-26T23:42:03.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.129+0000 7f4547600640 1 --2- 172.21.15.137:0/2552110147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4524004810 0x7f4524004c90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:03.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.129+0000 7f4547600640 1 -- 172.21.15.137:0/2552110147 >> 172.21.15.137:0/2552110147 conn(0x7f454006c5d0 msgr2=0x7f454006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:03.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.129+0000 7f4547600640 1 -- 172.21.15.137:0/2552110147 shutdown_connections 2024-04-26T23:42:03.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.129+0000 7f4547600640 1 -- 172.21.15.137:0/2552110147 wait complete. 2024-04-26T23:42:03.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f4547600640 1 Processor -- start 2024-04-26T23:42:03.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f4547600640 1 -- start start 2024-04-26T23:42:03.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f4547600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4524004810 0x7f45400cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:03.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f4547600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45401f0280 0x7f45401f0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:03.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f4547600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f454014d020 0x7f454014d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:03.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f4547600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f45400b61e0 con 0x7f45401f0280 2024-04-26T23:42:03.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f4547600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f45400b46c0 con 0x7f4524004810 2024-04-26T23:42:03.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f4547600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f454006f3d0 con 0x7f454014d020 2024-04-26T23:42:03.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f453fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45401f0280 0x7f45401f0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:03.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f453fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45401f0280 0x7f45401f0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38252/0 (socket says 172.21.15.137:38252) 2024-04-26T23:42:03.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f453fe00640 1 -- 172.21.15.137:0/789236067 learned_addr learned my addr 172.21.15.137:0/789236067 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:03.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f4544c00640 1 --2- 172.21.15.137:0/789236067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4524004810 0x7f45400cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:03.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f4545600640 1 --2- 172.21.15.137:0/789236067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f454014d020 0x7f454014d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:03.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f453fe00640 1 -- 172.21.15.137:0/789236067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f454014d020 msgr2=0x7f454014d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:03.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f453fe00640 1 --2- 172.21.15.137:0/789236067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f454014d020 0x7f454014d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:03.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f453fe00640 1 -- 172.21.15.137:0/789236067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4524004810 msgr2=0x7f45400cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:03.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f453fe00640 1 --2- 172.21.15.137:0/789236067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4524004810 0x7f45400cfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:03.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f453fe00640 1 -- 172.21.15.137:0/789236067 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454014dd90 con 0x7f45401f0280 2024-04-26T23:42:03.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f4544c00640 1 --2- 172.21.15.137:0/789236067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4524004810 0x7f45400cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:03.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f453fe00640 1 --2- 172.21.15.137:0/789236067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45401f0280 0x7f45401f0700 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f452801c1d0 tx=0x7f4524005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:03.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f453cc00640 1 -- 172.21.15.137:0/789236067 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45280013a0 con 0x7f45401f0280 2024-04-26T23:42:03.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f453cc00640 1 -- 172.21.15.137:0/789236067 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45280054a0 con 0x7f45401f0280 2024-04-26T23:42:03.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f4547600640 1 -- 172.21.15.137:0/789236067 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f454014e070 con 0x7f45401f0280 2024-04-26T23:42:03.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f453cc00640 1 -- 172.21.15.137:0/789236067 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528007a40 con 0x7f45401f0280 2024-04-26T23:42:03.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f4547600640 1 -- 172.21.15.137:0/789236067 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f454014e630 con 0x7f45401f0280 2024-04-26T23:42:03.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.133+0000 7f4547600640 1 -- 172.21.15.137:0/789236067 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f454006a4b0 con 0x7f45401f0280 2024-04-26T23:42:03.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.137+0000 7f453cc00640 1 -- 172.21.15.137:0/789236067 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f45280bd020 con 0x7f45401f0280 2024-04-26T23:42:03.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.137+0000 7f453cc00640 1 --2- 172.21.15.137:0/789236067 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f451c068380 0x7f451c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:03.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.137+0000 7f453cc00640 1 -- 172.21.15.137:0/789236067 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4528120340 con 0x7f45401f0280 2024-04-26T23:42:03.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.137+0000 7f4544c00640 1 --2- 172.21.15.137:0/789236067 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f451c068380 0x7f451c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:03.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.137+0000 7f4544c00640 1 --2- 172.21.15.137:0/789236067 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f451c068380 0x7f451c06a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4530001060 tx=0x7f4530009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:03.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.141+0000 7f453cc00640 1 -- 172.21.15.137:0/789236067 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f45280160b0 con 0x7f45401f0280 2024-04-26T23:42:03.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.313+0000 7f4547600640 1 -- 172.21.15.137:0/789236067 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f454015b2a0 con 0x7f45401f0280 2024-04-26T23:42:03.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.313+0000 7f453cc00640 1 -- 172.21.15.137:0/789236067 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f45280f08a0 con 0x7f45401f0280 2024-04-26T23:42:03.316 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T23:42:03.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.313+0000 7f4547600640 1 -- 172.21.15.137:0/789236067 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f451c068380 msgr2=0x7f451c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:03.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.313+0000 7f4547600640 1 --2- 172.21.15.137:0/789236067 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f451c068380 0x7f451c06a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4530001060 tx=0x7f4530009040 comp rx=0 tx=0).stop 2024-04-26T23:42:03.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.313+0000 7f4547600640 1 -- 172.21.15.137:0/789236067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45401f0280 msgr2=0x7f45401f0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:03.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.313+0000 7f4547600640 1 --2- 172.21.15.137:0/789236067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45401f0280 0x7f45401f0700 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f452801c1d0 tx=0x7f4524005840 comp rx=0 tx=0).stop 2024-04-26T23:42:03.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.313+0000 7f4547600640 1 -- 172.21.15.137:0/789236067 shutdown_connections 2024-04-26T23:42:03.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.313+0000 7f4547600640 1 --2- 172.21.15.137:0/789236067 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f451c068380 0x7f451c06a840 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:03.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.313+0000 7f4547600640 1 --2- 172.21.15.137:0/789236067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45401f0280 0x7f45401f0700 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:03.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.313+0000 7f4547600640 1 --2- 172.21.15.137:0/789236067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f454014d020 0x7f454014d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:03.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.313+0000 7f4547600640 1 --2- 172.21.15.137:0/789236067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4524004810 0x7f45400cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:03.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.313+0000 7f4547600640 1 -- 172.21.15.137:0/789236067 >> 172.21.15.137:0/789236067 conn(0x7f454006c5d0 msgr2=0x7f4540152070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:03.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.313+0000 7f4547600640 1 -- 172.21.15.137:0/789236067 shutdown_connections 2024-04-26T23:42:03.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.313+0000 7f4547600640 1 -- 172.21.15.137:0/789236067 wait complete. 2024-04-26T23:42:03.338 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi170.front.sepia.ceph.com... 2024-04-26T23:42:03.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:03.338 DEBUG:teuthology.orchestra.run.smithi170:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-04-26T23:42:03.376 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:42:03.376 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T23:42:03.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:03.376 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-26T23:42:03.436 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:42:03.436 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:42:03.444 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:42:03.444 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:42:03.498 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:42:03.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.673+0000 7fc7a7e00640 1 Processor -- start 2024-04-26T23:42:03.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.673+0000 7fc7a7e00640 1 -- start start 2024-04-26T23:42:03.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.673+0000 7fc7a7e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc7a8072c30 0x7fc7a80b3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:03.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.673+0000 7fc7a7e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc7a8073010 0x7fc7a8073440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:03.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.673+0000 7fc7a7e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a806e630 con 0x7fc7a8072560 2024-04-26T23:42:03.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.673+0000 7fc7a7e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc7a80b4bc0 con 0x7fc7a8073010 2024-04-26T23:42:03.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.673+0000 7fc7a7e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc7a80cd620 con 0x7fc7a8072c30 2024-04-26T23:42:03.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.673+0000 7fc7a7400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc7a8073010 0x7fc7a8073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:03.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.673+0000 7fc7a7400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc7a8073010 0x7fc7a8073440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38268/0 (socket says 172.21.15.137:38268) 2024-04-26T23:42:03.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.673+0000 7fc7a7400640 1 -- 172.21.15.137:0/2462937843 learned_addr learned my addr 172.21.15.137:0/2462937843 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:03.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.673+0000 7fc7a6a00640 1 --2- 172.21.15.137:0/2462937843 >> v2:172.21.15.170:3300/0 conn(0x7fc7a8072c30 0x7fc7a80b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:03.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.673+0000 7fc7a7400640 1 -- 172.21.15.137:0/2462937843 >> v2:172.21.15.170:3300/0 conn(0x7fc7a8072c30 msgr2=0x7fc7a80b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:03.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.673+0000 7fc7a7400640 1 --2- 172.21.15.137:0/2462937843 >> v2:172.21.15.170:3300/0 conn(0x7fc7a8072c30 0x7fc7a80b3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:03.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.673+0000 7fc7a7400640 1 -- 172.21.15.137:0/2462937843 >> v1:172.21.15.170:6789/0 conn(0x7fc7a8072560 legacy=0x7fc7a80cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:03.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.673+0000 7fc7a7400640 1 -- 172.21.15.137:0/2462937843 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a806e350 con 0x7fc7a8073010 2024-04-26T23:42:03.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.677+0000 7fc7a7400640 1 --2- 172.21.15.137:0/2462937843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a8073010 0x7fc7a8073440 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8070050 tx=0x7fc7a001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1919d3ea78e89caf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:03.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.677+0000 7fc7a6000640 1 -- 172.21.15.137:0/2462937843 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a00a56d0 con 0x7fc7a8073010 2024-04-26T23:42:03.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.677+0000 7fc7a6000640 1 -- 172.21.15.137:0/2462937843 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a00a5870 con 0x7fc7a8073010 2024-04-26T23:42:03.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.677+0000 7fc7a6000640 1 -- 172.21.15.137:0/2462937843 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a00a5c40 con 0x7fc7a8073010 2024-04-26T23:42:03.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.677+0000 7fc7a7e00640 1 -- 172.21.15.137:0/2462937843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a8073010 msgr2=0x7fc7a8073440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:03.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.677+0000 7fc7a7e00640 1 --2- 172.21.15.137:0/2462937843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a8073010 0x7fc7a8073440 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8070050 tx=0x7fc7a001c920 comp rx=0 tx=0).stop 2024-04-26T23:42:03.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.677+0000 7fc7a7e00640 1 -- 172.21.15.137:0/2462937843 shutdown_connections 2024-04-26T23:42:03.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.677+0000 7fc7a7e00640 1 --2- 172.21.15.137:0/2462937843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a8073010 0x7fc7a8073440 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:03.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.677+0000 7fc7a7e00640 1 --2- 172.21.15.137:0/2462937843 >> v2:172.21.15.170:3300/0 conn(0x7fc7a8072c30 0x7fc7a80b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:03.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.677+0000 7fc7a7e00640 1 -- 172.21.15.137:0/2462937843 >> 172.21.15.137:0/2462937843 conn(0x7fc7a80b2730 msgr2=0x7fc7a80b2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:03.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.677+0000 7fc7a7e00640 1 -- 172.21.15.137:0/2462937843 shutdown_connections 2024-04-26T23:42:03.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.677+0000 7fc7a7e00640 1 -- 172.21.15.137:0/2462937843 wait complete. 2024-04-26T23:42:03.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc7a7e00640 1 Processor -- start 2024-04-26T23:42:03.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc7a7e00640 1 -- start start 2024-04-26T23:42:03.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc7a7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7a8072560 0x7fc7a8151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:03.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc7a7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a8072c30 0x7fc7a8141300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:03.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc7a7e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7a8073010 0x7fc7a815b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:03.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc7a7e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a80b59c0 con 0x7fc7a8072c30 2024-04-26T23:42:03.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc7a7e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a80b5840 con 0x7fc7a8072560 2024-04-26T23:42:03.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc7a7e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a80b5b40 con 0x7fc7a8073010 2024-04-26T23:42:03.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc79e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a8072c30 0x7fc7a8141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:03.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc7a6a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7a8072560 0x7fc7a8151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:03.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc79e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a8072c30 0x7fc7a8141300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38280/0 (socket says 172.21.15.137:38280) 2024-04-26T23:42:03.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc79e000640 1 -- 172.21.15.137:0/2971975365 learned_addr learned my addr 172.21.15.137:0/2971975365 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:03.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc7a7400640 1 --2- 172.21.15.137:0/2971975365 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7a8073010 0x7fc7a815b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:03.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc79e000640 1 -- 172.21.15.137:0/2971975365 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7a8073010 msgr2=0x7fc7a815b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:03.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc79e000640 1 --2- 172.21.15.137:0/2971975365 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7a8073010 0x7fc7a815b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:03.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc79e000640 1 -- 172.21.15.137:0/2971975365 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7a8072560 msgr2=0x7fc7a8151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:03.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc79e000640 1 --2- 172.21.15.137:0/2971975365 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7a8072560 0x7fc7a8151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:03.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc79e000640 1 -- 172.21.15.137:0/2971975365 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a8151eb0 con 0x7fc7a8072c30 2024-04-26T23:42:03.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc79e000640 1 --2- 172.21.15.137:0/2971975365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a8072c30 0x7fc7a8141300 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc79000b410 tx=0x7fc79000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:03.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc79f400640 1 -- 172.21.15.137:0/2971975365 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc790015030 con 0x7fc7a8072c30 2024-04-26T23:42:03.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc79f400640 1 -- 172.21.15.137:0/2971975365 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc790004020 con 0x7fc7a8072c30 2024-04-26T23:42:03.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc79f400640 1 -- 172.21.15.137:0/2971975365 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc790004450 con 0x7fc7a8072c30 2024-04-26T23:42:03.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc7a7e00640 1 -- 172.21.15.137:0/2971975365 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a81521a0 con 0x7fc7a8072c30 2024-04-26T23:42:03.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.681+0000 7fc7a7e00640 1 -- 172.21.15.137:0/2971975365 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a81529e0 con 0x7fc7a8072c30 2024-04-26T23:42:03.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.685+0000 7fc7a7e00640 1 -- 172.21.15.137:0/2971975365 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7a806a410 con 0x7fc7a8072c30 2024-04-26T23:42:03.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.685+0000 7fc79f400640 1 -- 172.21.15.137:0/2971975365 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc790018070 con 0x7fc7a8072c30 2024-04-26T23:42:03.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.685+0000 7fc79f400640 1 --2- 172.21.15.137:0/2971975365 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc784068380 0x7fc78406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:03.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.685+0000 7fc79f400640 1 -- 172.21.15.137:0/2971975365 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc790086410 con 0x7fc7a8072c30 2024-04-26T23:42:03.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.685+0000 7fc7a6a00640 1 --2- 172.21.15.137:0/2971975365 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc784068380 0x7fc78406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:03.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.685+0000 7fc7a6a00640 1 --2- 172.21.15.137:0/2971975365 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc784068380 0x7fc78406a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc7980079c0 tx=0x7fc798008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:03.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.689+0000 7fc79f400640 1 -- 172.21.15.137:0/2971975365 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc7a81521a0 con 0x7fc7a8072c30 2024-04-26T23:42:03.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.852+0000 7fc7a7e00640 1 -- 172.21.15.137:0/2971975365 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7a80735a0 con 0x7fc7a8072c30 2024-04-26T23:42:03.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.852+0000 7fc79f400640 1 -- 172.21.15.137:0/2971975365 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16902 (secure 0 0 0) 0x7fc7900562e0 con 0x7fc7a8072c30 2024-04-26T23:42:03.858 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:03.858 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":21,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:42:03.745674+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:42:03.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.856+0000 7fc7a7e00640 1 -- 172.21.15.137:0/2971975365 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc784068380 msgr2=0x7fc78406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:03.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.856+0000 7fc7a7e00640 1 --2- 172.21.15.137:0/2971975365 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc784068380 0x7fc78406a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc7980079c0 tx=0x7fc798008040 comp rx=0 tx=0).stop 2024-04-26T23:42:03.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.856+0000 7fc7a7e00640 1 -- 172.21.15.137:0/2971975365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a8072c30 msgr2=0x7fc7a8141300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:03.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.856+0000 7fc7a7e00640 1 --2- 172.21.15.137:0/2971975365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a8072c30 0x7fc7a8141300 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc79000b410 tx=0x7fc79000b8d0 comp rx=0 tx=0).stop 2024-04-26T23:42:03.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.856+0000 7fc7a7e00640 1 -- 172.21.15.137:0/2971975365 shutdown_connections 2024-04-26T23:42:03.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.856+0000 7fc7a7e00640 1 --2- 172.21.15.137:0/2971975365 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc784068380 0x7fc78406a840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:03.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.856+0000 7fc7a7e00640 1 --2- 172.21.15.137:0/2971975365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a8072c30 0x7fc7a8141300 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:03.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.856+0000 7fc7a7e00640 1 --2- 172.21.15.137:0/2971975365 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7a8073010 0x7fc7a815b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:03.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.856+0000 7fc7a7e00640 1 --2- 172.21.15.137:0/2971975365 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7a8072560 0x7fc7a8151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:03.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.856+0000 7fc7a7e00640 1 -- 172.21.15.137:0/2971975365 >> 172.21.15.137:0/2971975365 conn(0x7fc7a80b2730 msgr2=0x7fc7a80ccc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:03.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.856+0000 7fc7a7e00640 1 -- 172.21.15.137:0/2971975365 shutdown_connections 2024-04-26T23:42:03.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:03.856+0000 7fc7a7e00640 1 -- 172.21.15.137:0/2971975365 wait complete. 2024-04-26T23:42:03.879 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:41:21.810449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:41:22.533452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:42:03.880 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:42:04.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.012+0000 7f2767e00640 1 Processor -- start 2024-04-26T23:42:04.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.012+0000 7f2767e00640 1 -- start start 2024-04-26T23:42:04.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.016+0000 7f2767e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f27600afbc0 0x7f276015df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:04.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.016+0000 7f2767e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2760073f20 0x7f27600735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:04.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.016+0000 7f2767e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2760073b20 con 0x7f27600affa0 2024-04-26T23:42:04.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.016+0000 7f2767e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f2760072860 con 0x7f27600afbc0 2024-04-26T23:42:04.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.016+0000 7f2767e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f27600743b0 con 0x7f2760073f20 2024-04-26T23:42:04.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.016+0000 7f2765400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f27600afbc0 0x7f276015df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:04.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.016+0000 7f2764a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2760073f20 0x7f27600735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:04.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.016+0000 7f2765400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f27600afbc0 0x7f276015df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:40482/0 (socket says 172.21.15.137:40482) 2024-04-26T23:42:04.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.016+0000 7f2765400640 1 -- 172.21.15.137:0/1156410713 learned_addr learned my addr 172.21.15.137:0/1156410713 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:04.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.016+0000 7f2765400640 1 -- 172.21.15.137:0/1156410713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2760073f20 msgr2=0x7f27600735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:04.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.016+0000 7f2765400640 1 --2- 172.21.15.137:0/1156410713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2760073f20 0x7f27600735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.016+0000 7f2765400640 1 -- 172.21.15.137:0/1156410713 >> v1:172.21.15.170:6789/0 conn(0x7f27600affa0 legacy=0x7f27600ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:04.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.016+0000 7f2765400640 1 -- 172.21.15.137:0/1156410713 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2760072b00 con 0x7f27600afbc0 2024-04-26T23:42:04.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.016+0000 7f2764a00640 1 --2- 172.21.15.137:0/1156410713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2760073f20 0x7f27600735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:42:04.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.020+0000 7f2765400640 1 --2- 172.21.15.137:0/1156410713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27600afbc0 0x7f276015df90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2754009e80 tx=0x7f275401ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3241f876c9376e40 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:04.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.020+0000 7f275fe00640 1 -- 172.21.15.137:0/1156410713 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27540a57d0 con 0x7f27600afbc0 2024-04-26T23:42:04.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.020+0000 7f275fe00640 1 -- 172.21.15.137:0/1156410713 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27540a5970 con 0x7f27600afbc0 2024-04-26T23:42:04.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.020+0000 7f275fe00640 1 -- 172.21.15.137:0/1156410713 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27540a5d40 con 0x7f27600afbc0 2024-04-26T23:42:04.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.020+0000 7f2767e00640 1 -- 172.21.15.137:0/1156410713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27600afbc0 msgr2=0x7f276015df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:04.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.020+0000 7f2767e00640 1 --2- 172.21.15.137:0/1156410713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27600afbc0 0x7f276015df90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2754009e80 tx=0x7f275401ca10 comp rx=0 tx=0).stop 2024-04-26T23:42:04.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.020+0000 7f2767e00640 1 -- 172.21.15.137:0/1156410713 shutdown_connections 2024-04-26T23:42:04.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.020+0000 7f2767e00640 1 --2- 172.21.15.137:0/1156410713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2760073f20 0x7f27600735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.020+0000 7f2767e00640 1 --2- 172.21.15.137:0/1156410713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27600afbc0 0x7f276015df90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.020+0000 7f2767e00640 1 -- 172.21.15.137:0/1156410713 >> 172.21.15.137:0/1156410713 conn(0x7f276006c800 msgr2=0x7f276006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:04.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.020+0000 7f2767e00640 1 -- 172.21.15.137:0/1156410713 shutdown_connections 2024-04-26T23:42:04.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.020+0000 7f2767e00640 1 -- 172.21.15.137:0/1156410713 wait complete. 2024-04-26T23:42:04.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.020+0000 7f2767e00640 1 Processor -- start 2024-04-26T23:42:04.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.020+0000 7f2767e00640 1 -- start start 2024-04-26T23:42:04.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f2767e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27600afbc0 0x7f27601551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:04.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f2767e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27600affa0 0x7f27600b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:04.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f2767e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f276014b4f0 0x7f27600b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:04.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f2767e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f27600cec40 con 0x7f27600affa0 2024-04-26T23:42:04.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f2767e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f27600ceac0 con 0x7f27600afbc0 2024-04-26T23:42:04.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f2767e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f276006efd0 con 0x7f276014b4f0 2024-04-26T23:42:04.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f2764a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27600affa0 0x7f27600b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:04.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f2764a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27600affa0 0x7f27600b5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38292/0 (socket says 172.21.15.137:38292) 2024-04-26T23:42:04.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f2764a00640 1 -- 172.21.15.137:0/1830775273 learned_addr learned my addr 172.21.15.137:0/1830775273 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:04.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f2765400640 1 --2- 172.21.15.137:0/1830775273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27600afbc0 0x7f27601551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:04.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f2765e00640 1 --2- 172.21.15.137:0/1830775273 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f276014b4f0 0x7f27600b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:04.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f2764a00640 1 -- 172.21.15.137:0/1830775273 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f276014b4f0 msgr2=0x7f27600b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:04.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f2764a00640 1 --2- 172.21.15.137:0/1830775273 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f276014b4f0 0x7f27600b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f2764a00640 1 -- 172.21.15.137:0/1830775273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27600afbc0 msgr2=0x7f27601551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:04.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f2764a00640 1 --2- 172.21.15.137:0/1830775273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27600afbc0 0x7f27601551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f2764a00640 1 -- 172.21.15.137:0/1830775273 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27601559f0 con 0x7f27600affa0 2024-04-26T23:42:04.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f2765e00640 1 --2- 172.21.15.137:0/1830775273 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f276014b4f0 0x7f27600b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:04.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f2764a00640 1 --2- 172.21.15.137:0/1830775273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27600affa0 0x7f27600b5180 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f274c00ebe0 tx=0x7f274c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:04.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f275d600640 1 -- 172.21.15.137:0/1830775273 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c017070 con 0x7f27600affa0 2024-04-26T23:42:04.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f2767e00640 1 -- 172.21.15.137:0/1830775273 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27601fb460 con 0x7f27600affa0 2024-04-26T23:42:04.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f275d600640 1 -- 172.21.15.137:0/1830775273 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f274c00cc30 con 0x7f27600affa0 2024-04-26T23:42:04.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f275d600640 1 -- 172.21.15.137:0/1830775273 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c013470 con 0x7f27600affa0 2024-04-26T23:42:04.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f2767e00640 1 -- 172.21.15.137:0/1830775273 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27601fba20 con 0x7f27600affa0 2024-04-26T23:42:04.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f2767e00640 1 -- 172.21.15.137:0/1830775273 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f276006a410 con 0x7f27600affa0 2024-04-26T23:42:04.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.024+0000 7f275d600640 1 -- 172.21.15.137:0/1830775273 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f274c01a070 con 0x7f27600affa0 2024-04-26T23:42:04.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.028+0000 7f275d600640 1 --2- 172.21.15.137:0/1830775273 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f27400683b0 0x7f274006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:04.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.028+0000 7f275d600640 1 -- 172.21.15.137:0/1830775273 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7f274c086de0 con 0x7f27600affa0 2024-04-26T23:42:04.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.028+0000 7f2765400640 1 --2- 172.21.15.137:0/1830775273 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f27400683b0 0x7f274006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:04.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.028+0000 7f2765400640 1 --2- 172.21.15.137:0/1830775273 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f27400683b0 0x7f274006a870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f27540ae000 tx=0x7f27540a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:04.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.032+0000 7f275d600640 1 -- 172.21.15.137:0/1830775273 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f274c057290 con 0x7f27600affa0 2024-04-26T23:42:04.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.192+0000 7f2767e00640 1 -- 172.21.15.137:0/1830775273 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2760160870 con 0x7f27600affa0 2024-04-26T23:42:04.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.192+0000 7f275d600640 1 -- 172.21.15.137:0/1830775273 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f274c056b90 con 0x7f27600affa0 2024-04-26T23:42:04.196 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:42:04.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.192+0000 7f2767e00640 1 -- 172.21.15.137:0/1830775273 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f27400683b0 msgr2=0x7f274006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:04.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.192+0000 7f2767e00640 1 --2- 172.21.15.137:0/1830775273 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f27400683b0 0x7f274006a870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f27540ae000 tx=0x7f27540a7070 comp rx=0 tx=0).stop 2024-04-26T23:42:04.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.192+0000 7f2767e00640 1 -- 172.21.15.137:0/1830775273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27600affa0 msgr2=0x7f27600b5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:04.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.192+0000 7f2767e00640 1 --2- 172.21.15.137:0/1830775273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27600affa0 0x7f27600b5180 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f274c00ebe0 tx=0x7f274c00c520 comp rx=0 tx=0).stop 2024-04-26T23:42:04.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.192+0000 7f2767e00640 1 -- 172.21.15.137:0/1830775273 shutdown_connections 2024-04-26T23:42:04.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.192+0000 7f2767e00640 1 --2- 172.21.15.137:0/1830775273 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f27400683b0 0x7f274006a870 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.192+0000 7f2767e00640 1 --2- 172.21.15.137:0/1830775273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27600affa0 0x7f27600b5180 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.192+0000 7f2767e00640 1 --2- 172.21.15.137:0/1830775273 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f276014b4f0 0x7f27600b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.192+0000 7f2767e00640 1 --2- 172.21.15.137:0/1830775273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27600afbc0 0x7f27601551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.192+0000 7f2767e00640 1 -- 172.21.15.137:0/1830775273 >> 172.21.15.137:0/1830775273 conn(0x7f276006c800 msgr2=0x7f2760152160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:04.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.192+0000 7f2767e00640 1 -- 172.21.15.137:0/1830775273 shutdown_connections 2024-04-26T23:42:04.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.192+0000 7f2767e00640 1 -- 172.21.15.137:0/1830775273 wait complete. 2024-04-26T23:42:04.218 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:42:04.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.352+0000 7f6c90000640 1 Processor -- start 2024-04-26T23:42:04.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.352+0000 7f6c90000640 1 -- start start 2024-04-26T23:42:04.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.352+0000 7f6c90000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6c880b54e0 0x7f6c880b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:04.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.352+0000 7f6c90000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c880cffa0 con 0x7f6c880cd710 2024-04-26T23:42:04.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.352+0000 7f6c90000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c880d0280 con 0x7f6c88160000 2024-04-26T23:42:04.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.352+0000 7f6c90000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f6c880b3d90 con 0x7f6c880b54e0 2024-04-26T23:42:04.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.352+0000 7f6c8cc00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f6c880cd710 0x7f6c8815f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52624/0 (socket says 172.21.15.137:52624) 2024-04-26T23:42:04.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.352+0000 7f6c8cc00640 1 -- 172.21.15.137:0/2189485523 learned_addr learned my addr 172.21.15.137:0/2189485523 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:04.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.352+0000 7f6c8d600640 1 --2- 172.21.15.137:0/2189485523 >> v2:172.21.15.170:3300/0 conn(0x7f6c880b54e0 0x7f6c880b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:04.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.352+0000 7f6c87e00640 1 -- 172.21.15.137:0/2189485523 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2920210338 0 0) 0x7f6c880cffa0 con 0x7f6c880cd710 2024-04-26T23:42:04.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.352+0000 7f6c87e00640 1 -- 172.21.15.137:0/2189485523 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c70003530 con 0x7f6c880cd710 2024-04-26T23:42:04.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.356+0000 7f6c8d600640 1 -- 172.21.15.137:0/2189485523 >> v1:172.21.15.170:6789/0 conn(0x7f6c88160000 legacy=0x7f6c88144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:04.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.356+0000 7f6c8d600640 1 -- 172.21.15.137:0/2189485523 >> v1:172.21.15.137:6789/0 conn(0x7f6c880cd710 legacy=0x7f6c8815f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:04.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.356+0000 7f6c8d600640 1 -- 172.21.15.137:0/2189485523 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c880d0560 con 0x7f6c880b54e0 2024-04-26T23:42:04.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.356+0000 7f6c8d600640 1 --2- 172.21.15.137:0/2189485523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c880b54e0 0x7f6c880b5ee0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0097f0 tx=0x7f6c7c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2afedcc558a590fe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:04.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.356+0000 7f6c87e00640 1 -- 172.21.15.137:0/2189485523 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c0b0070 con 0x7f6c880b54e0 2024-04-26T23:42:04.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.356+0000 7f6c87e00640 1 -- 172.21.15.137:0/2189485523 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c7c0ab600 con 0x7f6c880b54e0 2024-04-26T23:42:04.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.356+0000 7f6c87e00640 1 -- 172.21.15.137:0/2189485523 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c0ab9d0 con 0x7f6c880b54e0 2024-04-26T23:42:04.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.356+0000 7f6c90000640 1 -- 172.21.15.137:0/2189485523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c880b54e0 msgr2=0x7f6c880b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:04.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.356+0000 7f6c90000640 1 --2- 172.21.15.137:0/2189485523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c880b54e0 0x7f6c880b5ee0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0097f0 tx=0x7f6c7c01c4a0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.356+0000 7f6c90000640 1 -- 172.21.15.137:0/2189485523 shutdown_connections 2024-04-26T23:42:04.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.356+0000 7f6c90000640 1 --2- 172.21.15.137:0/2189485523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c880b54e0 0x7f6c880b5ee0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.356+0000 7f6c90000640 1 -- 172.21.15.137:0/2189485523 >> 172.21.15.137:0/2189485523 conn(0x7f6c8806c800 msgr2=0x7f6c8806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:04.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c90000640 1 -- 172.21.15.137:0/2189485523 shutdown_connections 2024-04-26T23:42:04.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c90000640 1 -- 172.21.15.137:0/2189485523 wait complete. 2024-04-26T23:42:04.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c90000640 1 Processor -- start 2024-04-26T23:42:04.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c90000640 1 -- start start 2024-04-26T23:42:04.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c90000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c880b54e0 0x7f6c881390f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:04.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c90000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c880cd710 0x7f6c8813cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:04.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c90000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c88160000 0x7f6c8813d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:04.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c90000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6c88073640 con 0x7f6c88160000 2024-04-26T23:42:04.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c90000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6c880734c0 con 0x7f6c880cd710 2024-04-26T23:42:04.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c90000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6c88145840 con 0x7f6c880b54e0 2024-04-26T23:42:04.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c8e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c88160000 0x7f6c8813d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:04.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c8e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c88160000 0x7f6c8813d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38296/0 (socket says 172.21.15.137:38296) 2024-04-26T23:42:04.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c8e000640 1 -- 172.21.15.137:0/1532650497 learned_addr learned my addr 172.21.15.137:0/1532650497 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:04.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c8cc00640 1 --2- 172.21.15.137:0/1532650497 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c880cd710 0x7f6c8813cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:04.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c8d600640 1 --2- 172.21.15.137:0/1532650497 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c880b54e0 0x7f6c881390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:04.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c8e000640 1 -- 172.21.15.137:0/1532650497 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c880b54e0 msgr2=0x7f6c881390f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:04.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c8e000640 1 --2- 172.21.15.137:0/1532650497 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c880b54e0 0x7f6c881390f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c8e000640 1 -- 172.21.15.137:0/1532650497 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c880cd710 msgr2=0x7f6c8813cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:04.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c8e000640 1 --2- 172.21.15.137:0/1532650497 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c880cd710 0x7f6c8813cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c8e000640 1 -- 172.21.15.137:0/1532650497 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8813d7f0 con 0x7f6c88160000 2024-04-26T23:42:04.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c8cc00640 1 --2- 172.21.15.137:0/1532650497 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c880cd710 0x7f6c8813cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:04.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c8d600640 1 --2- 172.21.15.137:0/1532650497 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c880b54e0 0x7f6c881390f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:04.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c8e000640 1 --2- 172.21.15.137:0/1532650497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c88160000 0x7f6c8813d1c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000c760 tx=0x7f6c8000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:04.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c85600640 1 -- 172.21.15.137:0/1532650497 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c80003b80 con 0x7f6c88160000 2024-04-26T23:42:04.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c85600640 1 -- 172.21.15.137:0/1532650497 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c80003d20 con 0x7f6c88160000 2024-04-26T23:42:04.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c85600640 1 -- 172.21.15.137:0/1532650497 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8000aa30 con 0x7f6c88160000 2024-04-26T23:42:04.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.360+0000 7f6c90000640 1 -- 172.21.15.137:0/1532650497 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c8813dad0 con 0x7f6c88160000 2024-04-26T23:42:04.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.364+0000 7f6c90000640 1 -- 172.21.15.137:0/1532650497 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c880b2280 con 0x7f6c88160000 2024-04-26T23:42:04.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.364+0000 7f6c90000640 1 -- 172.21.15.137:0/1532650497 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c8806a410 con 0x7f6c88160000 2024-04-26T23:42:04.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.364+0000 7f6c85600640 1 -- 172.21.15.137:0/1532650497 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6c8000abd0 con 0x7f6c88160000 2024-04-26T23:42:04.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.364+0000 7f6c85600640 1 --2- 172.21.15.137:0/1532650497 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6c68068380 0x7f6c6806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:04.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.364+0000 7f6c85600640 1 -- 172.21.15.137:0/1532650497 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7f6c80086940 con 0x7f6c88160000 2024-04-26T23:42:04.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.364+0000 7f6c8d600640 1 --2- 172.21.15.137:0/1532650497 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6c68068380 0x7f6c6806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:04.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.364+0000 7f6c8d600640 1 --2- 172.21.15.137:0/1532650497 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6c68068380 0x7f6c6806a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0ad000 tx=0x7f6c7c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:04.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.368+0000 7f6c85600640 1 -- 172.21.15.137:0/1532650497 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6c80056df0 con 0x7f6c88160000 2024-04-26T23:42:04.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.524+0000 7f6c90000640 1 -- 172.21.15.137:0/1532650497 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6c880b2450 con 0x7f6c88160000 2024-04-26T23:42:04.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.524+0000 7f6c85600640 1 -- 172.21.15.137:0/1532650497 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f6c800566f0 con 0x7f6c88160000 2024-04-26T23:42:04.530 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:42:04.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.528+0000 7f6c90000640 1 -- 172.21.15.137:0/1532650497 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6c68068380 msgr2=0x7f6c6806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:04.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.528+0000 7f6c90000640 1 --2- 172.21.15.137:0/1532650497 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6c68068380 0x7f6c6806a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0ad000 tx=0x7f6c7c008040 comp rx=0 tx=0).stop 2024-04-26T23:42:04.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.528+0000 7f6c90000640 1 -- 172.21.15.137:0/1532650497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c88160000 msgr2=0x7f6c8813d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:04.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.528+0000 7f6c90000640 1 --2- 172.21.15.137:0/1532650497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c88160000 0x7f6c8813d1c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000c760 tx=0x7f6c8000cc20 comp rx=0 tx=0).stop 2024-04-26T23:42:04.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.528+0000 7f6c90000640 1 -- 172.21.15.137:0/1532650497 shutdown_connections 2024-04-26T23:42:04.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.528+0000 7f6c90000640 1 --2- 172.21.15.137:0/1532650497 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6c68068380 0x7f6c6806a840 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.528+0000 7f6c90000640 1 --2- 172.21.15.137:0/1532650497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c88160000 0x7f6c8813d1c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.528+0000 7f6c90000640 1 --2- 172.21.15.137:0/1532650497 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c880cd710 0x7f6c8813cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.528+0000 7f6c90000640 1 --2- 172.21.15.137:0/1532650497 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c880b54e0 0x7f6c881390f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.528+0000 7f6c90000640 1 -- 172.21.15.137:0/1532650497 >> 172.21.15.137:0/1532650497 conn(0x7f6c8806c800 msgr2=0x7f6c88144c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:04.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.528+0000 7f6c90000640 1 -- 172.21.15.137:0/1532650497 shutdown_connections 2024-04-26T23:42:04.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.528+0000 7f6c90000640 1 -- 172.21.15.137:0/1532650497 wait complete. 2024-04-26T23:42:04.551 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:42:04.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.684+0000 7f1b6e600640 1 Processor -- start 2024-04-26T23:42:04.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.684+0000 7f1b6e600640 1 -- start start 2024-04-26T23:42:04.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.684+0000 7f1b6e600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b68148a10 0x7f1b680b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:04.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.684+0000 7f1b6e600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1b680afc40 0x7f1b6806e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:04.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.684+0000 7f1b6e600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b680b5c70 con 0x7f1b680b5810 2024-04-26T23:42:04.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.684+0000 7f1b6e600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1b680b00b0 con 0x7f1b680afc40 2024-04-26T23:42:04.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.684+0000 7f1b6e600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1b68073290 con 0x7f1b68148a10 2024-04-26T23:42:04.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.684+0000 7f1b5ea00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f1b680b5810 0x7f1b680af530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52634/0 (socket says 172.21.15.137:52634) 2024-04-26T23:42:04.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.684+0000 7f1b5ea00640 1 -- 172.21.15.137:0/1026245858 learned_addr learned my addr 172.21.15.137:0/1026245858 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:04.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.688+0000 7f1b67e00640 1 --2- 172.21.15.137:0/1026245858 >> v2:172.21.15.137:3300/0 conn(0x7f1b680afc40 0x7f1b6806e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:04.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.688+0000 7f1b67400640 1 --2- 172.21.15.137:0/1026245858 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b68148a10 0x7f1b680b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:04.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.688+0000 7f1b66a00640 1 -- 172.21.15.137:0/1026245858 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 735664106 0 0) 0x7f1b680b5c70 con 0x7f1b680b5810 2024-04-26T23:42:04.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.688+0000 7f1b66a00640 1 -- 172.21.15.137:0/1026245858 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b4c003530 con 0x7f1b680b5810 2024-04-26T23:42:04.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.688+0000 7f1b67e00640 1 -- 172.21.15.137:0/1026245858 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b68148a10 msgr2=0x7f1b680b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:04.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.688+0000 7f1b67e00640 1 --2- 172.21.15.137:0/1026245858 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b68148a10 0x7f1b680b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.688+0000 7f1b67e00640 1 -- 172.21.15.137:0/1026245858 >> v1:172.21.15.137:6789/0 conn(0x7f1b680b5810 legacy=0x7f1b680af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:04.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.688+0000 7f1b67e00640 1 -- 172.21.15.137:0/1026245858 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b68073570 con 0x7f1b680afc40 2024-04-26T23:42:04.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.688+0000 7f1b67e00640 1 --2- 172.21.15.137:0/1026245858 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b680afc40 0x7f1b6806e6d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1b600097c0 tx=0x7f1b6001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f205569d30e12ac5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:04.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.688+0000 7f1b66a00640 1 -- 172.21.15.137:0/1026245858 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b600b2070 con 0x7f1b680afc40 2024-04-26T23:42:04.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.688+0000 7f1b66a00640 1 -- 172.21.15.137:0/1026245858 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b600ad640 con 0x7f1b680afc40 2024-04-26T23:42:04.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.688+0000 7f1b66a00640 1 -- 172.21.15.137:0/1026245858 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b600ada10 con 0x7f1b680afc40 2024-04-26T23:42:04.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b6e600640 1 -- 172.21.15.137:0/1026245858 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b680afc40 msgr2=0x7f1b6806e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:04.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b6e600640 1 --2- 172.21.15.137:0/1026245858 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b680afc40 0x7f1b6806e6d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1b600097c0 tx=0x7f1b6001c4a0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b6e600640 1 -- 172.21.15.137:0/1026245858 shutdown_connections 2024-04-26T23:42:04.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b6e600640 1 --2- 172.21.15.137:0/1026245858 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b680afc40 0x7f1b6806e6d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b6e600640 1 --2- 172.21.15.137:0/1026245858 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b68148a10 0x7f1b680b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b6e600640 1 -- 172.21.15.137:0/1026245858 >> 172.21.15.137:0/1026245858 conn(0x7f1b6806c800 msgr2=0x7f1b6806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:04.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b6e600640 1 -- 172.21.15.137:0/1026245858 shutdown_connections 2024-04-26T23:42:04.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b6e600640 1 -- 172.21.15.137:0/1026245858 wait complete. 2024-04-26T23:42:04.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b6e600640 1 Processor -- start 2024-04-26T23:42:04.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b6e600640 1 -- start start 2024-04-26T23:42:04.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b6e600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b680afc40 0x7f1b6813b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:04.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b6e600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b680b5810 0x7f1b6813e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:04.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b6e600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b68148a10 0x7f1b68141ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:04.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b6e600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1b68074330 con 0x7f1b680afc40 2024-04-26T23:42:04.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b6e600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6806f420 con 0x7f1b680b5810 2024-04-26T23:42:04.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b6e600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1b681416f0 con 0x7f1b68148a10 2024-04-26T23:42:04.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b67400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b680afc40 0x7f1b6813b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:04.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b67400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b680afc40 0x7f1b6813b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38322/0 (socket says 172.21.15.137:38322) 2024-04-26T23:42:04.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b67400640 1 -- 172.21.15.137:0/3975697649 learned_addr learned my addr 172.21.15.137:0/3975697649 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:04.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b5ea00640 1 --2- 172.21.15.137:0/3975697649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b680b5810 0x7f1b6813e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:04.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b67e00640 1 --2- 172.21.15.137:0/3975697649 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b68148a10 0x7f1b68141ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:04.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b67400640 1 -- 172.21.15.137:0/3975697649 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b68148a10 msgr2=0x7f1b68141ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:04.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b67400640 1 --2- 172.21.15.137:0/3975697649 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b68148a10 0x7f1b68141ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b67400640 1 -- 172.21.15.137:0/3975697649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b680b5810 msgr2=0x7f1b6813e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:04.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b67400640 1 --2- 172.21.15.137:0/3975697649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b680b5810 0x7f1b6813e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b67400640 1 -- 172.21.15.137:0/3975697649 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b6815dba0 con 0x7f1b680afc40 2024-04-26T23:42:04.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.692+0000 7f1b67400640 1 --2- 172.21.15.137:0/3975697649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b680afc40 0x7f1b6813b4d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800efc0 tx=0x7f1b5800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:04.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.696+0000 7f1b5fe00640 1 -- 172.21.15.137:0/3975697649 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58018020 con 0x7f1b680afc40 2024-04-26T23:42:04.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.696+0000 7f1b5fe00640 1 -- 172.21.15.137:0/3975697649 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b58014480 con 0x7f1b680afc40 2024-04-26T23:42:04.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.696+0000 7f1b5fe00640 1 -- 172.21.15.137:0/3975697649 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58014850 con 0x7f1b680afc40 2024-04-26T23:42:04.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.696+0000 7f1b6e600640 1 -- 172.21.15.137:0/3975697649 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b6815de80 con 0x7f1b680afc40 2024-04-26T23:42:04.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.696+0000 7f1b6e600640 1 -- 172.21.15.137:0/3975697649 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b6815e440 con 0x7f1b680afc40 2024-04-26T23:42:04.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.696+0000 7f1b6e600640 1 -- 172.21.15.137:0/3975697649 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b6806a410 con 0x7f1b680afc40 2024-04-26T23:42:04.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.696+0000 7f1b5fe00640 1 -- 172.21.15.137:0/3975697649 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1b5801b020 con 0x7f1b680afc40 2024-04-26T23:42:04.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.696+0000 7f1b5fe00640 1 --2- 172.21.15.137:0/3975697649 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1b44068380 0x7f1b4406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:04.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.696+0000 7f1b5fe00640 1 -- 172.21.15.137:0/3975697649 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7f1b580874d0 con 0x7f1b680afc40 2024-04-26T23:42:04.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.696+0000 7f1b5ea00640 1 --2- 172.21.15.137:0/3975697649 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1b44068380 0x7f1b4406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:04.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.696+0000 7f1b5ea00640 1 --2- 172.21.15.137:0/3975697649 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1b44068380 0x7f1b4406a840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1b680b2010 tx=0x7f1b50009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:04.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.700+0000 7f1b5fe00640 1 -- 172.21.15.137:0/3975697649 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1b58022070 con 0x7f1b680afc40 2024-04-26T23:42:04.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.864+0000 7f1b6e600640 1 -- 172.21.15.137:0/3975697649 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1b68147c20 con 0x7f1b680afc40 2024-04-26T23:42:04.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.864+0000 7f1b5fe00640 1 -- 172.21.15.137:0/3975697649 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f1b58010040 con 0x7f1b680afc40 2024-04-26T23:42:04.869 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:42:04.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.864+0000 7f1b6e600640 1 -- 172.21.15.137:0/3975697649 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1b44068380 msgr2=0x7f1b4406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:04.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.864+0000 7f1b6e600640 1 --2- 172.21.15.137:0/3975697649 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1b44068380 0x7f1b4406a840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1b680b2010 tx=0x7f1b50009040 comp rx=0 tx=0).stop 2024-04-26T23:42:04.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.864+0000 7f1b6e600640 1 -- 172.21.15.137:0/3975697649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b680afc40 msgr2=0x7f1b6813b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:04.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.864+0000 7f1b6e600640 1 --2- 172.21.15.137:0/3975697649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b680afc40 0x7f1b6813b4d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800efc0 tx=0x7f1b5800c490 comp rx=0 tx=0).stop 2024-04-26T23:42:04.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.864+0000 7f1b6e600640 1 -- 172.21.15.137:0/3975697649 shutdown_connections 2024-04-26T23:42:04.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.864+0000 7f1b6e600640 1 --2- 172.21.15.137:0/3975697649 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1b44068380 0x7f1b4406a840 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.864+0000 7f1b6e600640 1 --2- 172.21.15.137:0/3975697649 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b68148a10 0x7f1b68141ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.864+0000 7f1b6e600640 1 --2- 172.21.15.137:0/3975697649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b680b5810 0x7f1b6813e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.864+0000 7f1b6e600640 1 --2- 172.21.15.137:0/3975697649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b680afc40 0x7f1b6813b4d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:04.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.864+0000 7f1b6e600640 1 -- 172.21.15.137:0/3975697649 >> 172.21.15.137:0/3975697649 conn(0x7f1b6806c800 msgr2=0x7f1b6806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:04.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.864+0000 7f1b6e600640 1 -- 172.21.15.137:0/3975697649 shutdown_connections 2024-04-26T23:42:04.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:04.864+0000 7f1b6e600640 1 -- 172.21.15.137:0/3975697649 wait complete. 2024-04-26T23:42:04.891 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:42:05.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.024+0000 7fa90d600640 1 Processor -- start 2024-04-26T23:42:05.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.024+0000 7fa90d600640 1 -- start start 2024-04-26T23:42:05.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.024+0000 7fa90d600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa9080b5080 0x7fa9080cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:05.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.024+0000 7fa90d600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa908072980 0x7fa908072e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:05.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.024+0000 7fa90d600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9080cfef0 con 0x7fa9080725a0 2024-04-26T23:42:05.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.024+0000 7fa90d600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa9080cddc0 con 0x7fa9080b5080 2024-04-26T23:42:05.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.024+0000 7fa90d600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fa9080d01b0 con 0x7fa908072980 2024-04-26T23:42:05.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.024+0000 7fa906000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa9080b5080 0x7fa9080cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:05.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.024+0000 7fa906000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa9080b5080 0x7fa9080cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38334/0 (socket says 172.21.15.137:38334) 2024-04-26T23:42:05.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.024+0000 7fa906000640 1 -- 172.21.15.137:0/4046577753 learned_addr learned my addr 172.21.15.137:0/4046577753 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:05.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.024+0000 7fa907400640 1 --2- 172.21.15.137:0/4046577753 >> v2:172.21.15.170:3300/0 conn(0x7fa908072980 0x7fa908072e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:05.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.024+0000 7fa906000640 1 -- 172.21.15.137:0/4046577753 >> v2:172.21.15.170:3300/0 conn(0x7fa908072980 msgr2=0x7fa908072e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:05.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.024+0000 7fa906000640 1 --2- 172.21.15.137:0/4046577753 >> v2:172.21.15.170:3300/0 conn(0x7fa908072980 0x7fa908072e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.024+0000 7fa906000640 1 -- 172.21.15.137:0/4046577753 >> v1:172.21.15.170:6789/0 conn(0x7fa9080725a0 legacy=0x7fa908073f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:05.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.024+0000 7fa906000640 1 -- 172.21.15.137:0/4046577753 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9080d0490 con 0x7fa9080b5080 2024-04-26T23:42:05.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.028+0000 7fa906000640 1 --2- 172.21.15.137:0/4046577753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9080b5080 0x7fa9080cd770 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40098a0 tx=0x7fa8f401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d55fae7fa40a566 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:05.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.028+0000 7fa905600640 1 -- 172.21.15.137:0/4046577753 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f40aa5f0 con 0x7fa9080b5080 2024-04-26T23:42:05.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.028+0000 7fa905600640 1 -- 172.21.15.137:0/4046577753 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8f40af070 con 0x7fa9080b5080 2024-04-26T23:42:05.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.028+0000 7fa905600640 1 -- 172.21.15.137:0/4046577753 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f40aa9b0 con 0x7fa9080b5080 2024-04-26T23:42:05.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.028+0000 7fa90d600640 1 -- 172.21.15.137:0/4046577753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9080b5080 msgr2=0x7fa9080cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:05.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.028+0000 7fa90d600640 1 --2- 172.21.15.137:0/4046577753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9080b5080 0x7fa9080cd770 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40098a0 tx=0x7fa8f401c490 comp rx=0 tx=0).stop 2024-04-26T23:42:05.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.028+0000 7fa90d600640 1 -- 172.21.15.137:0/4046577753 shutdown_connections 2024-04-26T23:42:05.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.028+0000 7fa90d600640 1 --2- 172.21.15.137:0/4046577753 >> v2:172.21.15.170:3300/0 conn(0x7fa908072980 0x7fa908072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.028+0000 7fa90d600640 1 --2- 172.21.15.137:0/4046577753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9080b5080 0x7fa9080cd770 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.028+0000 7fa90d600640 1 -- 172.21.15.137:0/4046577753 >> 172.21.15.137:0/4046577753 conn(0x7fa90806c5d0 msgr2=0x7fa90806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:05.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.028+0000 7fa90d600640 1 -- 172.21.15.137:0/4046577753 shutdown_connections 2024-04-26T23:42:05.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.028+0000 7fa90d600640 1 -- 172.21.15.137:0/4046577753 wait complete. 2024-04-26T23:42:05.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.028+0000 7fa90d600640 1 Processor -- start 2024-04-26T23:42:05.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa90d600640 1 -- start start 2024-04-26T23:42:05.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa90d600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9080725a0 0x7fa9081599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:05.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa90d600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa908072980 0x7fa90815e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:05.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa90d600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9080b5080 0x7fa90815ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:05.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa90d600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa9081684e0 con 0x7fa9080725a0 2024-04-26T23:42:05.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa90d600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa908168360 con 0x7fa908072980 2024-04-26T23:42:05.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa90d600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa908168660 con 0x7fa9080b5080 2024-04-26T23:42:05.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa906a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9080725a0 0x7fa9081599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:05.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa906a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9080725a0 0x7fa9081599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38336/0 (socket says 172.21.15.137:38336) 2024-04-26T23:42:05.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa906a00640 1 -- 172.21.15.137:0/1617341725 learned_addr learned my addr 172.21.15.137:0/1617341725 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:05.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa906000640 1 --2- 172.21.15.137:0/1617341725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa908072980 0x7fa90815e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:05.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa907400640 1 --2- 172.21.15.137:0/1617341725 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9080b5080 0x7fa90815ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:05.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa906a00640 1 -- 172.21.15.137:0/1617341725 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9080b5080 msgr2=0x7fa90815ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:05.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa906a00640 1 --2- 172.21.15.137:0/1617341725 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9080b5080 0x7fa90815ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa906a00640 1 -- 172.21.15.137:0/1617341725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa908072980 msgr2=0x7fa90815e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:05.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa906a00640 1 --2- 172.21.15.137:0/1617341725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa908072980 0x7fa90815e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa906a00640 1 -- 172.21.15.137:0/1617341725 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa908159f30 con 0x7fa9080725a0 2024-04-26T23:42:05.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa907400640 1 --2- 172.21.15.137:0/1617341725 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9080b5080 0x7fa90815ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:05.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa906000640 1 --2- 172.21.15.137:0/1617341725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa908072980 0x7fa90815e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:05.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa906a00640 1 --2- 172.21.15.137:0/1617341725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9080725a0 0x7fa9081599f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa8f800b410 tx=0x7fa8f800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:05.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa8fea00640 1 -- 172.21.15.137:0/1617341725 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8015030 con 0x7fa9080725a0 2024-04-26T23:42:05.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa8fea00640 1 -- 172.21.15.137:0/1617341725 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8f8004020 con 0x7fa9080725a0 2024-04-26T23:42:05.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa8fea00640 1 -- 172.21.15.137:0/1617341725 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8004450 con 0x7fa9080725a0 2024-04-26T23:42:05.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa90d600640 1 -- 172.21.15.137:0/1617341725 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa90815d5b0 con 0x7fa9080725a0 2024-04-26T23:42:05.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa90d600640 1 -- 172.21.15.137:0/1617341725 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa90815db70 con 0x7fa9080725a0 2024-04-26T23:42:05.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.032+0000 7fa90d600640 1 -- 172.21.15.137:0/1617341725 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa90806a4b0 con 0x7fa9080725a0 2024-04-26T23:42:05.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.036+0000 7fa8fea00640 1 -- 172.21.15.137:0/1617341725 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa8f8018070 con 0x7fa9080725a0 2024-04-26T23:42:05.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.036+0000 7fa8fea00640 1 --2- 172.21.15.137:0/1617341725 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa8e8068380 0x7fa8e806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:05.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.036+0000 7fa8fea00640 1 -- 172.21.15.137:0/1617341725 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fa8f8086670 con 0x7fa9080725a0 2024-04-26T23:42:05.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.036+0000 7fa906000640 1 --2- 172.21.15.137:0/1617341725 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa8e8068380 0x7fa8e806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:05.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.036+0000 7fa906000640 1 --2- 172.21.15.137:0/1617341725 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa8e8068380 0x7fa8e806a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40ae000 tx=0x7fa8f40a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:05.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.040+0000 7fa8fea00640 1 -- 172.21.15.137:0/1617341725 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa908159f30 con 0x7fa9080725a0 2024-04-26T23:42:05.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.208+0000 7fa90d600640 1 -- 172.21.15.137:0/1617341725 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa908072380 con 0x7fa9080725a0 2024-04-26T23:42:05.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.208+0000 7fa8fea00640 1 -- 172.21.15.137:0/1617341725 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fa8f8056b10 con 0x7fa9080725a0 2024-04-26T23:42:05.212 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T23:42:05.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.208+0000 7fa90d600640 1 -- 172.21.15.137:0/1617341725 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa8e8068380 msgr2=0x7fa8e806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:05.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.208+0000 7fa90d600640 1 --2- 172.21.15.137:0/1617341725 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa8e8068380 0x7fa8e806a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40ae000 tx=0x7fa8f40a7000 comp rx=0 tx=0).stop 2024-04-26T23:42:05.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.208+0000 7fa90d600640 1 -- 172.21.15.137:0/1617341725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9080725a0 msgr2=0x7fa9081599f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:05.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.208+0000 7fa90d600640 1 --2- 172.21.15.137:0/1617341725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9080725a0 0x7fa9081599f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa8f800b410 tx=0x7fa8f800b8d0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.208+0000 7fa90d600640 1 -- 172.21.15.137:0/1617341725 shutdown_connections 2024-04-26T23:42:05.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.208+0000 7fa90d600640 1 --2- 172.21.15.137:0/1617341725 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa8e8068380 0x7fa8e806a840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.208+0000 7fa90d600640 1 --2- 172.21.15.137:0/1617341725 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9080b5080 0x7fa90815ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.208+0000 7fa90d600640 1 --2- 172.21.15.137:0/1617341725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa908072980 0x7fa90815e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.208+0000 7fa90d600640 1 --2- 172.21.15.137:0/1617341725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9080725a0 0x7fa9081599f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.208+0000 7fa90d600640 1 -- 172.21.15.137:0/1617341725 >> 172.21.15.137:0/1617341725 conn(0x7fa90806c5d0 msgr2=0x7fa90815b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:05.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.208+0000 7fa90d600640 1 -- 172.21.15.137:0/1617341725 shutdown_connections 2024-04-26T23:42:05.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.208+0000 7fa90d600640 1 -- 172.21.15.137:0/1617341725 wait complete. 2024-04-26T23:42:05.234 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:42:05.234 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:42:05.243 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:42:05.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.416+0000 7fa5cf000640 1 Processor -- start 2024-04-26T23:42:05.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.416+0000 7fa5cf000640 1 -- start start 2024-04-26T23:42:05.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.416+0000 7fa5cf000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa5c80b5080 0x7fa5c80cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:05.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.416+0000 7fa5cf000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c80cfef0 con 0x7fa5c8072980 2024-04-26T23:42:05.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.416+0000 7fa5cf000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c80cddc0 con 0x7fa5c80725a0 2024-04-26T23:42:05.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.416+0000 7fa5cf000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa5c80d01b0 con 0x7fa5c80b5080 2024-04-26T23:42:05.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.416+0000 7fa5cd000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa5c8072980 0x7fa5c8072e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52644/0 (socket says 172.21.15.137:52644) 2024-04-26T23:42:05.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.416+0000 7fa5cd000640 1 -- 172.21.15.137:0/409835905 learned_addr learned my addr 172.21.15.137:0/409835905 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:05.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.416+0000 7fa5bf400640 1 --2- 172.21.15.137:0/409835905 >> v2:172.21.15.137:3300/0 conn(0x7fa5c80b5080 0x7fa5c80cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:05.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.416+0000 7fa5bf400640 1 -- 172.21.15.137:0/409835905 >> v1:172.21.15.170:6789/0 conn(0x7fa5c80725a0 legacy=0x7fa5c8073f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:05.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.416+0000 7fa5bf400640 1 -- 172.21.15.137:0/409835905 >> v1:172.21.15.137:6789/0 conn(0x7fa5c8072980 legacy=0x7fa5c8072e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:05.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.416+0000 7fa5bf400640 1 -- 172.21.15.137:0/409835905 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c80d0490 con 0x7fa5c80b5080 2024-04-26T23:42:05.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.420+0000 7fa5bf400640 1 --2- 172.21.15.137:0/409835905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c80b5080 0x7fa5c80cd770 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa5b00097f0 tx=0x7fa5b001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1053b3a18d1de395 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:05.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.420+0000 7fa5c7400640 1 -- 172.21.15.137:0/409835905 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b00ab650 con 0x7fa5c80b5080 2024-04-26T23:42:05.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.420+0000 7fa5c7400640 1 -- 172.21.15.137:0/409835905 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b00b0070 con 0x7fa5c80b5080 2024-04-26T23:42:05.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.420+0000 7fa5c7400640 1 -- 172.21.15.137:0/409835905 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b00aba10 con 0x7fa5c80b5080 2024-04-26T23:42:05.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.420+0000 7fa5cf000640 1 -- 172.21.15.137:0/409835905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c80b5080 msgr2=0x7fa5c80cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:05.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.420+0000 7fa5cf000640 1 --2- 172.21.15.137:0/409835905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c80b5080 0x7fa5c80cd770 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa5b00097f0 tx=0x7fa5b001c430 comp rx=0 tx=0).stop 2024-04-26T23:42:05.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.420+0000 7fa5cf000640 1 -- 172.21.15.137:0/409835905 shutdown_connections 2024-04-26T23:42:05.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.420+0000 7fa5cf000640 1 --2- 172.21.15.137:0/409835905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c80b5080 0x7fa5c80cd770 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.420+0000 7fa5cf000640 1 -- 172.21.15.137:0/409835905 >> 172.21.15.137:0/409835905 conn(0x7fa5c806c5d0 msgr2=0x7fa5c806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:05.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.420+0000 7fa5cf000640 1 -- 172.21.15.137:0/409835905 shutdown_connections 2024-04-26T23:42:05.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.420+0000 7fa5cf000640 1 -- 172.21.15.137:0/409835905 wait complete. 2024-04-26T23:42:05.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5cf000640 1 Processor -- start 2024-04-26T23:42:05.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5cf000640 1 -- start start 2024-04-26T23:42:05.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5cf000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5c80725a0 0x7fa5c813c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:05.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5cf000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c8072980 0x7fa5c8138100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:05.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5cf000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5c80b5080 0x7fa5c8158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:05.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5cf000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c8169900 con 0x7fa5c8072980 2024-04-26T23:42:05.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5cf000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c8169780 con 0x7fa5c80725a0 2024-04-26T23:42:05.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5cf000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c8169a80 con 0x7fa5c80b5080 2024-04-26T23:42:05.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5bf400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c8072980 0x7fa5c8138100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:05.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5bf400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c8072980 0x7fa5c8138100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38356/0 (socket says 172.21.15.137:38356) 2024-04-26T23:42:05.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5bf400640 1 -- 172.21.15.137:0/1574018522 learned_addr learned my addr 172.21.15.137:0/1574018522 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:05.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5c7e00640 1 --2- 172.21.15.137:0/1574018522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5c80725a0 0x7fa5c813c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:05.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5cd000640 1 --2- 172.21.15.137:0/1574018522 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5c80b5080 0x7fa5c8158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:05.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5bf400640 1 -- 172.21.15.137:0/1574018522 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5c80b5080 msgr2=0x7fa5c8158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:05.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5bf400640 1 --2- 172.21.15.137:0/1574018522 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5c80b5080 0x7fa5c8158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5bf400640 1 -- 172.21.15.137:0/1574018522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5c80725a0 msgr2=0x7fa5c813c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:05.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5bf400640 1 --2- 172.21.15.137:0/1574018522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5c80725a0 0x7fa5c813c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5bf400640 1 -- 172.21.15.137:0/1574018522 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c8159a40 con 0x7fa5c8072980 2024-04-26T23:42:05.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5bf400640 1 --2- 172.21.15.137:0/1574018522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c8072980 0x7fa5c8138100 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0019040 tx=0x7fa5b001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:05.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5c4c00640 1 -- 172.21.15.137:0/1574018522 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b00b5810 con 0x7fa5c8072980 2024-04-26T23:42:05.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5c4c00640 1 -- 172.21.15.137:0/1574018522 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b00b59d0 con 0x7fa5c8072980 2024-04-26T23:42:05.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5cf000640 1 -- 172.21.15.137:0/1574018522 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c80b18e0 con 0x7fa5c8072980 2024-04-26T23:42:05.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5c4c00640 1 -- 172.21.15.137:0/1574018522 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b00b5dc0 con 0x7fa5c8072980 2024-04-26T23:42:05.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.424+0000 7fa5cf000640 1 -- 172.21.15.137:0/1574018522 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c80b1ea0 con 0x7fa5c8072980 2024-04-26T23:42:05.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.428+0000 7fa5cf000640 1 -- 172.21.15.137:0/1574018522 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c806a4b0 con 0x7fa5c8072980 2024-04-26T23:42:05.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.428+0000 7fa5c4c00640 1 -- 172.21.15.137:0/1574018522 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa5b00bd020 con 0x7fa5c8072980 2024-04-26T23:42:05.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.428+0000 7fa5c4c00640 1 --2- 172.21.15.137:0/1574018522 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa5a4068380 0x7fa5a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:05.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.428+0000 7fa5c4c00640 1 -- 172.21.15.137:0/1574018522 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fa5b01219c0 con 0x7fa5c8072980 2024-04-26T23:42:05.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.428+0000 7fa5c7e00640 1 --2- 172.21.15.137:0/1574018522 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa5a4068380 0x7fa5a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:05.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.428+0000 7fa5c7e00640 1 --2- 172.21.15.137:0/1574018522 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa5a4068380 0x7fa5a406a840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80098e0 tx=0x7fa5b8009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:05.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.432+0000 7fa5c4c00640 1 -- 172.21.15.137:0/1574018522 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa5b00c4060 con 0x7fa5c8072980 2024-04-26T23:42:05.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.592+0000 7fa5cf000640 1 -- 172.21.15.137:0/1574018522 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5c8072380 con 0x7fa5c8072980 2024-04-26T23:42:05.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.596+0000 7fa5c4c00640 1 -- 172.21.15.137:0/1574018522 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16902 (secure 0 0 0) 0x7fa5b0016050 con 0x7fa5c8072980 2024-04-26T23:42:05.599 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:05.600 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":22,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:42:04.750301+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:42:05.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.596+0000 7fa5cf000640 1 -- 172.21.15.137:0/1574018522 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa5a4068380 msgr2=0x7fa5a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:05.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.596+0000 7fa5cf000640 1 --2- 172.21.15.137:0/1574018522 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa5a4068380 0x7fa5a406a840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80098e0 tx=0x7fa5b8009060 comp rx=0 tx=0).stop 2024-04-26T23:42:05.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.596+0000 7fa5cf000640 1 -- 172.21.15.137:0/1574018522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c8072980 msgr2=0x7fa5c8138100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:05.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.596+0000 7fa5cf000640 1 --2- 172.21.15.137:0/1574018522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c8072980 0x7fa5c8138100 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0019040 tx=0x7fa5b001ac70 comp rx=0 tx=0).stop 2024-04-26T23:42:05.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.596+0000 7fa5cf000640 1 -- 172.21.15.137:0/1574018522 shutdown_connections 2024-04-26T23:42:05.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.596+0000 7fa5cf000640 1 --2- 172.21.15.137:0/1574018522 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa5a4068380 0x7fa5a406a840 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.596+0000 7fa5cf000640 1 --2- 172.21.15.137:0/1574018522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c8072980 0x7fa5c8138100 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.596+0000 7fa5cf000640 1 --2- 172.21.15.137:0/1574018522 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5c80b5080 0x7fa5c8158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.596+0000 7fa5cf000640 1 --2- 172.21.15.137:0/1574018522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5c80725a0 0x7fa5c813c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.596+0000 7fa5cf000640 1 -- 172.21.15.137:0/1574018522 >> 172.21.15.137:0/1574018522 conn(0x7fa5c806c5d0 msgr2=0x7fa5c8072e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:05.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.596+0000 7fa5cf000640 1 -- 172.21.15.137:0/1574018522 shutdown_connections 2024-04-26T23:42:05.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.596+0000 7fa5cf000640 1 -- 172.21.15.137:0/1574018522 wait complete. 2024-04-26T23:42:05.621 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:41:21.810449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:41:22.533452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:42:05.621 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:42:05.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.756+0000 7f7b2b200640 1 Processor -- start 2024-04-26T23:42:05.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.756+0000 7f7b2b200640 1 -- start start 2024-04-26T23:42:05.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.756+0000 7f7b2b200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7b2c0d1420 0x7f7b2c072bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:05.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.756+0000 7f7b2b200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b2c0b5310 con 0x7f7b2c15bb80 2024-04-26T23:42:05.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.756+0000 7f7b2b200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b2c072110 con 0x7f7b2c0b3b10 2024-04-26T23:42:05.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.756+0000 7f7b2b200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7b2c0b50b0 con 0x7f7b2c0d1420 2024-04-26T23:42:05.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.756+0000 7f7b29e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f7b2c15bb80 0x7f7b2c0b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52660/0 (socket says 172.21.15.137:52660) 2024-04-26T23:42:05.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.756+0000 7f7b29e00640 1 -- 172.21.15.137:0/3817634165 learned_addr learned my addr 172.21.15.137:0/3817634165 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:05.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.756+0000 7f7b2a800640 1 --2- 172.21.15.137:0/3817634165 >> v2:172.21.15.137:3300/0 conn(0x7f7b2c0d1420 0x7f7b2c072bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:05.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.756+0000 7f7b2a800640 1 -- 172.21.15.137:0/3817634165 >> v1:172.21.15.170:6789/0 conn(0x7f7b2c0b3b10 legacy=0x7f7b2c0d0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:05.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.756+0000 7f7b2a800640 1 -- 172.21.15.137:0/3817634165 >> v1:172.21.15.137:6789/0 conn(0x7f7b2c15bb80 legacy=0x7f7b2c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:05.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.756+0000 7f7b2a800640 1 -- 172.21.15.137:0/3817634165 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2c0723f0 con 0x7f7b2c0d1420 2024-04-26T23:42:05.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.760+0000 7f7b2a800640 1 --2- 172.21.15.137:0/3817634165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b2c0d1420 0x7f7b2c072bf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7b24009d90 tx=0x7f7b2401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b42348f62094fa7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:05.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.760+0000 7f7b28a00640 1 -- 172.21.15.137:0/3817634165 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b240b2070 con 0x7f7b2c0d1420 2024-04-26T23:42:05.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.760+0000 7f7b28a00640 1 -- 172.21.15.137:0/3817634165 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b240a5820 con 0x7f7b2c0d1420 2024-04-26T23:42:05.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.760+0000 7f7b28a00640 1 -- 172.21.15.137:0/3817634165 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b240a5bf0 con 0x7f7b2c0d1420 2024-04-26T23:42:05.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.760+0000 7f7b2b200640 1 -- 172.21.15.137:0/3817634165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b2c0d1420 msgr2=0x7f7b2c072bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:05.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.760+0000 7f7b2b200640 1 --2- 172.21.15.137:0/3817634165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b2c0d1420 0x7f7b2c072bf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7b24009d90 tx=0x7f7b2401c850 comp rx=0 tx=0).stop 2024-04-26T23:42:05.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.760+0000 7f7b2b200640 1 -- 172.21.15.137:0/3817634165 shutdown_connections 2024-04-26T23:42:05.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.760+0000 7f7b2b200640 1 --2- 172.21.15.137:0/3817634165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b2c0d1420 0x7f7b2c072bf0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.760+0000 7f7b2b200640 1 -- 172.21.15.137:0/3817634165 >> 172.21.15.137:0/3817634165 conn(0x7f7b2c06c5d0 msgr2=0x7f7b2c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:05.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.760+0000 7f7b2b200640 1 -- 172.21.15.137:0/3817634165 shutdown_connections 2024-04-26T23:42:05.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.760+0000 7f7b2b200640 1 -- 172.21.15.137:0/3817634165 wait complete. 2024-04-26T23:42:05.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b2b200640 1 Processor -- start 2024-04-26T23:42:05.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b2b200640 1 -- start start 2024-04-26T23:42:05.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b2b200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7b2c0b3b10 0x7f7b2c0b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:05.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b2b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b2c0d1420 0x7f7b2c15eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:05.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b2b200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b2c15bb80 0x7f7b2c152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:05.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b2b200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c0ceae0 con 0x7f7b2c0d1420 2024-04-26T23:42:05.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b2b200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c0ce960 con 0x7f7b2c15bb80 2024-04-26T23:42:05.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b2b200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7b2c0cec60 con 0x7f7b2c0b3b10 2024-04-26T23:42:05.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b29400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b2c0d1420 0x7f7b2c15eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:05.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b29400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b2c0d1420 0x7f7b2c15eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38382/0 (socket says 172.21.15.137:38382) 2024-04-26T23:42:05.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b29400640 1 -- 172.21.15.137:0/478349981 learned_addr learned my addr 172.21.15.137:0/478349981 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:05.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b2a800640 1 --2- 172.21.15.137:0/478349981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b2c15bb80 0x7f7b2c152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:05.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b29e00640 1 --2- 172.21.15.137:0/478349981 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7b2c0b3b10 0x7f7b2c0b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:05.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b29400640 1 -- 172.21.15.137:0/478349981 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7b2c0b3b10 msgr2=0x7f7b2c0b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:05.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b29400640 1 --2- 172.21.15.137:0/478349981 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7b2c0b3b10 0x7f7b2c0b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b29400640 1 -- 172.21.15.137:0/478349981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b2c15bb80 msgr2=0x7f7b2c152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:05.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b29400640 1 --2- 172.21.15.137:0/478349981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b2c15bb80 0x7f7b2c152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b29400640 1 -- 172.21.15.137:0/478349981 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2c15c700 con 0x7f7b2c0d1420 2024-04-26T23:42:05.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b29400640 1 --2- 172.21.15.137:0/478349981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b2c0d1420 0x7f7b2c15eaa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800c430 tx=0x7f7b1800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:05.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b22000640 1 -- 172.21.15.137:0/478349981 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b180052d0 con 0x7f7b2c0d1420 2024-04-26T23:42:05.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b22000640 1 -- 172.21.15.137:0/478349981 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b18005470 con 0x7f7b2c0d1420 2024-04-26T23:42:05.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b2b200640 1 -- 172.21.15.137:0/478349981 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b2c15c9e0 con 0x7f7b2c0d1420 2024-04-26T23:42:05.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b22000640 1 -- 172.21.15.137:0/478349981 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b18007260 con 0x7f7b2c0d1420 2024-04-26T23:42:05.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b2b200640 1 -- 172.21.15.137:0/478349981 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b2c0b21b0 con 0x7f7b2c0d1420 2024-04-26T23:42:05.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.764+0000 7f7b2b200640 1 -- 172.21.15.137:0/478349981 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b2c06a300 con 0x7f7b2c0d1420 2024-04-26T23:42:05.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.768+0000 7f7b22000640 1 -- 172.21.15.137:0/478349981 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7b18007400 con 0x7f7b2c0d1420 2024-04-26T23:42:05.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.768+0000 7f7b22000640 1 --2- 172.21.15.137:0/478349981 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7b0c068380 0x7f7b0c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:05.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.768+0000 7f7b22000640 1 -- 172.21.15.137:0/478349981 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f7b18085f80 con 0x7f7b2c0d1420 2024-04-26T23:42:05.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.768+0000 7f7b29e00640 1 --2- 172.21.15.137:0/478349981 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7b0c068380 0x7f7b0c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:05.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.768+0000 7f7b29e00640 1 --2- 172.21.15.137:0/478349981 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7b0c068380 0x7f7b0c06a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c000f70 tx=0x7f7b1c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:05.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.772+0000 7f7b22000640 1 -- 172.21.15.137:0/478349981 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7b18055dd0 con 0x7f7b2c0d1420 2024-04-26T23:42:05.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.940+0000 7f7b2b200640 1 -- 172.21.15.137:0/478349981 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7b2c15cd70 con 0x7f7b2c0d1420 2024-04-26T23:42:05.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.940+0000 7f7b22000640 1 -- 172.21.15.137:0/478349981 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f7b1805a0d0 con 0x7f7b2c0d1420 2024-04-26T23:42:05.946 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:42:05.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.944+0000 7f7b2b200640 1 -- 172.21.15.137:0/478349981 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7b0c068380 msgr2=0x7f7b0c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:05.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.944+0000 7f7b2b200640 1 --2- 172.21.15.137:0/478349981 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7b0c068380 0x7f7b0c06a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c000f70 tx=0x7f7b1c009040 comp rx=0 tx=0).stop 2024-04-26T23:42:05.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.944+0000 7f7b2b200640 1 -- 172.21.15.137:0/478349981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b2c0d1420 msgr2=0x7f7b2c15eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:05.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.944+0000 7f7b2b200640 1 --2- 172.21.15.137:0/478349981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b2c0d1420 0x7f7b2c15eaa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800c430 tx=0x7f7b1800c8f0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.944+0000 7f7b2b200640 1 -- 172.21.15.137:0/478349981 shutdown_connections 2024-04-26T23:42:05.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.944+0000 7f7b2b200640 1 --2- 172.21.15.137:0/478349981 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7b0c068380 0x7f7b0c06a840 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.944+0000 7f7b2b200640 1 --2- 172.21.15.137:0/478349981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b2c0d1420 0x7f7b2c15eaa0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.944+0000 7f7b2b200640 1 --2- 172.21.15.137:0/478349981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b2c15bb80 0x7f7b2c152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.944+0000 7f7b2b200640 1 --2- 172.21.15.137:0/478349981 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7b2c0b3b10 0x7f7b2c0b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:05.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.944+0000 7f7b2b200640 1 -- 172.21.15.137:0/478349981 >> 172.21.15.137:0/478349981 conn(0x7f7b2c06c5d0 msgr2=0x7f7b2c15ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:05.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.944+0000 7f7b2b200640 1 -- 172.21.15.137:0/478349981 shutdown_connections 2024-04-26T23:42:05.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:05.944+0000 7f7b2b200640 1 -- 172.21.15.137:0/478349981 wait complete. 2024-04-26T23:42:05.967 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:42:06.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.100+0000 7f7d5ea00640 1 Processor -- start 2024-04-26T23:42:06.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.100+0000 7f7d5ea00640 1 -- start start 2024-04-26T23:42:06.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.100+0000 7f7d5ea00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7d58160450 0x7f7d580d3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.100+0000 7f7d5ea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7d580b0470 0x7f7d580d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.100+0000 7f7d5ea00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7d580d17f0 0x7f7d58160c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.100+0000 7f7d5ea00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7d580d1c40 con 0x7f7d580b0470 2024-04-26T23:42:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.100+0000 7f7d5ea00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f7d580b0cb0 con 0x7f7d580d17f0 2024-04-26T23:42:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.100+0000 7f7d5ea00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7d580b0f90 con 0x7f7d58160450 2024-04-26T23:42:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.100+0000 7f7d4fe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7d580b0470 0x7f7d580d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.100+0000 7f7d4fe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7d580b0470 0x7f7d580d12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38390/0 (socket says 172.21.15.137:38390) 2024-04-26T23:42:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.100+0000 7f7d4fe00640 1 -- 172.21.15.137:0/1241563479 learned_addr learned my addr 172.21.15.137:0/1241563479 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.100+0000 7f7d57e00640 1 --2- 172.21.15.137:0/1241563479 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7d58160450 0x7f7d580d3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.100+0000 7f7d5ca00640 1 --2- 172.21.15.137:0/1241563479 >> v2:172.21.15.170:3300/0 conn(0x7f7d580d17f0 0x7f7d58160c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.100+0000 7f7d4fe00640 1 -- 172.21.15.137:0/1241563479 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7d58160450 msgr2=0x7f7d580d3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.100+0000 7f7d4fe00640 1 --2- 172.21.15.137:0/1241563479 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7d58160450 0x7f7d580d3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.100+0000 7f7d4fe00640 1 -- 172.21.15.137:0/1241563479 >> v2:172.21.15.170:3300/0 conn(0x7f7d580d17f0 msgr2=0x7f7d58160c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.100+0000 7f7d4fe00640 1 --2- 172.21.15.137:0/1241563479 >> v2:172.21.15.170:3300/0 conn(0x7f7d580d17f0 0x7f7d58160c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.100+0000 7f7d4fe00640 1 -- 172.21.15.137:0/1241563479 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d580b1270 con 0x7f7d580b0470 2024-04-26T23:42:06.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.100+0000 7f7d57e00640 1 --2- 172.21.15.137:0/1241563479 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7d58160450 0x7f7d580d3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:06.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.100+0000 7f7d5ca00640 1 --2- 172.21.15.137:0/1241563479 >> v2:172.21.15.170:3300/0 conn(0x7f7d580d17f0 0x7f7d58160c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:06.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.104+0000 7f7d4fe00640 1 --2- 172.21.15.137:0/1241563479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d580b0470 0x7f7d580d12b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7d58161d00 tx=0x7f7d4001c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed965cf71f0d0a3d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.104+0000 7f7d57400640 1 -- 172.21.15.137:0/1241563479 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d400b0070 con 0x7f7d580b0470 2024-04-26T23:42:06.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.104+0000 7f7d57400640 1 -- 172.21.15.137:0/1241563479 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d400ab600 con 0x7f7d580b0470 2024-04-26T23:42:06.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.104+0000 7f7d57400640 1 -- 172.21.15.137:0/1241563479 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d400ab9d0 con 0x7f7d580b0470 2024-04-26T23:42:06.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.104+0000 7f7d5ea00640 1 -- 172.21.15.137:0/1241563479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d580b0470 msgr2=0x7f7d580d12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.104+0000 7f7d5ea00640 1 --2- 172.21.15.137:0/1241563479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d580b0470 0x7f7d580d12b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7d58161d00 tx=0x7f7d4001c230 comp rx=0 tx=0).stop 2024-04-26T23:42:06.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.104+0000 7f7d5ea00640 1 -- 172.21.15.137:0/1241563479 shutdown_connections 2024-04-26T23:42:06.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.104+0000 7f7d5ea00640 1 --2- 172.21.15.137:0/1241563479 >> v2:172.21.15.170:3300/0 conn(0x7f7d580d17f0 0x7f7d58160c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.104+0000 7f7d5ea00640 1 --2- 172.21.15.137:0/1241563479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d580b0470 0x7f7d580d12b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.104+0000 7f7d5ea00640 1 --2- 172.21.15.137:0/1241563479 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7d58160450 0x7f7d580d3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.104+0000 7f7d5ea00640 1 -- 172.21.15.137:0/1241563479 >> 172.21.15.137:0/1241563479 conn(0x7f7d5809ba60 msgr2=0x7f7d5809be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:06.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.104+0000 7f7d5ea00640 1 -- 172.21.15.137:0/1241563479 shutdown_connections 2024-04-26T23:42:06.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.104+0000 7f7d5ea00640 1 -- 172.21.15.137:0/1241563479 wait complete. 2024-04-26T23:42:06.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d5ea00640 1 Processor -- start 2024-04-26T23:42:06.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d5ea00640 1 -- start start 2024-04-26T23:42:06.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d5ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d580b0470 0x7f7d5815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d5ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d580d17f0 0x7f7d58153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d5ea00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7d58160450 0x7f7d58154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d5ea00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7d580b0a50 con 0x7f7d580d17f0 2024-04-26T23:42:06.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d5ea00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7d580b08d0 con 0x7f7d580b0470 2024-04-26T23:42:06.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d5ea00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7d58160830 con 0x7f7d58160450 2024-04-26T23:42:06.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d4fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d580d17f0 0x7f7d58153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d4fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d580d17f0 0x7f7d58153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38398/0 (socket says 172.21.15.137:38398) 2024-04-26T23:42:06.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d4fe00640 1 -- 172.21.15.137:0/2237139892 learned_addr learned my addr 172.21.15.137:0/2237139892 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:06.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d5ca00640 1 --2- 172.21.15.137:0/2237139892 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7d58160450 0x7f7d58154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d57e00640 1 --2- 172.21.15.137:0/2237139892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d580b0470 0x7f7d5815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d4fe00640 1 -- 172.21.15.137:0/2237139892 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7d58160450 msgr2=0x7f7d58154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d4fe00640 1 --2- 172.21.15.137:0/2237139892 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7d58160450 0x7f7d58154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d4fe00640 1 -- 172.21.15.137:0/2237139892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d580b0470 msgr2=0x7f7d5815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d4fe00640 1 --2- 172.21.15.137:0/2237139892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d580b0470 0x7f7d5815a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d4fe00640 1 -- 172.21.15.137:0/2237139892 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d58154990 con 0x7f7d580d17f0 2024-04-26T23:42:06.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d57e00640 1 --2- 172.21.15.137:0/2237139892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d580b0470 0x7f7d5815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:06.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d5ca00640 1 --2- 172.21.15.137:0/2237139892 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7d58160450 0x7f7d58154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:06.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d4fe00640 1 --2- 172.21.15.137:0/2237139892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d580d17f0 0x7f7d58153e40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7d4001a8e0 tx=0x7f7d40018fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d54c00640 1 -- 172.21.15.137:0/2237139892 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d400b0040 con 0x7f7d580d17f0 2024-04-26T23:42:06.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d54c00640 1 -- 172.21.15.137:0/2237139892 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d400b4620 con 0x7f7d580d17f0 2024-04-26T23:42:06.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d54c00640 1 -- 172.21.15.137:0/2237139892 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d400b4a10 con 0x7f7d580d17f0 2024-04-26T23:42:06.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d5ea00640 1 -- 172.21.15.137:0/2237139892 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d58154c30 con 0x7f7d580d17f0 2024-04-26T23:42:06.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d5ea00640 1 -- 172.21.15.137:0/2237139892 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d581551f0 con 0x7f7d580d17f0 2024-04-26T23:42:06.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.108+0000 7f7d5ea00640 1 -- 172.21.15.137:0/2237139892 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d580c9700 con 0x7f7d580d17f0 2024-04-26T23:42:06.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.112+0000 7f7d54c00640 1 -- 172.21.15.137:0/2237139892 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7d400ab4c0 con 0x7f7d580d17f0 2024-04-26T23:42:06.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.112+0000 7f7d54c00640 1 --2- 172.21.15.137:0/2237139892 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7d34068380 0x7f7d3406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.112+0000 7f7d54c00640 1 -- 172.21.15.137:0/2237139892 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f7d40120710 con 0x7f7d580d17f0 2024-04-26T23:42:06.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.112+0000 7f7d57e00640 1 --2- 172.21.15.137:0/2237139892 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7d34068380 0x7f7d3406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.112+0000 7f7d57e00640 1 --2- 172.21.15.137:0/2237139892 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7d34068380 0x7f7d3406a840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800b990 tx=0x7f7d48008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.116+0000 7f7d54c00640 1 -- 172.21.15.137:0/2237139892 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7d40016110 con 0x7f7d580d17f0 2024-04-26T23:42:06.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.268+0000 7f7d5ea00640 1 -- 172.21.15.137:0/2237139892 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7d5806a410 con 0x7f7d580d17f0 2024-04-26T23:42:06.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.272+0000 7f7d54c00640 1 -- 172.21.15.137:0/2237139892 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f7d400f0c40 con 0x7f7d580d17f0 2024-04-26T23:42:06.276 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:42:06.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.272+0000 7f7d5ea00640 1 -- 172.21.15.137:0/2237139892 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7d34068380 msgr2=0x7f7d3406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.272+0000 7f7d5ea00640 1 --2- 172.21.15.137:0/2237139892 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7d34068380 0x7f7d3406a840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800b990 tx=0x7f7d48008040 comp rx=0 tx=0).stop 2024-04-26T23:42:06.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.272+0000 7f7d5ea00640 1 -- 172.21.15.137:0/2237139892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d580d17f0 msgr2=0x7f7d58153e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.272+0000 7f7d5ea00640 1 --2- 172.21.15.137:0/2237139892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d580d17f0 0x7f7d58153e40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7d4001a8e0 tx=0x7f7d40018fd0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.272+0000 7f7d5ea00640 1 -- 172.21.15.137:0/2237139892 shutdown_connections 2024-04-26T23:42:06.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.272+0000 7f7d5ea00640 1 --2- 172.21.15.137:0/2237139892 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7d34068380 0x7f7d3406a840 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.272+0000 7f7d5ea00640 1 --2- 172.21.15.137:0/2237139892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d580d17f0 0x7f7d58153e40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.272+0000 7f7d5ea00640 1 --2- 172.21.15.137:0/2237139892 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7d58160450 0x7f7d58154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.272+0000 7f7d5ea00640 1 --2- 172.21.15.137:0/2237139892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d580b0470 0x7f7d5815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.272+0000 7f7d5ea00640 1 -- 172.21.15.137:0/2237139892 >> 172.21.15.137:0/2237139892 conn(0x7f7d5809ba60 msgr2=0x7f7d58159780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:06.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.272+0000 7f7d5ea00640 1 -- 172.21.15.137:0/2237139892 shutdown_connections 2024-04-26T23:42:06.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.272+0000 7f7d5ea00640 1 -- 172.21.15.137:0/2237139892 wait complete. 2024-04-26T23:42:06.297 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:42:06.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.432+0000 7f284b200640 1 Processor -- start 2024-04-26T23:42:06.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.432+0000 7f284b200640 1 -- start start 2024-04-26T23:42:06.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.432+0000 7f284b200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f284c15bb80 0x7f284c072bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.432+0000 7f284b200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f284c0d0d10 0x7f284c0d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.432+0000 7f284b200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f284c0b5310 con 0x7f284c0b3b10 2024-04-26T23:42:06.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.432+0000 7f284b200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f284c0d16a0 con 0x7f284c15bb80 2024-04-26T23:42:06.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.432+0000 7f284b200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f284c0b50b0 con 0x7f284c0d0d10 2024-04-26T23:42:06.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.432+0000 7f2849e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f284c15bb80 0x7f284c072bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.432+0000 7f2849400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f284c0b3b10 0x7f284c0b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52676/0 (socket says 172.21.15.137:52676) 2024-04-26T23:42:06.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.432+0000 7f2849400640 1 -- 172.21.15.137:0/2933614700 learned_addr learned my addr 172.21.15.137:0/2933614700 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:06.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.432+0000 7f284a800640 1 --2- 172.21.15.137:0/2933614700 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f284c0d0d10 0x7f284c0d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.432+0000 7f2849e00640 1 -- 172.21.15.137:0/2933614700 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f284c0d0d10 msgr2=0x7f284c0d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:06.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.432+0000 7f2849e00640 1 --2- 172.21.15.137:0/2933614700 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f284c0d0d10 0x7f284c0d1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.432+0000 7f2849e00640 1 -- 172.21.15.137:0/2933614700 >> v1:172.21.15.137:6789/0 conn(0x7f284c0b3b10 legacy=0x7f284c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.432+0000 7f2849e00640 1 -- 172.21.15.137:0/2933614700 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f284c072110 con 0x7f284c15bb80 2024-04-26T23:42:06.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.432+0000 7f2848a00640 1 -- 172.21.15.137:0/2933614700 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2620197173 0 0) 0x7f284c0b5310 con 0x7f284c0b3b10 2024-04-26T23:42:06.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.436+0000 7f2849e00640 1 --2- 172.21.15.137:0/2933614700 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f284c15bb80 0x7f284c072bf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f283c0097f0 tx=0x7f283c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0658a7ad376f44 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.436+0000 7f2848a00640 1 -- 172.21.15.137:0/2933614700 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c0b0070 con 0x7f284c15bb80 2024-04-26T23:42:06.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.436+0000 7f2848a00640 1 -- 172.21.15.137:0/2933614700 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f283c0ab600 con 0x7f284c15bb80 2024-04-26T23:42:06.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.436+0000 7f2848a00640 1 -- 172.21.15.137:0/2933614700 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c0ab9d0 con 0x7f284c15bb80 2024-04-26T23:42:06.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.436+0000 7f284b200640 1 -- 172.21.15.137:0/2933614700 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f284c15bb80 msgr2=0x7f284c072bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.436+0000 7f284b200640 1 --2- 172.21.15.137:0/2933614700 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f284c15bb80 0x7f284c072bf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f283c0097f0 tx=0x7f283c01c380 comp rx=0 tx=0).stop 2024-04-26T23:42:06.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.436+0000 7f284b200640 1 -- 172.21.15.137:0/2933614700 shutdown_connections 2024-04-26T23:42:06.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.436+0000 7f284b200640 1 --2- 172.21.15.137:0/2933614700 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f284c0d0d10 0x7f284c0d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.436+0000 7f284b200640 1 --2- 172.21.15.137:0/2933614700 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f284c15bb80 0x7f284c072bf0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.436+0000 7f284b200640 1 -- 172.21.15.137:0/2933614700 >> 172.21.15.137:0/2933614700 conn(0x7f284c06c5d0 msgr2=0x7f284c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:06.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.436+0000 7f284b200640 1 -- 172.21.15.137:0/2933614700 shutdown_connections 2024-04-26T23:42:06.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.436+0000 7f284b200640 1 -- 172.21.15.137:0/2933614700 wait complete. 2024-04-26T23:42:06.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.436+0000 7f284b200640 1 Processor -- start 2024-04-26T23:42:06.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f284b200640 1 -- start start 2024-04-26T23:42:06.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f284b200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f284c0b3b10 0x7f284c157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f284b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f284c0d0d10 0x7f284c06e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f284b200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f284c15bb80 0x7f284c15c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f284b200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f284c0ce8d0 con 0x7f284c0d0d10 2024-04-26T23:42:06.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f284b200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f284c0ce750 con 0x7f284c15bb80 2024-04-26T23:42:06.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f284b200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f284c0cea50 con 0x7f284c0b3b10 2024-04-26T23:42:06.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f2849400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f284c0d0d10 0x7f284c06e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f2849400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f284c0d0d10 0x7f284c06e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38418/0 (socket says 172.21.15.137:38418) 2024-04-26T23:42:06.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f2849400640 1 -- 172.21.15.137:0/3365460051 learned_addr learned my addr 172.21.15.137:0/3365460051 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:06.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f2849e00640 1 --2- 172.21.15.137:0/3365460051 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f284c0b3b10 0x7f284c157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f284a800640 1 --2- 172.21.15.137:0/3365460051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f284c15bb80 0x7f284c15c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f2849400640 1 -- 172.21.15.137:0/3365460051 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f284c0b3b10 msgr2=0x7f284c157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f2849400640 1 --2- 172.21.15.137:0/3365460051 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f284c0b3b10 0x7f284c157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f2849400640 1 -- 172.21.15.137:0/3365460051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f284c15bb80 msgr2=0x7f284c15c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f2849400640 1 --2- 172.21.15.137:0/3365460051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f284c15bb80 0x7f284c15c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f2849400640 1 -- 172.21.15.137:0/3365460051 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f284c158450 con 0x7f284c0d0d10 2024-04-26T23:42:06.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f284a800640 1 --2- 172.21.15.137:0/3365460051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f284c15bb80 0x7f284c15c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:06.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f2849400640 1 --2- 172.21.15.137:0/3365460051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f284c0d0d10 0x7f284c06e230 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f283800c4b0 tx=0x7f283800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f2842000640 1 -- 172.21.15.137:0/3365460051 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838018070 con 0x7f284c0d0d10 2024-04-26T23:42:06.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f2842000640 1 -- 172.21.15.137:0/3365460051 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2838007500 con 0x7f284c0d0d10 2024-04-26T23:42:06.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f2842000640 1 -- 172.21.15.137:0/3365460051 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838004a30 con 0x7f284c0d0d10 2024-04-26T23:42:06.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f284b200640 1 -- 172.21.15.137:0/3365460051 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f284c15cbc0 con 0x7f284c0d0d10 2024-04-26T23:42:06.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f284b200640 1 -- 172.21.15.137:0/3365460051 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f284c157710 con 0x7f284c0d0d10 2024-04-26T23:42:06.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.440+0000 7f284b200640 1 -- 172.21.15.137:0/3365460051 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f284c06a300 con 0x7f284c0d0d10 2024-04-26T23:42:06.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.444+0000 7f2842000640 1 -- 172.21.15.137:0/3365460051 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2838004bd0 con 0x7f284c0d0d10 2024-04-26T23:42:06.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.444+0000 7f2842000640 1 --2- 172.21.15.137:0/3365460051 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f282c068380 0x7f282c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.444+0000 7f2842000640 1 -- 172.21.15.137:0/3365460051 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f2838085cb0 con 0x7f284c0d0d10 2024-04-26T23:42:06.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.444+0000 7f2849e00640 1 --2- 172.21.15.137:0/3365460051 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f282c068380 0x7f282c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.444+0000 7f2849e00640 1 --2- 172.21.15.137:0/3365460051 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f282c068380 0x7f282c06a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f283c0ad000 tx=0x7f283c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.448+0000 7f2842000640 1 -- 172.21.15.137:0/3365460051 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2838055c50 con 0x7f284c0d0d10 2024-04-26T23:42:06.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.604+0000 7f284b200640 1 -- 172.21.15.137:0/3365460051 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f284c06fc10 con 0x7f284c0d0d10 2024-04-26T23:42:06.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.604+0000 7f2842000640 1 -- 172.21.15.137:0/3365460051 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f2838059f50 con 0x7f284c0d0d10 2024-04-26T23:42:06.608 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:42:06.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.604+0000 7f284b200640 1 -- 172.21.15.137:0/3365460051 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f282c068380 msgr2=0x7f282c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.604+0000 7f284b200640 1 --2- 172.21.15.137:0/3365460051 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f282c068380 0x7f282c06a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f283c0ad000 tx=0x7f283c008040 comp rx=0 tx=0).stop 2024-04-26T23:42:06.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.604+0000 7f284b200640 1 -- 172.21.15.137:0/3365460051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f284c0d0d10 msgr2=0x7f284c06e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.604+0000 7f284b200640 1 --2- 172.21.15.137:0/3365460051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f284c0d0d10 0x7f284c06e230 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f283800c4b0 tx=0x7f283800c970 comp rx=0 tx=0).stop 2024-04-26T23:42:06.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.604+0000 7f284b200640 1 -- 172.21.15.137:0/3365460051 shutdown_connections 2024-04-26T23:42:06.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.604+0000 7f284b200640 1 --2- 172.21.15.137:0/3365460051 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f282c068380 0x7f282c06a840 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.604+0000 7f284b200640 1 --2- 172.21.15.137:0/3365460051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f284c0d0d10 0x7f284c06e230 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.604+0000 7f284b200640 1 --2- 172.21.15.137:0/3365460051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f284c15bb80 0x7f284c15c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.604+0000 7f284b200640 1 --2- 172.21.15.137:0/3365460051 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f284c0b3b10 0x7f284c157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.604+0000 7f284b200640 1 -- 172.21.15.137:0/3365460051 >> 172.21.15.137:0/3365460051 conn(0x7f284c06c5d0 msgr2=0x7f284c0ae8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:06.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.604+0000 7f284b200640 1 -- 172.21.15.137:0/3365460051 shutdown_connections 2024-04-26T23:42:06.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.604+0000 7f284b200640 1 -- 172.21.15.137:0/3365460051 wait complete. 2024-04-26T23:42:06.629 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:42:06.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.760+0000 7fc856000640 1 Processor -- start 2024-04-26T23:42:06.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.760+0000 7fc856000640 1 -- start start 2024-04-26T23:42:06.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.760+0000 7fc856000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8500b5080 0x7fc8500cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.760+0000 7fc856000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc850072980 0x7fc850072e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.760+0000 7fc856000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8500cfef0 con 0x7fc8500725a0 2024-04-26T23:42:06.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.760+0000 7fc856000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc8500cddc0 con 0x7fc850072980 2024-04-26T23:42:06.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.760+0000 7fc856000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc8500d01b0 con 0x7fc8500b5080 2024-04-26T23:42:06.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.760+0000 7fc84fe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc850072980 0x7fc850072e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.760+0000 7fc846a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8500b5080 0x7fc8500cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.760+0000 7fc84fe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc850072980 0x7fc850072e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38420/0 (socket says 172.21.15.137:38420) 2024-04-26T23:42:06.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.760+0000 7fc84fe00640 1 -- 172.21.15.137:0/1567538095 learned_addr learned my addr 172.21.15.137:0/1567538095 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:06.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.760+0000 7fc84f400640 1 --1- 172.21.15.137:0/1567538095 >> v1:172.21.15.170:6789/0 conn(0x7fc8500725a0 0x7fc850073f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:33618/0 (socket says 172.21.15.137:33618) 2024-04-26T23:42:06.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.760+0000 7fc84fe00640 1 -- 172.21.15.137:0/1567538095 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8500b5080 msgr2=0x7fc8500cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:06.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.760+0000 7fc84fe00640 1 --2- 172.21.15.137:0/1567538095 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8500b5080 0x7fc8500cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.760+0000 7fc84fe00640 1 -- 172.21.15.137:0/1567538095 >> v1:172.21.15.170:6789/0 conn(0x7fc8500725a0 legacy=0x7fc850073f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.764+0000 7fc84fe00640 1 -- 172.21.15.137:0/1567538095 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8500d0490 con 0x7fc850072980 2024-04-26T23:42:06.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.764+0000 7fc84fe00640 1 --2- 172.21.15.137:0/1567538095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc850072980 0x7fc850072e10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc848009e50 tx=0x7fc84801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecebd159284f98e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.764+0000 7fc84ea00640 1 -- 172.21.15.137:0/1567538095 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8480a58f0 con 0x7fc850072980 2024-04-26T23:42:06.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.764+0000 7fc84ea00640 1 -- 172.21.15.137:0/1567538095 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8480a5a90 con 0x7fc850072980 2024-04-26T23:42:06.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.764+0000 7fc84ea00640 1 -- 172.21.15.137:0/1567538095 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8480a5e60 con 0x7fc850072980 2024-04-26T23:42:06.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.764+0000 7fc856000640 1 -- 172.21.15.137:0/1567538095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc850072980 msgr2=0x7fc850072e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.764+0000 7fc856000640 1 --2- 172.21.15.137:0/1567538095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc850072980 0x7fc850072e10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc848009e50 tx=0x7fc84801ca00 comp rx=0 tx=0).stop 2024-04-26T23:42:06.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.764+0000 7fc856000640 1 -- 172.21.15.137:0/1567538095 shutdown_connections 2024-04-26T23:42:06.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.764+0000 7fc856000640 1 --2- 172.21.15.137:0/1567538095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc850072980 0x7fc850072e10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.764+0000 7fc856000640 1 --2- 172.21.15.137:0/1567538095 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8500b5080 0x7fc8500cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.764+0000 7fc856000640 1 -- 172.21.15.137:0/1567538095 >> 172.21.15.137:0/1567538095 conn(0x7fc85006c5d0 msgr2=0x7fc85006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:06.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.764+0000 7fc856000640 1 -- 172.21.15.137:0/1567538095 shutdown_connections 2024-04-26T23:42:06.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.768+0000 7fc856000640 1 -- 172.21.15.137:0/1567538095 wait complete. 2024-04-26T23:42:06.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.768+0000 7fc856000640 1 Processor -- start 2024-04-26T23:42:06.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.768+0000 7fc856000640 1 -- start start 2024-04-26T23:42:06.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.768+0000 7fc856000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8500725a0 0x7fc8501f8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.768+0000 7fc856000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc850072980 0x7fc85015ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.768+0000 7fc856000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8500b5080 0x7fc8500b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.768+0000 7fc856000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc8501684e0 con 0x7fc8500b5080 2024-04-26T23:42:06.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.768+0000 7fc856000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc850168360 con 0x7fc8500725a0 2024-04-26T23:42:06.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.768+0000 7fc856000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc850168660 con 0x7fc850072980 2024-04-26T23:42:06.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.768+0000 7fc84fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8500b5080 0x7fc8500b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.768+0000 7fc84fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8500b5080 0x7fc8500b0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38436/0 (socket says 172.21.15.137:38436) 2024-04-26T23:42:06.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.768+0000 7fc84f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8500725a0 0x7fc8501f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.768+0000 7fc846a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc850072980 0x7fc85015ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.768+0000 7fc84fe00640 1 -- 172.21.15.137:0/1127462653 learned_addr learned my addr 172.21.15.137:0/1127462653 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:06.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.768+0000 7fc84fe00640 1 -- 172.21.15.137:0/1127462653 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc850072980 msgr2=0x7fc85015ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.768+0000 7fc84fe00640 1 --2- 172.21.15.137:0/1127462653 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc850072980 0x7fc85015ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.768+0000 7fc84fe00640 1 -- 172.21.15.137:0/1127462653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8500725a0 msgr2=0x7fc8501f8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.768+0000 7fc84fe00640 1 --2- 172.21.15.137:0/1127462653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8500725a0 0x7fc8501f8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.768+0000 7fc84fe00640 1 -- 172.21.15.137:0/1127462653 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8501f8ab0 con 0x7fc8500b5080 2024-04-26T23:42:06.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.768+0000 7fc84fe00640 1 --2- 172.21.15.137:0/1127462653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8500b5080 0x7fc8500b0850 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc84801a630 tx=0x7fc8480197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.768+0000 7fc847e00640 1 -- 172.21.15.137:0/1127462653 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8480bc030 con 0x7fc8500b5080 2024-04-26T23:42:06.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.772+0000 7fc847e00640 1 -- 172.21.15.137:0/1127462653 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc848007b70 con 0x7fc8500b5080 2024-04-26T23:42:06.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.772+0000 7fc847e00640 1 -- 172.21.15.137:0/1127462653 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8480a58f0 con 0x7fc8500b5080 2024-04-26T23:42:06.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.772+0000 7fc856000640 1 -- 172.21.15.137:0/1127462653 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8500b2a70 con 0x7fc8500b5080 2024-04-26T23:42:06.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.772+0000 7fc856000640 1 -- 172.21.15.137:0/1127462653 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8500b2ff0 con 0x7fc8500b5080 2024-04-26T23:42:06.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.772+0000 7fc856000640 1 -- 172.21.15.137:0/1127462653 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc85006a4b0 con 0x7fc8500b5080 2024-04-26T23:42:06.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.772+0000 7fc847e00640 1 -- 172.21.15.137:0/1127462653 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc8480bf070 con 0x7fc8500b5080 2024-04-26T23:42:06.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.772+0000 7fc847e00640 1 --2- 172.21.15.137:0/1127462653 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc82c0683b0 0x7fc82c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.772+0000 7fc847e00640 1 -- 172.21.15.137:0/1127462653 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fc848121610 con 0x7fc8500b5080 2024-04-26T23:42:06.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.772+0000 7fc84f400640 1 --2- 172.21.15.137:0/1127462653 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc82c0683b0 0x7fc82c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.772+0000 7fc84f400640 1 --2- 172.21.15.137:0/1127462653 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc82c0683b0 0x7fc82c06a870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc838000f70 tx=0x7fc838007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.776+0000 7fc847e00640 1 -- 172.21.15.137:0/1127462653 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc8480c7020 con 0x7fc8500b5080 2024-04-26T23:42:06.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.944+0000 7fc856000640 1 -- 172.21.15.137:0/1127462653 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc850072380 con 0x7fc8500b5080 2024-04-26T23:42:06.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.944+0000 7fc847e00640 1 -- 172.21.15.137:0/1127462653 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fc8501f8ab0 con 0x7fc8500b5080 2024-04-26T23:42:06.950 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T23:42:06.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.948+0000 7fc856000640 1 -- 172.21.15.137:0/1127462653 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc82c0683b0 msgr2=0x7fc82c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.948+0000 7fc856000640 1 --2- 172.21.15.137:0/1127462653 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc82c0683b0 0x7fc82c06a870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc838000f70 tx=0x7fc838007e90 comp rx=0 tx=0).stop 2024-04-26T23:42:06.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.948+0000 7fc856000640 1 -- 172.21.15.137:0/1127462653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8500b5080 msgr2=0x7fc8500b0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.948+0000 7fc856000640 1 --2- 172.21.15.137:0/1127462653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8500b5080 0x7fc8500b0850 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc84801a630 tx=0x7fc8480197a0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.948+0000 7fc856000640 1 -- 172.21.15.137:0/1127462653 shutdown_connections 2024-04-26T23:42:06.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.948+0000 7fc856000640 1 --2- 172.21.15.137:0/1127462653 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc82c0683b0 0x7fc82c06a870 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.948+0000 7fc856000640 1 --2- 172.21.15.137:0/1127462653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8500b5080 0x7fc8500b0850 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.948+0000 7fc856000640 1 --2- 172.21.15.137:0/1127462653 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc850072980 0x7fc85015ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.948+0000 7fc856000640 1 --2- 172.21.15.137:0/1127462653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8500725a0 0x7fc8501f8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.948+0000 7fc856000640 1 -- 172.21.15.137:0/1127462653 >> 172.21.15.137:0/1127462653 conn(0x7fc85006c5d0 msgr2=0x7fc85006c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:06.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.948+0000 7fc856000640 1 -- 172.21.15.137:0/1127462653 shutdown_connections 2024-04-26T23:42:06.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:06.948+0000 7fc856000640 1 -- 172.21.15.137:0/1127462653 wait complete. 2024-04-26T23:42:06.972 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi137.front.sepia.ceph.com... 2024-04-26T23:42:06.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:06.972 DEBUG:teuthology.orchestra.run.smithi137:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-04-26T23:42:06.993 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:42:06.993 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T23:42:06.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:06.994 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-26T23:42:07.043 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:42:07.043 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:42:07.053 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:42:07.054 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:42:07.111 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:42:07.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.240+0000 7fc0ea800640 1 Processor -- start 2024-04-26T23:42:07.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.240+0000 7fc0ea800640 1 -- start start 2024-04-26T23:42:07.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.240+0000 7fc0ea800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc0e4162de0 0x7fc0e4163260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:07.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.240+0000 7fc0ea800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0e40b2b60 0x7fc0e40b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:07.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.240+0000 7fc0ea800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0e40b64f0 con 0x7fc0e4159750 2024-04-26T23:42:07.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.240+0000 7fc0ea800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc0e40ae1d0 con 0x7fc0e4162de0 2024-04-26T23:42:07.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.240+0000 7fc0ea800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc0e40b48e0 con 0x7fc0e40b2b60 2024-04-26T23:42:07.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e3400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc0e4159750 0x7fc0e40b5de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52680/0 (socket says 172.21.15.137:52680) 2024-04-26T23:42:07.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e3400640 1 -- 172.21.15.137:0/3173509529 learned_addr learned my addr 172.21.15.137:0/3173509529 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:07.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e3e00640 1 --2- 172.21.15.137:0/3173509529 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0e40b2b60 0x7fc0e40b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:07.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e2a00640 1 --2- 172.21.15.137:0/3173509529 >> v2:172.21.15.170:3300/0 conn(0x7fc0e4162de0 0x7fc0e4163260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:07.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e2000640 1 -- 172.21.15.137:0/3173509529 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 900610272 0 0) 0x7fc0e40b64f0 con 0x7fc0e4159750 2024-04-26T23:42:07.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e2000640 1 -- 172.21.15.137:0/3173509529 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0c8003530 con 0x7fc0e4159750 2024-04-26T23:42:07.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e2000640 1 -- 172.21.15.137:0/3173509529 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1463707475 0 0) 0x7fc0c8003530 con 0x7fc0e4159750 2024-04-26T23:42:07.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e2000640 1 -- 172.21.15.137:0/3173509529 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0e40b2b60 msgr2=0x7fc0e40b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:07.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e2000640 1 --2- 172.21.15.137:0/3173509529 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0e40b2b60 0x7fc0e40b2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e2000640 1 -- 172.21.15.137:0/3173509529 >> v2:172.21.15.170:3300/0 conn(0x7fc0e4162de0 msgr2=0x7fc0e4163260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:07.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e2000640 1 --2- 172.21.15.137:0/3173509529 >> v2:172.21.15.170:3300/0 conn(0x7fc0e4162de0 0x7fc0e4163260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e2000640 1 -- 172.21.15.137:0/3173509529 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e40d1f30 con 0x7fc0e4159750 2024-04-26T23:42:07.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e2000640 1 -- 172.21.15.137:0/3173509529 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fc0d4001680 con 0x7fc0e4159750 2024-04-26T23:42:07.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e2000640 1 -- 172.21.15.137:0/3173509529 >> v1:172.21.15.137:6789/0 conn(0x7fc0e4159750 legacy=0x7fc0e40b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:07.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e2000640 1 --2- 172.21.15.137:0/3173509529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0c80039c0 0x7fc0c8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:07.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e2000640 1 --2- 172.21.15.137:0/3173509529 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0e40b2b60 0x7fc0c8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:07.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e2000640 1 --2- 172.21.15.137:0/3173509529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0c8004d50 0x7fc0c80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:07.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e2000640 1 -- 172.21.15.137:0/3173509529 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e40b48e0 con 0x7fc0c80039c0 2024-04-26T23:42:07.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e2000640 1 -- 172.21.15.137:0/3173509529 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c800b9d0 con 0x7fc0c8004d50 2024-04-26T23:42:07.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e2000640 1 -- 172.21.15.137:0/3173509529 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc0c800bb50 con 0x7fc0e40b2b60 2024-04-26T23:42:07.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e3400640 1 --2- 172.21.15.137:0/3173509529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0c80039c0 0x7fc0c8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:07.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e2a00640 1 --2- 172.21.15.137:0/3173509529 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0e40b2b60 0x7fc0c8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:07.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e3e00640 1 --2- 172.21.15.137:0/3173509529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0c8004d50 0x7fc0c80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:07.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e3400640 1 -- 172.21.15.137:0/3173509529 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0e40b2b60 msgr2=0x7fc0c8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:07.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e3400640 1 --2- 172.21.15.137:0/3173509529 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0e40b2b60 0x7fc0c8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e3400640 1 -- 172.21.15.137:0/3173509529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0c8004d50 msgr2=0x7fc0c80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:07.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e3400640 1 --2- 172.21.15.137:0/3173509529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0c8004d50 0x7fc0c80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.244+0000 7fc0e3400640 1 -- 172.21.15.137:0/3173509529 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c8003530 con 0x7fc0c80039c0 2024-04-26T23:42:07.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.248+0000 7fc0e3400640 1 --2- 172.21.15.137:0/3173509529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0c80039c0 0x7fc0c8003de0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc0d400c240 tx=0x7fc0d401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4869725de4027a0c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:07.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.248+0000 7fc0e2000640 1 -- 172.21.15.137:0/3173509529 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4007d60 con 0x7fc0c80039c0 2024-04-26T23:42:07.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.248+0000 7fc0e2000640 1 -- 172.21.15.137:0/3173509529 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d40a9020 con 0x7fc0c80039c0 2024-04-26T23:42:07.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.248+0000 7fc0e2000640 1 -- 172.21.15.137:0/3173509529 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4005ae0 con 0x7fc0c80039c0 2024-04-26T23:42:07.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.248+0000 7fc0ea800640 1 -- 172.21.15.137:0/3173509529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0c80039c0 msgr2=0x7fc0c8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:07.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.248+0000 7fc0ea800640 1 --2- 172.21.15.137:0/3173509529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0c80039c0 0x7fc0c8003de0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc0d400c240 tx=0x7fc0d401ccc0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.248+0000 7fc0e3e00640 1 -- 172.21.15.137:0/3173509529 reap_dead start 2024-04-26T23:42:07.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.248+0000 7fc0ea800640 1 -- 172.21.15.137:0/3173509529 shutdown_connections 2024-04-26T23:42:07.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.248+0000 7fc0ea800640 1 -- 172.21.15.137:0/3173509529 >> 172.21.15.137:0/3173509529 conn(0x7fc0e40b6710 msgr2=0x7fc0e40b6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:07.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.248+0000 7fc0ea800640 1 -- 172.21.15.137:0/3173509529 shutdown_connections 2024-04-26T23:42:07.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.248+0000 7fc0ea800640 1 -- 172.21.15.137:0/3173509529 wait complete. 2024-04-26T23:42:07.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.248+0000 7fc0ea800640 1 Processor -- start 2024-04-26T23:42:07.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.248+0000 7fc0ea800640 1 -- start start 2024-04-26T23:42:07.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.248+0000 7fc0ea800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0c80039c0 0x7fc0e4155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:07.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.248+0000 7fc0ea800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0e4153eb0 0x7fc0e41618c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:07.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0ea800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0e4161e00 0x7fc0e415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:07.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0ea800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e40d1a10 con 0x7fc0c80039c0 2024-04-26T23:42:07.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0ea800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e40d1890 con 0x7fc0e4153eb0 2024-04-26T23:42:07.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0ea800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc0e4159b30 con 0x7fc0e4161e00 2024-04-26T23:42:07.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0e3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0c80039c0 0x7fc0e4155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:07.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0e3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0c80039c0 0x7fc0e4155860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38460/0 (socket says 172.21.15.137:38460) 2024-04-26T23:42:07.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0e3400640 1 -- 172.21.15.137:0/175641148 learned_addr learned my addr 172.21.15.137:0/175641148 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:07.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0e2a00640 1 --2- 172.21.15.137:0/175641148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0e4153eb0 0x7fc0e41618c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:07.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0e3e00640 1 --2- 172.21.15.137:0/175641148 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0e4161e00 0x7fc0e415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:07.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0e3400640 1 -- 172.21.15.137:0/175641148 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0e4161e00 msgr2=0x7fc0e415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:07.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0e3400640 1 --2- 172.21.15.137:0/175641148 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0e4161e00 0x7fc0e415baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0e3400640 1 -- 172.21.15.137:0/175641148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0e4153eb0 msgr2=0x7fc0e41618c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:07.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0e3400640 1 --2- 172.21.15.137:0/175641148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0e4153eb0 0x7fc0e41618c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0e3400640 1 -- 172.21.15.137:0/175641148 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e4155fb0 con 0x7fc0c80039c0 2024-04-26T23:42:07.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0e3400640 1 --2- 172.21.15.137:0/175641148 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0c80039c0 0x7fc0e4155860 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc0d40ab040 tx=0x7fc0c8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:07.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0db400640 1 -- 172.21.15.137:0/175641148 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40049f0 con 0x7fc0c80039c0 2024-04-26T23:42:07.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0db400640 1 -- 172.21.15.137:0/175641148 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d4004b90 con 0x7fc0c80039c0 2024-04-26T23:42:07.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0ea800640 1 -- 172.21.15.137:0/175641148 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0e4156290 con 0x7fc0c80039c0 2024-04-26T23:42:07.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0db400640 1 -- 172.21.15.137:0/175641148 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40070d0 con 0x7fc0c80039c0 2024-04-26T23:42:07.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0ea800640 1 -- 172.21.15.137:0/175641148 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0e4154330 con 0x7fc0c80039c0 2024-04-26T23:42:07.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0ea800640 1 -- 172.21.15.137:0/175641148 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0e4162210 con 0x7fc0c80039c0 2024-04-26T23:42:07.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0db400640 1 -- 172.21.15.137:0/175641148 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc0d4007270 con 0x7fc0c80039c0 2024-04-26T23:42:07.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.252+0000 7fc0db400640 1 --2- 172.21.15.137:0/175641148 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc0c4068380 0x7fc0c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:07.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.256+0000 7fc0db400640 1 -- 172.21.15.137:0/175641148 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fc0d411ffe0 con 0x7fc0c80039c0 2024-04-26T23:42:07.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.256+0000 7fc0e2a00640 1 --2- 172.21.15.137:0/175641148 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc0c4068380 0x7fc0c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:07.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.256+0000 7fc0e2a00640 1 --2- 172.21.15.137:0/175641148 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc0c4068380 0x7fc0c406a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0009950 tx=0x7fc0d0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:07.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.260+0000 7fc0db400640 1 -- 172.21.15.137:0/175641148 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc0e4162210 con 0x7fc0c80039c0 2024-04-26T23:42:07.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.416+0000 7fc0ea800640 1 -- 172.21.15.137:0/175641148 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc0e406a4b0 con 0x7fc0c80039c0 2024-04-26T23:42:07.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.416+0000 7fc0db400640 1 -- 172.21.15.137:0/175641148 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16902 (secure 0 0 0) 0x7fc0d4117e20 con 0x7fc0c80039c0 2024-04-26T23:42:07.422 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:07.422 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":22,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:42:04.750301+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:42:07.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.420+0000 7fc0ea800640 1 -- 172.21.15.137:0/175641148 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc0c4068380 msgr2=0x7fc0c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:07.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.420+0000 7fc0ea800640 1 --2- 172.21.15.137:0/175641148 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc0c4068380 0x7fc0c406a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0009950 tx=0x7fc0d0008040 comp rx=0 tx=0).stop 2024-04-26T23:42:07.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.420+0000 7fc0ea800640 1 -- 172.21.15.137:0/175641148 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0c80039c0 msgr2=0x7fc0e4155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:07.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.420+0000 7fc0ea800640 1 --2- 172.21.15.137:0/175641148 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0c80039c0 0x7fc0e4155860 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc0d40ab040 tx=0x7fc0c8005840 comp rx=0 tx=0).stop 2024-04-26T23:42:07.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.420+0000 7fc0ea800640 1 -- 172.21.15.137:0/175641148 shutdown_connections 2024-04-26T23:42:07.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.420+0000 7fc0ea800640 1 --2- 172.21.15.137:0/175641148 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc0c4068380 0x7fc0c406a840 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.420+0000 7fc0ea800640 1 --2- 172.21.15.137:0/175641148 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0e4161e00 0x7fc0e415baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.420+0000 7fc0ea800640 1 --2- 172.21.15.137:0/175641148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0e4153eb0 0x7fc0e41618c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.420+0000 7fc0ea800640 1 --2- 172.21.15.137:0/175641148 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0c80039c0 0x7fc0e4155860 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.420+0000 7fc0ea800640 1 -- 172.21.15.137:0/175641148 >> 172.21.15.137:0/175641148 conn(0x7fc0e40b6710 msgr2=0x7fc0e40d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:07.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.420+0000 7fc0ea800640 1 -- 172.21.15.137:0/175641148 shutdown_connections 2024-04-26T23:42:07.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.420+0000 7fc0ea800640 1 -- 172.21.15.137:0/175641148 wait complete. 2024-04-26T23:42:07.444 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:41:21.810449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:41:22.533452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:42:07.445 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:42:07.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.580+0000 7fb444400640 1 Processor -- start 2024-04-26T23:42:07.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.580+0000 7fb444400640 1 -- start start 2024-04-26T23:42:07.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.580+0000 7fb444400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb43c06d370 0x7fb43c0b2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:07.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.580+0000 7fb444400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb43c06c610 0x7fb43c0cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:07.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.580+0000 7fb444400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb43c0d0680 con 0x7fb43c15f4d0 2024-04-26T23:42:07.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.580+0000 7fb444400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb43c0d0f80 con 0x7fb43c06c610 2024-04-26T23:42:07.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.580+0000 7fb444400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb43c0cfbb0 con 0x7fb43c06d370 2024-04-26T23:42:07.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.580+0000 7fb442400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb43c06c610 0x7fb43c0cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:07.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.580+0000 7fb441a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb43c15f4d0 0x7fb43c06cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52688/0 (socket says 172.21.15.137:52688) 2024-04-26T23:42:07.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.580+0000 7fb441a00640 1 -- 172.21.15.137:0/529747450 learned_addr learned my addr 172.21.15.137:0/529747450 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:07.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.580+0000 7fb441000640 1 --2- 172.21.15.137:0/529747450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb43c06d370 0x7fb43c0b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:07.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.580+0000 7fb442400640 1 -- 172.21.15.137:0/529747450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb43c06d370 msgr2=0x7fb43c0b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:07.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.580+0000 7fb442400640 1 --2- 172.21.15.137:0/529747450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb43c06d370 0x7fb43c0b2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.580+0000 7fb442400640 1 -- 172.21.15.137:0/529747450 >> v1:172.21.15.137:6789/0 conn(0x7fb43c15f4d0 legacy=0x7fb43c06cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:07.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.580+0000 7fb442400640 1 -- 172.21.15.137:0/529747450 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43c0cfde0 con 0x7fb43c06c610 2024-04-26T23:42:07.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.580+0000 7fb441000640 1 --2- 172.21.15.137:0/529747450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb43c06d370 0x7fb43c0b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:07.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.584+0000 7fb442400640 1 --2- 172.21.15.137:0/529747450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb43c06c610 0x7fb43c0cf670 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb434009d90 tx=0x7fb43401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6697322786606765 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:07.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.584+0000 7fb43be00640 1 -- 172.21.15.137:0/529747450 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4340b2070 con 0x7fb43c06c610 2024-04-26T23:42:07.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.584+0000 7fb43be00640 1 -- 172.21.15.137:0/529747450 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4340a5940 con 0x7fb43c06c610 2024-04-26T23:42:07.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.584+0000 7fb43be00640 1 -- 172.21.15.137:0/529747450 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4340a5d10 con 0x7fb43c06c610 2024-04-26T23:42:07.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.584+0000 7fb444400640 1 -- 172.21.15.137:0/529747450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb43c06c610 msgr2=0x7fb43c0cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:07.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.584+0000 7fb444400640 1 --2- 172.21.15.137:0/529747450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb43c06c610 0x7fb43c0cf670 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb434009d90 tx=0x7fb43401c970 comp rx=0 tx=0).stop 2024-04-26T23:42:07.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.584+0000 7fb444400640 1 -- 172.21.15.137:0/529747450 shutdown_connections 2024-04-26T23:42:07.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.584+0000 7fb444400640 1 --2- 172.21.15.137:0/529747450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb43c06c610 0x7fb43c0cf670 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.584+0000 7fb444400640 1 --2- 172.21.15.137:0/529747450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb43c06d370 0x7fb43c0b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.584+0000 7fb444400640 1 -- 172.21.15.137:0/529747450 >> 172.21.15.137:0/529747450 conn(0x7fb43c09ba60 msgr2=0x7fb43c09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:07.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.584+0000 7fb444400640 1 -- 172.21.15.137:0/529747450 shutdown_connections 2024-04-26T23:42:07.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.584+0000 7fb444400640 1 -- 172.21.15.137:0/529747450 wait complete. 2024-04-26T23:42:07.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.584+0000 7fb444400640 1 Processor -- start 2024-04-26T23:42:07.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.584+0000 7fb444400640 1 -- start start 2024-04-26T23:42:07.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb444400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb43c06c610 0x7fb43c14a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:07.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb444400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb43c06d370 0x7fb43c15bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:07.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb444400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb43c15f4d0 0x7fb43c157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:07.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb444400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c0d2060 con 0x7fb43c06d370 2024-04-26T23:42:07.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb444400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c0d1ee0 con 0x7fb43c15f4d0 2024-04-26T23:42:07.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb444400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb43c0d21e0 con 0x7fb43c06c610 2024-04-26T23:42:07.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb441000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb43c06d370 0x7fb43c15bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:07.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb441000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb43c06d370 0x7fb43c15bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38470/0 (socket says 172.21.15.137:38470) 2024-04-26T23:42:07.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb441000640 1 -- 172.21.15.137:0/3068341956 learned_addr learned my addr 172.21.15.137:0/3068341956 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:07.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb441a00640 1 --2- 172.21.15.137:0/3068341956 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb43c06c610 0x7fb43c14a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:07.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb442400640 1 --2- 172.21.15.137:0/3068341956 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb43c15f4d0 0x7fb43c157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:07.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb441000640 1 -- 172.21.15.137:0/3068341956 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb43c06c610 msgr2=0x7fb43c14a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:07.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb441000640 1 --2- 172.21.15.137:0/3068341956 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb43c06c610 0x7fb43c14a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb441000640 1 -- 172.21.15.137:0/3068341956 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb43c15f4d0 msgr2=0x7fb43c157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:07.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb441000640 1 --2- 172.21.15.137:0/3068341956 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb43c15f4d0 0x7fb43c157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb441000640 1 -- 172.21.15.137:0/3068341956 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43c15c5d0 con 0x7fb43c06d370 2024-04-26T23:42:07.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb441000640 1 --2- 172.21.15.137:0/3068341956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb43c06d370 0x7fb43c15bad0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb42800c7f0 tx=0x7fb42800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:07.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb439600640 1 -- 172.21.15.137:0/3068341956 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb428007a30 con 0x7fb43c06d370 2024-04-26T23:42:07.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb439600640 1 -- 172.21.15.137:0/3068341956 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb428007bd0 con 0x7fb43c06d370 2024-04-26T23:42:07.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb444400640 1 -- 172.21.15.137:0/3068341956 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb43c154850 con 0x7fb43c06d370 2024-04-26T23:42:07.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb439600640 1 -- 172.21.15.137:0/3068341956 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4280113f0 con 0x7fb43c06d370 2024-04-26T23:42:07.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb444400640 1 -- 172.21.15.137:0/3068341956 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb43c154e10 con 0x7fb43c06d370 2024-04-26T23:42:07.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb444400640 1 -- 172.21.15.137:0/3068341956 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb43c06a410 con 0x7fb43c06d370 2024-04-26T23:42:07.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.588+0000 7fb439600640 1 -- 172.21.15.137:0/3068341956 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb428011590 con 0x7fb43c06d370 2024-04-26T23:42:07.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.592+0000 7fb439600640 1 --2- 172.21.15.137:0/3068341956 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb41c068380 0x7fb41c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:07.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.592+0000 7fb439600640 1 -- 172.21.15.137:0/3068341956 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fb428086bd0 con 0x7fb43c06d370 2024-04-26T23:42:07.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.592+0000 7fb441a00640 1 --2- 172.21.15.137:0/3068341956 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb41c068380 0x7fb41c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:07.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.592+0000 7fb441a00640 1 --2- 172.21.15.137:0/3068341956 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb41c068380 0x7fb41c06a840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb43c150090 tx=0x7fb430007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:07.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.596+0000 7fb439600640 1 -- 172.21.15.137:0/3068341956 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb428015020 con 0x7fb43c06d370 2024-04-26T23:42:07.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.752+0000 7fb444400640 1 -- 172.21.15.137:0/3068341956 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb43c14a950 con 0x7fb43c06d370 2024-04-26T23:42:07.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.752+0000 7fb439600640 1 -- 172.21.15.137:0/3068341956 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fb428056ab0 con 0x7fb43c06d370 2024-04-26T23:42:07.757 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:42:07.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.752+0000 7fb444400640 1 -- 172.21.15.137:0/3068341956 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb41c068380 msgr2=0x7fb41c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:07.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.752+0000 7fb444400640 1 --2- 172.21.15.137:0/3068341956 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb41c068380 0x7fb41c06a840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb43c150090 tx=0x7fb430007e90 comp rx=0 tx=0).stop 2024-04-26T23:42:07.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.752+0000 7fb444400640 1 -- 172.21.15.137:0/3068341956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb43c06d370 msgr2=0x7fb43c15bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:07.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.752+0000 7fb444400640 1 --2- 172.21.15.137:0/3068341956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb43c06d370 0x7fb43c15bad0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb42800c7f0 tx=0x7fb42800ccb0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.752+0000 7fb444400640 1 -- 172.21.15.137:0/3068341956 shutdown_connections 2024-04-26T23:42:07.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.752+0000 7fb444400640 1 --2- 172.21.15.137:0/3068341956 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb41c068380 0x7fb41c06a840 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.752+0000 7fb444400640 1 --2- 172.21.15.137:0/3068341956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb43c06d370 0x7fb43c15bad0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.752+0000 7fb444400640 1 --2- 172.21.15.137:0/3068341956 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb43c15f4d0 0x7fb43c157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.752+0000 7fb444400640 1 --2- 172.21.15.137:0/3068341956 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb43c06c610 0x7fb43c14a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.752+0000 7fb444400640 1 -- 172.21.15.137:0/3068341956 >> 172.21.15.137:0/3068341956 conn(0x7fb43c09ba60 msgr2=0x7fb43c09be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:07.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.752+0000 7fb444400640 1 -- 172.21.15.137:0/3068341956 shutdown_connections 2024-04-26T23:42:07.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.752+0000 7fb444400640 1 -- 172.21.15.137:0/3068341956 wait complete. 2024-04-26T23:42:07.782 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:42:07.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.916+0000 7f567fe00640 1 Processor -- start 2024-04-26T23:42:07.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.916+0000 7f567fe00640 1 -- start start 2024-04-26T23:42:07.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.916+0000 7f567fe00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5678072930 0x7f5678072db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:07.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.916+0000 7f567fe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f56780afc80 0x7f56780b0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:07.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.916+0000 7f567fe00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56780b59a0 con 0x7f5678159560 2024-04-26T23:42:07.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.916+0000 7f567fe00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f56780b5c50 con 0x7f56780afc80 2024-04-26T23:42:07.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.916+0000 7f567fe00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f56780b5f30 con 0x7f5678072930 2024-04-26T23:42:07.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.916+0000 7f567de00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f56780afc80 0x7f56780b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:07.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.916+0000 7f567d400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f5678159560 0x7f56780b5290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52692/0 (socket says 172.21.15.137:52692) 2024-04-26T23:42:07.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.916+0000 7f567d400640 1 -- 172.21.15.137:0/2072251521 learned_addr learned my addr 172.21.15.137:0/2072251521 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:07.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.916+0000 7f567ca00640 1 --2- 172.21.15.137:0/2072251521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5678072930 0x7f5678072db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:07.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.916+0000 7f567de00640 1 -- 172.21.15.137:0/2072251521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5678072930 msgr2=0x7f5678072db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:07.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.916+0000 7f567de00640 1 --2- 172.21.15.137:0/2072251521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5678072930 0x7f5678072db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.916+0000 7f567de00640 1 -- 172.21.15.137:0/2072251521 >> v1:172.21.15.137:6789/0 conn(0x7f5678159560 legacy=0x7f56780b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:07.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.916+0000 7f567de00640 1 -- 172.21.15.137:0/2072251521 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56780b6210 con 0x7f56780afc80 2024-04-26T23:42:07.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.920+0000 7f567de00640 1 --2- 172.21.15.137:0/2072251521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56780afc80 0x7f56780b0110 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5670009d90 tx=0x7f567001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9944d8708a0854 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:07.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.920+0000 7f5677e00640 1 -- 172.21.15.137:0/2072251521 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56700b2070 con 0x7f56780afc80 2024-04-26T23:42:07.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.920+0000 7f5677e00640 1 -- 172.21.15.137:0/2072251521 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56700a5830 con 0x7f56780afc80 2024-04-26T23:42:07.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.920+0000 7f5677e00640 1 -- 172.21.15.137:0/2072251521 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56700a5c00 con 0x7f56780afc80 2024-04-26T23:42:07.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.920+0000 7f567fe00640 1 -- 172.21.15.137:0/2072251521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56780afc80 msgr2=0x7f56780b0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:07.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.920+0000 7f567fe00640 1 --2- 172.21.15.137:0/2072251521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56780afc80 0x7f56780b0110 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5670009d90 tx=0x7f567001c970 comp rx=0 tx=0).stop 2024-04-26T23:42:07.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.920+0000 7f567fe00640 1 -- 172.21.15.137:0/2072251521 shutdown_connections 2024-04-26T23:42:07.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.920+0000 7f567fe00640 1 --2- 172.21.15.137:0/2072251521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56780afc80 0x7f56780b0110 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.920+0000 7f567fe00640 1 --2- 172.21.15.137:0/2072251521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5678072930 0x7f5678072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.920+0000 7f567fe00640 1 -- 172.21.15.137:0/2072251521 >> 172.21.15.137:0/2072251521 conn(0x7f56780b3370 msgr2=0x7f56780b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:07.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.920+0000 7f567fe00640 1 -- 172.21.15.137:0/2072251521 shutdown_connections 2024-04-26T23:42:07.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.920+0000 7f567fe00640 1 -- 172.21.15.137:0/2072251521 wait complete. 2024-04-26T23:42:07.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567fe00640 1 Processor -- start 2024-04-26T23:42:07.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567fe00640 1 -- start start 2024-04-26T23:42:07.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5678072930 0x7f5678148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:07.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567fe00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56780afc80 0x7f5678156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:07.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5678159560 0x7f567814fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:07.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f567815f7d0 con 0x7f5678072930 2024-04-26T23:42:07.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567fe00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5678159b50 con 0x7f5678159560 2024-04-26T23:42:07.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567fe00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f567815f950 con 0x7f56780afc80 2024-04-26T23:42:07.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567d400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5678072930 0x7f5678148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:07.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567d400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5678072930 0x7f5678148e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38492/0 (socket says 172.21.15.137:38492) 2024-04-26T23:42:07.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567d400640 1 -- 172.21.15.137:0/1943720549 learned_addr learned my addr 172.21.15.137:0/1943720549 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:07.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567ca00640 1 --2- 172.21.15.137:0/1943720549 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56780afc80 0x7f5678156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:07.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567de00640 1 --2- 172.21.15.137:0/1943720549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5678159560 0x7f567814fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:07.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567d400640 1 -- 172.21.15.137:0/1943720549 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56780afc80 msgr2=0x7f5678156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:07.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567d400640 1 --2- 172.21.15.137:0/1943720549 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56780afc80 0x7f5678156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567d400640 1 -- 172.21.15.137:0/1943720549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5678159560 msgr2=0x7f567814fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:07.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567d400640 1 --2- 172.21.15.137:0/1943720549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5678159560 0x7f567814fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567d400640 1 -- 172.21.15.137:0/1943720549 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5678150900 con 0x7f5678072930 2024-04-26T23:42:07.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567ca00640 1 --2- 172.21.15.137:0/1943720549 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56780afc80 0x7f5678156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:07.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567d400640 1 --2- 172.21.15.137:0/1943720549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5678072930 0x7f5678148e80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f566c00c450 tx=0x7f566c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:07.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f5675600640 1 -- 172.21.15.137:0/1943720549 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566c017070 con 0x7f5678072930 2024-04-26T23:42:07.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f5675600640 1 -- 172.21.15.137:0/1943720549 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f566c005cf0 con 0x7f5678072930 2024-04-26T23:42:07.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f5675600640 1 -- 172.21.15.137:0/1943720549 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566c007290 con 0x7f5678072930 2024-04-26T23:42:07.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567fe00640 1 -- 172.21.15.137:0/1943720549 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5678150be0 con 0x7f5678072930 2024-04-26T23:42:07.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567fe00640 1 -- 172.21.15.137:0/1943720549 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f567814b1a0 con 0x7f5678072930 2024-04-26T23:42:07.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.924+0000 7f567fe00640 1 -- 172.21.15.137:0/1943720549 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f567806a410 con 0x7f5678072930 2024-04-26T23:42:07.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.928+0000 7f5675600640 1 -- 172.21.15.137:0/1943720549 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f566c01a070 con 0x7f5678072930 2024-04-26T23:42:07.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.928+0000 7f5675600640 1 --2- 172.21.15.137:0/1943720549 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5658068380 0x7f565806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:07.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.928+0000 7f5675600640 1 -- 172.21.15.137:0/1943720549 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f566c085e00 con 0x7f5678072930 2024-04-26T23:42:07.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.928+0000 7f567ca00640 1 --2- 172.21.15.137:0/1943720549 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5658068380 0x7f565806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:07.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.928+0000 7f567ca00640 1 --2- 172.21.15.137:0/1943720549 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5658068380 0x7f565806a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f56781fb690 tx=0x7f5664008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:07.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:07.932+0000 7f5675600640 1 -- 172.21.15.137:0/1943720549 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f566c0562a0 con 0x7f5678072930 2024-04-26T23:42:08.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.088+0000 7f567fe00640 1 -- 172.21.15.137:0/1943720549 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5678161790 con 0x7f5678072930 2024-04-26T23:42:08.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.088+0000 7f5675600640 1 -- 172.21.15.137:0/1943720549 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f566c055ba0 con 0x7f5678072930 2024-04-26T23:42:08.093 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:42:08.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.088+0000 7f567fe00640 1 -- 172.21.15.137:0/1943720549 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5658068380 msgr2=0x7f565806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:08.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.088+0000 7f567fe00640 1 --2- 172.21.15.137:0/1943720549 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5658068380 0x7f565806a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f56781fb690 tx=0x7f5664008040 comp rx=0 tx=0).stop 2024-04-26T23:42:08.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.088+0000 7f567fe00640 1 -- 172.21.15.137:0/1943720549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5678072930 msgr2=0x7f5678148e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:08.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.088+0000 7f567fe00640 1 --2- 172.21.15.137:0/1943720549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5678072930 0x7f5678148e80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f566c00c450 tx=0x7f566c00c910 comp rx=0 tx=0).stop 2024-04-26T23:42:08.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.088+0000 7f567fe00640 1 -- 172.21.15.137:0/1943720549 shutdown_connections 2024-04-26T23:42:08.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.088+0000 7f567fe00640 1 --2- 172.21.15.137:0/1943720549 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5658068380 0x7f565806a840 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.088+0000 7f567fe00640 1 --2- 172.21.15.137:0/1943720549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5678159560 0x7f567814fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.088+0000 7f567fe00640 1 --2- 172.21.15.137:0/1943720549 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56780afc80 0x7f5678156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.088+0000 7f567fe00640 1 --2- 172.21.15.137:0/1943720549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5678072930 0x7f5678148e80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.088+0000 7f567fe00640 1 -- 172.21.15.137:0/1943720549 >> 172.21.15.137:0/1943720549 conn(0x7f56780b3370 msgr2=0x7f567814f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:08.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.088+0000 7f567fe00640 1 -- 172.21.15.137:0/1943720549 shutdown_connections 2024-04-26T23:42:08.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.088+0000 7f567fe00640 1 -- 172.21.15.137:0/1943720549 wait complete. 2024-04-26T23:42:08.114 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:42:08.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.248+0000 7f2bd5800640 1 Processor -- start 2024-04-26T23:42:08.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.248+0000 7f2bd5800640 1 -- start start 2024-04-26T23:42:08.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.248+0000 7f2bd5800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2bd00afbc0 0x7f2bd015df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:08.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.248+0000 7f2bd5800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2bd00affa0 0x7f2bd00ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:08.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.248+0000 7f2bd5800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bd0072860 con 0x7f2bd0073f20 2024-04-26T23:42:08.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.248+0000 7f2bd5800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2bd00743b0 con 0x7f2bd00affa0 2024-04-26T23:42:08.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.248+0000 7f2bd5800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f2bd0072b00 con 0x7f2bd00afbc0 2024-04-26T23:42:08.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.248+0000 7f2bce000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f2bd0073f20 0x7f2bd00735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52702/0 (socket says 172.21.15.137:52702) 2024-04-26T23:42:08.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.248+0000 7f2bce000640 1 -- 172.21.15.137:0/148281102 learned_addr learned my addr 172.21.15.137:0/148281102 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:08.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.248+0000 7f2bcf400640 1 --2- 172.21.15.137:0/148281102 >> v2:172.21.15.137:3300/0 conn(0x7f2bd00affa0 0x7f2bd00ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:08.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.248+0000 7f2bcea00640 1 --2- 172.21.15.137:0/148281102 >> v2:172.21.15.170:3300/0 conn(0x7f2bd00afbc0 0x7f2bd015df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:08.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.248+0000 7f2bcd600640 1 -- 172.21.15.137:0/148281102 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 768549202 0 0) 0x7f2bd0072860 con 0x7f2bd0073f20 2024-04-26T23:42:08.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.248+0000 7f2bcd600640 1 -- 172.21.15.137:0/148281102 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bb4003530 con 0x7f2bd0073f20 2024-04-26T23:42:08.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.248+0000 7f2bcf400640 1 -- 172.21.15.137:0/148281102 >> v2:172.21.15.170:3300/0 conn(0x7f2bd00afbc0 msgr2=0x7f2bd015df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:08.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.248+0000 7f2bcf400640 1 --2- 172.21.15.137:0/148281102 >> v2:172.21.15.170:3300/0 conn(0x7f2bd00afbc0 0x7f2bd015df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.248+0000 7f2bcf400640 1 -- 172.21.15.137:0/148281102 >> v1:172.21.15.137:6789/0 conn(0x7f2bd0073f20 legacy=0x7f2bd00735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:08.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.248+0000 7f2bcf400640 1 -- 172.21.15.137:0/148281102 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd0072de0 con 0x7f2bd00affa0 2024-04-26T23:42:08.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.252+0000 7f2bcf400640 1 --2- 172.21.15.137:0/148281102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd00affa0 0x7f2bd00ce3b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8009d90 tx=0x7f2bc801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92406344396b20dd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:08.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.252+0000 7f2bcd600640 1 -- 172.21.15.137:0/148281102 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc80b2070 con 0x7f2bd00affa0 2024-04-26T23:42:08.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.252+0000 7f2bcd600640 1 -- 172.21.15.137:0/148281102 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc80a57f0 con 0x7f2bd00affa0 2024-04-26T23:42:08.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.252+0000 7f2bcd600640 1 -- 172.21.15.137:0/148281102 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc80a5bc0 con 0x7f2bd00affa0 2024-04-26T23:42:08.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.252+0000 7f2bd5800640 1 -- 172.21.15.137:0/148281102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd00affa0 msgr2=0x7f2bd00ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:08.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.252+0000 7f2bd5800640 1 --2- 172.21.15.137:0/148281102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd00affa0 0x7f2bd00ce3b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8009d90 tx=0x7f2bc801c930 comp rx=0 tx=0).stop 2024-04-26T23:42:08.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.252+0000 7f2bd5800640 1 -- 172.21.15.137:0/148281102 shutdown_connections 2024-04-26T23:42:08.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.252+0000 7f2bd5800640 1 --2- 172.21.15.137:0/148281102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd00affa0 0x7f2bd00ce3b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.252+0000 7f2bd5800640 1 --2- 172.21.15.137:0/148281102 >> v2:172.21.15.170:3300/0 conn(0x7f2bd00afbc0 0x7f2bd015df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.252+0000 7f2bd5800640 1 -- 172.21.15.137:0/148281102 >> 172.21.15.137:0/148281102 conn(0x7f2bd006c800 msgr2=0x7f2bd006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:08.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.252+0000 7f2bd5800640 1 -- 172.21.15.137:0/148281102 shutdown_connections 2024-04-26T23:42:08.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.252+0000 7f2bd5800640 1 -- 172.21.15.137:0/148281102 wait complete. 2024-04-26T23:42:08.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bd5800640 1 Processor -- start 2024-04-26T23:42:08.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bd5800640 1 -- start start 2024-04-26T23:42:08.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bd5800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd00afbc0 0x7f2bd0155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:08.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bd5800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bd00affa0 0x7f2bd0146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:08.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bd5800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bd0151110 0x7f2bd0152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:08.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bd5800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd006f360 con 0x7f2bd00afbc0 2024-04-26T23:42:08.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bd5800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd006f1e0 con 0x7f2bd00affa0 2024-04-26T23:42:08.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bd5800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2bd006f4e0 con 0x7f2bd0151110 2024-04-26T23:42:08.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bcea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd00afbc0 0x7f2bd0155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:08.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bcea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd00afbc0 0x7f2bd0155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38500/0 (socket says 172.21.15.137:38500) 2024-04-26T23:42:08.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bcea00640 1 -- 172.21.15.137:0/4029471019 learned_addr learned my addr 172.21.15.137:0/4029471019 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:08.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bce000640 1 --2- 172.21.15.137:0/4029471019 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bd00affa0 0x7f2bd0146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:08.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bcf400640 1 --2- 172.21.15.137:0/4029471019 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bd0151110 0x7f2bd0152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:08.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bcea00640 1 -- 172.21.15.137:0/4029471019 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bd0151110 msgr2=0x7f2bd0152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:08.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bcea00640 1 --2- 172.21.15.137:0/4029471019 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bd0151110 0x7f2bd0152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bcea00640 1 -- 172.21.15.137:0/4029471019 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bd00affa0 msgr2=0x7f2bd0146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:08.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bcea00640 1 --2- 172.21.15.137:0/4029471019 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bd00affa0 0x7f2bd0146610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bcea00640 1 -- 172.21.15.137:0/4029471019 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd01542a0 con 0x7f2bd00afbc0 2024-04-26T23:42:08.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bce000640 1 --2- 172.21.15.137:0/4029471019 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bd00affa0 0x7f2bd0146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:08.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bcea00640 1 --2- 172.21.15.137:0/4029471019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd00afbc0 0x7f2bd0155340 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2bc000e930 tx=0x7f2bc000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:08.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bc6a00640 1 -- 172.21.15.137:0/4029471019 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0017070 con 0x7f2bd00afbc0 2024-04-26T23:42:08.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bc6a00640 1 -- 172.21.15.137:0/4029471019 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc000ca00 con 0x7f2bd00afbc0 2024-04-26T23:42:08.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bd5800640 1 -- 172.21.15.137:0/4029471019 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd0154580 con 0x7f2bd00afbc0 2024-04-26T23:42:08.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bc6a00640 1 -- 172.21.15.137:0/4029471019 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc000cdb0 con 0x7f2bd00afbc0 2024-04-26T23:42:08.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bd5800640 1 -- 172.21.15.137:0/4029471019 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd0154b40 con 0x7f2bd00afbc0 2024-04-26T23:42:08.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.256+0000 7f2bd5800640 1 -- 172.21.15.137:0/4029471019 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bd006a410 con 0x7f2bd00afbc0 2024-04-26T23:42:08.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.260+0000 7f2bc6a00640 1 -- 172.21.15.137:0/4029471019 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2bc001a070 con 0x7f2bd00afbc0 2024-04-26T23:42:08.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.260+0000 7f2bc6a00640 1 --2- 172.21.15.137:0/4029471019 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2bb0068380 0x7f2bb006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:08.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.260+0000 7f2bc6a00640 1 -- 172.21.15.137:0/4029471019 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f2bc0086e20 con 0x7f2bd00afbc0 2024-04-26T23:42:08.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.260+0000 7f2bce000640 1 --2- 172.21.15.137:0/4029471019 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2bb0068380 0x7f2bb006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:08.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.260+0000 7f2bce000640 1 --2- 172.21.15.137:0/4029471019 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2bb0068380 0x7f2bb006a840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc005890 tx=0x7f2bbc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:08.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.264+0000 7f2bc6a00640 1 -- 172.21.15.137:0/4029471019 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2bc0057410 con 0x7f2bd00afbc0 2024-04-26T23:42:08.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.420+0000 7f2bd5800640 1 -- 172.21.15.137:0/4029471019 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2bd0160870 con 0x7f2bd00afbc0 2024-04-26T23:42:08.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.420+0000 7f2bc6a00640 1 -- 172.21.15.137:0/4029471019 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f2bc0056d10 con 0x7f2bd00afbc0 2024-04-26T23:42:08.426 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:42:08.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.424+0000 7f2bd5800640 1 -- 172.21.15.137:0/4029471019 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2bb0068380 msgr2=0x7f2bb006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:08.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.424+0000 7f2bd5800640 1 --2- 172.21.15.137:0/4029471019 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2bb0068380 0x7f2bb006a840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc005890 tx=0x7f2bbc009040 comp rx=0 tx=0).stop 2024-04-26T23:42:08.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.424+0000 7f2bd5800640 1 -- 172.21.15.137:0/4029471019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd00afbc0 msgr2=0x7f2bd0155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:08.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.424+0000 7f2bd5800640 1 --2- 172.21.15.137:0/4029471019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd00afbc0 0x7f2bd0155340 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2bc000e930 tx=0x7f2bc000edf0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.424+0000 7f2bd5800640 1 -- 172.21.15.137:0/4029471019 shutdown_connections 2024-04-26T23:42:08.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.424+0000 7f2bd5800640 1 --2- 172.21.15.137:0/4029471019 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2bb0068380 0x7f2bb006a840 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.424+0000 7f2bd5800640 1 --2- 172.21.15.137:0/4029471019 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bd0151110 0x7f2bd0152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.424+0000 7f2bd5800640 1 --2- 172.21.15.137:0/4029471019 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bd00affa0 0x7f2bd0146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.424+0000 7f2bd5800640 1 --2- 172.21.15.137:0/4029471019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd00afbc0 0x7f2bd0155340 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.424+0000 7f2bd5800640 1 -- 172.21.15.137:0/4029471019 >> 172.21.15.137:0/4029471019 conn(0x7f2bd006c800 msgr2=0x7f2bd006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:08.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.424+0000 7f2bd5800640 1 -- 172.21.15.137:0/4029471019 shutdown_connections 2024-04-26T23:42:08.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.424+0000 7f2bd5800640 1 -- 172.21.15.137:0/4029471019 wait complete. 2024-04-26T23:42:08.448 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:42:08.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.580+0000 7fcb2a000640 1 Processor -- start 2024-04-26T23:42:08.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.580+0000 7fcb2a000640 1 -- start start 2024-04-26T23:42:08.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.580+0000 7fcb2a000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fcb2415f3d0 0x7fcb240d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:08.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.580+0000 7fcb2a000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb240b4100 0x7fcb2415f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:08.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.580+0000 7fcb2a000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcb2415fcf0 0x7fcb240d2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:08.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.580+0000 7fcb2a000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fcb240b2960 con 0x7fcb2415fcf0 2024-04-26T23:42:08.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.580+0000 7fcb2a000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fcb24160240 con 0x7fcb2415f3d0 2024-04-26T23:42:08.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.580+0000 7fcb2a000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcb24160520 con 0x7fcb240b4100 2024-04-26T23:42:08.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.580+0000 7fcb23e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcb2415fcf0 0x7fcb240d2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:08.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.580+0000 7fcb23e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcb2415fcf0 0x7fcb240d2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38510/0 (socket says 172.21.15.137:38510) 2024-04-26T23:42:08.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.580+0000 7fcb23e00640 1 -- 172.21.15.137:0/2622082517 learned_addr learned my addr 172.21.15.137:0/2622082517 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:08.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.580+0000 7fcb22a00640 1 --2- 172.21.15.137:0/2622082517 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb240b4100 0x7fcb2415f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:08.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.580+0000 7fcb23400640 1 --2- 172.21.15.137:0/2622082517 >> v2:172.21.15.170:3300/0 conn(0x7fcb2415f3d0 0x7fcb240d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:08.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.580+0000 7fcb23e00640 1 -- 172.21.15.137:0/2622082517 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb240b4100 msgr2=0x7fcb2415f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:08.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.580+0000 7fcb23e00640 1 --2- 172.21.15.137:0/2622082517 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb240b4100 0x7fcb2415f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.580+0000 7fcb23e00640 1 -- 172.21.15.137:0/2622082517 >> v2:172.21.15.170:3300/0 conn(0x7fcb2415f3d0 msgr2=0x7fcb240d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:08.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.580+0000 7fcb23e00640 1 --2- 172.21.15.137:0/2622082517 >> v2:172.21.15.170:3300/0 conn(0x7fcb2415f3d0 0x7fcb240d1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.580+0000 7fcb23e00640 1 -- 172.21.15.137:0/2622082517 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb24160800 con 0x7fcb2415fcf0 2024-04-26T23:42:08.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.584+0000 7fcb23e00640 1 --2- 172.21.15.137:0/2622082517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb2415fcf0 0x7fcb240d2d80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcb24074680 tx=0x7fcb1c01c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2bc20738effd420 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:08.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.584+0000 7fcb22000640 1 -- 172.21.15.137:0/2622082517 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0a55a0 con 0x7fcb2415fcf0 2024-04-26T23:42:08.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.584+0000 7fcb22000640 1 -- 172.21.15.137:0/2622082517 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb1c0a5740 con 0x7fcb2415fcf0 2024-04-26T23:42:08.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.584+0000 7fcb22000640 1 -- 172.21.15.137:0/2622082517 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0a5b10 con 0x7fcb2415fcf0 2024-04-26T23:42:08.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.584+0000 7fcb2a000640 1 -- 172.21.15.137:0/2622082517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb2415fcf0 msgr2=0x7fcb240d2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:08.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.584+0000 7fcb2a000640 1 --2- 172.21.15.137:0/2622082517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb2415fcf0 0x7fcb240d2d80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcb24074680 tx=0x7fcb1c01c810 comp rx=0 tx=0).stop 2024-04-26T23:42:08.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.584+0000 7fcb2a000640 1 -- 172.21.15.137:0/2622082517 shutdown_connections 2024-04-26T23:42:08.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.584+0000 7fcb2a000640 1 --2- 172.21.15.137:0/2622082517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb2415fcf0 0x7fcb240d2d80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.584+0000 7fcb2a000640 1 --2- 172.21.15.137:0/2622082517 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb240b4100 0x7fcb2415f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.584+0000 7fcb2a000640 1 --2- 172.21.15.137:0/2622082517 >> v2:172.21.15.170:3300/0 conn(0x7fcb2415f3d0 0x7fcb240d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.584+0000 7fcb2a000640 1 -- 172.21.15.137:0/2622082517 >> 172.21.15.137:0/2622082517 conn(0x7fcb2409ba60 msgr2=0x7fcb2409be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:08.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.584+0000 7fcb2a000640 1 -- 172.21.15.137:0/2622082517 shutdown_connections 2024-04-26T23:42:08.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.584+0000 7fcb2a000640 1 -- 172.21.15.137:0/2622082517 wait complete. 2024-04-26T23:42:08.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb2a000640 1 Processor -- start 2024-04-26T23:42:08.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb2a000640 1 -- start start 2024-04-26T23:42:08.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb2a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb240b4100 0x7fcb2415e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:08.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb2a000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb2415f3d0 0x7fcb2414d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:08.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb2a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb2415fcf0 0x7fcb240b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:08.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb2a000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcb240d0370 con 0x7fcb240b4100 2024-04-26T23:42:08.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb2a000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcb240d01f0 con 0x7fcb2415fcf0 2024-04-26T23:42:08.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb2a000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcb240d04f0 con 0x7fcb2415f3d0 2024-04-26T23:42:08.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb23400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb240b4100 0x7fcb2415e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:08.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb23400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb240b4100 0x7fcb2415e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38518/0 (socket says 172.21.15.137:38518) 2024-04-26T23:42:08.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb23400640 1 -- 172.21.15.137:0/4272009730 learned_addr learned my addr 172.21.15.137:0/4272009730 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:08.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb23e00640 1 --2- 172.21.15.137:0/4272009730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb2415fcf0 0x7fcb240b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:08.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb22a00640 1 --2- 172.21.15.137:0/4272009730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb2415f3d0 0x7fcb2414d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:08.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb23400640 1 -- 172.21.15.137:0/4272009730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb2415f3d0 msgr2=0x7fcb2414d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:08.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb23400640 1 --2- 172.21.15.137:0/4272009730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb2415f3d0 0x7fcb2414d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb23400640 1 -- 172.21.15.137:0/4272009730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb2415fcf0 msgr2=0x7fcb240b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:08.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb23400640 1 --2- 172.21.15.137:0/4272009730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb2415fcf0 0x7fcb240b0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb23400640 1 -- 172.21.15.137:0/4272009730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2415eab0 con 0x7fcb240b4100 2024-04-26T23:42:08.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb23400640 1 --2- 172.21.15.137:0/4272009730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb240b4100 0x7fcb2415e570 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400d830 tx=0x7fcb1400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:08.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb1b400640 1 -- 172.21.15.137:0/4272009730 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1400b6c0 con 0x7fcb240b4100 2024-04-26T23:42:08.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb1b400640 1 -- 172.21.15.137:0/4272009730 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb14019070 con 0x7fcb240b4100 2024-04-26T23:42:08.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb1b400640 1 -- 172.21.15.137:0/4272009730 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1400ba60 con 0x7fcb240b4100 2024-04-26T23:42:08.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb2a000640 1 -- 172.21.15.137:0/4272009730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb241595c0 con 0x7fcb240b4100 2024-04-26T23:42:08.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb2a000640 1 -- 172.21.15.137:0/4272009730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb24159b80 con 0x7fcb240b4100 2024-04-26T23:42:08.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.588+0000 7fcb2a000640 1 -- 172.21.15.137:0/4272009730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb2406a4b0 con 0x7fcb240b4100 2024-04-26T23:42:08.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.592+0000 7fcb1b400640 1 -- 172.21.15.137:0/4272009730 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcb1401e460 con 0x7fcb240b4100 2024-04-26T23:42:08.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.592+0000 7fcb1b400640 1 --2- 172.21.15.137:0/4272009730 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fcb040683b0 0x7fcb0406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:08.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.592+0000 7fcb1b400640 1 -- 172.21.15.137:0/4272009730 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fcb14087070 con 0x7fcb240b4100 2024-04-26T23:42:08.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.592+0000 7fcb22a00640 1 --2- 172.21.15.137:0/4272009730 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fcb040683b0 0x7fcb0406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:08.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.592+0000 7fcb22a00640 1 --2- 172.21.15.137:0/4272009730 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fcb040683b0 0x7fcb0406a870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcb2415af20 tx=0x7fcb10008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:08.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.596+0000 7fcb1b400640 1 -- 172.21.15.137:0/4272009730 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcb140575a0 con 0x7fcb240b4100 2024-04-26T23:42:08.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.764+0000 7fcb2a000640 1 -- 172.21.15.137:0/4272009730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcb24070250 con 0x7fcb240b4100 2024-04-26T23:42:08.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.764+0000 7fcb1b400640 1 -- 172.21.15.137:0/4272009730 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fcb14056ea0 con 0x7fcb240b4100 2024-04-26T23:42:08.769 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T23:42:08.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.764+0000 7fcb2a000640 1 -- 172.21.15.137:0/4272009730 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fcb040683b0 msgr2=0x7fcb0406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:08.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.764+0000 7fcb2a000640 1 --2- 172.21.15.137:0/4272009730 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fcb040683b0 0x7fcb0406a870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcb2415af20 tx=0x7fcb10008040 comp rx=0 tx=0).stop 2024-04-26T23:42:08.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.764+0000 7fcb2a000640 1 -- 172.21.15.137:0/4272009730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb240b4100 msgr2=0x7fcb2415e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:08.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.764+0000 7fcb2a000640 1 --2- 172.21.15.137:0/4272009730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb240b4100 0x7fcb2415e570 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400d830 tx=0x7fcb1400dcf0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.764+0000 7fcb2a000640 1 -- 172.21.15.137:0/4272009730 shutdown_connections 2024-04-26T23:42:08.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.764+0000 7fcb2a000640 1 --2- 172.21.15.137:0/4272009730 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fcb040683b0 0x7fcb0406a870 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.764+0000 7fcb2a000640 1 --2- 172.21.15.137:0/4272009730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb2415fcf0 0x7fcb240b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.764+0000 7fcb2a000640 1 --2- 172.21.15.137:0/4272009730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb2415f3d0 0x7fcb2414d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.764+0000 7fcb2a000640 1 --2- 172.21.15.137:0/4272009730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb240b4100 0x7fcb2415e570 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.764+0000 7fcb2a000640 1 -- 172.21.15.137:0/4272009730 >> 172.21.15.137:0/4272009730 conn(0x7fcb2409ba60 msgr2=0x7fcb24070dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:08.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.764+0000 7fcb2a000640 1 -- 172.21.15.137:0/4272009730 shutdown_connections 2024-04-26T23:42:08.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.768+0000 7fcb2a000640 1 -- 172.21.15.137:0/4272009730 wait complete. 2024-04-26T23:42:08.793 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:42:08.793 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:42:08.803 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:42:08.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.932+0000 7fe72dc00640 1 Processor -- start 2024-04-26T23:42:08.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.932+0000 7fe72dc00640 1 -- start start 2024-04-26T23:42:08.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.936+0000 7fe72dc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7280725a0 0x7fe7280cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:08.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.936+0000 7fe72dc00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe728073f30 0x7fe728072980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:08.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.936+0000 7fe72dc00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7280cfef0 con 0x7fe728072ec0 2024-04-26T23:42:08.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.936+0000 7fe72dc00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe7280cddc0 con 0x7fe728073f30 2024-04-26T23:42:08.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.936+0000 7fe72dc00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe7280d01b0 con 0x7fe7280725a0 2024-04-26T23:42:08.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.936+0000 7fe726a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7280725a0 0x7fe7280cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:08.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.936+0000 7fe71e000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe728073f30 0x7fe728072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:08.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.936+0000 7fe71e000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe728073f30 0x7fe728072980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:40644/0 (socket says 172.21.15.137:40644) 2024-04-26T23:42:08.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.936+0000 7fe726a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7280725a0 0x7fe7280cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:38316/0 (socket says 172.21.15.137:38316) 2024-04-26T23:42:08.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.936+0000 7fe71e000640 1 -- 172.21.15.137:0/4099062839 learned_addr learned my addr 172.21.15.137:0/4099062839 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:08.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.936+0000 7fe726a00640 1 -- 172.21.15.137:0/4099062839 >> v2:172.21.15.170:3300/0 conn(0x7fe728073f30 msgr2=0x7fe728072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:08.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.936+0000 7fe726a00640 1 --2- 172.21.15.137:0/4099062839 >> v2:172.21.15.170:3300/0 conn(0x7fe728073f30 0x7fe728072980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.936+0000 7fe726a00640 1 -- 172.21.15.137:0/4099062839 >> v1:172.21.15.170:6789/0 conn(0x7fe728072ec0 legacy=0x7fe7280b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:08.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.936+0000 7fe726a00640 1 -- 172.21.15.137:0/4099062839 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7280d0490 con 0x7fe7280725a0 2024-04-26T23:42:08.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.936+0000 7fe71e000640 1 --2- 172.21.15.137:0/4099062839 >> v2:172.21.15.170:3300/0 conn(0x7fe728073f30 0x7fe728072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:42:08.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.940+0000 7fe726a00640 1 --2- 172.21.15.137:0/4099062839 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7280725a0 0x7fe7280cd770 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe7180097c0 tx=0x7fe71801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dda117477f86beb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:08.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.940+0000 7fe726000640 1 -- 172.21.15.137:0/4099062839 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7180aa5f0 con 0x7fe7280725a0 2024-04-26T23:42:08.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.940+0000 7fe726000640 1 -- 172.21.15.137:0/4099062839 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7180af070 con 0x7fe7280725a0 2024-04-26T23:42:08.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.940+0000 7fe726000640 1 -- 172.21.15.137:0/4099062839 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7180aa9b0 con 0x7fe7280725a0 2024-04-26T23:42:08.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.940+0000 7fe72dc00640 1 -- 172.21.15.137:0/4099062839 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7280725a0 msgr2=0x7fe7280cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:08.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.940+0000 7fe72dc00640 1 --2- 172.21.15.137:0/4099062839 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7280725a0 0x7fe7280cd770 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe7180097c0 tx=0x7fe71801c470 comp rx=0 tx=0).stop 2024-04-26T23:42:08.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.940+0000 7fe72dc00640 1 -- 172.21.15.137:0/4099062839 shutdown_connections 2024-04-26T23:42:08.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.940+0000 7fe72dc00640 1 --2- 172.21.15.137:0/4099062839 >> v2:172.21.15.170:3300/0 conn(0x7fe728073f30 0x7fe728072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.940+0000 7fe72dc00640 1 --2- 172.21.15.137:0/4099062839 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7280725a0 0x7fe7280cd770 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.940+0000 7fe72dc00640 1 -- 172.21.15.137:0/4099062839 >> 172.21.15.137:0/4099062839 conn(0x7fe72806c5d0 msgr2=0x7fe72806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:08.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.940+0000 7fe72dc00640 1 -- 172.21.15.137:0/4099062839 shutdown_connections 2024-04-26T23:42:08.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.940+0000 7fe72dc00640 1 -- 172.21.15.137:0/4099062839 wait complete. 2024-04-26T23:42:08.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.940+0000 7fe72dc00640 1 Processor -- start 2024-04-26T23:42:08.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.940+0000 7fe72dc00640 1 -- start start 2024-04-26T23:42:08.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe72dc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7280725a0 0x7fe72815b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:08.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe72dc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe728072ec0 0x7fe72813c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:08.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe72dc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe728073f30 0x7fe72813c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:08.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe72dc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe7280b5110 con 0x7fe728072ec0 2024-04-26T23:42:08.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe72dc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe7280b4f90 con 0x7fe7280725a0 2024-04-26T23:42:08.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe72dc00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe7280b5290 con 0x7fe728073f30 2024-04-26T23:42:08.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe71e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe728072ec0 0x7fe72813c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:08.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe71e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe728072ec0 0x7fe72813c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38532/0 (socket says 172.21.15.137:38532) 2024-04-26T23:42:08.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe71e000640 1 -- 172.21.15.137:0/1822406311 learned_addr learned my addr 172.21.15.137:0/1822406311 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:08.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe727400640 1 --2- 172.21.15.137:0/1822406311 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe728073f30 0x7fe72813c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:08.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe726a00640 1 --2- 172.21.15.137:0/1822406311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7280725a0 0x7fe72815b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:08.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe71e000640 1 -- 172.21.15.137:0/1822406311 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe728073f30 msgr2=0x7fe72813c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:08.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe71e000640 1 --2- 172.21.15.137:0/1822406311 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe728073f30 0x7fe72813c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe71e000640 1 -- 172.21.15.137:0/1822406311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7280725a0 msgr2=0x7fe72815b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:08.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe71e000640 1 --2- 172.21.15.137:0/1822406311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7280725a0 0x7fe72815b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:08.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe71e000640 1 -- 172.21.15.137:0/1822406311 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7280aecb0 con 0x7fe728072ec0 2024-04-26T23:42:08.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe727400640 1 --2- 172.21.15.137:0/1822406311 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe728073f30 0x7fe72813c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:08.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe71e000640 1 --2- 172.21.15.137:0/1822406311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe728072ec0 0x7fe72813c490 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe71000eda0 tx=0x7fe71000d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:08.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe71f400640 1 -- 172.21.15.137:0/1822406311 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710010850 con 0x7fe728072ec0 2024-04-26T23:42:08.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe72dc00640 1 -- 172.21.15.137:0/1822406311 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7280aef90 con 0x7fe728072ec0 2024-04-26T23:42:08.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe71f400640 1 -- 172.21.15.137:0/1822406311 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7100109f0 con 0x7fe728072ec0 2024-04-26T23:42:08.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe71f400640 1 -- 172.21.15.137:0/1822406311 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710010da0 con 0x7fe728072ec0 2024-04-26T23:42:08.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe72dc00640 1 -- 172.21.15.137:0/1822406311 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7280af550 con 0x7fe728072ec0 2024-04-26T23:42:08.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.944+0000 7fe72dc00640 1 -- 172.21.15.137:0/1822406311 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7280af930 con 0x7fe728072ec0 2024-04-26T23:42:08.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.948+0000 7fe71f400640 1 -- 172.21.15.137:0/1822406311 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe71000f3d0 con 0x7fe728072ec0 2024-04-26T23:42:08.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.948+0000 7fe71f400640 1 --2- 172.21.15.137:0/1822406311 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe7040683b0 0x7fe70406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:08.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.948+0000 7fe71f400640 1 -- 172.21.15.137:0/1822406311 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fe7100870b0 con 0x7fe728072ec0 2024-04-26T23:42:08.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.948+0000 7fe726a00640 1 --2- 172.21.15.137:0/1822406311 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe7040683b0 0x7fe70406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:08.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.948+0000 7fe726a00640 1 --2- 172.21.15.137:0/1822406311 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe7040683b0 0x7fe70406a870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe7180ae000 tx=0x7fe7180a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:08.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:08.952+0000 7fe71f400640 1 -- 172.21.15.137:0/1822406311 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe7280af930 con 0x7fe728072ec0 2024-04-26T23:42:09.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.108+0000 7fe72dc00640 1 -- 172.21.15.137:0/1822406311 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe72806a4b0 con 0x7fe728072ec0 2024-04-26T23:42:09.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.112+0000 7fe71f400640 1 -- 172.21.15.137:0/1822406311 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16902 (secure 0 0 0) 0x7fe71007ee20 con 0x7fe728072ec0 2024-04-26T23:42:09.117 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:09.117 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":22,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:42:04.750301+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:42:09.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.112+0000 7fe72dc00640 1 -- 172.21.15.137:0/1822406311 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe7040683b0 msgr2=0x7fe70406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:09.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.112+0000 7fe72dc00640 1 --2- 172.21.15.137:0/1822406311 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe7040683b0 0x7fe70406a870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe7180ae000 tx=0x7fe7180a7000 comp rx=0 tx=0).stop 2024-04-26T23:42:09.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.112+0000 7fe72dc00640 1 -- 172.21.15.137:0/1822406311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe728072ec0 msgr2=0x7fe72813c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:09.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.112+0000 7fe72dc00640 1 --2- 172.21.15.137:0/1822406311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe728072ec0 0x7fe72813c490 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe71000eda0 tx=0x7fe71000d720 comp rx=0 tx=0).stop 2024-04-26T23:42:09.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.112+0000 7fe72dc00640 1 -- 172.21.15.137:0/1822406311 shutdown_connections 2024-04-26T23:42:09.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.112+0000 7fe72dc00640 1 --2- 172.21.15.137:0/1822406311 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe7040683b0 0x7fe70406a870 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.112+0000 7fe72dc00640 1 --2- 172.21.15.137:0/1822406311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe728072ec0 0x7fe72813c490 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.112+0000 7fe72dc00640 1 --2- 172.21.15.137:0/1822406311 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe728073f30 0x7fe72813c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.112+0000 7fe72dc00640 1 --2- 172.21.15.137:0/1822406311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7280725a0 0x7fe72815b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.112+0000 7fe72dc00640 1 -- 172.21.15.137:0/1822406311 >> 172.21.15.137:0/1822406311 conn(0x7fe72806c5d0 msgr2=0x7fe7280b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:09.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.112+0000 7fe72dc00640 1 -- 172.21.15.137:0/1822406311 shutdown_connections 2024-04-26T23:42:09.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.112+0000 7fe72dc00640 1 -- 172.21.15.137:0/1822406311 wait complete. 2024-04-26T23:42:09.139 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:41:21.810449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:41:22.533452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:42:09.139 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:42:09.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.272+0000 7fed9e400640 1 Processor -- start 2024-04-26T23:42:09.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.272+0000 7fed9e400640 1 -- start start 2024-04-26T23:42:09.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.272+0000 7fed9e400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed98159560 0x7fed980b5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:09.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.272+0000 7fed9e400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fed980b57d0 0x7fed98072930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:09.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.272+0000 7fed9e400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fed98072e70 0x7fed98162c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:09.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.272+0000 7fed9e400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fed980732e0 con 0x7fed980b57d0 2024-04-26T23:42:09.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.272+0000 7fed9e400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fed980b5c50 con 0x7fed98072e70 2024-04-26T23:42:09.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.272+0000 7fed9e400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fed980b5f30 con 0x7fed98159560 2024-04-26T23:42:09.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.272+0000 7fed96a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fed980b57d0 0x7fed98072930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:09.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.272+0000 7fed96a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fed980b57d0 0x7fed98072930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38544/0 (socket says 172.21.15.137:38544) 2024-04-26T23:42:09.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.272+0000 7fed96a00640 1 -- 172.21.15.137:0/3810219540 learned_addr learned my addr 172.21.15.137:0/3810219540 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:09.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.276+0000 7fed97400640 1 --2- 172.21.15.137:0/3810219540 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed98159560 0x7fed980b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:09.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.276+0000 7fed97e00640 1 --2- 172.21.15.137:0/3810219540 >> v2:172.21.15.170:3300/0 conn(0x7fed98072e70 0x7fed98162c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:09.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.276+0000 7fed96a00640 1 -- 172.21.15.137:0/3810219540 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed98159560 msgr2=0x7fed980b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:09.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.276+0000 7fed96a00640 1 --2- 172.21.15.137:0/3810219540 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed98159560 0x7fed980b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.276+0000 7fed96a00640 1 -- 172.21.15.137:0/3810219540 >> v2:172.21.15.170:3300/0 conn(0x7fed98072e70 msgr2=0x7fed98162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:09.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.276+0000 7fed96a00640 1 --2- 172.21.15.137:0/3810219540 >> v2:172.21.15.170:3300/0 conn(0x7fed98072e70 0x7fed98162c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.276+0000 7fed96a00640 1 -- 172.21.15.137:0/3810219540 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed980b6210 con 0x7fed980b57d0 2024-04-26T23:42:09.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.276+0000 7fed96a00640 1 --2- 172.21.15.137:0/3810219540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed980b57d0 0x7fed98072930 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fed9806d480 tx=0x7fed8401c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f51df231317eb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:09.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.276+0000 7fed96000640 1 -- 172.21.15.137:0/3810219540 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed840b0070 con 0x7fed980b57d0 2024-04-26T23:42:09.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.276+0000 7fed96000640 1 -- 172.21.15.137:0/3810219540 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed840ab600 con 0x7fed980b57d0 2024-04-26T23:42:09.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.276+0000 7fed96000640 1 -- 172.21.15.137:0/3810219540 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed840ab9d0 con 0x7fed980b57d0 2024-04-26T23:42:09.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.276+0000 7fed9e400640 1 -- 172.21.15.137:0/3810219540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed980b57d0 msgr2=0x7fed98072930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:09.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.276+0000 7fed9e400640 1 --2- 172.21.15.137:0/3810219540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed980b57d0 0x7fed98072930 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fed9806d480 tx=0x7fed8401c260 comp rx=0 tx=0).stop 2024-04-26T23:42:09.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.276+0000 7fed9e400640 1 -- 172.21.15.137:0/3810219540 shutdown_connections 2024-04-26T23:42:09.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.276+0000 7fed9e400640 1 --2- 172.21.15.137:0/3810219540 >> v2:172.21.15.170:3300/0 conn(0x7fed98072e70 0x7fed98162c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed9e400640 1 --2- 172.21.15.137:0/3810219540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed980b57d0 0x7fed98072930 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed9e400640 1 --2- 172.21.15.137:0/3810219540 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed98159560 0x7fed980b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed9e400640 1 -- 172.21.15.137:0/3810219540 >> 172.21.15.137:0/3810219540 conn(0x7fed980b3370 msgr2=0x7fed980b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:09.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed9e400640 1 -- 172.21.15.137:0/3810219540 shutdown_connections 2024-04-26T23:42:09.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed9e400640 1 -- 172.21.15.137:0/3810219540 wait complete. 2024-04-26T23:42:09.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed9e400640 1 Processor -- start 2024-04-26T23:42:09.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed9e400640 1 -- start start 2024-04-26T23:42:09.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed9e400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed98072e70 0x7fed98157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:09.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed9e400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed980b57d0 0x7fed98150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:09.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed9e400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed98159560 0x7fed9814ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:09.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed9e400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fed9815f950 con 0x7fed980b57d0 2024-04-26T23:42:09.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed9e400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fed9815f7d0 con 0x7fed98072e70 2024-04-26T23:42:09.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed9e400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fed980afc80 con 0x7fed98159560 2024-04-26T23:42:09.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed96a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed980b57d0 0x7fed98150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:09.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed96a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed980b57d0 0x7fed98150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38548/0 (socket says 172.21.15.137:38548) 2024-04-26T23:42:09.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed96a00640 1 -- 172.21.15.137:0/1812159981 learned_addr learned my addr 172.21.15.137:0/1812159981 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:09.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed97e00640 1 --2- 172.21.15.137:0/1812159981 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed98159560 0x7fed9814ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:09.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed97400640 1 --2- 172.21.15.137:0/1812159981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed98072e70 0x7fed98157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:09.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed96a00640 1 -- 172.21.15.137:0/1812159981 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed98159560 msgr2=0x7fed9814ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:09.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed96a00640 1 --2- 172.21.15.137:0/1812159981 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed98159560 0x7fed9814ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed96a00640 1 -- 172.21.15.137:0/1812159981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed98072e70 msgr2=0x7fed98157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:09.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed96a00640 1 --2- 172.21.15.137:0/1812159981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed98072e70 0x7fed98157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed96a00640 1 -- 172.21.15.137:0/1812159981 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed981fc1c0 con 0x7fed980b57d0 2024-04-26T23:42:09.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed97400640 1 --2- 172.21.15.137:0/1812159981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed98072e70 0x7fed98157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:09.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.280+0000 7fed96a00640 1 --2- 172.21.15.137:0/1812159981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed980b57d0 0x7fed98150330 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fed8401a910 tx=0x7fed84019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:09.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.284+0000 7fed8f400640 1 -- 172.21.15.137:0/1812159981 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed840b9070 con 0x7fed980b57d0 2024-04-26T23:42:09.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.284+0000 7fed8f400640 1 -- 172.21.15.137:0/1812159981 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed840b4400 con 0x7fed980b57d0 2024-04-26T23:42:09.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.284+0000 7fed8f400640 1 -- 172.21.15.137:0/1812159981 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed840b0040 con 0x7fed980b57d0 2024-04-26T23:42:09.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.284+0000 7fed9e400640 1 -- 172.21.15.137:0/1812159981 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed981fc4a0 con 0x7fed980b57d0 2024-04-26T23:42:09.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.284+0000 7fed9e400640 1 -- 172.21.15.137:0/1812159981 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed981fca60 con 0x7fed980b57d0 2024-04-26T23:42:09.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.284+0000 7fed9e400640 1 -- 172.21.15.137:0/1812159981 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed980705c0 con 0x7fed980b57d0 2024-04-26T23:42:09.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.284+0000 7fed8f400640 1 -- 172.21.15.137:0/1812159981 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fed840b33a0 con 0x7fed980b57d0 2024-04-26T23:42:09.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.284+0000 7fed8f400640 1 --2- 172.21.15.137:0/1812159981 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fed780683b0 0x7fed7806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:09.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.284+0000 7fed8f400640 1 -- 172.21.15.137:0/1812159981 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fed8411fc20 con 0x7fed980b57d0 2024-04-26T23:42:09.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.284+0000 7fed97400640 1 --2- 172.21.15.137:0/1812159981 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fed780683b0 0x7fed7806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:09.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.284+0000 7fed97400640 1 --2- 172.21.15.137:0/1812159981 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fed780683b0 0x7fed7806a870 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fed88003fd0 tx=0x7fed880039a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:09.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.288+0000 7fed8f400640 1 -- 172.21.15.137:0/1812159981 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fed84016110 con 0x7fed980b57d0 2024-04-26T23:42:09.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.444+0000 7fed9e400640 1 -- 172.21.15.137:0/1812159981 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fed9806a410 con 0x7fed980b57d0 2024-04-26T23:42:09.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.448+0000 7fed8f400640 1 -- 172.21.15.137:0/1812159981 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fed840efb00 con 0x7fed980b57d0 2024-04-26T23:42:09.452 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:42:09.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.448+0000 7fed9e400640 1 -- 172.21.15.137:0/1812159981 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fed780683b0 msgr2=0x7fed7806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:09.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.448+0000 7fed9e400640 1 --2- 172.21.15.137:0/1812159981 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fed780683b0 0x7fed7806a870 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fed88003fd0 tx=0x7fed880039a0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.448+0000 7fed9e400640 1 -- 172.21.15.137:0/1812159981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed980b57d0 msgr2=0x7fed98150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:09.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.448+0000 7fed9e400640 1 --2- 172.21.15.137:0/1812159981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed980b57d0 0x7fed98150330 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fed8401a910 tx=0x7fed84019000 comp rx=0 tx=0).stop 2024-04-26T23:42:09.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.448+0000 7fed9e400640 1 -- 172.21.15.137:0/1812159981 shutdown_connections 2024-04-26T23:42:09.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.448+0000 7fed9e400640 1 --2- 172.21.15.137:0/1812159981 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fed780683b0 0x7fed7806a870 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.448+0000 7fed9e400640 1 --2- 172.21.15.137:0/1812159981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed980b57d0 0x7fed98150330 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.448+0000 7fed9e400640 1 --2- 172.21.15.137:0/1812159981 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed98159560 0x7fed9814ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.448+0000 7fed9e400640 1 --2- 172.21.15.137:0/1812159981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed98072e70 0x7fed98157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.448+0000 7fed9e400640 1 -- 172.21.15.137:0/1812159981 >> 172.21.15.137:0/1812159981 conn(0x7fed980b3370 msgr2=0x7fed9815fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:09.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.448+0000 7fed9e400640 1 -- 172.21.15.137:0/1812159981 shutdown_connections 2024-04-26T23:42:09.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.448+0000 7fed9e400640 1 -- 172.21.15.137:0/1812159981 wait complete. 2024-04-26T23:42:09.472 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:42:09.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab67600640 1 Processor -- start 2024-04-26T23:42:09.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab67600640 1 -- start start 2024-04-26T23:42:09.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab67600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab600ceb00 0x7fab60152510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:09.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab67600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab6015baf0 con 0x7fab600738d0 2024-04-26T23:42:09.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab67600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab6015bdb0 con 0x7fab600b3d90 2024-04-26T23:42:09.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab67600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fab6015c090 con 0x7fab600ceb00 2024-04-26T23:42:09.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab5fe00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fab600738d0 0x7fab60073d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52712/0 (socket says 172.21.15.137:52712) 2024-04-26T23:42:09.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab5fe00640 1 -- 172.21.15.137:0/545872595 learned_addr learned my addr 172.21.15.137:0/545872595 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:09.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab5f400640 1 -- 172.21.15.137:0/545872595 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2002608293 0 0) 0x7fab6015baf0 con 0x7fab600738d0 2024-04-26T23:42:09.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab5f400640 1 -- 172.21.15.137:0/545872595 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab44005740 con 0x7fab600738d0 2024-04-26T23:42:09.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab64c00640 1 --2- 172.21.15.137:0/545872595 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab600ceb00 0x7fab60152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:09.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab5f400640 1 -- 172.21.15.137:0/545872595 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3984393945 0 0) 0x7fab44005740 con 0x7fab600738d0 2024-04-26T23:42:09.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab5f400640 1 -- 172.21.15.137:0/545872595 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab600ceb00 msgr2=0x7fab60152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:09.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab5f400640 1 --2- 172.21.15.137:0/545872595 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab600ceb00 0x7fab60152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab5f400640 1 -- 172.21.15.137:0/545872595 >> v1:172.21.15.170:6789/0 conn(0x7fab600b3d90 legacy=0x7fab600b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:09.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab5f400640 1 -- 172.21.15.137:0/545872595 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6015c370 con 0x7fab600738d0 2024-04-26T23:42:09.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab5f400640 1 -- 172.21.15.137:0/545872595 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fab4c001680 con 0x7fab600738d0 2024-04-26T23:42:09.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab5f400640 1 -- 172.21.15.137:0/545872595 >> v1:172.21.15.137:6789/0 conn(0x7fab600738d0 legacy=0x7fab60073d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:09.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab5f400640 1 --2- 172.21.15.137:0/545872595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab44005c00 0x7fab44005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:09.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab5f400640 1 --2- 172.21.15.137:0/545872595 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab440065b0 0x7fab44006a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:09.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab5f400640 1 --2- 172.21.15.137:0/545872595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab440071a0 0x7fab4400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:09.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab5f400640 1 -- 172.21.15.137:0/545872595 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fab6015c090 con 0x7fab440071a0 2024-04-26T23:42:09.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab5f400640 1 -- 172.21.15.137:0/545872595 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fab4400e120 con 0x7fab44005c00 2024-04-26T23:42:09.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab5f400640 1 -- 172.21.15.137:0/545872595 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fab4400e2a0 con 0x7fab440065b0 2024-04-26T23:42:09.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab65600640 1 --2- 172.21.15.137:0/545872595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab440071a0 0x7fab4400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:09.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab64c00640 1 --2- 172.21.15.137:0/545872595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab44005c00 0x7fab44005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:09.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab5fe00640 1 --2- 172.21.15.137:0/545872595 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab440065b0 0x7fab44006a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:09.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab65600640 1 -- 172.21.15.137:0/545872595 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab440065b0 msgr2=0x7fab44006a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:09.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab65600640 1 --2- 172.21.15.137:0/545872595 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab440065b0 0x7fab44006a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab65600640 1 -- 172.21.15.137:0/545872595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab44005c00 msgr2=0x7fab44005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:09.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab65600640 1 --2- 172.21.15.137:0/545872595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab44005c00 0x7fab44005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.608+0000 7fab65600640 1 -- 172.21.15.137:0/545872595 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab44005740 con 0x7fab440071a0 2024-04-26T23:42:09.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.612+0000 7fab65600640 1 --2- 172.21.15.137:0/545872595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab440071a0 0x7fab4400dbe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fab58002010 tx=0x7fab5801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acbd8dfe6e770572 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:09.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.612+0000 7fab5f400640 1 -- 172.21.15.137:0/545872595 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab58001c10 con 0x7fab440071a0 2024-04-26T23:42:09.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.612+0000 7fab5f400640 1 -- 172.21.15.137:0/545872595 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab580a66c0 con 0x7fab440071a0 2024-04-26T23:42:09.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.612+0000 7fab5f400640 1 -- 172.21.15.137:0/545872595 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab580a6ab0 con 0x7fab440071a0 2024-04-26T23:42:09.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.612+0000 7fab67600640 1 -- 172.21.15.137:0/545872595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab440071a0 msgr2=0x7fab4400dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:09.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.612+0000 7fab67600640 1 --2- 172.21.15.137:0/545872595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab440071a0 0x7fab4400dbe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fab58002010 tx=0x7fab5801c8b0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.612+0000 7fab65600640 1 -- 172.21.15.137:0/545872595 reap_dead start 2024-04-26T23:42:09.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.612+0000 7fab67600640 1 -- 172.21.15.137:0/545872595 shutdown_connections 2024-04-26T23:42:09.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.612+0000 7fab67600640 1 -- 172.21.15.137:0/545872595 >> 172.21.15.137:0/545872595 conn(0x7fab6006c800 msgr2=0x7fab6006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:09.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.612+0000 7fab67600640 1 -- 172.21.15.137:0/545872595 shutdown_connections 2024-04-26T23:42:09.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.612+0000 7fab67600640 1 -- 172.21.15.137:0/545872595 wait complete. 2024-04-26T23:42:09.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.616+0000 7fab67600640 1 Processor -- start 2024-04-26T23:42:09.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.616+0000 7fab67600640 1 -- start start 2024-04-26T23:42:09.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.616+0000 7fab67600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab440071a0 0x7fab6014f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:09.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.616+0000 7fab67600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab6015f070 0x7fab6015f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:09.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.616+0000 7fab67600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab600c93e0 0x7fab600c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:09.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.616+0000 7fab67600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fab60162a10 con 0x7fab440071a0 2024-04-26T23:42:09.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.616+0000 7fab67600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fab6006f8f0 con 0x7fab600c93e0 2024-04-26T23:42:09.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.616+0000 7fab67600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fab60162b90 con 0x7fab6015f070 2024-04-26T23:42:09.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.616+0000 7fab64c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab440071a0 0x7fab6014f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:09.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.616+0000 7fab64c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab440071a0 0x7fab6014f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38570/0 (socket says 172.21.15.137:38570) 2024-04-26T23:42:09.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.616+0000 7fab64c00640 1 -- 172.21.15.137:0/3245284248 learned_addr learned my addr 172.21.15.137:0/3245284248 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:09.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.616+0000 7fab64c00640 1 -- 172.21.15.137:0/3245284248 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab6015f070 msgr2=0x7fab6015f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:09.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.616+0000 7fab64c00640 1 --2- 172.21.15.137:0/3245284248 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab6015f070 0x7fab6015f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.616+0000 7fab64c00640 1 -- 172.21.15.137:0/3245284248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab600c93e0 msgr2=0x7fab600c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:09.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.616+0000 7fab64c00640 1 --2- 172.21.15.137:0/3245284248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab600c93e0 0x7fab600c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.616+0000 7fab64c00640 1 -- 172.21.15.137:0/3245284248 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab601f7e00 con 0x7fab440071a0 2024-04-26T23:42:09.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.616+0000 7fab64c00640 1 --2- 172.21.15.137:0/3245284248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab440071a0 0x7fab6014f8c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fab500119d0 tx=0x7fab50011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:09.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.616+0000 7fab5cc00640 1 -- 172.21.15.137:0/3245284248 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5000fad0 con 0x7fab440071a0 2024-04-26T23:42:09.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.616+0000 7fab5cc00640 1 -- 172.21.15.137:0/3245284248 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab5000fc70 con 0x7fab440071a0 2024-04-26T23:42:09.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.616+0000 7fab5cc00640 1 -- 172.21.15.137:0/3245284248 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab50014440 con 0x7fab440071a0 2024-04-26T23:42:09.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.616+0000 7fab67600640 1 -- 172.21.15.137:0/3245284248 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab601f80e0 con 0x7fab440071a0 2024-04-26T23:42:09.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.616+0000 7fab67600640 1 -- 172.21.15.137:0/3245284248 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab601f86a0 con 0x7fab440071a0 2024-04-26T23:42:09.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.620+0000 7fab67600640 1 -- 172.21.15.137:0/3245284248 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab6015fa30 con 0x7fab440071a0 2024-04-26T23:42:09.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.620+0000 7fab5cc00640 1 -- 172.21.15.137:0/3245284248 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fab50012040 con 0x7fab440071a0 2024-04-26T23:42:09.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.620+0000 7fab5cc00640 1 --2- 172.21.15.137:0/3245284248 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fab400683b0 0x7fab4006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:09.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.620+0000 7fab5cc00640 1 -- 172.21.15.137:0/3245284248 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fab50087110 con 0x7fab440071a0 2024-04-26T23:42:09.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.620+0000 7fab5fe00640 1 --2- 172.21.15.137:0/3245284248 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fab400683b0 0x7fab4006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:09.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.620+0000 7fab5fe00640 1 --2- 172.21.15.137:0/3245284248 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fab400683b0 0x7fab4006a870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0011f0 tx=0x7fab4c001160 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:09.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.624+0000 7fab5cc00640 1 -- 172.21.15.137:0/3245284248 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fab50019030 con 0x7fab440071a0 2024-04-26T23:42:09.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.784+0000 7fab67600640 1 -- 172.21.15.137:0/3245284248 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fab6006a410 con 0x7fab440071a0 2024-04-26T23:42:09.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.784+0000 7fab5cc00640 1 -- 172.21.15.137:0/3245284248 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fab50057670 con 0x7fab440071a0 2024-04-26T23:42:09.789 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:42:09.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.784+0000 7fab67600640 1 -- 172.21.15.137:0/3245284248 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fab400683b0 msgr2=0x7fab4006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:09.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.784+0000 7fab67600640 1 --2- 172.21.15.137:0/3245284248 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fab400683b0 0x7fab4006a870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0011f0 tx=0x7fab4c001160 comp rx=0 tx=0).stop 2024-04-26T23:42:09.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.784+0000 7fab67600640 1 -- 172.21.15.137:0/3245284248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab440071a0 msgr2=0x7fab6014f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:09.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.784+0000 7fab67600640 1 --2- 172.21.15.137:0/3245284248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab440071a0 0x7fab6014f8c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fab500119d0 tx=0x7fab50011e90 comp rx=0 tx=0).stop 2024-04-26T23:42:09.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.784+0000 7fab67600640 1 -- 172.21.15.137:0/3245284248 shutdown_connections 2024-04-26T23:42:09.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.784+0000 7fab67600640 1 --2- 172.21.15.137:0/3245284248 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fab400683b0 0x7fab4006a870 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.784+0000 7fab67600640 1 --2- 172.21.15.137:0/3245284248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab600c93e0 0x7fab600c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.784+0000 7fab67600640 1 --2- 172.21.15.137:0/3245284248 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab6015f070 0x7fab6015f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.784+0000 7fab67600640 1 --2- 172.21.15.137:0/3245284248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab440071a0 0x7fab6014f8c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.784+0000 7fab67600640 1 -- 172.21.15.137:0/3245284248 >> 172.21.15.137:0/3245284248 conn(0x7fab6006c800 msgr2=0x7fab600b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:09.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.788+0000 7fab67600640 1 -- 172.21.15.137:0/3245284248 shutdown_connections 2024-04-26T23:42:09.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.788+0000 7fab67600640 1 -- 172.21.15.137:0/3245284248 wait complete. 2024-04-26T23:42:09.811 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:42:09.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.944+0000 7f1b7e800640 1 Processor -- start 2024-04-26T23:42:09.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.944+0000 7f1b7e800640 1 -- start start 2024-04-26T23:42:09.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.948+0000 7f1b7e800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1b78073f20 0x7f1b7815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:09.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.948+0000 7f1b7e800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b780affa0 0x7f1b780ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:09.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.948+0000 7f1b7e800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b78072860 con 0x7f1b780afbc0 2024-04-26T23:42:09.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.948+0000 7f1b7e800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1b780743b0 con 0x7f1b78073f20 2024-04-26T23:42:09.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.948+0000 7f1b7e800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1b78072b00 con 0x7f1b780affa0 2024-04-26T23:42:09.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.948+0000 7f1b77400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f1b780afbc0 0x7f1b780735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52722/0 (socket says 172.21.15.137:52722) 2024-04-26T23:42:09.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.948+0000 7f1b6ea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1b78073f20 0x7f1b7815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:09.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.948+0000 7f1b77400640 1 -- 172.21.15.137:0/1338323207 learned_addr learned my addr 172.21.15.137:0/1338323207 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:09.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.948+0000 7f1b77e00640 1 --2- 172.21.15.137:0/1338323207 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b780affa0 0x7f1b780ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:09.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.948+0000 7f1b6ea00640 1 -- 172.21.15.137:0/1338323207 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b780affa0 msgr2=0x7f1b780ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:09.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.948+0000 7f1b6ea00640 1 --2- 172.21.15.137:0/1338323207 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b780affa0 0x7f1b780ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.948+0000 7f1b6ea00640 1 -- 172.21.15.137:0/1338323207 >> v1:172.21.15.137:6789/0 conn(0x7f1b780afbc0 legacy=0x7f1b780735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:09.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.948+0000 7f1b6ea00640 1 -- 172.21.15.137:0/1338323207 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b78072de0 con 0x7f1b78073f20 2024-04-26T23:42:09.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.948+0000 7f1b76a00640 1 -- 172.21.15.137:0/1338323207 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2143010004 0 0) 0x7f1b78072860 con 0x7f1b780afbc0 2024-04-26T23:42:09.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.952+0000 7f1b6ea00640 1 --2- 172.21.15.137:0/1338323207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b78073f20 0x7f1b7815df90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1b600097f0 tx=0x7f1b6001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea89bba4470f8b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:09.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.952+0000 7f1b76a00640 1 -- 172.21.15.137:0/1338323207 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b600b0070 con 0x7f1b78073f20 2024-04-26T23:42:09.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.952+0000 7f1b76a00640 1 -- 172.21.15.137:0/1338323207 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b600ab600 con 0x7f1b78073f20 2024-04-26T23:42:09.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.952+0000 7f1b76a00640 1 -- 172.21.15.137:0/1338323207 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b600ab9d0 con 0x7f1b78073f20 2024-04-26T23:42:09.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.952+0000 7f1b7e800640 1 -- 172.21.15.137:0/1338323207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b78073f20 msgr2=0x7f1b7815df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:09.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.952+0000 7f1b7e800640 1 --2- 172.21.15.137:0/1338323207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b78073f20 0x7f1b7815df90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1b600097f0 tx=0x7f1b6001c4a0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.952+0000 7f1b7e800640 1 -- 172.21.15.137:0/1338323207 shutdown_connections 2024-04-26T23:42:09.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.952+0000 7f1b7e800640 1 --2- 172.21.15.137:0/1338323207 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b780affa0 0x7f1b780ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.952+0000 7f1b7e800640 1 --2- 172.21.15.137:0/1338323207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b78073f20 0x7f1b7815df90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.952+0000 7f1b7e800640 1 -- 172.21.15.137:0/1338323207 >> 172.21.15.137:0/1338323207 conn(0x7f1b7806c800 msgr2=0x7f1b7806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:09.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.952+0000 7f1b7e800640 1 -- 172.21.15.137:0/1338323207 shutdown_connections 2024-04-26T23:42:09.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.952+0000 7f1b7e800640 1 -- 172.21.15.137:0/1338323207 wait complete. 2024-04-26T23:42:09.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.952+0000 7f1b7e800640 1 Processor -- start 2024-04-26T23:42:09.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.952+0000 7f1b7e800640 1 -- start start 2024-04-26T23:42:09.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.952+0000 7f1b7e800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b780afbc0 0x7f1b78144210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:09.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.952+0000 7f1b7e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b780affa0 0x7f1b781510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:09.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.952+0000 7f1b7e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b78149100 0x7f1b7815f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:09.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.952+0000 7f1b7e800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7806f360 con 0x7f1b780affa0 2024-04-26T23:42:09.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.952+0000 7f1b7e800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7806f1e0 con 0x7f1b78149100 2024-04-26T23:42:09.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.952+0000 7f1b7e800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7806f4e0 con 0x7f1b780afbc0 2024-04-26T23:42:09.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.956+0000 7f1b6ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b780affa0 0x7f1b781510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:09.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.956+0000 7f1b6ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b780affa0 0x7f1b781510e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38594/0 (socket says 172.21.15.137:38594) 2024-04-26T23:42:09.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.956+0000 7f1b6ea00640 1 -- 172.21.15.137:0/1582884202 learned_addr learned my addr 172.21.15.137:0/1582884202 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:09.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.956+0000 7f1b77e00640 1 --2- 172.21.15.137:0/1582884202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b78149100 0x7f1b7815f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:09.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.956+0000 7f1b77400640 1 --2- 172.21.15.137:0/1582884202 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b780afbc0 0x7f1b78144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:09.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.956+0000 7f1b6ea00640 1 -- 172.21.15.137:0/1582884202 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b780afbc0 msgr2=0x7f1b78144210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:09.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.956+0000 7f1b6ea00640 1 --2- 172.21.15.137:0/1582884202 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b780afbc0 0x7f1b78144210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.956+0000 7f1b6ea00640 1 -- 172.21.15.137:0/1582884202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b78149100 msgr2=0x7f1b7815f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:09.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.956+0000 7f1b6ea00640 1 --2- 172.21.15.137:0/1582884202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b78149100 0x7f1b7815f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:09.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.956+0000 7f1b6ea00640 1 -- 172.21.15.137:0/1582884202 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b780b3e90 con 0x7f1b780affa0 2024-04-26T23:42:09.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.956+0000 7f1b77400640 1 --2- 172.21.15.137:0/1582884202 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b780afbc0 0x7f1b78144210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:09.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.956+0000 7f1b6ea00640 1 --2- 172.21.15.137:0/1582884202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b780affa0 0x7f1b781510e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1b6001a0d0 tx=0x7f1b6001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:09.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.956+0000 7f1b6fe00640 1 -- 172.21.15.137:0/1582884202 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b600b0050 con 0x7f1b780affa0 2024-04-26T23:42:09.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.956+0000 7f1b6fe00640 1 -- 172.21.15.137:0/1582884202 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b600bc070 con 0x7f1b780affa0 2024-04-26T23:42:09.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.956+0000 7f1b6fe00640 1 -- 172.21.15.137:0/1582884202 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b600b5a70 con 0x7f1b780affa0 2024-04-26T23:42:09.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.956+0000 7f1b7e800640 1 -- 172.21.15.137:0/1582884202 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b780b4170 con 0x7f1b780affa0 2024-04-26T23:42:09.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.956+0000 7f1b7e800640 1 -- 172.21.15.137:0/1582884202 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b780b4730 con 0x7f1b780affa0 2024-04-26T23:42:09.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.956+0000 7f1b7e800640 1 -- 172.21.15.137:0/1582884202 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b7806a410 con 0x7f1b780affa0 2024-04-26T23:42:09.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.956+0000 7f1b6fe00640 1 -- 172.21.15.137:0/1582884202 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1b600ab4c0 con 0x7f1b780affa0 2024-04-26T23:42:09.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.956+0000 7f1b6fe00640 1 --2- 172.21.15.137:0/1582884202 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1b540683b0 0x7f1b5406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:09.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.956+0000 7f1b6fe00640 1 -- 172.21.15.137:0/1582884202 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f1b601212d0 con 0x7f1b780affa0 2024-04-26T23:42:09.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.960+0000 7f1b77400640 1 --2- 172.21.15.137:0/1582884202 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1b540683b0 0x7f1b5406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:09.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.960+0000 7f1b77400640 1 --2- 172.21.15.137:0/1582884202 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1b540683b0 0x7f1b5406a870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1b68000f70 tx=0x7f1b68009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:09.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:09.964+0000 7f1b6fe00640 1 -- 172.21.15.137:0/1582884202 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1b60016090 con 0x7f1b780affa0 2024-04-26T23:42:10.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.120+0000 7f1b7e800640 1 -- 172.21.15.137:0/1582884202 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1b78160870 con 0x7f1b780affa0 2024-04-26T23:42:10.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.120+0000 7f1b6fe00640 1 -- 172.21.15.137:0/1582884202 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f1b600f1800 con 0x7f1b780affa0 2024-04-26T23:42:10.127 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:42:10.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.124+0000 7f1b7e800640 1 -- 172.21.15.137:0/1582884202 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1b540683b0 msgr2=0x7f1b5406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:10.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.124+0000 7f1b7e800640 1 --2- 172.21.15.137:0/1582884202 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1b540683b0 0x7f1b5406a870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1b68000f70 tx=0x7f1b68009040 comp rx=0 tx=0).stop 2024-04-26T23:42:10.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.124+0000 7f1b7e800640 1 -- 172.21.15.137:0/1582884202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b780affa0 msgr2=0x7f1b781510e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:10.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.124+0000 7f1b7e800640 1 --2- 172.21.15.137:0/1582884202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b780affa0 0x7f1b781510e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1b6001a0d0 tx=0x7f1b6001ace0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.124+0000 7f1b7e800640 1 -- 172.21.15.137:0/1582884202 shutdown_connections 2024-04-26T23:42:10.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.124+0000 7f1b7e800640 1 --2- 172.21.15.137:0/1582884202 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1b540683b0 0x7f1b5406a870 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.124+0000 7f1b7e800640 1 --2- 172.21.15.137:0/1582884202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b780affa0 0x7f1b781510e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.124+0000 7f1b7e800640 1 --2- 172.21.15.137:0/1582884202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b78149100 0x7f1b7815f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.124+0000 7f1b7e800640 1 --2- 172.21.15.137:0/1582884202 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b780afbc0 0x7f1b78144210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.124+0000 7f1b7e800640 1 -- 172.21.15.137:0/1582884202 >> 172.21.15.137:0/1582884202 conn(0x7f1b7806c800 msgr2=0x7f1b7806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:10.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.124+0000 7f1b7e800640 1 -- 172.21.15.137:0/1582884202 shutdown_connections 2024-04-26T23:42:10.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.124+0000 7f1b7e800640 1 -- 172.21.15.137:0/1582884202 wait complete. 2024-04-26T23:42:10.148 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:42:10.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.280+0000 7f96b4800640 1 Processor -- start 2024-04-26T23:42:10.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.280+0000 7f96b4800640 1 -- start start 2024-04-26T23:42:10.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.280+0000 7f96b4800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f96ac15ced0 0x7f96ac0d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:10.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.280+0000 7f96b4800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f96ac15d2b0 0x7f96ac0d18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:10.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.280+0000 7f96b4800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96ac0b1b30 con 0x7f96ac0b0d90 2024-04-26T23:42:10.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.280+0000 7f96b4800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f96ac0b18f0 con 0x7f96ac15ced0 2024-04-26T23:42:10.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.280+0000 7f96b4800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f96ac0b1e10 con 0x7f96ac15d2b0 2024-04-26T23:42:10.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.280+0000 7f96b2800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f96ac0b0d90 0x7f96ac0b11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52734/0 (socket says 172.21.15.137:52734) 2024-04-26T23:42:10.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.280+0000 7f96b2800640 1 -- 172.21.15.137:0/148674030 learned_addr learned my addr 172.21.15.137:0/148674030 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:10.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.280+0000 7f96b1e00640 1 --2- 172.21.15.137:0/148674030 >> v2:172.21.15.137:3300/0 conn(0x7f96ac15ced0 0x7f96ac0d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:10.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.280+0000 7f96b1400640 1 --2- 172.21.15.137:0/148674030 >> v2:172.21.15.170:3300/0 conn(0x7f96ac15d2b0 0x7f96ac0d18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:10.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.280+0000 7f96b1e00640 1 -- 172.21.15.137:0/148674030 >> v2:172.21.15.170:3300/0 conn(0x7f96ac15d2b0 msgr2=0x7f96ac0d18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:10.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.280+0000 7f96b1e00640 1 --2- 172.21.15.137:0/148674030 >> v2:172.21.15.170:3300/0 conn(0x7f96ac15d2b0 0x7f96ac0d18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.280+0000 7f96b1e00640 1 -- 172.21.15.137:0/148674030 >> v1:172.21.15.137:6789/0 conn(0x7f96ac0b0d90 legacy=0x7f96ac0b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:10.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.280+0000 7f96b1e00640 1 -- 172.21.15.137:0/148674030 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ac0b23f0 con 0x7f96ac15ced0 2024-04-26T23:42:10.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.280+0000 7f96b0a00640 1 -- 172.21.15.137:0/148674030 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2544514017 0 0) 0x7f96ac0b1b30 con 0x7f96ac0b0d90 2024-04-26T23:42:10.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.280+0000 7f96b1400640 1 --2- 172.21.15.137:0/148674030 >> v2:172.21.15.170:3300/0 conn(0x7f96ac15d2b0 0x7f96ac0d18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:10.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.284+0000 7f96b1e00640 1 --2- 172.21.15.137:0/148674030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96ac15ced0 0x7f96ac0d13b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f96ac074450 tx=0x7f96a001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bade66a1d2e8f56 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:10.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.284+0000 7f96b0a00640 1 -- 172.21.15.137:0/148674030 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a00b0070 con 0x7f96ac15ced0 2024-04-26T23:42:10.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.284+0000 7f96b0a00640 1 -- 172.21.15.137:0/148674030 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a00ab600 con 0x7f96ac15ced0 2024-04-26T23:42:10.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.284+0000 7f96b0a00640 1 -- 172.21.15.137:0/148674030 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a00ab9d0 con 0x7f96ac15ced0 2024-04-26T23:42:10.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.284+0000 7f96b4800640 1 -- 172.21.15.137:0/148674030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96ac15ced0 msgr2=0x7f96ac0d13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:10.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.284+0000 7f96b4800640 1 --2- 172.21.15.137:0/148674030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96ac15ced0 0x7f96ac0d13b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f96ac074450 tx=0x7f96a001c480 comp rx=0 tx=0).stop 2024-04-26T23:42:10.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.284+0000 7f96b4800640 1 -- 172.21.15.137:0/148674030 shutdown_connections 2024-04-26T23:42:10.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.284+0000 7f96b4800640 1 --2- 172.21.15.137:0/148674030 >> v2:172.21.15.170:3300/0 conn(0x7f96ac15d2b0 0x7f96ac0d18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.284+0000 7f96b4800640 1 --2- 172.21.15.137:0/148674030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96ac15ced0 0x7f96ac0d13b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.284+0000 7f96b4800640 1 -- 172.21.15.137:0/148674030 >> 172.21.15.137:0/148674030 conn(0x7f96ac09ba60 msgr2=0x7f96ac09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:10.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.284+0000 7f96b4800640 1 -- 172.21.15.137:0/148674030 shutdown_connections 2024-04-26T23:42:10.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.284+0000 7f96b4800640 1 -- 172.21.15.137:0/148674030 wait complete. 2024-04-26T23:42:10.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96b4800640 1 Processor -- start 2024-04-26T23:42:10.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96b4800640 1 -- start start 2024-04-26T23:42:10.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96b4800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96ac0b0d90 0x7f96ac06df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:10.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96b4800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96ac15ced0 0x7f96ac154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:10.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96b4800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96ac15d2b0 0x7f96ac165050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:10.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96b4800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac0b37d0 con 0x7f96ac15d2b0 2024-04-26T23:42:10.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96b4800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac0b3650 con 0x7f96ac0b0d90 2024-04-26T23:42:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96b4800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f96ac0b3950 con 0x7f96ac15ced0 2024-04-26T23:42:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96b2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96ac15d2b0 0x7f96ac165050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96b2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96ac15d2b0 0x7f96ac165050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38610/0 (socket says 172.21.15.137:38610) 2024-04-26T23:42:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96b2800640 1 -- 172.21.15.137:0/1110925177 learned_addr learned my addr 172.21.15.137:0/1110925177 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96b1400640 1 --2- 172.21.15.137:0/1110925177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96ac15ced0 0x7f96ac154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96b1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96ac0b0d90 0x7f96ac06df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96b2800640 1 -- 172.21.15.137:0/1110925177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96ac15ced0 msgr2=0x7f96ac154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96b2800640 1 --2- 172.21.15.137:0/1110925177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96ac15ced0 0x7f96ac154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96b2800640 1 -- 172.21.15.137:0/1110925177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96ac0b0d90 msgr2=0x7f96ac06df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96b2800640 1 --2- 172.21.15.137:0/1110925177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96ac0b0d90 0x7f96ac06df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96b2800640 1 -- 172.21.15.137:0/1110925177 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ac15a100 con 0x7f96ac15d2b0 2024-04-26T23:42:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96b2800640 1 --2- 172.21.15.137:0/1110925177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96ac15d2b0 0x7f96ac165050 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f96a800c7a0 tx=0x7f96a800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96a6000640 1 -- 172.21.15.137:0/1110925177 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a8018070 con 0x7f96ac15d2b0 2024-04-26T23:42:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96a6000640 1 -- 172.21.15.137:0/1110925177 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a800a640 con 0x7f96ac15d2b0 2024-04-26T23:42:10.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96a6000640 1 -- 172.21.15.137:0/1110925177 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a800aab0 con 0x7f96ac15d2b0 2024-04-26T23:42:10.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96b4800640 1 -- 172.21.15.137:0/1110925177 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96ac15bad0 con 0x7f96ac15d2b0 2024-04-26T23:42:10.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.288+0000 7f96b4800640 1 -- 172.21.15.137:0/1110925177 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96ac15a3e0 con 0x7f96ac15d2b0 2024-04-26T23:42:10.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.292+0000 7f96b4800640 1 -- 172.21.15.137:0/1110925177 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96ac06a4b0 con 0x7f96ac15d2b0 2024-04-26T23:42:10.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.292+0000 7f96a6000640 1 -- 172.21.15.137:0/1110925177 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f96a800ac50 con 0x7f96ac15d2b0 2024-04-26T23:42:10.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.292+0000 7f96a6000640 1 --2- 172.21.15.137:0/1110925177 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f96900683b0 0x7f969006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:10.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.292+0000 7f96a6000640 1 -- 172.21.15.137:0/1110925177 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f96a8085f00 con 0x7f96ac15d2b0 2024-04-26T23:42:10.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.292+0000 7f96b1e00640 1 --2- 172.21.15.137:0/1110925177 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f96900683b0 0x7f969006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:10.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.292+0000 7f96b1e00640 1 --2- 172.21.15.137:0/1110925177 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f96900683b0 0x7f969006a870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f96a00ad000 tx=0x7f96a00a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:10.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.296+0000 7f96a6000640 1 -- 172.21.15.137:0/1110925177 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f96a8055de0 con 0x7f96ac15d2b0 2024-04-26T23:42:10.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.464+0000 7f96b4800640 1 -- 172.21.15.137:0/1110925177 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f96ac09c7a0 con 0x7f96ac15d2b0 2024-04-26T23:42:10.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.468+0000 7f96a6000640 1 -- 172.21.15.137:0/1110925177 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f96a805a0e0 con 0x7f96ac15d2b0 2024-04-26T23:42:10.472 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T23:42:10.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.468+0000 7f96b4800640 1 -- 172.21.15.137:0/1110925177 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f96900683b0 msgr2=0x7f969006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:10.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.468+0000 7f96b4800640 1 --2- 172.21.15.137:0/1110925177 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f96900683b0 0x7f969006a870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f96a00ad000 tx=0x7f96a00a6000 comp rx=0 tx=0).stop 2024-04-26T23:42:10.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.468+0000 7f96b4800640 1 -- 172.21.15.137:0/1110925177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96ac15d2b0 msgr2=0x7f96ac165050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:10.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.468+0000 7f96b4800640 1 --2- 172.21.15.137:0/1110925177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96ac15d2b0 0x7f96ac165050 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f96a800c7a0 tx=0x7f96a800cc60 comp rx=0 tx=0).stop 2024-04-26T23:42:10.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.468+0000 7f96b4800640 1 -- 172.21.15.137:0/1110925177 shutdown_connections 2024-04-26T23:42:10.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.468+0000 7f96b4800640 1 --2- 172.21.15.137:0/1110925177 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f96900683b0 0x7f969006a870 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.468+0000 7f96b4800640 1 --2- 172.21.15.137:0/1110925177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96ac15d2b0 0x7f96ac165050 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.468+0000 7f96b4800640 1 --2- 172.21.15.137:0/1110925177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96ac15ced0 0x7f96ac154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.468+0000 7f96b4800640 1 --2- 172.21.15.137:0/1110925177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96ac0b0d90 0x7f96ac06df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.468+0000 7f96b4800640 1 -- 172.21.15.137:0/1110925177 >> 172.21.15.137:0/1110925177 conn(0x7f96ac09ba60 msgr2=0x7f96ac09c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:10.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.468+0000 7f96b4800640 1 -- 172.21.15.137:0/1110925177 shutdown_connections 2024-04-26T23:42:10.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.468+0000 7f96b4800640 1 -- 172.21.15.137:0/1110925177 wait complete. 2024-04-26T23:42:10.492 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi170.front.sepia.ceph.com... 2024-04-26T23:42:10.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:10.492 DEBUG:teuthology.orchestra.run.smithi170:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-04-26T23:42:10.515 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:42:10.515 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T23:42:10.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:10.515 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-26T23:42:10.567 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-26T23:42:10.567 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:42:10.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2b7800640 1 Processor -- start 2024-04-26T23:42:10.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2b7800640 1 -- start start 2024-04-26T23:42:10.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2b7800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff2b015ced0 0x7ff2b00d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:10.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2b7800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2b00b1b30 con 0x7ff2b015d2b0 2024-04-26T23:42:10.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2b7800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2b00b1e10 con 0x7ff2b00b14a0 2024-04-26T23:42:10.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2b7800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff2b00b18f0 con 0x7ff2b015ced0 2024-04-26T23:42:10.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2afe00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7ff2b015d2b0 0x7ff2b00b0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52744/0 (socket says 172.21.15.137:52744) 2024-04-26T23:42:10.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2afe00640 1 -- 172.21.15.137:0/84676186 learned_addr learned my addr 172.21.15.137:0/84676186 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:10.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2af400640 1 -- 172.21.15.137:0/84676186 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4289682643 0 0) 0x7ff2b00b1b30 con 0x7ff2b015d2b0 2024-04-26T23:42:10.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2af400640 1 -- 172.21.15.137:0/84676186 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff298003530 con 0x7ff2b015d2b0 2024-04-26T23:42:10.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2b4e00640 1 --2- 172.21.15.137:0/84676186 >> v2:172.21.15.170:3300/0 conn(0x7ff2b015ced0 0x7ff2b00d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:10.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2af400640 1 -- 172.21.15.137:0/84676186 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1490913513 0 0) 0x7ff298003530 con 0x7ff2b015d2b0 2024-04-26T23:42:10.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2af400640 1 -- 172.21.15.137:0/84676186 >> v2:172.21.15.170:3300/0 conn(0x7ff2b015ced0 msgr2=0x7ff2b00d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:10.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2af400640 1 --2- 172.21.15.137:0/84676186 >> v2:172.21.15.170:3300/0 conn(0x7ff2b015ced0 0x7ff2b00d13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2af400640 1 -- 172.21.15.137:0/84676186 >> v1:172.21.15.170:6789/0 conn(0x7ff2b00b14a0 legacy=0x7ff2b00b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:10.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2af400640 1 -- 172.21.15.137:0/84676186 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b00b23f0 con 0x7ff2b015d2b0 2024-04-26T23:42:10.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2af400640 1 -- 172.21.15.137:0/84676186 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7ff29c001680 con 0x7ff2b015d2b0 2024-04-26T23:42:10.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2af400640 1 -- 172.21.15.137:0/84676186 >> v1:172.21.15.137:6789/0 conn(0x7ff2b015d2b0 legacy=0x7ff2b00b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:10.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2af400640 1 --2- 172.21.15.137:0/84676186 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2980039c0 0x7ff298003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:10.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2af400640 1 --2- 172.21.15.137:0/84676186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff298004810 0x7ff298004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:10.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2af400640 1 --2- 172.21.15.137:0/84676186 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2980051d0 0x7ff29800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:10.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2af400640 1 -- 172.21.15.137:0/84676186 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b00b18f0 con 0x7ff298004810 2024-04-26T23:42:10.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2af400640 1 -- 172.21.15.137:0/84676186 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff29800c120 con 0x7ff2980039c0 2024-04-26T23:42:10.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2af400640 1 -- 172.21.15.137:0/84676186 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff29800c320 con 0x7ff2980051d0 2024-04-26T23:42:10.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2afe00640 1 --2- 172.21.15.137:0/84676186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff298004810 0x7ff298004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:10.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2b4e00640 1 --2- 172.21.15.137:0/84676186 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2980039c0 0x7ff298003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:10.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.700+0000 7ff2b5800640 1 --2- 172.21.15.137:0/84676186 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2980051d0 0x7ff29800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:10.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.704+0000 7ff2afe00640 1 -- 172.21.15.137:0/84676186 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2980051d0 msgr2=0x7ff29800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:10.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.704+0000 7ff2afe00640 1 --2- 172.21.15.137:0/84676186 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2980051d0 0x7ff29800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.704+0000 7ff2afe00640 1 -- 172.21.15.137:0/84676186 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2980039c0 msgr2=0x7ff298003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:10.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.704+0000 7ff2afe00640 1 --2- 172.21.15.137:0/84676186 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2980039c0 0x7ff298003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.704+0000 7ff2afe00640 1 -- 172.21.15.137:0/84676186 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff298003530 con 0x7ff298004810 2024-04-26T23:42:10.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.704+0000 7ff2b5800640 1 --2- 172.21.15.137:0/84676186 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2980051d0 0x7ff29800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:10.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.704+0000 7ff2b5800640 1 -- 172.21.15.137:0/84676186 reap_dead start 2024-04-26T23:42:10.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.704+0000 7ff2afe00640 1 --2- 172.21.15.137:0/84676186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff298004810 0x7ff298004c90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00c240 tx=0x7ff29c01f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c05c060cb26838 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:10.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.704+0000 7ff2af400640 1 -- 172.21.15.137:0/84676186 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c007d20 con 0x7ff298004810 2024-04-26T23:42:10.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.704+0000 7ff2af400640 1 -- 172.21.15.137:0/84676186 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff29c005ae0 con 0x7ff298004810 2024-04-26T23:42:10.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.704+0000 7ff2af400640 1 -- 172.21.15.137:0/84676186 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c007070 con 0x7ff298004810 2024-04-26T23:42:10.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.704+0000 7ff2b7800640 1 -- 172.21.15.137:0/84676186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff298004810 msgr2=0x7ff298004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:10.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.704+0000 7ff2b7800640 1 --2- 172.21.15.137:0/84676186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff298004810 0x7ff298004c90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00c240 tx=0x7ff29c01f3f0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.704+0000 7ff2b7800640 1 -- 172.21.15.137:0/84676186 shutdown_connections 2024-04-26T23:42:10.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.704+0000 7ff2b7800640 1 --2- 172.21.15.137:0/84676186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff298004810 0x7ff298004c90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.704+0000 7ff2b7800640 1 -- 172.21.15.137:0/84676186 >> 172.21.15.137:0/84676186 conn(0x7ff2b009ba60 msgr2=0x7ff2b009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:10.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.704+0000 7ff2b7800640 1 -- 172.21.15.137:0/84676186 shutdown_connections 2024-04-26T23:42:10.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2b7800640 1 -- 172.21.15.137:0/84676186 wait complete. 2024-04-26T23:42:10.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2b7800640 1 Processor -- start 2024-04-26T23:42:10.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2b7800640 1 -- start start 2024-04-26T23:42:10.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2b7800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff298004810 0x7ff2b00cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:10.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2b7800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2b01f86d0 0x7ff2b01591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:10.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2b7800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2b00c9ec0 0x7ff2b00ce950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:10.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2b7800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b00b0f10 con 0x7ff2b01f86d0 2024-04-26T23:42:10.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2b7800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b00b0d90 con 0x7ff2b00c9ec0 2024-04-26T23:42:10.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2b7800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff2b00b1090 con 0x7ff298004810 2024-04-26T23:42:10.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2afe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2b01f86d0 0x7ff2b01591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:10.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2afe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2b01f86d0 0x7ff2b01591b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38616/0 (socket says 172.21.15.137:38616) 2024-04-26T23:42:10.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2afe00640 1 -- 172.21.15.137:0/57445084 learned_addr learned my addr 172.21.15.137:0/57445084 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:10.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2b4e00640 1 --2- 172.21.15.137:0/57445084 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff298004810 0x7ff2b00cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:10.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2b5800640 1 --2- 172.21.15.137:0/57445084 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2b00c9ec0 0x7ff2b00ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:10.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2afe00640 1 -- 172.21.15.137:0/57445084 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff298004810 msgr2=0x7ff2b00cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:10.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2afe00640 1 --2- 172.21.15.137:0/57445084 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff298004810 0x7ff2b00cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2afe00640 1 -- 172.21.15.137:0/57445084 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2b00c9ec0 msgr2=0x7ff2b00ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:10.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2afe00640 1 --2- 172.21.15.137:0/57445084 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2b00c9ec0 0x7ff2b00ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2afe00640 1 -- 172.21.15.137:0/57445084 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b00cba70 con 0x7ff2b01f86d0 2024-04-26T23:42:10.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2b5800640 1 --2- 172.21.15.137:0/57445084 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2b00c9ec0 0x7ff2b00ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:10.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2afe00640 1 --2- 172.21.15.137:0/57445084 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2b01f86d0 0x7ff2b01591b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00c240 tx=0x7ff298005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:10.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2acc00640 1 -- 172.21.15.137:0/57445084 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c0049f0 con 0x7ff2b01f86d0 2024-04-26T23:42:10.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2acc00640 1 -- 172.21.15.137:0/57445084 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff29c0b6070 con 0x7ff2b01f86d0 2024-04-26T23:42:10.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2acc00640 1 -- 172.21.15.137:0/57445084 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c004db0 con 0x7ff2b01f86d0 2024-04-26T23:42:10.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.708+0000 7ff2b7800640 1 -- 172.21.15.137:0/57445084 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b01f8c20 con 0x7ff2b01f86d0 2024-04-26T23:42:10.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.712+0000 7ff2b7800640 1 -- 172.21.15.137:0/57445084 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b01f91e0 con 0x7ff2b01f86d0 2024-04-26T23:42:10.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.712+0000 7ff2b7800640 1 -- 172.21.15.137:0/57445084 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2b006a4b0 con 0x7ff2b01f86d0 2024-04-26T23:42:10.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.712+0000 7ff2acc00640 1 -- 172.21.15.137:0/57445084 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff29c0b8020 con 0x7ff2b01f86d0 2024-04-26T23:42:10.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.712+0000 7ff2acc00640 1 --2- 172.21.15.137:0/57445084 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff290068380 0x7ff29006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:10.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.712+0000 7ff2acc00640 1 -- 172.21.15.137:0/57445084 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7ff29c1236d0 con 0x7ff2b01f86d0 2024-04-26T23:42:10.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.712+0000 7ff2b4e00640 1 --2- 172.21.15.137:0/57445084 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff290068380 0x7ff29006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:10.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.712+0000 7ff2b4e00640 1 --2- 172.21.15.137:0/57445084 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff290068380 0x7ff29006a840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00cf630 tx=0x7ff2a4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:10.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.716+0000 7ff2acc00640 1 -- 172.21.15.137:0/57445084 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff29c0c2070 con 0x7ff2b01f86d0 2024-04-26T23:42:10.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.916+0000 7ff2b7800640 1 -- 172.21.15.137:0/57445084 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2b00c9950 con 0x7ff2b01f86d0 2024-04-26T23:42:10.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.920+0000 7ff2acc00640 1 -- 172.21.15.137:0/57445084 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7ff29c019100 con 0x7ff2b01f86d0 2024-04-26T23:42:10.924 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:10.924 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/861150521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":861150521},{"type":"v1","addr":"172.21.15.137:6836","nonce":861150521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/980246912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":980246912},{"type":"v1","addr":"172.21.15.137:6837","nonce":980246912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3288315078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3288315078},{"type":"v1","addr":"172.21.15.170:6835","nonce":3288315078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:41:23.574363+0000","modified":"2024-04-26T23:41:26.591710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6834/2444921875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2444921875},{"type":"v1","addr":"172.21.15.170:6834","nonce":2444921875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-26T23:42:10.924 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 8 2024-04-26T23:42:10.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.920+0000 7ff2b7800640 1 -- 172.21.15.137:0/57445084 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff290068380 msgr2=0x7ff29006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:10.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.920+0000 7ff2b7800640 1 --2- 172.21.15.137:0/57445084 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff290068380 0x7ff29006a840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00cf630 tx=0x7ff2a4008040 comp rx=0 tx=0).stop 2024-04-26T23:42:10.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.920+0000 7ff2b7800640 1 -- 172.21.15.137:0/57445084 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2b01f86d0 msgr2=0x7ff2b01591b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:10.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.920+0000 7ff2b7800640 1 --2- 172.21.15.137:0/57445084 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2b01f86d0 0x7ff2b01591b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00c240 tx=0x7ff298005840 comp rx=0 tx=0).stop 2024-04-26T23:42:10.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.920+0000 7ff2b7800640 1 -- 172.21.15.137:0/57445084 shutdown_connections 2024-04-26T23:42:10.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.920+0000 7ff2b7800640 1 --2- 172.21.15.137:0/57445084 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff290068380 0x7ff29006a840 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.920+0000 7ff2b7800640 1 --2- 172.21.15.137:0/57445084 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2b01f86d0 0x7ff2b01591b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.920+0000 7ff2b7800640 1 --2- 172.21.15.137:0/57445084 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2b00c9ec0 0x7ff2b00ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.920+0000 7ff2b7800640 1 --2- 172.21.15.137:0/57445084 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff298004810 0x7ff2b00cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:10.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.920+0000 7ff2b7800640 1 -- 172.21.15.137:0/57445084 >> 172.21.15.137:0/57445084 conn(0x7ff2b009ba60 msgr2=0x7ff2b0071400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:10.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.920+0000 7ff2b7800640 1 -- 172.21.15.137:0/57445084 shutdown_connections 2024-04-26T23:42:10.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:10.920+0000 7ff2b7800640 1 -- 172.21.15.137:0/57445084 wait complete. 2024-04-26T23:42:10.946 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:42:11.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.076+0000 7f9d96000640 1 Processor -- start 2024-04-26T23:42:11.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.076+0000 7f9d96000640 1 -- start start 2024-04-26T23:42:11.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.076+0000 7f9d96000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9d900725a0 0x7f9d900cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:11.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.076+0000 7f9d96000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d90073f30 0x7f9d90072980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:11.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.076+0000 7f9d96000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d900cfef0 con 0x7f9d90072ec0 2024-04-26T23:42:11.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.076+0000 7f9d96000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f9d900cddc0 con 0x7f9d900725a0 2024-04-26T23:42:11.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.076+0000 7f9d96000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9d900d01b0 con 0x7f9d90073f30 2024-04-26T23:42:11.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.076+0000 7f9d8f400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9d900725a0 0x7f9d900cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:11.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.076+0000 7f9d86a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d90073f30 0x7f9d90072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:11.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.076+0000 7f9d8fe00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f9d90072ec0 0x7f9d900b4070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:49854/0 (socket says 172.21.15.137:49854) 2024-04-26T23:42:11.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.076+0000 7f9d8fe00640 1 -- 172.21.15.137:0/563370756 learned_addr learned my addr 172.21.15.137:0/563370756 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:11.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.080+0000 7f9d8ea00640 1 -- 172.21.15.137:0/563370756 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3841280193 0 0) 0x7f9d900cfef0 con 0x7f9d90072ec0 2024-04-26T23:42:11.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.080+0000 7f9d8ea00640 1 -- 172.21.15.137:0/563370756 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d74003530 con 0x7f9d90072ec0 2024-04-26T23:42:11.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.080+0000 7f9d8f400640 1 -- 172.21.15.137:0/563370756 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d90073f30 msgr2=0x7f9d90072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:11.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.080+0000 7f9d8f400640 1 --2- 172.21.15.137:0/563370756 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d90073f30 0x7f9d90072980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.080+0000 7f9d8f400640 1 -- 172.21.15.137:0/563370756 >> v1:172.21.15.170:6789/0 conn(0x7f9d90072ec0 legacy=0x7f9d900b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:11.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.080+0000 7f9d8f400640 1 -- 172.21.15.137:0/563370756 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d900d0490 con 0x7f9d900725a0 2024-04-26T23:42:11.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.080+0000 7f9d86a00640 1 --2- 172.21.15.137:0/563370756 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d90073f30 0x7f9d90072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:42:11.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.080+0000 7f9d8f400640 1 --2- 172.21.15.137:0/563370756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d900725a0 0x7f9d900cd770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000bfa0 tx=0x7f9d8001eb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84e1b03366695b96 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:11.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.080+0000 7f9d8ea00640 1 -- 172.21.15.137:0/563370756 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8000b2d0 con 0x7f9d900725a0 2024-04-26T23:42:11.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.080+0000 7f9d8ea00640 1 -- 172.21.15.137:0/563370756 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d800a7a30 con 0x7f9d900725a0 2024-04-26T23:42:11.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.080+0000 7f9d8ea00640 1 -- 172.21.15.137:0/563370756 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d800a7e00 con 0x7f9d900725a0 2024-04-26T23:42:11.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.080+0000 7f9d96000640 1 -- 172.21.15.137:0/563370756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d900725a0 msgr2=0x7f9d900cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:11.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.080+0000 7f9d96000640 1 --2- 172.21.15.137:0/563370756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d900725a0 0x7f9d900cd770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000bfa0 tx=0x7f9d8001eb40 comp rx=0 tx=0).stop 2024-04-26T23:42:11.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.080+0000 7f9d96000640 1 -- 172.21.15.137:0/563370756 shutdown_connections 2024-04-26T23:42:11.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.080+0000 7f9d96000640 1 --2- 172.21.15.137:0/563370756 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d90073f30 0x7f9d90072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.080+0000 7f9d96000640 1 --2- 172.21.15.137:0/563370756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d900725a0 0x7f9d900cd770 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.080+0000 7f9d96000640 1 -- 172.21.15.137:0/563370756 >> 172.21.15.137:0/563370756 conn(0x7f9d9006c5d0 msgr2=0x7f9d9006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:11.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d96000640 1 -- 172.21.15.137:0/563370756 shutdown_connections 2024-04-26T23:42:11.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d96000640 1 -- 172.21.15.137:0/563370756 wait complete. 2024-04-26T23:42:11.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d96000640 1 Processor -- start 2024-04-26T23:42:11.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d96000640 1 -- start start 2024-04-26T23:42:11.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d96000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d900725a0 0x7f9d9013cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:11.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d96000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d90072ec0 0x7f9d90159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:11.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d96000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d90073f30 0x7f9d90159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:11.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d96000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9d900b5110 con 0x7f9d90072ec0 2024-04-26T23:42:11.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d96000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9d900b4f90 con 0x7f9d90073f30 2024-04-26T23:42:11.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d96000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9d900b5290 con 0x7f9d900725a0 2024-04-26T23:42:11.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d86a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d90072ec0 0x7f9d90159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d86a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d90072ec0 0x7f9d90159340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53296/0 (socket says 172.21.15.137:53296) 2024-04-26T23:42:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d86a00640 1 -- 172.21.15.137:0/3541391814 learned_addr learned my addr 172.21.15.137:0/3541391814 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d8f400640 1 --2- 172.21.15.137:0/3541391814 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d900725a0 0x7f9d9013cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d8fe00640 1 --2- 172.21.15.137:0/3541391814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d90073f30 0x7f9d90159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d86a00640 1 -- 172.21.15.137:0/3541391814 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d900725a0 msgr2=0x7f9d9013cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d86a00640 1 --2- 172.21.15.137:0/3541391814 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d900725a0 0x7f9d9013cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d86a00640 1 -- 172.21.15.137:0/3541391814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d90073f30 msgr2=0x7f9d90159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d86a00640 1 --2- 172.21.15.137:0/3541391814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d90073f30 0x7f9d90159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d86a00640 1 -- 172.21.15.137:0/3541391814 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d9015b2e0 con 0x7f9d90072ec0 2024-04-26T23:42:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d86a00640 1 --2- 172.21.15.137:0/3541391814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d90072ec0 0x7f9d90159340 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800ec10 tx=0x7f9d7800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d87e00640 1 -- 172.21.15.137:0/3541391814 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d78017070 con 0x7f9d90072ec0 2024-04-26T23:42:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d87e00640 1 -- 172.21.15.137:0/3541391814 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d7800cc30 con 0x7f9d90072ec0 2024-04-26T23:42:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d87e00640 1 -- 172.21.15.137:0/3541391814 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d78013470 con 0x7f9d90072ec0 2024-04-26T23:42:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.084+0000 7f9d96000640 1 -- 172.21.15.137:0/3541391814 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d9015b5c0 con 0x7f9d90072ec0 2024-04-26T23:42:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.088+0000 7f9d96000640 1 -- 172.21.15.137:0/3541391814 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d9015bb80 con 0x7f9d90072ec0 2024-04-26T23:42:11.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.088+0000 7f9d96000640 1 -- 172.21.15.137:0/3541391814 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d9006a4b0 con 0x7f9d90072ec0 2024-04-26T23:42:11.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.088+0000 7f9d87e00640 1 -- 172.21.15.137:0/3541391814 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9d7801a070 con 0x7f9d90072ec0 2024-04-26T23:42:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.088+0000 7f9d87e00640 1 --2- 172.21.15.137:0/3541391814 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9d6c068380 0x7f9d6c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.088+0000 7f9d87e00640 1 -- 172.21.15.137:0/3541391814 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f9d78086c70 con 0x7f9d90072ec0 2024-04-26T23:42:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.088+0000 7f9d8f400640 1 --2- 172.21.15.137:0/3541391814 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9d6c068380 0x7f9d6c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:11.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.088+0000 7f9d8f400640 1 --2- 172.21.15.137:0/3541391814 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9d6c068380 0x7f9d6c06a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9d800b0000 tx=0x7f9d800a9070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:11.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.092+0000 7f9d87e00640 1 -- 172.21.15.137:0/3541391814 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9d78056b60 con 0x7f9d90072ec0 2024-04-26T23:42:11.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.252+0000 7f9d96000640 1 -- 172.21.15.137:0/3541391814 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9d90072380 con 0x7f9d90072ec0 2024-04-26T23:42:11.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.252+0000 7f9d87e00640 1 -- 172.21.15.137:0/3541391814 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16902 (secure 0 0 0) 0x7f9d7805ae60 con 0x7f9d90072ec0 2024-04-26T23:42:11.259 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:11.259 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":22,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:42:04.750301+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:42:11.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.256+0000 7f9d96000640 1 -- 172.21.15.137:0/3541391814 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9d6c068380 msgr2=0x7f9d6c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:11.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.256+0000 7f9d96000640 1 --2- 172.21.15.137:0/3541391814 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9d6c068380 0x7f9d6c06a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9d800b0000 tx=0x7f9d800a9070 comp rx=0 tx=0).stop 2024-04-26T23:42:11.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.256+0000 7f9d96000640 1 -- 172.21.15.137:0/3541391814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d90072ec0 msgr2=0x7f9d90159340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:11.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.256+0000 7f9d96000640 1 --2- 172.21.15.137:0/3541391814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d90072ec0 0x7f9d90159340 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800ec10 tx=0x7f9d7800c520 comp rx=0 tx=0).stop 2024-04-26T23:42:11.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.256+0000 7f9d96000640 1 -- 172.21.15.137:0/3541391814 shutdown_connections 2024-04-26T23:42:11.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.256+0000 7f9d96000640 1 --2- 172.21.15.137:0/3541391814 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9d6c068380 0x7f9d6c06a840 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.256+0000 7f9d96000640 1 --2- 172.21.15.137:0/3541391814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d90072ec0 0x7f9d90159340 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.256+0000 7f9d96000640 1 --2- 172.21.15.137:0/3541391814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d90073f30 0x7f9d90159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.256+0000 7f9d96000640 1 --2- 172.21.15.137:0/3541391814 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d900725a0 0x7f9d9013cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.256+0000 7f9d96000640 1 -- 172.21.15.137:0/3541391814 >> 172.21.15.137:0/3541391814 conn(0x7f9d9006c5d0 msgr2=0x7f9d9013a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:11.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.256+0000 7f9d96000640 1 -- 172.21.15.137:0/3541391814 shutdown_connections 2024-04-26T23:42:11.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.256+0000 7f9d96000640 1 -- 172.21.15.137:0/3541391814 wait complete. 2024-04-26T23:42:11.280 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:41:21.810449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:41:22.533452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:42:11.280 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:42:11.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.412+0000 7f0456400640 1 Processor -- start 2024-04-26T23:42:11.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.412+0000 7f0456400640 1 -- start start 2024-04-26T23:42:11.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.416+0000 7f0456400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04500b5ee0 0x7f045015f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:11.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.416+0000 7f0456400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04500cffa0 con 0x7f04500b54e0 2024-04-26T23:42:11.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.416+0000 7f0456400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04500d0280 con 0x7f045015fe30 2024-04-26T23:42:11.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.416+0000 7f0456400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f04500b3d90 con 0x7f04500b5ee0 2024-04-26T23:42:11.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.416+0000 7f044f400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f04500b54e0 0x7f04500cd710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48072/0 (socket says 172.21.15.137:48072) 2024-04-26T23:42:11.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.416+0000 7f044f400640 1 -- 172.21.15.137:0/3988256816 learned_addr learned my addr 172.21.15.137:0/3988256816 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:11.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.416+0000 7f0446a00640 1 --2- 172.21.15.137:0/3988256816 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04500b5ee0 0x7f045015f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:11.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.416+0000 7f044ea00640 1 -- 172.21.15.137:0/3988256816 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 375126994 0 0) 0x7f04500cffa0 con 0x7f04500b54e0 2024-04-26T23:42:11.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.416+0000 7f044ea00640 1 -- 172.21.15.137:0/3988256816 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0434003530 con 0x7f04500b54e0 2024-04-26T23:42:11.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.416+0000 7f044ea00640 1 -- 172.21.15.137:0/3988256816 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1154726600 0 0) 0x7f04500d0280 con 0x7f045015fe30 2024-04-26T23:42:11.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.416+0000 7f044ea00640 1 -- 172.21.15.137:0/3988256816 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04500cffa0 con 0x7f045015fe30 2024-04-26T23:42:11.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.416+0000 7f044ea00640 1 -- 172.21.15.137:0/3988256816 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1947164640 0 0) 0x7f0434003530 con 0x7f04500b54e0 2024-04-26T23:42:11.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.416+0000 7f0446a00640 1 -- 172.21.15.137:0/3988256816 >> v1:172.21.15.170:6789/0 conn(0x7f045015fe30 legacy=0x7f0450144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:11.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.416+0000 7f0446a00640 1 -- 172.21.15.137:0/3988256816 >> v1:172.21.15.137:6789/0 conn(0x7f04500b54e0 legacy=0x7f04500cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:11.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.416+0000 7f0446a00640 1 -- 172.21.15.137:0/3988256816 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04500d0560 con 0x7f04500b5ee0 2024-04-26T23:42:11.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.420+0000 7f0446a00640 1 --2- 172.21.15.137:0/3988256816 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04500b5ee0 0x7f045015f8f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f04380097f0 tx=0x7f043801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7012483fc07e9a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:11.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.420+0000 7f044ea00640 1 -- 172.21.15.137:0/3988256816 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04380b0070 con 0x7f04500b5ee0 2024-04-26T23:42:11.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.420+0000 7f044ea00640 1 -- 172.21.15.137:0/3988256816 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04380ab400 con 0x7f04500b5ee0 2024-04-26T23:42:11.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.420+0000 7f044ea00640 1 -- 172.21.15.137:0/3988256816 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440001680 con 0x7f04500b5ee0 2024-04-26T23:42:11.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.420+0000 7f0456400640 1 -- 172.21.15.137:0/3988256816 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04500b5ee0 msgr2=0x7f045015f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:11.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.420+0000 7f0456400640 1 --2- 172.21.15.137:0/3988256816 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04500b5ee0 0x7f045015f8f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f04380097f0 tx=0x7f043801c400 comp rx=0 tx=0).stop 2024-04-26T23:42:11.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.420+0000 7f0456400640 1 -- 172.21.15.137:0/3988256816 shutdown_connections 2024-04-26T23:42:11.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.420+0000 7f0456400640 1 --2- 172.21.15.137:0/3988256816 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04500b5ee0 0x7f045015f8f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.420+0000 7f0456400640 1 -- 172.21.15.137:0/3988256816 >> 172.21.15.137:0/3988256816 conn(0x7f045006c800 msgr2=0x7f045006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:11.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.420+0000 7f0456400640 1 -- 172.21.15.137:0/3988256816 shutdown_connections 2024-04-26T23:42:11.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.420+0000 7f0456400640 1 -- 172.21.15.137:0/3988256816 wait complete. 2024-04-26T23:42:11.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.420+0000 7f0456400640 1 Processor -- start 2024-04-26T23:42:11.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.420+0000 7f0456400640 1 -- start start 2024-04-26T23:42:11.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f0456400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04500b54e0 0x7f04501448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:11.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f0456400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04500b5ee0 0x7f0450137170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:11.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f0456400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f045015fe30 0x7f0450164310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:11.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f0456400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0450145840 con 0x7f045015fe30 2024-04-26T23:42:11.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f0456400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0450160240 con 0x7f04500b54e0 2024-04-26T23:42:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f0456400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f04501459c0 con 0x7f04500b5ee0 2024-04-26T23:42:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f044fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f045015fe30 0x7f0450164310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f044fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f045015fe30 0x7f0450164310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53312/0 (socket says 172.21.15.137:53312) 2024-04-26T23:42:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f044fe00640 1 -- 172.21.15.137:0/774237001 learned_addr learned my addr 172.21.15.137:0/774237001 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f044f400640 1 --2- 172.21.15.137:0/774237001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04500b54e0 0x7f04501448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f0446a00640 1 --2- 172.21.15.137:0/774237001 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04500b5ee0 0x7f0450137170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f044fe00640 1 -- 172.21.15.137:0/774237001 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04500b5ee0 msgr2=0x7f0450137170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f044fe00640 1 --2- 172.21.15.137:0/774237001 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04500b5ee0 0x7f0450137170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f044fe00640 1 -- 172.21.15.137:0/774237001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04500b54e0 msgr2=0x7f04501448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f044fe00640 1 --2- 172.21.15.137:0/774237001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04500b54e0 0x7f04501448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f044fe00640 1 -- 172.21.15.137:0/774237001 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04501360d0 con 0x7f045015fe30 2024-04-26T23:42:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f0446a00640 1 --2- 172.21.15.137:0/774237001 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04500b5ee0 0x7f0450137170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f044f400640 1 --2- 172.21.15.137:0/774237001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04500b54e0 0x7f04501448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f044fe00640 1 --2- 172.21.15.137:0/774237001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f045015fe30 0x7f0450164310 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f044800c730 tx=0x7f044800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:11.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f0447e00640 1 -- 172.21.15.137:0/774237001 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0448003b80 con 0x7f045015fe30 2024-04-26T23:42:11.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f0447e00640 1 -- 172.21.15.137:0/774237001 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0448003d20 con 0x7f045015fe30 2024-04-26T23:42:11.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f0456400640 1 -- 172.21.15.137:0/774237001 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04501363b0 con 0x7f045015fe30 2024-04-26T23:42:11.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f0447e00640 1 -- 172.21.15.137:0/774237001 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044800aa90 con 0x7f045015fe30 2024-04-26T23:42:11.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f0456400640 1 -- 172.21.15.137:0/774237001 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0450136970 con 0x7f045015fe30 2024-04-26T23:42:11.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f0456400640 1 -- 172.21.15.137:0/774237001 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f045006a410 con 0x7f045015fe30 2024-04-26T23:42:11.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.424+0000 7f0447e00640 1 -- 172.21.15.137:0/774237001 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f044800ac30 con 0x7f045015fe30 2024-04-26T23:42:11.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.428+0000 7f0447e00640 1 --2- 172.21.15.137:0/774237001 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f042c0683b0 0x7f042c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:11.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.428+0000 7f0447e00640 1 -- 172.21.15.137:0/774237001 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f0448086920 con 0x7f045015fe30 2024-04-26T23:42:11.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.428+0000 7f044f400640 1 --2- 172.21.15.137:0/774237001 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f042c0683b0 0x7f042c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:11.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.428+0000 7f044f400640 1 --2- 172.21.15.137:0/774237001 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f042c0683b0 0x7f042c06a870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f04400011f0 tx=0x7f0440009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:11.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.432+0000 7f0447e00640 1 -- 172.21.15.137:0/774237001 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0448056e50 con 0x7f045015fe30 2024-04-26T23:42:11.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.592+0000 7f0456400640 1 -- 172.21.15.137:0/774237001 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f045006d410 con 0x7f045015fe30 2024-04-26T23:42:11.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.592+0000 7f0447e00640 1 -- 172.21.15.137:0/774237001 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f0448056750 con 0x7f045015fe30 2024-04-26T23:42:11.596 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:42:11.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.592+0000 7f0456400640 1 -- 172.21.15.137:0/774237001 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f042c0683b0 msgr2=0x7f042c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:11.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.592+0000 7f0456400640 1 --2- 172.21.15.137:0/774237001 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f042c0683b0 0x7f042c06a870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f04400011f0 tx=0x7f0440009040 comp rx=0 tx=0).stop 2024-04-26T23:42:11.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.592+0000 7f0456400640 1 -- 172.21.15.137:0/774237001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f045015fe30 msgr2=0x7f0450164310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:11.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.592+0000 7f0456400640 1 --2- 172.21.15.137:0/774237001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f045015fe30 0x7f0450164310 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f044800c730 tx=0x7f044800cbf0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.592+0000 7f0456400640 1 -- 172.21.15.137:0/774237001 shutdown_connections 2024-04-26T23:42:11.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.592+0000 7f0456400640 1 --2- 172.21.15.137:0/774237001 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f042c0683b0 0x7f042c06a870 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.592+0000 7f0456400640 1 --2- 172.21.15.137:0/774237001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f045015fe30 0x7f0450164310 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.592+0000 7f0456400640 1 --2- 172.21.15.137:0/774237001 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04500b5ee0 0x7f0450137170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.592+0000 7f0456400640 1 --2- 172.21.15.137:0/774237001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04500b54e0 0x7f04501448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.592+0000 7f0456400640 1 -- 172.21.15.137:0/774237001 >> 172.21.15.137:0/774237001 conn(0x7f045006c800 msgr2=0x7f04500b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:11.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.592+0000 7f0456400640 1 -- 172.21.15.137:0/774237001 shutdown_connections 2024-04-26T23:42:11.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.592+0000 7f0456400640 1 -- 172.21.15.137:0/774237001 wait complete. 2024-04-26T23:42:11.617 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:42:11.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.752+0000 7f79c1000640 1 Processor -- start 2024-04-26T23:42:11.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.752+0000 7f79c1000640 1 -- start start 2024-04-26T23:42:11.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.752+0000 7f79c1000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79bc073f20 0x7f79bc15df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:11.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.752+0000 7f79c1000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f79bc0affa0 0x7f79bc0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:11.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.752+0000 7f79c1000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79bc072860 con 0x7f79bc0afbc0 2024-04-26T23:42:11.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.752+0000 7f79c1000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f79bc0743b0 con 0x7f79bc0affa0 2024-04-26T23:42:11.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.752+0000 7f79c1000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f79bc072b00 con 0x7f79bc073f20 2024-04-26T23:42:11.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.752+0000 7f79b9e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f79bc0afbc0 0x7f79bc0735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48086/0 (socket says 172.21.15.137:48086) 2024-04-26T23:42:11.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.752+0000 7f79ba800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f79bc0affa0 0x7f79bc0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:11.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.752+0000 7f79b9e00640 1 -- 172.21.15.137:0/60172386 learned_addr learned my addr 172.21.15.137:0/60172386 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:11.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.752+0000 7f79b9400640 1 --2- 172.21.15.137:0/60172386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79bc073f20 0x7f79bc15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:11.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.752+0000 7f79ba800640 1 -- 172.21.15.137:0/60172386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79bc073f20 msgr2=0x7f79bc15df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:11.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.752+0000 7f79ba800640 1 --2- 172.21.15.137:0/60172386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79bc073f20 0x7f79bc15df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.752+0000 7f79ba800640 1 -- 172.21.15.137:0/60172386 >> v1:172.21.15.137:6789/0 conn(0x7f79bc0afbc0 legacy=0x7f79bc0735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:11.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.752+0000 7f79b8a00640 1 -- 172.21.15.137:0/60172386 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3240814702 0 0) 0x7f79bc072860 con 0x7f79bc0afbc0 2024-04-26T23:42:11.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.752+0000 7f79ba800640 1 -- 172.21.15.137:0/60172386 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79bc072de0 con 0x7f79bc0affa0 2024-04-26T23:42:11.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.756+0000 7f79ba800640 1 --2- 172.21.15.137:0/60172386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79bc0affa0 0x7f79bc0ce3b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009d90 tx=0x7f79b401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9ca71078c7855c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:11.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.756+0000 7f79b8a00640 1 -- 172.21.15.137:0/60172386 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b40b2070 con 0x7f79bc0affa0 2024-04-26T23:42:11.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.756+0000 7f79b8a00640 1 -- 172.21.15.137:0/60172386 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b40a5830 con 0x7f79bc0affa0 2024-04-26T23:42:11.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.756+0000 7f79b8a00640 1 -- 172.21.15.137:0/60172386 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b40a5c00 con 0x7f79bc0affa0 2024-04-26T23:42:11.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.756+0000 7f79c1000640 1 -- 172.21.15.137:0/60172386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79bc0affa0 msgr2=0x7f79bc0ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:11.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.756+0000 7f79c1000640 1 --2- 172.21.15.137:0/60172386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79bc0affa0 0x7f79bc0ce3b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009d90 tx=0x7f79b401c970 comp rx=0 tx=0).stop 2024-04-26T23:42:11.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.756+0000 7f79c1000640 1 -- 172.21.15.137:0/60172386 shutdown_connections 2024-04-26T23:42:11.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.756+0000 7f79c1000640 1 --2- 172.21.15.137:0/60172386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79bc0affa0 0x7f79bc0ce3b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.756+0000 7f79c1000640 1 --2- 172.21.15.137:0/60172386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79bc073f20 0x7f79bc15df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.756+0000 7f79c1000640 1 -- 172.21.15.137:0/60172386 >> 172.21.15.137:0/60172386 conn(0x7f79bc06c800 msgr2=0x7f79bc06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:11.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.756+0000 7f79c1000640 1 -- 172.21.15.137:0/60172386 shutdown_connections 2024-04-26T23:42:11.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.756+0000 7f79c1000640 1 -- 172.21.15.137:0/60172386 wait complete. 2024-04-26T23:42:11.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.756+0000 7f79c1000640 1 Processor -- start 2024-04-26T23:42:11.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.756+0000 7f79c1000640 1 -- start start 2024-04-26T23:42:11.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79c1000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79bc0afbc0 0x7f79bc1425d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:11.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79c1000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79bc0affa0 0x7f79bc0b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:11.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79c1000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79bc153b40 0x7f79bc0b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:11.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79c1000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f79bc06f3a0 con 0x7f79bc153b40 2024-04-26T23:42:11.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79c1000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f79bc06f220 con 0x7f79bc0affa0 2024-04-26T23:42:11.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79c1000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f79bc06f520 con 0x7f79bc0afbc0 2024-04-26T23:42:11.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79ba800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79bc153b40 0x7f79bc0b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:11.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79ba800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79bc153b40 0x7f79bc0b5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53320/0 (socket says 172.21.15.137:53320) 2024-04-26T23:42:11.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79ba800640 1 -- 172.21.15.137:0/3386886609 learned_addr learned my addr 172.21.15.137:0/3386886609 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:11.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79b9400640 1 --2- 172.21.15.137:0/3386886609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79bc0affa0 0x7f79bc0b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:11.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79b9e00640 1 --2- 172.21.15.137:0/3386886609 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79bc0afbc0 0x7f79bc1425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:11.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79ba800640 1 -- 172.21.15.137:0/3386886609 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79bc0afbc0 msgr2=0x7f79bc1425d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:11.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79ba800640 1 --2- 172.21.15.137:0/3386886609 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79bc0afbc0 0x7f79bc1425d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79ba800640 1 -- 172.21.15.137:0/3386886609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79bc0affa0 msgr2=0x7f79bc0b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:11.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79ba800640 1 --2- 172.21.15.137:0/3386886609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79bc0affa0 0x7f79bc0b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79ba800640 1 -- 172.21.15.137:0/3386886609 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79bc142b10 con 0x7f79bc153b40 2024-04-26T23:42:11.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79b9400640 1 --2- 172.21.15.137:0/3386886609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79bc0affa0 0x7f79bc0b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:11.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79ba800640 1 --2- 172.21.15.137:0/3386886609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79bc153b40 0x7f79bc0b5920 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f79b40b0040 tx=0x7f79b4019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:11.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79b2000640 1 -- 172.21.15.137:0/3386886609 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b40b2040 con 0x7f79bc153b40 2024-04-26T23:42:11.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79b2000640 1 -- 172.21.15.137:0/3386886609 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b40bf070 con 0x7f79bc153b40 2024-04-26T23:42:11.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79b2000640 1 -- 172.21.15.137:0/3386886609 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b40b88f0 con 0x7f79bc153b40 2024-04-26T23:42:11.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79c1000640 1 -- 172.21.15.137:0/3386886609 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79bc159190 con 0x7f79bc153b40 2024-04-26T23:42:11.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79c1000640 1 -- 172.21.15.137:0/3386886609 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79bc159750 con 0x7f79bc153b40 2024-04-26T23:42:11.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.760+0000 7f79c1000640 1 -- 172.21.15.137:0/3386886609 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79bc06a410 con 0x7f79bc153b40 2024-04-26T23:42:11.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.764+0000 7f79b2000640 1 -- 172.21.15.137:0/3386886609 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f79b40a56b0 con 0x7f79bc153b40 2024-04-26T23:42:11.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.764+0000 7f79b2000640 1 --2- 172.21.15.137:0/3386886609 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f799c068380 0x7f799c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:11.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.764+0000 7f79b2000640 1 -- 172.21.15.137:0/3386886609 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f79b4121bc0 con 0x7f79bc153b40 2024-04-26T23:42:11.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.764+0000 7f79b9e00640 1 --2- 172.21.15.137:0/3386886609 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f799c068380 0x7f799c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:11.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.764+0000 7f79b9e00640 1 --2- 172.21.15.137:0/3386886609 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f799c068380 0x7f799c06a840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f79ac000f70 tx=0x7f79ac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:11.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.768+0000 7f79b2000640 1 -- 172.21.15.137:0/3386886609 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f79b4016560 con 0x7f79bc153b40 2024-04-26T23:42:11.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.924+0000 7f79c1000640 1 -- 172.21.15.137:0/3386886609 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f79bc0b33d0 con 0x7f79bc153b40 2024-04-26T23:42:11.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.928+0000 7f79b2000640 1 -- 172.21.15.137:0/3386886609 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f79b40f2190 con 0x7f79bc153b40 2024-04-26T23:42:11.932 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:42:11.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.928+0000 7f79c1000640 1 -- 172.21.15.137:0/3386886609 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f799c068380 msgr2=0x7f799c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:11.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.928+0000 7f79c1000640 1 --2- 172.21.15.137:0/3386886609 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f799c068380 0x7f799c06a840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f79ac000f70 tx=0x7f79ac009040 comp rx=0 tx=0).stop 2024-04-26T23:42:11.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.928+0000 7f79c1000640 1 -- 172.21.15.137:0/3386886609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79bc153b40 msgr2=0x7f79bc0b5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:11.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.928+0000 7f79c1000640 1 --2- 172.21.15.137:0/3386886609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79bc153b40 0x7f79bc0b5920 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f79b40b0040 tx=0x7f79b4019710 comp rx=0 tx=0).stop 2024-04-26T23:42:11.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.928+0000 7f79c1000640 1 -- 172.21.15.137:0/3386886609 shutdown_connections 2024-04-26T23:42:11.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.928+0000 7f79c1000640 1 --2- 172.21.15.137:0/3386886609 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f799c068380 0x7f799c06a840 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.928+0000 7f79c1000640 1 --2- 172.21.15.137:0/3386886609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79bc153b40 0x7f79bc0b5920 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.928+0000 7f79c1000640 1 --2- 172.21.15.137:0/3386886609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79bc0affa0 0x7f79bc0b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.928+0000 7f79c1000640 1 --2- 172.21.15.137:0/3386886609 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79bc0afbc0 0x7f79bc1425d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:11.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.928+0000 7f79c1000640 1 -- 172.21.15.137:0/3386886609 >> 172.21.15.137:0/3386886609 conn(0x7f79bc06c800 msgr2=0x7f79bc0b2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:11.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.928+0000 7f79c1000640 1 -- 172.21.15.137:0/3386886609 shutdown_connections 2024-04-26T23:42:11.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:11.928+0000 7f79c1000640 1 -- 172.21.15.137:0/3386886609 wait complete. 2024-04-26T23:42:11.952 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:42:12.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.088+0000 7faaf0e00640 1 Processor -- start 2024-04-26T23:42:12.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.088+0000 7faaf0e00640 1 -- start start 2024-04-26T23:42:12.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.088+0000 7faaf0e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faaec0b5ee0 0x7faaec15f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:12.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.088+0000 7faaf0e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaec0cffa0 con 0x7faaec0b54e0 2024-04-26T23:42:12.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.088+0000 7faaf0e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaec0d0280 con 0x7faaec15fe30 2024-04-26T23:42:12.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.088+0000 7faaf0e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7faaec0b3d90 con 0x7faaec0b5ee0 2024-04-26T23:42:12.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.088+0000 7faae9e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7faaec0b54e0 0x7faaec0cd710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48094/0 (socket says 172.21.15.137:48094) 2024-04-26T23:42:12.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.088+0000 7faae9e00640 1 -- 172.21.15.137:0/32455633 learned_addr learned my addr 172.21.15.137:0/32455633 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:12.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.088+0000 7faae9400640 1 --2- 172.21.15.137:0/32455633 >> v2:172.21.15.137:3300/0 conn(0x7faaec0b5ee0 0x7faaec15f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:12.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.088+0000 7faae8a00640 1 -- 172.21.15.137:0/32455633 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3734722939 0 0) 0x7faaec0cffa0 con 0x7faaec0b54e0 2024-04-26T23:42:12.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.088+0000 7faae8a00640 1 -- 172.21.15.137:0/32455633 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faad0003530 con 0x7faaec0b54e0 2024-04-26T23:42:12.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.088+0000 7faae9400640 1 -- 172.21.15.137:0/32455633 >> v1:172.21.15.170:6789/0 conn(0x7faaec15fe30 legacy=0x7faaec144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:12.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.088+0000 7faae9400640 1 -- 172.21.15.137:0/32455633 >> v1:172.21.15.137:6789/0 conn(0x7faaec0b54e0 legacy=0x7faaec0cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:12.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.088+0000 7faae9400640 1 -- 172.21.15.137:0/32455633 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaec0d0560 con 0x7faaec0b5ee0 2024-04-26T23:42:12.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.092+0000 7faae9400640 1 --2- 172.21.15.137:0/32455633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faaec0b5ee0 0x7faaec15f8f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7faad80097c0 tx=0x7faad801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5942b69cf0e9216 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:12.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.092+0000 7faae8a00640 1 -- 172.21.15.137:0/32455633 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad80b0070 con 0x7faaec0b5ee0 2024-04-26T23:42:12.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.092+0000 7faae8a00640 1 -- 172.21.15.137:0/32455633 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad80ab600 con 0x7faaec0b5ee0 2024-04-26T23:42:12.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.092+0000 7faae8a00640 1 -- 172.21.15.137:0/32455633 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad80ab9d0 con 0x7faaec0b5ee0 2024-04-26T23:42:12.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.092+0000 7faaf0e00640 1 -- 172.21.15.137:0/32455633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faaec0b5ee0 msgr2=0x7faaec15f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:12.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.092+0000 7faaf0e00640 1 --2- 172.21.15.137:0/32455633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faaec0b5ee0 0x7faaec15f8f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7faad80097c0 tx=0x7faad801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.092+0000 7faaf0e00640 1 -- 172.21.15.137:0/32455633 shutdown_connections 2024-04-26T23:42:12.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.092+0000 7faaf0e00640 1 --2- 172.21.15.137:0/32455633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faaec0b5ee0 0x7faaec15f8f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.092+0000 7faaf0e00640 1 -- 172.21.15.137:0/32455633 >> 172.21.15.137:0/32455633 conn(0x7faaec06c800 msgr2=0x7faaec06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:12.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.092+0000 7faaf0e00640 1 -- 172.21.15.137:0/32455633 shutdown_connections 2024-04-26T23:42:12.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.092+0000 7faaf0e00640 1 -- 172.21.15.137:0/32455633 wait complete. 2024-04-26T23:42:12.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faaf0e00640 1 Processor -- start 2024-04-26T23:42:12.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faaf0e00640 1 -- start start 2024-04-26T23:42:12.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faaf0e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faaec0b54e0 0x7faaec0ad050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:12.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faaf0e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faaec0b5ee0 0x7faaec0afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:12.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faaf0e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faaec15fe30 0x7faaec0ab060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:12.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faaf0e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faaec145840 con 0x7faaec15fe30 2024-04-26T23:42:12.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faaf0e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faaec160240 con 0x7faaec0b54e0 2024-04-26T23:42:12.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faaf0e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faaec1459c0 con 0x7faaec0b5ee0 2024-04-26T23:42:12.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faaea800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faaec15fe30 0x7faaec0ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:12.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faaea800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faaec15fe30 0x7faaec0ab060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53328/0 (socket says 172.21.15.137:53328) 2024-04-26T23:42:12.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faaea800640 1 -- 172.21.15.137:0/589276889 learned_addr learned my addr 172.21.15.137:0/589276889 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:12.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faae9e00640 1 --2- 172.21.15.137:0/589276889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faaec0b54e0 0x7faaec0ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:12.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faae9400640 1 --2- 172.21.15.137:0/589276889 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faaec0b5ee0 0x7faaec0afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:12.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faaea800640 1 -- 172.21.15.137:0/589276889 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faaec0b5ee0 msgr2=0x7faaec0afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:12.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faaea800640 1 --2- 172.21.15.137:0/589276889 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faaec0b5ee0 0x7faaec0afee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faaea800640 1 -- 172.21.15.137:0/589276889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faaec0b54e0 msgr2=0x7faaec0ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:12.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faaea800640 1 --2- 172.21.15.137:0/589276889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faaec0b54e0 0x7faaec0ad050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faaea800640 1 -- 172.21.15.137:0/589276889 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaec0abd10 con 0x7faaec15fe30 2024-04-26T23:42:12.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faaea800640 1 --2- 172.21.15.137:0/589276889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faaec15fe30 0x7faaec0ab060 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faae400c730 tx=0x7faae400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:12.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faae2000640 1 -- 172.21.15.137:0/589276889 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae4003b80 con 0x7faaec15fe30 2024-04-26T23:42:12.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faae2000640 1 -- 172.21.15.137:0/589276889 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faae4003d20 con 0x7faaec15fe30 2024-04-26T23:42:12.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faae2000640 1 -- 172.21.15.137:0/589276889 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae400aa30 con 0x7faaec15fe30 2024-04-26T23:42:12.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faaf0e00640 1 -- 172.21.15.137:0/589276889 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaec0abfb0 con 0x7faaec15fe30 2024-04-26T23:42:12.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.096+0000 7faaf0e00640 1 -- 172.21.15.137:0/589276889 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaec0ac570 con 0x7faaec15fe30 2024-04-26T23:42:12.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.100+0000 7faaf0e00640 1 -- 172.21.15.137:0/589276889 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaec06a410 con 0x7faaec15fe30 2024-04-26T23:42:12.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.100+0000 7faae2000640 1 -- 172.21.15.137:0/589276889 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faae400abd0 con 0x7faaec15fe30 2024-04-26T23:42:12.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.100+0000 7faae2000640 1 --2- 172.21.15.137:0/589276889 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7faacc068380 0x7faacc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:12.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.100+0000 7faae2000640 1 -- 172.21.15.137:0/589276889 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7faae4086780 con 0x7faaec15fe30 2024-04-26T23:42:12.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.100+0000 7faae9e00640 1 --2- 172.21.15.137:0/589276889 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7faacc068380 0x7faacc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:12.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.100+0000 7faae9e00640 1 --2- 172.21.15.137:0/589276889 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7faacc068380 0x7faacc06a840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faadc0011f0 tx=0x7faadc007d40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:12.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.104+0000 7faae2000640 1 -- 172.21.15.137:0/589276889 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7faae4056670 con 0x7faaec15fe30 2024-04-26T23:42:12.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.264+0000 7faaf0e00640 1 -- 172.21.15.137:0/589276889 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7faaec0acce0 con 0x7faaec15fe30 2024-04-26T23:42:12.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.264+0000 7faae2000640 1 -- 172.21.15.137:0/589276889 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7faae405a970 con 0x7faaec15fe30 2024-04-26T23:42:12.271 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:42:12.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.268+0000 7faaf0e00640 1 -- 172.21.15.137:0/589276889 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7faacc068380 msgr2=0x7faacc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:12.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.268+0000 7faaf0e00640 1 --2- 172.21.15.137:0/589276889 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7faacc068380 0x7faacc06a840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faadc0011f0 tx=0x7faadc007d40 comp rx=0 tx=0).stop 2024-04-26T23:42:12.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.268+0000 7faaf0e00640 1 -- 172.21.15.137:0/589276889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faaec15fe30 msgr2=0x7faaec0ab060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:12.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.268+0000 7faaf0e00640 1 --2- 172.21.15.137:0/589276889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faaec15fe30 0x7faaec0ab060 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faae400c730 tx=0x7faae400cbf0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.268+0000 7faaf0e00640 1 -- 172.21.15.137:0/589276889 shutdown_connections 2024-04-26T23:42:12.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.268+0000 7faaf0e00640 1 --2- 172.21.15.137:0/589276889 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7faacc068380 0x7faacc06a840 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.268+0000 7faaf0e00640 1 --2- 172.21.15.137:0/589276889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faaec15fe30 0x7faaec0ab060 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.268+0000 7faaf0e00640 1 --2- 172.21.15.137:0/589276889 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faaec0b5ee0 0x7faaec0afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.268+0000 7faaf0e00640 1 --2- 172.21.15.137:0/589276889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faaec0b54e0 0x7faaec0ad050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.268+0000 7faaf0e00640 1 -- 172.21.15.137:0/589276889 >> 172.21.15.137:0/589276889 conn(0x7faaec06c800 msgr2=0x7faaec0cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:12.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.268+0000 7faaf0e00640 1 -- 172.21.15.137:0/589276889 shutdown_connections 2024-04-26T23:42:12.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.268+0000 7faaf0e00640 1 -- 172.21.15.137:0/589276889 wait complete. 2024-04-26T23:42:12.292 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:42:12.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.420+0000 7fb70d000640 1 Processor -- start 2024-04-26T23:42:12.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.420+0000 7fb70d000640 1 -- start start 2024-04-26T23:42:12.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.424+0000 7fb70d000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb708148950 0x7fb70815fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:12.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.424+0000 7fb70d000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb7080b4ad0 0x7fb70806f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:12.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.424+0000 7fb70d000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb708148d30 con 0x7fb70806f6d0 2024-04-26T23:42:12.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.424+0000 7fb70d000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb70806fb30 con 0x7fb708148950 2024-04-26T23:42:12.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.424+0000 7fb70d000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb708073540 con 0x7fb7080b4ad0 2024-04-26T23:42:12.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.424+0000 7fb705e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb708148950 0x7fb70815fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:12.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.424+0000 7fb705e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb708148950 0x7fb70815fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53344/0 (socket says 172.21.15.137:53344) 2024-04-26T23:42:12.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.424+0000 7fb705e00640 1 -- 172.21.15.137:0/2146743128 learned_addr learned my addr 172.21.15.137:0/2146743128 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:12.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.424+0000 7fb6fd400640 1 --2- 172.21.15.137:0/2146743128 >> v2:172.21.15.170:3300/0 conn(0x7fb7080b4ad0 0x7fb70806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:12.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.424+0000 7fb705e00640 1 -- 172.21.15.137:0/2146743128 >> v2:172.21.15.170:3300/0 conn(0x7fb7080b4ad0 msgr2=0x7fb70806f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:12.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.424+0000 7fb705e00640 1 --2- 172.21.15.137:0/2146743128 >> v2:172.21.15.170:3300/0 conn(0x7fb7080b4ad0 0x7fb70806f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.424+0000 7fb705e00640 1 -- 172.21.15.137:0/2146743128 >> v1:172.21.15.170:6789/0 conn(0x7fb70806f6d0 legacy=0x7fb7080b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:12.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.424+0000 7fb705e00640 1 -- 172.21.15.137:0/2146743128 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb708073820 con 0x7fb708148950 2024-04-26T23:42:12.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb705e00640 1 --2- 172.21.15.137:0/2146743128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb708148950 0x7fb70815fdc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb7080b0650 tx=0x7fb6f801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9e5f4b5a8dfe04 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:12.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb705400640 1 -- 172.21.15.137:0/2146743128 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80a57a0 con 0x7fb708148950 2024-04-26T23:42:12.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb705400640 1 -- 172.21.15.137:0/2146743128 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f80a5940 con 0x7fb708148950 2024-04-26T23:42:12.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb705400640 1 -- 172.21.15.137:0/2146743128 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80a5d10 con 0x7fb708148950 2024-04-26T23:42:12.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb70d000640 1 -- 172.21.15.137:0/2146743128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb708148950 msgr2=0x7fb70815fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:12.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb70d000640 1 --2- 172.21.15.137:0/2146743128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb708148950 0x7fb70815fdc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb7080b0650 tx=0x7fb6f801c9c0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb70d000640 1 -- 172.21.15.137:0/2146743128 shutdown_connections 2024-04-26T23:42:12.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb70d000640 1 --2- 172.21.15.137:0/2146743128 >> v2:172.21.15.170:3300/0 conn(0x7fb7080b4ad0 0x7fb70806f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb70d000640 1 --2- 172.21.15.137:0/2146743128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb708148950 0x7fb70815fdc0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb70d000640 1 -- 172.21.15.137:0/2146743128 >> 172.21.15.137:0/2146743128 conn(0x7fb70806c5d0 msgr2=0x7fb70806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:12.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb70d000640 1 -- 172.21.15.137:0/2146743128 shutdown_connections 2024-04-26T23:42:12.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb70d000640 1 -- 172.21.15.137:0/2146743128 wait complete. 2024-04-26T23:42:12.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb70d000640 1 Processor -- start 2024-04-26T23:42:12.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb70d000640 1 -- start start 2024-04-26T23:42:12.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb70d000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb70806f6d0 0x7fb70815e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:12.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb70d000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7080b4ad0 0x7fb7080cd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:12.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb70d000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb708148950 0x7fb70815f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:12.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb70d000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb708074480 con 0x7fb70806f6d0 2024-04-26T23:42:12.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb70d000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb708074300 con 0x7fb708148950 2024-04-26T23:42:12.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb70d000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb708160300 con 0x7fb7080b4ad0 2024-04-26T23:42:12.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb705e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb70806f6d0 0x7fb70815e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:12.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb705e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb70806f6d0 0x7fb70815e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53346/0 (socket says 172.21.15.137:53346) 2024-04-26T23:42:12.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb705e00640 1 -- 172.21.15.137:0/2939435952 learned_addr learned my addr 172.21.15.137:0/2939435952 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:12.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb706800640 1 --2- 172.21.15.137:0/2939435952 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb708148950 0x7fb70815f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:12.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.428+0000 7fb6fd400640 1 --2- 172.21.15.137:0/2939435952 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7080b4ad0 0x7fb7080cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:12.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.432+0000 7fb705e00640 1 -- 172.21.15.137:0/2939435952 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7080b4ad0 msgr2=0x7fb7080cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:12.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.432+0000 7fb705e00640 1 --2- 172.21.15.137:0/2939435952 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7080b4ad0 0x7fb7080cd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.432+0000 7fb705e00640 1 -- 172.21.15.137:0/2939435952 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb708148950 msgr2=0x7fb70815f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:12.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.432+0000 7fb705e00640 1 --2- 172.21.15.137:0/2939435952 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb708148950 0x7fb70815f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.432+0000 7fb705e00640 1 -- 172.21.15.137:0/2939435952 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7080ce430 con 0x7fb70806f6d0 2024-04-26T23:42:12.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.432+0000 7fb705e00640 1 --2- 172.21.15.137:0/2939435952 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb70806f6d0 0x7fb70815e710 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80af040 tx=0x7fb6f8019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:12.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.432+0000 7fb6fea00640 1 -- 172.21.15.137:0/2939435952 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80bc020 con 0x7fb70806f6d0 2024-04-26T23:42:12.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.432+0000 7fb6fea00640 1 -- 172.21.15.137:0/2939435952 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f80b8670 con 0x7fb70806f6d0 2024-04-26T23:42:12.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.432+0000 7fb6fea00640 1 -- 172.21.15.137:0/2939435952 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80b8a40 con 0x7fb70806f6d0 2024-04-26T23:42:12.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.432+0000 7fb70d000640 1 -- 172.21.15.137:0/2939435952 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb708140070 con 0x7fb70806f6d0 2024-04-26T23:42:12.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.432+0000 7fb70d000640 1 -- 172.21.15.137:0/2939435952 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb708140630 con 0x7fb70806f6d0 2024-04-26T23:42:12.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.432+0000 7fb70d000640 1 -- 172.21.15.137:0/2939435952 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb70806a4b0 con 0x7fb70806f6d0 2024-04-26T23:42:12.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.432+0000 7fb6fea00640 1 -- 172.21.15.137:0/2939435952 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb6f80bf020 con 0x7fb70806f6d0 2024-04-26T23:42:12.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.436+0000 7fb6fea00640 1 --2- 172.21.15.137:0/2939435952 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb6e4068380 0x7fb6e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:12.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.436+0000 7fb6fea00640 1 -- 172.21.15.137:0/2939435952 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fb6f81219a0 con 0x7fb70806f6d0 2024-04-26T23:42:12.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.436+0000 7fb6fd400640 1 --2- 172.21.15.137:0/2939435952 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb6e4068380 0x7fb6e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:12.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.436+0000 7fb6fd400640 1 --2- 172.21.15.137:0/2939435952 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb6e4068380 0x7fb6e406a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb70815f150 tx=0x7fb6f0009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:12.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.440+0000 7fb6fea00640 1 -- 172.21.15.137:0/2939435952 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb6f80c6030 con 0x7fb70806f6d0 2024-04-26T23:42:12.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.628+0000 7fb70d000640 1 -- 172.21.15.137:0/2939435952 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb708146010 con 0x7fb70806f6d0 2024-04-26T23:42:12.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.628+0000 7fb6fea00640 1 -- 172.21.15.137:0/2939435952 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7fb6f80165e0 con 0x7fb70806f6d0 2024-04-26T23:42:12.634 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:12.634 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/861150521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":861150521},{"type":"v1","addr":"172.21.15.137:6836","nonce":861150521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/980246912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":980246912},{"type":"v1","addr":"172.21.15.137:6837","nonce":980246912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3288315078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3288315078},{"type":"v1","addr":"172.21.15.170:6835","nonce":3288315078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:41:23.574363+0000","modified":"2024-04-26T23:41:26.591710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6834/2444921875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2444921875},{"type":"v1","addr":"172.21.15.170:6834","nonce":2444921875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-26T23:42:12.634 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 8 2024-04-26T23:42:12.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.632+0000 7fb70d000640 1 -- 172.21.15.137:0/2939435952 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb6e4068380 msgr2=0x7fb6e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:12.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.632+0000 7fb70d000640 1 --2- 172.21.15.137:0/2939435952 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb6e4068380 0x7fb6e406a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb70815f150 tx=0x7fb6f0009190 comp rx=0 tx=0).stop 2024-04-26T23:42:12.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.632+0000 7fb70d000640 1 -- 172.21.15.137:0/2939435952 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb70806f6d0 msgr2=0x7fb70815e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:12.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.632+0000 7fb70d000640 1 --2- 172.21.15.137:0/2939435952 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb70806f6d0 0x7fb70815e710 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80af040 tx=0x7fb6f8019760 comp rx=0 tx=0).stop 2024-04-26T23:42:12.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.632+0000 7fb70d000640 1 -- 172.21.15.137:0/2939435952 shutdown_connections 2024-04-26T23:42:12.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.632+0000 7fb70d000640 1 --2- 172.21.15.137:0/2939435952 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb6e4068380 0x7fb6e406a840 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.632+0000 7fb70d000640 1 --2- 172.21.15.137:0/2939435952 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb708148950 0x7fb70815f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.632+0000 7fb70d000640 1 --2- 172.21.15.137:0/2939435952 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7080b4ad0 0x7fb7080cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.632+0000 7fb70d000640 1 --2- 172.21.15.137:0/2939435952 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb70806f6d0 0x7fb70815e710 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.632+0000 7fb70d000640 1 -- 172.21.15.137:0/2939435952 >> 172.21.15.137:0/2939435952 conn(0x7fb70806c5d0 msgr2=0x7fb7080b5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:12.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.632+0000 7fb70d000640 1 -- 172.21.15.137:0/2939435952 shutdown_connections 2024-04-26T23:42:12.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.632+0000 7fb70d000640 1 -- 172.21.15.137:0/2939435952 wait complete. 2024-04-26T23:42:12.655 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:42:12.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.784+0000 7f91a1e00640 1 Processor -- start 2024-04-26T23:42:12.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.784+0000 7f91a1e00640 1 -- start start 2024-04-26T23:42:12.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.788+0000 7f91a1e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f919c15cf40 0x7f919c0d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:12.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.788+0000 7f91a1e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f919c0d2a20 0x7f919c0d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:12.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.788+0000 7f91a1e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f919c0d0580 con 0x7f919c0ce7b0 2024-04-26T23:42:12.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.788+0000 7f91a1e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f919c0cd510 con 0x7f919c0d2a20 2024-04-26T23:42:12.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.788+0000 7f91a1e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f919c160930 con 0x7f919c15cf40 2024-04-26T23:42:12.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.788+0000 7f919be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f919c0d2a20 0x7f919c0d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:12.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.788+0000 7f91a1400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f919c0ce7b0 0x7f919c0cec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48102/0 (socket says 172.21.15.137:48102) 2024-04-26T23:42:12.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.788+0000 7f91a1400640 1 -- 172.21.15.137:0/3959190216 learned_addr learned my addr 172.21.15.137:0/3959190216 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:12.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.788+0000 7f91a0a00640 1 --2- 172.21.15.137:0/3959190216 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f919c15cf40 0x7f919c0d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:12.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.788+0000 7f919be00640 1 -- 172.21.15.137:0/3959190216 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f919c15cf40 msgr2=0x7f919c0d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:12.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.788+0000 7f919be00640 1 --2- 172.21.15.137:0/3959190216 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f919c15cf40 0x7f919c0d1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.788+0000 7f919be00640 1 -- 172.21.15.137:0/3959190216 >> v1:172.21.15.137:6789/0 conn(0x7f919c0ce7b0 legacy=0x7f919c0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:12.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.788+0000 7f919be00640 1 -- 172.21.15.137:0/3959190216 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919c0d33e0 con 0x7f919c0d2a20 2024-04-26T23:42:12.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.792+0000 7f919be00640 1 --2- 172.21.15.137:0/3959190216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f919c0d2a20 0x7f919c0d2ea0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f919c160ab0 tx=0x7f918801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc3321ac9136ca8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:12.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.792+0000 7f919b400640 1 -- 172.21.15.137:0/3959190216 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91880b5070 con 0x7f919c0d2a20 2024-04-26T23:42:12.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.792+0000 7f919b400640 1 -- 172.21.15.137:0/3959190216 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91880a8990 con 0x7f919c0d2a20 2024-04-26T23:42:12.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.792+0000 7f919b400640 1 -- 172.21.15.137:0/3959190216 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91880a8d60 con 0x7f919c0d2a20 2024-04-26T23:42:12.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.792+0000 7f91a1e00640 1 -- 172.21.15.137:0/3959190216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f919c0d2a20 msgr2=0x7f919c0d2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:12.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.792+0000 7f91a1e00640 1 --2- 172.21.15.137:0/3959190216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f919c0d2a20 0x7f919c0d2ea0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f919c160ab0 tx=0x7f918801ec90 comp rx=0 tx=0).stop 2024-04-26T23:42:12.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.792+0000 7f91a1e00640 1 -- 172.21.15.137:0/3959190216 shutdown_connections 2024-04-26T23:42:12.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.792+0000 7f91a1e00640 1 --2- 172.21.15.137:0/3959190216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f919c0d2a20 0x7f919c0d2ea0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.792+0000 7f91a1e00640 1 --2- 172.21.15.137:0/3959190216 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f919c15cf40 0x7f919c0d1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.792+0000 7f91a1e00640 1 -- 172.21.15.137:0/3959190216 >> 172.21.15.137:0/3959190216 conn(0x7f919c09ba60 msgr2=0x7f919c09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:12.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.792+0000 7f91a1e00640 1 -- 172.21.15.137:0/3959190216 shutdown_connections 2024-04-26T23:42:12.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.792+0000 7f91a1e00640 1 -- 172.21.15.137:0/3959190216 wait complete. 2024-04-26T23:42:12.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.792+0000 7f91a1e00640 1 Processor -- start 2024-04-26T23:42:12.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.792+0000 7f91a1e00640 1 -- start start 2024-04-26T23:42:12.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f91a1e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f919c0ce7b0 0x7f919c15bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:12.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f91a1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f919c0d2a20 0x7f919c0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:12.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f91a1e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f919c15cf40 0x7f919c0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:12.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f91a1e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f919c160e60 con 0x7f919c0ce7b0 2024-04-26T23:42:12.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f91a1e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f919c161790 con 0x7f919c0d2a20 2024-04-26T23:42:12.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f91a1e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f919c161140 con 0x7f919c15cf40 2024-04-26T23:42:12.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f91a0a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f919c0ce7b0 0x7f919c15bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:12.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f91a0a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f919c0ce7b0 0x7f919c15bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53354/0 (socket says 172.21.15.137:53354) 2024-04-26T23:42:12.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f91a0a00640 1 -- 172.21.15.137:0/3704064264 learned_addr learned my addr 172.21.15.137:0/3704064264 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:12.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f91a1400640 1 --2- 172.21.15.137:0/3704064264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f919c15cf40 0x7f919c0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:12.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f919be00640 1 --2- 172.21.15.137:0/3704064264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f919c0d2a20 0x7f919c0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:12.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f91a0a00640 1 -- 172.21.15.137:0/3704064264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f919c15cf40 msgr2=0x7f919c0b77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:12.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f91a0a00640 1 --2- 172.21.15.137:0/3704064264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f919c15cf40 0x7f919c0b77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f91a0a00640 1 -- 172.21.15.137:0/3704064264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f919c0d2a20 msgr2=0x7f919c0cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:12.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f91a0a00640 1 --2- 172.21.15.137:0/3704064264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f919c0d2a20 0x7f919c0cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f91a0a00640 1 -- 172.21.15.137:0/3704064264 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919c0b7f80 con 0x7f919c0ce7b0 2024-04-26T23:42:12.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f91a1400640 1 --2- 172.21.15.137:0/3704064264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f919c15cf40 0x7f919c0b77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:12.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f91a0a00640 1 --2- 172.21.15.137:0/3704064264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f919c0ce7b0 0x7f919c15bbf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f918c009d10 tx=0x7f918c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:12.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f9198c00640 1 -- 172.21.15.137:0/3704064264 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c018020 con 0x7f919c0ce7b0 2024-04-26T23:42:12.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f9198c00640 1 -- 172.21.15.137:0/3704064264 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f918c014480 con 0x7f919c0ce7b0 2024-04-26T23:42:12.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f9198c00640 1 -- 172.21.15.137:0/3704064264 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c014830 con 0x7f919c0ce7b0 2024-04-26T23:42:12.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f91a1e00640 1 -- 172.21.15.137:0/3704064264 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f919c0b8260 con 0x7f919c0ce7b0 2024-04-26T23:42:12.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f91a1e00640 1 -- 172.21.15.137:0/3704064264 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f919c06c8f0 con 0x7f919c0ce7b0 2024-04-26T23:42:12.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.796+0000 7f91a1e00640 1 -- 172.21.15.137:0/3704064264 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f919c06a410 con 0x7f919c0ce7b0 2024-04-26T23:42:12.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.800+0000 7f9198c00640 1 -- 172.21.15.137:0/3704064264 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f918c01b020 con 0x7f919c0ce7b0 2024-04-26T23:42:12.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.800+0000 7f9198c00640 1 --2- 172.21.15.137:0/3704064264 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f917c068380 0x7f917c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:12.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.800+0000 7f9198c00640 1 -- 172.21.15.137:0/3704064264 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f918c0874b0 con 0x7f919c0ce7b0 2024-04-26T23:42:12.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.800+0000 7f919be00640 1 --2- 172.21.15.137:0/3704064264 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f917c068380 0x7f917c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:12.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.800+0000 7f919be00640 1 --2- 172.21.15.137:0/3704064264 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f917c068380 0x7f917c06a840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f91880b2000 tx=0x7f9188008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:12.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.804+0000 7f9198c00640 1 -- 172.21.15.137:0/3704064264 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f918c022070 con 0x7f919c0ce7b0 2024-04-26T23:42:12.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.960+0000 7f91a1e00640 1 -- 172.21.15.137:0/3704064264 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f919c070220 con 0x7f919c0ce7b0 2024-04-26T23:42:12.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.964+0000 7f9198c00640 1 -- 172.21.15.137:0/3704064264 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16902 (secure 0 0 0) 0x7f918c010040 con 0x7f919c0ce7b0 2024-04-26T23:42:12.969 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:12.969 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":22,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:42:04.750301+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:42:12.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.964+0000 7f91a1e00640 1 -- 172.21.15.137:0/3704064264 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f917c068380 msgr2=0x7f917c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:12.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.964+0000 7f91a1e00640 1 --2- 172.21.15.137:0/3704064264 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f917c068380 0x7f917c06a840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f91880b2000 tx=0x7f9188008040 comp rx=0 tx=0).stop 2024-04-26T23:42:12.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.964+0000 7f91a1e00640 1 -- 172.21.15.137:0/3704064264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f919c0ce7b0 msgr2=0x7f919c15bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:12.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.964+0000 7f91a1e00640 1 --2- 172.21.15.137:0/3704064264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f919c0ce7b0 0x7f919c15bbf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f918c009d10 tx=0x7f918c00c490 comp rx=0 tx=0).stop 2024-04-26T23:42:12.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.964+0000 7f91a1e00640 1 -- 172.21.15.137:0/3704064264 shutdown_connections 2024-04-26T23:42:12.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.964+0000 7f91a1e00640 1 --2- 172.21.15.137:0/3704064264 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f917c068380 0x7f917c06a840 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.964+0000 7f91a1e00640 1 --2- 172.21.15.137:0/3704064264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f919c15cf40 0x7f919c0b77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.964+0000 7f91a1e00640 1 --2- 172.21.15.137:0/3704064264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f919c0d2a20 0x7f919c0cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.964+0000 7f91a1e00640 1 --2- 172.21.15.137:0/3704064264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f919c0ce7b0 0x7f919c15bbf0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:12.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.964+0000 7f91a1e00640 1 -- 172.21.15.137:0/3704064264 >> 172.21.15.137:0/3704064264 conn(0x7f919c09ba60 msgr2=0x7f919c15ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:12.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.964+0000 7f91a1e00640 1 -- 172.21.15.137:0/3704064264 shutdown_connections 2024-04-26T23:42:12.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:12.964+0000 7f91a1e00640 1 -- 172.21.15.137:0/3704064264 wait complete. 2024-04-26T23:42:12.990 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T23:42:12.990 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:42:13.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.124+0000 7f9c45200640 1 Processor -- start 2024-04-26T23:42:13.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.124+0000 7f9c45200640 1 -- start start 2024-04-26T23:42:13.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.124+0000 7f9c45200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9c4015cd90 0x7f9c400d1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:13.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.124+0000 7f9c45200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9c400d3320 0x7f9c401612c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:13.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.124+0000 7f9c45200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c400d18c0 con 0x7f9c4015e400 2024-04-26T23:42:13.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.124+0000 7f9c45200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f9c40161800 con 0x7f9c4015cd90 2024-04-26T23:42:13.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.124+0000 7f9c45200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9c400706e0 con 0x7f9c400d3320 2024-04-26T23:42:13.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.124+0000 7f9c3f400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9c4015cd90 0x7f9c400d1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:13.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.124+0000 7f9c3ea00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f9c4015e400 0x7f9c400d2c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48118/0 (socket says 172.21.15.137:48118) 2024-04-26T23:42:13.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.124+0000 7f9c3ea00640 1 -- 172.21.15.137:0/585524481 learned_addr learned my addr 172.21.15.137:0/585524481 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:13.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.124+0000 7f9c3fe00640 1 --2- 172.21.15.137:0/585524481 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9c400d3320 0x7f9c401612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:13.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.124+0000 7f9c3f400640 1 -- 172.21.15.137:0/585524481 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9c400d3320 msgr2=0x7f9c401612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:13.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.124+0000 7f9c3f400640 1 --2- 172.21.15.137:0/585524481 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9c400d3320 0x7f9c401612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.124+0000 7f9c3f400640 1 -- 172.21.15.137:0/585524481 >> v1:172.21.15.137:6789/0 conn(0x7f9c4015e400 legacy=0x7f9c400d2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:13.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.124+0000 7f9c3f400640 1 -- 172.21.15.137:0/585524481 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4015e180 con 0x7f9c4015cd90 2024-04-26T23:42:13.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.124+0000 7f9c3e000640 1 -- 172.21.15.137:0/585524481 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3221223308 0 0) 0x7f9c400d18c0 con 0x7f9c4015e400 2024-04-26T23:42:13.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.128+0000 7f9c3f400640 1 --2- 172.21.15.137:0/585524481 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c4015cd90 0x7f9c400d1250 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9c300097c0 tx=0x7f9c3001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c0304d0c491c16 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:13.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.128+0000 7f9c3e000640 1 -- 172.21.15.137:0/585524481 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c300b0070 con 0x7f9c4015cd90 2024-04-26T23:42:13.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.128+0000 7f9c3e000640 1 -- 172.21.15.137:0/585524481 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c300ab600 con 0x7f9c4015cd90 2024-04-26T23:42:13.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.128+0000 7f9c3e000640 1 -- 172.21.15.137:0/585524481 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c300ab9d0 con 0x7f9c4015cd90 2024-04-26T23:42:13.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.128+0000 7f9c45200640 1 -- 172.21.15.137:0/585524481 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c4015cd90 msgr2=0x7f9c400d1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:13.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.128+0000 7f9c45200640 1 --2- 172.21.15.137:0/585524481 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c4015cd90 0x7f9c400d1250 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9c300097c0 tx=0x7f9c3001c380 comp rx=0 tx=0).stop 2024-04-26T23:42:13.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.128+0000 7f9c45200640 1 -- 172.21.15.137:0/585524481 shutdown_connections 2024-04-26T23:42:13.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.128+0000 7f9c45200640 1 --2- 172.21.15.137:0/585524481 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9c400d3320 0x7f9c401612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.128+0000 7f9c45200640 1 --2- 172.21.15.137:0/585524481 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c4015cd90 0x7f9c400d1250 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.128+0000 7f9c45200640 1 -- 172.21.15.137:0/585524481 >> 172.21.15.137:0/585524481 conn(0x7f9c4009ba60 msgr2=0x7f9c4009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:13.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.128+0000 7f9c45200640 1 -- 172.21.15.137:0/585524481 shutdown_connections 2024-04-26T23:42:13.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.128+0000 7f9c45200640 1 -- 172.21.15.137:0/585524481 wait complete. 2024-04-26T23:42:13.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.128+0000 7f9c45200640 1 Processor -- start 2024-04-26T23:42:13.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.128+0000 7f9c45200640 1 -- start start 2024-04-26T23:42:13.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c45200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c400d3320 0x7f9c400b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:13.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c45200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c4015cd90 0x7f9c400cd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:13.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c45200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9c4015e400 0x7f9c400cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:13.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c45200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4015dd10 con 0x7f9c4015cd90 2024-04-26T23:42:13.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c45200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4015db90 con 0x7f9c400d3320 2024-04-26T23:42:13.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c45200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9c4015de90 con 0x7f9c4015e400 2024-04-26T23:42:13.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c3ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c4015cd90 0x7f9c400cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:13.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c3ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c4015cd90 0x7f9c400cd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53368/0 (socket says 172.21.15.137:53368) 2024-04-26T23:42:13.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c3ea00640 1 -- 172.21.15.137:0/2918387467 learned_addr learned my addr 172.21.15.137:0/2918387467 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:13.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c3f400640 1 --2- 172.21.15.137:0/2918387467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c400d3320 0x7f9c400b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:13.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c3fe00640 1 --2- 172.21.15.137:0/2918387467 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9c4015e400 0x7f9c400cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:13.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c3ea00640 1 -- 172.21.15.137:0/2918387467 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9c4015e400 msgr2=0x7f9c400cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:13.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c3ea00640 1 --2- 172.21.15.137:0/2918387467 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9c4015e400 0x7f9c400cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c3ea00640 1 -- 172.21.15.137:0/2918387467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c400d3320 msgr2=0x7f9c400b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:13.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c3ea00640 1 --2- 172.21.15.137:0/2918387467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c400d3320 0x7f9c400b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c3ea00640 1 -- 172.21.15.137:0/2918387467 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c400b7030 con 0x7f9c4015cd90 2024-04-26T23:42:13.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c3ea00640 1 --2- 172.21.15.137:0/2918387467 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c4015cd90 0x7f9c400cd670 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00c4b0 tx=0x7f9c2c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:13.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c37400640 1 -- 172.21.15.137:0/2918387467 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c018070 con 0x7f9c4015cd90 2024-04-26T23:42:13.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c37400640 1 -- 172.21.15.137:0/2918387467 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c2c007500 con 0x7f9c4015cd90 2024-04-26T23:42:13.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c45200640 1 -- 172.21.15.137:0/2918387467 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c400b7310 con 0x7f9c4015cd90 2024-04-26T23:42:13.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c37400640 1 -- 172.21.15.137:0/2918387467 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c004a30 con 0x7f9c4015cd90 2024-04-26T23:42:13.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c45200640 1 -- 172.21.15.137:0/2918387467 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c400b78d0 con 0x7f9c4015cd90 2024-04-26T23:42:13.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.132+0000 7f9c45200640 1 -- 172.21.15.137:0/2918387467 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c4006a410 con 0x7f9c4015cd90 2024-04-26T23:42:13.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.136+0000 7f9c37400640 1 -- 172.21.15.137:0/2918387467 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9c2c01b070 con 0x7f9c4015cd90 2024-04-26T23:42:13.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.136+0000 7f9c37400640 1 --2- 172.21.15.137:0/2918387467 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9c20068380 0x7f9c2006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:13.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.136+0000 7f9c37400640 1 -- 172.21.15.137:0/2918387467 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f9c2c085d50 con 0x7f9c4015cd90 2024-04-26T23:42:13.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.136+0000 7f9c3f400640 1 --2- 172.21.15.137:0/2918387467 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9c20068380 0x7f9c2006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:13.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.136+0000 7f9c3f400640 1 --2- 172.21.15.137:0/2918387467 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9c20068380 0x7f9c2006a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9c300ad000 tx=0x7f9c300a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:13.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.140+0000 7f9c37400640 1 -- 172.21.15.137:0/2918387467 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9c2c055c60 con 0x7f9c4015cd90 2024-04-26T23:42:13.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.332+0000 7f9c45200640 1 -- 172.21.15.137:0/2918387467 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c40158740 con 0x7f9c4015cd90 2024-04-26T23:42:13.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.332+0000 7f9c37400640 1 -- 172.21.15.137:0/2918387467 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f9c2c059f60 con 0x7f9c4015cd90 2024-04-26T23:42:13.339 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:13.339 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/861150521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":861150521},{"type":"v1","addr":"172.21.15.137:6836","nonce":861150521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/980246912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":980246912},{"type":"v1","addr":"172.21.15.137:6837","nonce":980246912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3288315078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3288315078},{"type":"v1","addr":"172.21.15.170:6835","nonce":3288315078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:41:23.574363+0000","modified":"2024-04-26T23:41:26.591710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6834/2444921875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2444921875},{"type":"v1","addr":"172.21.15.170:6834","nonce":2444921875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-26T23:42:13.339 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 8 2024-04-26T23:42:13.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.336+0000 7f9c45200640 1 -- 172.21.15.137:0/2918387467 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9c20068380 msgr2=0x7f9c2006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:13.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.336+0000 7f9c45200640 1 --2- 172.21.15.137:0/2918387467 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9c20068380 0x7f9c2006a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9c300ad000 tx=0x7f9c300a6000 comp rx=0 tx=0).stop 2024-04-26T23:42:13.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.336+0000 7f9c45200640 1 -- 172.21.15.137:0/2918387467 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c4015cd90 msgr2=0x7f9c400cd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:13.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.336+0000 7f9c45200640 1 --2- 172.21.15.137:0/2918387467 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c4015cd90 0x7f9c400cd670 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00c4b0 tx=0x7f9c2c00c970 comp rx=0 tx=0).stop 2024-04-26T23:42:13.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.336+0000 7f9c45200640 1 -- 172.21.15.137:0/2918387467 shutdown_connections 2024-04-26T23:42:13.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.336+0000 7f9c45200640 1 --2- 172.21.15.137:0/2918387467 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9c20068380 0x7f9c2006a840 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.336+0000 7f9c45200640 1 --2- 172.21.15.137:0/2918387467 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c4015cd90 0x7f9c400cd670 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.336+0000 7f9c45200640 1 --2- 172.21.15.137:0/2918387467 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9c4015e400 0x7f9c400cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.336+0000 7f9c45200640 1 --2- 172.21.15.137:0/2918387467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c400d3320 0x7f9c400b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.336+0000 7f9c45200640 1 -- 172.21.15.137:0/2918387467 >> 172.21.15.137:0/2918387467 conn(0x7f9c4009ba60 msgr2=0x7f9c4006d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:13.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.336+0000 7f9c45200640 1 -- 172.21.15.137:0/2918387467 shutdown_connections 2024-04-26T23:42:13.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.336+0000 7f9c45200640 1 -- 172.21.15.137:0/2918387467 wait complete. 2024-04-26T23:42:13.361 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:42:13.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.492+0000 7f0c33800640 1 Processor -- start 2024-04-26T23:42:13.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.492+0000 7f0c33800640 1 -- start start 2024-04-26T23:42:13.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.492+0000 7f0c33800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0c2c0ce3e0 0x7f0c2c073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:13.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.492+0000 7f0c33800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0c2c0ce7c0 0x7f0c2c146210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:13.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.492+0000 7f0c33800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c2c073010 con 0x7f0c2c15de80 2024-04-26T23:42:13.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.492+0000 7f0c33800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0c2c0cef90 con 0x7f0c2c0ce7c0 2024-04-26T23:42:13.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.492+0000 7f0c33800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0c2c073280 con 0x7f0c2c0ce3e0 2024-04-26T23:42:13.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.492+0000 7f0c31800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0c2c0ce7c0 0x7f0c2c146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:13.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.492+0000 7f0c31800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0c2c0ce7c0 0x7f0c2c146210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53382/0 (socket says 172.21.15.137:53382) 2024-04-26T23:42:13.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.492+0000 7f0c31800640 1 -- 172.21.15.137:0/3835940751 learned_addr learned my addr 172.21.15.137:0/3835940751 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:13.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.492+0000 7f0c30e00640 1 --2- 172.21.15.137:0/3835940751 >> v2:172.21.15.170:3300/0 conn(0x7f0c2c0ce3e0 0x7f0c2c073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:13.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.492+0000 7f0c31800640 1 -- 172.21.15.137:0/3835940751 >> v2:172.21.15.170:3300/0 conn(0x7f0c2c0ce3e0 msgr2=0x7f0c2c073d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:13.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.492+0000 7f0c31800640 1 --2- 172.21.15.137:0/3835940751 >> v2:172.21.15.170:3300/0 conn(0x7f0c2c0ce3e0 0x7f0c2c073d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.492+0000 7f0c31800640 1 -- 172.21.15.137:0/3835940751 >> v1:172.21.15.170:6789/0 conn(0x7f0c2c15de80 legacy=0x7f0c2c0d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:13.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.492+0000 7f0c31800640 1 -- 172.21.15.137:0/3835940751 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c073560 con 0x7f0c2c0ce7c0 2024-04-26T23:42:13.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.496+0000 7f0c31800640 1 --2- 172.21.15.137:0/3835940751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c2c0ce7c0 0x7f0c2c146210 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0c24009e50 tx=0x7f0c2401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4445a6f2e091a639 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:13.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.496+0000 7f0c2b400640 1 -- 172.21.15.137:0/3835940751 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c240a5790 con 0x7f0c2c0ce7c0 2024-04-26T23:42:13.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.496+0000 7f0c2b400640 1 -- 172.21.15.137:0/3835940751 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c240a5930 con 0x7f0c2c0ce7c0 2024-04-26T23:42:13.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.496+0000 7f0c2b400640 1 -- 172.21.15.137:0/3835940751 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c240a5d00 con 0x7f0c2c0ce7c0 2024-04-26T23:42:13.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.496+0000 7f0c33800640 1 -- 172.21.15.137:0/3835940751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c2c0ce7c0 msgr2=0x7f0c2c146210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:13.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.496+0000 7f0c33800640 1 --2- 172.21.15.137:0/3835940751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c2c0ce7c0 0x7f0c2c146210 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0c24009e50 tx=0x7f0c2401c9c0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.496+0000 7f0c33800640 1 -- 172.21.15.137:0/3835940751 shutdown_connections 2024-04-26T23:42:13.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.496+0000 7f0c33800640 1 --2- 172.21.15.137:0/3835940751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c2c0ce7c0 0x7f0c2c146210 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.496+0000 7f0c33800640 1 --2- 172.21.15.137:0/3835940751 >> v2:172.21.15.170:3300/0 conn(0x7f0c2c0ce3e0 0x7f0c2c073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.496+0000 7f0c33800640 1 -- 172.21.15.137:0/3835940751 >> 172.21.15.137:0/3835940751 conn(0x7f0c2c06c5d0 msgr2=0x7f0c2c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:13.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.496+0000 7f0c33800640 1 -- 172.21.15.137:0/3835940751 shutdown_connections 2024-04-26T23:42:13.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.496+0000 7f0c33800640 1 -- 172.21.15.137:0/3835940751 wait complete. 2024-04-26T23:42:13.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c33800640 1 Processor -- start 2024-04-26T23:42:13.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c33800640 1 -- start start 2024-04-26T23:42:13.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c33800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c2c0ce3e0 0x7f0c2c143810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:13.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c33800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c2c0ce7c0 0x7f0c2c137fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:13.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c33800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c2c15de80 0x7f0c2c15f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:13.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c33800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c06f0a0 con 0x7f0c2c15de80 2024-04-26T23:42:13.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c33800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c06ef20 con 0x7f0c2c0ce7c0 2024-04-26T23:42:13.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c33800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0c2c06f220 con 0x7f0c2c0ce3e0 2024-04-26T23:42:13.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c31800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c2c15de80 0x7f0c2c15f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:13.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c31800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c2c15de80 0x7f0c2c15f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53390/0 (socket says 172.21.15.137:53390) 2024-04-26T23:42:13.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c31800640 1 -- 172.21.15.137:0/2272019325 learned_addr learned my addr 172.21.15.137:0/2272019325 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:13.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c30e00640 1 --2- 172.21.15.137:0/2272019325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c2c0ce3e0 0x7f0c2c143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:13.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c2be00640 1 --2- 172.21.15.137:0/2272019325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c2c0ce7c0 0x7f0c2c137fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:13.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c31800640 1 -- 172.21.15.137:0/2272019325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c2c0ce3e0 msgr2=0x7f0c2c143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:13.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c31800640 1 --2- 172.21.15.137:0/2272019325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c2c0ce3e0 0x7f0c2c143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c31800640 1 -- 172.21.15.137:0/2272019325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c2c0ce7c0 msgr2=0x7f0c2c137fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:13.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c31800640 1 --2- 172.21.15.137:0/2272019325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c2c0ce7c0 0x7f0c2c137fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c31800640 1 -- 172.21.15.137:0/2272019325 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c138a80 con 0x7f0c2c15de80 2024-04-26T23:42:13.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c31800640 1 --2- 172.21.15.137:0/2272019325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c2c15de80 0x7f0c2c15f6b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0c240195d0 tx=0x7f0c24019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:13.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c28c00640 1 -- 172.21.15.137:0/2272019325 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c240bc020 con 0x7f0c2c15de80 2024-04-26T23:42:13.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c28c00640 1 -- 172.21.15.137:0/2272019325 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c240b8670 con 0x7f0c2c15de80 2024-04-26T23:42:13.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c28c00640 1 -- 172.21.15.137:0/2272019325 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c240b8a60 con 0x7f0c2c15de80 2024-04-26T23:42:13.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c33800640 1 -- 172.21.15.137:0/2272019325 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2c138d60 con 0x7f0c2c15de80 2024-04-26T23:42:13.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c33800640 1 -- 172.21.15.137:0/2272019325 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c2c142c30 con 0x7f0c2c15de80 2024-04-26T23:42:13.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.500+0000 7f0c33800640 1 -- 172.21.15.137:0/2272019325 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c2c068920 con 0x7f0c2c15de80 2024-04-26T23:42:13.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.504+0000 7f0c28c00640 1 -- 172.21.15.137:0/2272019325 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0c240bf020 con 0x7f0c2c15de80 2024-04-26T23:42:13.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.504+0000 7f0c28c00640 1 --2- 172.21.15.137:0/2272019325 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0c0c068380 0x7f0c0c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:13.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.504+0000 7f0c28c00640 1 -- 172.21.15.137:0/2272019325 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f0c24121ac0 con 0x7f0c2c15de80 2024-04-26T23:42:13.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.504+0000 7f0c30e00640 1 --2- 172.21.15.137:0/2272019325 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0c0c068380 0x7f0c0c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:13.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.504+0000 7f0c30e00640 1 --2- 172.21.15.137:0/2272019325 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0c0c068380 0x7f0c0c06a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009ac0 tx=0x7f0c20009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:13.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.508+0000 7f0c28c00640 1 -- 172.21.15.137:0/2272019325 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0c240c6030 con 0x7f0c2c15de80 2024-04-26T23:42:13.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.700+0000 7f0c33800640 1 -- 172.21.15.137:0/2272019325 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c2c06a4b0 con 0x7f0c2c15de80 2024-04-26T23:42:13.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.700+0000 7f0c28c00640 1 -- 172.21.15.137:0/2272019325 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f0c240165e0 con 0x7f0c2c15de80 2024-04-26T23:42:13.706 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:13.706 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/861150521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":861150521},{"type":"v1","addr":"172.21.15.137:6836","nonce":861150521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/980246912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":980246912},{"type":"v1","addr":"172.21.15.137:6837","nonce":980246912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3288315078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3288315078},{"type":"v1","addr":"172.21.15.170:6835","nonce":3288315078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:41:23.574363+0000","modified":"2024-04-26T23:41:26.591710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6834/2444921875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2444921875},{"type":"v1","addr":"172.21.15.170:6834","nonce":2444921875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-26T23:42:13.706 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 8 2024-04-26T23:42:13.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.704+0000 7f0c33800640 1 -- 172.21.15.137:0/2272019325 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0c0c068380 msgr2=0x7f0c0c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:13.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.704+0000 7f0c33800640 1 --2- 172.21.15.137:0/2272019325 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0c0c068380 0x7f0c0c06a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009ac0 tx=0x7f0c20009190 comp rx=0 tx=0).stop 2024-04-26T23:42:13.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.704+0000 7f0c33800640 1 -- 172.21.15.137:0/2272019325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c2c15de80 msgr2=0x7f0c2c15f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:13.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.704+0000 7f0c33800640 1 --2- 172.21.15.137:0/2272019325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c2c15de80 0x7f0c2c15f6b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0c240195d0 tx=0x7f0c24019760 comp rx=0 tx=0).stop 2024-04-26T23:42:13.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.704+0000 7f0c33800640 1 -- 172.21.15.137:0/2272019325 shutdown_connections 2024-04-26T23:42:13.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.704+0000 7f0c33800640 1 --2- 172.21.15.137:0/2272019325 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0c0c068380 0x7f0c0c06a840 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.704+0000 7f0c33800640 1 --2- 172.21.15.137:0/2272019325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c2c15de80 0x7f0c2c15f6b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.704+0000 7f0c33800640 1 --2- 172.21.15.137:0/2272019325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c2c0ce7c0 0x7f0c2c137fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.704+0000 7f0c33800640 1 --2- 172.21.15.137:0/2272019325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c2c0ce3e0 0x7f0c2c143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.704+0000 7f0c33800640 1 -- 172.21.15.137:0/2272019325 >> 172.21.15.137:0/2272019325 conn(0x7f0c2c06c5d0 msgr2=0x7f0c2c0ccee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:13.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.704+0000 7f0c33800640 1 -- 172.21.15.137:0/2272019325 shutdown_connections 2024-04-26T23:42:13.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.704+0000 7f0c33800640 1 -- 172.21.15.137:0/2272019325 wait complete. 2024-04-26T23:42:13.727 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:42:13.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.860+0000 7fb33dc00640 1 Processor -- start 2024-04-26T23:42:13.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.860+0000 7fb33dc00640 1 -- start start 2024-04-26T23:42:13.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.860+0000 7fb33dc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb3380ce3e0 0x7fb338073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:13.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.860+0000 7fb33dc00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb33815de80 0x7fb3380d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:13.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.860+0000 7fb33dc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb338073010 con 0x7fb3380ce7c0 2024-04-26T23:42:13.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.860+0000 7fb33dc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb3380cef90 con 0x7fb3380ce3e0 2024-04-26T23:42:13.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.860+0000 7fb33dc00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb338073280 con 0x7fb33815de80 2024-04-26T23:42:13.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.860+0000 7fb336a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb3380ce3e0 0x7fb338073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:13.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.860+0000 7fb337400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb3380ce7c0 0x7fb338146210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48128/0 (socket says 172.21.15.137:48128) 2024-04-26T23:42:13.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.860+0000 7fb337400640 1 -- 172.21.15.137:0/2579227239 learned_addr learned my addr 172.21.15.137:0/2579227239 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:13.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.860+0000 7fb32fe00640 1 --2- 172.21.15.137:0/2579227239 >> v2:172.21.15.170:3300/0 conn(0x7fb33815de80 0x7fb3380d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:13.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.860+0000 7fb336a00640 1 -- 172.21.15.137:0/2579227239 >> v2:172.21.15.170:3300/0 conn(0x7fb33815de80 msgr2=0x7fb3380d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:13.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.860+0000 7fb336a00640 1 --2- 172.21.15.137:0/2579227239 >> v2:172.21.15.170:3300/0 conn(0x7fb33815de80 0x7fb3380d04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.860+0000 7fb336a00640 1 -- 172.21.15.137:0/2579227239 >> v1:172.21.15.137:6789/0 conn(0x7fb3380ce7c0 legacy=0x7fb338146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:13.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.860+0000 7fb336a00640 1 -- 172.21.15.137:0/2579227239 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb338073560 con 0x7fb3380ce3e0 2024-04-26T23:42:13.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.864+0000 7fb336a00640 1 --2- 172.21.15.137:0/2579227239 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3380ce3e0 0x7fb338073d60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb3280097c0 tx=0x7fb32801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16c1b13bb1e2507 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:13.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.864+0000 7fb336000640 1 -- 172.21.15.137:0/2579227239 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3280ab650 con 0x7fb3380ce3e0 2024-04-26T23:42:13.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.864+0000 7fb336000640 1 -- 172.21.15.137:0/2579227239 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3280b0070 con 0x7fb3380ce3e0 2024-04-26T23:42:13.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.864+0000 7fb336000640 1 -- 172.21.15.137:0/2579227239 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3280aba10 con 0x7fb3380ce3e0 2024-04-26T23:42:13.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.864+0000 7fb33dc00640 1 -- 172.21.15.137:0/2579227239 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3380ce3e0 msgr2=0x7fb338073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:13.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.864+0000 7fb33dc00640 1 --2- 172.21.15.137:0/2579227239 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3380ce3e0 0x7fb338073d60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb3280097c0 tx=0x7fb32801c430 comp rx=0 tx=0).stop 2024-04-26T23:42:13.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.864+0000 7fb33dc00640 1 -- 172.21.15.137:0/2579227239 shutdown_connections 2024-04-26T23:42:13.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.864+0000 7fb33dc00640 1 --2- 172.21.15.137:0/2579227239 >> v2:172.21.15.170:3300/0 conn(0x7fb33815de80 0x7fb3380d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.864+0000 7fb33dc00640 1 --2- 172.21.15.137:0/2579227239 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3380ce3e0 0x7fb338073d60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.864+0000 7fb33dc00640 1 -- 172.21.15.137:0/2579227239 >> 172.21.15.137:0/2579227239 conn(0x7fb33806c5d0 msgr2=0x7fb33806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:13.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.864+0000 7fb33dc00640 1 -- 172.21.15.137:0/2579227239 shutdown_connections 2024-04-26T23:42:13.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.864+0000 7fb33dc00640 1 -- 172.21.15.137:0/2579227239 wait complete. 2024-04-26T23:42:13.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb33dc00640 1 Processor -- start 2024-04-26T23:42:13.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb33dc00640 1 -- start start 2024-04-26T23:42:13.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb33dc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3380ce3e0 0x7fb33815bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:13.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb33dc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3380ce7c0 0x7fb33813d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:13.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb33dc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb33815de80 0x7fb338166fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:13.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb33dc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb338146aa0 con 0x7fb33815de80 2024-04-26T23:42:13.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb33dc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb338146920 con 0x7fb3380ce7c0 2024-04-26T23:42:13.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb33dc00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb33806ed10 con 0x7fb3380ce3e0 2024-04-26T23:42:13.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb337400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb33815de80 0x7fb338166fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:13.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb337400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb33815de80 0x7fb338166fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53406/0 (socket says 172.21.15.137:53406) 2024-04-26T23:42:13.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb337400640 1 -- 172.21.15.137:0/821944536 learned_addr learned my addr 172.21.15.137:0/821944536 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:13.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb32fe00640 1 --2- 172.21.15.137:0/821944536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3380ce7c0 0x7fb33813d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:13.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb336a00640 1 --2- 172.21.15.137:0/821944536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3380ce3e0 0x7fb33815bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:13.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb337400640 1 -- 172.21.15.137:0/821944536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3380ce3e0 msgr2=0x7fb33815bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:13.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb337400640 1 --2- 172.21.15.137:0/821944536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3380ce3e0 0x7fb33815bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb337400640 1 -- 172.21.15.137:0/821944536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3380ce7c0 msgr2=0x7fb33813d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:13.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb337400640 1 --2- 172.21.15.137:0/821944536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3380ce7c0 0x7fb33813d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:13.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb337400640 1 -- 172.21.15.137:0/821944536 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3380b3e70 con 0x7fb33815de80 2024-04-26T23:42:13.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb337400640 1 --2- 172.21.15.137:0/821944536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb33815de80 0x7fb338166fb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb33000cbc0 tx=0x7fb33000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:13.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb32ea00640 1 -- 172.21.15.137:0/821944536 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb330017070 con 0x7fb33815de80 2024-04-26T23:42:13.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb32ea00640 1 -- 172.21.15.137:0/821944536 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb33000ad40 con 0x7fb33815de80 2024-04-26T23:42:13.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb32ea00640 1 -- 172.21.15.137:0/821944536 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb330012600 con 0x7fb33815de80 2024-04-26T23:42:13.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb33dc00640 1 -- 172.21.15.137:0/821944536 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3380b4150 con 0x7fb33815de80 2024-04-26T23:42:13.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.868+0000 7fb33dc00640 1 -- 172.21.15.137:0/821944536 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3380b4710 con 0x7fb33815de80 2024-04-26T23:42:13.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.872+0000 7fb33dc00640 1 -- 172.21.15.137:0/821944536 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb33806a4b0 con 0x7fb33815de80 2024-04-26T23:42:13.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.872+0000 7fb32ea00640 1 -- 172.21.15.137:0/821944536 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb33001a070 con 0x7fb33815de80 2024-04-26T23:42:13.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.872+0000 7fb32ea00640 1 --2- 172.21.15.137:0/821944536 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb314068380 0x7fb31406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:13.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.872+0000 7fb32ea00640 1 -- 172.21.15.137:0/821944536 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fb330086720 con 0x7fb33815de80 2024-04-26T23:42:13.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.872+0000 7fb336a00640 1 --2- 172.21.15.137:0/821944536 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb314068380 0x7fb31406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:13.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.872+0000 7fb336a00640 1 --2- 172.21.15.137:0/821944536 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb314068380 0x7fb31406a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb3280af000 tx=0x7fb3280a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:13.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:13.876+0000 7fb32ea00640 1 -- 172.21.15.137:0/821944536 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb330056600 con 0x7fb33815de80 2024-04-26T23:42:14.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.032+0000 7fb33dc00640 1 -- 172.21.15.137:0/821944536 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb338161400 con 0x7fb33815de80 2024-04-26T23:42:14.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.036+0000 7fb32ea00640 1 -- 172.21.15.137:0/821944536 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16902 (secure 0 0 0) 0x7fb33005a900 con 0x7fb33815de80 2024-04-26T23:42:14.040 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:14.040 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":22,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:42:04.750301+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:41:21.810449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:41:22.533452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:42:14.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.036+0000 7fb33dc00640 1 -- 172.21.15.137:0/821944536 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb314068380 msgr2=0x7fb31406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:14.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.036+0000 7fb33dc00640 1 --2- 172.21.15.137:0/821944536 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb314068380 0x7fb31406a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb3280af000 tx=0x7fb3280a7000 comp rx=0 tx=0).stop 2024-04-26T23:42:14.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.036+0000 7fb33dc00640 1 -- 172.21.15.137:0/821944536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb33815de80 msgr2=0x7fb338166fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:14.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.036+0000 7fb33dc00640 1 --2- 172.21.15.137:0/821944536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb33815de80 0x7fb338166fb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb33000cbc0 tx=0x7fb33000a430 comp rx=0 tx=0).stop 2024-04-26T23:42:14.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.036+0000 7fb33dc00640 1 -- 172.21.15.137:0/821944536 shutdown_connections 2024-04-26T23:42:14.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.036+0000 7fb33dc00640 1 --2- 172.21.15.137:0/821944536 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb314068380 0x7fb31406a840 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.036+0000 7fb33dc00640 1 --2- 172.21.15.137:0/821944536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb33815de80 0x7fb338166fb0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.036+0000 7fb33dc00640 1 --2- 172.21.15.137:0/821944536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3380ce7c0 0x7fb33813d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.036+0000 7fb33dc00640 1 --2- 172.21.15.137:0/821944536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3380ce3e0 0x7fb33815bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.036+0000 7fb33dc00640 1 -- 172.21.15.137:0/821944536 >> 172.21.15.137:0/821944536 conn(0x7fb33806c5d0 msgr2=0x7fb338160840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:14.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.036+0000 7fb33dc00640 1 -- 172.21.15.137:0/821944536 shutdown_connections 2024-04-26T23:42:14.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.036+0000 7fb33dc00640 1 -- 172.21.15.137:0/821944536 wait complete. 2024-04-26T23:42:14.061 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T23:42:14.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.192+0000 7f076a600640 1 Processor -- start 2024-04-26T23:42:14.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.192+0000 7f076a600640 1 -- start start 2024-04-26T23:42:14.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.196+0000 7f076a600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f07640ce3e0 0x7f0764073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:14.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.196+0000 7f076a600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f076415de80 0x7f07640d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:14.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.196+0000 7f076a600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0764073010 con 0x7f07640ce7c0 2024-04-26T23:42:14.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.196+0000 7f076a600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f07640cef90 con 0x7f07640ce3e0 2024-04-26T23:42:14.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.196+0000 7f076a600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0764073280 con 0x7f076415de80 2024-04-26T23:42:14.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.196+0000 7f0763400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f07640ce3e0 0x7f0764073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:14.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.196+0000 7f0763400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f07640ce3e0 0x7f0764073d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53420/0 (socket says 172.21.15.137:53420) 2024-04-26T23:42:14.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.196+0000 7f0763400640 1 -- 172.21.15.137:0/3278873452 learned_addr learned my addr 172.21.15.137:0/3278873452 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:14.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.196+0000 7f0762a00640 1 --2- 172.21.15.137:0/3278873452 >> v2:172.21.15.170:3300/0 conn(0x7f076415de80 0x7f07640d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:14.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.196+0000 7f0763400640 1 -- 172.21.15.137:0/3278873452 >> v2:172.21.15.170:3300/0 conn(0x7f076415de80 msgr2=0x7f07640d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:14.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.196+0000 7f0763400640 1 --2- 172.21.15.137:0/3278873452 >> v2:172.21.15.170:3300/0 conn(0x7f076415de80 0x7f07640d04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.196+0000 7f0763400640 1 -- 172.21.15.137:0/3278873452 >> v1:172.21.15.170:6789/0 conn(0x7f07640ce7c0 legacy=0x7f0764146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:14.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.196+0000 7f0763400640 1 -- 172.21.15.137:0/3278873452 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0764073560 con 0x7f07640ce3e0 2024-04-26T23:42:14.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.196+0000 7f0762a00640 1 --2- 172.21.15.137:0/3278873452 >> v2:172.21.15.170:3300/0 conn(0x7f076415de80 0x7f07640d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:14.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.196+0000 7f0763400640 1 --2- 172.21.15.137:0/3278873452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07640ce3e0 0x7f0764073d60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0754009870 tx=0x7f075401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa49c5e8199d0194 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:14.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.196+0000 7f0762000640 1 -- 172.21.15.137:0/3278873452 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07540aa430 con 0x7f07640ce3e0 2024-04-26T23:42:14.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.196+0000 7f0762000640 1 -- 172.21.15.137:0/3278873452 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07540af070 con 0x7f07640ce3e0 2024-04-26T23:42:14.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.196+0000 7f0762000640 1 -- 172.21.15.137:0/3278873452 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07540aa7f0 con 0x7f07640ce3e0 2024-04-26T23:42:14.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f076a600640 1 -- 172.21.15.137:0/3278873452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07640ce3e0 msgr2=0x7f0764073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:14.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f076a600640 1 --2- 172.21.15.137:0/3278873452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07640ce3e0 0x7f0764073d60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0754009870 tx=0x7f075401c4b0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f076a600640 1 -- 172.21.15.137:0/3278873452 shutdown_connections 2024-04-26T23:42:14.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f076a600640 1 --2- 172.21.15.137:0/3278873452 >> v2:172.21.15.170:3300/0 conn(0x7f076415de80 0x7f07640d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f076a600640 1 --2- 172.21.15.137:0/3278873452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07640ce3e0 0x7f0764073d60 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f076a600640 1 -- 172.21.15.137:0/3278873452 >> 172.21.15.137:0/3278873452 conn(0x7f076406c5d0 msgr2=0x7f076406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:14.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f076a600640 1 -- 172.21.15.137:0/3278873452 shutdown_connections 2024-04-26T23:42:14.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f076a600640 1 -- 172.21.15.137:0/3278873452 wait complete. 2024-04-26T23:42:14.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f076a600640 1 Processor -- start 2024-04-26T23:42:14.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f076a600640 1 -- start start 2024-04-26T23:42:14.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f076a600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07640ce3e0 0x7f0764160aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:14.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f076a600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07640ce7c0 0x7f07640ac520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:14.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f076a600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f076415de80 0x7f07640b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:14.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f076a600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0764146aa0 con 0x7f07640ce3e0 2024-04-26T23:42:14.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f076a600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0764146920 con 0x7f076415de80 2024-04-26T23:42:14.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f076a600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f076406ed10 con 0x7f07640ce7c0 2024-04-26T23:42:14.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f0763400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07640ce3e0 0x7f0764160aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:14.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f0763400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07640ce3e0 0x7f0764160aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53426/0 (socket says 172.21.15.137:53426) 2024-04-26T23:42:14.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f0763400640 1 -- 172.21.15.137:0/2389675849 learned_addr learned my addr 172.21.15.137:0/2389675849 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:14.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f0763400640 1 -- 172.21.15.137:0/2389675849 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07640ce7c0 msgr2=0x7f07640ac520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:14.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f0763400640 1 --2- 172.21.15.137:0/2389675849 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07640ce7c0 0x7f07640ac520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f0763400640 1 -- 172.21.15.137:0/2389675849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f076415de80 msgr2=0x7f07640b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:14.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f0763400640 1 --2- 172.21.15.137:0/2389675849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f076415de80 0x7f07640b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f0763400640 1 -- 172.21.15.137:0/2389675849 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07640b0e00 con 0x7f07640ce3e0 2024-04-26T23:42:14.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.200+0000 7f0763400640 1 --2- 172.21.15.137:0/2389675849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07640ce3e0 0x7f0764160aa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f07540ac040 tx=0x7f075401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:14.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.204+0000 7f075b400640 1 -- 172.21.15.137:0/2389675849 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07540b3800 con 0x7f07640ce3e0 2024-04-26T23:42:14.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.204+0000 7f075b400640 1 -- 172.21.15.137:0/2389675849 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07540b39c0 con 0x7f07640ce3e0 2024-04-26T23:42:14.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.204+0000 7f076a600640 1 -- 172.21.15.137:0/2389675849 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07640b10e0 con 0x7f07640ce3e0 2024-04-26T23:42:14.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.204+0000 7f075b400640 1 -- 172.21.15.137:0/2389675849 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07540b3db0 con 0x7f07640ce3e0 2024-04-26T23:42:14.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.204+0000 7f076a600640 1 -- 172.21.15.137:0/2389675849 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07640b16a0 con 0x7f07640ce3e0 2024-04-26T23:42:14.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.204+0000 7f076a600640 1 -- 172.21.15.137:0/2389675849 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07640744e0 con 0x7f07640ce3e0 2024-04-26T23:42:14.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.204+0000 7f075b400640 1 -- 172.21.15.137:0/2389675849 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f07540c6390 con 0x7f07640ce3e0 2024-04-26T23:42:14.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.204+0000 7f075b400640 1 --2- 172.21.15.137:0/2389675849 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0744068380 0x7f074406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:14.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.204+0000 7f075b400640 1 -- 172.21.15.137:0/2389675849 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f0754120fe0 con 0x7f07640ce3e0 2024-04-26T23:42:14.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.204+0000 7f0762a00640 1 --2- 172.21.15.137:0/2389675849 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0744068380 0x7f074406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:14.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.204+0000 7f0762a00640 1 --2- 172.21.15.137:0/2389675849 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0744068380 0x7f074406a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0764072c10 tx=0x7f0750008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:14.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.208+0000 7f075b400640 1 -- 172.21.15.137:0/2389675849 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f07540c3060 con 0x7f07640ce3e0 2024-04-26T23:42:14.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.400+0000 7f076a600640 1 -- 172.21.15.137:0/2389675849 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f076406a4b0 con 0x7f07640ce3e0 2024-04-26T23:42:14.406 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-04-26T23:42:14.400+0000 7f1be8800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T23:42:14.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.404+0000 7f075b400640 1 -- 172.21.15.137:0/2389675849 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f07540160d0 con 0x7f07640ce3e0 2024-04-26T23:42:14.409 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T23:42:14.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.404+0000 7f076a600640 1 -- 172.21.15.137:0/2389675849 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0744068380 msgr2=0x7f074406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:14.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.404+0000 7f076a600640 1 --2- 172.21.15.137:0/2389675849 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0744068380 0x7f074406a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0764072c10 tx=0x7f0750008040 comp rx=0 tx=0).stop 2024-04-26T23:42:14.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.404+0000 7f076a600640 1 -- 172.21.15.137:0/2389675849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07640ce3e0 msgr2=0x7f0764160aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:14.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.404+0000 7f076a600640 1 --2- 172.21.15.137:0/2389675849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07640ce3e0 0x7f0764160aa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f07540ac040 tx=0x7f075401acf0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.404+0000 7f076a600640 1 -- 172.21.15.137:0/2389675849 shutdown_connections 2024-04-26T23:42:14.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.404+0000 7f076a600640 1 --2- 172.21.15.137:0/2389675849 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0744068380 0x7f074406a840 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.404+0000 7f076a600640 1 --2- 172.21.15.137:0/2389675849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f076415de80 0x7f07640b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.404+0000 7f076a600640 1 --2- 172.21.15.137:0/2389675849 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07640ce7c0 0x7f07640ac520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.404+0000 7f076a600640 1 --2- 172.21.15.137:0/2389675849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07640ce3e0 0x7f0764160aa0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.404+0000 7f076a600640 1 -- 172.21.15.137:0/2389675849 >> 172.21.15.137:0/2389675849 conn(0x7f076406c5d0 msgr2=0x7f0764145730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:14.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.404+0000 7f076a600640 1 -- 172.21.15.137:0/2389675849 shutdown_connections 2024-04-26T23:42:14.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.404+0000 7f076a600640 1 -- 172.21.15.137:0/2389675849 wait complete. 2024-04-26T23:42:14.421 INFO:tasks.ceph.mds.d.smithi170.stderr: -3204> 2024-04-26T23:41:28.162+0000 7fdfa6a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:42:14.431 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T23:42:14.472 INFO:tasks.ceph.mds.d.smithi170.stdout:starting mds.d at 2024-04-26T23:42:14.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.564+0000 7f5da5200640 1 Processor -- start 2024-04-26T23:42:14.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.564+0000 7f5da5200640 1 -- start start 2024-04-26T23:42:14.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.564+0000 7f5da5200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5da00afbc0 0x7f5da015df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:14.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.564+0000 7f5da5200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5da0073f20 0x7f5da00735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:14.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.564+0000 7f5da5200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5da00affa0 0x7f5da00ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:14.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.564+0000 7f5da5200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5da0073b20 con 0x7f5da00afbc0 2024-04-26T23:42:14.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.564+0000 7f5da5200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f5da0072860 con 0x7f5da0073f20 2024-04-26T23:42:14.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.564+0000 7f5da5200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5da00743b0 con 0x7f5da00affa0 2024-04-26T23:42:14.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.568+0000 7f5d9de00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5da00afbc0 0x7f5da015df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:14.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.568+0000 7f5d9de00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5da00afbc0 0x7f5da015df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53428/0 (socket says 172.21.15.137:53428) 2024-04-26T23:42:14.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.568+0000 7f5d9de00640 1 -- 172.21.15.137:0/77328393 learned_addr learned my addr 172.21.15.137:0/77328393 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:14.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.568+0000 7f5d9e800640 1 --2- 172.21.15.137:0/77328393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5da00affa0 0x7f5da00ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:14.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.568+0000 7f5d9d400640 1 --2- 172.21.15.137:0/77328393 >> v2:172.21.15.170:3300/0 conn(0x7f5da0073f20 0x7f5da00735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:14.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.568+0000 7f5d9de00640 1 -- 172.21.15.137:0/77328393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5da00affa0 msgr2=0x7f5da00ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:14.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.568+0000 7f5d9de00640 1 --2- 172.21.15.137:0/77328393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5da00affa0 0x7f5da00ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.568+0000 7f5d9de00640 1 -- 172.21.15.137:0/77328393 >> v2:172.21.15.170:3300/0 conn(0x7f5da0073f20 msgr2=0x7f5da00735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:14.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.568+0000 7f5d9de00640 1 --2- 172.21.15.137:0/77328393 >> v2:172.21.15.170:3300/0 conn(0x7f5da0073f20 0x7f5da00735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.568+0000 7f5d9de00640 1 -- 172.21.15.137:0/77328393 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da0072b00 con 0x7f5da00afbc0 2024-04-26T23:42:14.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.568+0000 7f5d9d400640 1 --2- 172.21.15.137:0/77328393 >> v2:172.21.15.170:3300/0 conn(0x7f5da0073f20 0x7f5da00735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:14.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.568+0000 7f5d9de00640 1 --2- 172.21.15.137:0/77328393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5da00afbc0 0x7f5da015df90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009e50 tx=0x7f5d9001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225f532b371db1fc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:14.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.568+0000 7f5d9ca00640 1 -- 172.21.15.137:0/77328393 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d900a5670 con 0x7f5da00afbc0 2024-04-26T23:42:14.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.568+0000 7f5d9ca00640 1 -- 172.21.15.137:0/77328393 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d900a5810 con 0x7f5da00afbc0 2024-04-26T23:42:14.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.568+0000 7f5d9ca00640 1 -- 172.21.15.137:0/77328393 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d900a5be0 con 0x7f5da00afbc0 2024-04-26T23:42:14.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5da5200640 1 -- 172.21.15.137:0/77328393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5da00afbc0 msgr2=0x7f5da015df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:14.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5da5200640 1 --2- 172.21.15.137:0/77328393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5da00afbc0 0x7f5da015df90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009e50 tx=0x7f5d9001c9f0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5da5200640 1 -- 172.21.15.137:0/77328393 shutdown_connections 2024-04-26T23:42:14.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5da5200640 1 --2- 172.21.15.137:0/77328393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5da00affa0 0x7f5da00ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5da5200640 1 --2- 172.21.15.137:0/77328393 >> v2:172.21.15.170:3300/0 conn(0x7f5da0073f20 0x7f5da00735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5da5200640 1 --2- 172.21.15.137:0/77328393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5da00afbc0 0x7f5da015df90 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5da5200640 1 -- 172.21.15.137:0/77328393 >> 172.21.15.137:0/77328393 conn(0x7f5da006c800 msgr2=0x7f5da006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:14.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5da5200640 1 -- 172.21.15.137:0/77328393 shutdown_connections 2024-04-26T23:42:14.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5da5200640 1 -- 172.21.15.137:0/77328393 wait complete. 2024-04-26T23:42:14.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5da5200640 1 Processor -- start 2024-04-26T23:42:14.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5da5200640 1 -- start start 2024-04-26T23:42:14.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5da5200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5da00afbc0 0x7f5da00ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:14.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5da5200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5da00affa0 0x7f5da00aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:14.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5da5200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5da014f830 0x7f5da0161970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:14.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5da5200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5da0161490 con 0x7f5da014f830 2024-04-26T23:42:14.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5da5200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5da0161310 con 0x7f5da00affa0 2024-04-26T23:42:14.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5da5200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5da0161610 con 0x7f5da00afbc0 2024-04-26T23:42:14.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5d9e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5da014f830 0x7f5da0161970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:14.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5d9e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5da014f830 0x7f5da0161970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53430/0 (socket says 172.21.15.137:53430) 2024-04-26T23:42:14.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5d9e800640 1 -- 172.21.15.137:0/1565761770 learned_addr learned my addr 172.21.15.137:0/1565761770 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:14.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5d9de00640 1 --2- 172.21.15.137:0/1565761770 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5da00afbc0 0x7f5da00ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:14.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5d9d400640 1 --2- 172.21.15.137:0/1565761770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5da00affa0 0x7f5da00aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:14.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5d9e800640 1 -- 172.21.15.137:0/1565761770 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5da00afbc0 msgr2=0x7f5da00ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:14.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5d9e800640 1 --2- 172.21.15.137:0/1565761770 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5da00afbc0 0x7f5da00ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5d9e800640 1 -- 172.21.15.137:0/1565761770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5da00affa0 msgr2=0x7f5da00aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:14.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5d9e800640 1 --2- 172.21.15.137:0/1565761770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5da00affa0 0x7f5da00aee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:14.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5d9e800640 1 -- 172.21.15.137:0/1565761770 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da0162660 con 0x7f5da014f830 2024-04-26T23:42:14.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.572+0000 7f5d9d400640 1 --2- 172.21.15.137:0/1565761770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5da00affa0 0x7f5da00aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:14.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.576+0000 7f5d9e800640 1 --2- 172.21.15.137:0/1565761770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5da014f830 0x7f5da0161970 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800e820 tx=0x7f5d9800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:14.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.576+0000 7f5d96000640 1 -- 172.21.15.137:0/1565761770 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d98017070 con 0x7f5da014f830 2024-04-26T23:42:14.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.576+0000 7f5d96000640 1 -- 172.21.15.137:0/1565761770 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d9800c8e0 con 0x7f5da014f830 2024-04-26T23:42:14.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.576+0000 7f5da5200640 1 -- 172.21.15.137:0/1565761770 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5da0162940 con 0x7f5da014f830 2024-04-26T23:42:14.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.576+0000 7f5d96000640 1 -- 172.21.15.137:0/1565761770 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9800ccb0 con 0x7f5da014f830 2024-04-26T23:42:14.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.576+0000 7f5da5200640 1 -- 172.21.15.137:0/1565761770 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5da01f9290 con 0x7f5da014f830 2024-04-26T23:42:14.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.576+0000 7f5da5200640 1 -- 172.21.15.137:0/1565761770 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5da0162df0 con 0x7f5da014f830 2024-04-26T23:42:14.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.576+0000 7f5d96000640 1 -- 172.21.15.137:0/1565761770 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5d9801a070 con 0x7f5da014f830 2024-04-26T23:42:14.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.576+0000 7f5d96000640 1 --2- 172.21.15.137:0/1565761770 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5d80068380 0x7f5d8006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:14.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.576+0000 7f5d96000640 1 -- 172.21.15.137:0/1565761770 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5911+0+0 (secure 0 0 0) 0x7f5d980867d0 con 0x7f5da014f830 2024-04-26T23:42:14.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.576+0000 7f5d9de00640 1 --2- 172.21.15.137:0/1565761770 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5d80068380 0x7f5d8006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:14.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.580+0000 7f5d9de00640 1 --2- 172.21.15.137:0/1565761770 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5d80068380 0x7f5d8006a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5d900ae000 tx=0x7f5d900a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:14.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.580+0000 7f5d96000640 1 -- 172.21.15.137:0/1565761770 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5d98056660 con 0x7f5da014f830 2024-04-26T23:42:14.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:14.776+0000 7f5da5200640 1 -- 172.21.15.137:0/1565761770 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5da0160870 con 0x7f5da014f830 2024-04-26T23:42:15.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.404+0000 7f5d96000640 1 -- 172.21.15.137:0/1565761770 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f5d9805a960 con 0x7f5da014f830 2024-04-26T23:42:15.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.408+0000 7f5da5200640 1 -- 172.21.15.137:0/1565761770 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5d80068380 msgr2=0x7f5d8006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:15.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.408+0000 7f5da5200640 1 --2- 172.21.15.137:0/1565761770 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5d80068380 0x7f5d8006a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5d900ae000 tx=0x7f5d900a7070 comp rx=0 tx=0).stop 2024-04-26T23:42:15.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.408+0000 7f5da5200640 1 -- 172.21.15.137:0/1565761770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5da014f830 msgr2=0x7f5da0161970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:15.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.408+0000 7f5da5200640 1 --2- 172.21.15.137:0/1565761770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5da014f830 0x7f5da0161970 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800e820 tx=0x7f5d9800ece0 comp rx=0 tx=0).stop 2024-04-26T23:42:15.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.408+0000 7f5da5200640 1 -- 172.21.15.137:0/1565761770 shutdown_connections 2024-04-26T23:42:15.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.408+0000 7f5da5200640 1 --2- 172.21.15.137:0/1565761770 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5d80068380 0x7f5d8006a840 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:15.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.408+0000 7f5da5200640 1 --2- 172.21.15.137:0/1565761770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5da014f830 0x7f5da0161970 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:15.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.408+0000 7f5da5200640 1 --2- 172.21.15.137:0/1565761770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5da00affa0 0x7f5da00aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:15.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.408+0000 7f5da5200640 1 --2- 172.21.15.137:0/1565761770 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5da00afbc0 0x7f5da00ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:15.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.408+0000 7f5da5200640 1 -- 172.21.15.137:0/1565761770 >> 172.21.15.137:0/1565761770 conn(0x7f5da006c800 msgr2=0x7f5da00b1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:15.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.408+0000 7f5da5200640 1 -- 172.21.15.137:0/1565761770 shutdown_connections 2024-04-26T23:42:15.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.408+0000 7f5da5200640 1 -- 172.21.15.137:0/1565761770 wait complete. 2024-04-26T23:42:15.436 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T23:42:15.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.572+0000 7eff4b200640 1 Processor -- start 2024-04-26T23:42:15.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.572+0000 7eff4b200640 1 -- start start 2024-04-26T23:42:15.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.572+0000 7eff4b200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7eff4c0727d0 0x7eff4c06f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:15.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.572+0000 7eff4b200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7eff4c072c50 0x7eff4c06f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:15.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.572+0000 7eff4b200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff4c15db00 con 0x7eff4c145670 2024-04-26T23:42:15.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.572+0000 7eff4b200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7eff4c0cee50 con 0x7eff4c0727d0 2024-04-26T23:42:15.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.572+0000 7eff4b200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7eff4c0cf9d0 con 0x7eff4c072c50 2024-04-26T23:42:15.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.576+0000 7eff41400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7eff4c0727d0 0x7eff4c06f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:15.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.576+0000 7eff41400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7eff4c0727d0 0x7eff4c06f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53442/0 (socket says 172.21.15.137:53442) 2024-04-26T23:42:15.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.576+0000 7eff41400640 1 -- 172.21.15.137:0/3022207649 learned_addr learned my addr 172.21.15.137:0/3022207649 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:15.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.576+0000 7eff4a800640 1 --2- 172.21.15.137:0/3022207649 >> v2:172.21.15.170:3300/0 conn(0x7eff4c072c50 0x7eff4c06f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:15.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.576+0000 7eff41400640 1 -- 172.21.15.137:0/3022207649 >> v2:172.21.15.170:3300/0 conn(0x7eff4c072c50 msgr2=0x7eff4c06f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:15.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.576+0000 7eff41400640 1 --2- 172.21.15.137:0/3022207649 >> v2:172.21.15.170:3300/0 conn(0x7eff4c072c50 0x7eff4c06f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:15.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.576+0000 7eff41400640 1 -- 172.21.15.137:0/3022207649 >> v1:172.21.15.170:6789/0 conn(0x7eff4c145670 legacy=0x7eff4c15d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:15.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.576+0000 7eff41400640 1 -- 172.21.15.137:0/3022207649 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4c0cf0a0 con 0x7eff4c0727d0 2024-04-26T23:42:15.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.576+0000 7eff41400640 1 --2- 172.21.15.137:0/3022207649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff4c0727d0 0x7eff4c06f150 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0b3bc0 tx=0x7eff3401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155e2ed05f2e9157 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:15.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.576+0000 7eff49400640 1 -- 172.21.15.137:0/3022207649 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff340ab5f0 con 0x7eff4c0727d0 2024-04-26T23:42:15.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.576+0000 7eff49400640 1 -- 172.21.15.137:0/3022207649 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff340b0070 con 0x7eff4c0727d0 2024-04-26T23:42:15.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.576+0000 7eff49400640 1 -- 172.21.15.137:0/3022207649 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff340ab9b0 con 0x7eff4c0727d0 2024-04-26T23:42:15.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff4b200640 1 -- 172.21.15.137:0/3022207649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff4c0727d0 msgr2=0x7eff4c06f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:15.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff4b200640 1 --2- 172.21.15.137:0/3022207649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff4c0727d0 0x7eff4c06f150 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0b3bc0 tx=0x7eff3401c4e0 comp rx=0 tx=0).stop 2024-04-26T23:42:15.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff4b200640 1 -- 172.21.15.137:0/3022207649 shutdown_connections 2024-04-26T23:42:15.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff4b200640 1 --2- 172.21.15.137:0/3022207649 >> v2:172.21.15.170:3300/0 conn(0x7eff4c072c50 0x7eff4c06f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:15.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff4b200640 1 --2- 172.21.15.137:0/3022207649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff4c0727d0 0x7eff4c06f150 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:15.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff4b200640 1 -- 172.21.15.137:0/3022207649 >> 172.21.15.137:0/3022207649 conn(0x7eff4c0b2830 msgr2=0x7eff4c0b2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:15.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff4b200640 1 -- 172.21.15.137:0/3022207649 shutdown_connections 2024-04-26T23:42:15.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff4b200640 1 -- 172.21.15.137:0/3022207649 wait complete. 2024-04-26T23:42:15.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff4b200640 1 Processor -- start 2024-04-26T23:42:15.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff4b200640 1 -- start start 2024-04-26T23:42:15.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff4b200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff4c0727d0 0x7eff4c15aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:15.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff4b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff4c072c50 0x7eff4c13d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:15.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff4b200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff4c145670 0x7eff4c13ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:15.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff4b200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7eff4c168a40 con 0x7eff4c072c50 2024-04-26T23:42:15.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff4b200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7eff4c145a50 con 0x7eff4c0727d0 2024-04-26T23:42:15.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff4b200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7eff4c168bc0 con 0x7eff4c145670 2024-04-26T23:42:15.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff41400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff4c072c50 0x7eff4c13d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:15.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff41400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff4c072c50 0x7eff4c13d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53444/0 (socket says 172.21.15.137:53444) 2024-04-26T23:42:15.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff41400640 1 -- 172.21.15.137:0/3832108078 learned_addr learned my addr 172.21.15.137:0/3832108078 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:15.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff4a800640 1 --2- 172.21.15.137:0/3832108078 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff4c145670 0x7eff4c13ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:15.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff49e00640 1 --2- 172.21.15.137:0/3832108078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff4c0727d0 0x7eff4c15aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:15.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff41400640 1 -- 172.21.15.137:0/3832108078 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff4c145670 msgr2=0x7eff4c13ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:15.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff41400640 1 --2- 172.21.15.137:0/3832108078 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff4c145670 0x7eff4c13ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:15.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff41400640 1 -- 172.21.15.137:0/3832108078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff4c0727d0 msgr2=0x7eff4c15aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:15.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff41400640 1 --2- 172.21.15.137:0/3832108078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff4c0727d0 0x7eff4c15aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:15.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff41400640 1 -- 172.21.15.137:0/3832108078 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4c140370 con 0x7eff4c072c50 2024-04-26T23:42:15.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff41400640 1 --2- 172.21.15.137:0/3832108078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff4c072c50 0x7eff4c13d690 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7eff340ad040 tx=0x7eff3401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:15.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.580+0000 7eff42a00640 1 -- 172.21.15.137:0/3832108078 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff340abe60 con 0x7eff4c072c50 2024-04-26T23:42:15.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.584+0000 7eff42a00640 1 -- 172.21.15.137:0/3832108078 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff340be5f0 con 0x7eff4c072c50 2024-04-26T23:42:15.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.584+0000 7eff4b200640 1 -- 172.21.15.137:0/3832108078 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff4c13afb0 con 0x7eff4c072c50 2024-04-26T23:42:15.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.584+0000 7eff42a00640 1 -- 172.21.15.137:0/3832108078 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff340be9c0 con 0x7eff4c072c50 2024-04-26T23:42:15.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.584+0000 7eff4b200640 1 -- 172.21.15.137:0/3832108078 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff4c13b570 con 0x7eff4c072c50 2024-04-26T23:42:15.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.584+0000 7eff4b200640 1 -- 172.21.15.137:0/3832108078 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff4c06a480 con 0x7eff4c072c50 2024-04-26T23:42:15.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.584+0000 7eff42a00640 1 -- 172.21.15.137:0/3832108078 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7eff340b43f0 con 0x7eff4c072c50 2024-04-26T23:42:15.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.584+0000 7eff42a00640 1 --2- 172.21.15.137:0/3832108078 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7eff28068380 0x7eff2806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:15.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.584+0000 7eff42a00640 1 -- 172.21.15.137:0/3832108078 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5911+0+0 (secure 0 0 0) 0x7eff34120d50 con 0x7eff4c072c50 2024-04-26T23:42:15.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.584+0000 7eff49e00640 1 --2- 172.21.15.137:0/3832108078 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7eff28068380 0x7eff2806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:15.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.584+0000 7eff49e00640 1 --2- 172.21.15.137:0/3832108078 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7eff28068380 0x7eff2806a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7eff3c00b810 tx=0x7eff3c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:15.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.588+0000 7eff42a00640 1 -- 172.21.15.137:0/3832108078 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7eff340c4060 con 0x7eff4c072c50 2024-04-26T23:42:15.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:15.748+0000 7eff4b200640 1 -- 172.21.15.137:0/3832108078 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7eff4c0b0f90 con 0x7eff4c072c50 2024-04-26T23:42:16.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.412+0000 7eff42a00640 1 -- 172.21.15.137:0/3832108078 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) ==== 181+0+0 (secure 0 0 0) 0x7eff340160d0 con 0x7eff4c072c50 2024-04-26T23:42:16.417 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' removed 2024-04-26T23:42:16.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.416+0000 7eff4b200640 1 -- 172.21.15.137:0/3832108078 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7eff28068380 msgr2=0x7eff2806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:16.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.416+0000 7eff4b200640 1 --2- 172.21.15.137:0/3832108078 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7eff28068380 0x7eff2806a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7eff3c00b810 tx=0x7eff3c008040 comp rx=0 tx=0).stop 2024-04-26T23:42:16.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.416+0000 7eff4b200640 1 -- 172.21.15.137:0/3832108078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff4c072c50 msgr2=0x7eff4c13d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:16.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.416+0000 7eff4b200640 1 --2- 172.21.15.137:0/3832108078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff4c072c50 0x7eff4c13d690 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7eff340ad040 tx=0x7eff3401ad20 comp rx=0 tx=0).stop 2024-04-26T23:42:16.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.416+0000 7eff4b200640 1 -- 172.21.15.137:0/3832108078 shutdown_connections 2024-04-26T23:42:16.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.416+0000 7eff4b200640 1 --2- 172.21.15.137:0/3832108078 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7eff28068380 0x7eff2806a840 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:16.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.416+0000 7eff4b200640 1 --2- 172.21.15.137:0/3832108078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff4c072c50 0x7eff4c13d690 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:16.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.416+0000 7eff4b200640 1 --2- 172.21.15.137:0/3832108078 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff4c145670 0x7eff4c13ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:16.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.416+0000 7eff4b200640 1 --2- 172.21.15.137:0/3832108078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff4c0727d0 0x7eff4c15aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:16.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.416+0000 7eff4b200640 1 -- 172.21.15.137:0/3832108078 >> 172.21.15.137:0/3832108078 conn(0x7eff4c0b2830 msgr2=0x7eff4c0b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:16.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.416+0000 7eff4b200640 1 -- 172.21.15.137:0/3832108078 shutdown_connections 2024-04-26T23:42:16.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.416+0000 7eff4b200640 1 -- 172.21.15.137:0/3832108078 wait complete. 2024-04-26T23:42:16.443 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T23:42:16.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.580+0000 7ff413e00640 1 Processor -- start 2024-04-26T23:42:16.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.580+0000 7ff413e00640 1 -- start start 2024-04-26T23:42:16.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.580+0000 7ff413e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4141627d0 0x7ff41409ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:16.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.580+0000 7ff413e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff41409a700 0x7ff4140cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:16.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.580+0000 7ff413e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff4140cf700 0x7ff41406f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:16.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.580+0000 7ff413e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff41406f090 con 0x7ff41409a700 2024-04-26T23:42:16.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.580+0000 7ff413e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff41406e780 con 0x7ff4140cf700 2024-04-26T23:42:16.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.580+0000 7ff413e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff414163b00 con 0x7ff4141627d0 2024-04-26T23:42:16.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.580+0000 7ff412000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff41409a700 0x7ff4140cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:16.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.580+0000 7ff412000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff41409a700 0x7ff4140cf1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53454/0 (socket says 172.21.15.137:53454) 2024-04-26T23:42:16.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.580+0000 7ff412000640 1 -- 172.21.15.137:0/718227613 learned_addr learned my addr 172.21.15.137:0/718227613 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:16.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.580+0000 7ff412a00640 1 --2- 172.21.15.137:0/718227613 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4141627d0 0x7ff41409ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:16.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.580+0000 7ff413400640 1 --2- 172.21.15.137:0/718227613 >> v2:172.21.15.170:3300/0 conn(0x7ff4140cf700 0x7ff41406f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:16.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.580+0000 7ff412000640 1 -- 172.21.15.137:0/718227613 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4141627d0 msgr2=0x7ff41409ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:16.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.580+0000 7ff412000640 1 --2- 172.21.15.137:0/718227613 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4141627d0 0x7ff41409ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:16.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.580+0000 7ff412000640 1 -- 172.21.15.137:0/718227613 >> v2:172.21.15.170:3300/0 conn(0x7ff4140cf700 msgr2=0x7ff41406f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:16.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.580+0000 7ff412000640 1 --2- 172.21.15.137:0/718227613 >> v2:172.21.15.170:3300/0 conn(0x7ff4140cf700 0x7ff41406f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:16.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.580+0000 7ff412000640 1 -- 172.21.15.137:0/718227613 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41406ea40 con 0x7ff41409a700 2024-04-26T23:42:16.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.588+0000 7ff412000640 1 --2- 172.21.15.137:0/718227613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff41409a700 0x7ff4140cf1c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff414072670 tx=0x7ff40001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3741d9a8ab6b21d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:16.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.588+0000 7ff411600640 1 -- 172.21.15.137:0/718227613 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4000b0070 con 0x7ff41409a700 2024-04-26T23:42:16.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.588+0000 7ff411600640 1 -- 172.21.15.137:0/718227613 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4000ab600 con 0x7ff41409a700 2024-04-26T23:42:16.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.588+0000 7ff411600640 1 -- 172.21.15.137:0/718227613 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4000ab9d0 con 0x7ff41409a700 2024-04-26T23:42:16.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.588+0000 7ff413e00640 1 -- 172.21.15.137:0/718227613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff41409a700 msgr2=0x7ff4140cf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:16.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.588+0000 7ff413e00640 1 --2- 172.21.15.137:0/718227613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff41409a700 0x7ff4140cf1c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff414072670 tx=0x7ff40001c520 comp rx=0 tx=0).stop 2024-04-26T23:42:16.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.592+0000 7ff413e00640 1 -- 172.21.15.137:0/718227613 shutdown_connections 2024-04-26T23:42:16.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.592+0000 7ff413e00640 1 --2- 172.21.15.137:0/718227613 >> v2:172.21.15.170:3300/0 conn(0x7ff4140cf700 0x7ff41406f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:16.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.592+0000 7ff413e00640 1 --2- 172.21.15.137:0/718227613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff41409a700 0x7ff4140cf1c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:16.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.592+0000 7ff413e00640 1 --2- 172.21.15.137:0/718227613 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4141627d0 0x7ff41409ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:16.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.592+0000 7ff413e00640 1 -- 172.21.15.137:0/718227613 >> 172.21.15.137:0/718227613 conn(0x7ff4140b2ef0 msgr2=0x7ff4140b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:16.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.592+0000 7ff413e00640 1 -- 172.21.15.137:0/718227613 shutdown_connections 2024-04-26T23:42:16.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.592+0000 7ff413e00640 1 -- 172.21.15.137:0/718227613 wait complete. 2024-04-26T23:42:16.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.592+0000 7ff413e00640 1 Processor -- start 2024-04-26T23:42:16.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.592+0000 7ff413e00640 1 -- start start 2024-04-26T23:42:16.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.596+0000 7ff413e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff41409a700 0x7ff41414f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:16.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.596+0000 7ff413e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4140cf700 0x7ff414157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:16.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.596+0000 7ff413e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4141627d0 0x7ff414157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:16.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.596+0000 7ff413e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff414073ad0 con 0x7ff4140cf700 2024-04-26T23:42:16.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.596+0000 7ff413e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff4140c8050 con 0x7ff4141627d0 2024-04-26T23:42:16.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.596+0000 7ff413e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff414073c50 con 0x7ff41409a700 2024-04-26T23:42:16.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.596+0000 7ff413400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4141627d0 0x7ff414157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:16.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.596+0000 7ff412a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff41409a700 0x7ff41414f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:16.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.596+0000 7ff413400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4141627d0 0x7ff414157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:36078/0 (socket says 172.21.15.137:36078) 2024-04-26T23:42:16.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.596+0000 7ff413400640 1 -- 172.21.15.137:0/1456808594 learned_addr learned my addr 172.21.15.137:0/1456808594 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:16.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.596+0000 7ff412000640 1 --2- 172.21.15.137:0/1456808594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4140cf700 0x7ff414157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:16.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.596+0000 7ff413400640 1 -- 172.21.15.137:0/1456808594 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff41409a700 msgr2=0x7ff41414f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:16.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.596+0000 7ff413400640 1 --2- 172.21.15.137:0/1456808594 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff41409a700 0x7ff41414f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:16.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.596+0000 7ff413400640 1 -- 172.21.15.137:0/1456808594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4140cf700 msgr2=0x7ff414157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:16.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.596+0000 7ff413400640 1 --2- 172.21.15.137:0/1456808594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4140cf700 0x7ff414157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:16.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.596+0000 7ff413400640 1 -- 172.21.15.137:0/1456808594 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff414157260 con 0x7ff4141627d0 2024-04-26T23:42:16.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.596+0000 7ff413400640 1 --2- 172.21.15.137:0/1456808594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4141627d0 0x7ff414157d90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00bf30 tx=0x7ff40c016420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:16.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.596+0000 7ff40aa00640 1 -- 172.21.15.137:0/1456808594 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40c016c40 con 0x7ff4141627d0 2024-04-26T23:42:16.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.596+0000 7ff40aa00640 1 -- 172.21.15.137:0/1456808594 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff40c016de0 con 0x7ff4141627d0 2024-04-26T23:42:16.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.596+0000 7ff40aa00640 1 -- 172.21.15.137:0/1456808594 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40c013630 con 0x7ff4141627d0 2024-04-26T23:42:16.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.596+0000 7ff413e00640 1 -- 172.21.15.137:0/1456808594 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff414157540 con 0x7ff4141627d0 2024-04-26T23:42:16.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.596+0000 7ff413e00640 1 -- 172.21.15.137:0/1456808594 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4140af020 con 0x7ff4141627d0 2024-04-26T23:42:16.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.600+0000 7ff413e00640 1 -- 172.21.15.137:0/1456808594 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff41406a480 con 0x7ff4141627d0 2024-04-26T23:42:16.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.600+0000 7ff40aa00640 1 -- 172.21.15.137:0/1456808594 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff40c03aab0 con 0x7ff4141627d0 2024-04-26T23:42:16.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.600+0000 7ff40aa00640 1 --2- 172.21.15.137:0/1456808594 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff3f4068380 0x7ff3f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:16.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.600+0000 7ff40aa00640 1 -- 172.21.15.137:0/1456808594 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5473+0+0 (secure 0 0 0) 0x7ff40c0871c0 con 0x7ff4141627d0 2024-04-26T23:42:16.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.600+0000 7ff412a00640 1 --2- 172.21.15.137:0/1456808594 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff3f4068380 0x7ff3f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:16.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.600+0000 7ff412a00640 1 --2- 172.21.15.137:0/1456808594 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff3f4068380 0x7ff3f406a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff404009ac0 tx=0x7ff404009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:16.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.604+0000 7ff40aa00640 1 -- 172.21.15.137:0/1456808594 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff40c0578c0 con 0x7ff4141627d0 2024-04-26T23:42:16.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:16.764+0000 7ff413e00640 1 -- 172.21.15.137:0/1456808594 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff4140d1040 con 0x7ff4141627d0 2024-04-26T23:42:17.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.420+0000 7ff40aa00640 1 -- 172.21.15.137:0/1456808594 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) ==== 169+0+0 (secure 0 0 0) 0x7ff40c0571c0 con 0x7ff4141627d0 2024-04-26T23:42:17.425 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' removed 2024-04-26T23:42:17.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.424+0000 7ff413e00640 1 -- 172.21.15.137:0/1456808594 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff3f4068380 msgr2=0x7ff3f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:17.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.424+0000 7ff413e00640 1 --2- 172.21.15.137:0/1456808594 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff3f4068380 0x7ff3f406a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff404009ac0 tx=0x7ff404009190 comp rx=0 tx=0).stop 2024-04-26T23:42:17.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.424+0000 7ff413e00640 1 -- 172.21.15.137:0/1456808594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4141627d0 msgr2=0x7ff414157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:17.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.424+0000 7ff413e00640 1 --2- 172.21.15.137:0/1456808594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4141627d0 0x7ff414157d90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00bf30 tx=0x7ff40c016420 comp rx=0 tx=0).stop 2024-04-26T23:42:17.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.424+0000 7ff413e00640 1 -- 172.21.15.137:0/1456808594 shutdown_connections 2024-04-26T23:42:17.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.424+0000 7ff413e00640 1 --2- 172.21.15.137:0/1456808594 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff3f4068380 0x7ff3f406a840 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.424+0000 7ff413e00640 1 --2- 172.21.15.137:0/1456808594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4140cf700 0x7ff414157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.424+0000 7ff413e00640 1 --2- 172.21.15.137:0/1456808594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4141627d0 0x7ff414157d90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.424+0000 7ff413e00640 1 --2- 172.21.15.137:0/1456808594 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff41409a700 0x7ff41414f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.424+0000 7ff413e00640 1 -- 172.21.15.137:0/1456808594 >> 172.21.15.137:0/1456808594 conn(0x7ff4140b2ef0 msgr2=0x7ff4140b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:17.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.424+0000 7ff413e00640 1 -- 172.21.15.137:0/1456808594 shutdown_connections 2024-04-26T23:42:17.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.424+0000 7ff413e00640 1 -- 172.21.15.137:0/1456808594 wait complete. 2024-04-26T23:42:17.453 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T23:42:17.453 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-26T23:42:17.454 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T23:42:17.454 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:42:17.454 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T23:42:17.454 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-26T23:42:17.454 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T23:42:17.454 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:42:17.455 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T23:42:17.455 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-26T23:42:17.455 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T23:42:17.455 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:42:17.455 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T23:42:17.455 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-26T23:42:17.455 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T23:42:17.455 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:42:17.468 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T23:42:17.468 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T23:42:17.470 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T23:42:17.470 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T23:42:17.471 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T23:42:17.472 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T23:42:17.472 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T23:42:17.472 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T23:42:17.513 INFO:tasks.ceph.mds.a:Started 2024-04-26T23:42:17.514 DEBUG:teuthology.parallel:result is None 2024-04-26T23:42:17.516 INFO:tasks.ceph.mds.c:Started 2024-04-26T23:42:17.516 DEBUG:teuthology.parallel:result is None 2024-04-26T23:42:17.521 INFO:tasks.ceph.mds.b:Started 2024-04-26T23:42:17.521 DEBUG:teuthology.parallel:result is None 2024-04-26T23:42:17.522 INFO:tasks.ceph.mds.d:Started 2024-04-26T23:42:17.523 DEBUG:teuthology.parallel:result is None 2024-04-26T23:42:17.523 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-26T23:42:17.604 INFO:tasks.ceph.mds.a.smithi137.stdout:starting mds.a at 2024-04-26T23:42:17.604 INFO:tasks.ceph.mds.c.smithi137.stdout:starting mds.c at 2024-04-26T23:42:17.610 INFO:tasks.ceph.mds.d.smithi170.stdout:starting mds.d at 2024-04-26T23:42:17.610 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2024-04-26T23:42:17.612 INFO:tasks.ceph.mds.d.smithi170.stderr:2024-04-26T23:42:17.605+0000 7fb944200640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-04-26T23:42:17.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.668+0000 7f1841400640 1 Processor -- start 2024-04-26T23:42:17.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.668+0000 7f1841400640 1 -- start start 2024-04-26T23:42:17.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.668+0000 7f1841400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f183c15f3d0 0x7f183c0d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:17.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.668+0000 7f1841400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f183c0d2d80 0x7f183c0d3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:17.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.668+0000 7f1841400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f183c0d36c0 con 0x7f183c0b4100 2024-04-26T23:42:17.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.668+0000 7f1841400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f183c0b2960 con 0x7f183c15f3d0 2024-04-26T23:42:17.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.668+0000 7f1841400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f183c160240 con 0x7f183c0d2d80 2024-04-26T23:42:17.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.668+0000 7f183a800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f183c15f3d0 0x7f183c0d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:17.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.668+0000 7f1839e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f183c0b4100 0x7f183c15f7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48148/0 (socket says 172.21.15.137:48148) 2024-04-26T23:42:17.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.668+0000 7f1839e00640 1 -- 172.21.15.137:0/629493637 learned_addr learned my addr 172.21.15.137:0/629493637 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:17.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.668+0000 7f183b200640 1 --2- 172.21.15.137:0/629493637 >> v2:172.21.15.170:3300/0 conn(0x7f183c0d2d80 0x7f183c0d3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:17.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.668+0000 7f183a800640 1 -- 172.21.15.137:0/629493637 >> v2:172.21.15.170:3300/0 conn(0x7f183c0d2d80 msgr2=0x7f183c0d3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:17.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.668+0000 7f183a800640 1 --2- 172.21.15.137:0/629493637 >> v2:172.21.15.170:3300/0 conn(0x7f183c0d2d80 0x7f183c0d3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.668+0000 7f183a800640 1 -- 172.21.15.137:0/629493637 >> v1:172.21.15.137:6789/0 conn(0x7f183c0b4100 legacy=0x7f183c15f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:17.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.668+0000 7f183a800640 1 -- 172.21.15.137:0/629493637 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183c160520 con 0x7f183c15f3d0 2024-04-26T23:42:17.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.668+0000 7f1839400640 1 -- 172.21.15.137:0/629493637 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 654330455 0 0) 0x7f183c0d36c0 con 0x7f183c0b4100 2024-04-26T23:42:17.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.672+0000 7f183a800640 1 --2- 172.21.15.137:0/629493637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f183c15f3d0 0x7f183c0d1030 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f183c06fc40 tx=0x7f182c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca690bd4c36e8909 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:17.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.672+0000 7f1839400640 1 -- 172.21.15.137:0/629493637 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c0b2070 con 0x7f183c15f3d0 2024-04-26T23:42:17.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.672+0000 7f1839400640 1 -- 172.21.15.137:0/629493637 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f182c0ad640 con 0x7f183c15f3d0 2024-04-26T23:42:17.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.672+0000 7f1839400640 1 -- 172.21.15.137:0/629493637 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c0ada10 con 0x7f183c15f3d0 2024-04-26T23:42:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.672+0000 7f1841400640 1 -- 172.21.15.137:0/629493637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f183c15f3d0 msgr2=0x7f183c0d1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.672+0000 7f1841400640 1 --2- 172.21.15.137:0/629493637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f183c15f3d0 0x7f183c0d1030 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f183c06fc40 tx=0x7f182c01c480 comp rx=0 tx=0).stop 2024-04-26T23:42:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.672+0000 7f1841400640 1 -- 172.21.15.137:0/629493637 shutdown_connections 2024-04-26T23:42:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.672+0000 7f1841400640 1 --2- 172.21.15.137:0/629493637 >> v2:172.21.15.170:3300/0 conn(0x7f183c0d2d80 0x7f183c0d3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.672+0000 7f1841400640 1 --2- 172.21.15.137:0/629493637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f183c15f3d0 0x7f183c0d1030 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.672+0000 7f1841400640 1 -- 172.21.15.137:0/629493637 >> 172.21.15.137:0/629493637 conn(0x7f183c09ba60 msgr2=0x7f183c09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:17.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.672+0000 7f1841400640 1 -- 172.21.15.137:0/629493637 shutdown_connections 2024-04-26T23:42:17.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.672+0000 7f1841400640 1 -- 172.21.15.137:0/629493637 wait complete. 2024-04-26T23:42:17.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f1841400640 1 Processor -- start 2024-04-26T23:42:17.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f1841400640 1 -- start start 2024-04-26T23:42:17.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f1841400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f183c0b4100 0x7f183c0d1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:17.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f1841400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f183c0d2d80 0x7f183c14d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:17.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f1841400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f183c15f3d0 0x7f183c0b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:17.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f1841400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f183c0b39d0 con 0x7f183c0b4100 2024-04-26T23:42:17.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f1841400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f183c0b3850 con 0x7f183c15f3d0 2024-04-26T23:42:17.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f1841400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f183c0b3b50 con 0x7f183c0d2d80 2024-04-26T23:42:17.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f183a800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f183c0b4100 0x7f183c0d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:17.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f183a800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f183c0b4100 0x7f183c0d1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53494/0 (socket says 172.21.15.137:53494) 2024-04-26T23:42:17.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f183a800640 1 -- 172.21.15.137:0/4018964874 learned_addr learned my addr 172.21.15.137:0/4018964874 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:17.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f183b200640 1 --2- 172.21.15.137:0/4018964874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f183c15f3d0 0x7f183c0b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:17.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f1839e00640 1 --2- 172.21.15.137:0/4018964874 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f183c0d2d80 0x7f183c14d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:17.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f183a800640 1 -- 172.21.15.137:0/4018964874 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f183c0d2d80 msgr2=0x7f183c14d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:17.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f183a800640 1 --2- 172.21.15.137:0/4018964874 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f183c0d2d80 0x7f183c14d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f183a800640 1 -- 172.21.15.137:0/4018964874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f183c15f3d0 msgr2=0x7f183c0b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:17.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f183a800640 1 --2- 172.21.15.137:0/4018964874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f183c15f3d0 0x7f183c0b6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f183a800640 1 -- 172.21.15.137:0/4018964874 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183c15dbc0 con 0x7f183c0b4100 2024-04-26T23:42:17.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f183a800640 1 --2- 172.21.15.137:0/4018964874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f183c0b4100 0x7f183c0d1720 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f182c0b0040 tx=0x7f182c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:17.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f1832a00640 1 -- 172.21.15.137:0/4018964874 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c0ba020 con 0x7f183c0b4100 2024-04-26T23:42:17.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f1832a00640 1 -- 172.21.15.137:0/4018964874 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f182c0b6410 con 0x7f183c0b4100 2024-04-26T23:42:17.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f1832a00640 1 -- 172.21.15.137:0/4018964874 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c0b2040 con 0x7f183c0b4100 2024-04-26T23:42:17.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f1841400640 1 -- 172.21.15.137:0/4018964874 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f183c159c70 con 0x7f183c0b4100 2024-04-26T23:42:17.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f1841400640 1 -- 172.21.15.137:0/4018964874 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f183c0d1c60 con 0x7f183c0b4100 2024-04-26T23:42:17.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.676+0000 7f1841400640 1 -- 172.21.15.137:0/4018964874 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f183c06a4b0 con 0x7f183c0b4100 2024-04-26T23:42:17.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.680+0000 7f1832a00640 1 -- 172.21.15.137:0/4018964874 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f182c0bd020 con 0x7f183c0b4100 2024-04-26T23:42:17.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.680+0000 7f1832a00640 1 --2- 172.21.15.137:0/4018964874 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f181c068380 0x7f181c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:17.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.680+0000 7f1832a00640 1 -- 172.21.15.137:0/4018964874 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4943+0+0 (secure 0 0 0) 0x7f182c120400 con 0x7f183c0b4100 2024-04-26T23:42:17.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.680+0000 7f1839e00640 1 --2- 172.21.15.137:0/4018964874 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f181c068380 0x7f181c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:17.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.680+0000 7f1839e00640 1 --2- 172.21.15.137:0/4018964874 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f181c068380 0x7f181c06a840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f183c0d16b0 tx=0x7f1828007d60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:17.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.684+0000 7f1832a00640 1 -- 172.21.15.137:0/4018964874 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f182c0c4030 con 0x7f183c0b4100 2024-04-26T23:42:17.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:17.856+0000 7f1841400640 1 -- 172.21.15.137:0/4018964874 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f183c0b24f0 con 0x7f183c0b4100 2024-04-26T23:42:18.352 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:42:18.355 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:42:18.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.432+0000 7f1832a00640 1 -- 172.21.15.137:0/4018964874 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) ==== 97+0+0 (secure 0 0 0) 0x7f182c016070 con 0x7f183c0b4100 2024-04-26T23:42:18.437 INFO:teuthology.orchestra.run.smithi137.stderr: removed all blocklist entries 2024-04-26T23:42:18.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.432+0000 7f1841400640 1 -- 172.21.15.137:0/4018964874 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f181c068380 msgr2=0x7f181c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.432+0000 7f1841400640 1 --2- 172.21.15.137:0/4018964874 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f181c068380 0x7f181c06a840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f183c0d16b0 tx=0x7f1828007d60 comp rx=0 tx=0).stop 2024-04-26T23:42:18.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.436+0000 7f1841400640 1 -- 172.21.15.137:0/4018964874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f183c0b4100 msgr2=0x7f183c0d1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.436+0000 7f1841400640 1 --2- 172.21.15.137:0/4018964874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f183c0b4100 0x7f183c0d1720 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f182c0b0040 tx=0x7f182c019220 comp rx=0 tx=0).stop 2024-04-26T23:42:18.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.436+0000 7f1841400640 1 -- 172.21.15.137:0/4018964874 shutdown_connections 2024-04-26T23:42:18.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.436+0000 7f1841400640 1 --2- 172.21.15.137:0/4018964874 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f181c068380 0x7f181c06a840 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.436+0000 7f1841400640 1 --2- 172.21.15.137:0/4018964874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f183c15f3d0 0x7f183c0b6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.436+0000 7f1841400640 1 --2- 172.21.15.137:0/4018964874 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f183c0d2d80 0x7f183c14d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.436+0000 7f1841400640 1 --2- 172.21.15.137:0/4018964874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f183c0b4100 0x7f183c0d1720 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.436+0000 7f1841400640 1 -- 172.21.15.137:0/4018964874 >> 172.21.15.137:0/4018964874 conn(0x7f183c09ba60 msgr2=0x7f183c158950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:18.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.436+0000 7f1841400640 1 -- 172.21.15.137:0/4018964874 shutdown_connections 2024-04-26T23:42:18.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.436+0000 7f1841400640 1 -- 172.21.15.137:0/4018964874 wait complete. 2024-04-26T23:42:18.461 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-26T23:42:18.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.640+0000 7fc2a0a00640 1 Processor -- start 2024-04-26T23:42:18.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.640+0000 7fc2a0a00640 1 -- start start 2024-04-26T23:42:18.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.640+0000 7fc2a0a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc29c0d3270 0x7fc29c0d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.640+0000 7fc2a0a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc29c06c400 0x7fc29c0b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.640+0000 7fc2a0a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc29c0b44e0 con 0x7fc29c0cee50 2024-04-26T23:42:18.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.640+0000 7fc2a0a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc29c0d1f50 con 0x7fc29c0d3270 2024-04-26T23:42:18.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.640+0000 7fc2a0a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc29c0d1340 con 0x7fc29c06c400 2024-04-26T23:42:18.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.640+0000 7fc29aa00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc29c0d3270 0x7fc29c0d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.640+0000 7fc29b400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc29c0cee50 0x7fc29c0d2b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48160/0 (socket says 172.21.15.137:48160) 2024-04-26T23:42:18.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.640+0000 7fc29aa00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc29c0d3270 0x7fc29c0d0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53506/0 (socket says 172.21.15.137:53506) 2024-04-26T23:42:18.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.640+0000 7fc29b400640 1 -- 172.21.15.137:0/956267102 learned_addr learned my addr 172.21.15.137:0/956267102 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:18.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.640+0000 7fc29aa00640 1 -- 172.21.15.137:0/956267102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc29c06c400 msgr2=0x7fc29c0b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:18.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.640+0000 7fc29aa00640 1 --2- 172.21.15.137:0/956267102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc29c06c400 0x7fc29c0b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.640+0000 7fc29aa00640 1 -- 172.21.15.137:0/956267102 >> v1:172.21.15.137:6789/0 conn(0x7fc29c0cee50 legacy=0x7fc29c0d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.640+0000 7fc29aa00640 1 -- 172.21.15.137:0/956267102 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29c0d1620 con 0x7fc29c0d3270 2024-04-26T23:42:18.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.644+0000 7fc29aa00640 1 --2- 172.21.15.137:0/956267102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc29c0d3270 0x7fc29c0d0cc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc2880097c0 tx=0x7fc28801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ebb53051db9354 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:18.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.644+0000 7fc29a000640 1 -- 172.21.15.137:0/956267102 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2880b0070 con 0x7fc29c0d3270 2024-04-26T23:42:18.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.644+0000 7fc29a000640 1 -- 172.21.15.137:0/956267102 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2880ab600 con 0x7fc29c0d3270 2024-04-26T23:42:18.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.644+0000 7fc29a000640 1 -- 172.21.15.137:0/956267102 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2880ab9d0 con 0x7fc29c0d3270 2024-04-26T23:42:18.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.644+0000 7fc2a0a00640 1 -- 172.21.15.137:0/956267102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc29c0d3270 msgr2=0x7fc29c0d0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.644+0000 7fc2a0a00640 1 --2- 172.21.15.137:0/956267102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc29c0d3270 0x7fc29c0d0cc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc2880097c0 tx=0x7fc28801c410 comp rx=0 tx=0).stop 2024-04-26T23:42:18.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.644+0000 7fc2a0a00640 1 -- 172.21.15.137:0/956267102 shutdown_connections 2024-04-26T23:42:18.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.644+0000 7fc2a0a00640 1 --2- 172.21.15.137:0/956267102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc29c06c400 0x7fc29c0b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.644+0000 7fc2a0a00640 1 --2- 172.21.15.137:0/956267102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc29c0d3270 0x7fc29c0d0cc0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.644+0000 7fc2a0a00640 1 -- 172.21.15.137:0/956267102 >> 172.21.15.137:0/956267102 conn(0x7fc29c09ba60 msgr2=0x7fc29c09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:18.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.644+0000 7fc2a0a00640 1 -- 172.21.15.137:0/956267102 shutdown_connections 2024-04-26T23:42:18.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.644+0000 7fc2a0a00640 1 -- 172.21.15.137:0/956267102 wait complete. 2024-04-26T23:42:18.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.644+0000 7fc2a0a00640 1 Processor -- start 2024-04-26T23:42:18.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.644+0000 7fc2a0a00640 1 -- start start 2024-04-26T23:42:18.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc2a0a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc29c06c400 0x7fc29c160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc2a0a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc29c0cee50 0x7fc29c15ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc2a0a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc29c0d3270 0x7fc29c15b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc2a0a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c0b3e50 con 0x7fc29c06c400 2024-04-26T23:42:18.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc2a0a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c0b3cd0 con 0x7fc29c0cee50 2024-04-26T23:42:18.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc2a0a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc29c16bcd0 con 0x7fc29c0d3270 2024-04-26T23:42:18.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc29b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc29c06c400 0x7fc29c160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc29b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc29c06c400 0x7fc29c160ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53522/0 (socket says 172.21.15.137:53522) 2024-04-26T23:42:18.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc29b400640 1 -- 172.21.15.137:0/954351906 learned_addr learned my addr 172.21.15.137:0/954351906 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:18.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc29be00640 1 --2- 172.21.15.137:0/954351906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc29c0d3270 0x7fc29c15b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc29aa00640 1 --2- 172.21.15.137:0/954351906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc29c0cee50 0x7fc29c15ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc29b400640 1 -- 172.21.15.137:0/954351906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc29c0d3270 msgr2=0x7fc29c15b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc29b400640 1 --2- 172.21.15.137:0/954351906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc29c0d3270 0x7fc29c15b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc29b400640 1 -- 172.21.15.137:0/954351906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc29c0cee50 msgr2=0x7fc29c15ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc29b400640 1 --2- 172.21.15.137:0/954351906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc29c0cee50 0x7fc29c15ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc29b400640 1 -- 172.21.15.137:0/954351906 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29c15b710 con 0x7fc29c06c400 2024-04-26T23:42:18.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc29be00640 1 --2- 172.21.15.137:0/954351906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc29c0d3270 0x7fc29c15b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:18.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc29aa00640 1 --2- 172.21.15.137:0/954351906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc29c0cee50 0x7fc29c15ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:18.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc29b400640 1 --2- 172.21.15.137:0/954351906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc29c06c400 0x7fc29c160ac0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc28c00c370 tx=0x7fc28c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:18.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc293400640 1 -- 172.21.15.137:0/954351906 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28c017070 con 0x7fc29c06c400 2024-04-26T23:42:18.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc293400640 1 -- 172.21.15.137:0/954351906 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc28c005cf0 con 0x7fc29c06c400 2024-04-26T23:42:18.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc293400640 1 -- 172.21.15.137:0/954351906 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28c0072f0 con 0x7fc29c06c400 2024-04-26T23:42:18.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc2a0a00640 1 -- 172.21.15.137:0/954351906 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc29c1611b0 con 0x7fc29c06c400 2024-04-26T23:42:18.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc2a0a00640 1 -- 172.21.15.137:0/954351906 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc29c1619f0 con 0x7fc29c06c400 2024-04-26T23:42:18.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc2a0a00640 1 -- 172.21.15.137:0/954351906 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc29c06a410 con 0x7fc29c06c400 2024-04-26T23:42:18.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.648+0000 7fc293400640 1 -- 172.21.15.137:0/954351906 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc28c01a070 con 0x7fc29c06c400 2024-04-26T23:42:18.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.652+0000 7fc293400640 1 --2- 172.21.15.137:0/954351906 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc27c068380 0x7fc27c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.652+0000 7fc293400640 1 -- 172.21.15.137:0/954351906 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fc28c085aa0 con 0x7fc29c06c400 2024-04-26T23:42:18.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.652+0000 7fc29aa00640 1 --2- 172.21.15.137:0/954351906 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc27c068380 0x7fc27c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.652+0000 7fc29aa00640 1 --2- 172.21.15.137:0/954351906 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc27c068380 0x7fc27c06a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc2880ad000 tx=0x7fc2880a4f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:18.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.656+0000 7fc293400640 1 -- 172.21.15.137:0/954351906 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc29c1611b0 con 0x7fc29c06c400 2024-04-26T23:42:18.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.864+0000 7fc2a0a00640 1 -- 172.21.15.137:0/954351906 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fc29c0698f0 con 0x7fc29c06c400 2024-04-26T23:42:18.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.864+0000 7fc293400640 1 -- 172.21.15.137:0/954351906 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v5) ==== 80+0+6645 (secure 0 0 0) 0x7fc28c056310 con 0x7fc29c06c400 2024-04-26T23:42:18.871 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:18.871 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:42:18.871 INFO:teuthology.orchestra.run.smithi137.stdout: "auth_dump": [ 2024-04-26T23:42:18.871 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.871 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.a", 2024-04-26T23:42:18.871 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBkOyxm8fEFJhAApnO8C5VzrzRze2CXBFDX+w==", 2024-04-26T23:42:18.871 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.871 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:42:18.871 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T23:42:18.871 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T23:42:18.872 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:42:18.872 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.872 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.872 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.b", 2024-04-26T23:42:18.872 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBkOyxmcIXMMRAAbatu788GHajE0CeUmSfG6g==", 2024-04-26T23:42:18.872 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.872 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:42:18.872 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T23:42:18.872 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T23:42:18.872 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:42:18.872 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.872 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.872 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.c", 2024-04-26T23:42:18.873 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBkOyxmxOM0LRAAqjFB1cWhxjLMmH2Hw08y4Q==", 2024-04-26T23:42:18.873 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.873 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:42:18.873 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T23:42:18.873 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T23:42:18.873 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:42:18.873 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.873 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.873 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.873 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.d", 2024-04-26T23:42:18.873 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBkOyxmtB0QORAA4pb1qkARdVDYWtrlHHLM8A==", 2024-04-26T23:42:18.873 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.873 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:42:18.873 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T23:42:18.873 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T23:42:18.874 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:42:18.874 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.874 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.874 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.874 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.0", 2024-04-26T23:42:18.874 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBoOyxmBpUlARAAFTI893hK3CG+M43N95QY0Q==", 2024-04-26T23:42:18.874 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.874 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:42:18.874 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:42:18.874 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:42:18.874 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.874 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.874 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.874 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.1", 2024-04-26T23:42:18.874 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBrOyxmOKoBDRAAEKl+f5dgrhKsrw9GLl/aZg==", 2024-04-26T23:42:18.875 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.875 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:42:18.875 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:42:18.875 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:42:18.875 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.875 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.2", 2024-04-26T23:42:18.875 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBuOyxmRCxpFxAAiugbUkmCpSi3PpcfSIqzag==", 2024-04-26T23:42:18.875 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.875 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:42:18.875 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:42:18.875 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:42:18.875 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.876 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.876 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.3", 2024-04-26T23:42:18.876 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBxOyxmAVDRHxAAn16e0bzh8lMn7IfompY4tg==", 2024-04-26T23:42:18.876 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.876 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:42:18.876 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:42:18.876 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:42:18.876 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.876 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.876 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.4", 2024-04-26T23:42:18.876 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQB1OyxmBaU+MRAADSzfJp0HfnkgWh57F6vmGw==", 2024-04-26T23:42:18.876 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.876 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:42:18.877 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:42:18.877 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:42:18.877 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.877 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.877 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.877 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.5", 2024-04-26T23:42:18.877 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQB4OyxmFhNFOhAAIqlQNOvaL8EMnodLeQMhDw==", 2024-04-26T23:42:18.877 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.877 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:42:18.877 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:42:18.877 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:42:18.877 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.877 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.877 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.878 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.6", 2024-04-26T23:42:18.878 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQB8Oyxm1y03BxAAZaVKAAMQ8CgZxR9QOSmmxg==", 2024-04-26T23:42:18.878 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.878 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:42:18.878 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:42:18.878 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:42:18.878 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.878 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.878 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.7", 2024-04-26T23:42:18.878 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQB/Oyxmnl5HERAAzW6LvTGUe02XbfzKUdE9Ww==", 2024-04-26T23:42:18.878 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.878 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:42:18.878 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:42:18.879 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:42:18.879 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.879 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.0", 2024-04-26T23:42:18.879 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBlOyxmNsaKARAAi0ecpgpB9GUVCXS04Xi03g==", 2024-04-26T23:42:18.879 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.879 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:42:18.879 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T23:42:18.879 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T23:42:18.879 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T23:42:18.879 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.880 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.1", 2024-04-26T23:42:18.880 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBlOyxmZdztChAA5CqZN408iUQConPiWOpzNA==", 2024-04-26T23:42:18.880 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.880 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:42:18.880 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T23:42:18.880 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T23:42:18.880 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T23:42:18.880 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.880 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.880 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.2", 2024-04-26T23:42:18.880 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBlOyxmtliOBxAADAAo7qWwq7kTIiAzKhdSEw==", 2024-04-26T23:42:18.880 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.880 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:42:18.880 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T23:42:18.881 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T23:42:18.881 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T23:42:18.881 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.881 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.881 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.3", 2024-04-26T23:42:18.881 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBlOyxmY+nwEBAAwfSl/XoOGWEecTT5NKOaUQ==", 2024-04-26T23:42:18.881 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.881 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:42:18.881 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T23:42:18.881 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T23:42:18.881 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T23:42:18.881 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.881 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.881 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.admin", 2024-04-26T23:42:18.881 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBkOyxmhPUIChAA9/bw/6JVN8b4Qg3isTXsuw==", 2024-04-26T23:42:18.882 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.882 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T23:42:18.882 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T23:42:18.882 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T23:42:18.882 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:42:18.882 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.882 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.bootstrap-mds", 2024-04-26T23:42:18.882 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQCKOyxmdbn4IRAA5kpd5/FKOUd437VohZkEfQ==", 2024-04-26T23:42:18.882 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.882 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile bootstrap-mds" 2024-04-26T23:42:18.882 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.883 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.bootstrap-mgr", 2024-04-26T23:42:18.883 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQCKOyxm08b4IRAAEaRWgaaSsRQ79DP4IMTF5g==", 2024-04-26T23:42:18.883 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.883 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-26T23:42:18.883 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.883 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.bootstrap-osd", 2024-04-26T23:42:18.883 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQCKOyxm7c/4IRAAoUOsaJNnXEIzFvjt5HJj6Q==", 2024-04-26T23:42:18.883 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.883 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile bootstrap-osd" 2024-04-26T23:42:18.883 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.884 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.bootstrap-rbd", 2024-04-26T23:42:18.884 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQCKOyxmKt74IRAA6/1j9t8kGyBOEBDhgFQTjQ==", 2024-04-26T23:42:18.884 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.884 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-26T23:42:18.884 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.884 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-26T23:42:18.884 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQCKOyxmFOf4IRAAr+yz6oSiqiVAfbxBznvVYA==", 2024-04-26T23:42:18.884 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.884 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-26T23:42:18.884 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.885 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.bootstrap-rgw", 2024-04-26T23:42:18.885 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQCKOyxmMfD4IRAAA3Ups5GrfFNenxVcxWESVQ==", 2024-04-26T23:42:18.885 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.885 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-26T23:42:18.885 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.885 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mgr.x", 2024-04-26T23:42:18.885 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBkOyxmXYSgIRAAYsHzI8tb+DSiNPdNJxRDag==", 2024-04-26T23:42:18.885 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.885 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T23:42:18.885 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile mgr", 2024-04-26T23:42:18.885 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:42:18.885 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:18.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:18.886 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mgr.y", 2024-04-26T23:42:18.886 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBkOyxmdEIZHhAAPO3gVpDHmMunKrxtjSmYxw==", 2024-04-26T23:42:18.886 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:42:18.886 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T23:42:18.886 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile mgr", 2024-04-26T23:42:18.886 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:42:18.886 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.886 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:18.886 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-26T23:42:18.886 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:42:18.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.868+0000 7fc2a0a00640 1 -- 172.21.15.137:0/954351906 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc27c068380 msgr2=0x7fc27c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.868+0000 7fc2a0a00640 1 --2- 172.21.15.137:0/954351906 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc27c068380 0x7fc27c06a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc2880ad000 tx=0x7fc2880a4f90 comp rx=0 tx=0).stop 2024-04-26T23:42:18.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.868+0000 7fc2a0a00640 1 -- 172.21.15.137:0/954351906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc29c06c400 msgr2=0x7fc29c160ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.868+0000 7fc2a0a00640 1 --2- 172.21.15.137:0/954351906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc29c06c400 0x7fc29c160ac0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc28c00c370 tx=0x7fc28c00c830 comp rx=0 tx=0).stop 2024-04-26T23:42:18.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.868+0000 7fc2a0a00640 1 -- 172.21.15.137:0/954351906 shutdown_connections 2024-04-26T23:42:18.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.868+0000 7fc2a0a00640 1 --2- 172.21.15.137:0/954351906 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc27c068380 0x7fc27c06a840 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.868+0000 7fc2a0a00640 1 --2- 172.21.15.137:0/954351906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc29c0d3270 0x7fc29c15b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.868+0000 7fc2a0a00640 1 --2- 172.21.15.137:0/954351906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc29c0cee50 0x7fc29c15ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.868+0000 7fc2a0a00640 1 --2- 172.21.15.137:0/954351906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc29c06c400 0x7fc29c160ac0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.868+0000 7fc2a0a00640 1 -- 172.21.15.137:0/954351906 >> 172.21.15.137:0/954351906 conn(0x7fc29c09ba60 msgr2=0x7fc29c15f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:18.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.868+0000 7fc2a0a00640 1 -- 172.21.15.137:0/954351906 shutdown_connections 2024-04-26T23:42:18.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:18.868+0000 7fc2a0a00640 1 -- 172.21.15.137:0/954351906 wait complete. 2024-04-26T23:42:18.892 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-26T23:42:19.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.024+0000 7f18c6200640 1 Processor -- start 2024-04-26T23:42:19.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.024+0000 7f18c6200640 1 -- start start 2024-04-26T23:42:19.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.024+0000 7f18c6200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18c00725a0 0x7f18c00cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:19.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.024+0000 7f18c6200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f18c0073f30 0x7f18c0072980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:19.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.024+0000 7f18c6200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f18c0072ec0 0x7f18c00b4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:19.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.024+0000 7f18c6200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f18c00cfef0 con 0x7f18c0073f30 2024-04-26T23:42:19.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.024+0000 7f18c6200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f18c00cddc0 con 0x7f18c0072ec0 2024-04-26T23:42:19.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.024+0000 7f18c6200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f18c00d01b0 con 0x7f18c00725a0 2024-04-26T23:42:19.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.024+0000 7f18bea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f18c0073f30 0x7f18c0072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:19.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.024+0000 7f18bea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f18c0073f30 0x7f18c0072980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53528/0 (socket says 172.21.15.137:53528) 2024-04-26T23:42:19.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.024+0000 7f18bea00640 1 -- 172.21.15.137:0/2411506907 learned_addr learned my addr 172.21.15.137:0/2411506907 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:19.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.024+0000 7f18bf400640 1 --2- 172.21.15.137:0/2411506907 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18c00725a0 0x7f18c00cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:19.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.024+0000 7f18bfe00640 1 --2- 172.21.15.137:0/2411506907 >> v2:172.21.15.170:3300/0 conn(0x7f18c0072ec0 0x7f18c00b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:19.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.024+0000 7f18bea00640 1 -- 172.21.15.137:0/2411506907 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18c00725a0 msgr2=0x7f18c00cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:19.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.024+0000 7f18bea00640 1 --2- 172.21.15.137:0/2411506907 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18c00725a0 0x7f18c00cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.024+0000 7f18bea00640 1 -- 172.21.15.137:0/2411506907 >> v2:172.21.15.170:3300/0 conn(0x7f18c0072ec0 msgr2=0x7f18c00b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:19.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.024+0000 7f18bea00640 1 --2- 172.21.15.137:0/2411506907 >> v2:172.21.15.170:3300/0 conn(0x7f18c0072ec0 0x7f18c00b4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.024+0000 7f18bea00640 1 -- 172.21.15.137:0/2411506907 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c00d0490 con 0x7f18c0073f30 2024-04-26T23:42:19.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.028+0000 7f18bea00640 1 --2- 172.21.15.137:0/2411506907 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18c0073f30 0x7f18c0072980 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f18c00ce960 tx=0x7f18ac01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a72b49617c8d71 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:19.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.028+0000 7f18be000640 1 -- 172.21.15.137:0/2411506907 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac0aa430 con 0x7f18c0073f30 2024-04-26T23:42:19.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.028+0000 7f18be000640 1 -- 172.21.15.137:0/2411506907 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18ac0af070 con 0x7f18c0073f30 2024-04-26T23:42:19.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.028+0000 7f18be000640 1 -- 172.21.15.137:0/2411506907 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac0aa7f0 con 0x7f18c0073f30 2024-04-26T23:42:19.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.028+0000 7f18c6200640 1 -- 172.21.15.137:0/2411506907 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18c0073f30 msgr2=0x7f18c0072980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:19.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.028+0000 7f18c6200640 1 --2- 172.21.15.137:0/2411506907 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18c0073f30 0x7f18c0072980 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f18c00ce960 tx=0x7f18ac01c4f0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.028+0000 7f18c6200640 1 -- 172.21.15.137:0/2411506907 shutdown_connections 2024-04-26T23:42:19.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.028+0000 7f18c6200640 1 --2- 172.21.15.137:0/2411506907 >> v2:172.21.15.170:3300/0 conn(0x7f18c0072ec0 0x7f18c00b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.028+0000 7f18c6200640 1 --2- 172.21.15.137:0/2411506907 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18c0073f30 0x7f18c0072980 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.028+0000 7f18c6200640 1 --2- 172.21.15.137:0/2411506907 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18c00725a0 0x7f18c00cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.028+0000 7f18c6200640 1 -- 172.21.15.137:0/2411506907 >> 172.21.15.137:0/2411506907 conn(0x7f18c006c5d0 msgr2=0x7f18c006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:19.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.028+0000 7f18c6200640 1 -- 172.21.15.137:0/2411506907 shutdown_connections 2024-04-26T23:42:19.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.028+0000 7f18c6200640 1 -- 172.21.15.137:0/2411506907 wait complete. 2024-04-26T23:42:19.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18c6200640 1 Processor -- start 2024-04-26T23:42:19.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18c6200640 1 -- start start 2024-04-26T23:42:19.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18c6200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18c00725a0 0x7f18c015c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:19.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18c6200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18c0072ec0 0x7f18c0159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:19.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18c6200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18c0073f30 0x7f18c013bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:19.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18c6200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f18c00b4f40 con 0x7f18c0072ec0 2024-04-26T23:42:19.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18c6200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f18c00b4dc0 con 0x7f18c00725a0 2024-04-26T23:42:19.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18c6200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f18c00b50c0 con 0x7f18c0073f30 2024-04-26T23:42:19.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18bea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18c0072ec0 0x7f18c0159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:19.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18bea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18c0072ec0 0x7f18c0159be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53542/0 (socket says 172.21.15.137:53542) 2024-04-26T23:42:19.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18bea00640 1 -- 172.21.15.137:0/3253614919 learned_addr learned my addr 172.21.15.137:0/3253614919 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:19.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18bf400640 1 --2- 172.21.15.137:0/3253614919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18c00725a0 0x7f18c015c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:19.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18bfe00640 1 --2- 172.21.15.137:0/3253614919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18c0073f30 0x7f18c013bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:19.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18bea00640 1 -- 172.21.15.137:0/3253614919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18c0073f30 msgr2=0x7f18c013bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:19.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18bea00640 1 --2- 172.21.15.137:0/3253614919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18c0073f30 0x7f18c013bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18bea00640 1 -- 172.21.15.137:0/3253614919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18c00725a0 msgr2=0x7f18c015c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:19.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18bea00640 1 --2- 172.21.15.137:0/3253614919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18c00725a0 0x7f18c015c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18bea00640 1 -- 172.21.15.137:0/3253614919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c013e470 con 0x7f18c0072ec0 2024-04-26T23:42:19.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18bea00640 1 --2- 172.21.15.137:0/3253614919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18c0072ec0 0x7f18c0159be0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f18ac01cd90 tx=0x7f18ac01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:19.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18b7400640 1 -- 172.21.15.137:0/3253614919 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac0bd5f0 con 0x7f18c0072ec0 2024-04-26T23:42:19.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18b7400640 1 -- 172.21.15.137:0/3253614919 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18ac0bd7b0 con 0x7f18c0072ec0 2024-04-26T23:42:19.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18b7400640 1 -- 172.21.15.137:0/3253614919 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac0bdba0 con 0x7f18c0072ec0 2024-04-26T23:42:19.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18c6200640 1 -- 172.21.15.137:0/3253614919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c013e750 con 0x7f18c0072ec0 2024-04-26T23:42:19.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18c6200640 1 -- 172.21.15.137:0/3253614919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c013ea30 con 0x7f18c0072ec0 2024-04-26T23:42:19.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.032+0000 7f18c6200640 1 -- 172.21.15.137:0/3253614919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c006a4b0 con 0x7f18c0072ec0 2024-04-26T23:42:19.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.036+0000 7f18b7400640 1 -- 172.21.15.137:0/3253614919 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f18ac0b33f0 con 0x7f18c0072ec0 2024-04-26T23:42:19.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.036+0000 7f18b7400640 1 --2- 172.21.15.137:0/3253614919 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f18a00683b0 0x7f18a006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:19.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.036+0000 7f18b7400640 1 -- 172.21.15.137:0/3253614919 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f18ac120640 con 0x7f18c0072ec0 2024-04-26T23:42:19.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.036+0000 7f18bf400640 1 --2- 172.21.15.137:0/3253614919 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f18a00683b0 0x7f18a006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:19.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.036+0000 7f18bf400640 1 --2- 172.21.15.137:0/3253614919 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f18a00683b0 0x7f18a006a870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f18b00079c0 tx=0x7f18b0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:19.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.040+0000 7f18b7400640 1 -- 172.21.15.137:0/3253614919 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f18ac016110 con 0x7f18c0072ec0 2024-04-26T23:42:19.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.252+0000 7f18c6200640 1 -- 172.21.15.137:0/3253614919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f18c0072380 con 0x7f18c0072ec0 2024-04-26T23:42:19.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.256+0000 7f18b7400640 1 -- 172.21.15.137:0/3253614919 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f18ac0f0860 con 0x7f18c0072ec0 2024-04-26T23:42:19.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.256+0000 7f18c6200640 1 -- 172.21.15.137:0/3253614919 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f18a00683b0 msgr2=0x7f18a006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:19.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.256+0000 7f18c6200640 1 --2- 172.21.15.137:0/3253614919 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f18a00683b0 0x7f18a006a870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f18b00079c0 tx=0x7f18b0008040 comp rx=0 tx=0).stop 2024-04-26T23:42:19.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.256+0000 7f18c6200640 1 -- 172.21.15.137:0/3253614919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18c0072ec0 msgr2=0x7f18c0159be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:19.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.256+0000 7f18c6200640 1 --2- 172.21.15.137:0/3253614919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18c0072ec0 0x7f18c0159be0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f18ac01cd90 tx=0x7f18ac01ad30 comp rx=0 tx=0).stop 2024-04-26T23:42:19.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.256+0000 7f18c6200640 1 -- 172.21.15.137:0/3253614919 shutdown_connections 2024-04-26T23:42:19.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.256+0000 7f18c6200640 1 --2- 172.21.15.137:0/3253614919 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f18a00683b0 0x7f18a006a870 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.256+0000 7f18c6200640 1 --2- 172.21.15.137:0/3253614919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18c0072ec0 0x7f18c0159be0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.256+0000 7f18c6200640 1 --2- 172.21.15.137:0/3253614919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18c0073f30 0x7f18c013bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.256+0000 7f18c6200640 1 --2- 172.21.15.137:0/3253614919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18c00725a0 0x7f18c015c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.256+0000 7f18c6200640 1 -- 172.21.15.137:0/3253614919 >> 172.21.15.137:0/3253614919 conn(0x7f18c006c5d0 msgr2=0x7f18c0141920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:19.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.256+0000 7f18c6200640 1 -- 172.21.15.137:0/3253614919 shutdown_connections 2024-04-26T23:42:19.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.256+0000 7f18c6200640 1 -- 172.21.15.137:0/3253614919 wait complete. 2024-04-26T23:42:19.281 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-26T23:42:19.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.412+0000 7fd3ad400640 1 Processor -- start 2024-04-26T23:42:19.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.412+0000 7fd3ad400640 1 -- start start 2024-04-26T23:42:19.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.412+0000 7fd3ad400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd3a8146920 0x7fd3a8073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:19.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.412+0000 7fd3ad400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3a8073010 con 0x7fd3a80ce3e0 2024-04-26T23:42:19.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.412+0000 7fd3ad400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3a80cef90 con 0x7fd3a815de80 2024-04-26T23:42:19.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.412+0000 7fd3ad400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd3a8073280 con 0x7fd3a8146920 2024-04-26T23:42:19.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.412+0000 7fd3a7200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd3a8146920 0x7fd3a8073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:19.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.416+0000 7fd3a6800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fd3a80ce3e0 0x7fd3a80d04e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48176/0 (socket says 172.21.15.137:48176) 2024-04-26T23:42:19.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.416+0000 7fd3a6800640 1 -- 172.21.15.137:0/411836714 learned_addr learned my addr 172.21.15.137:0/411836714 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:19.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.416+0000 7fd3a7200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd3a8146920 0x7fd3a8073d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53548/0 (socket says 172.21.15.137:53548) 2024-04-26T23:42:19.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.416+0000 7fd3a7200640 1 -- 172.21.15.137:0/411836714 >> v1:172.21.15.170:6789/0 conn(0x7fd3a815de80 legacy=0x7fd3a8146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:19.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.416+0000 7fd3a7200640 1 -- 172.21.15.137:0/411836714 >> v1:172.21.15.137:6789/0 conn(0x7fd3a80ce3e0 legacy=0x7fd3a80d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:19.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.416+0000 7fd3a7200640 1 -- 172.21.15.137:0/411836714 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a8073560 con 0x7fd3a8146920 2024-04-26T23:42:19.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.416+0000 7fd3a7200640 1 --2- 172.21.15.137:0/411836714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3a8146920 0x7fd3a8073d60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0009dc0 tx=0x7fd3a001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3624dea684984a77 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:19.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.416+0000 7fd3a5e00640 1 -- 172.21.15.137:0/411836714 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a00b2070 con 0x7fd3a8146920 2024-04-26T23:42:19.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.416+0000 7fd3a5e00640 1 -- 172.21.15.137:0/411836714 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a00a59c0 con 0x7fd3a8146920 2024-04-26T23:42:19.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.416+0000 7fd3a5e00640 1 -- 172.21.15.137:0/411836714 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a00a5d90 con 0x7fd3a8146920 2024-04-26T23:42:19.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3ad400640 1 -- 172.21.15.137:0/411836714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3a8146920 msgr2=0x7fd3a8073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:19.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3ad400640 1 --2- 172.21.15.137:0/411836714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3a8146920 0x7fd3a8073d60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0009dc0 tx=0x7fd3a001c8e0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3ad400640 1 -- 172.21.15.137:0/411836714 shutdown_connections 2024-04-26T23:42:19.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3ad400640 1 --2- 172.21.15.137:0/411836714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3a8146920 0x7fd3a8073d60 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3ad400640 1 -- 172.21.15.137:0/411836714 >> 172.21.15.137:0/411836714 conn(0x7fd3a806c5d0 msgr2=0x7fd3a806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:19.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3ad400640 1 -- 172.21.15.137:0/411836714 shutdown_connections 2024-04-26T23:42:19.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3ad400640 1 -- 172.21.15.137:0/411836714 wait complete. 2024-04-26T23:42:19.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3ad400640 1 Processor -- start 2024-04-26T23:42:19.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3ad400640 1 -- start start 2024-04-26T23:42:19.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3ad400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3a80ce3e0 0x7fd3a815bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:19.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3ad400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3a8146920 0x7fd3a815c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:19.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3ad400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3a815de80 0x7fd3a815c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:19.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3ad400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a806f0e0 con 0x7fd3a815de80 2024-04-26T23:42:19.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3ad400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a806ef60 con 0x7fd3a80ce3e0 2024-04-26T23:42:19.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3ad400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd3a806f260 con 0x7fd3a8146920 2024-04-26T23:42:19.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3a7200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3a815de80 0x7fd3a815c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:19.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3a7200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3a815de80 0x7fd3a815c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53552/0 (socket says 172.21.15.137:53552) 2024-04-26T23:42:19.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3a7200640 1 -- 172.21.15.137:0/2615867935 learned_addr learned my addr 172.21.15.137:0/2615867935 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:19.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3a6800640 1 --2- 172.21.15.137:0/2615867935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3a80ce3e0 0x7fd3a815bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:19.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd39de00640 1 --2- 172.21.15.137:0/2615867935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3a8146920 0x7fd3a815c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:19.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3a7200640 1 -- 172.21.15.137:0/2615867935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3a8146920 msgr2=0x7fd3a815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:19.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3a7200640 1 --2- 172.21.15.137:0/2615867935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3a8146920 0x7fd3a815c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3a7200640 1 -- 172.21.15.137:0/2615867935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3a80ce3e0 msgr2=0x7fd3a815bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:19.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3a7200640 1 --2- 172.21.15.137:0/2615867935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3a80ce3e0 0x7fd3a815bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.420+0000 7fd3a7200640 1 -- 172.21.15.137:0/2615867935 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a80b31e0 con 0x7fd3a815de80 2024-04-26T23:42:19.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.424+0000 7fd3a7200640 1 --2- 172.21.15.137:0/2615867935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3a815de80 0x7fd3a815c7e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd3a001a510 tx=0x7fd3a0019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:19.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.424+0000 7fd39f400640 1 -- 172.21.15.137:0/2615867935 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a00b2050 con 0x7fd3a815de80 2024-04-26T23:42:19.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.424+0000 7fd39f400640 1 -- 172.21.15.137:0/2615867935 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a00be070 con 0x7fd3a815de80 2024-04-26T23:42:19.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.424+0000 7fd39f400640 1 -- 172.21.15.137:0/2615867935 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a00adbd0 con 0x7fd3a815de80 2024-04-26T23:42:19.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.424+0000 7fd3ad400640 1 -- 172.21.15.137:0/2615867935 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3a8143850 con 0x7fd3a815de80 2024-04-26T23:42:19.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.424+0000 7fd3ad400640 1 -- 172.21.15.137:0/2615867935 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3a815b6b0 con 0x7fd3a815de80 2024-04-26T23:42:19.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.424+0000 7fd3ad400640 1 -- 172.21.15.137:0/2615867935 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3a806a4b0 con 0x7fd3a815de80 2024-04-26T23:42:19.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.424+0000 7fd39f400640 1 -- 172.21.15.137:0/2615867935 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd3a00c3460 con 0x7fd3a815de80 2024-04-26T23:42:19.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.424+0000 7fd39f400640 1 --2- 172.21.15.137:0/2615867935 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd384068380 0x7fd38406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:19.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.424+0000 7fd39f400640 1 -- 172.21.15.137:0/2615867935 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fd3a0121b90 con 0x7fd3a815de80 2024-04-26T23:42:19.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.424+0000 7fd3a6800640 1 --2- 172.21.15.137:0/2615867935 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd384068380 0x7fd38406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:19.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.428+0000 7fd3a6800640 1 --2- 172.21.15.137:0/2615867935 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd384068380 0x7fd38406a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd3a815f270 tx=0x7fd398007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:19.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.428+0000 7fd39f400640 1 -- 172.21.15.137:0/2615867935 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd3a0016500 con 0x7fd3a815de80 2024-04-26T23:42:19.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.648+0000 7fd3ad400640 1 -- 172.21.15.137:0/2615867935 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fd3a8072170 con 0x7fd3a815de80 2024-04-26T23:42:19.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.648+0000 7fd39f400640 1 -- 172.21.15.137:0/2615867935 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7fd3a00f1f80 con 0x7fd3a815de80 2024-04-26T23:42:19.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.652+0000 7fd3ad400640 1 -- 172.21.15.137:0/2615867935 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd384068380 msgr2=0x7fd38406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:19.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.652+0000 7fd3ad400640 1 --2- 172.21.15.137:0/2615867935 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd384068380 0x7fd38406a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd3a815f270 tx=0x7fd398007e90 comp rx=0 tx=0).stop 2024-04-26T23:42:19.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.652+0000 7fd3ad400640 1 -- 172.21.15.137:0/2615867935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3a815de80 msgr2=0x7fd3a815c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:19.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.652+0000 7fd3ad400640 1 --2- 172.21.15.137:0/2615867935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3a815de80 0x7fd3a815c7e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd3a001a510 tx=0x7fd3a0019680 comp rx=0 tx=0).stop 2024-04-26T23:42:19.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.652+0000 7fd3ad400640 1 -- 172.21.15.137:0/2615867935 shutdown_connections 2024-04-26T23:42:19.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.652+0000 7fd3ad400640 1 --2- 172.21.15.137:0/2615867935 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd384068380 0x7fd38406a840 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.652+0000 7fd3ad400640 1 --2- 172.21.15.137:0/2615867935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3a815de80 0x7fd3a815c7e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.652+0000 7fd3ad400640 1 --2- 172.21.15.137:0/2615867935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3a8146920 0x7fd3a815c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.652+0000 7fd3ad400640 1 --2- 172.21.15.137:0/2615867935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3a80ce3e0 0x7fd3a815bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.652+0000 7fd3ad400640 1 -- 172.21.15.137:0/2615867935 >> 172.21.15.137:0/2615867935 conn(0x7fd3a806c5d0 msgr2=0x7fd3a80d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:19.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.652+0000 7fd3ad400640 1 -- 172.21.15.137:0/2615867935 shutdown_connections 2024-04-26T23:42:19.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.652+0000 7fd3ad400640 1 -- 172.21.15.137:0/2615867935 wait complete. 2024-04-26T23:42:19.676 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-26T23:42:19.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.808+0000 7fab2ca00640 1 Processor -- start 2024-04-26T23:42:19.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.808+0000 7fab2ca00640 1 -- start start 2024-04-26T23:42:19.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.808+0000 7fab2ca00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fab28162de0 0x7fab28163260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:19.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.808+0000 7fab2ca00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab280b2b60 0x7fab280b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:19.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.808+0000 7fab2ca00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab280b64f0 con 0x7fab28159750 2024-04-26T23:42:19.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.808+0000 7fab2ca00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fab280ae1d0 con 0x7fab28162de0 2024-04-26T23:42:19.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.808+0000 7fab2ca00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fab280b48e0 con 0x7fab280b2b60 2024-04-26T23:42:19.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab25e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fab28159750 0x7fab280b5de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48190/0 (socket says 172.21.15.137:48190) 2024-04-26T23:42:19.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab25e00640 1 -- 172.21.15.137:0/2300084724 learned_addr learned my addr 172.21.15.137:0/2300084724 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:19.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab24a00640 1 -- 172.21.15.137:0/2300084724 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4228273765 0 0) 0x7fab280b64f0 con 0x7fab28159750 2024-04-26T23:42:19.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab25400640 1 --2- 172.21.15.137:0/2300084724 >> v2:172.21.15.170:3300/0 conn(0x7fab28162de0 0x7fab28163260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:19.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab26800640 1 --2- 172.21.15.137:0/2300084724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab280b2b60 0x7fab280b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:19.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab24a00640 1 -- 172.21.15.137:0/2300084724 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab0c003530 con 0x7fab28159750 2024-04-26T23:42:19.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab24a00640 1 -- 172.21.15.137:0/2300084724 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1637987311 0 0) 0x7fab0c003530 con 0x7fab28159750 2024-04-26T23:42:19.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab24a00640 1 -- 172.21.15.137:0/2300084724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab280b2b60 msgr2=0x7fab280b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:19.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab24a00640 1 --2- 172.21.15.137:0/2300084724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab280b2b60 0x7fab280b2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab24a00640 1 -- 172.21.15.137:0/2300084724 >> v2:172.21.15.170:3300/0 conn(0x7fab28162de0 msgr2=0x7fab28163260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:19.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab24a00640 1 --2- 172.21.15.137:0/2300084724 >> v2:172.21.15.170:3300/0 conn(0x7fab28162de0 0x7fab28163260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab24a00640 1 -- 172.21.15.137:0/2300084724 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab280d1f30 con 0x7fab28159750 2024-04-26T23:42:19.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab24a00640 1 -- 172.21.15.137:0/2300084724 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fab18001680 con 0x7fab28159750 2024-04-26T23:42:19.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab24a00640 1 -- 172.21.15.137:0/2300084724 >> v1:172.21.15.137:6789/0 conn(0x7fab28159750 legacy=0x7fab280b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:19.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab24a00640 1 --2- 172.21.15.137:0/2300084724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab0c0039c0 0x7fab0c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:19.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab24a00640 1 --2- 172.21.15.137:0/2300084724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab0c004810 0x7fab0c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:19.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab24a00640 1 --2- 172.21.15.137:0/2300084724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab280b2b60 0x7fab0c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:19.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab24a00640 1 -- 172.21.15.137:0/2300084724 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fab280b48e0 con 0x7fab0c004810 2024-04-26T23:42:19.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab24a00640 1 -- 172.21.15.137:0/2300084724 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c00b9d0 con 0x7fab0c0039c0 2024-04-26T23:42:19.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab24a00640 1 -- 172.21.15.137:0/2300084724 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fab0c00bb50 con 0x7fab280b2b60 2024-04-26T23:42:19.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab25400640 1 --2- 172.21.15.137:0/2300084724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab0c004810 0x7fab0c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:19.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab25e00640 1 --2- 172.21.15.137:0/2300084724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab0c0039c0 0x7fab0c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:19.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab26800640 1 --2- 172.21.15.137:0/2300084724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab280b2b60 0x7fab0c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:19.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab25400640 1 -- 172.21.15.137:0/2300084724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab280b2b60 msgr2=0x7fab0c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:19.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab25400640 1 --2- 172.21.15.137:0/2300084724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab280b2b60 0x7fab0c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab25400640 1 -- 172.21.15.137:0/2300084724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab0c0039c0 msgr2=0x7fab0c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:19.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab25400640 1 --2- 172.21.15.137:0/2300084724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab0c0039c0 0x7fab0c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.812+0000 7fab25400640 1 -- 172.21.15.137:0/2300084724 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab0c003530 con 0x7fab0c004810 2024-04-26T23:42:19.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.816+0000 7fab25400640 1 --2- 172.21.15.137:0/2300084724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab0c004810 0x7fab0c004c90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fab14009ae0 tx=0x7fab1401c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9658f8a2fcf5ade1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:19.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.816+0000 7fab24a00640 1 -- 172.21.15.137:0/2300084724 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab140b1070 con 0x7fab0c004810 2024-04-26T23:42:19.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.816+0000 7fab24a00640 1 -- 172.21.15.137:0/2300084724 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab140a4af0 con 0x7fab0c004810 2024-04-26T23:42:19.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.816+0000 7fab24a00640 1 -- 172.21.15.137:0/2300084724 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab140096b0 con 0x7fab0c004810 2024-04-26T23:42:19.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.816+0000 7fab2ca00640 1 -- 172.21.15.137:0/2300084724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab0c004810 msgr2=0x7fab0c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:19.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.816+0000 7fab2ca00640 1 --2- 172.21.15.137:0/2300084724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab0c004810 0x7fab0c004c90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fab14009ae0 tx=0x7fab1401c790 comp rx=0 tx=0).stop 2024-04-26T23:42:19.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.816+0000 7fab26800640 1 -- 172.21.15.137:0/2300084724 reap_dead start 2024-04-26T23:42:19.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.816+0000 7fab2ca00640 1 -- 172.21.15.137:0/2300084724 shutdown_connections 2024-04-26T23:42:19.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.816+0000 7fab2ca00640 1 -- 172.21.15.137:0/2300084724 >> 172.21.15.137:0/2300084724 conn(0x7fab280b6710 msgr2=0x7fab280b6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:19.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.816+0000 7fab2ca00640 1 -- 172.21.15.137:0/2300084724 shutdown_connections 2024-04-26T23:42:19.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.816+0000 7fab2ca00640 1 -- 172.21.15.137:0/2300084724 wait complete. 2024-04-26T23:42:19.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.816+0000 7fab2ca00640 1 Processor -- start 2024-04-26T23:42:19.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.816+0000 7fab2ca00640 1 -- start start 2024-04-26T23:42:19.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab2ca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab0c004810 0x7fab281f5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:19.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab2ca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab281558a0 0x7fab28152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:19.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab2ca00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab28153370 0x7fab281f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:19.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab2ca00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fab280b4570 con 0x7fab281558a0 2024-04-26T23:42:19.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab2ca00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fab280b4290 con 0x7fab0c004810 2024-04-26T23:42:19.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab2ca00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fab280d1890 con 0x7fab28153370 2024-04-26T23:42:19.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab25400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab281558a0 0x7fab28152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:19.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab25400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab281558a0 0x7fab28152e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53574/0 (socket says 172.21.15.137:53574) 2024-04-26T23:42:19.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab25400640 1 -- 172.21.15.137:0/3478524603 learned_addr learned my addr 172.21.15.137:0/3478524603 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:19.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab25e00640 1 --2- 172.21.15.137:0/3478524603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab0c004810 0x7fab281f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:19.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab26800640 1 --2- 172.21.15.137:0/3478524603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab28153370 0x7fab281f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:19.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab25400640 1 -- 172.21.15.137:0/3478524603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab28153370 msgr2=0x7fab281f4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:19.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab25400640 1 --2- 172.21.15.137:0/3478524603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab28153370 0x7fab281f4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab25400640 1 -- 172.21.15.137:0/3478524603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab0c004810 msgr2=0x7fab281f5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:19.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab25400640 1 --2- 172.21.15.137:0/3478524603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab0c004810 0x7fab281f5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:19.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab25400640 1 -- 172.21.15.137:0/3478524603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab28155d80 con 0x7fab281558a0 2024-04-26T23:42:19.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab25400640 1 --2- 172.21.15.137:0/3478524603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab281558a0 0x7fab28152e30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fab14009ae0 tx=0x7fab0c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:19.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab1e000640 1 -- 172.21.15.137:0/3478524603 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab140b1040 con 0x7fab281558a0 2024-04-26T23:42:19.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab1e000640 1 -- 172.21.15.137:0/3478524603 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab1400f000 con 0x7fab281558a0 2024-04-26T23:42:19.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab1e000640 1 -- 172.21.15.137:0/3478524603 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab140096b0 con 0x7fab281558a0 2024-04-26T23:42:19.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab2ca00640 1 -- 172.21.15.137:0/3478524603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab28156060 con 0x7fab281558a0 2024-04-26T23:42:19.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab2ca00640 1 -- 172.21.15.137:0/3478524603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab281f5100 con 0x7fab281558a0 2024-04-26T23:42:19.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab2ca00640 1 -- 172.21.15.137:0/3478524603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab2806a4b0 con 0x7fab281558a0 2024-04-26T23:42:19.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.820+0000 7fab1e000640 1 -- 172.21.15.137:0/3478524603 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fab140bf030 con 0x7fab281558a0 2024-04-26T23:42:19.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.824+0000 7fab1e000640 1 --2- 172.21.15.137:0/3478524603 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fab08068380 0x7fab0806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:19.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.824+0000 7fab1e000640 1 -- 172.21.15.137:0/3478524603 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fab1411fb80 con 0x7fab281558a0 2024-04-26T23:42:19.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.824+0000 7fab25e00640 1 --2- 172.21.15.137:0/3478524603 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fab08068380 0x7fab0806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:19.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.824+0000 7fab25e00640 1 --2- 172.21.15.137:0/3478524603 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fab08068380 0x7fab0806a840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fab280b7120 tx=0x7fab18007900 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:19.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:19.828+0000 7fab1e000640 1 -- 172.21.15.137:0/3478524603 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fab140c6060 con 0x7fab281558a0 2024-04-26T23:42:20.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.040+0000 7fab2ca00640 1 -- 172.21.15.137:0/3478524603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fab2806f2d0 con 0x7fab281558a0 2024-04-26T23:42:20.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.044+0000 7fab1e000640 1 -- 172.21.15.137:0/3478524603 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fab140167c0 con 0x7fab281558a0 2024-04-26T23:42:20.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.044+0000 7fab2ca00640 1 -- 172.21.15.137:0/3478524603 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fab08068380 msgr2=0x7fab0806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:20.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.044+0000 7fab2ca00640 1 --2- 172.21.15.137:0/3478524603 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fab08068380 0x7fab0806a840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fab280b7120 tx=0x7fab18007900 comp rx=0 tx=0).stop 2024-04-26T23:42:20.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.044+0000 7fab2ca00640 1 -- 172.21.15.137:0/3478524603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab281558a0 msgr2=0x7fab28152e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:20.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.044+0000 7fab2ca00640 1 --2- 172.21.15.137:0/3478524603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab281558a0 0x7fab28152e30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fab14009ae0 tx=0x7fab0c005840 comp rx=0 tx=0).stop 2024-04-26T23:42:20.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.044+0000 7fab2ca00640 1 -- 172.21.15.137:0/3478524603 shutdown_connections 2024-04-26T23:42:20.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.044+0000 7fab2ca00640 1 --2- 172.21.15.137:0/3478524603 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fab08068380 0x7fab0806a840 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.044+0000 7fab2ca00640 1 --2- 172.21.15.137:0/3478524603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab281558a0 0x7fab28152e30 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.044+0000 7fab2ca00640 1 --2- 172.21.15.137:0/3478524603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab28153370 0x7fab281f4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.044+0000 7fab2ca00640 1 --2- 172.21.15.137:0/3478524603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab0c004810 0x7fab281f5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.044+0000 7fab2ca00640 1 -- 172.21.15.137:0/3478524603 >> 172.21.15.137:0/3478524603 conn(0x7fab280b6710 msgr2=0x7fab2815e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:20.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.044+0000 7fab2ca00640 1 -- 172.21.15.137:0/3478524603 shutdown_connections 2024-04-26T23:42:20.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.044+0000 7fab2ca00640 1 -- 172.21.15.137:0/3478524603 wait complete. 2024-04-26T23:42:20.069 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-26T23:42:20.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.200+0000 7f6da0800640 1 Processor -- start 2024-04-26T23:42:20.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.200+0000 7f6da0800640 1 -- start start 2024-04-26T23:42:20.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.200+0000 7f6da0800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6d9806eff0 0x7f6d9815c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:20.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.200+0000 7f6da0800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6d98155c20 0x7f6d980ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:20.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.200+0000 7f6da0800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d980b3e30 con 0x7f6d980b5c90 2024-04-26T23:42:20.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.200+0000 7f6da0800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6d980d0850 con 0x7f6d9806eff0 2024-04-26T23:42:20.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.200+0000 7f6da0800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f6d9815ca00 con 0x7f6d98155c20 2024-04-26T23:42:20.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.200+0000 7f6d9de00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6d9806eff0 0x7f6d9815c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:20.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.200+0000 7f6d9d400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f6d980b5c90 0x7f6d98155510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48192/0 (socket says 172.21.15.137:48192) 2024-04-26T23:42:20.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.204+0000 7f6d9d400640 1 -- 172.21.15.137:0/4018797595 learned_addr learned my addr 172.21.15.137:0/4018797595 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:20.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.204+0000 7f6d9e800640 1 --2- 172.21.15.137:0/4018797595 >> v2:172.21.15.170:3300/0 conn(0x7f6d98155c20 0x7f6d980ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:20.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.204+0000 7f6d9de00640 1 -- 172.21.15.137:0/4018797595 >> v2:172.21.15.170:3300/0 conn(0x7f6d98155c20 msgr2=0x7f6d980ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:20.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.204+0000 7f6d9de00640 1 --2- 172.21.15.137:0/4018797595 >> v2:172.21.15.170:3300/0 conn(0x7f6d98155c20 0x7f6d980ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.204+0000 7f6d9de00640 1 -- 172.21.15.137:0/4018797595 >> v1:172.21.15.137:6789/0 conn(0x7f6d980b5c90 legacy=0x7f6d98155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:20.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.204+0000 7f6d9de00640 1 -- 172.21.15.137:0/4018797595 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d980b40a0 con 0x7f6d9806eff0 2024-04-26T23:42:20.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.204+0000 7f6d9ca00640 1 -- 172.21.15.137:0/4018797595 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3699259250 0 0) 0x7f6d980b3e30 con 0x7f6d980b5c90 2024-04-26T23:42:20.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.204+0000 7f6d9de00640 1 --2- 172.21.15.137:0/4018797595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d9806eff0 0x7f6d9815c4c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0097f0 tx=0x7f6d8c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182ef0a982b8a7f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:20.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.204+0000 7f6d9ca00640 1 -- 172.21.15.137:0/4018797595 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c0b1070 con 0x7f6d9806eff0 2024-04-26T23:42:20.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.204+0000 7f6d9ca00640 1 -- 172.21.15.137:0/4018797595 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d8c0ac410 con 0x7f6d9806eff0 2024-04-26T23:42:20.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.204+0000 7f6d9ca00640 1 -- 172.21.15.137:0/4018797595 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c0ac7e0 con 0x7f6d9806eff0 2024-04-26T23:42:20.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6da0800640 1 -- 172.21.15.137:0/4018797595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d9806eff0 msgr2=0x7f6d9815c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:20.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6da0800640 1 --2- 172.21.15.137:0/4018797595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d9806eff0 0x7f6d9815c4c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0097f0 tx=0x7f6d8c01c430 comp rx=0 tx=0).stop 2024-04-26T23:42:20.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6da0800640 1 -- 172.21.15.137:0/4018797595 shutdown_connections 2024-04-26T23:42:20.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6da0800640 1 --2- 172.21.15.137:0/4018797595 >> v2:172.21.15.170:3300/0 conn(0x7f6d98155c20 0x7f6d980ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6da0800640 1 --2- 172.21.15.137:0/4018797595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d9806eff0 0x7f6d9815c4c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6da0800640 1 -- 172.21.15.137:0/4018797595 >> 172.21.15.137:0/4018797595 conn(0x7f6d9806c5d0 msgr2=0x7f6d9806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:20.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6da0800640 1 -- 172.21.15.137:0/4018797595 shutdown_connections 2024-04-26T23:42:20.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6da0800640 1 -- 172.21.15.137:0/4018797595 wait complete. 2024-04-26T23:42:20.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6da0800640 1 Processor -- start 2024-04-26T23:42:20.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6da0800640 1 -- start start 2024-04-26T23:42:20.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6da0800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d9806eff0 0x7f6d98152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:20.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6da0800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d980b5c90 0x7f6d981526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:20.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6da0800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d98155c20 0x7f6d981531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:20.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6da0800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6d980cf0d0 con 0x7f6d98155c20 2024-04-26T23:42:20.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6da0800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6d980b61e0 con 0x7f6d9806eff0 2024-04-26T23:42:20.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6da0800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6d980cf250 con 0x7f6d980b5c90 2024-04-26T23:42:20.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6d9e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d98155c20 0x7f6d981531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:20.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6d9e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d98155c20 0x7f6d981531a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53590/0 (socket says 172.21.15.137:53590) 2024-04-26T23:42:20.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6d9e800640 1 -- 172.21.15.137:0/1173342280 learned_addr learned my addr 172.21.15.137:0/1173342280 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:20.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6d9de00640 1 --2- 172.21.15.137:0/1173342280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d9806eff0 0x7f6d98152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:20.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6d9d400640 1 --2- 172.21.15.137:0/1173342280 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d980b5c90 0x7f6d981526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:20.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6d9e800640 1 -- 172.21.15.137:0/1173342280 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d980b5c90 msgr2=0x7f6d981526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:20.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6d9e800640 1 --2- 172.21.15.137:0/1173342280 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d980b5c90 0x7f6d981526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6d9e800640 1 -- 172.21.15.137:0/1173342280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d9806eff0 msgr2=0x7f6d98152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:20.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6d9e800640 1 --2- 172.21.15.137:0/1173342280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d9806eff0 0x7f6d98152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6d9e800640 1 -- 172.21.15.137:0/1173342280 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d981456a0 con 0x7f6d98155c20 2024-04-26T23:42:20.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.208+0000 7f6d9e800640 1 --2- 172.21.15.137:0/1173342280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d98155c20 0x7f6d981531a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6d94009fd0 tx=0x7f6d9400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:20.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.212+0000 7f6d92000640 1 -- 172.21.15.137:0/1173342280 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d94014420 con 0x7f6d98155c20 2024-04-26T23:42:20.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.212+0000 7f6d92000640 1 -- 172.21.15.137:0/1173342280 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d94019070 con 0x7f6d98155c20 2024-04-26T23:42:20.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.212+0000 7f6da0800640 1 -- 172.21.15.137:0/1173342280 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d98145980 con 0x7f6d98155c20 2024-04-26T23:42:20.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.212+0000 7f6d92000640 1 -- 172.21.15.137:0/1173342280 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d94014800 con 0x7f6d98155c20 2024-04-26T23:42:20.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.212+0000 7f6da0800640 1 -- 172.21.15.137:0/1173342280 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d98145f40 con 0x7f6d98155c20 2024-04-26T23:42:20.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.212+0000 7f6da0800640 1 -- 172.21.15.137:0/1173342280 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d9806a4b0 con 0x7f6d98155c20 2024-04-26T23:42:20.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.212+0000 7f6d92000640 1 -- 172.21.15.137:0/1173342280 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6d940149a0 con 0x7f6d98155c20 2024-04-26T23:42:20.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.212+0000 7f6d92000640 1 --2- 172.21.15.137:0/1173342280 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6d7c068380 0x7f6d7c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:20.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.212+0000 7f6d92000640 1 -- 172.21.15.137:0/1173342280 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f6d94086f70 con 0x7f6d98155c20 2024-04-26T23:42:20.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.212+0000 7f6d9de00640 1 --2- 172.21.15.137:0/1173342280 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6d7c068380 0x7f6d7c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:20.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.216+0000 7f6d9de00640 1 --2- 172.21.15.137:0/1173342280 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6d7c068380 0x7f6d7c06a840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0ae000 tx=0x7f6d8c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:20.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.220+0000 7f6d92000640 1 -- 172.21.15.137:0/1173342280 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6d940577e0 con 0x7f6d98155c20 2024-04-26T23:42:20.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.428+0000 7f6da0800640 1 -- 172.21.15.137:0/1173342280 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f6d9806cc00 con 0x7f6d98155c20 2024-04-26T23:42:20.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.432+0000 7f6d92000640 1 -- 172.21.15.137:0/1173342280 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f6d940570e0 con 0x7f6d98155c20 2024-04-26T23:42:20.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.432+0000 7f6da0800640 1 -- 172.21.15.137:0/1173342280 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6d7c068380 msgr2=0x7f6d7c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:20.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.432+0000 7f6da0800640 1 --2- 172.21.15.137:0/1173342280 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6d7c068380 0x7f6d7c06a840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0ae000 tx=0x7f6d8c008040 comp rx=0 tx=0).stop 2024-04-26T23:42:20.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.432+0000 7f6da0800640 1 -- 172.21.15.137:0/1173342280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d98155c20 msgr2=0x7f6d981531a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:20.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.432+0000 7f6da0800640 1 --2- 172.21.15.137:0/1173342280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d98155c20 0x7f6d981531a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6d94009fd0 tx=0x7f6d9400e4b0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.432+0000 7f6da0800640 1 -- 172.21.15.137:0/1173342280 shutdown_connections 2024-04-26T23:42:20.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.432+0000 7f6da0800640 1 --2- 172.21.15.137:0/1173342280 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6d7c068380 0x7f6d7c06a840 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.432+0000 7f6da0800640 1 --2- 172.21.15.137:0/1173342280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d98155c20 0x7f6d981531a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.432+0000 7f6da0800640 1 --2- 172.21.15.137:0/1173342280 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d980b5c90 0x7f6d981526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.432+0000 7f6da0800640 1 --2- 172.21.15.137:0/1173342280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d9806eff0 0x7f6d98152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.432+0000 7f6da0800640 1 -- 172.21.15.137:0/1173342280 >> 172.21.15.137:0/1173342280 conn(0x7f6d9806c5d0 msgr2=0x7f6d981464a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:20.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.436+0000 7f6da0800640 1 -- 172.21.15.137:0/1173342280 shutdown_connections 2024-04-26T23:42:20.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.436+0000 7f6da0800640 1 -- 172.21.15.137:0/1173342280 wait complete. 2024-04-26T23:42:20.460 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-26T23:42:20.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.592+0000 7ff607000640 1 Processor -- start 2024-04-26T23:42:20.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.592+0000 7ff607000640 1 -- start start 2024-04-26T23:42:20.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.592+0000 7ff607000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff6000b2170 0x7ff6000704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:20.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.592+0000 7ff607000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff6000d0dd0 0x7ff6000d1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:20.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.592+0000 7ff607000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6000b2550 con 0x7ff6000d2a90 2024-04-26T23:42:20.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.592+0000 7ff607000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff600070a10 con 0x7ff6000d0dd0 2024-04-26T23:42:20.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.592+0000 7ff607000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff6001605c0 con 0x7ff6000b2170 2024-04-26T23:42:20.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.592+0000 7ff605200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff6000d0dd0 0x7ff6000d1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:20.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.592+0000 7ff605200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff6000d0dd0 0x7ff6000d1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53598/0 (socket says 172.21.15.137:53598) 2024-04-26T23:42:20.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.592+0000 7ff605200640 1 -- 172.21.15.137:0/2915010262 learned_addr learned my addr 172.21.15.137:0/2915010262 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:20.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.592+0000 7ff606600640 1 --1- 172.21.15.137:0/2915010262 >> v1:172.21.15.137:6789/0 conn(0x7ff6000d2a90 0x7ff6000d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48206/0 (socket says 172.21.15.137:48206) 2024-04-26T23:42:20.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.592+0000 7ff605c00640 1 --2- 172.21.15.137:0/2915010262 >> v2:172.21.15.170:3300/0 conn(0x7ff6000b2170 0x7ff6000704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:20.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.592+0000 7ff605200640 1 -- 172.21.15.137:0/2915010262 >> v2:172.21.15.170:3300/0 conn(0x7ff6000b2170 msgr2=0x7ff6000704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:20.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.592+0000 7ff605200640 1 --2- 172.21.15.137:0/2915010262 >> v2:172.21.15.170:3300/0 conn(0x7ff6000b2170 0x7ff6000704d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.592+0000 7ff605200640 1 -- 172.21.15.137:0/2915010262 >> v1:172.21.15.137:6789/0 conn(0x7ff6000d2a90 legacy=0x7ff6000d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:20.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.592+0000 7ff605200640 1 -- 172.21.15.137:0/2915010262 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff60015fd20 con 0x7ff6000d0dd0 2024-04-26T23:42:20.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.592+0000 7ff605c00640 1 --2- 172.21.15.137:0/2915010262 >> v2:172.21.15.170:3300/0 conn(0x7ff6000b2170 0x7ff6000704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:20.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.592+0000 7ff5ffe00640 1 -- 172.21.15.137:0/2915010262 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2401213262 0 0) 0x7ff6000b2550 con 0x7ff6000d2a90 2024-04-26T23:42:20.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.596+0000 7ff605200640 1 --2- 172.21.15.137:0/2915010262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6000d0dd0 0x7ff6000d1280 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff6000b5850 tx=0x7ff5ec01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2d5da9920b2d06 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:20.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.596+0000 7ff5ffe00640 1 -- 172.21.15.137:0/2915010262 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec0ab660 con 0x7ff6000d0dd0 2024-04-26T23:42:20.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.596+0000 7ff5ffe00640 1 -- 172.21.15.137:0/2915010262 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5ec0b0070 con 0x7ff6000d0dd0 2024-04-26T23:42:20.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.596+0000 7ff5ffe00640 1 -- 172.21.15.137:0/2915010262 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec0aba20 con 0x7ff6000d0dd0 2024-04-26T23:42:20.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.596+0000 7ff607000640 1 -- 172.21.15.137:0/2915010262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6000d0dd0 msgr2=0x7ff6000d1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:20.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.596+0000 7ff607000640 1 --2- 172.21.15.137:0/2915010262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6000d0dd0 0x7ff6000d1280 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff6000b5850 tx=0x7ff5ec01c460 comp rx=0 tx=0).stop 2024-04-26T23:42:20.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.596+0000 7ff607000640 1 -- 172.21.15.137:0/2915010262 shutdown_connections 2024-04-26T23:42:20.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.596+0000 7ff607000640 1 --2- 172.21.15.137:0/2915010262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6000d0dd0 0x7ff6000d1280 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.596+0000 7ff607000640 1 --2- 172.21.15.137:0/2915010262 >> v2:172.21.15.170:3300/0 conn(0x7ff6000b2170 0x7ff6000704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.596+0000 7ff607000640 1 -- 172.21.15.137:0/2915010262 >> 172.21.15.137:0/2915010262 conn(0x7ff60009ba60 msgr2=0x7ff60009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:20.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.596+0000 7ff607000640 1 -- 172.21.15.137:0/2915010262 shutdown_connections 2024-04-26T23:42:20.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.596+0000 7ff607000640 1 -- 172.21.15.137:0/2915010262 wait complete. 2024-04-26T23:42:20.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff607000640 1 Processor -- start 2024-04-26T23:42:20.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff607000640 1 -- start start 2024-04-26T23:42:20.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff607000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6000b2170 0x7ff6000c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:20.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff607000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6000d0dd0 0x7ff6000c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:20.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff607000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6000d2a90 0x7ff600157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:20.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff607000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff6000d0510 con 0x7ff6000d0dd0 2024-04-26T23:42:20.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff607000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff6000d0390 con 0x7ff6000d2a90 2024-04-26T23:42:20.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff607000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff60015e920 con 0x7ff6000b2170 2024-04-26T23:42:20.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff605200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6000d0dd0 0x7ff6000c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:20.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff605200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6000d0dd0 0x7ff6000c9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53606/0 (socket says 172.21.15.137:53606) 2024-04-26T23:42:20.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff605200640 1 -- 172.21.15.137:0/2572507032 learned_addr learned my addr 172.21.15.137:0/2572507032 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:20.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff606600640 1 --2- 172.21.15.137:0/2572507032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6000d2a90 0x7ff600157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:20.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff605c00640 1 --2- 172.21.15.137:0/2572507032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6000b2170 0x7ff6000c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:20.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff605200640 1 -- 172.21.15.137:0/2572507032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6000b2170 msgr2=0x7ff6000c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:20.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff605200640 1 --2- 172.21.15.137:0/2572507032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6000b2170 0x7ff6000c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff605200640 1 -- 172.21.15.137:0/2572507032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6000d2a90 msgr2=0x7ff600157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:20.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff605200640 1 --2- 172.21.15.137:0/2572507032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6000d2a90 0x7ff600157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff605200640 1 -- 172.21.15.137:0/2572507032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6000b58f0 con 0x7ff6000d0dd0 2024-04-26T23:42:20.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff605200640 1 --2- 172.21.15.137:0/2572507032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6000d0dd0 0x7ff6000c9200 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec019070 tx=0x7ff5ec01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:20.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff5fd600640 1 -- 172.21.15.137:0/2572507032 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec0be5f0 con 0x7ff6000d0dd0 2024-04-26T23:42:20.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff5fd600640 1 -- 172.21.15.137:0/2572507032 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5ec0be790 con 0x7ff6000d0dd0 2024-04-26T23:42:20.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff5fd600640 1 -- 172.21.15.137:0/2572507032 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec0beb80 con 0x7ff6000d0dd0 2024-04-26T23:42:20.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff607000640 1 -- 172.21.15.137:0/2572507032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6000b5bd0 con 0x7ff6000d0dd0 2024-04-26T23:42:20.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.600+0000 7ff607000640 1 -- 172.21.15.137:0/2572507032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6000b6190 con 0x7ff6000d0dd0 2024-04-26T23:42:20.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.604+0000 7ff607000640 1 -- 172.21.15.137:0/2572507032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff60006a410 con 0x7ff6000d0dd0 2024-04-26T23:42:20.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.604+0000 7ff5fd600640 1 -- 172.21.15.137:0/2572507032 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff5ec0b43f0 con 0x7ff6000d0dd0 2024-04-26T23:42:20.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.604+0000 7ff5fd600640 1 --2- 172.21.15.137:0/2572507032 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff5e00683b0 0x7ff5e006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:20.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.604+0000 7ff5fd600640 1 -- 172.21.15.137:0/2572507032 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7ff5ec121130 con 0x7ff6000d0dd0 2024-04-26T23:42:20.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.604+0000 7ff605c00640 1 --2- 172.21.15.137:0/2572507032 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff5e00683b0 0x7ff5e006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:20.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.604+0000 7ff605c00640 1 --2- 172.21.15.137:0/2572507032 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff5e00683b0 0x7ff5e006a870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40098b0 tx=0x7ff5f4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:20.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.608+0000 7ff5fd600640 1 -- 172.21.15.137:0/2572507032 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff5ec016110 con 0x7ff6000d0dd0 2024-04-26T23:42:20.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.820+0000 7ff607000640 1 -- 172.21.15.137:0/2572507032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7ff6000b2750 con 0x7ff6000d0dd0 2024-04-26T23:42:20.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.824+0000 7ff5fd600640 1 -- 172.21.15.137:0/2572507032 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v10) ==== 97+0+0 (secure 0 0 0) 0x7ff5ec0f1470 con 0x7ff6000d0dd0 2024-04-26T23:42:20.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.824+0000 7ff607000640 1 -- 172.21.15.137:0/2572507032 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff5e00683b0 msgr2=0x7ff5e006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:20.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.824+0000 7ff607000640 1 --2- 172.21.15.137:0/2572507032 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff5e00683b0 0x7ff5e006a870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40098b0 tx=0x7ff5f4008040 comp rx=0 tx=0).stop 2024-04-26T23:42:20.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.824+0000 7ff607000640 1 -- 172.21.15.137:0/2572507032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6000d0dd0 msgr2=0x7ff6000c9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:20.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.824+0000 7ff607000640 1 --2- 172.21.15.137:0/2572507032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6000d0dd0 0x7ff6000c9200 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec019070 tx=0x7ff5ec01aca0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.824+0000 7ff607000640 1 -- 172.21.15.137:0/2572507032 shutdown_connections 2024-04-26T23:42:20.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.824+0000 7ff607000640 1 --2- 172.21.15.137:0/2572507032 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff5e00683b0 0x7ff5e006a870 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.824+0000 7ff607000640 1 --2- 172.21.15.137:0/2572507032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6000d0dd0 0x7ff6000c9200 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.824+0000 7ff607000640 1 --2- 172.21.15.137:0/2572507032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6000d2a90 0x7ff600157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.824+0000 7ff607000640 1 --2- 172.21.15.137:0/2572507032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6000b2170 0x7ff6000c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.824+0000 7ff607000640 1 -- 172.21.15.137:0/2572507032 >> 172.21.15.137:0/2572507032 conn(0x7ff60009ba60 msgr2=0x7ff6000b47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:20.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.824+0000 7ff607000640 1 -- 172.21.15.137:0/2572507032 shutdown_connections 2024-04-26T23:42:20.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.824+0000 7ff607000640 1 -- 172.21.15.137:0/2572507032 wait complete. 2024-04-26T23:42:20.850 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-26T23:42:20.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.980+0000 7f3a5f200640 1 Processor -- start 2024-04-26T23:42:20.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.980+0000 7f3a5f200640 1 -- start start 2024-04-26T23:42:20.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.984+0000 7f3a5f200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3a580ce3e0 0x7f3a58073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:20.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.984+0000 7f3a5f200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3a5815de80 0x7f3a580d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:20.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.984+0000 7f3a5f200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a58073010 con 0x7f3a580ce7c0 2024-04-26T23:42:20.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.984+0000 7f3a5f200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3a580cef90 con 0x7f3a580ce3e0 2024-04-26T23:42:20.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.984+0000 7f3a5f200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f3a58073280 con 0x7f3a5815de80 2024-04-26T23:42:20.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.984+0000 7f3a57e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3a580ce3e0 0x7f3a58073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:20.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.984+0000 7f3a57e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3a580ce3e0 0x7f3a58073d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36220/0 (socket says 172.21.15.137:36220) 2024-04-26T23:42:20.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.984+0000 7f3a57e00640 1 -- 172.21.15.137:0/3398991646 learned_addr learned my addr 172.21.15.137:0/3398991646 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:20.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.984+0000 7f3a5d200640 1 --1- 172.21.15.137:0/3398991646 >> v1:172.21.15.137:6789/0 conn(0x7f3a580ce7c0 0x7f3a58146210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58668/0 (socket says 172.21.15.137:58668) 2024-04-26T23:42:20.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.984+0000 7f3a57e00640 1 -- 172.21.15.137:0/3398991646 >> v2:172.21.15.170:3300/0 conn(0x7f3a5815de80 msgr2=0x7f3a580d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:20.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.984+0000 7f3a57e00640 1 --2- 172.21.15.137:0/3398991646 >> v2:172.21.15.170:3300/0 conn(0x7f3a5815de80 0x7f3a580d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.984+0000 7f3a57e00640 1 -- 172.21.15.137:0/3398991646 >> v1:172.21.15.137:6789/0 conn(0x7f3a580ce7c0 legacy=0x7f3a58146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:20.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.984+0000 7f3a57e00640 1 -- 172.21.15.137:0/3398991646 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a58073560 con 0x7f3a580ce3e0 2024-04-26T23:42:20.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.988+0000 7f3a57e00640 1 --2- 172.21.15.137:0/3398991646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a580ce3e0 0x7f3a58073d60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3a40009870 tx=0x7f3a4001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09a68cf9048436a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:20.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.988+0000 7f3a56a00640 1 -- 172.21.15.137:0/3398991646 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a400aa670 con 0x7f3a580ce3e0 2024-04-26T23:42:20.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.988+0000 7f3a56a00640 1 -- 172.21.15.137:0/3398991646 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a400af070 con 0x7f3a580ce3e0 2024-04-26T23:42:20.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.988+0000 7f3a56a00640 1 -- 172.21.15.137:0/3398991646 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a400aaa30 con 0x7f3a580ce3e0 2024-04-26T23:42:20.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.988+0000 7f3a5f200640 1 -- 172.21.15.137:0/3398991646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a580ce3e0 msgr2=0x7f3a58073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:20.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.988+0000 7f3a5f200640 1 --2- 172.21.15.137:0/3398991646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a580ce3e0 0x7f3a58073d60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3a40009870 tx=0x7f3a4001c4f0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.988+0000 7f3a5f200640 1 -- 172.21.15.137:0/3398991646 shutdown_connections 2024-04-26T23:42:20.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.988+0000 7f3a5f200640 1 --2- 172.21.15.137:0/3398991646 >> v2:172.21.15.170:3300/0 conn(0x7f3a5815de80 0x7f3a580d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.988+0000 7f3a5f200640 1 --2- 172.21.15.137:0/3398991646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a580ce3e0 0x7f3a58073d60 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.988+0000 7f3a5f200640 1 -- 172.21.15.137:0/3398991646 >> 172.21.15.137:0/3398991646 conn(0x7f3a5806c5d0 msgr2=0x7f3a5806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:20.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.988+0000 7f3a5f200640 1 -- 172.21.15.137:0/3398991646 shutdown_connections 2024-04-26T23:42:20.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.988+0000 7f3a5f200640 1 -- 172.21.15.137:0/3398991646 wait complete. 2024-04-26T23:42:20.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.988+0000 7f3a5f200640 1 Processor -- start 2024-04-26T23:42:20.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.988+0000 7f3a5f200640 1 -- start start 2024-04-26T23:42:20.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.988+0000 7f3a5f200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a580ce3e0 0x7f3a581f5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:20.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.988+0000 7f3a5f200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a580ce7c0 0x7f3a5813e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:20.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a5f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a5815de80 0x7f3a58141500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:20.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a5f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3a58146aa0 con 0x7f3a5815de80 2024-04-26T23:42:20.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a5f200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3a58146920 con 0x7f3a580ce7c0 2024-04-26T23:42:20.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a5f200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3a5806ed10 con 0x7f3a580ce3e0 2024-04-26T23:42:20.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a5d200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a5815de80 0x7f3a58141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:20.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a5d200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a5815de80 0x7f3a58141500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36236/0 (socket says 172.21.15.137:36236) 2024-04-26T23:42:20.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a5d200640 1 -- 172.21.15.137:0/2933510402 learned_addr learned my addr 172.21.15.137:0/2933510402 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:20.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a57e00640 1 --2- 172.21.15.137:0/2933510402 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a580ce3e0 0x7f3a581f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:20.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a57400640 1 --2- 172.21.15.137:0/2933510402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a580ce7c0 0x7f3a5813e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:20.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a5d200640 1 -- 172.21.15.137:0/2933510402 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a580ce3e0 msgr2=0x7f3a581f5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:20.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a5d200640 1 --2- 172.21.15.137:0/2933510402 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a580ce3e0 0x7f3a581f5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a5d200640 1 -- 172.21.15.137:0/2933510402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a580ce7c0 msgr2=0x7f3a5813e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:20.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a5d200640 1 --2- 172.21.15.137:0/2933510402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a580ce7c0 0x7f3a5813e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:20.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a5d200640 1 -- 172.21.15.137:0/2933510402 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a58157af0 con 0x7f3a5815de80 2024-04-26T23:42:20.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a57400640 1 --2- 172.21.15.137:0/2933510402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a580ce7c0 0x7f3a5813e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:20.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a5d200640 1 --2- 172.21.15.137:0/2933510402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a5815de80 0x7f3a58141500 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3a5000c7a0 tx=0x7f3a5000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:20.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a4fe00640 1 -- 172.21.15.137:0/2933510402 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a50017070 con 0x7f3a5815de80 2024-04-26T23:42:20.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a4fe00640 1 -- 172.21.15.137:0/2933510402 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a5000a640 con 0x7f3a5815de80 2024-04-26T23:42:20.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a5f200640 1 -- 172.21.15.137:0/2933510402 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a58157d90 con 0x7f3a5815de80 2024-04-26T23:42:20.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a4fe00640 1 -- 172.21.15.137:0/2933510402 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5000a9f0 con 0x7f3a5815de80 2024-04-26T23:42:20.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a5f200640 1 -- 172.21.15.137:0/2933510402 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a58141a40 con 0x7f3a5815de80 2024-04-26T23:42:20.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a5f200640 1 -- 172.21.15.137:0/2933510402 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a5806a4b0 con 0x7f3a5815de80 2024-04-26T23:42:20.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a4fe00640 1 -- 172.21.15.137:0/2933510402 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3a5001a070 con 0x7f3a5815de80 2024-04-26T23:42:20.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.992+0000 7f3a4fe00640 1 --2- 172.21.15.137:0/2933510402 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3a34068380 0x7f3a3406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:20.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.996+0000 7f3a4fe00640 1 -- 172.21.15.137:0/2933510402 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f3a50085c00 con 0x7f3a5815de80 2024-04-26T23:42:21.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.996+0000 7f3a57e00640 1 --2- 172.21.15.137:0/2933510402 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3a34068380 0x7f3a3406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:21.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:20.996+0000 7f3a57e00640 1 --2- 172.21.15.137:0/2933510402 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3a34068380 0x7f3a3406a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3a400ae000 tx=0x7f3a400a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:21.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.000+0000 7f3a4fe00640 1 -- 172.21.15.137:0/2933510402 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3a50055eb0 con 0x7f3a5815de80 2024-04-26T23:42:21.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.212+0000 7f3a5f200640 1 -- 172.21.15.137:0/2933510402 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f3a5806f3b0 con 0x7f3a5815de80 2024-04-26T23:42:21.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.212+0000 7f3a4fe00640 1 -- 172.21.15.137:0/2933510402 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7f3a5005a1b0 con 0x7f3a5815de80 2024-04-26T23:42:21.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.216+0000 7f3a5f200640 1 -- 172.21.15.137:0/2933510402 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3a34068380 msgr2=0x7f3a3406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:21.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.216+0000 7f3a5f200640 1 --2- 172.21.15.137:0/2933510402 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3a34068380 0x7f3a3406a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3a400ae000 tx=0x7f3a400a7000 comp rx=0 tx=0).stop 2024-04-26T23:42:21.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.216+0000 7f3a5f200640 1 -- 172.21.15.137:0/2933510402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a5815de80 msgr2=0x7f3a58141500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:21.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.216+0000 7f3a5f200640 1 --2- 172.21.15.137:0/2933510402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a5815de80 0x7f3a58141500 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3a5000c7a0 tx=0x7f3a5000cc60 comp rx=0 tx=0).stop 2024-04-26T23:42:21.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.216+0000 7f3a5f200640 1 -- 172.21.15.137:0/2933510402 shutdown_connections 2024-04-26T23:42:21.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.216+0000 7f3a5f200640 1 --2- 172.21.15.137:0/2933510402 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3a34068380 0x7f3a3406a840 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.216+0000 7f3a5f200640 1 --2- 172.21.15.137:0/2933510402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a5815de80 0x7f3a58141500 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.216+0000 7f3a5f200640 1 --2- 172.21.15.137:0/2933510402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a580ce7c0 0x7f3a5813e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.216+0000 7f3a5f200640 1 --2- 172.21.15.137:0/2933510402 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a580ce3e0 0x7f3a581f5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.216+0000 7f3a5f200640 1 -- 172.21.15.137:0/2933510402 >> 172.21.15.137:0/2933510402 conn(0x7f3a5806c5d0 msgr2=0x7f3a5815af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:21.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.216+0000 7f3a5f200640 1 -- 172.21.15.137:0/2933510402 shutdown_connections 2024-04-26T23:42:21.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.216+0000 7f3a5f200640 1 -- 172.21.15.137:0/2933510402 wait complete. 2024-04-26T23:42:21.241 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:42:21.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.372+0000 7fec10000640 1 Processor -- start 2024-04-26T23:42:21.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.372+0000 7fec10000640 1 -- start start 2024-04-26T23:42:21.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.372+0000 7fec10000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec080ce3e0 0x7fec08073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:21.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.372+0000 7fec10000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fec080ce7c0 0x7fec08146210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:21.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.372+0000 7fec10000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec08073010 con 0x7fec0815de80 2024-04-26T23:42:21.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.372+0000 7fec10000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fec080cef90 con 0x7fec080ce7c0 2024-04-26T23:42:21.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.372+0000 7fec10000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fec08073280 con 0x7fec080ce3e0 2024-04-26T23:42:21.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.372+0000 7fec0e000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fec080ce7c0 0x7fec08146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:21.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.372+0000 7fec0e000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fec080ce7c0 0x7fec08146210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36248/0 (socket says 172.21.15.137:36248) 2024-04-26T23:42:21.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.372+0000 7fec0e000640 1 -- 172.21.15.137:0/4230560678 learned_addr learned my addr 172.21.15.137:0/4230560678 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:21.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.372+0000 7fec0d600640 1 --2- 172.21.15.137:0/4230560678 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec080ce3e0 0x7fec08073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:21.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.372+0000 7fec0e000640 1 -- 172.21.15.137:0/4230560678 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec080ce3e0 msgr2=0x7fec08073d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:21.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.372+0000 7fec0e000640 1 --2- 172.21.15.137:0/4230560678 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec080ce3e0 0x7fec08073d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.372+0000 7fec0e000640 1 -- 172.21.15.137:0/4230560678 >> v1:172.21.15.170:6789/0 conn(0x7fec0815de80 legacy=0x7fec080d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:21.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.372+0000 7fec0e000640 1 -- 172.21.15.137:0/4230560678 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec08073560 con 0x7fec080ce7c0 2024-04-26T23:42:21.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.376+0000 7fec0e000640 1 --2- 172.21.15.137:0/4230560678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec080ce7c0 0x7fec08146210 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fec00009e50 tx=0x7fec0001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4846cf93a0b1cbdf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:21.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.376+0000 7fec07e00640 1 -- 172.21.15.137:0/4230560678 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec000a57e0 con 0x7fec080ce7c0 2024-04-26T23:42:21.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.376+0000 7fec07e00640 1 -- 172.21.15.137:0/4230560678 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec000a5980 con 0x7fec080ce7c0 2024-04-26T23:42:21.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.376+0000 7fec07e00640 1 -- 172.21.15.137:0/4230560678 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec000a5d50 con 0x7fec080ce7c0 2024-04-26T23:42:21.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.376+0000 7fec10000640 1 -- 172.21.15.137:0/4230560678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec080ce7c0 msgr2=0x7fec08146210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:21.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.376+0000 7fec10000640 1 --2- 172.21.15.137:0/4230560678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec080ce7c0 0x7fec08146210 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fec00009e50 tx=0x7fec0001ca00 comp rx=0 tx=0).stop 2024-04-26T23:42:21.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.376+0000 7fec10000640 1 -- 172.21.15.137:0/4230560678 shutdown_connections 2024-04-26T23:42:21.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.376+0000 7fec10000640 1 --2- 172.21.15.137:0/4230560678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec080ce7c0 0x7fec08146210 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.376+0000 7fec10000640 1 --2- 172.21.15.137:0/4230560678 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec080ce3e0 0x7fec08073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.376+0000 7fec10000640 1 -- 172.21.15.137:0/4230560678 >> 172.21.15.137:0/4230560678 conn(0x7fec0806c5d0 msgr2=0x7fec0806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:21.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.376+0000 7fec10000640 1 -- 172.21.15.137:0/4230560678 shutdown_connections 2024-04-26T23:42:21.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.376+0000 7fec10000640 1 -- 172.21.15.137:0/4230560678 wait complete. 2024-04-26T23:42:21.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec10000640 1 Processor -- start 2024-04-26T23:42:21.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec10000640 1 -- start start 2024-04-26T23:42:21.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec10000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec080ce3e0 0x7fec081448d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:21.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec10000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec080ce7c0 0x7fec0815fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:21.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec10000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec0815de80 0x7fec0813e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:21.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec10000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fec0806f0a0 con 0x7fec080ce3e0 2024-04-26T23:42:21.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec10000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fec0806ef20 con 0x7fec0815de80 2024-04-26T23:42:21.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec10000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fec0806f220 con 0x7fec080ce7c0 2024-04-26T23:42:21.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec0d600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec080ce3e0 0x7fec081448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:21.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec0d600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec080ce3e0 0x7fec081448d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36254/0 (socket says 172.21.15.137:36254) 2024-04-26T23:42:21.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec0d600640 1 -- 172.21.15.137:0/1882464772 learned_addr learned my addr 172.21.15.137:0/1882464772 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:21.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec0e000640 1 --2- 172.21.15.137:0/1882464772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec0815de80 0x7fec0813e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:21.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec0cc00640 1 --2- 172.21.15.137:0/1882464772 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec080ce7c0 0x7fec0815fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:21.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec0d600640 1 -- 172.21.15.137:0/1882464772 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec080ce7c0 msgr2=0x7fec0815fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:21.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec0d600640 1 --2- 172.21.15.137:0/1882464772 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec080ce7c0 0x7fec0815fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec0d600640 1 -- 172.21.15.137:0/1882464772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec0815de80 msgr2=0x7fec0813e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:21.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec0d600640 1 --2- 172.21.15.137:0/1882464772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec0815de80 0x7fec0813e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec0d600640 1 -- 172.21.15.137:0/1882464772 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec081f7e80 con 0x7fec080ce3e0 2024-04-26T23:42:21.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec0d600640 1 --2- 172.21.15.137:0/1882464772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec080ce3e0 0x7fec081448d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7febfc00d800 tx=0x7febfc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:21.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec05600640 1 -- 172.21.15.137:0/1882464772 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc00b6c0 con 0x7fec080ce3e0 2024-04-26T23:42:21.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec05600640 1 -- 172.21.15.137:0/1882464772 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febfc019070 con 0x7fec080ce3e0 2024-04-26T23:42:21.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec10000640 1 -- 172.21.15.137:0/1882464772 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec080b5260 con 0x7fec080ce3e0 2024-04-26T23:42:21.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec05600640 1 -- 172.21.15.137:0/1882464772 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc00ba60 con 0x7fec080ce3e0 2024-04-26T23:42:21.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec10000640 1 -- 172.21.15.137:0/1882464772 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec080b5b00 con 0x7fec080ce3e0 2024-04-26T23:42:21.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.380+0000 7fec10000640 1 -- 172.21.15.137:0/1882464772 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec0806a4b0 con 0x7fec080ce3e0 2024-04-26T23:42:21.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.384+0000 7fec05600640 1 -- 172.21.15.137:0/1882464772 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7febfc00bc00 con 0x7fec080ce3e0 2024-04-26T23:42:21.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.384+0000 7fec05600640 1 --2- 172.21.15.137:0/1882464772 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7febe8068380 0x7febe806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:21.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.384+0000 7fec05600640 1 -- 172.21.15.137:0/1882464772 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7febfc086b50 con 0x7fec080ce3e0 2024-04-26T23:42:21.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.384+0000 7fec0cc00640 1 --2- 172.21.15.137:0/1882464772 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7febe8068380 0x7febe806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:21.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.384+0000 7fec0cc00640 1 --2- 172.21.15.137:0/1882464772 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7febe8068380 0x7febe806a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fec0813f160 tx=0x7febf4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:21.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.388+0000 7fec05600640 1 -- 172.21.15.137:0/1882464772 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7febfc057460 con 0x7fec080ce3e0 2024-04-26T23:42:21.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.548+0000 7fec10000640 1 -- 172.21.15.137:0/1882464772 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec080d06b0 con 0x7fec080ce3e0 2024-04-26T23:42:21.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.548+0000 7fec05600640 1 -- 172.21.15.137:0/1882464772 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+12939 (secure 0 0 0) 0x7febfc056d60 con 0x7fec080ce3e0 2024-04-26T23:42:21.554 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:21.555 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":29,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:42:18.443356+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:42:21.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.552+0000 7fec10000640 1 -- 172.21.15.137:0/1882464772 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7febe8068380 msgr2=0x7febe806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:21.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.552+0000 7fec10000640 1 --2- 172.21.15.137:0/1882464772 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7febe8068380 0x7febe806a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fec0813f160 tx=0x7febf4009040 comp rx=0 tx=0).stop 2024-04-26T23:42:21.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.552+0000 7fec10000640 1 -- 172.21.15.137:0/1882464772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec080ce3e0 msgr2=0x7fec081448d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:21.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.552+0000 7fec10000640 1 --2- 172.21.15.137:0/1882464772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec080ce3e0 0x7fec081448d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7febfc00d800 tx=0x7febfc00dcc0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.552+0000 7fec10000640 1 -- 172.21.15.137:0/1882464772 shutdown_connections 2024-04-26T23:42:21.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.552+0000 7fec10000640 1 --2- 172.21.15.137:0/1882464772 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7febe8068380 0x7febe806a840 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.552+0000 7fec10000640 1 --2- 172.21.15.137:0/1882464772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec0815de80 0x7fec0813e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.552+0000 7fec10000640 1 --2- 172.21.15.137:0/1882464772 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec080ce7c0 0x7fec0815fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.552+0000 7fec10000640 1 --2- 172.21.15.137:0/1882464772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec080ce3e0 0x7fec081448d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.552+0000 7fec10000640 1 -- 172.21.15.137:0/1882464772 >> 172.21.15.137:0/1882464772 conn(0x7fec0806c5d0 msgr2=0x7fec0813f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:21.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.552+0000 7fec10000640 1 -- 172.21.15.137:0/1882464772 shutdown_connections 2024-04-26T23:42:21.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.552+0000 7fec10000640 1 -- 172.21.15.137:0/1882464772 wait complete. 2024-04-26T23:42:21.576 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:42:21.576 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:42:21.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.712+0000 7f645b600640 1 Processor -- start 2024-04-26T23:42:21.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.712+0000 7f645b600640 1 -- start start 2024-04-26T23:42:21.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.712+0000 7f645b600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f64540afbc0 0x7f645415df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:21.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.712+0000 7f645b600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6454073f20 0x7f64540735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:21.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.712+0000 7f645b600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f64540affa0 0x7f64540ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:21.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.712+0000 7f645b600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6454073b20 con 0x7f64540afbc0 2024-04-26T23:42:21.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.712+0000 7f645b600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f6454072860 con 0x7f64540affa0 2024-04-26T23:42:21.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.712+0000 7f645b600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f64540743b0 con 0x7f6454073f20 2024-04-26T23:42:21.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.712+0000 7f6458c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f64540afbc0 0x7f645415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:21.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.712+0000 7f6458c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f64540afbc0 0x7f645415df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36270/0 (socket says 172.21.15.137:36270) 2024-04-26T23:42:21.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.712+0000 7f6458c00640 1 -- 172.21.15.137:0/589077346 learned_addr learned my addr 172.21.15.137:0/589077346 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:21.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.712+0000 7f6453e00640 1 --2- 172.21.15.137:0/589077346 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6454073f20 0x7f64540735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:21.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.712+0000 7f6459600640 1 --2- 172.21.15.137:0/589077346 >> v2:172.21.15.170:3300/0 conn(0x7f64540affa0 0x7f64540ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:21.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.712+0000 7f6458c00640 1 -- 172.21.15.137:0/589077346 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6454073f20 msgr2=0x7f64540735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:21.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.712+0000 7f6458c00640 1 --2- 172.21.15.137:0/589077346 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6454073f20 0x7f64540735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.712+0000 7f6458c00640 1 -- 172.21.15.137:0/589077346 >> v2:172.21.15.170:3300/0 conn(0x7f64540affa0 msgr2=0x7f64540ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:21.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.712+0000 7f6458c00640 1 --2- 172.21.15.137:0/589077346 >> v2:172.21.15.170:3300/0 conn(0x7f64540affa0 0x7f64540ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.712+0000 7f6458c00640 1 -- 172.21.15.137:0/589077346 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6454072b00 con 0x7f64540afbc0 2024-04-26T23:42:21.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.712+0000 7f6459600640 1 --2- 172.21.15.137:0/589077346 >> v2:172.21.15.170:3300/0 conn(0x7f64540affa0 0x7f64540ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:21.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.716+0000 7f6458c00640 1 --2- 172.21.15.137:0/589077346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64540afbc0 0x7f645415df90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6444009870 tx=0x7f644401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb4695c3c139c12 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:21.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.716+0000 7f6453400640 1 -- 172.21.15.137:0/589077346 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64440b0070 con 0x7f64540afbc0 2024-04-26T23:42:21.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.716+0000 7f6453400640 1 -- 172.21.15.137:0/589077346 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64440ab600 con 0x7f64540afbc0 2024-04-26T23:42:21.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.716+0000 7f6453400640 1 -- 172.21.15.137:0/589077346 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64440ab9d0 con 0x7f64540afbc0 2024-04-26T23:42:21.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.716+0000 7f645b600640 1 -- 172.21.15.137:0/589077346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64540afbc0 msgr2=0x7f645415df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:21.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.716+0000 7f645b600640 1 --2- 172.21.15.137:0/589077346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64540afbc0 0x7f645415df90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6444009870 tx=0x7f644401c520 comp rx=0 tx=0).stop 2024-04-26T23:42:21.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.716+0000 7f645b600640 1 -- 172.21.15.137:0/589077346 shutdown_connections 2024-04-26T23:42:21.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.716+0000 7f645b600640 1 --2- 172.21.15.137:0/589077346 >> v2:172.21.15.170:3300/0 conn(0x7f64540affa0 0x7f64540ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.716+0000 7f645b600640 1 --2- 172.21.15.137:0/589077346 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6454073f20 0x7f64540735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.716+0000 7f645b600640 1 --2- 172.21.15.137:0/589077346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64540afbc0 0x7f645415df90 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.716+0000 7f645b600640 1 -- 172.21.15.137:0/589077346 >> 172.21.15.137:0/589077346 conn(0x7f645406c800 msgr2=0x7f645406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:21.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.716+0000 7f645b600640 1 -- 172.21.15.137:0/589077346 shutdown_connections 2024-04-26T23:42:21.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.716+0000 7f645b600640 1 -- 172.21.15.137:0/589077346 wait complete. 2024-04-26T23:42:21.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f645b600640 1 Processor -- start 2024-04-26T23:42:21.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f645b600640 1 -- start start 2024-04-26T23:42:21.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f645b600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64540afbc0 0x7f645414d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:21.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f645b600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64540affa0 0x7f64540b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:21.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f645b600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f645415e640 0x7f6454150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:21.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f645b600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6454161490 con 0x7f64540afbc0 2024-04-26T23:42:21.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f645b600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6454161310 con 0x7f64540affa0 2024-04-26T23:42:21.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f645b600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6454161610 con 0x7f645415e640 2024-04-26T23:42:21.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f6458c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64540afbc0 0x7f645414d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:21.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f6458c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64540afbc0 0x7f645414d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36276/0 (socket says 172.21.15.137:36276) 2024-04-26T23:42:21.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f6458c00640 1 -- 172.21.15.137:0/2290333715 learned_addr learned my addr 172.21.15.137:0/2290333715 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:21.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f6453e00640 1 --2- 172.21.15.137:0/2290333715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64540affa0 0x7f64540b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:21.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f6459600640 1 --2- 172.21.15.137:0/2290333715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f645415e640 0x7f6454150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:21.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f6458c00640 1 -- 172.21.15.137:0/2290333715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f645415e640 msgr2=0x7f6454150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:21.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f6458c00640 1 --2- 172.21.15.137:0/2290333715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f645415e640 0x7f6454150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f6458c00640 1 -- 172.21.15.137:0/2290333715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64540affa0 msgr2=0x7f64540b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:21.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f6458c00640 1 --2- 172.21.15.137:0/2290333715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64540affa0 0x7f64540b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f6458c00640 1 -- 172.21.15.137:0/2290333715 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6454150ac0 con 0x7f64540afbc0 2024-04-26T23:42:21.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f6458c00640 1 --2- 172.21.15.137:0/2290333715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64540afbc0 0x7f645414d350 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f64440ae040 tx=0x7f644401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:21.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f6450c00640 1 -- 172.21.15.137:0/2290333715 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64440ba020 con 0x7f64540afbc0 2024-04-26T23:42:21.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f6450c00640 1 -- 172.21.15.137:0/2290333715 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64440b6420 con 0x7f64540afbc0 2024-04-26T23:42:21.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f645b600640 1 -- 172.21.15.137:0/2290333715 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6454150da0 con 0x7f64540afbc0 2024-04-26T23:42:21.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f6450c00640 1 -- 172.21.15.137:0/2290333715 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64440b0040 con 0x7f64540afbc0 2024-04-26T23:42:21.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f645b600640 1 -- 172.21.15.137:0/2290333715 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f645414d8d0 con 0x7f64540afbc0 2024-04-26T23:42:21.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.720+0000 7f645b600640 1 -- 172.21.15.137:0/2290333715 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f645406a410 con 0x7f64540afbc0 2024-04-26T23:42:21.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.724+0000 7f6450c00640 1 -- 172.21.15.137:0/2290333715 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f64440bd020 con 0x7f64540afbc0 2024-04-26T23:42:21.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.724+0000 7f6450c00640 1 --2- 172.21.15.137:0/2290333715 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6434068380 0x7f643406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:21.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.724+0000 7f6450c00640 1 -- 172.21.15.137:0/2290333715 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f64441208c0 con 0x7f64540afbc0 2024-04-26T23:42:21.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.724+0000 7f6453e00640 1 --2- 172.21.15.137:0/2290333715 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6434068380 0x7f643406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:21.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.724+0000 7f6453e00640 1 --2- 172.21.15.137:0/2290333715 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6434068380 0x7f643406a840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f645415bf30 tx=0x7f6440008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:21.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.728+0000 7f6450c00640 1 -- 172.21.15.137:0/2290333715 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f64440c4030 con 0x7f64540afbc0 2024-04-26T23:42:21.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.892+0000 7f645b600640 1 -- 172.21.15.137:0/2290333715 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6454160870 con 0x7f64540afbc0 2024-04-26T23:42:21.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.892+0000 7f6450c00640 1 -- 172.21.15.137:0/2290333715 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f6444016110 con 0x7f64540afbc0 2024-04-26T23:42:21.897 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:42:21.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.892+0000 7f645b600640 1 -- 172.21.15.137:0/2290333715 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6434068380 msgr2=0x7f643406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:21.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.892+0000 7f645b600640 1 --2- 172.21.15.137:0/2290333715 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6434068380 0x7f643406a840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f645415bf30 tx=0x7f6440008040 comp rx=0 tx=0).stop 2024-04-26T23:42:21.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.892+0000 7f645b600640 1 -- 172.21.15.137:0/2290333715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64540afbc0 msgr2=0x7f645414d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:21.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.892+0000 7f645b600640 1 --2- 172.21.15.137:0/2290333715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64540afbc0 0x7f645414d350 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f64440ae040 tx=0x7f644401ad60 comp rx=0 tx=0).stop 2024-04-26T23:42:21.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.892+0000 7f645b600640 1 -- 172.21.15.137:0/2290333715 shutdown_connections 2024-04-26T23:42:21.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.892+0000 7f645b600640 1 --2- 172.21.15.137:0/2290333715 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6434068380 0x7f643406a840 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.892+0000 7f645b600640 1 --2- 172.21.15.137:0/2290333715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f645415e640 0x7f6454150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.892+0000 7f645b600640 1 --2- 172.21.15.137:0/2290333715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64540affa0 0x7f64540b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.892+0000 7f645b600640 1 --2- 172.21.15.137:0/2290333715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64540afbc0 0x7f645414d350 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.892+0000 7f645b600640 1 -- 172.21.15.137:0/2290333715 >> 172.21.15.137:0/2290333715 conn(0x7f645406c800 msgr2=0x7f64541514e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:21.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.892+0000 7f645b600640 1 -- 172.21.15.137:0/2290333715 shutdown_connections 2024-04-26T23:42:21.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:21.892+0000 7f645b600640 1 -- 172.21.15.137:0/2290333715 wait complete. 2024-04-26T23:42:21.918 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T23:42:22.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.048+0000 7fd51fa00640 1 Processor -- start 2024-04-26T23:42:22.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.048+0000 7fd51fa00640 1 -- start start 2024-04-26T23:42:22.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.048+0000 7fd51fa00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd5180d0520 0x7fd5180b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:22.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.048+0000 7fd51fa00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5180d3330 con 0x7fd518162940 2024-04-26T23:42:22.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.048+0000 7fd51fa00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5180d3600 con 0x7fd5180d00b0 2024-04-26T23:42:22.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.048+0000 7fd51fa00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd5180d38e0 con 0x7fd5180d0520 2024-04-26T23:42:22.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.048+0000 7fd51da00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd5180d0520 0x7fd5180b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:22.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.048+0000 7fd51d000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fd518162940 0x7fd5180d2c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58676/0 (socket says 172.21.15.137:58676) 2024-04-26T23:42:22.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.048+0000 7fd51d000640 1 -- 172.21.15.137:0/2749842252 learned_addr learned my addr 172.21.15.137:0/2749842252 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:22.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.048+0000 7fd51da00640 1 -- 172.21.15.137:0/2749842252 >> v1:172.21.15.170:6789/0 conn(0x7fd5180d00b0 legacy=0x7fd5180b8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:22.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.048+0000 7fd51da00640 1 -- 172.21.15.137:0/2749842252 >> v1:172.21.15.137:6789/0 conn(0x7fd518162940 legacy=0x7fd5180d2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:22.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.048+0000 7fd51da00640 1 -- 172.21.15.137:0/2749842252 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5180d3bc0 con 0x7fd5180d0520 2024-04-26T23:42:22.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.052+0000 7fd51da00640 1 --2- 172.21.15.137:0/2749842252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5180d0520 0x7fd5180b8b70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd5100097c0 tx=0x7fd51001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe1825234e2b142 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:22.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.052+0000 7fd517400640 1 -- 172.21.15.137:0/2749842252 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5100b5070 con 0x7fd5180d0520 2024-04-26T23:42:22.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.052+0000 7fd517400640 1 -- 172.21.15.137:0/2749842252 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5100a8950 con 0x7fd5180d0520 2024-04-26T23:42:22.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.052+0000 7fd517400640 1 -- 172.21.15.137:0/2749842252 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5100a8d20 con 0x7fd5180d0520 2024-04-26T23:42:22.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.052+0000 7fd51fa00640 1 -- 172.21.15.137:0/2749842252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5180d0520 msgr2=0x7fd5180b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:22.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.052+0000 7fd51fa00640 1 --2- 172.21.15.137:0/2749842252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5180d0520 0x7fd5180b8b70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd5100097c0 tx=0x7fd51001ec50 comp rx=0 tx=0).stop 2024-04-26T23:42:22.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.052+0000 7fd51fa00640 1 -- 172.21.15.137:0/2749842252 shutdown_connections 2024-04-26T23:42:22.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.052+0000 7fd51fa00640 1 --2- 172.21.15.137:0/2749842252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5180d0520 0x7fd5180b8b70 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:22.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.052+0000 7fd51fa00640 1 -- 172.21.15.137:0/2749842252 >> 172.21.15.137:0/2749842252 conn(0x7fd51806ca60 msgr2=0x7fd518072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:22.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.052+0000 7fd51fa00640 1 -- 172.21.15.137:0/2749842252 shutdown_connections 2024-04-26T23:42:22.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.052+0000 7fd51fa00640 1 -- 172.21.15.137:0/2749842252 wait complete. 2024-04-26T23:42:22.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd51fa00640 1 Processor -- start 2024-04-26T23:42:22.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd51fa00640 1 -- start start 2024-04-26T23:42:22.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd51fa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5180d00b0 0x7fd5181503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:22.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd51fa00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5180d0520 0x7fd5181e8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:22.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd51fa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd518162940 0x7fd5181e8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:22.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd51fa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd5180d0970 con 0x7fd518162940 2024-04-26T23:42:22.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd51fa00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd5180d4180 con 0x7fd5180d00b0 2024-04-26T23:42:22.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd51fa00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd5180cfc70 con 0x7fd5180d0520 2024-04-26T23:42:22.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd51da00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd518162940 0x7fd5181e8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:22.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd51da00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd518162940 0x7fd5181e8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36294/0 (socket says 172.21.15.137:36294) 2024-04-26T23:42:22.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd51da00640 1 -- 172.21.15.137:0/540999524 learned_addr learned my addr 172.21.15.137:0/540999524 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:22.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd51d000640 1 --2- 172.21.15.137:0/540999524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5180d00b0 0x7fd5181503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:22.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd517e00640 1 --2- 172.21.15.137:0/540999524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5180d0520 0x7fd5181e8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:22.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd51da00640 1 -- 172.21.15.137:0/540999524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5180d0520 msgr2=0x7fd5181e8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:22.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd51da00640 1 --2- 172.21.15.137:0/540999524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5180d0520 0x7fd5181e8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:22.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd51da00640 1 -- 172.21.15.137:0/540999524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5180d00b0 msgr2=0x7fd5181503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:22.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd51da00640 1 --2- 172.21.15.137:0/540999524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5180d00b0 0x7fd5181503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:22.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd51da00640 1 -- 172.21.15.137:0/540999524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5181e91c0 con 0x7fd518162940 2024-04-26T23:42:22.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd517e00640 1 --2- 172.21.15.137:0/540999524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5180d0520 0x7fd5181e8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:22.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd51da00640 1 --2- 172.21.15.137:0/540999524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd518162940 0x7fd5181e8b60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd5100b3040 tx=0x7fd51001b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:22.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd514c00640 1 -- 172.21.15.137:0/540999524 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5100bf070 con 0x7fd518162940 2024-04-26T23:42:22.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd514c00640 1 -- 172.21.15.137:0/540999524 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5100b0740 con 0x7fd518162940 2024-04-26T23:42:22.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd51fa00640 1 -- 172.21.15.137:0/540999524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5181e94a0 con 0x7fd518162940 2024-04-26T23:42:22.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd514c00640 1 -- 172.21.15.137:0/540999524 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5100b5040 con 0x7fd518162940 2024-04-26T23:42:22.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd51fa00640 1 -- 172.21.15.137:0/540999524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd518151230 con 0x7fd518162940 2024-04-26T23:42:22.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.056+0000 7fd51fa00640 1 -- 172.21.15.137:0/540999524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd51806a4b0 con 0x7fd518162940 2024-04-26T23:42:22.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.060+0000 7fd514c00640 1 -- 172.21.15.137:0/540999524 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd5100c2070 con 0x7fd518162940 2024-04-26T23:42:22.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.060+0000 7fd514c00640 1 --2- 172.21.15.137:0/540999524 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd4f8068380 0x7fd4f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:22.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.060+0000 7fd514c00640 1 -- 172.21.15.137:0/540999524 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fd510122ef0 con 0x7fd518162940 2024-04-26T23:42:22.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.060+0000 7fd51d000640 1 --2- 172.21.15.137:0/540999524 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd4f8068380 0x7fd4f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:22.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.060+0000 7fd51d000640 1 --2- 172.21.15.137:0/540999524 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd4f8068380 0x7fd4f806a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd5080012f0 tx=0x7fd508009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:22.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.064+0000 7fd514c00640 1 -- 172.21.15.137:0/540999524 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd5100187b0 con 0x7fd518162940 2024-04-26T23:42:22.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.220+0000 7fd51fa00640 1 -- 172.21.15.137:0/540999524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd5180cbee0 con 0x7fd518162940 2024-04-26T23:42:22.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.220+0000 7fd514c00640 1 -- 172.21.15.137:0/540999524 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) ==== 84+0+65 (secure 0 0 0) 0x7fd5100f3760 con 0x7fd518162940 2024-04-26T23:42:22.225 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:22.225 INFO:teuthology.orchestra.run.smithi137.stdout:[ 2024-04-26T23:42:22.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:42:22.226 INFO:teuthology.orchestra.run.smithi137.stdout: "poolnum": 1, 2024-04-26T23:42:22.226 INFO:teuthology.orchestra.run.smithi137.stdout: "poolname": ".mgr" 2024-04-26T23:42:22.226 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:22.226 INFO:teuthology.orchestra.run.smithi137.stdout:] 2024-04-26T23:42:22.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.220+0000 7fd51fa00640 1 -- 172.21.15.137:0/540999524 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd4f8068380 msgr2=0x7fd4f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:22.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.220+0000 7fd51fa00640 1 --2- 172.21.15.137:0/540999524 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd4f8068380 0x7fd4f806a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd5080012f0 tx=0x7fd508009040 comp rx=0 tx=0).stop 2024-04-26T23:42:22.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.220+0000 7fd51fa00640 1 -- 172.21.15.137:0/540999524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd518162940 msgr2=0x7fd5181e8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:22.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.220+0000 7fd51fa00640 1 --2- 172.21.15.137:0/540999524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd518162940 0x7fd5181e8b60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd5100b3040 tx=0x7fd51001b9f0 comp rx=0 tx=0).stop 2024-04-26T23:42:22.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.220+0000 7fd51fa00640 1 -- 172.21.15.137:0/540999524 shutdown_connections 2024-04-26T23:42:22.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.220+0000 7fd51fa00640 1 --2- 172.21.15.137:0/540999524 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd4f8068380 0x7fd4f806a840 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:22.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.220+0000 7fd51fa00640 1 --2- 172.21.15.137:0/540999524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd518162940 0x7fd5181e8b60 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:22.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.220+0000 7fd51fa00640 1 --2- 172.21.15.137:0/540999524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5180d0520 0x7fd5181e8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:22.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.220+0000 7fd51fa00640 1 --2- 172.21.15.137:0/540999524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5180d00b0 0x7fd5181503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:22.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.220+0000 7fd51fa00640 1 -- 172.21.15.137:0/540999524 >> 172.21.15.137:0/540999524 conn(0x7fd51806ca60 msgr2=0x7fd5180b9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:22.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.220+0000 7fd51fa00640 1 -- 172.21.15.137:0/540999524 shutdown_connections 2024-04-26T23:42:22.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.220+0000 7fd51fa00640 1 -- 172.21.15.137:0/540999524 wait complete. 2024-04-26T23:42:22.246 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T23:42:22.247 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T23:42:22.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.380+0000 7f46e9200640 1 Processor -- start 2024-04-26T23:42:22.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.380+0000 7f46e9200640 1 -- start start 2024-04-26T23:42:22.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.380+0000 7f46e9200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46e40b6820 0x7f46e4160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:22.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.380+0000 7f46e9200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e406d240 con 0x7f46e4145c30 2024-04-26T23:42:22.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.380+0000 7f46e9200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e4074410 con 0x7f46e4146410 2024-04-26T23:42:22.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.380+0000 7f46e9200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f46e4073890 con 0x7f46e40b6820 2024-04-26T23:42:22.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e1e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f46e4145c30 0x7f46e415d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58686/0 (socket says 172.21.15.137:58686) 2024-04-26T23:42:22.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e1e00640 1 -- 172.21.15.137:0/216045165 learned_addr learned my addr 172.21.15.137:0/216045165 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:22.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e2800640 1 --2- 172.21.15.137:0/216045165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46e40b6820 0x7f46e4160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:22.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e1400640 1 -- 172.21.15.137:0/216045165 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2766092021 0 0) 0x7f46e406d240 con 0x7f46e4145c30 2024-04-26T23:42:22.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e1400640 1 -- 172.21.15.137:0/216045165 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46c8003530 con 0x7f46e4145c30 2024-04-26T23:42:22.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e1400640 1 -- 172.21.15.137:0/216045165 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3197445132 0 0) 0x7f46e4074410 con 0x7f46e4146410 2024-04-26T23:42:22.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e1400640 1 -- 172.21.15.137:0/216045165 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46e406d240 con 0x7f46e4146410 2024-04-26T23:42:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e1400640 1 -- 172.21.15.137:0/216045165 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3609392173 0 0) 0x7f46c8003530 con 0x7f46e4145c30 2024-04-26T23:42:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e1400640 1 -- 172.21.15.137:0/216045165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46e40b6820 msgr2=0x7f46e4160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e1400640 1 --2- 172.21.15.137:0/216045165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46e40b6820 0x7f46e4160f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e1400640 1 -- 172.21.15.137:0/216045165 >> v1:172.21.15.170:6789/0 conn(0x7f46e4146410 legacy=0x7f46e40b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e1400640 1 -- 172.21.15.137:0/216045165 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e4073b70 con 0x7f46e4145c30 2024-04-26T23:42:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e1400640 1 -- 172.21.15.137:0/216045165 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f46d4001a00 con 0x7f46e4145c30 2024-04-26T23:42:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e1400640 1 -- 172.21.15.137:0/216045165 >> v1:172.21.15.137:6789/0 conn(0x7f46e4145c30 legacy=0x7f46e415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e1400640 1 --2- 172.21.15.137:0/216045165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46c8003b80 0x7f46c8003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e1400640 1 --2- 172.21.15.137:0/216045165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46c8004810 0x7f46c8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e1400640 1 --2- 172.21.15.137:0/216045165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46c80051d0 0x7f46c800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e1400640 1 -- 172.21.15.137:0/216045165 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f46e4073890 con 0x7f46c80051d0 2024-04-26T23:42:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e1400640 1 -- 172.21.15.137:0/216045165 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f46c800bf40 con 0x7f46c8004810 2024-04-26T23:42:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e1400640 1 -- 172.21.15.137:0/216045165 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f46c800c140 con 0x7f46c8003b80 2024-04-26T23:42:22.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e2800640 1 --2- 172.21.15.137:0/216045165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46c80051d0 0x7f46c800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:22.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e1e00640 1 --2- 172.21.15.137:0/216045165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46c8003b80 0x7f46c8003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:22.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46d9400640 1 --2- 172.21.15.137:0/216045165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46c8004810 0x7f46c8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:22.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e2800640 1 -- 172.21.15.137:0/216045165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46c8003b80 msgr2=0x7f46c8003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:22.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e2800640 1 --2- 172.21.15.137:0/216045165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46c8003b80 0x7f46c8003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:22.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e2800640 1 -- 172.21.15.137:0/216045165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46c8004810 msgr2=0x7f46c8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:22.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e2800640 1 --2- 172.21.15.137:0/216045165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46c8004810 0x7f46c8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:22.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.384+0000 7f46e2800640 1 -- 172.21.15.137:0/216045165 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c8003530 con 0x7f46c80051d0 2024-04-26T23:42:22.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.388+0000 7f46e2800640 1 --2- 172.21.15.137:0/216045165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46c80051d0 0x7f46c800b9d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f46e40ce010 tx=0x7f46dc01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da77a50c6012e7c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:22.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.388+0000 7f46e1400640 1 -- 172.21.15.137:0/216045165 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46dc009670 con 0x7f46c80051d0 2024-04-26T23:42:22.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.388+0000 7f46e1400640 1 -- 172.21.15.137:0/216045165 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46dc0a64d0 con 0x7f46c80051d0 2024-04-26T23:42:22.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.388+0000 7f46e1400640 1 -- 172.21.15.137:0/216045165 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46dc0a68c0 con 0x7f46c80051d0 2024-04-26T23:42:22.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.388+0000 7f46e9200640 1 -- 172.21.15.137:0/216045165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46c80051d0 msgr2=0x7f46c800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:22.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.388+0000 7f46e9200640 1 --2- 172.21.15.137:0/216045165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46c80051d0 0x7f46c800b9d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f46e40ce010 tx=0x7f46dc01c8d0 comp rx=0 tx=0).stop 2024-04-26T23:42:22.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.388+0000 7f46e2800640 1 -- 172.21.15.137:0/216045165 reap_dead start 2024-04-26T23:42:22.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.388+0000 7f46e9200640 1 -- 172.21.15.137:0/216045165 shutdown_connections 2024-04-26T23:42:22.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.388+0000 7f46e9200640 1 -- 172.21.15.137:0/216045165 >> 172.21.15.137:0/216045165 conn(0x7f46e406e2d0 msgr2=0x7f46e406e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:22.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.388+0000 7f46e9200640 1 -- 172.21.15.137:0/216045165 shutdown_connections 2024-04-26T23:42:22.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.388+0000 7f46e9200640 1 -- 172.21.15.137:0/216045165 wait complete. 2024-04-26T23:42:22.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.388+0000 7f46e9200640 1 Processor -- start 2024-04-26T23:42:22.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.388+0000 7f46e9200640 1 -- start start 2024-04-26T23:42:22.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46e9200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46e4158f40 0x7f46e413b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:22.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46e9200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46e413bc60 0x7f46e41f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:22.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46e9200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46e41f64e0 0x7f46e413d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:22.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46e9200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f46e4073540 con 0x7f46e4158f40 2024-04-26T23:42:22.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46e9200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f46e4074130 con 0x7f46e41f64e0 2024-04-26T23:42:22.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46e9200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f46e4146010 con 0x7f46e413bc60 2024-04-26T23:42:22.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46e1e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46e4158f40 0x7f46e413b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:22.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46e1e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46e4158f40 0x7f46e413b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36318/0 (socket says 172.21.15.137:36318) 2024-04-26T23:42:22.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46e1e00640 1 -- 172.21.15.137:0/2141671427 learned_addr learned my addr 172.21.15.137:0/2141671427 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:22.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46d9400640 1 --2- 172.21.15.137:0/2141671427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46e413bc60 0x7f46e41f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:22.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46e2800640 1 --2- 172.21.15.137:0/2141671427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46e41f64e0 0x7f46e413d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:22.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46e1e00640 1 -- 172.21.15.137:0/2141671427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46e413bc60 msgr2=0x7f46e41f5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:22.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46e1e00640 1 --2- 172.21.15.137:0/2141671427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46e413bc60 0x7f46e41f5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:22.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46e1e00640 1 -- 172.21.15.137:0/2141671427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46e41f64e0 msgr2=0x7f46e413d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:22.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46e1e00640 1 --2- 172.21.15.137:0/2141671427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46e41f64e0 0x7f46e413d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:22.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46e1e00640 1 -- 172.21.15.137:0/2141671427 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e415bf00 con 0x7f46e4158f40 2024-04-26T23:42:22.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46d9400640 1 --2- 172.21.15.137:0/2141671427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46e413bc60 0x7f46e41f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:22.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46e1e00640 1 --2- 172.21.15.137:0/2141671427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46e4158f40 0x7f46e413b720 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f46d4001ae0 tx=0x7f46d400f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:22.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46daa00640 1 -- 172.21.15.137:0/2141671427 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d400fe60 con 0x7f46e4158f40 2024-04-26T23:42:22.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46daa00640 1 -- 172.21.15.137:0/2141671427 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d401a070 con 0x7f46e4158f40 2024-04-26T23:42:22.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46e9200640 1 -- 172.21.15.137:0/2141671427 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e413c270 con 0x7f46e4158f40 2024-04-26T23:42:22.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46daa00640 1 -- 172.21.15.137:0/2141671427 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d4007390 con 0x7f46e4158f40 2024-04-26T23:42:22.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46e9200640 1 -- 172.21.15.137:0/2141671427 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e415d6b0 con 0x7f46e4158f40 2024-04-26T23:42:22.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46e9200640 1 -- 172.21.15.137:0/2141671427 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46e40765d0 con 0x7f46e4158f40 2024-04-26T23:42:22.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46daa00640 1 -- 172.21.15.137:0/2141671427 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f46d4013040 con 0x7f46e4158f40 2024-04-26T23:42:22.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.392+0000 7f46daa00640 1 --2- 172.21.15.137:0/2141671427 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f46c0068380 0x7f46c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:22.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.396+0000 7f46daa00640 1 -- 172.21.15.137:0/2141671427 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f46d4089e90 con 0x7f46e4158f40 2024-04-26T23:42:22.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.396+0000 7f46d9400640 1 --2- 172.21.15.137:0/2141671427 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f46c0068380 0x7f46c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:22.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.396+0000 7f46d9400640 1 --2- 172.21.15.137:0/2141671427 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f46c0068380 0x7f46c006a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f46e4072940 tx=0x7f46cc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:22.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.396+0000 7f46daa00640 1 -- 172.21.15.137:0/2141671427 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f46d405a8f0 con 0x7f46e4158f40 2024-04-26T23:42:22.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:22.556+0000 7f46e9200640 1 -- 172.21.15.137:0/2141671427 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f46e41f68c0 con 0x7f46e4158f40 2024-04-26T23:42:23.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.456+0000 7f46daa00640 1 -- 172.21.15.137:0/2141671427 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) ==== 138+0+0 (secure 0 0 0) 0x7f46d405a1f0 con 0x7f46e4158f40 2024-04-26T23:42:23.460 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' created 2024-04-26T23:42:23.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.456+0000 7f46e9200640 1 -- 172.21.15.137:0/2141671427 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f46c0068380 msgr2=0x7f46c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:23.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.456+0000 7f46e9200640 1 --2- 172.21.15.137:0/2141671427 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f46c0068380 0x7f46c006a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f46e4072940 tx=0x7f46cc009040 comp rx=0 tx=0).stop 2024-04-26T23:42:23.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.456+0000 7f46e9200640 1 -- 172.21.15.137:0/2141671427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46e4158f40 msgr2=0x7f46e413b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:23.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.456+0000 7f46e9200640 1 --2- 172.21.15.137:0/2141671427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46e4158f40 0x7f46e413b720 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f46d4001ae0 tx=0x7f46d400f5a0 comp rx=0 tx=0).stop 2024-04-26T23:42:23.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.460+0000 7f46e9200640 1 -- 172.21.15.137:0/2141671427 shutdown_connections 2024-04-26T23:42:23.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.460+0000 7f46e9200640 1 --2- 172.21.15.137:0/2141671427 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f46c0068380 0x7f46c006a840 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:23.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.460+0000 7f46e9200640 1 --2- 172.21.15.137:0/2141671427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46e41f64e0 0x7f46e413d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:23.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.460+0000 7f46e9200640 1 --2- 172.21.15.137:0/2141671427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46e413bc60 0x7f46e41f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:23.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.460+0000 7f46e9200640 1 --2- 172.21.15.137:0/2141671427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46e4158f40 0x7f46e413b720 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:23.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.460+0000 7f46e9200640 1 -- 172.21.15.137:0/2141671427 >> 172.21.15.137:0/2141671427 conn(0x7f46e406e2d0 msgr2=0x7f46e415c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:23.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.460+0000 7f46e9200640 1 -- 172.21.15.137:0/2141671427 shutdown_connections 2024-04-26T23:42:23.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.460+0000 7f46e9200640 1 -- 172.21.15.137:0/2141671427 wait complete. 2024-04-26T23:42:23.490 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T23:42:23.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.628+0000 7f28adc00640 1 Processor -- start 2024-04-26T23:42:23.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28adc00640 1 -- start start 2024-04-26T23:42:23.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28adc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28a80afbc0 0x7f28a815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:23.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28adc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28a8072860 con 0x7f28a8073f20 2024-04-26T23:42:23.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28adc00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28a80743b0 con 0x7f28a80affa0 2024-04-26T23:42:23.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28adc00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f28a8072b00 con 0x7f28a80afbc0 2024-04-26T23:42:23.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a6000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f28a8073f20 0x7f28a80735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58698/0 (socket says 172.21.15.137:58698) 2024-04-26T23:42:23.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a6000640 1 -- 172.21.15.137:0/4101527089 learned_addr learned my addr 172.21.15.137:0/4101527089 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:23.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a6a00640 1 --2- 172.21.15.137:0/4101527089 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28a80afbc0 0x7f28a815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:23.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a5600640 1 -- 172.21.15.137:0/4101527089 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2750844092 0 0) 0x7f28a8072860 con 0x7f28a8073f20 2024-04-26T23:42:23.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a5600640 1 -- 172.21.15.137:0/4101527089 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f288c003530 con 0x7f28a8073f20 2024-04-26T23:42:23.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a5600640 1 -- 172.21.15.137:0/4101527089 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4075431048 0 0) 0x7f288c003530 con 0x7f28a8073f20 2024-04-26T23:42:23.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a5600640 1 -- 172.21.15.137:0/4101527089 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28a80afbc0 msgr2=0x7f28a815df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:23.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a5600640 1 --2- 172.21.15.137:0/4101527089 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28a80afbc0 0x7f28a815df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:23.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a5600640 1 -- 172.21.15.137:0/4101527089 >> v1:172.21.15.170:6789/0 conn(0x7f28a80affa0 legacy=0x7f28a80ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:23.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a5600640 1 -- 172.21.15.137:0/4101527089 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a8072de0 con 0x7f28a8073f20 2024-04-26T23:42:23.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a5600640 1 -- 172.21.15.137:0/4101527089 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f2894001680 con 0x7f28a8073f20 2024-04-26T23:42:23.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a5600640 1 -- 172.21.15.137:0/4101527089 >> v1:172.21.15.137:6789/0 conn(0x7f28a8073f20 legacy=0x7f28a80735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:23.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a5600640 1 --2- 172.21.15.137:0/4101527089 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f288c0039f0 0x7f288c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:23.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a5600640 1 --2- 172.21.15.137:0/4101527089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f288c004810 0x7f288c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:23.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a5600640 1 --2- 172.21.15.137:0/4101527089 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28a80afbc0 0x7f288c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:23.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a5600640 1 -- 172.21.15.137:0/4101527089 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f28a8072b00 con 0x7f288c004810 2024-04-26T23:42:23.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a5600640 1 -- 172.21.15.137:0/4101527089 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f288c00ba80 con 0x7f288c0039f0 2024-04-26T23:42:23.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a5600640 1 -- 172.21.15.137:0/4101527089 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f288c00bc80 con 0x7f28a80afbc0 2024-04-26T23:42:23.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a6000640 1 --2- 172.21.15.137:0/4101527089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f288c004810 0x7f288c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:23.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a6a00640 1 --2- 172.21.15.137:0/4101527089 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f288c0039f0 0x7f288c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:23.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a7400640 1 --2- 172.21.15.137:0/4101527089 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28a80afbc0 0x7f288c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:23.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a6000640 1 -- 172.21.15.137:0/4101527089 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28a80afbc0 msgr2=0x7f288c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:23.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a6000640 1 --2- 172.21.15.137:0/4101527089 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28a80afbc0 0x7f288c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:23.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a6000640 1 -- 172.21.15.137:0/4101527089 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f288c0039f0 msgr2=0x7f288c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:23.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a6000640 1 --2- 172.21.15.137:0/4101527089 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f288c0039f0 0x7f288c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:23.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.632+0000 7f28a6000640 1 -- 172.21.15.137:0/4101527089 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f288c003530 con 0x7f288c004810 2024-04-26T23:42:23.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.636+0000 7f28a6000640 1 --2- 172.21.15.137:0/4101527089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f288c004810 0x7f288c004c90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f289400c190 tx=0x7f289401f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac7826a956c474e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:23.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.636+0000 7f28a5600640 1 -- 172.21.15.137:0/4101527089 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2894007d00 con 0x7f288c004810 2024-04-26T23:42:23.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.636+0000 7f28a5600640 1 -- 172.21.15.137:0/4101527089 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2894005b00 con 0x7f288c004810 2024-04-26T23:42:23.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.636+0000 7f28a5600640 1 -- 172.21.15.137:0/4101527089 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2894007070 con 0x7f288c004810 2024-04-26T23:42:23.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.636+0000 7f28adc00640 1 -- 172.21.15.137:0/4101527089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f288c004810 msgr2=0x7f288c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:23.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.636+0000 7f28adc00640 1 --2- 172.21.15.137:0/4101527089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f288c004810 0x7f288c004c90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f289400c190 tx=0x7f289401f370 comp rx=0 tx=0).stop 2024-04-26T23:42:23.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.636+0000 7f28a7400640 1 -- 172.21.15.137:0/4101527089 reap_dead start 2024-04-26T23:42:23.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.636+0000 7f28adc00640 1 -- 172.21.15.137:0/4101527089 shutdown_connections 2024-04-26T23:42:23.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.636+0000 7f28adc00640 1 -- 172.21.15.137:0/4101527089 >> 172.21.15.137:0/4101527089 conn(0x7f28a806c800 msgr2=0x7f28a806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:23.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.636+0000 7f28adc00640 1 -- 172.21.15.137:0/4101527089 shutdown_connections 2024-04-26T23:42:23.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.636+0000 7f28adc00640 1 -- 172.21.15.137:0/4101527089 wait complete. 2024-04-26T23:42:23.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f28adc00640 1 Processor -- start 2024-04-26T23:42:23.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f28adc00640 1 -- start start 2024-04-26T23:42:23.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f28adc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f288c004810 0x7f28a8157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:23.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f28adc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28a8155be0 0x7f28a8159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:23.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f28adc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28a815a070 0x7f28a815e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:23.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f28adc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f28a80ceac0 con 0x7f28a815a070 2024-04-26T23:42:23.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f28adc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f28a80d0850 con 0x7f28a8155be0 2024-04-26T23:42:23.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f28adc00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f28a80cec40 con 0x7f288c004810 2024-04-26T23:42:23.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f28a7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28a815a070 0x7f28a815e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:23.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f28a7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28a815a070 0x7f28a815e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36334/0 (socket says 172.21.15.137:36334) 2024-04-26T23:42:23.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f28a7400640 1 -- 172.21.15.137:0/614748271 learned_addr learned my addr 172.21.15.137:0/614748271 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:23.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f28a6000640 1 --2- 172.21.15.137:0/614748271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28a8155be0 0x7f28a8159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:23.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f28a6a00640 1 --2- 172.21.15.137:0/614748271 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f288c004810 0x7f28a8157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:23.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f28a7400640 1 -- 172.21.15.137:0/614748271 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f288c004810 msgr2=0x7f28a8157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:23.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f28a7400640 1 --2- 172.21.15.137:0/614748271 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f288c004810 0x7f28a8157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:23.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f28a7400640 1 -- 172.21.15.137:0/614748271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28a8155be0 msgr2=0x7f28a8159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:23.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f28a7400640 1 --2- 172.21.15.137:0/614748271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28a8155be0 0x7f28a8159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:23.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f28a7400640 1 -- 172.21.15.137:0/614748271 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a81583f0 con 0x7f28a815a070 2024-04-26T23:42:23.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f28a7400640 1 --2- 172.21.15.137:0/614748271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28a815a070 0x7f28a815e700 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f28a80cf200 tx=0x7f28a000fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:23.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f289ea00640 1 -- 172.21.15.137:0/614748271 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a001a070 con 0x7f28a815a070 2024-04-26T23:42:23.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f289ea00640 1 -- 172.21.15.137:0/614748271 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28a000fe60 con 0x7f28a815a070 2024-04-26T23:42:23.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f28adc00640 1 -- 172.21.15.137:0/614748271 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a8158a90 con 0x7f28a815a070 2024-04-26T23:42:23.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f289ea00640 1 -- 172.21.15.137:0/614748271 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a0003980 con 0x7f28a815a070 2024-04-26T23:42:23.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f28adc00640 1 -- 172.21.15.137:0/614748271 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a8159050 con 0x7f28a815a070 2024-04-26T23:42:23.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.640+0000 7f28adc00640 1 -- 172.21.15.137:0/614748271 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28a806a410 con 0x7f28a815a070 2024-04-26T23:42:23.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.644+0000 7f289ea00640 1 -- 172.21.15.137:0/614748271 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f28a001d070 con 0x7f28a815a070 2024-04-26T23:42:23.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.644+0000 7f289ea00640 1 --2- 172.21.15.137:0/614748271 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2888068380 0x7f288806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:23.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.644+0000 7f289ea00640 1 -- 172.21.15.137:0/614748271 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7f28a0085c80 con 0x7f28a815a070 2024-04-26T23:42:23.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.644+0000 7f28a6a00640 1 --2- 172.21.15.137:0/614748271 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2888068380 0x7f288806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:23.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.644+0000 7f28a6a00640 1 --2- 172.21.15.137:0/614748271 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2888068380 0x7f288806a840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2898009be0 tx=0x7f2898009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:23.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.648+0000 7f289ea00640 1 -- 172.21.15.137:0/614748271 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f28a81583f0 con 0x7f28a815a070 2024-04-26T23:42:23.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:23.808+0000 7f28adc00640 1 -- 172.21.15.137:0/614748271 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f28a806d410 con 0x7f28a815a070 2024-04-26T23:42:24.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.464+0000 7f289ea00640 1 -- 172.21.15.137:0/614748271 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) ==== 170+0+0 (secure 0 0 0) 0x7f28a0055d30 con 0x7f28a815a070 2024-04-26T23:42:24.469 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' created 2024-04-26T23:42:24.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.464+0000 7f28adc00640 1 -- 172.21.15.137:0/614748271 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2888068380 msgr2=0x7f288806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:24.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.464+0000 7f28adc00640 1 --2- 172.21.15.137:0/614748271 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2888068380 0x7f288806a840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2898009be0 tx=0x7f2898009190 comp rx=0 tx=0).stop 2024-04-26T23:42:24.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.464+0000 7f28adc00640 1 -- 172.21.15.137:0/614748271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28a815a070 msgr2=0x7f28a815e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:24.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.464+0000 7f28adc00640 1 --2- 172.21.15.137:0/614748271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28a815a070 0x7f28a815e700 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f28a80cf200 tx=0x7f28a000fc10 comp rx=0 tx=0).stop 2024-04-26T23:42:24.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.464+0000 7f28adc00640 1 -- 172.21.15.137:0/614748271 shutdown_connections 2024-04-26T23:42:24.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.468+0000 7f28adc00640 1 --2- 172.21.15.137:0/614748271 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2888068380 0x7f288806a840 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:24.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.468+0000 7f28adc00640 1 --2- 172.21.15.137:0/614748271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28a815a070 0x7f28a815e700 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:24.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.468+0000 7f28adc00640 1 --2- 172.21.15.137:0/614748271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28a8155be0 0x7f28a8159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:24.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.468+0000 7f28adc00640 1 --2- 172.21.15.137:0/614748271 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f288c004810 0x7f28a8157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:24.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.468+0000 7f28adc00640 1 -- 172.21.15.137:0/614748271 >> 172.21.15.137:0/614748271 conn(0x7f28a806c800 msgr2=0x7f28a806f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:24.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.468+0000 7f28adc00640 1 -- 172.21.15.137:0/614748271 shutdown_connections 2024-04-26T23:42:24.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.468+0000 7f28adc00640 1 -- 172.21.15.137:0/614748271 wait complete. 2024-04-26T23:42:24.516 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T23:42:24.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.652+0000 7f78e4c00640 1 Processor -- start 2024-04-26T23:42:24.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.652+0000 7f78e4c00640 1 -- start start 2024-04-26T23:42:24.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.652+0000 7f78e4c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f78e00b54e0 0x7f78e00b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:24.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.652+0000 7f78e4c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78e0160000 0x7f78e0144d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:24.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.652+0000 7f78e4c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e00cffa0 con 0x7f78e00cd710 2024-04-26T23:42:24.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.652+0000 7f78e4c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f78e00b3d90 con 0x7f78e00b54e0 2024-04-26T23:42:24.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.652+0000 7f78e4c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f78e00d0840 con 0x7f78e0160000 2024-04-26T23:42:24.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.652+0000 7f78de800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78e0160000 0x7f78e0144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:24.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.652+0000 7f78dde00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f78e00b54e0 0x7f78e00b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:24.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.652+0000 7f78de800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78e0160000 0x7f78e0144d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:55702/0 (socket says 172.21.15.137:55702) 2024-04-26T23:42:24.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.652+0000 7f78de800640 1 -- 172.21.15.137:0/174441380 learned_addr learned my addr 172.21.15.137:0/174441380 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:24.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.656+0000 7f78de800640 1 -- 172.21.15.137:0/174441380 >> v2:172.21.15.170:3300/0 conn(0x7f78e00b54e0 msgr2=0x7f78e00b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:24.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.656+0000 7f78de800640 1 --2- 172.21.15.137:0/174441380 >> v2:172.21.15.170:3300/0 conn(0x7f78e00b54e0 0x7f78e00b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:24.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.656+0000 7f78de800640 1 -- 172.21.15.137:0/174441380 >> v1:172.21.15.170:6789/0 conn(0x7f78e00cd710 legacy=0x7f78e015f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:24.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.656+0000 7f78de800640 1 -- 172.21.15.137:0/174441380 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e00d0280 con 0x7f78e0160000 2024-04-26T23:42:24.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.656+0000 7f78de800640 1 --2- 172.21.15.137:0/174441380 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78e0160000 0x7f78e0144d20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009870 tx=0x7f78d801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2102f2a78d068014 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:24.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.656+0000 7f78dd400640 1 -- 172.21.15.137:0/174441380 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d80a9610 con 0x7f78e0160000 2024-04-26T23:42:24.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.656+0000 7f78dd400640 1 -- 172.21.15.137:0/174441380 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78e0145a70 con 0x7f78e0160000 2024-04-26T23:42:24.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.656+0000 7f78dd400640 1 -- 172.21.15.137:0/174441380 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d80a99d0 con 0x7f78e0160000 2024-04-26T23:42:24.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.656+0000 7f78e4c00640 1 -- 172.21.15.137:0/174441380 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78e0160000 msgr2=0x7f78e0144d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:24.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.656+0000 7f78e4c00640 1 --2- 172.21.15.137:0/174441380 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78e0160000 0x7f78e0144d20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009870 tx=0x7f78d801c530 comp rx=0 tx=0).stop 2024-04-26T23:42:24.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.656+0000 7f78e4c00640 1 -- 172.21.15.137:0/174441380 shutdown_connections 2024-04-26T23:42:24.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.656+0000 7f78e4c00640 1 --2- 172.21.15.137:0/174441380 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78e0160000 0x7f78e0144d20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:24.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.656+0000 7f78e4c00640 1 --2- 172.21.15.137:0/174441380 >> v2:172.21.15.170:3300/0 conn(0x7f78e00b54e0 0x7f78e00b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:24.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.656+0000 7f78e4c00640 1 -- 172.21.15.137:0/174441380 >> 172.21.15.137:0/174441380 conn(0x7f78e006c800 msgr2=0x7f78e006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:24.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.660+0000 7f78e4c00640 1 -- 172.21.15.137:0/174441380 shutdown_connections 2024-04-26T23:42:24.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.660+0000 7f78e4c00640 1 -- 172.21.15.137:0/174441380 wait complete. 2024-04-26T23:42:24.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.660+0000 7f78e4c00640 1 Processor -- start 2024-04-26T23:42:24.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.660+0000 7f78e4c00640 1 -- start start 2024-04-26T23:42:24.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.660+0000 7f78e4c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78e00b54e0 0x7f78e015b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:24.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.660+0000 7f78e4c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78e00cd710 0x7f78e015a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:24.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.660+0000 7f78e4c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78e0160000 0x7f78e013bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:24.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.660+0000 7f78e4c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f78e00cdb20 con 0x7f78e00b54e0 2024-04-26T23:42:24.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.660+0000 7f78e4c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f78e00724b0 con 0x7f78e0160000 2024-04-26T23:42:24.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.660+0000 7f78e4c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f78e015bc20 con 0x7f78e00cd710 2024-04-26T23:42:24.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.660+0000 7f78dde00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78e00b54e0 0x7f78e015b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:24.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.660+0000 7f78dde00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78e00b54e0 0x7f78e015b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36338/0 (socket says 172.21.15.137:36338) 2024-04-26T23:42:24.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.660+0000 7f78dde00640 1 -- 172.21.15.137:0/2874618024 learned_addr learned my addr 172.21.15.137:0/2874618024 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:24.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.660+0000 7f78de800640 1 --2- 172.21.15.137:0/2874618024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78e0160000 0x7f78e013bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:24.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.660+0000 7f78d5400640 1 --2- 172.21.15.137:0/2874618024 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78e00cd710 0x7f78e015a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:24.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.660+0000 7f78dde00640 1 -- 172.21.15.137:0/2874618024 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78e00cd710 msgr2=0x7f78e015a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:24.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.660+0000 7f78dde00640 1 --2- 172.21.15.137:0/2874618024 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78e00cd710 0x7f78e015a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:24.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.660+0000 7f78dde00640 1 -- 172.21.15.137:0/2874618024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78e0160000 msgr2=0x7f78e013bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:24.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.660+0000 7f78dde00640 1 --2- 172.21.15.137:0/2874618024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78e0160000 0x7f78e013bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:24.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.660+0000 7f78dde00640 1 -- 172.21.15.137:0/2874618024 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e013e830 con 0x7f78e00b54e0 2024-04-26T23:42:24.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.660+0000 7f78dde00640 1 --2- 172.21.15.137:0/2874618024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78e00b54e0 0x7f78e015b6e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009db0 tx=0x7f78d000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:24.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.664+0000 7f78d6a00640 1 -- 172.21.15.137:0/2874618024 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0018020 con 0x7f78e00b54e0 2024-04-26T23:42:24.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.664+0000 7f78d6a00640 1 -- 172.21.15.137:0/2874618024 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d0014480 con 0x7f78e00b54e0 2024-04-26T23:42:24.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.664+0000 7f78d6a00640 1 -- 172.21.15.137:0/2874618024 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0014850 con 0x7f78e00b54e0 2024-04-26T23:42:24.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.664+0000 7f78e4c00640 1 -- 172.21.15.137:0/2874618024 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e015a920 con 0x7f78e00b54e0 2024-04-26T23:42:24.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.664+0000 7f78e4c00640 1 -- 172.21.15.137:0/2874618024 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e015aee0 con 0x7f78e00b54e0 2024-04-26T23:42:24.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.664+0000 7f78e4c00640 1 -- 172.21.15.137:0/2874618024 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78e006a410 con 0x7f78e00b54e0 2024-04-26T23:42:24.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.664+0000 7f78d6a00640 1 -- 172.21.15.137:0/2874618024 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f78d001b020 con 0x7f78e00b54e0 2024-04-26T23:42:24.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.664+0000 7f78d6a00640 1 --2- 172.21.15.137:0/2874618024 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f78bc068380 0x7f78bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:24.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.664+0000 7f78d6a00640 1 -- 172.21.15.137:0/2874618024 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5609+0+0 (secure 0 0 0) 0x7f78d0087c10 con 0x7f78e00b54e0 2024-04-26T23:42:24.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.664+0000 7f78d5400640 1 --2- 172.21.15.137:0/2874618024 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f78bc068380 0x7f78bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:24.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.668+0000 7f78d5400640 1 --2- 172.21.15.137:0/2874618024 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f78bc068380 0x7f78bc06a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f78e013b810 tx=0x7f78c8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:24.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.668+0000 7f78d6a00640 1 -- 172.21.15.137:0/2874618024 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f78d0022070 con 0x7f78e00b54e0 2024-04-26T23:42:24.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:24.860+0000 7f78e4c00640 1 -- 172.21.15.137:0/2874618024 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f78e013ba70 con 0x7f78e00b54e0 2024-04-26T23:42:25.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.464+0000 7f78d6a00640 1 -- 172.21.15.137:0/2874618024 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7f78d0010040 con 0x7f78e00b54e0 2024-04-26T23:42:25.471 INFO:teuthology.orchestra.run.smithi137.stderr:new fs with metadata pool 4 and data pool 5 2024-04-26T23:42:25.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.468+0000 7f78e4c00640 1 -- 172.21.15.137:0/2874618024 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f78bc068380 msgr2=0x7f78bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:25.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.468+0000 7f78e4c00640 1 --2- 172.21.15.137:0/2874618024 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f78bc068380 0x7f78bc06a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f78e013b810 tx=0x7f78c8009040 comp rx=0 tx=0).stop 2024-04-26T23:42:25.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.468+0000 7f78e4c00640 1 -- 172.21.15.137:0/2874618024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78e00b54e0 msgr2=0x7f78e015b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:25.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.468+0000 7f78e4c00640 1 --2- 172.21.15.137:0/2874618024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78e00b54e0 0x7f78e015b6e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009db0 tx=0x7f78d000c490 comp rx=0 tx=0).stop 2024-04-26T23:42:25.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.472+0000 7f78e4c00640 1 -- 172.21.15.137:0/2874618024 shutdown_connections 2024-04-26T23:42:25.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.472+0000 7f78e4c00640 1 --2- 172.21.15.137:0/2874618024 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f78bc068380 0x7f78bc06a840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.472+0000 7f78e4c00640 1 --2- 172.21.15.137:0/2874618024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78e0160000 0x7f78e013bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.472+0000 7f78e4c00640 1 --2- 172.21.15.137:0/2874618024 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78e00cd710 0x7f78e015a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.472+0000 7f78e4c00640 1 --2- 172.21.15.137:0/2874618024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78e00b54e0 0x7f78e015b6e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.472+0000 7f78e4c00640 1 -- 172.21.15.137:0/2874618024 >> 172.21.15.137:0/2874618024 conn(0x7f78e006c800 msgr2=0x7f78e0072920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:25.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.472+0000 7f78e4c00640 1 -- 172.21.15.137:0/2874618024 shutdown_connections 2024-04-26T23:42:25.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.472+0000 7f78e4c00640 1 -- 172.21.15.137:0/2874618024 wait complete. 2024-04-26T23:42:25.517 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:42:25.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.648+0000 7f8bb9c00640 1 Processor -- start 2024-04-26T23:42:25.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.652+0000 7f8bb9c00640 1 -- start start 2024-04-26T23:42:25.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.652+0000 7f8bb9c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb4074450 0x7f8bb40723a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:25.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.652+0000 7f8bb9c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8bb40cf6f0 0x7f8bb40b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:25.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.652+0000 7f8bb9c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb406f200 con 0x7f8bb415bb70 2024-04-26T23:42:25.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.652+0000 7f8bb9c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8bb40cfb60 con 0x7f8bb40cf6f0 2024-04-26T23:42:25.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.652+0000 7f8bb9c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb40cfdb0 con 0x7f8bb4074450 2024-04-26T23:42:25.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.652+0000 7f8bb9200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8bb40cf6f0 0x7f8bb40b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:25.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.652+0000 7f8bb9200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8bb40cf6f0 0x7f8bb40b41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36342/0 (socket says 172.21.15.137:36342) 2024-04-26T23:42:25.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.652+0000 7f8bb9200640 1 -- 172.21.15.137:0/2525433094 learned_addr learned my addr 172.21.15.137:0/2525433094 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:25.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.652+0000 7f8bb3400640 1 --2- 172.21.15.137:0/2525433094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb4074450 0x7f8bb40723a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:25.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.652+0000 7f8bb9200640 1 -- 172.21.15.137:0/2525433094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb4074450 msgr2=0x7f8bb40723a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:25.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.652+0000 7f8bb9200640 1 --2- 172.21.15.137:0/2525433094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb4074450 0x7f8bb40723a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.652+0000 7f8bb9200640 1 -- 172.21.15.137:0/2525433094 >> v1:172.21.15.170:6789/0 conn(0x7f8bb415bb70 legacy=0x7f8bb4073d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:25.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.652+0000 7f8bb9200640 1 -- 172.21.15.137:0/2525433094 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb40d0090 con 0x7f8bb40cf6f0 2024-04-26T23:42:25.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.656+0000 7f8bb9200640 1 --2- 172.21.15.137:0/2525433094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bb40cf6f0 0x7f8bb40b41c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00d150 tx=0x7f8bac01ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbab210f51654aac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:25.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.656+0000 7f8bb2a00640 1 -- 172.21.15.137:0/2525433094 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bac0a7cd0 con 0x7f8bb40cf6f0 2024-04-26T23:42:25.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.656+0000 7f8bb2a00640 1 -- 172.21.15.137:0/2525433094 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bac00b0d0 con 0x7f8bb40cf6f0 2024-04-26T23:42:25.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.656+0000 7f8bb2a00640 1 -- 172.21.15.137:0/2525433094 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bac009600 con 0x7f8bb40cf6f0 2024-04-26T23:42:25.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.656+0000 7f8bb9c00640 1 -- 172.21.15.137:0/2525433094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bb40cf6f0 msgr2=0x7f8bb40b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:25.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.656+0000 7f8bb9c00640 1 --2- 172.21.15.137:0/2525433094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bb40cf6f0 0x7f8bb40b41c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00d150 tx=0x7f8bac01ec00 comp rx=0 tx=0).stop 2024-04-26T23:42:25.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.656+0000 7f8bb9c00640 1 -- 172.21.15.137:0/2525433094 shutdown_connections 2024-04-26T23:42:25.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.656+0000 7f8bb9c00640 1 --2- 172.21.15.137:0/2525433094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bb40cf6f0 0x7f8bb40b41c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.656+0000 7f8bb9c00640 1 --2- 172.21.15.137:0/2525433094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb4074450 0x7f8bb40723a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.656+0000 7f8bb9c00640 1 -- 172.21.15.137:0/2525433094 >> 172.21.15.137:0/2525433094 conn(0x7f8bb406e2b0 msgr2=0x7f8bb406e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:25.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.656+0000 7f8bb9c00640 1 -- 172.21.15.137:0/2525433094 shutdown_connections 2024-04-26T23:42:25.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.656+0000 7f8bb9c00640 1 -- 172.21.15.137:0/2525433094 wait complete. 2024-04-26T23:42:25.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.656+0000 7f8bb9c00640 1 Processor -- start 2024-04-26T23:42:25.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.656+0000 7f8bb9c00640 1 -- start start 2024-04-26T23:42:25.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8bb9c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb4074450 0x7f8bb4163bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:25.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8bb9c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bb40cf6f0 0x7f8bb4146d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:25.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8bb9c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bb415bb70 0x7f8bb41489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:25.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8bb9c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb415c0d0 con 0x7f8bb40cf6f0 2024-04-26T23:42:25.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8bb9c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb415bf50 con 0x7f8bb415bb70 2024-04-26T23:42:25.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8bb9c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb40b4f10 con 0x7f8bb4074450 2024-04-26T23:42:25.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8bb3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bb40cf6f0 0x7f8bb4146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:25.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8bb3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bb40cf6f0 0x7f8bb4146d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36350/0 (socket says 172.21.15.137:36350) 2024-04-26T23:42:25.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8bb3400640 1 -- 172.21.15.137:0/3021624744 learned_addr learned my addr 172.21.15.137:0/3021624744 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:25.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8bb3e00640 1 --2- 172.21.15.137:0/3021624744 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb4074450 0x7f8bb4163bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:25.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8bb9200640 1 --2- 172.21.15.137:0/3021624744 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bb415bb70 0x7f8bb41489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:25.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8bb3400640 1 -- 172.21.15.137:0/3021624744 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb4074450 msgr2=0x7f8bb4163bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:25.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8bb3400640 1 --2- 172.21.15.137:0/3021624744 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb4074450 0x7f8bb4163bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8bb3400640 1 -- 172.21.15.137:0/3021624744 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bb415bb70 msgr2=0x7f8bb41489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:25.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8bb3400640 1 --2- 172.21.15.137:0/3021624744 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bb415bb70 0x7f8bb41489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8bb3400640 1 -- 172.21.15.137:0/3021624744 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb41643e0 con 0x7f8bb40cf6f0 2024-04-26T23:42:25.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8bb3400640 1 --2- 172.21.15.137:0/3021624744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bb40cf6f0 0x7f8bb4146d60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000e8d0 tx=0x7f8ba000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:25.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8babe00640 1 -- 172.21.15.137:0/3021624744 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0017070 con 0x7f8bb40cf6f0 2024-04-26T23:42:25.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8babe00640 1 -- 172.21.15.137:0/3021624744 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba000c940 con 0x7f8bb40cf6f0 2024-04-26T23:42:25.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8babe00640 1 -- 172.21.15.137:0/3021624744 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba000ccf0 con 0x7f8bb40cf6f0 2024-04-26T23:42:25.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8bb9c00640 1 -- 172.21.15.137:0/3021624744 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb41646c0 con 0x7f8bb40cf6f0 2024-04-26T23:42:25.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8bb9c00640 1 -- 172.21.15.137:0/3021624744 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb41640f0 con 0x7f8bb40cf6f0 2024-04-26T23:42:25.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8bb9c00640 1 -- 172.21.15.137:0/3021624744 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bb406a410 con 0x7f8bb40cf6f0 2024-04-26T23:42:25.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.660+0000 7f8babe00640 1 -- 172.21.15.137:0/3021624744 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8ba001a070 con 0x7f8bb40cf6f0 2024-04-26T23:42:25.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.664+0000 7f8babe00640 1 --2- 172.21.15.137:0/3021624744 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8b94068380 0x7f8b9406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:25.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.664+0000 7f8babe00640 1 -- 172.21.15.137:0/3021624744 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f8ba0086d00 con 0x7f8bb40cf6f0 2024-04-26T23:42:25.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.664+0000 7f8bb3e00640 1 --2- 172.21.15.137:0/3021624744 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8b94068380 0x7f8b9406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:25.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.664+0000 7f8bb3e00640 1 --2- 172.21.15.137:0/3021624744 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8b94068380 0x7f8b9406a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4158be0 tx=0x7f8ba4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:25.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.668+0000 7f8babe00640 1 -- 172.21.15.137:0/3021624744 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8ba0056bd0 con 0x7f8bb40cf6f0 2024-04-26T23:42:25.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.828+0000 7f8bb9c00640 1 -- 172.21.15.137:0/3021624744 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8bb40b3c90 con 0x7f8bb40cf6f0 2024-04-26T23:42:25.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.828+0000 7f8babe00640 1 -- 172.21.15.137:0/3021624744 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16730 (secure 0 0 0) 0x7f8ba005aed0 con 0x7f8bb40cf6f0 2024-04-26T23:42:25.834 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:25.834 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":32,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:42:24.865502+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:42:22.570062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:42:23.822598+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:42:25.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.832+0000 7f8bb9c00640 1 -- 172.21.15.137:0/3021624744 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8b94068380 msgr2=0x7f8b9406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:25.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.832+0000 7f8bb9c00640 1 --2- 172.21.15.137:0/3021624744 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8b94068380 0x7f8b9406a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4158be0 tx=0x7f8ba4009040 comp rx=0 tx=0).stop 2024-04-26T23:42:25.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.832+0000 7f8bb9c00640 1 -- 172.21.15.137:0/3021624744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bb40cf6f0 msgr2=0x7f8bb4146d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:25.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.832+0000 7f8bb9c00640 1 --2- 172.21.15.137:0/3021624744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bb40cf6f0 0x7f8bb4146d60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000e8d0 tx=0x7f8ba000ed90 comp rx=0 tx=0).stop 2024-04-26T23:42:25.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.832+0000 7f8bb9c00640 1 -- 172.21.15.137:0/3021624744 shutdown_connections 2024-04-26T23:42:25.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.832+0000 7f8bb9c00640 1 --2- 172.21.15.137:0/3021624744 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8b94068380 0x7f8b9406a840 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.832+0000 7f8bb9c00640 1 --2- 172.21.15.137:0/3021624744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bb40cf6f0 0x7f8bb4146d60 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.832+0000 7f8bb9c00640 1 --2- 172.21.15.137:0/3021624744 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bb415bb70 0x7f8bb41489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.832+0000 7f8bb9c00640 1 --2- 172.21.15.137:0/3021624744 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb4074450 0x7f8bb4163bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.832+0000 7f8bb9c00640 1 -- 172.21.15.137:0/3021624744 >> 172.21.15.137:0/3021624744 conn(0x7f8bb406e2b0 msgr2=0x7f8bb415a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:25.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.832+0000 7f8bb9c00640 1 -- 172.21.15.137:0/3021624744 shutdown_connections 2024-04-26T23:42:25.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.832+0000 7f8bb9c00640 1 -- 172.21.15.137:0/3021624744 wait complete. 2024-04-26T23:42:25.855 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:42:25.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.984+0000 7f590de00640 1 Processor -- start 2024-04-26T23:42:25.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.984+0000 7f590de00640 1 -- start start 2024-04-26T23:42:25.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.984+0000 7f590de00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59080b5080 0x7f59080cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:25.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.984+0000 7f590de00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5908072980 0x7f5908072e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:25.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.984+0000 7f590de00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59080cfef0 con 0x7f59080725a0 2024-04-26T23:42:25.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.984+0000 7f590de00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f59080cddc0 con 0x7f5908072980 2024-04-26T23:42:25.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.984+0000 7f590de00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f59080d01b0 con 0x7f59080b5080 2024-04-26T23:42:25.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.984+0000 7f5907400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5908072980 0x7f5908072e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:25.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.984+0000 7f58fe000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59080b5080 0x7f59080cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:25.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.984+0000 7f5907400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5908072980 0x7f5908072e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:39752/0 (socket says 172.21.15.137:39752) 2024-04-26T23:42:25.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.984+0000 7f5907400640 1 -- 172.21.15.137:0/1695099881 learned_addr learned my addr 172.21.15.137:0/1695099881 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:25.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.984+0000 7f5906a00640 1 --1- 172.21.15.137:0/1695099881 >> v1:172.21.15.170:6789/0 conn(0x7f59080725a0 0x7f5908073f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:60646/0 (socket says 172.21.15.137:60646) 2024-04-26T23:42:25.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.988+0000 7f58fe000640 1 -- 172.21.15.137:0/1695099881 >> v2:172.21.15.170:3300/0 conn(0x7f5908072980 msgr2=0x7f5908072e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:25.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.988+0000 7f58fe000640 1 --2- 172.21.15.137:0/1695099881 >> v2:172.21.15.170:3300/0 conn(0x7f5908072980 0x7f5908072e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.988+0000 7f58fe000640 1 -- 172.21.15.137:0/1695099881 >> v1:172.21.15.170:6789/0 conn(0x7f59080725a0 legacy=0x7f5908073f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:25.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.988+0000 7f58fe000640 1 -- 172.21.15.137:0/1695099881 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59080d0490 con 0x7f59080b5080 2024-04-26T23:42:25.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.988+0000 7f58fe000640 1 --2- 172.21.15.137:0/1695099881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59080b5080 0x7f59080cd770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f58f00097c0 tx=0x7f58f001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=924836a1bcd7126c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:25.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.988+0000 7f5906000640 1 -- 172.21.15.137:0/1695099881 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f00aa5f0 con 0x7f59080b5080 2024-04-26T23:42:25.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.988+0000 7f5906000640 1 -- 172.21.15.137:0/1695099881 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f00af070 con 0x7f59080b5080 2024-04-26T23:42:25.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.988+0000 7f5906000640 1 -- 172.21.15.137:0/1695099881 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f00aa9b0 con 0x7f59080b5080 2024-04-26T23:42:25.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.988+0000 7f590de00640 1 -- 172.21.15.137:0/1695099881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59080b5080 msgr2=0x7f59080cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:25.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.988+0000 7f590de00640 1 --2- 172.21.15.137:0/1695099881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59080b5080 0x7f59080cd770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f58f00097c0 tx=0x7f58f001c470 comp rx=0 tx=0).stop 2024-04-26T23:42:25.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.988+0000 7f590de00640 1 -- 172.21.15.137:0/1695099881 shutdown_connections 2024-04-26T23:42:25.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.988+0000 7f590de00640 1 --2- 172.21.15.137:0/1695099881 >> v2:172.21.15.170:3300/0 conn(0x7f5908072980 0x7f5908072e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.988+0000 7f590de00640 1 --2- 172.21.15.137:0/1695099881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59080b5080 0x7f59080cd770 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.988+0000 7f590de00640 1 -- 172.21.15.137:0/1695099881 >> 172.21.15.137:0/1695099881 conn(0x7f590806c5d0 msgr2=0x7f590806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:25.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f590de00640 1 -- 172.21.15.137:0/1695099881 shutdown_connections 2024-04-26T23:42:25.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f590de00640 1 -- 172.21.15.137:0/1695099881 wait complete. 2024-04-26T23:42:25.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f590de00640 1 Processor -- start 2024-04-26T23:42:25.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f590de00640 1 -- start start 2024-04-26T23:42:25.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f590de00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59080725a0 0x7f590815edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:25.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f590de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5908072980 0x7f5908159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:25.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f590de00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59080b5080 0x7f590815cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:25.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f590de00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f590806ef10 con 0x7f59080725a0 2024-04-26T23:42:25.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f590de00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f590806ed90 con 0x7f5908072980 2024-04-26T23:42:25.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f590de00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f590806f090 con 0x7f59080b5080 2024-04-26T23:42:25.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f5906a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59080725a0 0x7f590815edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:25.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f5906a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59080725a0 0x7f590815edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36356/0 (socket says 172.21.15.137:36356) 2024-04-26T23:42:25.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f5906a00640 1 -- 172.21.15.137:0/300143229 learned_addr learned my addr 172.21.15.137:0/300143229 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:25.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f58fe000640 1 --2- 172.21.15.137:0/300143229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5908072980 0x7f5908159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:25.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f5907400640 1 --2- 172.21.15.137:0/300143229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59080b5080 0x7f590815cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:25.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f5906a00640 1 -- 172.21.15.137:0/300143229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59080b5080 msgr2=0x7f590815cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:25.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f5906a00640 1 --2- 172.21.15.137:0/300143229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59080b5080 0x7f590815cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f5906a00640 1 -- 172.21.15.137:0/300143229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5908072980 msgr2=0x7f5908159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:25.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f5906a00640 1 --2- 172.21.15.137:0/300143229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5908072980 0x7f5908159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f5906a00640 1 -- 172.21.15.137:0/300143229 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5908139770 con 0x7f59080725a0 2024-04-26T23:42:26.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f5906a00640 1 --2- 172.21.15.137:0/300143229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59080725a0 0x7f590815edc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f58f800c370 tx=0x7f58f800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:26.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f58ffe00640 1 -- 172.21.15.137:0/300143229 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f80074e0 con 0x7f59080725a0 2024-04-26T23:42:26.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.992+0000 7f58ffe00640 1 -- 172.21.15.137:0/300143229 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f8007680 con 0x7f59080725a0 2024-04-26T23:42:26.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.996+0000 7f58ffe00640 1 -- 172.21.15.137:0/300143229 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f8004a30 con 0x7f59080725a0 2024-04-26T23:42:26.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.996+0000 7f590de00640 1 -- 172.21.15.137:0/300143229 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f590813eeb0 con 0x7f59080725a0 2024-04-26T23:42:26.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.996+0000 7f590de00640 1 -- 172.21.15.137:0/300143229 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f590813f470 con 0x7f59080725a0 2024-04-26T23:42:26.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.996+0000 7f590de00640 1 -- 172.21.15.137:0/300143229 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f590806a4b0 con 0x7f59080725a0 2024-04-26T23:42:26.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.996+0000 7f58ffe00640 1 -- 172.21.15.137:0/300143229 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f58f801a020 con 0x7f59080725a0 2024-04-26T23:42:26.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.996+0000 7f58ffe00640 1 --2- 172.21.15.137:0/300143229 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f58e4068380 0x7f58e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:26.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.996+0000 7f58ffe00640 1 -- 172.21.15.137:0/300143229 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f58f8085fe0 con 0x7f59080725a0 2024-04-26T23:42:26.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.996+0000 7f58fe000640 1 --2- 172.21.15.137:0/300143229 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f58e4068380 0x7f58e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:26.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:25.996+0000 7f58fe000640 1 --2- 172.21.15.137:0/300143229 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f58e4068380 0x7f58e406a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f58f00ae000 tx=0x7f58f00b5040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:26.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.000+0000 7f58ffe00640 1 -- 172.21.15.137:0/300143229 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f58f8055fa0 con 0x7f59080725a0 2024-04-26T23:42:26.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.156+0000 7f590de00640 1 -- 172.21.15.137:0/300143229 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5908072380 con 0x7f59080725a0 2024-04-26T23:42:26.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.160+0000 7f58ffe00640 1 -- 172.21.15.137:0/300143229 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16730 (secure 0 0 0) 0x7f58f805a2a0 con 0x7f59080725a0 2024-04-26T23:42:26.164 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:26.164 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":32,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:42:24.865502+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:42:22.570062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:42:23.822598+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:42:26.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.160+0000 7f590de00640 1 -- 172.21.15.137:0/300143229 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f58e4068380 msgr2=0x7f58e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:26.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.160+0000 7f590de00640 1 --2- 172.21.15.137:0/300143229 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f58e4068380 0x7f58e406a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f58f00ae000 tx=0x7f58f00b5040 comp rx=0 tx=0).stop 2024-04-26T23:42:26.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.160+0000 7f590de00640 1 -- 172.21.15.137:0/300143229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59080725a0 msgr2=0x7f590815edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:26.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.160+0000 7f590de00640 1 --2- 172.21.15.137:0/300143229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59080725a0 0x7f590815edc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f58f800c370 tx=0x7f58f800c830 comp rx=0 tx=0).stop 2024-04-26T23:42:26.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.160+0000 7f590de00640 1 -- 172.21.15.137:0/300143229 shutdown_connections 2024-04-26T23:42:26.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.160+0000 7f590de00640 1 --2- 172.21.15.137:0/300143229 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f58e4068380 0x7f58e406a840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:26.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.160+0000 7f590de00640 1 --2- 172.21.15.137:0/300143229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59080b5080 0x7f590815cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:26.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.160+0000 7f590de00640 1 --2- 172.21.15.137:0/300143229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5908072980 0x7f5908159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:26.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.160+0000 7f590de00640 1 --2- 172.21.15.137:0/300143229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59080725a0 0x7f590815edc0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:26.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.160+0000 7f590de00640 1 -- 172.21.15.137:0/300143229 >> 172.21.15.137:0/300143229 conn(0x7f590806c5d0 msgr2=0x7f5908144bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:26.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.160+0000 7f590de00640 1 -- 172.21.15.137:0/300143229 shutdown_connections 2024-04-26T23:42:26.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.160+0000 7f590de00640 1 -- 172.21.15.137:0/300143229 wait complete. 2024-04-26T23:42:26.186 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T23:42:26.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.320+0000 7f60bee00640 1 Processor -- start 2024-04-26T23:42:26.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.320+0000 7f60bee00640 1 -- start start 2024-04-26T23:42:26.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.320+0000 7f60bee00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60b80b54e0 0x7f60b80b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:26.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.320+0000 7f60bee00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f60b80cd710 0x7f60b815f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:26.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.320+0000 7f60bee00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60b8160250 con 0x7f60b815fe30 2024-04-26T23:42:26.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.320+0000 7f60bee00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f60b80b3d90 con 0x7f60b80cd710 2024-04-26T23:42:26.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.320+0000 7f60bee00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f60b80d0840 con 0x7f60b80b54e0 2024-04-26T23:42:26.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.320+0000 7f60af400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f60b80cd710 0x7f60b815f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:26.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.320+0000 7f60af400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f60b80cd710 0x7f60b815f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:39758/0 (socket says 172.21.15.137:39758) 2024-04-26T23:42:26.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.320+0000 7f60af400640 1 -- 172.21.15.137:0/2007352184 learned_addr learned my addr 172.21.15.137:0/2007352184 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:26.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.320+0000 7f60b7e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60b80b54e0 0x7f60b80b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:26.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.320+0000 7f60bce00640 1 --1- 172.21.15.137:0/2007352184 >> v1:172.21.15.170:6789/0 conn(0x7f60b815fe30 0x7f60b8144d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:60650/0 (socket says 172.21.15.137:60650) 2024-04-26T23:42:26.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.320+0000 7f60af400640 1 -- 172.21.15.137:0/2007352184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60b80b54e0 msgr2=0x7f60b80b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:26.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.320+0000 7f60af400640 1 --2- 172.21.15.137:0/2007352184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60b80b54e0 0x7f60b80b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:26.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.320+0000 7f60af400640 1 -- 172.21.15.137:0/2007352184 >> v1:172.21.15.170:6789/0 conn(0x7f60b815fe30 legacy=0x7f60b8144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:26.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.320+0000 7f60af400640 1 -- 172.21.15.137:0/2007352184 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b80cffa0 con 0x7f60b80cd710 2024-04-26T23:42:26.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.320+0000 7f60b7e00640 1 --2- 172.21.15.137:0/2007352184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60b80b54e0 0x7f60b80b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:42:26.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.324+0000 7f60af400640 1 --2- 172.21.15.137:0/2007352184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60b80cd710 0x7f60b815f8f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f60a00098a0 tx=0x7f60a001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c12e11926a5220d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:26.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.324+0000 7f60b7400640 1 -- 172.21.15.137:0/2007352184 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a00aa670 con 0x7f60b80cd710 2024-04-26T23:42:26.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.324+0000 7f60b7400640 1 -- 172.21.15.137:0/2007352184 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60a00af070 con 0x7f60b80cd710 2024-04-26T23:42:26.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.324+0000 7f60b7400640 1 -- 172.21.15.137:0/2007352184 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a00aaa30 con 0x7f60b80cd710 2024-04-26T23:42:26.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.324+0000 7f60bee00640 1 -- 172.21.15.137:0/2007352184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60b80cd710 msgr2=0x7f60b815f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:26.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.324+0000 7f60bee00640 1 --2- 172.21.15.137:0/2007352184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60b80cd710 0x7f60b815f8f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f60a00098a0 tx=0x7f60a001c510 comp rx=0 tx=0).stop 2024-04-26T23:42:26.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.324+0000 7f60bee00640 1 -- 172.21.15.137:0/2007352184 shutdown_connections 2024-04-26T23:42:26.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.324+0000 7f60bee00640 1 --2- 172.21.15.137:0/2007352184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60b80cd710 0x7f60b815f8f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:26.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.324+0000 7f60bee00640 1 --2- 172.21.15.137:0/2007352184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60b80b54e0 0x7f60b80b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:26.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.324+0000 7f60bee00640 1 -- 172.21.15.137:0/2007352184 >> 172.21.15.137:0/2007352184 conn(0x7f60b806c800 msgr2=0x7f60b806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:26.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.324+0000 7f60bee00640 1 -- 172.21.15.137:0/2007352184 shutdown_connections 2024-04-26T23:42:26.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.324+0000 7f60bee00640 1 -- 172.21.15.137:0/2007352184 wait complete. 2024-04-26T23:42:26.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.328+0000 7f60bee00640 1 Processor -- start 2024-04-26T23:42:26.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.328+0000 7f60bee00640 1 -- start start 2024-04-26T23:42:26.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.328+0000 7f60bee00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60b80b54e0 0x7f60b8141f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:26.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.328+0000 7f60bee00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60b80cd710 0x7f60b80b1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:26.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.328+0000 7f60bee00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60b815fe30 0x7f60b8163290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:26.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.328+0000 7f60bee00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f60b80cdb50 con 0x7f60b80b54e0 2024-04-26T23:42:26.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.328+0000 7f60bee00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f60b80cded0 con 0x7f60b815fe30 2024-04-26T23:42:26.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.328+0000 7f60bee00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f60b8145840 con 0x7f60b80cd710 2024-04-26T23:42:26.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.328+0000 7f60b7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60b80b54e0 0x7f60b8141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:26.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.328+0000 7f60b7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60b80b54e0 0x7f60b8141f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36362/0 (socket says 172.21.15.137:36362) 2024-04-26T23:42:26.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.328+0000 7f60b7e00640 1 -- 172.21.15.137:0/368828414 learned_addr learned my addr 172.21.15.137:0/368828414 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:26.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.328+0000 7f60b7e00640 1 -- 172.21.15.137:0/368828414 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60b80cd710 msgr2=0x7f60b80b1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:26.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.328+0000 7f60b7e00640 1 --2- 172.21.15.137:0/368828414 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60b80cd710 0x7f60b80b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:26.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.328+0000 7f60b7e00640 1 -- 172.21.15.137:0/368828414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60b815fe30 msgr2=0x7f60b8163290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:26.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.328+0000 7f60b7e00640 1 --2- 172.21.15.137:0/368828414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60b815fe30 0x7f60b8163290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:26.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.328+0000 7f60b7e00640 1 -- 172.21.15.137:0/368828414 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b8142460 con 0x7f60b80b54e0 2024-04-26T23:42:26.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.328+0000 7f60b7e00640 1 --2- 172.21.15.137:0/368828414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60b80b54e0 0x7f60b8141f20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f60a800efc0 tx=0x7f60a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:26.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.328+0000 7f60b4c00640 1 -- 172.21.15.137:0/368828414 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a8018020 con 0x7f60b80b54e0 2024-04-26T23:42:26.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.328+0000 7f60b4c00640 1 -- 172.21.15.137:0/368828414 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60a8014680 con 0x7f60b80b54e0 2024-04-26T23:42:26.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.328+0000 7f60b4c00640 1 -- 172.21.15.137:0/368828414 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a8014a50 con 0x7f60b80b54e0 2024-04-26T23:42:26.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.328+0000 7f60bee00640 1 -- 172.21.15.137:0/368828414 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b80b21a0 con 0x7f60b80b54e0 2024-04-26T23:42:26.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.328+0000 7f60bee00640 1 -- 172.21.15.137:0/368828414 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b80b2760 con 0x7f60b80b54e0 2024-04-26T23:42:26.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.332+0000 7f60bee00640 1 -- 172.21.15.137:0/368828414 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60b806a410 con 0x7f60b80b54e0 2024-04-26T23:42:26.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.332+0000 7f60b4c00640 1 -- 172.21.15.137:0/368828414 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f60a801b020 con 0x7f60b80b54e0 2024-04-26T23:42:26.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.332+0000 7f60b4c00640 1 --2- 172.21.15.137:0/368828414 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6094068380 0x7f609406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:26.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.332+0000 7f60b4c00640 1 -- 172.21.15.137:0/368828414 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f60a8087850 con 0x7f60b80b54e0 2024-04-26T23:42:26.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.332+0000 7f60af400640 1 --2- 172.21.15.137:0/368828414 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6094068380 0x7f609406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:26.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.332+0000 7f60af400640 1 --2- 172.21.15.137:0/368828414 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6094068380 0x7f609406a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f60a00ae000 tx=0x7f60a0004740 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:26.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.336+0000 7f60b4c00640 1 -- 172.21.15.137:0/368828414 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f60a8022030 con 0x7f60b80b54e0 2024-04-26T23:42:26.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:26.536+0000 7f60bee00640 1 -- 172.21.15.137:0/368828414 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f60b8166c90 con 0x7f60b80b54e0 2024-04-26T23:42:27.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.492+0000 7f60b4c00640 1 -- 172.21.15.137:0/368828414 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f60a8010040 con 0x7f60b80b54e0 2024-04-26T23:42:27.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.496+0000 7f60bee00640 1 -- 172.21.15.137:0/368828414 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6094068380 msgr2=0x7f609406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:27.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.496+0000 7f60bee00640 1 --2- 172.21.15.137:0/368828414 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6094068380 0x7f609406a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f60a00ae000 tx=0x7f60a0004740 comp rx=0 tx=0).stop 2024-04-26T23:42:27.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.496+0000 7f60bee00640 1 -- 172.21.15.137:0/368828414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60b80b54e0 msgr2=0x7f60b8141f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:27.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.496+0000 7f60bee00640 1 --2- 172.21.15.137:0/368828414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60b80b54e0 0x7f60b8141f20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f60a800efc0 tx=0x7f60a800c490 comp rx=0 tx=0).stop 2024-04-26T23:42:27.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.496+0000 7f60bee00640 1 -- 172.21.15.137:0/368828414 shutdown_connections 2024-04-26T23:42:27.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.496+0000 7f60bee00640 1 --2- 172.21.15.137:0/368828414 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6094068380 0x7f609406a840 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:27.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.496+0000 7f60bee00640 1 --2- 172.21.15.137:0/368828414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60b815fe30 0x7f60b8163290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:27.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.496+0000 7f60bee00640 1 --2- 172.21.15.137:0/368828414 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60b80cd710 0x7f60b80b1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:27.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.496+0000 7f60bee00640 1 --2- 172.21.15.137:0/368828414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60b80b54e0 0x7f60b8141f20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:27.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.496+0000 7f60bee00640 1 -- 172.21.15.137:0/368828414 >> 172.21.15.137:0/368828414 conn(0x7f60b806c800 msgr2=0x7f60b8144d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:27.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.496+0000 7f60bee00640 1 -- 172.21.15.137:0/368828414 shutdown_connections 2024-04-26T23:42:27.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.496+0000 7f60bee00640 1 -- 172.21.15.137:0/368828414 wait complete. 2024-04-26T23:42:27.524 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T23:42:27.524 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T23:42:27.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe42ec00640 1 Processor -- start 2024-04-26T23:42:27.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe42ec00640 1 -- start start 2024-04-26T23:42:27.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe42ec00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe428073f20 0x7fe42815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:27.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe42ec00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe428072860 con 0x7fe4280afbc0 2024-04-26T23:42:27.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe42ec00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4280743b0 con 0x7fe4280affa0 2024-04-26T23:42:27.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe42ec00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe428072b00 con 0x7fe428073f20 2024-04-26T23:42:27.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe427e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fe4280afbc0 0x7fe4280735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58702/0 (socket says 172.21.15.137:58702) 2024-04-26T23:42:27.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe427e00640 1 -- 172.21.15.137:0/2223329715 learned_addr learned my addr 172.21.15.137:0/2223329715 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:27.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe427400640 1 --2- 172.21.15.137:0/2223329715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe428073f20 0x7fe42815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:27.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe426a00640 1 -- 172.21.15.137:0/2223329715 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 422748764 0 0) 0x7fe428072860 con 0x7fe4280afbc0 2024-04-26T23:42:27.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe426a00640 1 -- 172.21.15.137:0/2223329715 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe40c003530 con 0x7fe4280afbc0 2024-04-26T23:42:27.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe426a00640 1 -- 172.21.15.137:0/2223329715 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 604080922 0 0) 0x7fe40c003530 con 0x7fe4280afbc0 2024-04-26T23:42:27.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe426a00640 1 -- 172.21.15.137:0/2223329715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe428073f20 msgr2=0x7fe42815df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:27.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe426a00640 1 --2- 172.21.15.137:0/2223329715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe428073f20 0x7fe42815df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:27.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe426a00640 1 -- 172.21.15.137:0/2223329715 >> v1:172.21.15.170:6789/0 conn(0x7fe4280affa0 legacy=0x7fe4280ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:27.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe426a00640 1 -- 172.21.15.137:0/2223329715 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe428072de0 con 0x7fe4280afbc0 2024-04-26T23:42:27.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe426a00640 1 -- 172.21.15.137:0/2223329715 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fe4180016a0 con 0x7fe4280afbc0 2024-04-26T23:42:27.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe426a00640 1 -- 172.21.15.137:0/2223329715 >> v1:172.21.15.137:6789/0 conn(0x7fe4280afbc0 legacy=0x7fe4280735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:27.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe426a00640 1 --2- 172.21.15.137:0/2223329715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe40c0039f0 0x7fe40c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:27.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe426a00640 1 --2- 172.21.15.137:0/2223329715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe40c004350 0x7fe40c004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:27.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe426a00640 1 --2- 172.21.15.137:0/2223329715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe40c005030 0x7fe40c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:27.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe426a00640 1 -- 172.21.15.137:0/2223329715 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe428072b00 con 0x7fe40c004350 2024-04-26T23:42:27.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe426a00640 1 -- 172.21.15.137:0/2223329715 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c00bf10 con 0x7fe40c005030 2024-04-26T23:42:27.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe426a00640 1 -- 172.21.15.137:0/2223329715 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe40c00c0c0 con 0x7fe40c0039f0 2024-04-26T23:42:27.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe427400640 1 --2- 172.21.15.137:0/2223329715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe40c004350 0x7fe40c004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:27.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe427e00640 1 --2- 172.21.15.137:0/2223329715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe40c0039f0 0x7fe40c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:27.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe42cc00640 1 --2- 172.21.15.137:0/2223329715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe40c005030 0x7fe40c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:27.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe427400640 1 -- 172.21.15.137:0/2223329715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe40c0039f0 msgr2=0x7fe40c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:27.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe427400640 1 --2- 172.21.15.137:0/2223329715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe40c0039f0 0x7fe40c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:27.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe427400640 1 -- 172.21.15.137:0/2223329715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe40c005030 msgr2=0x7fe40c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:27.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.664+0000 7fe427400640 1 --2- 172.21.15.137:0/2223329715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe40c005030 0x7fe40c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:27.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.668+0000 7fe427400640 1 -- 172.21.15.137:0/2223329715 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40c003530 con 0x7fe40c004350 2024-04-26T23:42:27.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.668+0000 7fe427400640 1 --2- 172.21.15.137:0/2223329715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe40c004350 0x7fe40c004830 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe414009ae0 tx=0x7fe41401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ffbdb87a02fb85 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:27.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.668+0000 7fe426a00640 1 -- 172.21.15.137:0/2223329715 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4140b2070 con 0x7fe40c004350 2024-04-26T23:42:27.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.668+0000 7fe426a00640 1 -- 172.21.15.137:0/2223329715 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4140a5660 con 0x7fe40c004350 2024-04-26T23:42:27.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.668+0000 7fe426a00640 1 -- 172.21.15.137:0/2223329715 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4140096b0 con 0x7fe40c004350 2024-04-26T23:42:27.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.668+0000 7fe42ec00640 1 -- 172.21.15.137:0/2223329715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe40c004350 msgr2=0x7fe40c004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:27.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.668+0000 7fe42ec00640 1 --2- 172.21.15.137:0/2223329715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe40c004350 0x7fe40c004830 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe414009ae0 tx=0x7fe41401ca70 comp rx=0 tx=0).stop 2024-04-26T23:42:27.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.668+0000 7fe42cc00640 1 -- 172.21.15.137:0/2223329715 reap_dead start 2024-04-26T23:42:27.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.668+0000 7fe42ec00640 1 -- 172.21.15.137:0/2223329715 shutdown_connections 2024-04-26T23:42:27.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.668+0000 7fe42ec00640 1 -- 172.21.15.137:0/2223329715 >> 172.21.15.137:0/2223329715 conn(0x7fe42806c800 msgr2=0x7fe42806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:27.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.668+0000 7fe42ec00640 1 -- 172.21.15.137:0/2223329715 shutdown_connections 2024-04-26T23:42:27.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.668+0000 7fe42ec00640 1 -- 172.21.15.137:0/2223329715 wait complete. 2024-04-26T23:42:27.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe42ec00640 1 Processor -- start 2024-04-26T23:42:27.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe42ec00640 1 -- start start 2024-04-26T23:42:27.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe42ec00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe428145670 0x7fe428151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:27.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe42ec00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe42814e8f0 0x7fe4281581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:27.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe42ec00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe42815ec90 0x7fe42815f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:27.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe42ec00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe4280ceac0 con 0x7fe428145670 2024-04-26T23:42:27.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe42ec00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe4280d0850 con 0x7fe42814e8f0 2024-04-26T23:42:27.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe42ec00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe4280cec40 con 0x7fe42815ec90 2024-04-26T23:42:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe427e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe428145670 0x7fe428151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe427e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe428145670 0x7fe428151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36388/0 (socket says 172.21.15.137:36388) 2024-04-26T23:42:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe427e00640 1 -- 172.21.15.137:0/2918707619 learned_addr learned my addr 172.21.15.137:0/2918707619 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe427400640 1 --2- 172.21.15.137:0/2918707619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe42814e8f0 0x7fe4281581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe42cc00640 1 --2- 172.21.15.137:0/2918707619 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe42815ec90 0x7fe42815f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe427e00640 1 -- 172.21.15.137:0/2918707619 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe42815ec90 msgr2=0x7fe42815f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe427e00640 1 --2- 172.21.15.137:0/2918707619 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe42815ec90 0x7fe42815f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe427e00640 1 -- 172.21.15.137:0/2918707619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe42814e8f0 msgr2=0x7fe4281581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe427e00640 1 --2- 172.21.15.137:0/2918707619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe42814e8f0 0x7fe4281581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe427e00640 1 -- 172.21.15.137:0/2918707619 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe428150470 con 0x7fe428145670 2024-04-26T23:42:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe427400640 1 --2- 172.21.15.137:0/2918707619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe42814e8f0 0x7fe4281581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe427e00640 1 --2- 172.21.15.137:0/2918707619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe428145670 0x7fe428151510 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe418012510 tx=0x7fe4180129d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe41fe00640 1 -- 172.21.15.137:0/2918707619 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41801c070 con 0x7fe428145670 2024-04-26T23:42:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe41fe00640 1 -- 172.21.15.137:0/2918707619 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe418014830 con 0x7fe428145670 2024-04-26T23:42:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe41fe00640 1 -- 172.21.15.137:0/2918707619 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418014c20 con 0x7fe428145670 2024-04-26T23:42:27.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe42ec00640 1 -- 172.21.15.137:0/2918707619 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe428150750 con 0x7fe428145670 2024-04-26T23:42:27.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.672+0000 7fe42ec00640 1 -- 172.21.15.137:0/2918707619 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe428150d10 con 0x7fe428145670 2024-04-26T23:42:27.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.676+0000 7fe42ec00640 1 -- 172.21.15.137:0/2918707619 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe42806a410 con 0x7fe428145670 2024-04-26T23:42:27.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.676+0000 7fe41fe00640 1 -- 172.21.15.137:0/2918707619 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe4180153e0 con 0x7fe428145670 2024-04-26T23:42:27.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.676+0000 7fe41fe00640 1 --2- 172.21.15.137:0/2918707619 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe408068380 0x7fe40806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:27.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.676+0000 7fe41fe00640 1 -- 172.21.15.137:0/2918707619 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe418089360 con 0x7fe428145670 2024-04-26T23:42:27.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.676+0000 7fe427400640 1 --2- 172.21.15.137:0/2918707619 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe408068380 0x7fe40806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:27.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.676+0000 7fe427400640 1 --2- 172.21.15.137:0/2918707619 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe408068380 0x7fe40806a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe4140af000 tx=0x7fe414008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:27.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.680+0000 7fe41fe00640 1 -- 172.21.15.137:0/2918707619 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe418059910 con 0x7fe428145670 2024-04-26T23:42:27.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:27.872+0000 7fe42ec00640 1 -- 172.21.15.137:0/2918707619 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe428160870 con 0x7fe428145670 2024-04-26T23:42:28.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.496+0000 7fe41fe00640 1 -- 172.21.15.137:0/2918707619 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7fe418059210 con 0x7fe428145670 2024-04-26T23:42:28.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.500+0000 7fe42ec00640 1 -- 172.21.15.137:0/2918707619 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe408068380 msgr2=0x7fe40806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:28.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.500+0000 7fe42ec00640 1 --2- 172.21.15.137:0/2918707619 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe408068380 0x7fe40806a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe4140af000 tx=0x7fe414008040 comp rx=0 tx=0).stop 2024-04-26T23:42:28.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.500+0000 7fe42ec00640 1 -- 172.21.15.137:0/2918707619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe428145670 msgr2=0x7fe428151510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:28.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.500+0000 7fe42ec00640 1 --2- 172.21.15.137:0/2918707619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe428145670 0x7fe428151510 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe418012510 tx=0x7fe4180129d0 comp rx=0 tx=0).stop 2024-04-26T23:42:28.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.500+0000 7fe42ec00640 1 -- 172.21.15.137:0/2918707619 shutdown_connections 2024-04-26T23:42:28.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.500+0000 7fe42ec00640 1 --2- 172.21.15.137:0/2918707619 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe408068380 0x7fe40806a840 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:28.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.500+0000 7fe42ec00640 1 --2- 172.21.15.137:0/2918707619 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe42815ec90 0x7fe42815f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:28.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.500+0000 7fe42ec00640 1 --2- 172.21.15.137:0/2918707619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe42814e8f0 0x7fe4281581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:28.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.500+0000 7fe42ec00640 1 --2- 172.21.15.137:0/2918707619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe428145670 0x7fe428151510 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:28.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.500+0000 7fe42ec00640 1 -- 172.21.15.137:0/2918707619 >> 172.21.15.137:0/2918707619 conn(0x7fe42806c800 msgr2=0x7fe42806f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:28.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.500+0000 7fe42ec00640 1 -- 172.21.15.137:0/2918707619 shutdown_connections 2024-04-26T23:42:28.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.500+0000 7fe42ec00640 1 -- 172.21.15.137:0/2918707619 wait complete. 2024-04-26T23:42:28.527 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T23:42:28.528 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:42:28.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.660+0000 7fe314a00640 1 Processor -- start 2024-04-26T23:42:28.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.660+0000 7fe314a00640 1 -- start start 2024-04-26T23:42:28.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.660+0000 7fe314a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3100b5080 0x7fe3100cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:28.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.660+0000 7fe314a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3100cfef0 con 0x7fe310072980 2024-04-26T23:42:28.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.660+0000 7fe314a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3100cddc0 con 0x7fe3100725a0 2024-04-26T23:42:28.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.660+0000 7fe314a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe3100d01b0 con 0x7fe3100b5080 2024-04-26T23:42:28.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.660+0000 7fe30e800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fe310072980 0x7fe310072e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58712/0 (socket says 172.21.15.137:58712) 2024-04-26T23:42:28.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.660+0000 7fe30e800640 1 -- 172.21.15.137:0/3813426572 learned_addr learned my addr 172.21.15.137:0/3813426572 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:28.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.664+0000 7fe30d400640 1 --2- 172.21.15.137:0/3813426572 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3100b5080 0x7fe3100cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:28.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.664+0000 7fe30ca00640 1 -- 172.21.15.137:0/3813426572 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1708366474 0 0) 0x7fe3100cfef0 con 0x7fe310072980 2024-04-26T23:42:28.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.664+0000 7fe30ca00640 1 -- 172.21.15.137:0/3813426572 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2f4003530 con 0x7fe310072980 2024-04-26T23:42:28.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.664+0000 7fe30ca00640 1 -- 172.21.15.137:0/3813426572 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1537434286 0 0) 0x7fe3100cddc0 con 0x7fe3100725a0 2024-04-26T23:42:28.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.664+0000 7fe30ca00640 1 -- 172.21.15.137:0/3813426572 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3100cfef0 con 0x7fe3100725a0 2024-04-26T23:42:28.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.664+0000 7fe30d400640 1 -- 172.21.15.137:0/3813426572 >> v1:172.21.15.170:6789/0 conn(0x7fe3100725a0 legacy=0x7fe310073f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:28.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.664+0000 7fe30d400640 1 -- 172.21.15.137:0/3813426572 >> v1:172.21.15.137:6789/0 conn(0x7fe310072980 legacy=0x7fe310072e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:28.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.664+0000 7fe30d400640 1 -- 172.21.15.137:0/3813426572 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3100d0490 con 0x7fe3100b5080 2024-04-26T23:42:28.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.664+0000 7fe30d400640 1 --2- 172.21.15.137:0/3813426572 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3100b5080 0x7fe3100cd770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0097f0 tx=0x7fe2fc01c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9340c027b30e6627 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:28.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.664+0000 7fe30ca00640 1 -- 172.21.15.137:0/3813426572 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc0ab640 con 0x7fe3100b5080 2024-04-26T23:42:28.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.664+0000 7fe30ca00640 1 -- 172.21.15.137:0/3813426572 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2fc0b0070 con 0x7fe3100b5080 2024-04-26T23:42:28.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.664+0000 7fe30ca00640 1 -- 172.21.15.137:0/3813426572 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc0aba00 con 0x7fe3100b5080 2024-04-26T23:42:28.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe314a00640 1 -- 172.21.15.137:0/3813426572 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3100b5080 msgr2=0x7fe3100cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:28.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe314a00640 1 --2- 172.21.15.137:0/3813426572 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3100b5080 0x7fe3100cd770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0097f0 tx=0x7fe2fc01c420 comp rx=0 tx=0).stop 2024-04-26T23:42:28.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe314a00640 1 -- 172.21.15.137:0/3813426572 shutdown_connections 2024-04-26T23:42:28.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe314a00640 1 --2- 172.21.15.137:0/3813426572 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3100b5080 0x7fe3100cd770 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:28.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe314a00640 1 -- 172.21.15.137:0/3813426572 >> 172.21.15.137:0/3813426572 conn(0x7fe31006c5d0 msgr2=0x7fe31006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:28.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe314a00640 1 -- 172.21.15.137:0/3813426572 shutdown_connections 2024-04-26T23:42:28.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe314a00640 1 -- 172.21.15.137:0/3813426572 wait complete. 2024-04-26T23:42:28.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe314a00640 1 Processor -- start 2024-04-26T23:42:28.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe314a00640 1 -- start start 2024-04-26T23:42:28.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe314a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3100725a0 0x7fe31015ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:28.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe314a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe310072980 0x7fe3101596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:28.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe314a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3100b5080 0x7fe31015e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:28.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe314a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe310169900 con 0x7fe3100725a0 2024-04-26T23:42:28.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe314a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe310169780 con 0x7fe3100b5080 2024-04-26T23:42:28.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe314a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe310169a80 con 0x7fe310072980 2024-04-26T23:42:28.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe30de00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3100725a0 0x7fe31015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:28.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe30de00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3100725a0 0x7fe31015ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36390/0 (socket says 172.21.15.137:36390) 2024-04-26T23:42:28.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe30de00640 1 -- 172.21.15.137:0/2907016371 learned_addr learned my addr 172.21.15.137:0/2907016371 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:28.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe30e800640 1 --2- 172.21.15.137:0/2907016371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3100b5080 0x7fe31015e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:28.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe30d400640 1 --2- 172.21.15.137:0/2907016371 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe310072980 0x7fe3101596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:28.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe30de00640 1 -- 172.21.15.137:0/2907016371 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe310072980 msgr2=0x7fe3101596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:28.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe30de00640 1 --2- 172.21.15.137:0/2907016371 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe310072980 0x7fe3101596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:28.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe30de00640 1 -- 172.21.15.137:0/2907016371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3100b5080 msgr2=0x7fe31015e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:28.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe30de00640 1 --2- 172.21.15.137:0/2907016371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3100b5080 0x7fe31015e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:28.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe30de00640 1 -- 172.21.15.137:0/2907016371 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3101f7920 con 0x7fe3100725a0 2024-04-26T23:42:28.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.668+0000 7fe30e800640 1 --2- 172.21.15.137:0/2907016371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3100b5080 0x7fe31015e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:28.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.672+0000 7fe30de00640 1 --2- 172.21.15.137:0/2907016371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3100725a0 0x7fe31015ce00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe30000c460 tx=0x7fe30000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:28.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.672+0000 7fe306000640 1 -- 172.21.15.137:0/2907016371 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3000052d0 con 0x7fe3100725a0 2024-04-26T23:42:28.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.672+0000 7fe306000640 1 -- 172.21.15.137:0/2907016371 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe300005490 con 0x7fe3100725a0 2024-04-26T23:42:28.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.672+0000 7fe306000640 1 -- 172.21.15.137:0/2907016371 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300012850 con 0x7fe3100725a0 2024-04-26T23:42:28.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.672+0000 7fe314a00640 1 -- 172.21.15.137:0/2907016371 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3101f7c00 con 0x7fe3100725a0 2024-04-26T23:42:28.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.672+0000 7fe314a00640 1 -- 172.21.15.137:0/2907016371 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3101f81c0 con 0x7fe3100725a0 2024-04-26T23:42:28.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.672+0000 7fe314a00640 1 -- 172.21.15.137:0/2907016371 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe31006a4b0 con 0x7fe3100725a0 2024-04-26T23:42:28.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.672+0000 7fe306000640 1 -- 172.21.15.137:0/2907016371 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe3000129f0 con 0x7fe3100725a0 2024-04-26T23:42:28.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.672+0000 7fe306000640 1 --2- 172.21.15.137:0/2907016371 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe2f0068380 0x7fe2f006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:28.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.672+0000 7fe306000640 1 -- 172.21.15.137:0/2907016371 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe3000865b0 con 0x7fe3100725a0 2024-04-26T23:42:28.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.672+0000 7fe30d400640 1 --2- 172.21.15.137:0/2907016371 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe2f0068380 0x7fe2f006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:28.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.672+0000 7fe30d400640 1 --2- 172.21.15.137:0/2907016371 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe2f0068380 0x7fe2f006a840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0af000 tx=0x7fe2fc0b6040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:28.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.676+0000 7fe306000640 1 -- 172.21.15.137:0/2907016371 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe300056b70 con 0x7fe3100725a0 2024-04-26T23:42:28.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.868+0000 7fe314a00640 1 -- 172.21.15.137:0/2907016371 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe310072380 con 0x7fe3100725a0 2024-04-26T23:42:28.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.868+0000 7fe306000640 1 -- 172.21.15.137:0/2907016371 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5198 (secure 0 0 0) 0x7fe300056470 con 0x7fe3100725a0 2024-04-26T23:42:28.874 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:28.874 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1345232353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1345232353},{"type":"v1","addr":"172.21.15.137:6836","nonce":1345232353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1274585662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1274585662},{"type":"v1","addr":"172.21.15.137:6837","nonce":1274585662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4079333736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4079333736},{"type":"v1","addr":"172.21.15.170:6834","nonce":4079333736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:42:24.865468+0000","modified":"2024-04-26T23:42:27.876394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34808},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34808":{"gid":34808,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/3364296586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3364296586},{"type":"v1","addr":"172.21.15.170:6835","nonce":3364296586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34808,"qdb_cluster":[34808]},"id":2}]} 2024-04-26T23:42:28.874 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 17 2024-04-26T23:42:28.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.872+0000 7fe314a00640 1 -- 172.21.15.137:0/2907016371 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe2f0068380 msgr2=0x7fe2f006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:28.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.872+0000 7fe314a00640 1 --2- 172.21.15.137:0/2907016371 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe2f0068380 0x7fe2f006a840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0af000 tx=0x7fe2fc0b6040 comp rx=0 tx=0).stop 2024-04-26T23:42:28.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.872+0000 7fe314a00640 1 -- 172.21.15.137:0/2907016371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3100725a0 msgr2=0x7fe31015ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:28.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.872+0000 7fe314a00640 1 --2- 172.21.15.137:0/2907016371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3100725a0 0x7fe31015ce00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe30000c460 tx=0x7fe30000c920 comp rx=0 tx=0).stop 2024-04-26T23:42:28.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.872+0000 7fe314a00640 1 -- 172.21.15.137:0/2907016371 shutdown_connections 2024-04-26T23:42:28.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.872+0000 7fe314a00640 1 --2- 172.21.15.137:0/2907016371 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe2f0068380 0x7fe2f006a840 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:28.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.872+0000 7fe314a00640 1 --2- 172.21.15.137:0/2907016371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3100b5080 0x7fe31015e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:28.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.872+0000 7fe314a00640 1 --2- 172.21.15.137:0/2907016371 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe310072980 0x7fe3101596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:28.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.872+0000 7fe314a00640 1 --2- 172.21.15.137:0/2907016371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3100725a0 0x7fe31015ce00 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:28.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.872+0000 7fe314a00640 1 -- 172.21.15.137:0/2907016371 >> 172.21.15.137:0/2907016371 conn(0x7fe31006c5d0 msgr2=0x7fe3101407f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:28.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.872+0000 7fe314a00640 1 -- 172.21.15.137:0/2907016371 shutdown_connections 2024-04-26T23:42:28.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:28.872+0000 7fe314a00640 1 -- 172.21.15.137:0/2907016371 wait complete. 2024-04-26T23:42:28.895 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:42:29.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.024+0000 7f1d66e00640 1 Processor -- start 2024-04-26T23:42:29.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.024+0000 7f1d66e00640 1 -- start start 2024-04-26T23:42:29.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.024+0000 7f1d66e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d600725a0 0x7f1d600cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:29.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.028+0000 7f1d66e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1d600b5080 0x7f1d60165930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:29.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.028+0000 7f1d66e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d600cfef0 con 0x7f1d60073f30 2024-04-26T23:42:29.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.028+0000 7f1d66e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1d600cddc0 con 0x7f1d600b5080 2024-04-26T23:42:29.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.028+0000 7f1d66e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1d600d01b0 con 0x7f1d600725a0 2024-04-26T23:42:29.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.028+0000 7f1d5f400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f1d60073f30 0x7f1d60072980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58728/0 (socket says 172.21.15.137:58728) 2024-04-26T23:42:29.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.028+0000 7f1d5f400640 1 -- 172.21.15.137:0/3935359931 learned_addr learned my addr 172.21.15.137:0/3935359931 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:29.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.028+0000 7f1d64e00640 1 --2- 172.21.15.137:0/3935359931 >> v2:172.21.15.137:3300/0 conn(0x7f1d600b5080 0x7f1d60165930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:29.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.028+0000 7f1d5fe00640 1 --2- 172.21.15.137:0/3935359931 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d600725a0 0x7f1d600cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:29.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.028+0000 7f1d64e00640 1 -- 172.21.15.137:0/3935359931 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d600725a0 msgr2=0x7f1d600cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:29.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.028+0000 7f1d64e00640 1 --2- 172.21.15.137:0/3935359931 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d600725a0 0x7f1d600cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.028+0000 7f1d64e00640 1 -- 172.21.15.137:0/3935359931 >> v1:172.21.15.137:6789/0 conn(0x7f1d60073f30 legacy=0x7f1d60072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:29.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.028+0000 7f1d64e00640 1 -- 172.21.15.137:0/3935359931 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d600d0490 con 0x7f1d600b5080 2024-04-26T23:42:29.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.028+0000 7f1d5ea00640 1 -- 172.21.15.137:0/3935359931 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2532603845 0 0) 0x7f1d600cfef0 con 0x7f1d60073f30 2024-04-26T23:42:29.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.028+0000 7f1d64e00640 1 --2- 172.21.15.137:0/3935359931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d600b5080 0x7f1d60165930 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1d58009dc0 tx=0x7f1d5801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d7c3fb63a966d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:29.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.028+0000 7f1d5ea00640 1 -- 172.21.15.137:0/3935359931 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d580b2070 con 0x7f1d600b5080 2024-04-26T23:42:29.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.028+0000 7f1d5ea00640 1 -- 172.21.15.137:0/3935359931 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d580a58f0 con 0x7f1d600b5080 2024-04-26T23:42:29.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.028+0000 7f1d5ea00640 1 -- 172.21.15.137:0/3935359931 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d580a5cc0 con 0x7f1d600b5080 2024-04-26T23:42:29.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.032+0000 7f1d66e00640 1 -- 172.21.15.137:0/3935359931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d600b5080 msgr2=0x7f1d60165930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:29.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.032+0000 7f1d66e00640 1 --2- 172.21.15.137:0/3935359931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d600b5080 0x7f1d60165930 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1d58009dc0 tx=0x7f1d5801c920 comp rx=0 tx=0).stop 2024-04-26T23:42:29.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.032+0000 7f1d66e00640 1 -- 172.21.15.137:0/3935359931 shutdown_connections 2024-04-26T23:42:29.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.032+0000 7f1d66e00640 1 --2- 172.21.15.137:0/3935359931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d600b5080 0x7f1d60165930 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.032+0000 7f1d66e00640 1 --2- 172.21.15.137:0/3935359931 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d600725a0 0x7f1d600cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.032+0000 7f1d66e00640 1 -- 172.21.15.137:0/3935359931 >> 172.21.15.137:0/3935359931 conn(0x7f1d6006c5d0 msgr2=0x7f1d6006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:29.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.032+0000 7f1d66e00640 1 -- 172.21.15.137:0/3935359931 shutdown_connections 2024-04-26T23:42:29.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.032+0000 7f1d66e00640 1 -- 172.21.15.137:0/3935359931 wait complete. 2024-04-26T23:42:29.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.032+0000 7f1d66e00640 1 Processor -- start 2024-04-26T23:42:29.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.032+0000 7f1d66e00640 1 -- start start 2024-04-26T23:42:29.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.032+0000 7f1d66e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d600725a0 0x7f1d60138670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:29.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.032+0000 7f1d66e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d60073f30 0x7f1d60138bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:29.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.032+0000 7f1d66e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d600b5080 0x7f1d601f8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:29.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.032+0000 7f1d66e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1d60168a20 con 0x7f1d600b5080 2024-04-26T23:42:29.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.032+0000 7f1d66e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1d601688a0 con 0x7f1d60073f30 2024-04-26T23:42:29.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.032+0000 7f1d66e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1d60168ba0 con 0x7f1d600725a0 2024-04-26T23:42:29.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.032+0000 7f1d64e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d600b5080 0x7f1d601f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:29.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.032+0000 7f1d64e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d600b5080 0x7f1d601f8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36404/0 (socket says 172.21.15.137:36404) 2024-04-26T23:42:29.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.032+0000 7f1d64e00640 1 -- 172.21.15.137:0/2802509510 learned_addr learned my addr 172.21.15.137:0/2802509510 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:29.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.032+0000 7f1d5fe00640 1 --2- 172.21.15.137:0/2802509510 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d600725a0 0x7f1d60138670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:29.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.032+0000 7f1d5f400640 1 --2- 172.21.15.137:0/2802509510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d60073f30 0x7f1d60138bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:29.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.036+0000 7f1d64e00640 1 -- 172.21.15.137:0/2802509510 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d600725a0 msgr2=0x7f1d60138670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:29.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.036+0000 7f1d64e00640 1 --2- 172.21.15.137:0/2802509510 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d600725a0 0x7f1d60138670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.036+0000 7f1d64e00640 1 -- 172.21.15.137:0/2802509510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d60073f30 msgr2=0x7f1d60138bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:29.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.036+0000 7f1d64e00640 1 --2- 172.21.15.137:0/2802509510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d60073f30 0x7f1d60138bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.036+0000 7f1d64e00640 1 -- 172.21.15.137:0/2802509510 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d60135e60 con 0x7f1d600b5080 2024-04-26T23:42:29.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.036+0000 7f1d64e00640 1 --2- 172.21.15.137:0/2802509510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d600b5080 0x7f1d601f8480 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1d5801afd0 tx=0x7f1d580196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:29.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.036+0000 7f1d57e00640 1 -- 172.21.15.137:0/2802509510 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d580b2050 con 0x7f1d600b5080 2024-04-26T23:42:29.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.036+0000 7f1d57e00640 1 -- 172.21.15.137:0/2802509510 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d580be070 con 0x7f1d600b5080 2024-04-26T23:42:29.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.036+0000 7f1d66e00640 1 -- 172.21.15.137:0/2802509510 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d60136140 con 0x7f1d600b5080 2024-04-26T23:42:29.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.036+0000 7f1d57e00640 1 -- 172.21.15.137:0/2802509510 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d580ada90 con 0x7f1d600b5080 2024-04-26T23:42:29.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.036+0000 7f1d66e00640 1 -- 172.21.15.137:0/2802509510 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d60136700 con 0x7f1d600b5080 2024-04-26T23:42:29.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.036+0000 7f1d66e00640 1 -- 172.21.15.137:0/2802509510 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d6006a4b0 con 0x7f1d600b5080 2024-04-26T23:42:29.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.036+0000 7f1d57e00640 1 -- 172.21.15.137:0/2802509510 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1d580adc30 con 0x7f1d600b5080 2024-04-26T23:42:29.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.036+0000 7f1d57e00640 1 --2- 172.21.15.137:0/2802509510 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d3c068380 0x7f1d3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:29.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.036+0000 7f1d57e00640 1 -- 172.21.15.137:0/2802509510 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1d58121ee0 con 0x7f1d600b5080 2024-04-26T23:42:29.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.036+0000 7f1d5fe00640 1 --2- 172.21.15.137:0/2802509510 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d3c068380 0x7f1d3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:29.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.040+0000 7f1d5fe00640 1 --2- 172.21.15.137:0/2802509510 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d3c068380 0x7f1d3c06a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1d480079c0 tx=0x7f1d48008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:29.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.044+0000 7f1d57e00640 1 -- 172.21.15.137:0/2802509510 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1d58016540 con 0x7f1d600b5080 2024-04-26T23:42:29.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.200+0000 7f1d66e00640 1 -- 172.21.15.137:0/2802509510 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d60072380 con 0x7f1d600b5080 2024-04-26T23:42:29.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.204+0000 7f1d57e00640 1 -- 172.21.15.137:0/2802509510 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16717 (secure 0 0 0) 0x7f1d580f1ed0 con 0x7f1d600b5080 2024-04-26T23:42:29.209 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:29.209 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":33,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:42:26.483092+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:42:22.570062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:42:23.822598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:42:29.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.204+0000 7f1d66e00640 1 -- 172.21.15.137:0/2802509510 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d3c068380 msgr2=0x7f1d3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:29.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.204+0000 7f1d66e00640 1 --2- 172.21.15.137:0/2802509510 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d3c068380 0x7f1d3c06a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1d480079c0 tx=0x7f1d48008040 comp rx=0 tx=0).stop 2024-04-26T23:42:29.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.204+0000 7f1d66e00640 1 -- 172.21.15.137:0/2802509510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d600b5080 msgr2=0x7f1d601f8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:29.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.204+0000 7f1d66e00640 1 --2- 172.21.15.137:0/2802509510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d600b5080 0x7f1d601f8480 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1d5801afd0 tx=0x7f1d580196c0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.204+0000 7f1d66e00640 1 -- 172.21.15.137:0/2802509510 shutdown_connections 2024-04-26T23:42:29.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.204+0000 7f1d66e00640 1 --2- 172.21.15.137:0/2802509510 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d3c068380 0x7f1d3c06a840 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.204+0000 7f1d66e00640 1 --2- 172.21.15.137:0/2802509510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d600b5080 0x7f1d601f8480 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.204+0000 7f1d66e00640 1 --2- 172.21.15.137:0/2802509510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d60073f30 0x7f1d60138bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.204+0000 7f1d66e00640 1 --2- 172.21.15.137:0/2802509510 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d600725a0 0x7f1d60138670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.204+0000 7f1d66e00640 1 -- 172.21.15.137:0/2802509510 >> 172.21.15.137:0/2802509510 conn(0x7f1d6006c5d0 msgr2=0x7f1d6013dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:29.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.204+0000 7f1d66e00640 1 -- 172.21.15.137:0/2802509510 shutdown_connections 2024-04-26T23:42:29.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.204+0000 7f1d66e00640 1 -- 172.21.15.137:0/2802509510 wait complete. 2024-04-26T23:42:29.230 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T23:42:29.230 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:42:29.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.360+0000 7fb908c00640 1 Processor -- start 2024-04-26T23:42:29.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.360+0000 7fb908c00640 1 -- start start 2024-04-26T23:42:29.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.364+0000 7fb908c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb90415de80 0x7fb904073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:29.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.364+0000 7fb908c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9040ce7c0 0x7fb904146210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:29.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.364+0000 7fb908c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb904073010 con 0x7fb9040ce3e0 2024-04-26T23:42:29.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.364+0000 7fb908c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb9040cef90 con 0x7fb90415de80 2024-04-26T23:42:29.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.364+0000 7fb908c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb904073280 con 0x7fb9040ce7c0 2024-04-26T23:42:29.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.364+0000 7fb8f9400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb90415de80 0x7fb904073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:29.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.364+0000 7fb8f9400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb90415de80 0x7fb904073d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36410/0 (socket says 172.21.15.137:36410) 2024-04-26T23:42:29.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.364+0000 7fb8f9400640 1 -- 172.21.15.137:0/1753441398 learned_addr learned my addr 172.21.15.137:0/1753441398 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:29.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.364+0000 7fb901e00640 1 --1- 172.21.15.137:0/1753441398 >> v1:172.21.15.137:6789/0 conn(0x7fb9040ce3e0 0x7fb9040d04e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58732/0 (socket says 172.21.15.137:58732) 2024-04-26T23:42:29.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.364+0000 7fb902800640 1 --2- 172.21.15.137:0/1753441398 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9040ce7c0 0x7fb904146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:29.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.364+0000 7fb8f9400640 1 -- 172.21.15.137:0/1753441398 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9040ce7c0 msgr2=0x7fb904146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:29.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.364+0000 7fb8f9400640 1 --2- 172.21.15.137:0/1753441398 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9040ce7c0 0x7fb904146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.364+0000 7fb8f9400640 1 -- 172.21.15.137:0/1753441398 >> v1:172.21.15.137:6789/0 conn(0x7fb9040ce3e0 legacy=0x7fb9040d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:29.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.364+0000 7fb8f9400640 1 -- 172.21.15.137:0/1753441398 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb904073560 con 0x7fb90415de80 2024-04-26T23:42:29.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.364+0000 7fb901400640 1 -- 172.21.15.137:0/1753441398 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3297232534 0 0) 0x7fb904073010 con 0x7fb9040ce3e0 2024-04-26T23:42:29.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.364+0000 7fb8f9400640 1 --2- 172.21.15.137:0/1753441398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb90415de80 0x7fb904073d60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0098a0 tx=0x7fb8ec01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e2291b3c6c6b9d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:29.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.364+0000 7fb901400640 1 -- 172.21.15.137:0/1753441398 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec0ab620 con 0x7fb90415de80 2024-04-26T23:42:29.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb901400640 1 -- 172.21.15.137:0/1753441398 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8ec0b0070 con 0x7fb90415de80 2024-04-26T23:42:29.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb901400640 1 -- 172.21.15.137:0/1753441398 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec0ab9e0 con 0x7fb90415de80 2024-04-26T23:42:29.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb908c00640 1 -- 172.21.15.137:0/1753441398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb90415de80 msgr2=0x7fb904073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:29.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb908c00640 1 --2- 172.21.15.137:0/1753441398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb90415de80 0x7fb904073d60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0098a0 tx=0x7fb8ec01c510 comp rx=0 tx=0).stop 2024-04-26T23:42:29.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb908c00640 1 -- 172.21.15.137:0/1753441398 shutdown_connections 2024-04-26T23:42:29.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb908c00640 1 --2- 172.21.15.137:0/1753441398 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9040ce7c0 0x7fb904146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb908c00640 1 --2- 172.21.15.137:0/1753441398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb90415de80 0x7fb904073d60 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb908c00640 1 -- 172.21.15.137:0/1753441398 >> 172.21.15.137:0/1753441398 conn(0x7fb90406c5d0 msgr2=0x7fb90406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:29.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb908c00640 1 -- 172.21.15.137:0/1753441398 shutdown_connections 2024-04-26T23:42:29.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb908c00640 1 -- 172.21.15.137:0/1753441398 wait complete. 2024-04-26T23:42:29.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb908c00640 1 Processor -- start 2024-04-26T23:42:29.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb908c00640 1 -- start start 2024-04-26T23:42:29.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb908c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9040ce3e0 0x7fb90413e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:29.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb908c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9040ce7c0 0x7fb904142260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:29.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb908c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb90415de80 0x7fb9040b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:29.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb908c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb90406f0a0 con 0x7fb9040ce3e0 2024-04-26T23:42:29.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb908c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb90406ef20 con 0x7fb9040ce7c0 2024-04-26T23:42:29.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb908c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb90406f220 con 0x7fb90415de80 2024-04-26T23:42:29.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb901e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9040ce3e0 0x7fb90413e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:29.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb901e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9040ce3e0 0x7fb90413e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36418/0 (socket says 172.21.15.137:36418) 2024-04-26T23:42:29.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb901e00640 1 -- 172.21.15.137:0/1423846746 learned_addr learned my addr 172.21.15.137:0/1423846746 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:29.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb901e00640 1 -- 172.21.15.137:0/1423846746 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb90415de80 msgr2=0x7fb9040b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:29.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb8f9400640 1 --2- 172.21.15.137:0/1423846746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9040ce7c0 0x7fb904142260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:29.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb902800640 1 --2- 172.21.15.137:0/1423846746 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb90415de80 0x7fb9040b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:29.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb901e00640 1 --2- 172.21.15.137:0/1423846746 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb90415de80 0x7fb9040b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb901e00640 1 -- 172.21.15.137:0/1423846746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9040ce7c0 msgr2=0x7fb904142260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:29.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb901e00640 1 --2- 172.21.15.137:0/1423846746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9040ce7c0 0x7fb904142260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb901e00640 1 -- 172.21.15.137:0/1423846746 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb904142ab0 con 0x7fb9040ce3e0 2024-04-26T23:42:29.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb8f9400640 1 --2- 172.21.15.137:0/1423846746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9040ce7c0 0x7fb904142260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:29.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.368+0000 7fb902800640 1 --2- 172.21.15.137:0/1423846746 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb90415de80 0x7fb9040b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:29.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.372+0000 7fb901e00640 1 --2- 172.21.15.137:0/1423846746 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9040ce3e0 0x7fb90413e690 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4001570 tx=0x7fb8f400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:29.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.372+0000 7fb8faa00640 1 -- 172.21.15.137:0/1423846746 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4018070 con 0x7fb9040ce3e0 2024-04-26T23:42:29.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.372+0000 7fb8faa00640 1 -- 172.21.15.137:0/1423846746 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8f400a640 con 0x7fb9040ce3e0 2024-04-26T23:42:29.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.372+0000 7fb908c00640 1 -- 172.21.15.137:0/1423846746 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb904142d90 con 0x7fb9040ce3e0 2024-04-26T23:42:29.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.372+0000 7fb8faa00640 1 -- 172.21.15.137:0/1423846746 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f400aa30 con 0x7fb9040ce3e0 2024-04-26T23:42:29.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.372+0000 7fb908c00640 1 -- 172.21.15.137:0/1423846746 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb904143350 con 0x7fb9040ce3e0 2024-04-26T23:42:29.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.372+0000 7fb908c00640 1 -- 172.21.15.137:0/1423846746 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb904143590 con 0x7fb9040ce3e0 2024-04-26T23:42:29.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.372+0000 7fb8faa00640 1 -- 172.21.15.137:0/1423846746 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb8f401b070 con 0x7fb9040ce3e0 2024-04-26T23:42:29.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.372+0000 7fb8faa00640 1 --2- 172.21.15.137:0/1423846746 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb8e0068380 0x7fb8e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:29.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.372+0000 7fb8faa00640 1 -- 172.21.15.137:0/1423846746 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fb8f4086090 con 0x7fb9040ce3e0 2024-04-26T23:42:29.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.372+0000 7fb8f9400640 1 --2- 172.21.15.137:0/1423846746 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb8e0068380 0x7fb8e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:29.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.376+0000 7fb8f9400640 1 --2- 172.21.15.137:0/1423846746 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb8e0068380 0x7fb8e006a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0af000 tx=0x7fb8ec008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:29.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.376+0000 7fb8faa00640 1 -- 172.21.15.137:0/1423846746 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb8f4056640 con 0x7fb9040ce3e0 2024-04-26T23:42:29.445 INFO:tasks.ceph.mds.d.smithi170.stderr:2024-04-26T23:42:29.436+0000 7fb93ca00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:42:29.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.532+0000 7fb908c00640 1 -- 172.21.15.137:0/1423846746 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb90406a4b0 con 0x7fb8e0068380 2024-04-26T23:42:29.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.540+0000 7fb8faa00640 1 -- 172.21.15.137:0/1423846746 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251880 (secure 0 0 0) 0x7fb90406a4b0 con 0x7fb8e0068380 2024-04-26T23:42:29.547 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:29.548 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T23:42:29.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.540+0000 7fb908c00640 1 -- 172.21.15.137:0/1423846746 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb8e0068380 msgr2=0x7fb8e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:29.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.540+0000 7fb908c00640 1 --2- 172.21.15.137:0/1423846746 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb8e0068380 0x7fb8e006a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0af000 tx=0x7fb8ec008040 comp rx=0 tx=0).stop 2024-04-26T23:42:29.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.544+0000 7fb908c00640 1 -- 172.21.15.137:0/1423846746 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9040ce3e0 msgr2=0x7fb90413e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:29.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.544+0000 7fb908c00640 1 --2- 172.21.15.137:0/1423846746 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9040ce3e0 0x7fb90413e690 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4001570 tx=0x7fb8f400cd20 comp rx=0 tx=0).stop 2024-04-26T23:42:29.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.544+0000 7fb908c00640 1 -- 172.21.15.137:0/1423846746 shutdown_connections 2024-04-26T23:42:29.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.544+0000 7fb908c00640 1 --2- 172.21.15.137:0/1423846746 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb8e0068380 0x7fb8e006a840 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.544+0000 7fb908c00640 1 --2- 172.21.15.137:0/1423846746 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb90415de80 0x7fb9040b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.544+0000 7fb908c00640 1 --2- 172.21.15.137:0/1423846746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9040ce7c0 0x7fb904142260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.544+0000 7fb908c00640 1 --2- 172.21.15.137:0/1423846746 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9040ce3e0 0x7fb90413e690 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.544+0000 7fb908c00640 1 -- 172.21.15.137:0/1423846746 >> 172.21.15.137:0/1423846746 conn(0x7fb90406c5d0 msgr2=0x7fb9040d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:29.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.544+0000 7fb908c00640 1 -- 172.21.15.137:0/1423846746 shutdown_connections 2024-04-26T23:42:29.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.544+0000 7fb908c00640 1 -- 172.21.15.137:0/1423846746 wait complete. 2024-04-26T23:42:29.567 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-04-26T23:42:27.601645+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":67,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236736,"kb_used_data":3916,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737984,"statfs":{"total":773094113280,"available":772851695616,"internally_reserved":0,"allocated":4009984,"data_stored":2262852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.142979"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.512639+0000","last_change":"2024-04-26T23:42:25.505117+0000","last_active":"2024-04-26T23:42:25.512639+0000","last_peered":"2024-04-26T23:42:25.512639+0000","last_clean":"2024-04-26T23:42:25.512639+0000","last_became_active":"2024-04-26T23:42:25.496294+0000","last_became_peered":"2024-04-26T23:42:25.496294+0000","last_unstale":"2024-04-26T23:42:25.512639+0000","last_undegraded":"2024-04-26T23:42:25.512639+0000","last_fullsized":"2024-04-26T23:42:25.512639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:07:59.104387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.487260+0000","last_change":"2024-04-26T23:42:25.485469+0000","last_active":"2024-04-26T23:42:25.487260+0000","last_peered":"2024-04-26T23:42:25.487260+0000","last_clean":"2024-04-26T23:42:25.487260+0000","last_became_active":"2024-04-26T23:42:25.484412+0000","last_became_peered":"2024-04-26T23:42:25.484412+0000","last_unstale":"2024-04-26T23:42:25.487260+0000","last_undegraded":"2024-04-26T23:42:25.487260+0000","last_fullsized":"2024-04-26T23:42:25.487260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:46:07.530048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.502132+0000","last_change":"2024-04-26T23:42:25.497908+0000","last_active":"2024-04-26T23:42:25.502132+0000","last_peered":"2024-04-26T23:42:25.502132+0000","last_clean":"2024-04-26T23:42:25.502132+0000","last_became_active":"2024-04-26T23:42:25.497588+0000","last_became_peered":"2024-04-26T23:42:25.497588+0000","last_unstale":"2024-04-26T23:42:25.502132+0000","last_undegraded":"2024-04-26T23:42:25.502132+0000","last_fullsized":"2024-04-26T23:42:25.502132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:22.719776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.510916+0000","last_change":"2024-04-26T23:42:25.504929+0000","last_active":"2024-04-26T23:42:25.510916+0000","last_peered":"2024-04-26T23:42:25.510916+0000","last_clean":"2024-04-26T23:42:25.510916+0000","last_became_active":"2024-04-26T23:42:25.503518+0000","last_became_peered":"2024-04-26T23:42:25.503518+0000","last_unstale":"2024-04-26T23:42:25.510916+0000","last_undegraded":"2024-04-26T23:42:25.510916+0000","last_fullsized":"2024-04-26T23:42:25.510916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:54.243362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.504748+0000","last_change":"2024-04-26T23:42:25.498675+0000","last_active":"2024-04-26T23:42:25.504748+0000","last_peered":"2024-04-26T23:42:25.504748+0000","last_clean":"2024-04-26T23:42:25.504748+0000","last_became_active":"2024-04-26T23:42:25.497486+0000","last_became_peered":"2024-04-26T23:42:25.497486+0000","last_unstale":"2024-04-26T23:42:25.504748+0000","last_undegraded":"2024-04-26T23:42:25.504748+0000","last_fullsized":"2024-04-26T23:42:25.504748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:15.553331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.487249+0000","last_change":"2024-04-26T23:42:25.484693+0000","last_active":"2024-04-26T23:42:25.487249+0000","last_peered":"2024-04-26T23:42:25.487249+0000","last_clean":"2024-04-26T23:42:25.487249+0000","last_became_active":"2024-04-26T23:42:25.484530+0000","last_became_peered":"2024-04-26T23:42:25.484530+0000","last_unstale":"2024-04-26T23:42:25.487249+0000","last_undegraded":"2024-04-26T23:42:25.487249+0000","last_fullsized":"2024-04-26T23:42:25.487249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:22.719776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.508492+0000","last_change":"2024-04-26T23:42:25.505143+0000","last_active":"2024-04-26T23:42:25.508492+0000","last_peered":"2024-04-26T23:42:25.508492+0000","last_clean":"2024-04-26T23:42:25.508492+0000","last_became_active":"2024-04-26T23:42:25.504846+0000","last_became_peered":"2024-04-26T23:42:25.504846+0000","last_unstale":"2024-04-26T23:42:25.508492+0000","last_undegraded":"2024-04-26T23:42:25.508492+0000","last_fullsized":"2024-04-26T23:42:25.508492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:54.243362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.504769+0000","last_change":"2024-04-26T23:42:25.503168+0000","last_active":"2024-04-26T23:42:25.504769+0000","last_peered":"2024-04-26T23:42:25.504769+0000","last_clean":"2024-04-26T23:42:25.504769+0000","last_became_active":"2024-04-26T23:42:25.502951+0000","last_became_peered":"2024-04-26T23:42:25.502951+0000","last_unstale":"2024-04-26T23:42:25.504769+0000","last_undegraded":"2024-04-26T23:42:25.504769+0000","last_fullsized":"2024-04-26T23:42:25.504769+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:21:05.256266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.501230+0000","last_change":"2024-04-26T23:42:25.499981+0000","last_active":"2024-04-26T23:42:25.501230+0000","last_peered":"2024-04-26T23:42:25.501230+0000","last_clean":"2024-04-26T23:42:25.501230+0000","last_became_active":"2024-04-26T23:42:25.499610+0000","last_became_peered":"2024-04-26T23:42:25.499610+0000","last_unstale":"2024-04-26T23:42:25.501230+0000","last_undegraded":"2024-04-26T23:42:25.501230+0000","last_fullsized":"2024-04-26T23:42:25.501230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:54.243362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.509685+0000","last_change":"2024-04-26T23:42:25.497932+0000","last_active":"2024-04-26T23:42:25.509685+0000","last_peered":"2024-04-26T23:42:25.509685+0000","last_clean":"2024-04-26T23:42:25.509685+0000","last_became_active":"2024-04-26T23:42:25.497644+0000","last_became_peered":"2024-04-26T23:42:25.497644+0000","last_unstale":"2024-04-26T23:42:25.509685+0000","last_undegraded":"2024-04-26T23:42:25.509685+0000","last_fullsized":"2024-04-26T23:42:25.509685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:07:59.104387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.514472+0000","last_change":"2024-04-26T23:42:25.512746+0000","last_active":"2024-04-26T23:42:25.514472+0000","last_peered":"2024-04-26T23:42:25.514472+0000","last_clean":"2024-04-26T23:42:25.514472+0000","last_became_active":"2024-04-26T23:42:25.512166+0000","last_became_peered":"2024-04-26T23:42:25.512166+0000","last_unstale":"2024-04-26T23:42:25.514472+0000","last_undegraded":"2024-04-26T23:42:25.514472+0000","last_fullsized":"2024-04-26T23:42:25.514472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:29.218972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.495764+0000","last_change":"2024-04-26T23:42:25.487652+0000","last_active":"2024-04-26T23:42:25.495764+0000","last_peered":"2024-04-26T23:42:25.495764+0000","last_clean":"2024-04-26T23:42:25.495764+0000","last_became_active":"2024-04-26T23:42:25.484134+0000","last_became_peered":"2024-04-26T23:42:25.484134+0000","last_unstale":"2024-04-26T23:42:25.495764+0000","last_undegraded":"2024-04-26T23:42:25.495764+0000","last_fullsized":"2024-04-26T23:42:25.495764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:52.504897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.504869+0000","last_change":"2024-04-26T23:42:25.500676+0000","last_active":"2024-04-26T23:42:25.504869+0000","last_peered":"2024-04-26T23:42:25.504869+0000","last_clean":"2024-04-26T23:42:25.504869+0000","last_became_active":"2024-04-26T23:42:25.500441+0000","last_became_peered":"2024-04-26T23:42:25.500441+0000","last_unstale":"2024-04-26T23:42:25.504869+0000","last_undegraded":"2024-04-26T23:42:25.504869+0000","last_fullsized":"2024-04-26T23:42:25.504869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:06.751860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.499088+0000","last_change":"2024-04-26T23:42:25.495271+0000","last_active":"2024-04-26T23:42:25.499088+0000","last_peered":"2024-04-26T23:42:25.499088+0000","last_clean":"2024-04-26T23:42:25.499088+0000","last_became_active":"2024-04-26T23:42:25.494922+0000","last_became_peered":"2024-04-26T23:42:25.494922+0000","last_unstale":"2024-04-26T23:42:25.499088+0000","last_undegraded":"2024-04-26T23:42:25.499088+0000","last_fullsized":"2024-04-26T23:42:25.499088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:16:56.474132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.510090+0000","last_change":"2024-04-26T23:42:25.507719+0000","last_active":"2024-04-26T23:42:25.510090+0000","last_peered":"2024-04-26T23:42:25.510090+0000","last_clean":"2024-04-26T23:42:25.510090+0000","last_became_active":"2024-04-26T23:42:25.507491+0000","last_became_peered":"2024-04-26T23:42:25.507491+0000","last_unstale":"2024-04-26T23:42:25.510090+0000","last_undegraded":"2024-04-26T23:42:25.510090+0000","last_fullsized":"2024-04-26T23:42:25.510090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:00:28.493209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.504791+0000","last_change":"2024-04-26T23:42:25.503345+0000","last_active":"2024-04-26T23:42:25.504791+0000","last_peered":"2024-04-26T23:42:25.504791+0000","last_clean":"2024-04-26T23:42:25.504791+0000","last_became_active":"2024-04-26T23:42:25.503141+0000","last_became_peered":"2024-04-26T23:42:25.503141+0000","last_unstale":"2024-04-26T23:42:25.504791+0000","last_undegraded":"2024-04-26T23:42:25.504791+0000","last_fullsized":"2024-04-26T23:42:25.504791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:07:59.104387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.515797+0000","last_change":"2024-04-26T23:42:25.515025+0000","last_active":"2024-04-26T23:42:25.515797+0000","last_peered":"2024-04-26T23:42:25.515797+0000","last_clean":"2024-04-26T23:42:25.515797+0000","last_became_active":"2024-04-26T23:42:25.514752+0000","last_became_peered":"2024-04-26T23:42:25.514752+0000","last_unstale":"2024-04-26T23:42:25.515797+0000","last_undegraded":"2024-04-26T23:42:25.515797+0000","last_fullsized":"2024-04-26T23:42:25.515797+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:46:07.530048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.504506+0000","last_change":"2024-04-26T23:42:25.499116+0000","last_active":"2024-04-26T23:42:25.504506+0000","last_peered":"2024-04-26T23:42:25.504506+0000","last_clean":"2024-04-26T23:42:25.504506+0000","last_became_active":"2024-04-26T23:42:25.498364+0000","last_became_peered":"2024-04-26T23:42:25.498364+0000","last_unstale":"2024-04-26T23:42:25.504506+0000","last_undegraded":"2024-04-26T23:42:25.504506+0000","last_fullsized":"2024-04-26T23:42:25.504506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:20.672990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.505652+0000","last_change":"2024-04-26T23:42:25.499490+0000","last_active":"2024-04-26T23:42:25.505652+0000","last_peered":"2024-04-26T23:42:25.505652+0000","last_clean":"2024-04-26T23:42:25.505652+0000","last_became_active":"2024-04-26T23:42:25.499200+0000","last_became_peered":"2024-04-26T23:42:25.499200+0000","last_unstale":"2024-04-26T23:42:25.505652+0000","last_undegraded":"2024-04-26T23:42:25.505652+0000","last_fullsized":"2024-04-26T23:42:25.505652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:22:46.905273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.506298+0000","last_change":"2024-04-26T23:42:25.503747+0000","last_active":"2024-04-26T23:42:25.506298+0000","last_peered":"2024-04-26T23:42:25.506298+0000","last_clean":"2024-04-26T23:42:25.506298+0000","last_became_active":"2024-04-26T23:42:25.503500+0000","last_became_peered":"2024-04-26T23:42:25.503500+0000","last_unstale":"2024-04-26T23:42:25.506298+0000","last_undegraded":"2024-04-26T23:42:25.506298+0000","last_fullsized":"2024-04-26T23:42:25.506298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:13:11.155363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.508650+0000","last_change":"2024-04-26T23:42:25.507205+0000","last_active":"2024-04-26T23:42:25.508650+0000","last_peered":"2024-04-26T23:42:25.508650+0000","last_clean":"2024-04-26T23:42:25.508650+0000","last_became_active":"2024-04-26T23:42:25.506896+0000","last_became_peered":"2024-04-26T23:42:25.506896+0000","last_unstale":"2024-04-26T23:42:25.508650+0000","last_undegraded":"2024-04-26T23:42:25.508650+0000","last_fullsized":"2024-04-26T23:42:25.508650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:36:51.669023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.499233+0000","last_change":"2024-04-26T23:42:25.490433+0000","last_active":"2024-04-26T23:42:25.499233+0000","last_peered":"2024-04-26T23:42:25.499233+0000","last_clean":"2024-04-26T23:42:25.499233+0000","last_became_active":"2024-04-26T23:42:25.489532+0000","last_became_peered":"2024-04-26T23:42:25.489532+0000","last_unstale":"2024-04-26T23:42:25.499233+0000","last_undegraded":"2024-04-26T23:42:25.499233+0000","last_fullsized":"2024-04-26T23:42:25.499233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:07:59.104387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.507298+0000","last_change":"2024-04-26T23:42:25.502005+0000","last_active":"2024-04-26T23:42:25.507298+0000","last_peered":"2024-04-26T23:42:25.507298+0000","last_clean":"2024-04-26T23:42:25.507298+0000","last_became_active":"2024-04-26T23:42:25.501674+0000","last_became_peered":"2024-04-26T23:42:25.501674+0000","last_unstale":"2024-04-26T23:42:25.507298+0000","last_undegraded":"2024-04-26T23:42:25.507298+0000","last_fullsized":"2024-04-26T23:42:25.507298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:47.493980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.502765+0000","last_change":"2024-04-26T23:42:25.501926+0000","last_active":"2024-04-26T23:42:25.502765+0000","last_peered":"2024-04-26T23:42:25.502765+0000","last_clean":"2024-04-26T23:42:25.502765+0000","last_became_active":"2024-04-26T23:42:25.501537+0000","last_became_peered":"2024-04-26T23:42:25.501537+0000","last_unstale":"2024-04-26T23:42:25.502765+0000","last_undegraded":"2024-04-26T23:42:25.502765+0000","last_fullsized":"2024-04-26T23:42:25.502765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:45:23.560351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.514606+0000","last_change":"2024-04-26T23:42:25.513611+0000","last_active":"2024-04-26T23:42:25.514606+0000","last_peered":"2024-04-26T23:42:25.514606+0000","last_clean":"2024-04-26T23:42:25.514606+0000","last_became_active":"2024-04-26T23:42:25.513356+0000","last_became_peered":"2024-04-26T23:42:25.513356+0000","last_unstale":"2024-04-26T23:42:25.514606+0000","last_undegraded":"2024-04-26T23:42:25.514606+0000","last_fullsized":"2024-04-26T23:42:25.514606+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:29.218972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.499344+0000","last_change":"2024-04-26T23:42:25.492782+0000","last_active":"2024-04-26T23:42:25.499344+0000","last_peered":"2024-04-26T23:42:25.499344+0000","last_clean":"2024-04-26T23:42:25.499344+0000","last_became_active":"2024-04-26T23:42:25.492496+0000","last_became_peered":"2024-04-26T23:42:25.492496+0000","last_unstale":"2024-04-26T23:42:25.499344+0000","last_undegraded":"2024-04-26T23:42:25.499344+0000","last_fullsized":"2024-04-26T23:42:25.499344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:45:23.560351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.511022+0000","last_change":"2024-04-26T23:42:25.508166+0000","last_active":"2024-04-26T23:42:25.511022+0000","last_peered":"2024-04-26T23:42:25.511022+0000","last_clean":"2024-04-26T23:42:25.511022+0000","last_became_active":"2024-04-26T23:42:25.507898+0000","last_became_peered":"2024-04-26T23:42:25.507898+0000","last_unstale":"2024-04-26T23:42:25.511022+0000","last_undegraded":"2024-04-26T23:42:25.511022+0000","last_fullsized":"2024-04-26T23:42:25.511022+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:52.504897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.495743+0000","last_change":"2024-04-26T23:42:25.484393+0000","last_active":"2024-04-26T23:42:25.495743+0000","last_peered":"2024-04-26T23:42:25.495743+0000","last_clean":"2024-04-26T23:42:25.495743+0000","last_became_active":"2024-04-26T23:42:25.483761+0000","last_became_peered":"2024-04-26T23:42:25.483761+0000","last_unstale":"2024-04-26T23:42:25.495743+0000","last_undegraded":"2024-04-26T23:42:25.495743+0000","last_fullsized":"2024-04-26T23:42:25.495743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:45:53.092092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.487867+0000","last_change":"2024-04-26T23:42:25.482548+0000","last_active":"2024-04-26T23:42:25.487867+0000","last_peered":"2024-04-26T23:42:25.487867+0000","last_clean":"2024-04-26T23:42:25.487867+0000","last_became_active":"2024-04-26T23:42:25.482037+0000","last_became_peered":"2024-04-26T23:42:25.482037+0000","last_unstale":"2024-04-26T23:42:25.487867+0000","last_undegraded":"2024-04-26T23:42:25.487867+0000","last_fullsized":"2024-04-26T23:42:25.487867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:05.788026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.515080+0000","last_change":"2024-04-26T23:42:25.513241+0000","last_active":"2024-04-26T23:42:25.515080+0000","last_peered":"2024-04-26T23:42:25.515080+0000","last_clean":"2024-04-26T23:42:25.515080+0000","last_became_active":"2024-04-26T23:42:25.512140+0000","last_became_peered":"2024-04-26T23:42:25.512140+0000","last_unstale":"2024-04-26T23:42:25.515080+0000","last_undegraded":"2024-04-26T23:42:25.515080+0000","last_fullsized":"2024-04-26T23:42:25.515080+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:22.719776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.515309+0000","last_change":"2024-04-26T23:42:25.503006+0000","last_active":"2024-04-26T23:42:25.515309+0000","last_peered":"2024-04-26T23:42:25.515309+0000","last_clean":"2024-04-26T23:42:25.515309+0000","last_became_active":"2024-04-26T23:42:25.502307+0000","last_became_peered":"2024-04-26T23:42:25.502307+0000","last_unstale":"2024-04-26T23:42:25.515309+0000","last_undegraded":"2024-04-26T23:42:25.515309+0000","last_fullsized":"2024-04-26T23:42:25.515309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:05.788026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.502095+0000","last_change":"2024-04-26T23:42:25.501059+0000","last_active":"2024-04-26T23:42:25.502095+0000","last_peered":"2024-04-26T23:42:25.502095+0000","last_clean":"2024-04-26T23:42:25.502095+0000","last_became_active":"2024-04-26T23:42:25.498674+0000","last_became_peered":"2024-04-26T23:42:25.498674+0000","last_unstale":"2024-04-26T23:42:25.502095+0000","last_undegraded":"2024-04-26T23:42:25.502095+0000","last_fullsized":"2024-04-26T23:42:25.502095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:23.713594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.506120+0000","last_change":"2024-04-26T23:42:25.493989+0000","last_active":"2024-04-26T23:42:25.506120+0000","last_peered":"2024-04-26T23:42:25.506120+0000","last_clean":"2024-04-26T23:42:25.506120+0000","last_became_active":"2024-04-26T23:42:25.493686+0000","last_became_peered":"2024-04-26T23:42:25.493686+0000","last_unstale":"2024-04-26T23:42:25.506120+0000","last_undegraded":"2024-04-26T23:42:25.506120+0000","last_fullsized":"2024-04-26T23:42:25.506120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:21:05.256266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.516626+0000","last_change":"2024-04-26T23:42:24.480773+0000","last_active":"2024-04-26T23:42:25.516626+0000","last_peered":"2024-04-26T23:42:25.516626+0000","last_clean":"2024-04-26T23:42:25.516626+0000","last_became_active":"2024-04-26T23:42:24.480452+0000","last_became_peered":"2024-04-26T23:42:24.480452+0000","last_unstale":"2024-04-26T23:42:25.516626+0000","last_undegraded":"2024-04-26T23:42:25.516626+0000","last_fullsized":"2024-04-26T23:42:25.516626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:21:04.249493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.512665+0000","last_change":"2024-04-26T23:42:25.505327+0000","last_active":"2024-04-26T23:42:25.512665+0000","last_peered":"2024-04-26T23:42:25.512665+0000","last_clean":"2024-04-26T23:42:25.512665+0000","last_became_active":"2024-04-26T23:42:25.504115+0000","last_became_peered":"2024-04-26T23:42:25.504115+0000","last_unstale":"2024-04-26T23:42:25.512665+0000","last_undegraded":"2024-04-26T23:42:25.512665+0000","last_fullsized":"2024-04-26T23:42:25.512665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:47.493980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.502272+0000","last_change":"2024-04-26T23:42:24.494369+0000","last_active":"2024-04-26T23:42:25.502272+0000","last_peered":"2024-04-26T23:42:25.502272+0000","last_clean":"2024-04-26T23:42:25.502272+0000","last_became_active":"2024-04-26T23:42:24.493123+0000","last_became_peered":"2024-04-26T23:42:24.493123+0000","last_unstale":"2024-04-26T23:42:25.502272+0000","last_undegraded":"2024-04-26T23:42:25.502272+0000","last_fullsized":"2024-04-26T23:42:25.502272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:19.854795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.499150+0000","last_change":"2024-04-26T23:42:25.493897+0000","last_active":"2024-04-26T23:42:25.499150+0000","last_peered":"2024-04-26T23:42:25.499150+0000","last_clean":"2024-04-26T23:42:25.499150+0000","last_became_active":"2024-04-26T23:42:25.491495+0000","last_became_peered":"2024-04-26T23:42:25.491495+0000","last_unstale":"2024-04-26T23:42:25.499150+0000","last_undegraded":"2024-04-26T23:42:25.499150+0000","last_fullsized":"2024-04-26T23:42:25.499150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:47.493980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.503660+0000","last_change":"2024-04-26T23:42:24.499347+0000","last_active":"2024-04-26T23:42:25.503660+0000","last_peered":"2024-04-26T23:42:25.503660+0000","last_clean":"2024-04-26T23:42:25.503660+0000","last_became_active":"2024-04-26T23:42:24.499079+0000","last_became_peered":"2024-04-26T23:42:24.499079+0000","last_unstale":"2024-04-26T23:42:25.503660+0000","last_undegraded":"2024-04-26T23:42:25.503660+0000","last_fullsized":"2024-04-26T23:42:25.503660+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:51.498125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.511008+0000","last_change":"2024-04-26T23:42:25.508179+0000","last_active":"2024-04-26T23:42:25.511008+0000","last_peered":"2024-04-26T23:42:25.511008+0000","last_clean":"2024-04-26T23:42:25.511008+0000","last_became_active":"2024-04-26T23:42:25.507871+0000","last_became_peered":"2024-04-26T23:42:25.507871+0000","last_unstale":"2024-04-26T23:42:25.511008+0000","last_undegraded":"2024-04-26T23:42:25.511008+0000","last_fullsized":"2024-04-26T23:42:25.511008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:45:53.092092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.509128+0000","last_change":"2024-04-26T23:42:24.498467+0000","last_active":"2024-04-26T23:42:25.509128+0000","last_peered":"2024-04-26T23:42:25.509128+0000","last_clean":"2024-04-26T23:42:25.509128+0000","last_became_active":"2024-04-26T23:42:24.498135+0000","last_became_peered":"2024-04-26T23:42:24.498135+0000","last_unstale":"2024-04-26T23:42:25.509128+0000","last_undegraded":"2024-04-26T23:42:25.509128+0000","last_fullsized":"2024-04-26T23:42:25.509128+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:13:12.396014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.512001+0000","last_change":"2024-04-26T23:42:25.507864+0000","last_active":"2024-04-26T23:42:25.512001+0000","last_peered":"2024-04-26T23:42:25.512001+0000","last_clean":"2024-04-26T23:42:25.512001+0000","last_became_active":"2024-04-26T23:42:25.507551+0000","last_became_peered":"2024-04-26T23:42:25.507551+0000","last_unstale":"2024-04-26T23:42:25.512001+0000","last_undegraded":"2024-04-26T23:42:25.512001+0000","last_fullsized":"2024-04-26T23:42:25.512001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:52.504897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.509983+0000","last_change":"2024-04-26T23:42:24.491550+0000","last_active":"2024-04-26T23:42:25.509983+0000","last_peered":"2024-04-26T23:42:25.509983+0000","last_clean":"2024-04-26T23:42:25.509983+0000","last_became_active":"2024-04-26T23:42:24.491287+0000","last_became_peered":"2024-04-26T23:42:24.491287+0000","last_unstale":"2024-04-26T23:42:25.509983+0000","last_undegraded":"2024-04-26T23:42:25.509983+0000","last_fullsized":"2024-04-26T23:42:25.509983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:32.545453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.495440+0000","last_change":"2024-04-26T23:42:25.494438+0000","last_active":"2024-04-26T23:42:25.495440+0000","last_peered":"2024-04-26T23:42:25.495440+0000","last_clean":"2024-04-26T23:42:25.495440+0000","last_became_active":"2024-04-26T23:42:25.494035+0000","last_became_peered":"2024-04-26T23:42:25.494035+0000","last_unstale":"2024-04-26T23:42:25.495440+0000","last_undegraded":"2024-04-26T23:42:25.495440+0000","last_fullsized":"2024-04-26T23:42:25.495440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:29.218972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.511032+0000","last_change":"2024-04-26T23:42:24.491245+0000","last_active":"2024-04-26T23:42:25.511032+0000","last_peered":"2024-04-26T23:42:25.511032+0000","last_clean":"2024-04-26T23:42:25.511032+0000","last_became_active":"2024-04-26T23:42:24.490425+0000","last_became_peered":"2024-04-26T23:42:24.490425+0000","last_unstale":"2024-04-26T23:42:25.511032+0000","last_undegraded":"2024-04-26T23:42:25.511032+0000","last_fullsized":"2024-04-26T23:42:25.511032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:17:27.887895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.490675+0000","last_change":"2024-04-26T23:42:25.486839+0000","last_active":"2024-04-26T23:42:25.490675+0000","last_peered":"2024-04-26T23:42:25.490675+0000","last_clean":"2024-04-26T23:42:25.490675+0000","last_became_active":"2024-04-26T23:42:25.486505+0000","last_became_peered":"2024-04-26T23:42:25.486505+0000","last_unstale":"2024-04-26T23:42:25.490675+0000","last_undegraded":"2024-04-26T23:42:25.490675+0000","last_fullsized":"2024-04-26T23:42:25.490675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:23.713594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.473011+0000","last_change":"2024-04-26T23:42:24.501525+0000","last_active":"2024-04-26T23:42:25.473011+0000","last_peered":"2024-04-26T23:42:25.473011+0000","last_clean":"2024-04-26T23:42:25.473011+0000","last_became_active":"2024-04-26T23:42:24.501258+0000","last_became_peered":"2024-04-26T23:42:24.501258+0000","last_unstale":"2024-04-26T23:42:25.473011+0000","last_undegraded":"2024-04-26T23:42:25.473011+0000","last_fullsized":"2024-04-26T23:42:25.473011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:45:52.085320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.509229+0000","last_change":"2024-04-26T23:42:25.497077+0000","last_active":"2024-04-26T23:42:25.509229+0000","last_peered":"2024-04-26T23:42:25.509229+0000","last_clean":"2024-04-26T23:42:25.509229+0000","last_became_active":"2024-04-26T23:42:25.496108+0000","last_became_peered":"2024-04-26T23:42:25.496108+0000","last_unstale":"2024-04-26T23:42:25.509229+0000","last_undegraded":"2024-04-26T23:42:25.509229+0000","last_fullsized":"2024-04-26T23:42:25.509229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:21:05.256266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.476100+0000","last_change":"2024-04-26T23:42:24.485085+0000","last_active":"2024-04-26T23:42:25.476100+0000","last_peered":"2024-04-26T23:42:25.476100+0000","last_clean":"2024-04-26T23:42:25.476100+0000","last_became_active":"2024-04-26T23:42:24.484430+0000","last_became_peered":"2024-04-26T23:42:24.484430+0000","last_unstale":"2024-04-26T23:42:25.476100+0000","last_undegraded":"2024-04-26T23:42:25.476100+0000","last_fullsized":"2024-04-26T23:42:25.476100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:13:10.148591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.484592+0000","last_change":"2024-04-26T23:42:25.483257+0000","last_active":"2024-04-26T23:42:25.484592+0000","last_peered":"2024-04-26T23:42:25.484592+0000","last_clean":"2024-04-26T23:42:25.484592+0000","last_became_active":"2024-04-26T23:42:25.482992+0000","last_became_peered":"2024-04-26T23:42:25.482992+0000","last_unstale":"2024-04-26T23:42:25.484592+0000","last_undegraded":"2024-04-26T23:42:25.484592+0000","last_fullsized":"2024-04-26T23:42:25.484592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:54.243362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.472963+0000","last_change":"2024-04-26T23:42:24.495212+0000","last_active":"2024-04-26T23:42:25.472963+0000","last_peered":"2024-04-26T23:42:25.472963+0000","last_clean":"2024-04-26T23:42:25.472963+0000","last_became_active":"2024-04-26T23:42:24.494935+0000","last_became_peered":"2024-04-26T23:42:24.494935+0000","last_unstale":"2024-04-26T23:42:25.472963+0000","last_undegraded":"2024-04-26T23:42:25.472963+0000","last_fullsized":"2024-04-26T23:42:25.472963+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:53.236590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.506260+0000","last_change":"2024-04-26T23:42:25.499511+0000","last_active":"2024-04-26T23:42:25.506260+0000","last_peered":"2024-04-26T23:42:25.506260+0000","last_clean":"2024-04-26T23:42:25.506260+0000","last_became_active":"2024-04-26T23:42:25.499210+0000","last_became_peered":"2024-04-26T23:42:25.499210+0000","last_unstale":"2024-04-26T23:42:25.506260+0000","last_undegraded":"2024-04-26T23:42:25.506260+0000","last_fullsized":"2024-04-26T23:42:25.506260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:32:11.244966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.478746+0000","last_change":"2024-04-26T23:42:24.495039+0000","last_active":"2024-04-26T23:42:25.478746+0000","last_peered":"2024-04-26T23:42:25.478746+0000","last_clean":"2024-04-26T23:42:25.478746+0000","last_became_active":"2024-04-26T23:42:24.494760+0000","last_became_peered":"2024-04-26T23:42:24.494760+0000","last_unstale":"2024-04-26T23:42:25.478746+0000","last_undegraded":"2024-04-26T23:42:25.478746+0000","last_fullsized":"2024-04-26T23:42:25.478746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:04.781254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.499663+0000","last_change":"2024-04-26T23:42:25.492837+0000","last_active":"2024-04-26T23:42:25.499663+0000","last_peered":"2024-04-26T23:42:25.499663+0000","last_clean":"2024-04-26T23:42:25.499663+0000","last_became_active":"2024-04-26T23:42:25.492486+0000","last_became_peered":"2024-04-26T23:42:25.492486+0000","last_unstale":"2024-04-26T23:42:25.499663+0000","last_undegraded":"2024-04-26T23:42:25.499663+0000","last_fullsized":"2024-04-26T23:42:25.499663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:00:28.493209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.496989+0000","last_change":"2024-04-26T23:42:24.491054+0000","last_active":"2024-04-26T23:42:25.496989+0000","last_peered":"2024-04-26T23:42:25.496989+0000","last_clean":"2024-04-26T23:42:25.496989+0000","last_became_active":"2024-04-26T23:42:24.490586+0000","last_became_peered":"2024-04-26T23:42:24.490586+0000","last_unstale":"2024-04-26T23:42:25.496989+0000","last_undegraded":"2024-04-26T23:42:25.496989+0000","last_fullsized":"2024-04-26T23:42:25.496989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:46.487208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.512233+0000","last_change":"2024-04-26T23:42:25.510146+0000","last_active":"2024-04-26T23:42:25.512233+0000","last_peered":"2024-04-26T23:42:25.512233+0000","last_clean":"2024-04-26T23:42:25.512233+0000","last_became_active":"2024-04-26T23:42:25.509871+0000","last_became_peered":"2024-04-26T23:42:25.509871+0000","last_unstale":"2024-04-26T23:42:25.512233+0000","last_undegraded":"2024-04-26T23:42:25.512233+0000","last_fullsized":"2024-04-26T23:42:25.512233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:16:56.474132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.512763+0000","last_change":"2024-04-26T23:42:24.499354+0000","last_active":"2024-04-26T23:42:25.512763+0000","last_peered":"2024-04-26T23:42:25.512763+0000","last_clean":"2024-04-26T23:42:25.512763+0000","last_became_active":"2024-04-26T23:42:24.499091+0000","last_became_peered":"2024-04-26T23:42:24.499091+0000","last_unstale":"2024-04-26T23:42:25.512763+0000","last_undegraded":"2024-04-26T23:42:25.512763+0000","last_fullsized":"2024-04-26T23:42:25.512763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:36:50.662251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.509933+0000","last_change":"2024-04-26T23:42:25.498488+0000","last_active":"2024-04-26T23:42:25.509933+0000","last_peered":"2024-04-26T23:42:25.509933+0000","last_clean":"2024-04-26T23:42:25.509933+0000","last_became_active":"2024-04-26T23:42:25.498190+0000","last_became_peered":"2024-04-26T23:42:25.498190+0000","last_unstale":"2024-04-26T23:42:25.509933+0000","last_undegraded":"2024-04-26T23:42:25.509933+0000","last_fullsized":"2024-04-26T23:42:25.509933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:47.493980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.514120+0000","last_change":"2024-04-26T23:42:24.487980+0000","last_active":"2024-04-26T23:42:25.514120+0000","last_peered":"2024-04-26T23:42:25.514120+0000","last_clean":"2024-04-26T23:42:25.514120+0000","last_became_active":"2024-04-26T23:42:24.487585+0000","last_became_peered":"2024-04-26T23:42:24.487585+0000","last_unstale":"2024-04-26T23:42:25.514120+0000","last_undegraded":"2024-04-26T23:42:25.514120+0000","last_fullsized":"2024-04-26T23:42:25.514120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:49:32.823232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.488005+0000","last_change":"2024-04-26T23:42:25.484412+0000","last_active":"2024-04-26T23:42:25.488005+0000","last_peered":"2024-04-26T23:42:25.488005+0000","last_clean":"2024-04-26T23:42:25.488005+0000","last_became_active":"2024-04-26T23:42:25.484075+0000","last_became_peered":"2024-04-26T23:42:25.484075+0000","last_unstale":"2024-04-26T23:42:25.488005+0000","last_undegraded":"2024-04-26T23:42:25.488005+0000","last_fullsized":"2024-04-26T23:42:25.488005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:29.218972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.487169+0000","last_change":"2024-04-26T23:42:24.480931+0000","last_active":"2024-04-26T23:42:25.487169+0000","last_peered":"2024-04-26T23:42:25.487169+0000","last_clean":"2024-04-26T23:42:25.487169+0000","last_became_active":"2024-04-26T23:42:24.480466+0000","last_became_peered":"2024-04-26T23:42:24.480466+0000","last_unstale":"2024-04-26T23:42:25.487169+0000","last_undegraded":"2024-04-26T23:42:25.487169+0000","last_fullsized":"2024-04-26T23:42:25.487169+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:02:16.144159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.508554+0000","last_change":"2024-04-26T23:42:25.507442+0000","last_active":"2024-04-26T23:42:25.508554+0000","last_peered":"2024-04-26T23:42:25.508554+0000","last_clean":"2024-04-26T23:42:25.508554+0000","last_became_active":"2024-04-26T23:42:25.507184+0000","last_became_peered":"2024-04-26T23:42:25.507184+0000","last_unstale":"2024-04-26T23:42:25.508554+0000","last_undegraded":"2024-04-26T23:42:25.508554+0000","last_fullsized":"2024-04-26T23:42:25.508554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:45:53.092092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.472074+0000","last_change":"2024-04-26T23:42:24.495324+0000","last_active":"2024-04-26T23:42:25.472074+0000","last_peered":"2024-04-26T23:42:25.472074+0000","last_clean":"2024-04-26T23:42:25.472074+0000","last_became_active":"2024-04-26T23:42:24.495053+0000","last_became_peered":"2024-04-26T23:42:24.495053+0000","last_unstale":"2024-04-26T23:42:25.472074+0000","last_undegraded":"2024-04-26T23:42:25.472074+0000","last_fullsized":"2024-04-26T23:42:25.472074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:07:58.097615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.515288+0000","last_change":"2024-04-26T23:42:25.502739+0000","last_active":"2024-04-26T23:42:25.515288+0000","last_peered":"2024-04-26T23:42:25.515288+0000","last_clean":"2024-04-26T23:42:25.515288+0000","last_became_active":"2024-04-26T23:42:25.501992+0000","last_became_peered":"2024-04-26T23:42:25.501992+0000","last_unstale":"2024-04-26T23:42:25.515288+0000","last_undegraded":"2024-04-26T23:42:25.515288+0000","last_fullsized":"2024-04-26T23:42:25.515288+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:48:06.328205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.510508+0000","last_change":"2024-04-26T23:42:24.502074+0000","last_active":"2024-04-26T23:42:25.510508+0000","last_peered":"2024-04-26T23:42:25.510508+0000","last_clean":"2024-04-26T23:42:25.510508+0000","last_became_active":"2024-04-26T23:42:24.501779+0000","last_became_peered":"2024-04-26T23:42:24.501779+0000","last_unstale":"2024-04-26T23:42:25.510508+0000","last_undegraded":"2024-04-26T23:42:25.510508+0000","last_fullsized":"2024-04-26T23:42:25.510508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:46.487208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.499569+0000","last_change":"2024-04-26T23:42:25.488630+0000","last_active":"2024-04-26T23:42:25.499569+0000","last_peered":"2024-04-26T23:42:25.499569+0000","last_clean":"2024-04-26T23:42:25.499569+0000","last_became_active":"2024-04-26T23:42:25.488367+0000","last_became_peered":"2024-04-26T23:42:25.488367+0000","last_unstale":"2024-04-26T23:42:25.499569+0000","last_undegraded":"2024-04-26T23:42:25.499569+0000","last_fullsized":"2024-04-26T23:42:25.499569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:21:05.256266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.508654+0000","last_change":"2024-04-26T23:42:24.497470+0000","last_active":"2024-04-26T23:42:25.508654+0000","last_peered":"2024-04-26T23:42:25.508654+0000","last_clean":"2024-04-26T23:42:25.508654+0000","last_became_active":"2024-04-26T23:42:24.497134+0000","last_became_peered":"2024-04-26T23:42:24.497134+0000","last_unstale":"2024-04-26T23:42:25.508654+0000","last_undegraded":"2024-04-26T23:42:25.508654+0000","last_fullsized":"2024-04-26T23:42:25.508654+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:48:05.321433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.485260+0000","last_change":"2024-04-26T23:42:25.483615+0000","last_active":"2024-04-26T23:42:25.485260+0000","last_peered":"2024-04-26T23:42:25.485260+0000","last_clean":"2024-04-26T23:42:25.485260+0000","last_became_active":"2024-04-26T23:42:25.483301+0000","last_became_peered":"2024-04-26T23:42:25.483301+0000","last_unstale":"2024-04-26T23:42:25.485260+0000","last_undegraded":"2024-04-26T23:42:25.485260+0000","last_fullsized":"2024-04-26T23:42:25.485260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:36:51.669023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.513913+0000","last_change":"2024-04-26T23:42:24.482597+0000","last_active":"2024-04-26T23:42:25.513913+0000","last_peered":"2024-04-26T23:42:25.513913+0000","last_clean":"2024-04-26T23:42:25.513913+0000","last_became_active":"2024-04-26T23:42:24.482023+0000","last_became_peered":"2024-04-26T23:42:24.482023+0000","last_unstale":"2024-04-26T23:42:25.513913+0000","last_undegraded":"2024-04-26T23:42:25.513913+0000","last_fullsized":"2024-04-26T23:42:25.513913+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:48:05.321433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.510940+0000","last_change":"2024-04-26T23:42:25.505159+0000","last_active":"2024-04-26T23:42:25.510940+0000","last_peered":"2024-04-26T23:42:25.510940+0000","last_clean":"2024-04-26T23:42:25.510940+0000","last_became_active":"2024-04-26T23:42:25.502780+0000","last_became_peered":"2024-04-26T23:42:25.502780+0000","last_unstale":"2024-04-26T23:42:25.510940+0000","last_undegraded":"2024-04-26T23:42:25.510940+0000","last_fullsized":"2024-04-26T23:42:25.510940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:36:51.669023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.512388+0000","last_change":"2024-04-26T23:42:24.488681+0000","last_active":"2024-04-26T23:42:25.512388+0000","last_peered":"2024-04-26T23:42:25.512388+0000","last_clean":"2024-04-26T23:42:25.512388+0000","last_became_active":"2024-04-26T23:42:24.488435+0000","last_became_peered":"2024-04-26T23:42:24.488435+0000","last_unstale":"2024-04-26T23:42:25.512388+0000","last_undegraded":"2024-04-26T23:42:25.512388+0000","last_fullsized":"2024-04-26T23:42:25.512388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:02:16.144159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.502170+0000","last_change":"2024-04-26T23:42:25.496135+0000","last_active":"2024-04-26T23:42:25.502170+0000","last_peered":"2024-04-26T23:42:25.502170+0000","last_clean":"2024-04-26T23:42:25.502170+0000","last_became_active":"2024-04-26T23:42:25.495564+0000","last_became_peered":"2024-04-26T23:42:25.495564+0000","last_unstale":"2024-04-26T23:42:25.502170+0000","last_undegraded":"2024-04-26T23:42:25.502170+0000","last_fullsized":"2024-04-26T23:42:25.502170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:57:39.229535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.478129+0000","last_change":"2024-04-26T23:42:24.490749+0000","last_active":"2024-04-26T23:42:25.478129+0000","last_peered":"2024-04-26T23:42:25.478129+0000","last_clean":"2024-04-26T23:42:25.478129+0000","last_became_active":"2024-04-26T23:42:24.490443+0000","last_became_peered":"2024-04-26T23:42:24.490443+0000","last_unstale":"2024-04-26T23:42:25.478129+0000","last_undegraded":"2024-04-26T23:42:25.478129+0000","last_fullsized":"2024-04-26T23:42:25.478129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.243240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.497778+0000","last_change":"2024-04-26T23:42:25.490541+0000","last_active":"2024-04-26T23:42:25.497778+0000","last_peered":"2024-04-26T23:42:25.497778+0000","last_clean":"2024-04-26T23:42:25.497778+0000","last_became_active":"2024-04-26T23:42:25.490257+0000","last_became_peered":"2024-04-26T23:42:25.490257+0000","last_unstale":"2024-04-26T23:42:25.497778+0000","last_undegraded":"2024-04-26T23:42:25.497778+0000","last_fullsized":"2024-04-26T23:42:25.497778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:57:21.571341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.509631+0000","last_change":"2024-04-26T23:42:24.477362+0000","last_active":"2024-04-26T23:42:25.509631+0000","last_peered":"2024-04-26T23:42:25.509631+0000","last_clean":"2024-04-26T23:42:25.509631+0000","last_became_active":"2024-04-26T23:42:24.476779+0000","last_became_peered":"2024-04-26T23:42:24.476779+0000","last_unstale":"2024-04-26T23:42:25.509631+0000","last_undegraded":"2024-04-26T23:42:25.509631+0000","last_fullsized":"2024-04-26T23:42:25.509631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:49:32.823232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.506490+0000","last_change":"2024-04-26T23:42:25.504089+0000","last_active":"2024-04-26T23:42:25.506490+0000","last_peered":"2024-04-26T23:42:25.506490+0000","last_clean":"2024-04-26T23:42:25.506490+0000","last_became_active":"2024-04-26T23:42:25.502408+0000","last_became_peered":"2024-04-26T23:42:25.502408+0000","last_unstale":"2024-04-26T23:42:25.506490+0000","last_undegraded":"2024-04-26T23:42:25.506490+0000","last_fullsized":"2024-04-26T23:42:25.506490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:51.250012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.503647+0000","last_change":"2024-04-26T23:42:24.481563+0000","last_active":"2024-04-26T23:42:25.503647+0000","last_peered":"2024-04-26T23:42:25.503647+0000","last_clean":"2024-04-26T23:42:25.503647+0000","last_became_active":"2024-04-26T23:42:24.481256+0000","last_became_peered":"2024-04-26T23:42:24.481256+0000","last_unstale":"2024-04-26T23:42:25.503647+0000","last_undegraded":"2024-04-26T23:42:25.503647+0000","last_fullsized":"2024-04-26T23:42:25.503647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:22.706822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.506350+0000","last_change":"2024-04-26T23:42:25.502311+0000","last_active":"2024-04-26T23:42:25.506350+0000","last_peered":"2024-04-26T23:42:25.506350+0000","last_clean":"2024-04-26T23:42:25.506350+0000","last_became_active":"2024-04-26T23:42:25.501979+0000","last_became_peered":"2024-04-26T23:42:25.501979+0000","last_unstale":"2024-04-26T23:42:25.506350+0000","last_undegraded":"2024-04-26T23:42:25.506350+0000","last_fullsized":"2024-04-26T23:42:25.506350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:15.727459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.480186+0000","last_change":"2024-04-26T23:42:24.486069+0000","last_active":"2024-04-26T23:42:25.480186+0000","last_peered":"2024-04-26T23:42:25.480186+0000","last_clean":"2024-04-26T23:42:25.480186+0000","last_became_active":"2024-04-26T23:42:24.484178+0000","last_became_peered":"2024-04-26T23:42:24.484178+0000","last_unstale":"2024-04-26T23:42:25.480186+0000","last_undegraded":"2024-04-26T23:42:25.480186+0000","last_fullsized":"2024-04-26T23:42:25.480186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:11.360474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.508472+0000","last_change":"2024-04-26T23:42:25.504887+0000","last_active":"2024-04-26T23:42:25.508472+0000","last_peered":"2024-04-26T23:42:25.508472+0000","last_clean":"2024-04-26T23:42:25.508472+0000","last_became_active":"2024-04-26T23:42:25.504581+0000","last_became_peered":"2024-04-26T23:42:25.504581+0000","last_unstale":"2024-04-26T23:42:25.508472+0000","last_undegraded":"2024-04-26T23:42:25.508472+0000","last_fullsized":"2024-04-26T23:42:25.508472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:47.493980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.474780+0000","last_change":"2024-04-26T23:42:24.492664+0000","last_active":"2024-04-26T23:42:25.474780+0000","last_peered":"2024-04-26T23:42:25.474780+0000","last_clean":"2024-04-26T23:42:25.474780+0000","last_became_active":"2024-04-26T23:42:24.492363+0000","last_became_peered":"2024-04-26T23:42:24.492363+0000","last_unstale":"2024-04-26T23:42:25.474780+0000","last_undegraded":"2024-04-26T23:42:25.474780+0000","last_fullsized":"2024-04-26T23:42:25.474780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:07:58.097615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.503047+0000","last_change":"2024-04-26T23:42:25.496135+0000","last_active":"2024-04-26T23:42:25.503047+0000","last_peered":"2024-04-26T23:42:25.503047+0000","last_clean":"2024-04-26T23:42:25.503047+0000","last_became_active":"2024-04-26T23:42:25.495891+0000","last_became_peered":"2024-04-26T23:42:25.495891+0000","last_unstale":"2024-04-26T23:42:25.503047+0000","last_undegraded":"2024-04-26T23:42:25.503047+0000","last_fullsized":"2024-04-26T23:42:25.503047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:42.870767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.510959+0000","last_change":"2024-04-26T23:42:24.489857+0000","last_active":"2024-04-26T23:42:25.510959+0000","last_peered":"2024-04-26T23:42:25.510959+0000","last_clean":"2024-04-26T23:42:25.510959+0000","last_became_active":"2024-04-26T23:42:24.489564+0000","last_became_peered":"2024-04-26T23:42:24.489564+0000","last_unstale":"2024-04-26T23:42:25.510959+0000","last_undegraded":"2024-04-26T23:42:25.510959+0000","last_fullsized":"2024-04-26T23:42:25.510959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:04.781254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.502044+0000","last_change":"2024-04-26T23:42:25.498484+0000","last_active":"2024-04-26T23:42:25.502044+0000","last_peered":"2024-04-26T23:42:25.502044+0000","last_clean":"2024-04-26T23:42:25.502044+0000","last_became_active":"2024-04-26T23:42:25.498149+0000","last_became_peered":"2024-04-26T23:42:25.498149+0000","last_unstale":"2024-04-26T23:42:25.502044+0000","last_undegraded":"2024-04-26T23:42:25.502044+0000","last_fullsized":"2024-04-26T23:42:25.502044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:46:07.530048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.478732+0000","last_change":"2024-04-26T23:42:24.479204+0000","last_active":"2024-04-26T23:42:25.478732+0000","last_peered":"2024-04-26T23:42:25.478732+0000","last_clean":"2024-04-26T23:42:25.478732+0000","last_became_active":"2024-04-26T23:42:24.478877+0000","last_became_peered":"2024-04-26T23:42:24.478877+0000","last_unstale":"2024-04-26T23:42:25.478732+0000","last_undegraded":"2024-04-26T23:42:25.478732+0000","last_fullsized":"2024-04-26T23:42:25.478732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:48:05.321433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.507265+0000","last_change":"2024-04-26T23:42:25.502817+0000","last_active":"2024-04-26T23:42:25.507265+0000","last_peered":"2024-04-26T23:42:25.507265+0000","last_clean":"2024-04-26T23:42:25.507265+0000","last_became_active":"2024-04-26T23:42:25.502561+0000","last_became_peered":"2024-04-26T23:42:25.502561+0000","last_unstale":"2024-04-26T23:42:25.507265+0000","last_undegraded":"2024-04-26T23:42:25.507265+0000","last_fullsized":"2024-04-26T23:42:25.507265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:07:59.104387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.495650+0000","last_change":"2024-04-26T23:42:24.492997+0000","last_active":"2024-04-26T23:42:25.495650+0000","last_peered":"2024-04-26T23:42:25.495650+0000","last_clean":"2024-04-26T23:42:25.495650+0000","last_became_active":"2024-04-26T23:42:24.492373+0000","last_became_peered":"2024-04-26T23:42:24.492373+0000","last_unstale":"2024-04-26T23:42:25.495650+0000","last_undegraded":"2024-04-26T23:42:25.495650+0000","last_fullsized":"2024-04-26T23:42:25.495650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:22.706822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.512997+0000","last_change":"2024-04-26T23:42:25.505394+0000","last_active":"2024-04-26T23:42:25.512997+0000","last_peered":"2024-04-26T23:42:25.512997+0000","last_clean":"2024-04-26T23:42:25.512997+0000","last_became_active":"2024-04-26T23:42:25.503709+0000","last_became_peered":"2024-04-26T23:42:25.503709+0000","last_unstale":"2024-04-26T23:42:25.512997+0000","last_undegraded":"2024-04-26T23:42:25.512997+0000","last_fullsized":"2024-04-26T23:42:25.512997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:54.243362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.478109+0000","last_change":"2024-04-26T23:42:24.483875+0000","last_active":"2024-04-26T23:42:25.478109+0000","last_peered":"2024-04-26T23:42:25.478109+0000","last_clean":"2024-04-26T23:42:25.478109+0000","last_became_active":"2024-04-26T23:42:24.483256+0000","last_became_peered":"2024-04-26T23:42:24.483256+0000","last_unstale":"2024-04-26T23:42:25.478109+0000","last_undegraded":"2024-04-26T23:42:25.478109+0000","last_fullsized":"2024-04-26T23:42:25.478109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:02:16.144159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.501653+0000","last_change":"2024-04-26T23:42:25.494465+0000","last_active":"2024-04-26T23:42:25.501653+0000","last_peered":"2024-04-26T23:42:25.501653+0000","last_clean":"2024-04-26T23:42:25.501653+0000","last_became_active":"2024-04-26T23:42:25.492358+0000","last_became_peered":"2024-04-26T23:42:25.492358+0000","last_unstale":"2024-04-26T23:42:25.501653+0000","last_undegraded":"2024-04-26T23:42:25.501653+0000","last_fullsized":"2024-04-26T23:42:25.501653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:23.713594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.487307+0000","last_change":"2024-04-26T23:42:24.488238+0000","last_active":"2024-04-26T23:42:25.487307+0000","last_peered":"2024-04-26T23:42:25.487307+0000","last_clean":"2024-04-26T23:42:25.487307+0000","last_became_active":"2024-04-26T23:42:24.487984+0000","last_became_peered":"2024-04-26T23:42:24.487984+0000","last_unstale":"2024-04-26T23:42:25.487307+0000","last_undegraded":"2024-04-26T23:42:25.487307+0000","last_fullsized":"2024-04-26T23:42:25.487307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:19.854795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.506295+0000","last_change":"2024-04-26T23:42:25.499954+0000","last_active":"2024-04-26T23:42:25.506295+0000","last_peered":"2024-04-26T23:42:25.506295+0000","last_clean":"2024-04-26T23:42:25.506295+0000","last_became_active":"2024-04-26T23:42:25.499652+0000","last_became_peered":"2024-04-26T23:42:25.499652+0000","last_unstale":"2024-04-26T23:42:25.506295+0000","last_undegraded":"2024-04-26T23:42:25.506295+0000","last_fullsized":"2024-04-26T23:42:25.506295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:11.767639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.480190+0000","last_change":"2024-04-26T23:42:24.479442+0000","last_active":"2024-04-26T23:42:25.480190+0000","last_peered":"2024-04-26T23:42:25.480190+0000","last_clean":"2024-04-26T23:42:25.480190+0000","last_became_active":"2024-04-26T23:42:24.479070+0000","last_became_peered":"2024-04-26T23:42:24.479070+0000","last_unstale":"2024-04-26T23:42:25.480190+0000","last_undegraded":"2024-04-26T23:42:25.480190+0000","last_fullsized":"2024-04-26T23:42:25.480190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:17.617013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.485111+0000","last_change":"2024-04-26T23:42:25.481190+0000","last_active":"2024-04-26T23:42:25.485111+0000","last_peered":"2024-04-26T23:42:25.485111+0000","last_clean":"2024-04-26T23:42:25.485111+0000","last_became_active":"2024-04-26T23:42:25.480878+0000","last_became_peered":"2024-04-26T23:42:25.480878+0000","last_unstale":"2024-04-26T23:42:25.485111+0000","last_undegraded":"2024-04-26T23:42:25.485111+0000","last_fullsized":"2024-04-26T23:42:25.485111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:20.861567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.472028+0000","last_change":"2024-04-26T23:42:24.495418+0000","last_active":"2024-04-26T23:42:25.472028+0000","last_peered":"2024-04-26T23:42:25.472028+0000","last_clean":"2024-04-26T23:42:25.472028+0000","last_became_active":"2024-04-26T23:42:24.495133+0000","last_became_peered":"2024-04-26T23:42:24.495133+0000","last_unstale":"2024-04-26T23:42:25.472028+0000","last_undegraded":"2024-04-26T23:42:25.472028+0000","last_fullsized":"2024-04-26T23:42:25.472028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:21:04.249493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.508416+0000","last_change":"2024-04-26T23:42:25.505640+0000","last_active":"2024-04-26T23:42:25.508416+0000","last_peered":"2024-04-26T23:42:25.508416+0000","last_clean":"2024-04-26T23:42:25.508416+0000","last_became_active":"2024-04-26T23:42:25.505410+0000","last_became_peered":"2024-04-26T23:42:25.505410+0000","last_unstale":"2024-04-26T23:42:25.508416+0000","last_undegraded":"2024-04-26T23:42:25.508416+0000","last_fullsized":"2024-04-26T23:42:25.508416+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:36:51.669023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.493833+0000","last_change":"2024-04-26T23:42:24.489970+0000","last_active":"2024-04-26T23:42:25.493833+0000","last_peered":"2024-04-26T23:42:25.493833+0000","last_clean":"2024-04-26T23:42:25.493833+0000","last_became_active":"2024-04-26T23:42:24.489652+0000","last_became_peered":"2024-04-26T23:42:24.489652+0000","last_unstale":"2024-04-26T23:42:25.493833+0000","last_undegraded":"2024-04-26T23:42:25.493833+0000","last_fullsized":"2024-04-26T23:42:25.493833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:19.854795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":192,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.489129+0000","last_change":"2024-04-26T23:41:12.783987+0000","last_active":"2024-04-26T23:42:25.489129+0000","last_peered":"2024-04-26T23:42:25.489129+0000","last_clean":"2024-04-26T23:42:25.489129+0000","last_became_active":"2024-04-26T23:41:12.782901+0000","last_became_peered":"2024-04-26T23:41:12.782901+0000","last_unstale":"2024-04-26T23:42:25.489129+0000","last_undegraded":"2024-04-26T23:42:25.489129+0000","last_fullsized":"2024-04-26T23:42:25.489129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_clean_scrub_stamp":"2024-04-26T23:41:11.626255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:16.305521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":942080,"data_stored":723917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":348160,"data_stored":133549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":133549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":368640,"data_stored":140428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":133549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":140394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":133549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":942080,"data_stored":723917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:42:29.572 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:42:29.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.740+0000 7ff917c00640 1 Processor -- start 2024-04-26T23:42:29.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.740+0000 7ff917c00640 1 -- start start 2024-04-26T23:42:29.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.744+0000 7ff917c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff9100d1ac0 0x7ff9100b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:29.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.744+0000 7ff917c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff91015d2b0 0x7ff9100b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:29.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.744+0000 7ff917c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9100b1b30 con 0x7ff91015ced0 2024-04-26T23:42:29.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.744+0000 7ff917c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff9100b1e10 con 0x7ff9100d1ac0 2024-04-26T23:42:29.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.744+0000 7ff917c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff9100b23f0 con 0x7ff91015d2b0 2024-04-26T23:42:29.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.744+0000 7ff907e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff9100d1ac0 0x7ff9100b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:29.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.744+0000 7ff915200640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7ff91015ced0 0x7ff9100d13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58744/0 (socket says 172.21.15.137:58744) 2024-04-26T23:42:29.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.744+0000 7ff907e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff9100d1ac0 0x7ff9100b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36430/0 (socket says 172.21.15.137:36430) 2024-04-26T23:42:29.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.744+0000 7ff915200640 1 -- 172.21.15.137:0/2093019795 learned_addr learned my addr 172.21.15.137:0/2093019795 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:29.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.744+0000 7ff915c00640 1 --2- 172.21.15.137:0/2093019795 >> v2:172.21.15.170:3300/0 conn(0x7ff91015d2b0 0x7ff9100b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:29.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.744+0000 7ff907e00640 1 -- 172.21.15.137:0/2093019795 >> v2:172.21.15.170:3300/0 conn(0x7ff91015d2b0 msgr2=0x7ff9100b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:29.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.744+0000 7ff907e00640 1 --2- 172.21.15.137:0/2093019795 >> v2:172.21.15.170:3300/0 conn(0x7ff91015d2b0 0x7ff9100b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.744+0000 7ff907e00640 1 -- 172.21.15.137:0/2093019795 >> v1:172.21.15.137:6789/0 conn(0x7ff91015ced0 legacy=0x7ff9100d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:29.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.744+0000 7ff907e00640 1 -- 172.21.15.137:0/2093019795 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9100b26d0 con 0x7ff9100d1ac0 2024-04-26T23:42:29.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.744+0000 7ff90fe00640 1 -- 172.21.15.137:0/2093019795 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1701084938 0 0) 0x7ff9100b1b30 con 0x7ff91015ced0 2024-04-26T23:42:29.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.744+0000 7ff915c00640 1 --2- 172.21.15.137:0/2093019795 >> v2:172.21.15.170:3300/0 conn(0x7ff91015d2b0 0x7ff9100b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:29.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.744+0000 7ff907e00640 1 --2- 172.21.15.137:0/2093019795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9100d1ac0 0x7ff9100b0d90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff9100d3000 tx=0x7ff8f801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3a453d04480354 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:29.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.744+0000 7ff90fe00640 1 -- 172.21.15.137:0/2093019795 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f80b0070 con 0x7ff9100d1ac0 2024-04-26T23:42:29.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.744+0000 7ff90fe00640 1 -- 172.21.15.137:0/2093019795 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8f80ab600 con 0x7ff9100d1ac0 2024-04-26T23:42:29.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.744+0000 7ff90fe00640 1 -- 172.21.15.137:0/2093019795 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f80ab9d0 con 0x7ff9100d1ac0 2024-04-26T23:42:29.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.748+0000 7ff917c00640 1 -- 172.21.15.137:0/2093019795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9100d1ac0 msgr2=0x7ff9100b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:29.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.748+0000 7ff917c00640 1 --2- 172.21.15.137:0/2093019795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9100d1ac0 0x7ff9100b0d90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff9100d3000 tx=0x7ff8f801c480 comp rx=0 tx=0).stop 2024-04-26T23:42:29.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.748+0000 7ff917c00640 1 -- 172.21.15.137:0/2093019795 shutdown_connections 2024-04-26T23:42:29.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.748+0000 7ff917c00640 1 --2- 172.21.15.137:0/2093019795 >> v2:172.21.15.170:3300/0 conn(0x7ff91015d2b0 0x7ff9100b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.748+0000 7ff917c00640 1 --2- 172.21.15.137:0/2093019795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9100d1ac0 0x7ff9100b0d90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.748+0000 7ff917c00640 1 -- 172.21.15.137:0/2093019795 >> 172.21.15.137:0/2093019795 conn(0x7ff91009ba60 msgr2=0x7ff91009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:29.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.748+0000 7ff917c00640 1 -- 172.21.15.137:0/2093019795 shutdown_connections 2024-04-26T23:42:29.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.748+0000 7ff917c00640 1 -- 172.21.15.137:0/2093019795 wait complete. 2024-04-26T23:42:29.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.748+0000 7ff917c00640 1 Processor -- start 2024-04-26T23:42:29.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.748+0000 7ff917c00640 1 -- start start 2024-04-26T23:42:29.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.748+0000 7ff917c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9100d1ac0 0x7ff910151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:29.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.748+0000 7ff917c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff91015ced0 0x7ff9100c7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:29.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.748+0000 7ff917c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff91015d2b0 0x7ff9100c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:29.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.748+0000 7ff917c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff9100b3810 con 0x7ff91015ced0 2024-04-26T23:42:29.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.748+0000 7ff917c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff9100b3690 con 0x7ff91015d2b0 2024-04-26T23:42:29.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.748+0000 7ff917c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff9100b3990 con 0x7ff9100d1ac0 2024-04-26T23:42:29.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.748+0000 7ff907e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff91015ced0 0x7ff9100c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:29.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.748+0000 7ff907e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff91015ced0 0x7ff9100c7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36446/0 (socket says 172.21.15.137:36446) 2024-04-26T23:42:29.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.748+0000 7ff907e00640 1 -- 172.21.15.137:0/59969478 learned_addr learned my addr 172.21.15.137:0/59969478 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:29.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.748+0000 7ff915200640 1 --2- 172.21.15.137:0/59969478 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9100d1ac0 0x7ff910151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:29.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.748+0000 7ff915c00640 1 --2- 172.21.15.137:0/59969478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff91015d2b0 0x7ff9100c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:29.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.752+0000 7ff907e00640 1 -- 172.21.15.137:0/59969478 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9100d1ac0 msgr2=0x7ff910151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:29.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.752+0000 7ff907e00640 1 --2- 172.21.15.137:0/59969478 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9100d1ac0 0x7ff910151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.752+0000 7ff907e00640 1 -- 172.21.15.137:0/59969478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff91015d2b0 msgr2=0x7ff9100c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:29.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.752+0000 7ff907e00640 1 --2- 172.21.15.137:0/59969478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff91015d2b0 0x7ff9100c7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.752+0000 7ff907e00640 1 -- 172.21.15.137:0/59969478 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9100cbcd0 con 0x7ff91015ced0 2024-04-26T23:42:29.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.752+0000 7ff907e00640 1 --2- 172.21.15.137:0/59969478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff91015ced0 0x7ff9100c7210 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff8f80ae040 tx=0x7ff8f8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:29.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.752+0000 7ff90d600640 1 -- 172.21.15.137:0/59969478 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f80b8020 con 0x7ff91015ced0 2024-04-26T23:42:29.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.752+0000 7ff90d600640 1 -- 172.21.15.137:0/59969478 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8f80aa640 con 0x7ff91015ced0 2024-04-26T23:42:29.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.752+0000 7ff917c00640 1 -- 172.21.15.137:0/59969478 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9100cbfb0 con 0x7ff91015ced0 2024-04-26T23:42:29.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.752+0000 7ff90d600640 1 -- 172.21.15.137:0/59969478 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f80b0040 con 0x7ff91015ced0 2024-04-26T23:42:29.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.752+0000 7ff917c00640 1 -- 172.21.15.137:0/59969478 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9100cc570 con 0x7ff91015ced0 2024-04-26T23:42:29.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.752+0000 7ff917c00640 1 -- 172.21.15.137:0/59969478 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff91006a4b0 con 0x7ff91015ced0 2024-04-26T23:42:29.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.752+0000 7ff90d600640 1 -- 172.21.15.137:0/59969478 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff8f80bb020 con 0x7ff91015ced0 2024-04-26T23:42:29.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.752+0000 7ff90d600640 1 --2- 172.21.15.137:0/59969478 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff8ec068380 0x7ff8ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:29.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.752+0000 7ff90d600640 1 -- 172.21.15.137:0/59969478 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7ff8f8120990 con 0x7ff91015ced0 2024-04-26T23:42:29.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.752+0000 7ff915200640 1 --2- 172.21.15.137:0/59969478 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff8ec068380 0x7ff8ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:29.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.756+0000 7ff915200640 1 --2- 172.21.15.137:0/59969478 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff8ec068380 0x7ff8ec06a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff900000f70 tx=0x7ff900007b60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:29.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.756+0000 7ff90d600640 1 -- 172.21.15.137:0/59969478 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff8f80c2030 con 0x7ff91015ced0 2024-04-26T23:42:29.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.912+0000 7ff917c00640 1 -- 172.21.15.137:0/59969478 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff910070a90 con 0x7ff8ec068380 2024-04-26T23:42:29.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.916+0000 7ff90d600640 1 -- 172.21.15.137:0/59969478 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251880 (secure 0 0 0) 0x7ff910070a90 con 0x7ff8ec068380 2024-04-26T23:42:29.925 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:29.927 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T23:42:29.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.920+0000 7ff917c00640 1 -- 172.21.15.137:0/59969478 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff8ec068380 msgr2=0x7ff8ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:29.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.920+0000 7ff917c00640 1 --2- 172.21.15.137:0/59969478 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff8ec068380 0x7ff8ec06a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff900000f70 tx=0x7ff900007b60 comp rx=0 tx=0).stop 2024-04-26T23:42:29.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.920+0000 7ff917c00640 1 -- 172.21.15.137:0/59969478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff91015ced0 msgr2=0x7ff9100c7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:29.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.920+0000 7ff917c00640 1 --2- 172.21.15.137:0/59969478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff91015ced0 0x7ff9100c7210 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff8f80ae040 tx=0x7ff8f8019220 comp rx=0 tx=0).stop 2024-04-26T23:42:29.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.920+0000 7ff917c00640 1 -- 172.21.15.137:0/59969478 shutdown_connections 2024-04-26T23:42:29.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.920+0000 7ff917c00640 1 --2- 172.21.15.137:0/59969478 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff8ec068380 0x7ff8ec06a840 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.920+0000 7ff917c00640 1 --2- 172.21.15.137:0/59969478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff91015ced0 0x7ff9100c7210 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.920+0000 7ff917c00640 1 --2- 172.21.15.137:0/59969478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff91015d2b0 0x7ff9100c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.920+0000 7ff917c00640 1 --2- 172.21.15.137:0/59969478 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9100d1ac0 0x7ff910151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:29.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.920+0000 7ff917c00640 1 -- 172.21.15.137:0/59969478 >> 172.21.15.137:0/59969478 conn(0x7ff91009ba60 msgr2=0x7ff91009bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:29.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.920+0000 7ff917c00640 1 -- 172.21.15.137:0/59969478 shutdown_connections 2024-04-26T23:42:29.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:29.920+0000 7ff917c00640 1 -- 172.21.15.137:0/59969478 wait complete. 2024-04-26T23:42:29.946 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-04-26T23:42:29.602000+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":67,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236736,"kb_used_data":3916,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737984,"statfs":{"total":773094113280,"available":772851695616,"internally_reserved":0,"allocated":4009984,"data_stored":2262852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001001"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.512639+0000","last_change":"2024-04-26T23:42:25.505117+0000","last_active":"2024-04-26T23:42:25.512639+0000","last_peered":"2024-04-26T23:42:25.512639+0000","last_clean":"2024-04-26T23:42:25.512639+0000","last_became_active":"2024-04-26T23:42:25.496294+0000","last_became_peered":"2024-04-26T23:42:25.496294+0000","last_unstale":"2024-04-26T23:42:25.512639+0000","last_undegraded":"2024-04-26T23:42:25.512639+0000","last_fullsized":"2024-04-26T23:42:25.512639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:07:59.104387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.487260+0000","last_change":"2024-04-26T23:42:25.485469+0000","last_active":"2024-04-26T23:42:25.487260+0000","last_peered":"2024-04-26T23:42:25.487260+0000","last_clean":"2024-04-26T23:42:25.487260+0000","last_became_active":"2024-04-26T23:42:25.484412+0000","last_became_peered":"2024-04-26T23:42:25.484412+0000","last_unstale":"2024-04-26T23:42:25.487260+0000","last_undegraded":"2024-04-26T23:42:25.487260+0000","last_fullsized":"2024-04-26T23:42:25.487260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:46:07.530048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.502132+0000","last_change":"2024-04-26T23:42:25.497908+0000","last_active":"2024-04-26T23:42:25.502132+0000","last_peered":"2024-04-26T23:42:25.502132+0000","last_clean":"2024-04-26T23:42:25.502132+0000","last_became_active":"2024-04-26T23:42:25.497588+0000","last_became_peered":"2024-04-26T23:42:25.497588+0000","last_unstale":"2024-04-26T23:42:25.502132+0000","last_undegraded":"2024-04-26T23:42:25.502132+0000","last_fullsized":"2024-04-26T23:42:25.502132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:22.719776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.510916+0000","last_change":"2024-04-26T23:42:25.504929+0000","last_active":"2024-04-26T23:42:25.510916+0000","last_peered":"2024-04-26T23:42:25.510916+0000","last_clean":"2024-04-26T23:42:25.510916+0000","last_became_active":"2024-04-26T23:42:25.503518+0000","last_became_peered":"2024-04-26T23:42:25.503518+0000","last_unstale":"2024-04-26T23:42:25.510916+0000","last_undegraded":"2024-04-26T23:42:25.510916+0000","last_fullsized":"2024-04-26T23:42:25.510916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:54.243362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.504748+0000","last_change":"2024-04-26T23:42:25.498675+0000","last_active":"2024-04-26T23:42:25.504748+0000","last_peered":"2024-04-26T23:42:25.504748+0000","last_clean":"2024-04-26T23:42:25.504748+0000","last_became_active":"2024-04-26T23:42:25.497486+0000","last_became_peered":"2024-04-26T23:42:25.497486+0000","last_unstale":"2024-04-26T23:42:25.504748+0000","last_undegraded":"2024-04-26T23:42:25.504748+0000","last_fullsized":"2024-04-26T23:42:25.504748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:15.553331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.487249+0000","last_change":"2024-04-26T23:42:25.484693+0000","last_active":"2024-04-26T23:42:25.487249+0000","last_peered":"2024-04-26T23:42:25.487249+0000","last_clean":"2024-04-26T23:42:25.487249+0000","last_became_active":"2024-04-26T23:42:25.484530+0000","last_became_peered":"2024-04-26T23:42:25.484530+0000","last_unstale":"2024-04-26T23:42:25.487249+0000","last_undegraded":"2024-04-26T23:42:25.487249+0000","last_fullsized":"2024-04-26T23:42:25.487249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:22.719776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.508492+0000","last_change":"2024-04-26T23:42:25.505143+0000","last_active":"2024-04-26T23:42:25.508492+0000","last_peered":"2024-04-26T23:42:25.508492+0000","last_clean":"2024-04-26T23:42:25.508492+0000","last_became_active":"2024-04-26T23:42:25.504846+0000","last_became_peered":"2024-04-26T23:42:25.504846+0000","last_unstale":"2024-04-26T23:42:25.508492+0000","last_undegraded":"2024-04-26T23:42:25.508492+0000","last_fullsized":"2024-04-26T23:42:25.508492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:54.243362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.504769+0000","last_change":"2024-04-26T23:42:25.503168+0000","last_active":"2024-04-26T23:42:25.504769+0000","last_peered":"2024-04-26T23:42:25.504769+0000","last_clean":"2024-04-26T23:42:25.504769+0000","last_became_active":"2024-04-26T23:42:25.502951+0000","last_became_peered":"2024-04-26T23:42:25.502951+0000","last_unstale":"2024-04-26T23:42:25.504769+0000","last_undegraded":"2024-04-26T23:42:25.504769+0000","last_fullsized":"2024-04-26T23:42:25.504769+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:21:05.256266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.501230+0000","last_change":"2024-04-26T23:42:25.499981+0000","last_active":"2024-04-26T23:42:25.501230+0000","last_peered":"2024-04-26T23:42:25.501230+0000","last_clean":"2024-04-26T23:42:25.501230+0000","last_became_active":"2024-04-26T23:42:25.499610+0000","last_became_peered":"2024-04-26T23:42:25.499610+0000","last_unstale":"2024-04-26T23:42:25.501230+0000","last_undegraded":"2024-04-26T23:42:25.501230+0000","last_fullsized":"2024-04-26T23:42:25.501230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:54.243362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.509685+0000","last_change":"2024-04-26T23:42:25.497932+0000","last_active":"2024-04-26T23:42:25.509685+0000","last_peered":"2024-04-26T23:42:25.509685+0000","last_clean":"2024-04-26T23:42:25.509685+0000","last_became_active":"2024-04-26T23:42:25.497644+0000","last_became_peered":"2024-04-26T23:42:25.497644+0000","last_unstale":"2024-04-26T23:42:25.509685+0000","last_undegraded":"2024-04-26T23:42:25.509685+0000","last_fullsized":"2024-04-26T23:42:25.509685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:07:59.104387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.514472+0000","last_change":"2024-04-26T23:42:25.512746+0000","last_active":"2024-04-26T23:42:25.514472+0000","last_peered":"2024-04-26T23:42:25.514472+0000","last_clean":"2024-04-26T23:42:25.514472+0000","last_became_active":"2024-04-26T23:42:25.512166+0000","last_became_peered":"2024-04-26T23:42:25.512166+0000","last_unstale":"2024-04-26T23:42:25.514472+0000","last_undegraded":"2024-04-26T23:42:25.514472+0000","last_fullsized":"2024-04-26T23:42:25.514472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:29.218972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.495764+0000","last_change":"2024-04-26T23:42:25.487652+0000","last_active":"2024-04-26T23:42:25.495764+0000","last_peered":"2024-04-26T23:42:25.495764+0000","last_clean":"2024-04-26T23:42:25.495764+0000","last_became_active":"2024-04-26T23:42:25.484134+0000","last_became_peered":"2024-04-26T23:42:25.484134+0000","last_unstale":"2024-04-26T23:42:25.495764+0000","last_undegraded":"2024-04-26T23:42:25.495764+0000","last_fullsized":"2024-04-26T23:42:25.495764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:52.504897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.504869+0000","last_change":"2024-04-26T23:42:25.500676+0000","last_active":"2024-04-26T23:42:25.504869+0000","last_peered":"2024-04-26T23:42:25.504869+0000","last_clean":"2024-04-26T23:42:25.504869+0000","last_became_active":"2024-04-26T23:42:25.500441+0000","last_became_peered":"2024-04-26T23:42:25.500441+0000","last_unstale":"2024-04-26T23:42:25.504869+0000","last_undegraded":"2024-04-26T23:42:25.504869+0000","last_fullsized":"2024-04-26T23:42:25.504869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:06.751860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.499088+0000","last_change":"2024-04-26T23:42:25.495271+0000","last_active":"2024-04-26T23:42:25.499088+0000","last_peered":"2024-04-26T23:42:25.499088+0000","last_clean":"2024-04-26T23:42:25.499088+0000","last_became_active":"2024-04-26T23:42:25.494922+0000","last_became_peered":"2024-04-26T23:42:25.494922+0000","last_unstale":"2024-04-26T23:42:25.499088+0000","last_undegraded":"2024-04-26T23:42:25.499088+0000","last_fullsized":"2024-04-26T23:42:25.499088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:16:56.474132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.510090+0000","last_change":"2024-04-26T23:42:25.507719+0000","last_active":"2024-04-26T23:42:25.510090+0000","last_peered":"2024-04-26T23:42:25.510090+0000","last_clean":"2024-04-26T23:42:25.510090+0000","last_became_active":"2024-04-26T23:42:25.507491+0000","last_became_peered":"2024-04-26T23:42:25.507491+0000","last_unstale":"2024-04-26T23:42:25.510090+0000","last_undegraded":"2024-04-26T23:42:25.510090+0000","last_fullsized":"2024-04-26T23:42:25.510090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:00:28.493209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.504791+0000","last_change":"2024-04-26T23:42:25.503345+0000","last_active":"2024-04-26T23:42:25.504791+0000","last_peered":"2024-04-26T23:42:25.504791+0000","last_clean":"2024-04-26T23:42:25.504791+0000","last_became_active":"2024-04-26T23:42:25.503141+0000","last_became_peered":"2024-04-26T23:42:25.503141+0000","last_unstale":"2024-04-26T23:42:25.504791+0000","last_undegraded":"2024-04-26T23:42:25.504791+0000","last_fullsized":"2024-04-26T23:42:25.504791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:07:59.104387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.515797+0000","last_change":"2024-04-26T23:42:25.515025+0000","last_active":"2024-04-26T23:42:25.515797+0000","last_peered":"2024-04-26T23:42:25.515797+0000","last_clean":"2024-04-26T23:42:25.515797+0000","last_became_active":"2024-04-26T23:42:25.514752+0000","last_became_peered":"2024-04-26T23:42:25.514752+0000","last_unstale":"2024-04-26T23:42:25.515797+0000","last_undegraded":"2024-04-26T23:42:25.515797+0000","last_fullsized":"2024-04-26T23:42:25.515797+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:46:07.530048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.504506+0000","last_change":"2024-04-26T23:42:25.499116+0000","last_active":"2024-04-26T23:42:25.504506+0000","last_peered":"2024-04-26T23:42:25.504506+0000","last_clean":"2024-04-26T23:42:25.504506+0000","last_became_active":"2024-04-26T23:42:25.498364+0000","last_became_peered":"2024-04-26T23:42:25.498364+0000","last_unstale":"2024-04-26T23:42:25.504506+0000","last_undegraded":"2024-04-26T23:42:25.504506+0000","last_fullsized":"2024-04-26T23:42:25.504506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:20.672990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.505652+0000","last_change":"2024-04-26T23:42:25.499490+0000","last_active":"2024-04-26T23:42:25.505652+0000","last_peered":"2024-04-26T23:42:25.505652+0000","last_clean":"2024-04-26T23:42:25.505652+0000","last_became_active":"2024-04-26T23:42:25.499200+0000","last_became_peered":"2024-04-26T23:42:25.499200+0000","last_unstale":"2024-04-26T23:42:25.505652+0000","last_undegraded":"2024-04-26T23:42:25.505652+0000","last_fullsized":"2024-04-26T23:42:25.505652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:22:46.905273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.506298+0000","last_change":"2024-04-26T23:42:25.503747+0000","last_active":"2024-04-26T23:42:25.506298+0000","last_peered":"2024-04-26T23:42:25.506298+0000","last_clean":"2024-04-26T23:42:25.506298+0000","last_became_active":"2024-04-26T23:42:25.503500+0000","last_became_peered":"2024-04-26T23:42:25.503500+0000","last_unstale":"2024-04-26T23:42:25.506298+0000","last_undegraded":"2024-04-26T23:42:25.506298+0000","last_fullsized":"2024-04-26T23:42:25.506298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:13:11.155363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.508650+0000","last_change":"2024-04-26T23:42:25.507205+0000","last_active":"2024-04-26T23:42:25.508650+0000","last_peered":"2024-04-26T23:42:25.508650+0000","last_clean":"2024-04-26T23:42:25.508650+0000","last_became_active":"2024-04-26T23:42:25.506896+0000","last_became_peered":"2024-04-26T23:42:25.506896+0000","last_unstale":"2024-04-26T23:42:25.508650+0000","last_undegraded":"2024-04-26T23:42:25.508650+0000","last_fullsized":"2024-04-26T23:42:25.508650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:36:51.669023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.499233+0000","last_change":"2024-04-26T23:42:25.490433+0000","last_active":"2024-04-26T23:42:25.499233+0000","last_peered":"2024-04-26T23:42:25.499233+0000","last_clean":"2024-04-26T23:42:25.499233+0000","last_became_active":"2024-04-26T23:42:25.489532+0000","last_became_peered":"2024-04-26T23:42:25.489532+0000","last_unstale":"2024-04-26T23:42:25.499233+0000","last_undegraded":"2024-04-26T23:42:25.499233+0000","last_fullsized":"2024-04-26T23:42:25.499233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:07:59.104387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.507298+0000","last_change":"2024-04-26T23:42:25.502005+0000","last_active":"2024-04-26T23:42:25.507298+0000","last_peered":"2024-04-26T23:42:25.507298+0000","last_clean":"2024-04-26T23:42:25.507298+0000","last_became_active":"2024-04-26T23:42:25.501674+0000","last_became_peered":"2024-04-26T23:42:25.501674+0000","last_unstale":"2024-04-26T23:42:25.507298+0000","last_undegraded":"2024-04-26T23:42:25.507298+0000","last_fullsized":"2024-04-26T23:42:25.507298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:47.493980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.502765+0000","last_change":"2024-04-26T23:42:25.501926+0000","last_active":"2024-04-26T23:42:25.502765+0000","last_peered":"2024-04-26T23:42:25.502765+0000","last_clean":"2024-04-26T23:42:25.502765+0000","last_became_active":"2024-04-26T23:42:25.501537+0000","last_became_peered":"2024-04-26T23:42:25.501537+0000","last_unstale":"2024-04-26T23:42:25.502765+0000","last_undegraded":"2024-04-26T23:42:25.502765+0000","last_fullsized":"2024-04-26T23:42:25.502765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:45:23.560351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.514606+0000","last_change":"2024-04-26T23:42:25.513611+0000","last_active":"2024-04-26T23:42:25.514606+0000","last_peered":"2024-04-26T23:42:25.514606+0000","last_clean":"2024-04-26T23:42:25.514606+0000","last_became_active":"2024-04-26T23:42:25.513356+0000","last_became_peered":"2024-04-26T23:42:25.513356+0000","last_unstale":"2024-04-26T23:42:25.514606+0000","last_undegraded":"2024-04-26T23:42:25.514606+0000","last_fullsized":"2024-04-26T23:42:25.514606+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:29.218972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.499344+0000","last_change":"2024-04-26T23:42:25.492782+0000","last_active":"2024-04-26T23:42:25.499344+0000","last_peered":"2024-04-26T23:42:25.499344+0000","last_clean":"2024-04-26T23:42:25.499344+0000","last_became_active":"2024-04-26T23:42:25.492496+0000","last_became_peered":"2024-04-26T23:42:25.492496+0000","last_unstale":"2024-04-26T23:42:25.499344+0000","last_undegraded":"2024-04-26T23:42:25.499344+0000","last_fullsized":"2024-04-26T23:42:25.499344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:45:23.560351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.511022+0000","last_change":"2024-04-26T23:42:25.508166+0000","last_active":"2024-04-26T23:42:25.511022+0000","last_peered":"2024-04-26T23:42:25.511022+0000","last_clean":"2024-04-26T23:42:25.511022+0000","last_became_active":"2024-04-26T23:42:25.507898+0000","last_became_peered":"2024-04-26T23:42:25.507898+0000","last_unstale":"2024-04-26T23:42:25.511022+0000","last_undegraded":"2024-04-26T23:42:25.511022+0000","last_fullsized":"2024-04-26T23:42:25.511022+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:52.504897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.495743+0000","last_change":"2024-04-26T23:42:25.484393+0000","last_active":"2024-04-26T23:42:25.495743+0000","last_peered":"2024-04-26T23:42:25.495743+0000","last_clean":"2024-04-26T23:42:25.495743+0000","last_became_active":"2024-04-26T23:42:25.483761+0000","last_became_peered":"2024-04-26T23:42:25.483761+0000","last_unstale":"2024-04-26T23:42:25.495743+0000","last_undegraded":"2024-04-26T23:42:25.495743+0000","last_fullsized":"2024-04-26T23:42:25.495743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:45:53.092092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.487867+0000","last_change":"2024-04-26T23:42:25.482548+0000","last_active":"2024-04-26T23:42:25.487867+0000","last_peered":"2024-04-26T23:42:25.487867+0000","last_clean":"2024-04-26T23:42:25.487867+0000","last_became_active":"2024-04-26T23:42:25.482037+0000","last_became_peered":"2024-04-26T23:42:25.482037+0000","last_unstale":"2024-04-26T23:42:25.487867+0000","last_undegraded":"2024-04-26T23:42:25.487867+0000","last_fullsized":"2024-04-26T23:42:25.487867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:05.788026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.515080+0000","last_change":"2024-04-26T23:42:25.513241+0000","last_active":"2024-04-26T23:42:25.515080+0000","last_peered":"2024-04-26T23:42:25.515080+0000","last_clean":"2024-04-26T23:42:25.515080+0000","last_became_active":"2024-04-26T23:42:25.512140+0000","last_became_peered":"2024-04-26T23:42:25.512140+0000","last_unstale":"2024-04-26T23:42:25.515080+0000","last_undegraded":"2024-04-26T23:42:25.515080+0000","last_fullsized":"2024-04-26T23:42:25.515080+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:22.719776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.515309+0000","last_change":"2024-04-26T23:42:25.503006+0000","last_active":"2024-04-26T23:42:25.515309+0000","last_peered":"2024-04-26T23:42:25.515309+0000","last_clean":"2024-04-26T23:42:25.515309+0000","last_became_active":"2024-04-26T23:42:25.502307+0000","last_became_peered":"2024-04-26T23:42:25.502307+0000","last_unstale":"2024-04-26T23:42:25.515309+0000","last_undegraded":"2024-04-26T23:42:25.515309+0000","last_fullsized":"2024-04-26T23:42:25.515309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:05.788026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.502095+0000","last_change":"2024-04-26T23:42:25.501059+0000","last_active":"2024-04-26T23:42:25.502095+0000","last_peered":"2024-04-26T23:42:25.502095+0000","last_clean":"2024-04-26T23:42:25.502095+0000","last_became_active":"2024-04-26T23:42:25.498674+0000","last_became_peered":"2024-04-26T23:42:25.498674+0000","last_unstale":"2024-04-26T23:42:25.502095+0000","last_undegraded":"2024-04-26T23:42:25.502095+0000","last_fullsized":"2024-04-26T23:42:25.502095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:23.713594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.506120+0000","last_change":"2024-04-26T23:42:25.493989+0000","last_active":"2024-04-26T23:42:25.506120+0000","last_peered":"2024-04-26T23:42:25.506120+0000","last_clean":"2024-04-26T23:42:25.506120+0000","last_became_active":"2024-04-26T23:42:25.493686+0000","last_became_peered":"2024-04-26T23:42:25.493686+0000","last_unstale":"2024-04-26T23:42:25.506120+0000","last_undegraded":"2024-04-26T23:42:25.506120+0000","last_fullsized":"2024-04-26T23:42:25.506120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:21:05.256266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.516626+0000","last_change":"2024-04-26T23:42:24.480773+0000","last_active":"2024-04-26T23:42:25.516626+0000","last_peered":"2024-04-26T23:42:25.516626+0000","last_clean":"2024-04-26T23:42:25.516626+0000","last_became_active":"2024-04-26T23:42:24.480452+0000","last_became_peered":"2024-04-26T23:42:24.480452+0000","last_unstale":"2024-04-26T23:42:25.516626+0000","last_undegraded":"2024-04-26T23:42:25.516626+0000","last_fullsized":"2024-04-26T23:42:25.516626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:21:04.249493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.512665+0000","last_change":"2024-04-26T23:42:25.505327+0000","last_active":"2024-04-26T23:42:25.512665+0000","last_peered":"2024-04-26T23:42:25.512665+0000","last_clean":"2024-04-26T23:42:25.512665+0000","last_became_active":"2024-04-26T23:42:25.504115+0000","last_became_peered":"2024-04-26T23:42:25.504115+0000","last_unstale":"2024-04-26T23:42:25.512665+0000","last_undegraded":"2024-04-26T23:42:25.512665+0000","last_fullsized":"2024-04-26T23:42:25.512665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:47.493980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.502272+0000","last_change":"2024-04-26T23:42:24.494369+0000","last_active":"2024-04-26T23:42:25.502272+0000","last_peered":"2024-04-26T23:42:25.502272+0000","last_clean":"2024-04-26T23:42:25.502272+0000","last_became_active":"2024-04-26T23:42:24.493123+0000","last_became_peered":"2024-04-26T23:42:24.493123+0000","last_unstale":"2024-04-26T23:42:25.502272+0000","last_undegraded":"2024-04-26T23:42:25.502272+0000","last_fullsized":"2024-04-26T23:42:25.502272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:19.854795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.499150+0000","last_change":"2024-04-26T23:42:25.493897+0000","last_active":"2024-04-26T23:42:25.499150+0000","last_peered":"2024-04-26T23:42:25.499150+0000","last_clean":"2024-04-26T23:42:25.499150+0000","last_became_active":"2024-04-26T23:42:25.491495+0000","last_became_peered":"2024-04-26T23:42:25.491495+0000","last_unstale":"2024-04-26T23:42:25.499150+0000","last_undegraded":"2024-04-26T23:42:25.499150+0000","last_fullsized":"2024-04-26T23:42:25.499150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:47.493980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.503660+0000","last_change":"2024-04-26T23:42:24.499347+0000","last_active":"2024-04-26T23:42:25.503660+0000","last_peered":"2024-04-26T23:42:25.503660+0000","last_clean":"2024-04-26T23:42:25.503660+0000","last_became_active":"2024-04-26T23:42:24.499079+0000","last_became_peered":"2024-04-26T23:42:24.499079+0000","last_unstale":"2024-04-26T23:42:25.503660+0000","last_undegraded":"2024-04-26T23:42:25.503660+0000","last_fullsized":"2024-04-26T23:42:25.503660+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:51.498125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.511008+0000","last_change":"2024-04-26T23:42:25.508179+0000","last_active":"2024-04-26T23:42:25.511008+0000","last_peered":"2024-04-26T23:42:25.511008+0000","last_clean":"2024-04-26T23:42:25.511008+0000","last_became_active":"2024-04-26T23:42:25.507871+0000","last_became_peered":"2024-04-26T23:42:25.507871+0000","last_unstale":"2024-04-26T23:42:25.511008+0000","last_undegraded":"2024-04-26T23:42:25.511008+0000","last_fullsized":"2024-04-26T23:42:25.511008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:45:53.092092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.509128+0000","last_change":"2024-04-26T23:42:24.498467+0000","last_active":"2024-04-26T23:42:25.509128+0000","last_peered":"2024-04-26T23:42:25.509128+0000","last_clean":"2024-04-26T23:42:25.509128+0000","last_became_active":"2024-04-26T23:42:24.498135+0000","last_became_peered":"2024-04-26T23:42:24.498135+0000","last_unstale":"2024-04-26T23:42:25.509128+0000","last_undegraded":"2024-04-26T23:42:25.509128+0000","last_fullsized":"2024-04-26T23:42:25.509128+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:13:12.396014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.512001+0000","last_change":"2024-04-26T23:42:25.507864+0000","last_active":"2024-04-26T23:42:25.512001+0000","last_peered":"2024-04-26T23:42:25.512001+0000","last_clean":"2024-04-26T23:42:25.512001+0000","last_became_active":"2024-04-26T23:42:25.507551+0000","last_became_peered":"2024-04-26T23:42:25.507551+0000","last_unstale":"2024-04-26T23:42:25.512001+0000","last_undegraded":"2024-04-26T23:42:25.512001+0000","last_fullsized":"2024-04-26T23:42:25.512001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:52.504897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.509983+0000","last_change":"2024-04-26T23:42:24.491550+0000","last_active":"2024-04-26T23:42:25.509983+0000","last_peered":"2024-04-26T23:42:25.509983+0000","last_clean":"2024-04-26T23:42:25.509983+0000","last_became_active":"2024-04-26T23:42:24.491287+0000","last_became_peered":"2024-04-26T23:42:24.491287+0000","last_unstale":"2024-04-26T23:42:25.509983+0000","last_undegraded":"2024-04-26T23:42:25.509983+0000","last_fullsized":"2024-04-26T23:42:25.509983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:32.545453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.495440+0000","last_change":"2024-04-26T23:42:25.494438+0000","last_active":"2024-04-26T23:42:25.495440+0000","last_peered":"2024-04-26T23:42:25.495440+0000","last_clean":"2024-04-26T23:42:25.495440+0000","last_became_active":"2024-04-26T23:42:25.494035+0000","last_became_peered":"2024-04-26T23:42:25.494035+0000","last_unstale":"2024-04-26T23:42:25.495440+0000","last_undegraded":"2024-04-26T23:42:25.495440+0000","last_fullsized":"2024-04-26T23:42:25.495440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:29.218972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.511032+0000","last_change":"2024-04-26T23:42:24.491245+0000","last_active":"2024-04-26T23:42:25.511032+0000","last_peered":"2024-04-26T23:42:25.511032+0000","last_clean":"2024-04-26T23:42:25.511032+0000","last_became_active":"2024-04-26T23:42:24.490425+0000","last_became_peered":"2024-04-26T23:42:24.490425+0000","last_unstale":"2024-04-26T23:42:25.511032+0000","last_undegraded":"2024-04-26T23:42:25.511032+0000","last_fullsized":"2024-04-26T23:42:25.511032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:17:27.887895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.490675+0000","last_change":"2024-04-26T23:42:25.486839+0000","last_active":"2024-04-26T23:42:25.490675+0000","last_peered":"2024-04-26T23:42:25.490675+0000","last_clean":"2024-04-26T23:42:25.490675+0000","last_became_active":"2024-04-26T23:42:25.486505+0000","last_became_peered":"2024-04-26T23:42:25.486505+0000","last_unstale":"2024-04-26T23:42:25.490675+0000","last_undegraded":"2024-04-26T23:42:25.490675+0000","last_fullsized":"2024-04-26T23:42:25.490675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:23.713594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.473011+0000","last_change":"2024-04-26T23:42:24.501525+0000","last_active":"2024-04-26T23:42:25.473011+0000","last_peered":"2024-04-26T23:42:25.473011+0000","last_clean":"2024-04-26T23:42:25.473011+0000","last_became_active":"2024-04-26T23:42:24.501258+0000","last_became_peered":"2024-04-26T23:42:24.501258+0000","last_unstale":"2024-04-26T23:42:25.473011+0000","last_undegraded":"2024-04-26T23:42:25.473011+0000","last_fullsized":"2024-04-26T23:42:25.473011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:45:52.085320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.509229+0000","last_change":"2024-04-26T23:42:25.497077+0000","last_active":"2024-04-26T23:42:25.509229+0000","last_peered":"2024-04-26T23:42:25.509229+0000","last_clean":"2024-04-26T23:42:25.509229+0000","last_became_active":"2024-04-26T23:42:25.496108+0000","last_became_peered":"2024-04-26T23:42:25.496108+0000","last_unstale":"2024-04-26T23:42:25.509229+0000","last_undegraded":"2024-04-26T23:42:25.509229+0000","last_fullsized":"2024-04-26T23:42:25.509229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:21:05.256266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.476100+0000","last_change":"2024-04-26T23:42:24.485085+0000","last_active":"2024-04-26T23:42:25.476100+0000","last_peered":"2024-04-26T23:42:25.476100+0000","last_clean":"2024-04-26T23:42:25.476100+0000","last_became_active":"2024-04-26T23:42:24.484430+0000","last_became_peered":"2024-04-26T23:42:24.484430+0000","last_unstale":"2024-04-26T23:42:25.476100+0000","last_undegraded":"2024-04-26T23:42:25.476100+0000","last_fullsized":"2024-04-26T23:42:25.476100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:13:10.148591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.484592+0000","last_change":"2024-04-26T23:42:25.483257+0000","last_active":"2024-04-26T23:42:25.484592+0000","last_peered":"2024-04-26T23:42:25.484592+0000","last_clean":"2024-04-26T23:42:25.484592+0000","last_became_active":"2024-04-26T23:42:25.482992+0000","last_became_peered":"2024-04-26T23:42:25.482992+0000","last_unstale":"2024-04-26T23:42:25.484592+0000","last_undegraded":"2024-04-26T23:42:25.484592+0000","last_fullsized":"2024-04-26T23:42:25.484592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:54.243362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.472963+0000","last_change":"2024-04-26T23:42:24.495212+0000","last_active":"2024-04-26T23:42:25.472963+0000","last_peered":"2024-04-26T23:42:25.472963+0000","last_clean":"2024-04-26T23:42:25.472963+0000","last_became_active":"2024-04-26T23:42:24.494935+0000","last_became_peered":"2024-04-26T23:42:24.494935+0000","last_unstale":"2024-04-26T23:42:25.472963+0000","last_undegraded":"2024-04-26T23:42:25.472963+0000","last_fullsized":"2024-04-26T23:42:25.472963+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:53.236590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.506260+0000","last_change":"2024-04-26T23:42:25.499511+0000","last_active":"2024-04-26T23:42:25.506260+0000","last_peered":"2024-04-26T23:42:25.506260+0000","last_clean":"2024-04-26T23:42:25.506260+0000","last_became_active":"2024-04-26T23:42:25.499210+0000","last_became_peered":"2024-04-26T23:42:25.499210+0000","last_unstale":"2024-04-26T23:42:25.506260+0000","last_undegraded":"2024-04-26T23:42:25.506260+0000","last_fullsized":"2024-04-26T23:42:25.506260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:32:11.244966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.478746+0000","last_change":"2024-04-26T23:42:24.495039+0000","last_active":"2024-04-26T23:42:25.478746+0000","last_peered":"2024-04-26T23:42:25.478746+0000","last_clean":"2024-04-26T23:42:25.478746+0000","last_became_active":"2024-04-26T23:42:24.494760+0000","last_became_peered":"2024-04-26T23:42:24.494760+0000","last_unstale":"2024-04-26T23:42:25.478746+0000","last_undegraded":"2024-04-26T23:42:25.478746+0000","last_fullsized":"2024-04-26T23:42:25.478746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:04.781254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.499663+0000","last_change":"2024-04-26T23:42:25.492837+0000","last_active":"2024-04-26T23:42:25.499663+0000","last_peered":"2024-04-26T23:42:25.499663+0000","last_clean":"2024-04-26T23:42:25.499663+0000","last_became_active":"2024-04-26T23:42:25.492486+0000","last_became_peered":"2024-04-26T23:42:25.492486+0000","last_unstale":"2024-04-26T23:42:25.499663+0000","last_undegraded":"2024-04-26T23:42:25.499663+0000","last_fullsized":"2024-04-26T23:42:25.499663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:00:28.493209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.496989+0000","last_change":"2024-04-26T23:42:24.491054+0000","last_active":"2024-04-26T23:42:25.496989+0000","last_peered":"2024-04-26T23:42:25.496989+0000","last_clean":"2024-04-26T23:42:25.496989+0000","last_became_active":"2024-04-26T23:42:24.490586+0000","last_became_peered":"2024-04-26T23:42:24.490586+0000","last_unstale":"2024-04-26T23:42:25.496989+0000","last_undegraded":"2024-04-26T23:42:25.496989+0000","last_fullsized":"2024-04-26T23:42:25.496989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:46.487208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.512233+0000","last_change":"2024-04-26T23:42:25.510146+0000","last_active":"2024-04-26T23:42:25.512233+0000","last_peered":"2024-04-26T23:42:25.512233+0000","last_clean":"2024-04-26T23:42:25.512233+0000","last_became_active":"2024-04-26T23:42:25.509871+0000","last_became_peered":"2024-04-26T23:42:25.509871+0000","last_unstale":"2024-04-26T23:42:25.512233+0000","last_undegraded":"2024-04-26T23:42:25.512233+0000","last_fullsized":"2024-04-26T23:42:25.512233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:16:56.474132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.512763+0000","last_change":"2024-04-26T23:42:24.499354+0000","last_active":"2024-04-26T23:42:25.512763+0000","last_peered":"2024-04-26T23:42:25.512763+0000","last_clean":"2024-04-26T23:42:25.512763+0000","last_became_active":"2024-04-26T23:42:24.499091+0000","last_became_peered":"2024-04-26T23:42:24.499091+0000","last_unstale":"2024-04-26T23:42:25.512763+0000","last_undegraded":"2024-04-26T23:42:25.512763+0000","last_fullsized":"2024-04-26T23:42:25.512763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:36:50.662251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.509933+0000","last_change":"2024-04-26T23:42:25.498488+0000","last_active":"2024-04-26T23:42:25.509933+0000","last_peered":"2024-04-26T23:42:25.509933+0000","last_clean":"2024-04-26T23:42:25.509933+0000","last_became_active":"2024-04-26T23:42:25.498190+0000","last_became_peered":"2024-04-26T23:42:25.498190+0000","last_unstale":"2024-04-26T23:42:25.509933+0000","last_undegraded":"2024-04-26T23:42:25.509933+0000","last_fullsized":"2024-04-26T23:42:25.509933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:47.493980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.514120+0000","last_change":"2024-04-26T23:42:24.487980+0000","last_active":"2024-04-26T23:42:25.514120+0000","last_peered":"2024-04-26T23:42:25.514120+0000","last_clean":"2024-04-26T23:42:25.514120+0000","last_became_active":"2024-04-26T23:42:24.487585+0000","last_became_peered":"2024-04-26T23:42:24.487585+0000","last_unstale":"2024-04-26T23:42:25.514120+0000","last_undegraded":"2024-04-26T23:42:25.514120+0000","last_fullsized":"2024-04-26T23:42:25.514120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:49:32.823232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.488005+0000","last_change":"2024-04-26T23:42:25.484412+0000","last_active":"2024-04-26T23:42:25.488005+0000","last_peered":"2024-04-26T23:42:25.488005+0000","last_clean":"2024-04-26T23:42:25.488005+0000","last_became_active":"2024-04-26T23:42:25.484075+0000","last_became_peered":"2024-04-26T23:42:25.484075+0000","last_unstale":"2024-04-26T23:42:25.488005+0000","last_undegraded":"2024-04-26T23:42:25.488005+0000","last_fullsized":"2024-04-26T23:42:25.488005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:29.218972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.487169+0000","last_change":"2024-04-26T23:42:24.480931+0000","last_active":"2024-04-26T23:42:25.487169+0000","last_peered":"2024-04-26T23:42:25.487169+0000","last_clean":"2024-04-26T23:42:25.487169+0000","last_became_active":"2024-04-26T23:42:24.480466+0000","last_became_peered":"2024-04-26T23:42:24.480466+0000","last_unstale":"2024-04-26T23:42:25.487169+0000","last_undegraded":"2024-04-26T23:42:25.487169+0000","last_fullsized":"2024-04-26T23:42:25.487169+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:02:16.144159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.508554+0000","last_change":"2024-04-26T23:42:25.507442+0000","last_active":"2024-04-26T23:42:25.508554+0000","last_peered":"2024-04-26T23:42:25.508554+0000","last_clean":"2024-04-26T23:42:25.508554+0000","last_became_active":"2024-04-26T23:42:25.507184+0000","last_became_peered":"2024-04-26T23:42:25.507184+0000","last_unstale":"2024-04-26T23:42:25.508554+0000","last_undegraded":"2024-04-26T23:42:25.508554+0000","last_fullsized":"2024-04-26T23:42:25.508554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:45:53.092092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.472074+0000","last_change":"2024-04-26T23:42:24.495324+0000","last_active":"2024-04-26T23:42:25.472074+0000","last_peered":"2024-04-26T23:42:25.472074+0000","last_clean":"2024-04-26T23:42:25.472074+0000","last_became_active":"2024-04-26T23:42:24.495053+0000","last_became_peered":"2024-04-26T23:42:24.495053+0000","last_unstale":"2024-04-26T23:42:25.472074+0000","last_undegraded":"2024-04-26T23:42:25.472074+0000","last_fullsized":"2024-04-26T23:42:25.472074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:07:58.097615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.515288+0000","last_change":"2024-04-26T23:42:25.502739+0000","last_active":"2024-04-26T23:42:25.515288+0000","last_peered":"2024-04-26T23:42:25.515288+0000","last_clean":"2024-04-26T23:42:25.515288+0000","last_became_active":"2024-04-26T23:42:25.501992+0000","last_became_peered":"2024-04-26T23:42:25.501992+0000","last_unstale":"2024-04-26T23:42:25.515288+0000","last_undegraded":"2024-04-26T23:42:25.515288+0000","last_fullsized":"2024-04-26T23:42:25.515288+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:48:06.328205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.510508+0000","last_change":"2024-04-26T23:42:24.502074+0000","last_active":"2024-04-26T23:42:25.510508+0000","last_peered":"2024-04-26T23:42:25.510508+0000","last_clean":"2024-04-26T23:42:25.510508+0000","last_became_active":"2024-04-26T23:42:24.501779+0000","last_became_peered":"2024-04-26T23:42:24.501779+0000","last_unstale":"2024-04-26T23:42:25.510508+0000","last_undegraded":"2024-04-26T23:42:25.510508+0000","last_fullsized":"2024-04-26T23:42:25.510508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:46.487208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.499569+0000","last_change":"2024-04-26T23:42:25.488630+0000","last_active":"2024-04-26T23:42:25.499569+0000","last_peered":"2024-04-26T23:42:25.499569+0000","last_clean":"2024-04-26T23:42:25.499569+0000","last_became_active":"2024-04-26T23:42:25.488367+0000","last_became_peered":"2024-04-26T23:42:25.488367+0000","last_unstale":"2024-04-26T23:42:25.499569+0000","last_undegraded":"2024-04-26T23:42:25.499569+0000","last_fullsized":"2024-04-26T23:42:25.499569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:21:05.256266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.508654+0000","last_change":"2024-04-26T23:42:24.497470+0000","last_active":"2024-04-26T23:42:25.508654+0000","last_peered":"2024-04-26T23:42:25.508654+0000","last_clean":"2024-04-26T23:42:25.508654+0000","last_became_active":"2024-04-26T23:42:24.497134+0000","last_became_peered":"2024-04-26T23:42:24.497134+0000","last_unstale":"2024-04-26T23:42:25.508654+0000","last_undegraded":"2024-04-26T23:42:25.508654+0000","last_fullsized":"2024-04-26T23:42:25.508654+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:48:05.321433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.485260+0000","last_change":"2024-04-26T23:42:25.483615+0000","last_active":"2024-04-26T23:42:25.485260+0000","last_peered":"2024-04-26T23:42:25.485260+0000","last_clean":"2024-04-26T23:42:25.485260+0000","last_became_active":"2024-04-26T23:42:25.483301+0000","last_became_peered":"2024-04-26T23:42:25.483301+0000","last_unstale":"2024-04-26T23:42:25.485260+0000","last_undegraded":"2024-04-26T23:42:25.485260+0000","last_fullsized":"2024-04-26T23:42:25.485260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:36:51.669023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.513913+0000","last_change":"2024-04-26T23:42:24.482597+0000","last_active":"2024-04-26T23:42:25.513913+0000","last_peered":"2024-04-26T23:42:25.513913+0000","last_clean":"2024-04-26T23:42:25.513913+0000","last_became_active":"2024-04-26T23:42:24.482023+0000","last_became_peered":"2024-04-26T23:42:24.482023+0000","last_unstale":"2024-04-26T23:42:25.513913+0000","last_undegraded":"2024-04-26T23:42:25.513913+0000","last_fullsized":"2024-04-26T23:42:25.513913+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:48:05.321433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.510940+0000","last_change":"2024-04-26T23:42:25.505159+0000","last_active":"2024-04-26T23:42:25.510940+0000","last_peered":"2024-04-26T23:42:25.510940+0000","last_clean":"2024-04-26T23:42:25.510940+0000","last_became_active":"2024-04-26T23:42:25.502780+0000","last_became_peered":"2024-04-26T23:42:25.502780+0000","last_unstale":"2024-04-26T23:42:25.510940+0000","last_undegraded":"2024-04-26T23:42:25.510940+0000","last_fullsized":"2024-04-26T23:42:25.510940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:36:51.669023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.512388+0000","last_change":"2024-04-26T23:42:24.488681+0000","last_active":"2024-04-26T23:42:25.512388+0000","last_peered":"2024-04-26T23:42:25.512388+0000","last_clean":"2024-04-26T23:42:25.512388+0000","last_became_active":"2024-04-26T23:42:24.488435+0000","last_became_peered":"2024-04-26T23:42:24.488435+0000","last_unstale":"2024-04-26T23:42:25.512388+0000","last_undegraded":"2024-04-26T23:42:25.512388+0000","last_fullsized":"2024-04-26T23:42:25.512388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:02:16.144159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.502170+0000","last_change":"2024-04-26T23:42:25.496135+0000","last_active":"2024-04-26T23:42:25.502170+0000","last_peered":"2024-04-26T23:42:25.502170+0000","last_clean":"2024-04-26T23:42:25.502170+0000","last_became_active":"2024-04-26T23:42:25.495564+0000","last_became_peered":"2024-04-26T23:42:25.495564+0000","last_unstale":"2024-04-26T23:42:25.502170+0000","last_undegraded":"2024-04-26T23:42:25.502170+0000","last_fullsized":"2024-04-26T23:42:25.502170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:57:39.229535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.478129+0000","last_change":"2024-04-26T23:42:24.490749+0000","last_active":"2024-04-26T23:42:25.478129+0000","last_peered":"2024-04-26T23:42:25.478129+0000","last_clean":"2024-04-26T23:42:25.478129+0000","last_became_active":"2024-04-26T23:42:24.490443+0000","last_became_peered":"2024-04-26T23:42:24.490443+0000","last_unstale":"2024-04-26T23:42:25.478129+0000","last_undegraded":"2024-04-26T23:42:25.478129+0000","last_fullsized":"2024-04-26T23:42:25.478129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.243240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.497778+0000","last_change":"2024-04-26T23:42:25.490541+0000","last_active":"2024-04-26T23:42:25.497778+0000","last_peered":"2024-04-26T23:42:25.497778+0000","last_clean":"2024-04-26T23:42:25.497778+0000","last_became_active":"2024-04-26T23:42:25.490257+0000","last_became_peered":"2024-04-26T23:42:25.490257+0000","last_unstale":"2024-04-26T23:42:25.497778+0000","last_undegraded":"2024-04-26T23:42:25.497778+0000","last_fullsized":"2024-04-26T23:42:25.497778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:57:21.571341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.509631+0000","last_change":"2024-04-26T23:42:24.477362+0000","last_active":"2024-04-26T23:42:25.509631+0000","last_peered":"2024-04-26T23:42:25.509631+0000","last_clean":"2024-04-26T23:42:25.509631+0000","last_became_active":"2024-04-26T23:42:24.476779+0000","last_became_peered":"2024-04-26T23:42:24.476779+0000","last_unstale":"2024-04-26T23:42:25.509631+0000","last_undegraded":"2024-04-26T23:42:25.509631+0000","last_fullsized":"2024-04-26T23:42:25.509631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:49:32.823232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.506490+0000","last_change":"2024-04-26T23:42:25.504089+0000","last_active":"2024-04-26T23:42:25.506490+0000","last_peered":"2024-04-26T23:42:25.506490+0000","last_clean":"2024-04-26T23:42:25.506490+0000","last_became_active":"2024-04-26T23:42:25.502408+0000","last_became_peered":"2024-04-26T23:42:25.502408+0000","last_unstale":"2024-04-26T23:42:25.506490+0000","last_undegraded":"2024-04-26T23:42:25.506490+0000","last_fullsized":"2024-04-26T23:42:25.506490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:51.250012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.503647+0000","last_change":"2024-04-26T23:42:24.481563+0000","last_active":"2024-04-26T23:42:25.503647+0000","last_peered":"2024-04-26T23:42:25.503647+0000","last_clean":"2024-04-26T23:42:25.503647+0000","last_became_active":"2024-04-26T23:42:24.481256+0000","last_became_peered":"2024-04-26T23:42:24.481256+0000","last_unstale":"2024-04-26T23:42:25.503647+0000","last_undegraded":"2024-04-26T23:42:25.503647+0000","last_fullsized":"2024-04-26T23:42:25.503647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:22.706822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.506350+0000","last_change":"2024-04-26T23:42:25.502311+0000","last_active":"2024-04-26T23:42:25.506350+0000","last_peered":"2024-04-26T23:42:25.506350+0000","last_clean":"2024-04-26T23:42:25.506350+0000","last_became_active":"2024-04-26T23:42:25.501979+0000","last_became_peered":"2024-04-26T23:42:25.501979+0000","last_unstale":"2024-04-26T23:42:25.506350+0000","last_undegraded":"2024-04-26T23:42:25.506350+0000","last_fullsized":"2024-04-26T23:42:25.506350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:10:15.727459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.480186+0000","last_change":"2024-04-26T23:42:24.486069+0000","last_active":"2024-04-26T23:42:25.480186+0000","last_peered":"2024-04-26T23:42:25.480186+0000","last_clean":"2024-04-26T23:42:25.480186+0000","last_became_active":"2024-04-26T23:42:24.484178+0000","last_became_peered":"2024-04-26T23:42:24.484178+0000","last_unstale":"2024-04-26T23:42:25.480186+0000","last_undegraded":"2024-04-26T23:42:25.480186+0000","last_fullsized":"2024-04-26T23:42:25.480186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:11.360474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.508472+0000","last_change":"2024-04-26T23:42:25.504887+0000","last_active":"2024-04-26T23:42:25.508472+0000","last_peered":"2024-04-26T23:42:25.508472+0000","last_clean":"2024-04-26T23:42:25.508472+0000","last_became_active":"2024-04-26T23:42:25.504581+0000","last_became_peered":"2024-04-26T23:42:25.504581+0000","last_unstale":"2024-04-26T23:42:25.508472+0000","last_undegraded":"2024-04-26T23:42:25.508472+0000","last_fullsized":"2024-04-26T23:42:25.508472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:47.493980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.474780+0000","last_change":"2024-04-26T23:42:24.492664+0000","last_active":"2024-04-26T23:42:25.474780+0000","last_peered":"2024-04-26T23:42:25.474780+0000","last_clean":"2024-04-26T23:42:25.474780+0000","last_became_active":"2024-04-26T23:42:24.492363+0000","last_became_peered":"2024-04-26T23:42:24.492363+0000","last_unstale":"2024-04-26T23:42:25.474780+0000","last_undegraded":"2024-04-26T23:42:25.474780+0000","last_fullsized":"2024-04-26T23:42:25.474780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:07:58.097615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.503047+0000","last_change":"2024-04-26T23:42:25.496135+0000","last_active":"2024-04-26T23:42:25.503047+0000","last_peered":"2024-04-26T23:42:25.503047+0000","last_clean":"2024-04-26T23:42:25.503047+0000","last_became_active":"2024-04-26T23:42:25.495891+0000","last_became_peered":"2024-04-26T23:42:25.495891+0000","last_unstale":"2024-04-26T23:42:25.503047+0000","last_undegraded":"2024-04-26T23:42:25.503047+0000","last_fullsized":"2024-04-26T23:42:25.503047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:42.870767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.510959+0000","last_change":"2024-04-26T23:42:24.489857+0000","last_active":"2024-04-26T23:42:25.510959+0000","last_peered":"2024-04-26T23:42:25.510959+0000","last_clean":"2024-04-26T23:42:25.510959+0000","last_became_active":"2024-04-26T23:42:24.489564+0000","last_became_peered":"2024-04-26T23:42:24.489564+0000","last_unstale":"2024-04-26T23:42:25.510959+0000","last_undegraded":"2024-04-26T23:42:25.510959+0000","last_fullsized":"2024-04-26T23:42:25.510959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:04.781254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.502044+0000","last_change":"2024-04-26T23:42:25.498484+0000","last_active":"2024-04-26T23:42:25.502044+0000","last_peered":"2024-04-26T23:42:25.502044+0000","last_clean":"2024-04-26T23:42:25.502044+0000","last_became_active":"2024-04-26T23:42:25.498149+0000","last_became_peered":"2024-04-26T23:42:25.498149+0000","last_unstale":"2024-04-26T23:42:25.502044+0000","last_undegraded":"2024-04-26T23:42:25.502044+0000","last_fullsized":"2024-04-26T23:42:25.502044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:46:07.530048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.478732+0000","last_change":"2024-04-26T23:42:24.479204+0000","last_active":"2024-04-26T23:42:25.478732+0000","last_peered":"2024-04-26T23:42:25.478732+0000","last_clean":"2024-04-26T23:42:25.478732+0000","last_became_active":"2024-04-26T23:42:24.478877+0000","last_became_peered":"2024-04-26T23:42:24.478877+0000","last_unstale":"2024-04-26T23:42:25.478732+0000","last_undegraded":"2024-04-26T23:42:25.478732+0000","last_fullsized":"2024-04-26T23:42:25.478732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:48:05.321433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.507265+0000","last_change":"2024-04-26T23:42:25.502817+0000","last_active":"2024-04-26T23:42:25.507265+0000","last_peered":"2024-04-26T23:42:25.507265+0000","last_clean":"2024-04-26T23:42:25.507265+0000","last_became_active":"2024-04-26T23:42:25.502561+0000","last_became_peered":"2024-04-26T23:42:25.502561+0000","last_unstale":"2024-04-26T23:42:25.507265+0000","last_undegraded":"2024-04-26T23:42:25.507265+0000","last_fullsized":"2024-04-26T23:42:25.507265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:07:59.104387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.495650+0000","last_change":"2024-04-26T23:42:24.492997+0000","last_active":"2024-04-26T23:42:25.495650+0000","last_peered":"2024-04-26T23:42:25.495650+0000","last_clean":"2024-04-26T23:42:25.495650+0000","last_became_active":"2024-04-26T23:42:24.492373+0000","last_became_peered":"2024-04-26T23:42:24.492373+0000","last_unstale":"2024-04-26T23:42:25.495650+0000","last_undegraded":"2024-04-26T23:42:25.495650+0000","last_fullsized":"2024-04-26T23:42:25.495650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:22.706822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.512997+0000","last_change":"2024-04-26T23:42:25.505394+0000","last_active":"2024-04-26T23:42:25.512997+0000","last_peered":"2024-04-26T23:42:25.512997+0000","last_clean":"2024-04-26T23:42:25.512997+0000","last_became_active":"2024-04-26T23:42:25.503709+0000","last_became_peered":"2024-04-26T23:42:25.503709+0000","last_unstale":"2024-04-26T23:42:25.512997+0000","last_undegraded":"2024-04-26T23:42:25.512997+0000","last_fullsized":"2024-04-26T23:42:25.512997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:54.243362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.478109+0000","last_change":"2024-04-26T23:42:24.483875+0000","last_active":"2024-04-26T23:42:25.478109+0000","last_peered":"2024-04-26T23:42:25.478109+0000","last_clean":"2024-04-26T23:42:25.478109+0000","last_became_active":"2024-04-26T23:42:24.483256+0000","last_became_peered":"2024-04-26T23:42:24.483256+0000","last_unstale":"2024-04-26T23:42:25.478109+0000","last_undegraded":"2024-04-26T23:42:25.478109+0000","last_fullsized":"2024-04-26T23:42:25.478109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:02:16.144159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.501653+0000","last_change":"2024-04-26T23:42:25.494465+0000","last_active":"2024-04-26T23:42:25.501653+0000","last_peered":"2024-04-26T23:42:25.501653+0000","last_clean":"2024-04-26T23:42:25.501653+0000","last_became_active":"2024-04-26T23:42:25.492358+0000","last_became_peered":"2024-04-26T23:42:25.492358+0000","last_unstale":"2024-04-26T23:42:25.501653+0000","last_undegraded":"2024-04-26T23:42:25.501653+0000","last_fullsized":"2024-04-26T23:42:25.501653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:23.713594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.487307+0000","last_change":"2024-04-26T23:42:24.488238+0000","last_active":"2024-04-26T23:42:25.487307+0000","last_peered":"2024-04-26T23:42:25.487307+0000","last_clean":"2024-04-26T23:42:25.487307+0000","last_became_active":"2024-04-26T23:42:24.487984+0000","last_became_peered":"2024-04-26T23:42:24.487984+0000","last_unstale":"2024-04-26T23:42:25.487307+0000","last_undegraded":"2024-04-26T23:42:25.487307+0000","last_fullsized":"2024-04-26T23:42:25.487307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:19.854795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.506295+0000","last_change":"2024-04-26T23:42:25.499954+0000","last_active":"2024-04-26T23:42:25.506295+0000","last_peered":"2024-04-26T23:42:25.506295+0000","last_clean":"2024-04-26T23:42:25.506295+0000","last_became_active":"2024-04-26T23:42:25.499652+0000","last_became_peered":"2024-04-26T23:42:25.499652+0000","last_unstale":"2024-04-26T23:42:25.506295+0000","last_undegraded":"2024-04-26T23:42:25.506295+0000","last_fullsized":"2024-04-26T23:42:25.506295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:11.767639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.480190+0000","last_change":"2024-04-26T23:42:24.479442+0000","last_active":"2024-04-26T23:42:25.480190+0000","last_peered":"2024-04-26T23:42:25.480190+0000","last_clean":"2024-04-26T23:42:25.480190+0000","last_became_active":"2024-04-26T23:42:24.479070+0000","last_became_peered":"2024-04-26T23:42:24.479070+0000","last_unstale":"2024-04-26T23:42:25.480190+0000","last_undegraded":"2024-04-26T23:42:25.480190+0000","last_fullsized":"2024-04-26T23:42:25.480190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:17.617013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.485111+0000","last_change":"2024-04-26T23:42:25.481190+0000","last_active":"2024-04-26T23:42:25.485111+0000","last_peered":"2024-04-26T23:42:25.485111+0000","last_clean":"2024-04-26T23:42:25.485111+0000","last_became_active":"2024-04-26T23:42:25.480878+0000","last_became_peered":"2024-04-26T23:42:25.480878+0000","last_unstale":"2024-04-26T23:42:25.485111+0000","last_undegraded":"2024-04-26T23:42:25.485111+0000","last_fullsized":"2024-04-26T23:42:25.485111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:20.861567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.472028+0000","last_change":"2024-04-26T23:42:24.495418+0000","last_active":"2024-04-26T23:42:25.472028+0000","last_peered":"2024-04-26T23:42:25.472028+0000","last_clean":"2024-04-26T23:42:25.472028+0000","last_became_active":"2024-04-26T23:42:24.495133+0000","last_became_peered":"2024-04-26T23:42:24.495133+0000","last_unstale":"2024-04-26T23:42:25.472028+0000","last_undegraded":"2024-04-26T23:42:25.472028+0000","last_fullsized":"2024-04-26T23:42:25.472028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:21:04.249493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.508416+0000","last_change":"2024-04-26T23:42:25.505640+0000","last_active":"2024-04-26T23:42:25.508416+0000","last_peered":"2024-04-26T23:42:25.508416+0000","last_clean":"2024-04-26T23:42:25.508416+0000","last_became_active":"2024-04-26T23:42:25.505410+0000","last_became_peered":"2024-04-26T23:42:25.505410+0000","last_unstale":"2024-04-26T23:42:25.508416+0000","last_undegraded":"2024-04-26T23:42:25.508416+0000","last_fullsized":"2024-04-26T23:42:25.508416+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:24.458682+0000","last_clean_scrub_stamp":"2024-04-26T23:42:24.458682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:36:51.669023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.493833+0000","last_change":"2024-04-26T23:42:24.489970+0000","last_active":"2024-04-26T23:42:25.493833+0000","last_peered":"2024-04-26T23:42:25.493833+0000","last_clean":"2024-04-26T23:42:25.493833+0000","last_became_active":"2024-04-26T23:42:24.489652+0000","last_became_peered":"2024-04-26T23:42:24.489652+0000","last_unstale":"2024-04-26T23:42:25.493833+0000","last_undegraded":"2024-04-26T23:42:25.493833+0000","last_fullsized":"2024-04-26T23:42:25.493833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:42:23.451910+0000","last_clean_scrub_stamp":"2024-04-26T23:42:23.451910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:19.854795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":192,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T23:42:25.489129+0000","last_change":"2024-04-26T23:41:12.783987+0000","last_active":"2024-04-26T23:42:25.489129+0000","last_peered":"2024-04-26T23:42:25.489129+0000","last_clean":"2024-04-26T23:42:25.489129+0000","last_became_active":"2024-04-26T23:41:12.782901+0000","last_became_peered":"2024-04-26T23:41:12.782901+0000","last_unstale":"2024-04-26T23:42:25.489129+0000","last_undegraded":"2024-04-26T23:42:25.489129+0000","last_fullsized":"2024-04-26T23:42:25.489129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_clean_scrub_stamp":"2024-04-26T23:41:11.626255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:16.305521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":942080,"data_stored":723917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":348160,"data_stored":133549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":133549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":368640,"data_stored":140428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":133549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":140394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":133549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":942080,"data_stored":723917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:42:29.950 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T23:42:29.950 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-26T23:42:30.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.124+0000 7fe8ac400640 1 Processor -- start 2024-04-26T23:42:30.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.124+0000 7fe8ac400640 1 -- start start 2024-04-26T23:42:30.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.124+0000 7fe8ac400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe8a415bfd0 0x7fe8a406d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:30.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.124+0000 7fe8ac400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8a406fb80 con 0x7fe8a415bbf0 2024-04-26T23:42:30.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.124+0000 7fe8ac400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8a40af4b0 con 0x7fe8a40b6de0 2024-04-26T23:42:30.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.124+0000 7fe8ac400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe8a4070190 con 0x7fe8a415bfd0 2024-04-26T23:42:30.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.124+0000 7fe8a9a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fe8a415bbf0 0x7fe8a40aeda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58760/0 (socket says 172.21.15.137:58760) 2024-04-26T23:42:30.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.124+0000 7fe8a9a00640 1 -- 172.21.15.137:0/43178644 learned_addr learned my addr 172.21.15.137:0/43178644 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:30.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.124+0000 7fe8a9000640 1 --2- 172.21.15.137:0/43178644 >> v2:172.21.15.170:3300/0 conn(0x7fe8a415bfd0 0x7fe8a406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:30.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.124+0000 7fe8a3e00640 1 -- 172.21.15.137:0/43178644 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4146875912 0 0) 0x7fe8a406fb80 con 0x7fe8a415bbf0 2024-04-26T23:42:30.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.124+0000 7fe8a3e00640 1 -- 172.21.15.137:0/43178644 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe88c003530 con 0x7fe8a415bbf0 2024-04-26T23:42:30.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.124+0000 7fe8a9000640 1 -- 172.21.15.137:0/43178644 >> v1:172.21.15.170:6789/0 conn(0x7fe8a40b6de0 legacy=0x7fe8a4070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:30.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.124+0000 7fe8a9000640 1 -- 172.21.15.137:0/43178644 >> v1:172.21.15.137:6789/0 conn(0x7fe8a415bbf0 legacy=0x7fe8a40aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:30.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.124+0000 7fe8a3e00640 1 -- 172.21.15.137:0/43178644 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 246782776 0 0) 0x7fe88c003530 con 0x7fe8a415bbf0 2024-04-26T23:42:30.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.124+0000 7fe8a9000640 1 -- 172.21.15.137:0/43178644 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a40b5b40 con 0x7fe8a415bfd0 2024-04-26T23:42:30.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.128+0000 7fe8a9000640 1 --2- 172.21.15.137:0/43178644 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8a415bfd0 0x7fe8a406d410 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe8900097c0 tx=0x7fe89001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5907eee0cb8c228 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:30.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.128+0000 7fe8a3e00640 1 -- 172.21.15.137:0/43178644 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8900b0070 con 0x7fe8a415bfd0 2024-04-26T23:42:30.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.128+0000 7fe8a3e00640 1 -- 172.21.15.137:0/43178644 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8900ab400 con 0x7fe8a415bfd0 2024-04-26T23:42:30.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.128+0000 7fe8a3e00640 1 -- 172.21.15.137:0/43178644 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8980016a0 con 0x7fe8a415bfd0 2024-04-26T23:42:30.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.128+0000 7fe8ac400640 1 -- 172.21.15.137:0/43178644 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8a415bfd0 msgr2=0x7fe8a406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:30.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.128+0000 7fe8ac400640 1 --2- 172.21.15.137:0/43178644 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8a415bfd0 0x7fe8a406d410 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe8900097c0 tx=0x7fe89001c3c0 comp rx=0 tx=0).stop 2024-04-26T23:42:30.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.128+0000 7fe8ac400640 1 -- 172.21.15.137:0/43178644 shutdown_connections 2024-04-26T23:42:30.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.128+0000 7fe8ac400640 1 --2- 172.21.15.137:0/43178644 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8a415bfd0 0x7fe8a406d410 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:30.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.128+0000 7fe8ac400640 1 -- 172.21.15.137:0/43178644 >> 172.21.15.137:0/43178644 conn(0x7fe8a4073160 msgr2=0x7fe8a4073570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:30.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.128+0000 7fe8ac400640 1 -- 172.21.15.137:0/43178644 shutdown_connections 2024-04-26T23:42:30.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.128+0000 7fe8ac400640 1 -- 172.21.15.137:0/43178644 wait complete. 2024-04-26T23:42:30.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8ac400640 1 Processor -- start 2024-04-26T23:42:30.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8ac400640 1 -- start start 2024-04-26T23:42:30.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8ac400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8a40b6de0 0x7fe8a40b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:30.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8ac400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8a415bbf0 0x7fe8a4152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:30.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8ac400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8a415bfd0 0x7fe8a4153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:30.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8ac400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a406dad0 con 0x7fe8a40b6de0 2024-04-26T23:42:30.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8ac400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a406d950 con 0x7fe8a415bfd0 2024-04-26T23:42:30.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8ac400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe8a406dc50 con 0x7fe8a415bbf0 2024-04-26T23:42:30.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8a9a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8a40b6de0 0x7fe8a40b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:30.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8a9a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8a40b6de0 0x7fe8a40b2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36462/0 (socket says 172.21.15.137:36462) 2024-04-26T23:42:30.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8a9a00640 1 -- 172.21.15.137:0/1359550709 learned_addr learned my addr 172.21.15.137:0/1359550709 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:30.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8a9000640 1 --2- 172.21.15.137:0/1359550709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8a415bbf0 0x7fe8a4152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:30.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8a9a00640 1 -- 172.21.15.137:0/1359550709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8a415bbf0 msgr2=0x7fe8a4152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:30.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8a9a00640 1 --2- 172.21.15.137:0/1359550709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8a415bbf0 0x7fe8a4152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:30.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8aa400640 1 --2- 172.21.15.137:0/1359550709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8a415bfd0 0x7fe8a4153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:30.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8a9a00640 1 -- 172.21.15.137:0/1359550709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8a415bfd0 msgr2=0x7fe8a4153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:30.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8a9a00640 1 --2- 172.21.15.137:0/1359550709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8a415bfd0 0x7fe8a4153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:30.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8a9a00640 1 -- 172.21.15.137:0/1359550709 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a40cf5e0 con 0x7fe8a40b6de0 2024-04-26T23:42:30.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8a9000640 1 --2- 172.21.15.137:0/1359550709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8a415bbf0 0x7fe8a4152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:30.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8aa400640 1 --2- 172.21.15.137:0/1359550709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8a415bfd0 0x7fe8a4153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:30.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8a9a00640 1 --2- 172.21.15.137:0/1359550709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8a40b6de0 0x7fe8a40b2220 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe89800c730 tx=0x7fe89800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:30.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8a1600640 1 -- 172.21.15.137:0/1359550709 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe898018070 con 0x7fe8a40b6de0 2024-04-26T23:42:30.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8a1600640 1 -- 172.21.15.137:0/1359550709 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8980072f0 con 0x7fe8a40b6de0 2024-04-26T23:42:30.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8a1600640 1 -- 172.21.15.137:0/1359550709 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8980047f0 con 0x7fe8a40b6de0 2024-04-26T23:42:30.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8ac400640 1 -- 172.21.15.137:0/1359550709 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8a40cf8c0 con 0x7fe8a40b6de0 2024-04-26T23:42:30.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.132+0000 7fe8ac400640 1 -- 172.21.15.137:0/1359550709 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8a40cfe80 con 0x7fe8a40b6de0 2024-04-26T23:42:30.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.136+0000 7fe8ac400640 1 -- 172.21.15.137:0/1359550709 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8a406a410 con 0x7fe8a40b6de0 2024-04-26T23:42:30.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.136+0000 7fe8a1600640 1 -- 172.21.15.137:0/1359550709 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe89801b070 con 0x7fe8a40b6de0 2024-04-26T23:42:30.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.136+0000 7fe8a1600640 1 --2- 172.21.15.137:0/1359550709 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe884068380 0x7fe88406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:30.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.136+0000 7fe8a1600640 1 -- 172.21.15.137:0/1359550709 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe898085f70 con 0x7fe8a40b6de0 2024-04-26T23:42:30.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.136+0000 7fe8a9000640 1 --2- 172.21.15.137:0/1359550709 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe884068380 0x7fe88406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:30.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.136+0000 7fe8a9000640 1 --2- 172.21.15.137:0/1359550709 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe884068380 0x7fe88406a840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe8900ad000 tx=0x7fe890008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:30.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.140+0000 7fe8a1600640 1 -- 172.21.15.137:0/1359550709 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe898056400 con 0x7fe8a40b6de0 2024-04-26T23:42:30.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.356+0000 7fe8ac400640 1 -- 172.21.15.137:0/1359550709 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe8a4073790 con 0x7fe8a40b6de0 2024-04-26T23:42:30.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.356+0000 7fe8a1600640 1 -- 172.21.15.137:0/1359550709 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7fe898055d00 con 0x7fe8a40b6de0 2024-04-26T23:42:30.362 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-04-26T23:42:30.362 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBlOyxmNsaKARAAi0ecpgpB9GUVCXS04Xi03g== 2024-04-26T23:42:30.362 INFO:teuthology.orchestra.run.smithi137.stdout: caps mds = "allow" 2024-04-26T23:42:30.362 INFO:teuthology.orchestra.run.smithi137.stdout: caps mon = "allow r" 2024-04-26T23:42:30.363 INFO:teuthology.orchestra.run.smithi137.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-26T23:42:30.363 INFO:teuthology.orchestra.run.smithi137.stderr:updated caps for client.0 2024-04-26T23:42:30.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.360+0000 7fe8ac400640 1 -- 172.21.15.137:0/1359550709 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe884068380 msgr2=0x7fe88406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:30.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.360+0000 7fe8ac400640 1 --2- 172.21.15.137:0/1359550709 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe884068380 0x7fe88406a840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe8900ad000 tx=0x7fe890008040 comp rx=0 tx=0).stop 2024-04-26T23:42:30.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.360+0000 7fe8ac400640 1 -- 172.21.15.137:0/1359550709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8a40b6de0 msgr2=0x7fe8a40b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:30.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.360+0000 7fe8ac400640 1 --2- 172.21.15.137:0/1359550709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8a40b6de0 0x7fe8a40b2220 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe89800c730 tx=0x7fe89800cbf0 comp rx=0 tx=0).stop 2024-04-26T23:42:30.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.360+0000 7fe8ac400640 1 -- 172.21.15.137:0/1359550709 shutdown_connections 2024-04-26T23:42:30.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.360+0000 7fe8ac400640 1 --2- 172.21.15.137:0/1359550709 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe884068380 0x7fe88406a840 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:30.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.360+0000 7fe8ac400640 1 --2- 172.21.15.137:0/1359550709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8a415bfd0 0x7fe8a4153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:30.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.360+0000 7fe8ac400640 1 --2- 172.21.15.137:0/1359550709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8a415bbf0 0x7fe8a4152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:30.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.360+0000 7fe8ac400640 1 --2- 172.21.15.137:0/1359550709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8a40b6de0 0x7fe8a40b2220 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:30.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.360+0000 7fe8ac400640 1 -- 172.21.15.137:0/1359550709 >> 172.21.15.137:0/1359550709 conn(0x7fe8a4073160 msgr2=0x7fe8a40b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:30.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.360+0000 7fe8ac400640 1 -- 172.21.15.137:0/1359550709 shutdown_connections 2024-04-26T23:42:30.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.360+0000 7fe8ac400640 1 -- 172.21.15.137:0/1359550709 wait complete. 2024-04-26T23:42:30.383 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:42:30.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.512+0000 7f10db000640 1 Processor -- start 2024-04-26T23:42:30.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.512+0000 7f10db000640 1 -- start start 2024-04-26T23:42:30.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.516+0000 7f10db000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f10d4146b10 0x7f10d406f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:30.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.516+0000 7f10db000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10d406f540 0x7f10d406d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:30.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.516+0000 7f10db000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f10d406d950 0x7f10d4075380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:30.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.516+0000 7f10db000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f10d406ddc0 con 0x7f10d406d950 2024-04-26T23:42:30.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.516+0000 7f10db000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f10d415d7b0 con 0x7f10d4146b10 2024-04-26T23:42:30.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.516+0000 7f10db000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f10d415da90 con 0x7f10d406f540 2024-04-26T23:42:30.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.516+0000 7f10d9000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f10d406d950 0x7f10d4075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:30.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.516+0000 7f10d9000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f10d406d950 0x7f10d4075380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36464/0 (socket says 172.21.15.137:36464) 2024-04-26T23:42:30.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.516+0000 7f10d9000640 1 -- 172.21.15.137:0/3189718073 learned_addr learned my addr 172.21.15.137:0/3189718073 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:30.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.516+0000 7f10d3e00640 1 --2- 172.21.15.137:0/3189718073 >> v2:172.21.15.170:3300/0 conn(0x7f10d4146b10 0x7f10d406f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:30.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.516+0000 7f10cb400640 1 --2- 172.21.15.137:0/3189718073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10d406f540 0x7f10d406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:30.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.516+0000 7f10d9000640 1 -- 172.21.15.137:0/3189718073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10d406f540 msgr2=0x7f10d406d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:30.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.516+0000 7f10d9000640 1 --2- 172.21.15.137:0/3189718073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10d406f540 0x7f10d406d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:30.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.516+0000 7f10d9000640 1 -- 172.21.15.137:0/3189718073 >> v2:172.21.15.170:3300/0 conn(0x7f10d4146b10 msgr2=0x7f10d406f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:30.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.516+0000 7f10d9000640 1 --2- 172.21.15.137:0/3189718073 >> v2:172.21.15.170:3300/0 conn(0x7f10d4146b10 0x7f10d406f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:30.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.516+0000 7f10d9000640 1 -- 172.21.15.137:0/3189718073 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d415dd70 con 0x7f10d406d950 2024-04-26T23:42:30.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.516+0000 7f10cb400640 1 --2- 172.21.15.137:0/3189718073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10d406f540 0x7f10d406d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:30.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10d9000640 1 --2- 172.21.15.137:0/3189718073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10d406d950 0x7f10d4075380 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f10d4076390 tx=0x7f10cc01c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1a3083dc684edb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:30.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10d3400640 1 -- 172.21.15.137:0/3189718073 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0ac020 con 0x7f10d406d950 2024-04-26T23:42:30.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10d3400640 1 -- 172.21.15.137:0/3189718073 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10cc0a6420 con 0x7f10d406d950 2024-04-26T23:42:30.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10d3400640 1 -- 172.21.15.137:0/3189718073 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0a67f0 con 0x7f10d406d950 2024-04-26T23:42:30.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10db000640 1 -- 172.21.15.137:0/3189718073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10d406d950 msgr2=0x7f10d4075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:30.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10db000640 1 --2- 172.21.15.137:0/3189718073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10d406d950 0x7f10d4075380 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f10d4076390 tx=0x7f10cc01c6a0 comp rx=0 tx=0).stop 2024-04-26T23:42:30.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10db000640 1 -- 172.21.15.137:0/3189718073 shutdown_connections 2024-04-26T23:42:30.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10db000640 1 --2- 172.21.15.137:0/3189718073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10d406d950 0x7f10d4075380 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:30.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10db000640 1 --2- 172.21.15.137:0/3189718073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10d406f540 0x7f10d406d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:30.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10db000640 1 --2- 172.21.15.137:0/3189718073 >> v2:172.21.15.170:3300/0 conn(0x7f10d4146b10 0x7f10d406f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:30.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10db000640 1 -- 172.21.15.137:0/3189718073 >> 172.21.15.137:0/3189718073 conn(0x7f10d4073160 msgr2=0x7f10d4073570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:30.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10db000640 1 -- 172.21.15.137:0/3189718073 shutdown_connections 2024-04-26T23:42:30.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10db000640 1 -- 172.21.15.137:0/3189718073 wait complete. 2024-04-26T23:42:30.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10db000640 1 Processor -- start 2024-04-26T23:42:30.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10db000640 1 -- start start 2024-04-26T23:42:30.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10db000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10d406d950 0x7f10d41f7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:30.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10db000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10d406f540 0x7f10d415c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:30.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10db000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10d4146b10 0x7f10d415ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:30.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10db000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f10d40af300 con 0x7f10d406f540 2024-04-26T23:42:30.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10db000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f10d40af180 con 0x7f10d406d950 2024-04-26T23:42:30.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10db000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f10d40af480 con 0x7f10d4146b10 2024-04-26T23:42:30.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10cb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10d406f540 0x7f10d415c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:30.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10cb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10d406f540 0x7f10d415c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36476/0 (socket says 172.21.15.137:36476) 2024-04-26T23:42:30.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.520+0000 7f10cb400640 1 -- 172.21.15.137:0/2133889113 learned_addr learned my addr 172.21.15.137:0/2133889113 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:30.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.524+0000 7f10d3e00640 1 --2- 172.21.15.137:0/2133889113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10d406d950 0x7f10d41f7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:30.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.524+0000 7f10d9000640 1 --2- 172.21.15.137:0/2133889113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10d4146b10 0x7f10d415ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:30.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.524+0000 7f10cb400640 1 -- 172.21.15.137:0/2133889113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10d4146b10 msgr2=0x7f10d415ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:30.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.524+0000 7f10cb400640 1 --2- 172.21.15.137:0/2133889113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10d4146b10 0x7f10d415ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:30.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.524+0000 7f10cb400640 1 -- 172.21.15.137:0/2133889113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10d406d950 msgr2=0x7f10d41f7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:30.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.524+0000 7f10cb400640 1 --2- 172.21.15.137:0/2133889113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10d406d950 0x7f10d41f7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:30.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.524+0000 7f10cb400640 1 -- 172.21.15.137:0/2133889113 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d40b4d70 con 0x7f10d406f540 2024-04-26T23:42:30.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.524+0000 7f10d3e00640 1 --2- 172.21.15.137:0/2133889113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10d406d950 0x7f10d41f7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:30.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.524+0000 7f10d9000640 1 --2- 172.21.15.137:0/2133889113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10d4146b10 0x7f10d415ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:30.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.524+0000 7f10cb400640 1 --2- 172.21.15.137:0/2133889113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10d406f540 0x7f10d415c5f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00c7c0 tx=0x7f10bc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:30.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.524+0000 7f10d0c00640 1 -- 172.21.15.137:0/2133889113 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc015070 con 0x7f10d406f540 2024-04-26T23:42:30.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.524+0000 7f10d0c00640 1 -- 172.21.15.137:0/2133889113 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10bc007a30 con 0x7f10d406f540 2024-04-26T23:42:30.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.524+0000 7f10db000640 1 -- 172.21.15.137:0/2133889113 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10d40b5010 con 0x7f10d406f540 2024-04-26T23:42:30.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.524+0000 7f10d0c00640 1 -- 172.21.15.137:0/2133889113 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc007e00 con 0x7f10d406f540 2024-04-26T23:42:30.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.524+0000 7f10db000640 1 -- 172.21.15.137:0/2133889113 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10d40b55d0 con 0x7f10d406f540 2024-04-26T23:42:30.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.524+0000 7f10db000640 1 -- 172.21.15.137:0/2133889113 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10d406a4b0 con 0x7f10d406f540 2024-04-26T23:42:30.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.524+0000 7f10d0c00640 1 -- 172.21.15.137:0/2133889113 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f10bc018070 con 0x7f10d406f540 2024-04-26T23:42:30.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.524+0000 7f10d0c00640 1 --2- 172.21.15.137:0/2133889113 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f10b0068380 0x7f10b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:30.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.524+0000 7f10d0c00640 1 -- 172.21.15.137:0/2133889113 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f10bc086880 con 0x7f10d406f540 2024-04-26T23:42:30.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.528+0000 7f10d3e00640 1 --2- 172.21.15.137:0/2133889113 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f10b0068380 0x7f10b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:30.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.528+0000 7f10d3e00640 1 --2- 172.21.15.137:0/2133889113 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f10b0068380 0x7f10b006a840 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f10c40097a0 tx=0x7f10c4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:30.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.528+0000 7f10d0c00640 1 -- 172.21.15.137:0/2133889113 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f10bc056ed0 con 0x7f10d406f540 2024-04-26T23:42:30.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.724+0000 7f10db000640 1 -- 172.21.15.137:0/2133889113 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10d40d1560 con 0x7f10d406f540 2024-04-26T23:42:30.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.724+0000 7f10d0c00640 1 -- 172.21.15.137:0/2133889113 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5198 (secure 0 0 0) 0x7f10bc0567d0 con 0x7f10d406f540 2024-04-26T23:42:30.730 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:30.730 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1345232353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1345232353},{"type":"v1","addr":"172.21.15.137:6836","nonce":1345232353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1274585662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1274585662},{"type":"v1","addr":"172.21.15.137:6837","nonce":1274585662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4079333736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4079333736},{"type":"v1","addr":"172.21.15.170:6834","nonce":4079333736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:42:24.865468+0000","modified":"2024-04-26T23:42:27.876394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34808},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34808":{"gid":34808,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/3364296586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3364296586},{"type":"v1","addr":"172.21.15.170:6835","nonce":3364296586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34808,"qdb_cluster":[34808]},"id":2}]} 2024-04-26T23:42:30.730 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 17 2024-04-26T23:42:30.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.728+0000 7f10db000640 1 -- 172.21.15.137:0/2133889113 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f10b0068380 msgr2=0x7f10b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:30.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.728+0000 7f10db000640 1 --2- 172.21.15.137:0/2133889113 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f10b0068380 0x7f10b006a840 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f10c40097a0 tx=0x7f10c4008040 comp rx=0 tx=0).stop 2024-04-26T23:42:30.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.728+0000 7f10db000640 1 -- 172.21.15.137:0/2133889113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10d406f540 msgr2=0x7f10d415c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:30.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.728+0000 7f10db000640 1 --2- 172.21.15.137:0/2133889113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10d406f540 0x7f10d415c5f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00c7c0 tx=0x7f10bc00cc80 comp rx=0 tx=0).stop 2024-04-26T23:42:30.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.728+0000 7f10db000640 1 -- 172.21.15.137:0/2133889113 shutdown_connections 2024-04-26T23:42:30.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.728+0000 7f10db000640 1 --2- 172.21.15.137:0/2133889113 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f10b0068380 0x7f10b006a840 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:30.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.728+0000 7f10db000640 1 --2- 172.21.15.137:0/2133889113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10d406f540 0x7f10d415c5f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:30.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.728+0000 7f10db000640 1 --2- 172.21.15.137:0/2133889113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10d4146b10 0x7f10d415ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:30.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.728+0000 7f10db000640 1 --2- 172.21.15.137:0/2133889113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10d406d950 0x7f10d41f7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:30.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.728+0000 7f10db000640 1 -- 172.21.15.137:0/2133889113 >> 172.21.15.137:0/2133889113 conn(0x7f10d4073160 msgr2=0x7f10d41674f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:30.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.728+0000 7f10db000640 1 -- 172.21.15.137:0/2133889113 shutdown_connections 2024-04-26T23:42:30.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:30.728+0000 7f10db000640 1 -- 172.21.15.137:0/2133889113 wait complete. 2024-04-26T23:42:31.154 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T23:42:24.865468+0000', 'modified': '2024-04-26T23:42:27.876394+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34808}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34808': {'gid': 34808, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.170:6835/3364296586', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6833', 'nonce': 3364296586}, {'type': 'v1', 'addr': '172.21.15.170:6835', 'nonce': 3364296586}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34808, 'qdb_cluster': [34808]} 2024-04-26T23:42:31.154 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T23:42:31.155 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-26T23:42:31.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.288+0000 7efbfe200640 1 Processor -- start 2024-04-26T23:42:31.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.288+0000 7efbfe200640 1 -- start start 2024-04-26T23:42:31.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.288+0000 7efbfe200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efbf80b4100 0x7efbf80d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.288+0000 7efbfe200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7efbf80d2d80 0x7efbf80d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.288+0000 7efbfe200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efbf8160240 con 0x7efbf815f3d0 2024-04-26T23:42:31.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.288+0000 7efbfe200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7efbf80d3730 con 0x7efbf80d2d80 2024-04-26T23:42:31.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.288+0000 7efbfe200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7efbf80b2960 con 0x7efbf80b4100 2024-04-26T23:42:31.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.288+0000 7efbf7e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7efbf80d2d80 0x7efbf80d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.288+0000 7efbf6a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efbf80b4100 0x7efbf80d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.288+0000 7efbf7e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7efbf80d2d80 0x7efbf80d31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:57302/0 (socket says 172.21.15.137:57302) 2024-04-26T23:42:31.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.288+0000 7efbf7e00640 1 -- 172.21.15.137:0/2404164321 learned_addr learned my addr 172.21.15.137:0/2404164321 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:31.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.288+0000 7efbf7400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7efbf815f3d0 0x7efbf815f7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:42264/0 (socket says 172.21.15.137:42264) 2024-04-26T23:42:31.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.288+0000 7efbf7e00640 1 -- 172.21.15.137:0/2404164321 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efbf80b4100 msgr2=0x7efbf80d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:31.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.288+0000 7efbf7e00640 1 --2- 172.21.15.137:0/2404164321 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efbf80b4100 0x7efbf80d1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.288+0000 7efbf7e00640 1 -- 172.21.15.137:0/2404164321 >> v1:172.21.15.170:6789/0 conn(0x7efbf815f3d0 legacy=0x7efbf815f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:31.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.288+0000 7efbf7e00640 1 -- 172.21.15.137:0/2404164321 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbf8160520 con 0x7efbf80d2d80 2024-04-26T23:42:31.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.288+0000 7efbf6000640 1 -- 172.21.15.137:0/2404164321 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 118305737 0 0) 0x7efbf8160240 con 0x7efbf815f3d0 2024-04-26T23:42:31.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.288+0000 7efbf6a00640 1 --2- 172.21.15.137:0/2404164321 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efbf80b4100 0x7efbf80d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:42:31.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.292+0000 7efbf7e00640 1 --2- 172.21.15.137:0/2404164321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efbf80d2d80 0x7efbf80d31f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009e50 tx=0x7efbf001ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b769160c4aab8e70 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:31.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.292+0000 7efbf6000640 1 -- 172.21.15.137:0/2404164321 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf00a5810 con 0x7efbf80d2d80 2024-04-26T23:42:31.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.292+0000 7efbf6000640 1 -- 172.21.15.137:0/2404164321 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf00a59b0 con 0x7efbf80d2d80 2024-04-26T23:42:31.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.292+0000 7efbf6000640 1 -- 172.21.15.137:0/2404164321 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf00a5d80 con 0x7efbf80d2d80 2024-04-26T23:42:31.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.292+0000 7efbfe200640 1 -- 172.21.15.137:0/2404164321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efbf80d2d80 msgr2=0x7efbf80d31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:31.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.292+0000 7efbfe200640 1 --2- 172.21.15.137:0/2404164321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efbf80d2d80 0x7efbf80d31f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009e50 tx=0x7efbf001ca30 comp rx=0 tx=0).stop 2024-04-26T23:42:31.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.292+0000 7efbfe200640 1 -- 172.21.15.137:0/2404164321 shutdown_connections 2024-04-26T23:42:31.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.292+0000 7efbfe200640 1 --2- 172.21.15.137:0/2404164321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efbf80d2d80 0x7efbf80d31f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.292+0000 7efbfe200640 1 --2- 172.21.15.137:0/2404164321 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efbf80b4100 0x7efbf80d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.292+0000 7efbfe200640 1 -- 172.21.15.137:0/2404164321 >> 172.21.15.137:0/2404164321 conn(0x7efbf809ba60 msgr2=0x7efbf809be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:31.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.292+0000 7efbfe200640 1 -- 172.21.15.137:0/2404164321 shutdown_connections 2024-04-26T23:42:31.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.292+0000 7efbfe200640 1 -- 172.21.15.137:0/2404164321 wait complete. 2024-04-26T23:42:31.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbfe200640 1 Processor -- start 2024-04-26T23:42:31.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbfe200640 1 -- start start 2024-04-26T23:42:31.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbfe200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efbf80b4100 0x7efbf814cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbfe200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efbf80d2d80 0x7efbf814d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbfe200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efbf815f3d0 0x7efbf814dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbfe200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efbf80b39d0 con 0x7efbf80d2d80 2024-04-26T23:42:31.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbfe200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efbf80b3850 con 0x7efbf815f3d0 2024-04-26T23:42:31.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbfe200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7efbf80b3b50 con 0x7efbf80b4100 2024-04-26T23:42:31.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbf6a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efbf80d2d80 0x7efbf814d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbf6a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efbf80d2d80 0x7efbf814d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43066/0 (socket says 172.21.15.137:43066) 2024-04-26T23:42:31.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbf7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efbf815f3d0 0x7efbf814dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbf6a00640 1 -- 172.21.15.137:0/3659132604 learned_addr learned my addr 172.21.15.137:0/3659132604 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:31.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbf7400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efbf80b4100 0x7efbf814cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbf6a00640 1 -- 172.21.15.137:0/3659132604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efbf80b4100 msgr2=0x7efbf814cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:31.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbf6a00640 1 --2- 172.21.15.137:0/3659132604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efbf80b4100 0x7efbf814cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbf6a00640 1 -- 172.21.15.137:0/3659132604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efbf815f3d0 msgr2=0x7efbf814dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:31.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbf6a00640 1 --2- 172.21.15.137:0/3659132604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efbf815f3d0 0x7efbf814dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbf6a00640 1 -- 172.21.15.137:0/3659132604 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbf80b6bc0 con 0x7efbf80d2d80 2024-04-26T23:42:31.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbf6a00640 1 --2- 172.21.15.137:0/3659132604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efbf80d2d80 0x7efbf814d670 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efbe400e9e0 tx=0x7efbe400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:31.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbef400640 1 -- 172.21.15.137:0/3659132604 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe4017070 con 0x7efbf80d2d80 2024-04-26T23:42:31.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbef400640 1 -- 172.21.15.137:0/3659132604 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbe400c9d0 con 0x7efbf80d2d80 2024-04-26T23:42:31.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbfe200640 1 -- 172.21.15.137:0/3659132604 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efbf80b6ea0 con 0x7efbf80d2d80 2024-04-26T23:42:31.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.296+0000 7efbef400640 1 -- 172.21.15.137:0/3659132604 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe400cdc0 con 0x7efbf80d2d80 2024-04-26T23:42:31.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.300+0000 7efbfe200640 1 -- 172.21.15.137:0/3659132604 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efbf80c8480 con 0x7efbf80d2d80 2024-04-26T23:42:31.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.300+0000 7efbef400640 1 -- 172.21.15.137:0/3659132604 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efbe401a070 con 0x7efbf80d2d80 2024-04-26T23:42:31.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.300+0000 7efbef400640 1 --2- 172.21.15.137:0/3659132604 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efbd8068380 0x7efbd806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.300+0000 7efbef400640 1 -- 172.21.15.137:0/3659132604 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7efbe4086830 con 0x7efbf80d2d80 2024-04-26T23:42:31.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.300+0000 7efbf7400640 1 --2- 172.21.15.137:0/3659132604 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efbd8068380 0x7efbd806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.300+0000 7efc016de000 1 Processor -- start 2024-04-26T23:42:31.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.300+0000 7efc016de000 1 -- start start 2024-04-26T23:42:31.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.300+0000 7efbf7400640 1 --2- 172.21.15.137:0/3659132604 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efbd8068380 0x7efbd806a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efbe8007fd0 tx=0x7efbe8007d60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:31.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efc016de000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560ee4f51710 0x560ee4f51af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efc016de000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f52030 0x560ee4f08210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efc016de000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f08750 0x560ee4f08b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efc016de000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560ee4dc0150 con 0x560ee4f08750 2024-04-26T23:42:31.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efc016de000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560ee4d35e00 con 0x560ee4f52030 2024-04-26T23:42:31.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efc016de000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x560ee4ceea00 con 0x560ee4f51710 2024-04-26T23:42:31.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efbf7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f08750 0x560ee4f08b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efbf7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f08750 0x560ee4f08b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43068/0 (socket says 172.21.15.137:43068) 2024-04-26T23:42:31.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efbf7e00640 1 -- 172.21.15.137:0/1184320936 learned_addr learned my addr 172.21.15.137:0/1184320936 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:31.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efbf6a00640 1 --2- 172.21.15.137:0/1184320936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f52030 0x560ee4f08210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efbf7400640 1 --2- 172.21.15.137:0/1184320936 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560ee4f51710 0x560ee4f51af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efbf7e00640 1 -- 172.21.15.137:0/1184320936 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560ee4f51710 msgr2=0x560ee4f51af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:31.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efbf7e00640 1 --2- 172.21.15.137:0/1184320936 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560ee4f51710 0x560ee4f51af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efbf7e00640 1 -- 172.21.15.137:0/1184320936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f52030 msgr2=0x560ee4f08210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:31.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efbf7e00640 1 --2- 172.21.15.137:0/1184320936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f52030 0x560ee4f08210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efbf7e00640 1 -- 172.21.15.137:0/1184320936 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ee4cf30e0 con 0x560ee4f08750 2024-04-26T23:42:31.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efbf6a00640 1 --2- 172.21.15.137:0/1184320936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f52030 0x560ee4f08210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:42:31.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efbf7e00640 1 --2- 172.21.15.137:0/1184320936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f08750 0x560ee4f08b30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009e50 tx=0x7efbf0004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc080f42fa2c666 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:31.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efbe3e00640 1 -- 172.21.15.137:0/1184320936 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf00a5810 con 0x560ee4f08750 2024-04-26T23:42:31.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efbe3e00640 1 -- 172.21.15.137:0/1184320936 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf00a59b0 con 0x560ee4f08750 2024-04-26T23:42:31.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efbe3e00640 1 -- 172.21.15.137:0/1184320936 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf00a5d80 con 0x560ee4f08750 2024-04-26T23:42:31.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efc016de000 1 -- 172.21.15.137:0/1184320936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f08750 msgr2=0x560ee4f08b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:31.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efc016de000 1 --2- 172.21.15.137:0/1184320936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f08750 0x560ee4f08b30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009e50 tx=0x7efbf0004ac0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efc016de000 1 -- 172.21.15.137:0/1184320936 shutdown_connections 2024-04-26T23:42:31.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efc016de000 1 --2- 172.21.15.137:0/1184320936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f08750 0x560ee4f08b30 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efc016de000 1 --2- 172.21.15.137:0/1184320936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f52030 0x560ee4f08210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efc016de000 1 --2- 172.21.15.137:0/1184320936 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560ee4f51710 0x560ee4f51af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efc016de000 1 -- 172.21.15.137:0/1184320936 >> 172.21.15.137:0/1184320936 conn(0x560ee4f04700 msgr2=0x560ee4f06af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:31.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efc016de000 1 -- 172.21.15.137:0/1184320936 shutdown_connections 2024-04-26T23:42:31.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efc016de000 1 -- 172.21.15.137:0/1184320936 wait complete. 2024-04-26T23:42:31.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efc016de000 1 -- start start 2024-04-26T23:42:31.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.304+0000 7efc016de000 1 Processor -- start 2024-04-26T23:42:31.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efc016de000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f08750 0x560ee4f130b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efc016de000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560ee4f51710 0x560ee4f135f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efc016de000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f52030 0x560ee4f13b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efc016de000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560ee4d43200 con 0x560ee4f52030 2024-04-26T23:42:31.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efc016de000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560ee4cd9e80 con 0x560ee4f08750 2024-04-26T23:42:31.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efc016de000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x560ee4d30ae0 con 0x560ee4f51710 2024-04-26T23:42:31.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efc016de000 10 client.0 _ll_register_callbacks cb 0x560ee4d42da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:42:31.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efbf7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f52030 0x560ee4f13b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efbf6a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560ee4f51710 0x560ee4f135f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efbf7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f52030 0x560ee4f13b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43080/0 (socket says 172.21.15.137:43080) 2024-04-26T23:42:31.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efbf7e00640 1 -- 172.21.15.137:0/4021270730 learned_addr learned my addr 172.21.15.137:0/4021270730 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:31.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efbf7400640 1 --2- 172.21.15.137:0/4021270730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f08750 0x560ee4f130b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efbf7e00640 1 -- 172.21.15.137:0/4021270730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560ee4f51710 msgr2=0x560ee4f135f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:31.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efbf7e00640 1 --2- 172.21.15.137:0/4021270730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560ee4f51710 0x560ee4f135f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efbf7e00640 1 -- 172.21.15.137:0/4021270730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f08750 msgr2=0x560ee4f130b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:31.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efbf7e00640 1 --2- 172.21.15.137:0/4021270730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f08750 0x560ee4f130b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efbf7e00640 1 -- 172.21.15.137:0/4021270730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ee4cd54e0 con 0x560ee4f52030 2024-04-26T23:42:31.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efbf6a00640 1 --2- 172.21.15.137:0/4021270730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560ee4f51710 0x560ee4f135f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:42:31.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efbf7e00640 1 --2- 172.21.15.137:0/4021270730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f52030 0x560ee4f13b30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009e50 tx=0x7efbf001b270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e730e658db73d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:31.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efbe0c00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T23:42:31.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efbe0c00640 1 -- 172.21.15.137:0/4021270730 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf00039a0 con 0x560ee4f52030 2024-04-26T23:42:31.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efc016de000 1 -- 172.21.15.137:0/4021270730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efbf00a59b0 con 0x560ee4f52030 2024-04-26T23:42:31.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efbe0c00640 1 -- 172.21.15.137:0/4021270730 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7efbf0003b40 con 0x560ee4f52030 2024-04-26T23:42:31.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efbe0c00640 1 -- 172.21.15.137:0/4021270730 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7efbf0003d40 con 0x560ee4f52030 2024-04-26T23:42:31.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efc016de000 10 client.5427 fetch_fsmap learned FSMap version 17 2024-04-26T23:42:31.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efc016de000 1 -- 172.21.15.137:0/4021270730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x560ee4cbbe80 con 0x560ee4f52030 2024-04-26T23:42:31.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efbe0c00640 1 -- 172.21.15.137:0/4021270730 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf00a59b0 con 0x560ee4f52030 2024-04-26T23:42:31.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efbe0c00640 1 -- 172.21.15.137:0/4021270730 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7efbf0008040 con 0x560ee4f52030 2024-04-26T23:42:31.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efc016de000 10 client.5427 fetch_fsmap finished waiting for FSMap version 17 2024-04-26T23:42:31.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efc016de000 10 client.5427 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-26T23:42:31.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efc016de000 20 client.5427 populate_metadata read hostname 'smithi137' 2024-04-26T23:42:31.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efc016de000 1 --2- 172.21.15.137:0/4021270730 >> [v2:172.21.15.170:6833/3364296586,v1:172.21.15.170:6835/3364296586] conn(0x560ee4f14540 0x560ee4f637c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efc016de000 4 client.5427 mds_command: new command op to 34808 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T23:42:31.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efc016de000 1 -- 172.21.15.137:0/4021270730 --> [v2:172.21.15.170:6833/3364296586,v1:172.21.15.170:6835/3364296586] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ee4ccebc0 con 0x560ee4f14540 2024-04-26T23:42:31.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efbf7400640 1 --2- 172.21.15.137:0/4021270730 >> [v2:172.21.15.170:6833/3364296586,v1:172.21.15.170:6835/3364296586] conn(0x560ee4f14540 0x560ee4f637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efbf7400640 1 --2- 172.21.15.137:0/4021270730 >> [v2:172.21.15.170:6833/3364296586,v1:172.21.15.170:6835/3364296586] conn(0x560ee4f14540 0x560ee4f637c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a41fc92bb54d69 server_cookie=6b4bdcddd5f5287a in_seq=0 out_seq=0 2024-04-26T23:42:31.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.308+0000 7efbe0c00640 10 client.5427 ms_handle_connect on v2:172.21.15.170:6833/3364296586 2024-04-26T23:42:31.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.312+0000 7efbe0c00640 1 -- 172.21.15.137:0/4021270730 <== mds.0 v2:172.21.15.170:6833/3364296586 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560ee4ccebc0 con 0x560ee4f14540 2024-04-26T23:42:31.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.312+0000 7efbe0c00640 10 client.5427 handle_command_reply: tid=0 2024-04-26T23:42:31.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.312+0000 7efc016de000 1 client.5427 shutdown 2024-04-26T23:42:31.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.312+0000 7efc016de000 1 -- 172.21.15.137:0/4021270730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f52030 msgr2=0x560ee4f13b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:31.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.312+0000 7efc016de000 1 --2- 172.21.15.137:0/4021270730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f52030 0x560ee4f13b30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009e50 tx=0x7efbf001b270 comp rx=0 tx=0).stop 2024-04-26T23:42:31.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.312+0000 7efc016de000 1 -- 172.21.15.137:0/4021270730 shutdown_connections 2024-04-26T23:42:31.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.312+0000 7efc016de000 1 --2- 172.21.15.137:0/4021270730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f52030 0x560ee4f13b30 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.312+0000 7efc016de000 1 --2- 172.21.15.137:0/4021270730 >> [v2:172.21.15.170:6833/3364296586,v1:172.21.15.170:6835/3364296586] conn(0x560ee4f14540 0x560ee4f637c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.312+0000 7efc016de000 1 --2- 172.21.15.137:0/4021270730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560ee4f51710 0x560ee4f135f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.312+0000 7efc016de000 1 --2- 172.21.15.137:0/4021270730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f08750 0x560ee4f130b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.312+0000 7efbe0c00640 0 client.5427 ms_handle_reset on v2:172.21.15.170:6833/3364296586 2024-04-26T23:42:31.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.312+0000 7efc016de000 1 -- 172.21.15.137:0/4021270730 >> 172.21.15.137:0/4021270730 conn(0x560ee4f04700 msgr2=0x560ee4f07380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:31.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.312+0000 7efc016de000 1 -- 172.21.15.137:0/4021270730 shutdown_connections 2024-04-26T23:42:31.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.312+0000 7efc016de000 1 -- 172.21.15.137:0/4021270730 wait complete. 2024-04-26T23:42:31.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.312+0000 7efc016de000 20 client.5427 trim_cache size 0 max 16384 2024-04-26T23:42:31.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.328+0000 7efc016de000 1 Processor -- start 2024-04-26T23:42:31.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.328+0000 7efc016de000 1 -- start start 2024-04-26T23:42:31.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560ee4f08750 0x560ee4f66a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f51710 0x560ee4f07b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f52030 0x560ee4f08040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efbf8203390 con 0x560ee4f52030 2024-04-26T23:42:31.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efbf82026f0 con 0x560ee4f51710 2024-04-26T23:42:31.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7efbf8202d40 con 0x560ee4f08750 2024-04-26T23:42:31.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efbf7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f52030 0x560ee4f08040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efbf7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f52030 0x560ee4f08040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43090/0 (socket says 172.21.15.137:43090) 2024-04-26T23:42:31.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efbf7e00640 1 -- 172.21.15.137:0/2384169248 learned_addr learned my addr 172.21.15.137:0/2384169248 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:31.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efbf7400640 1 --2- 172.21.15.137:0/2384169248 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560ee4f08750 0x560ee4f66a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efbf6a00640 1 --2- 172.21.15.137:0/2384169248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f51710 0x560ee4f07b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efbf7e00640 1 -- 172.21.15.137:0/2384169248 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560ee4f08750 msgr2=0x560ee4f66a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:31.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efbf7e00640 1 --2- 172.21.15.137:0/2384169248 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560ee4f08750 0x560ee4f66a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efbf7e00640 1 -- 172.21.15.137:0/2384169248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f51710 msgr2=0x560ee4f07b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:31.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efbf7e00640 1 --2- 172.21.15.137:0/2384169248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f51710 0x560ee4f07b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efbf7e00640 1 -- 172.21.15.137:0/2384169248 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ee4ceec50 con 0x560ee4f52030 2024-04-26T23:42:31.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efbf6a00640 1 --2- 172.21.15.137:0/2384169248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f51710 0x560ee4f07b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:31.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efbf7e00640 1 --2- 172.21.15.137:0/2384169248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f52030 0x560ee4f08040 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7efbf001d2d0 tx=0x7efbf00c5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4e5144ae3d3d5d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:31.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efbe3400640 1 -- 172.21.15.137:0/2384169248 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf00039a0 con 0x560ee4f52030 2024-04-26T23:42:31.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efbe3400640 1 -- 172.21.15.137:0/2384169248 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf00d5070 con 0x560ee4f52030 2024-04-26T23:42:31.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efbe3400640 1 -- 172.21.15.137:0/2384169248 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf00042d0 con 0x560ee4f52030 2024-04-26T23:42:31.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 -- 172.21.15.137:0/2384169248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f52030 msgr2=0x560ee4f08040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:31.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 --2- 172.21.15.137:0/2384169248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f52030 0x560ee4f08040 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7efbf001d2d0 tx=0x7efbf00c5000 comp rx=0 tx=0).stop 2024-04-26T23:42:31.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 -- 172.21.15.137:0/2384169248 shutdown_connections 2024-04-26T23:42:31.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 --2- 172.21.15.137:0/2384169248 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f52030 0x560ee4f08040 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 --2- 172.21.15.137:0/2384169248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f51710 0x560ee4f07b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 --2- 172.21.15.137:0/2384169248 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560ee4f08750 0x560ee4f66a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 -- 172.21.15.137:0/2384169248 >> 172.21.15.137:0/2384169248 conn(0x560ee4f04700 msgr2=0x560ee4f5e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:31.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 -- 172.21.15.137:0/2384169248 shutdown_connections 2024-04-26T23:42:31.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 -- 172.21.15.137:0/2384169248 wait complete. 2024-04-26T23:42:31.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 -- start start 2024-04-26T23:42:31.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 Processor -- start 2024-04-26T23:42:31.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f08750 0x560ee4f66330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f51710 0x560ee4f7d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560ee4f52030 0x560ee4f7d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560ee4d35110 con 0x560ee4f08750 2024-04-26T23:42:31.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560ee4ccb7b0 con 0x560ee4f51710 2024-04-26T23:42:31.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x560ee4d3a430 con 0x560ee4f52030 2024-04-26T23:42:31.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.332+0000 7efc016de000 10 client.0 _ll_register_callbacks cb 0x7efbf00ba050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:42:31.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbf7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f08750 0x560ee4f66330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbf7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f08750 0x560ee4f66330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43100/0 (socket says 172.21.15.137:43100) 2024-04-26T23:42:31.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbf7400640 1 -- 172.21.15.137:0/3297920957 learned_addr learned my addr 172.21.15.137:0/3297920957 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:31.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbf6a00640 1 --2- 172.21.15.137:0/3297920957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f51710 0x560ee4f7d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbf7e00640 1 --2- 172.21.15.137:0/3297920957 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560ee4f52030 0x560ee4f7d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbf7400640 1 -- 172.21.15.137:0/3297920957 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560ee4f52030 msgr2=0x560ee4f7d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:31.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbf7400640 1 --2- 172.21.15.137:0/3297920957 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560ee4f52030 0x560ee4f7d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbf7400640 1 -- 172.21.15.137:0/3297920957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f51710 msgr2=0x560ee4f7d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:31.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbf7400640 1 --2- 172.21.15.137:0/3297920957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f51710 0x560ee4f7d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbf7400640 1 -- 172.21.15.137:0/3297920957 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ee4dd8170 con 0x560ee4f08750 2024-04-26T23:42:31.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbf6a00640 1 --2- 172.21.15.137:0/3297920957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f51710 0x560ee4f7d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:31.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbf7400640 1 --2- 172.21.15.137:0/3297920957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f08750 0x560ee4f66330 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efbe8007ab0 tx=0x7efbe8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a48a6fb26a7107 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:31.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbe0c00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T23:42:31.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbe0c00640 1 -- 172.21.15.137:0/3297920957 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe80297a0 con 0x560ee4f08750 2024-04-26T23:42:31.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbe0c00640 1 -- 172.21.15.137:0/3297920957 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7efbe80223f0 con 0x560ee4f08750 2024-04-26T23:42:31.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efc016de000 1 -- 172.21.15.137:0/3297920957 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efbf00d5070 con 0x560ee4f08750 2024-04-26T23:42:31.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbe0c00640 1 -- 172.21.15.137:0/3297920957 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7efbe8035050 con 0x560ee4f08750 2024-04-26T23:42:31.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efc016de000 10 client.5433 fetch_fsmap learned FSMap version 17 2024-04-26T23:42:31.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efc016de000 1 -- 172.21.15.137:0/3297920957 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x560ee49ef0c0 con 0x560ee4f08750 2024-04-26T23:42:31.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbe0c00640 1 -- 172.21.15.137:0/3297920957 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf00d5070 con 0x560ee4f08750 2024-04-26T23:42:31.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbe0c00640 1 -- 172.21.15.137:0/3297920957 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7efbe8038020 con 0x560ee4f08750 2024-04-26T23:42:31.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efc016de000 10 client.5433 fetch_fsmap finished waiting for FSMap version 17 2024-04-26T23:42:31.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efc016de000 10 client.5433 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-26T23:42:31.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efc016de000 20 client.5433 populate_metadata read hostname 'smithi137' 2024-04-26T23:42:31.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efc016de000 1 --2- 172.21.15.137:0/3297920957 >> [v2:172.21.15.170:6833/3364296586,v1:172.21.15.170:6835/3364296586] conn(0x560ee4fc0780 0x560ee4fc0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efc016de000 4 client.5433 mds_command: new command op to 34808 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T23:42:31.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efc016de000 1 -- 172.21.15.137:0/3297920957 --> [v2:172.21.15.170:6833/3364296586,v1:172.21.15.170:6835/3364296586] -- command(tid 0: {"prefix": "status"}) -- 0x560ee4d43a10 con 0x560ee4fc0780 2024-04-26T23:42:31.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbf6a00640 1 --2- 172.21.15.137:0/3297920957 >> [v2:172.21.15.170:6833/3364296586,v1:172.21.15.170:6835/3364296586] conn(0x560ee4fc0780 0x560ee4fc0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbf6a00640 1 --2- 172.21.15.137:0/3297920957 >> [v2:172.21.15.170:6833/3364296586,v1:172.21.15.170:6835/3364296586] conn(0x560ee4fc0780 0x560ee4fc0b60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=234ca9646ed7ca69 server_cookie=d1436d487e6d1799 in_seq=0 out_seq=0 2024-04-26T23:42:31.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbe0c00640 10 client.5433 ms_handle_connect on v2:172.21.15.170:6833/3364296586 2024-04-26T23:42:31.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbe0c00640 1 -- 172.21.15.137:0/3297920957 <== mds.0 v2:172.21.15.170:6833/3364296586 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560ee4d43a10 con 0x560ee4fc0780 2024-04-26T23:42:31.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbe0c00640 10 client.5433 handle_command_reply: tid=0 2024-04-26T23:42:31.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efc016de000 1 client.5433 shutdown 2024-04-26T23:42:31.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efc016de000 1 -- 172.21.15.137:0/3297920957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f08750 msgr2=0x560ee4f66330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:31.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efc016de000 1 --2- 172.21.15.137:0/3297920957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f08750 0x560ee4f66330 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efbe8007ab0 tx=0x7efbe8000ee0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efc016de000 1 -- 172.21.15.137:0/3297920957 shutdown_connections 2024-04-26T23:42:31.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efc016de000 1 --2- 172.21.15.137:0/3297920957 >> [v2:172.21.15.170:6833/3364296586,v1:172.21.15.170:6835/3364296586] conn(0x560ee4fc0780 0x560ee4fc0b60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efc016de000 1 --2- 172.21.15.137:0/3297920957 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560ee4f52030 0x560ee4f7d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efc016de000 1 --2- 172.21.15.137:0/3297920957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560ee4f51710 0x560ee4f7d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbe0c00640 0 client.5433 ms_handle_reset on v2:172.21.15.170:6833/3364296586 2024-04-26T23:42:31.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efc016de000 1 --2- 172.21.15.137:0/3297920957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560ee4f08750 0x560ee4f66330 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efc016de000 1 -- 172.21.15.137:0/3297920957 >> 172.21.15.137:0/3297920957 conn(0x560ee4f04700 msgr2=0x560ee4f5ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:31.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efc016de000 1 -- 172.21.15.137:0/3297920957 shutdown_connections 2024-04-26T23:42:31.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efc016de000 1 -- 172.21.15.137:0/3297920957 wait complete. 2024-04-26T23:42:31.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efc016de000 20 client.5433 trim_cache size 0 max 16384 2024-04-26T23:42:31.347 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:42:31.347 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "efde6204-be0d-4c4f-9ea0-954d26627e78", 2024-04-26T23:42:31.347 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 0, 2024-04-26T23:42:31.347 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 34808, 2024-04-26T23:42:31.347 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-26T23:42:31.347 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-26T23:42:31.347 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-26T23:42:31.347 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 5.8697808299999998, 2024-04-26T23:42:31.347 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 17, 2024-04-26T23:42:31.348 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 33, 2024-04-26T23:42:31.348 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 33, 2024-04-26T23:42:31.348 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 13.727913149999999 2024-04-26T23:42:31.348 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:42:31.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbfe200640 1 -- 172.21.15.137:0/3659132604 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efbd8068380 msgr2=0x7efbd806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:31.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbfe200640 1 --2- 172.21.15.137:0/3659132604 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efbd8068380 0x7efbd806a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efbe8007fd0 tx=0x7efbe8007d60 comp rx=0 tx=0).stop 2024-04-26T23:42:31.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbfe200640 1 -- 172.21.15.137:0/3659132604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efbf80d2d80 msgr2=0x7efbf814d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:31.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbfe200640 1 --2- 172.21.15.137:0/3659132604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efbf80d2d80 0x7efbf814d670 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efbe400e9e0 tx=0x7efbe400eea0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbfe200640 1 -- 172.21.15.137:0/3659132604 shutdown_connections 2024-04-26T23:42:31.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbfe200640 1 --2- 172.21.15.137:0/3659132604 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efbd8068380 0x7efbd806a840 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbfe200640 1 --2- 172.21.15.137:0/3659132604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efbf80d2d80 0x7efbf814d670 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbfe200640 1 --2- 172.21.15.137:0/3659132604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efbf815f3d0 0x7efbf814dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.336+0000 7efbfe200640 1 --2- 172.21.15.137:0/3659132604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efbf80b4100 0x7efbf814cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.340+0000 7efbfe200640 1 -- 172.21.15.137:0/3659132604 >> 172.21.15.137:0/3659132604 conn(0x7efbf809ba60 msgr2=0x7efbf80b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:31.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.340+0000 7efbfe200640 1 -- 172.21.15.137:0/3659132604 shutdown_connections 2024-04-26T23:42:31.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.340+0000 7efbfe200640 1 -- 172.21.15.137:0/3659132604 wait complete. 2024-04-26T23:42:31.363 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:42:31.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.492+0000 7f9ba8e00640 1 Processor -- start 2024-04-26T23:42:31.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.492+0000 7f9ba8e00640 1 -- start start 2024-04-26T23:42:31.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.496+0000 7f9ba8e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9ba40725a0 0x7f9ba40cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.496+0000 7f9ba8e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ba4073f30 0x7f9ba4072980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.496+0000 7f9ba8e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9ba4072ec0 0x7f9ba40b4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.496+0000 7f9ba8e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f9ba40cfef0 con 0x7f9ba4072ec0 2024-04-26T23:42:31.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.496+0000 7f9ba8e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f9ba40cddc0 con 0x7f9ba40725a0 2024-04-26T23:42:31.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.496+0000 7f9ba8e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba40d01b0 con 0x7f9ba4073f30 2024-04-26T23:42:31.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.496+0000 7f9ba2800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9ba4072ec0 0x7f9ba40b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.496+0000 7f9ba2800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9ba4072ec0 0x7f9ba40b4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43110/0 (socket says 172.21.15.137:43110) 2024-04-26T23:42:31.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.496+0000 7f9ba2800640 1 -- 172.21.15.137:0/2138089729 learned_addr learned my addr 172.21.15.137:0/2138089729 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:31.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.496+0000 7f9ba1e00640 1 --2- 172.21.15.137:0/2138089729 >> v2:172.21.15.170:3300/0 conn(0x7f9ba40725a0 0x7f9ba40cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.496+0000 7f9b99400640 1 --2- 172.21.15.137:0/2138089729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ba4073f30 0x7f9ba4072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.496+0000 7f9ba2800640 1 -- 172.21.15.137:0/2138089729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ba4073f30 msgr2=0x7f9ba4072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:31.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.496+0000 7f9ba2800640 1 --2- 172.21.15.137:0/2138089729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ba4073f30 0x7f9ba4072980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.496+0000 7f9ba2800640 1 -- 172.21.15.137:0/2138089729 >> v2:172.21.15.170:3300/0 conn(0x7f9ba40725a0 msgr2=0x7f9ba40cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:31.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.496+0000 7f9ba2800640 1 --2- 172.21.15.137:0/2138089729 >> v2:172.21.15.170:3300/0 conn(0x7f9ba40725a0 0x7f9ba40cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.496+0000 7f9ba2800640 1 -- 172.21.15.137:0/2138089729 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba40d0490 con 0x7f9ba4072ec0 2024-04-26T23:42:31.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.496+0000 7f9b99400640 1 --2- 172.21.15.137:0/2138089729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ba4073f30 0x7f9ba4072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:31.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.496+0000 7f9ba1e00640 1 --2- 172.21.15.137:0/2138089729 >> v2:172.21.15.170:3300/0 conn(0x7f9ba40725a0 0x7f9ba40cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:31.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba2800640 1 --2- 172.21.15.137:0/2138089729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ba4072ec0 0x7f9ba40b4070 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9ba406ffc0 tx=0x7f9b9c01ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e0e5941c80d8c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:31.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba1400640 1 -- 172.21.15.137:0/2138089729 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c00b2d0 con 0x7f9ba4072ec0 2024-04-26T23:42:31.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba1400640 1 -- 172.21.15.137:0/2138089729 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b9c00b470 con 0x7f9ba4072ec0 2024-04-26T23:42:31.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba1400640 1 -- 172.21.15.137:0/2138089729 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c0a7c90 con 0x7f9ba4072ec0 2024-04-26T23:42:31.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba8e00640 1 -- 172.21.15.137:0/2138089729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ba4072ec0 msgr2=0x7f9ba40b4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:31.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba8e00640 1 --2- 172.21.15.137:0/2138089729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ba4072ec0 0x7f9ba40b4070 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9ba406ffc0 tx=0x7f9b9c01ebc0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba8e00640 1 -- 172.21.15.137:0/2138089729 shutdown_connections 2024-04-26T23:42:31.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba8e00640 1 --2- 172.21.15.137:0/2138089729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ba4072ec0 0x7f9ba40b4070 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba8e00640 1 --2- 172.21.15.137:0/2138089729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ba4073f30 0x7f9ba4072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba8e00640 1 --2- 172.21.15.137:0/2138089729 >> v2:172.21.15.170:3300/0 conn(0x7f9ba40725a0 0x7f9ba40cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba8e00640 1 -- 172.21.15.137:0/2138089729 >> 172.21.15.137:0/2138089729 conn(0x7f9ba406c5d0 msgr2=0x7f9ba406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:31.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba8e00640 1 -- 172.21.15.137:0/2138089729 shutdown_connections 2024-04-26T23:42:31.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba8e00640 1 -- 172.21.15.137:0/2138089729 wait complete. 2024-04-26T23:42:31.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba8e00640 1 Processor -- start 2024-04-26T23:42:31.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba8e00640 1 -- start start 2024-04-26T23:42:31.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba8e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ba40725a0 0x7f9ba415ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba8e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ba4072ec0 0x7f9ba413c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba8e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ba4073f30 0x7f9ba41336f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba8e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba40b4f40 con 0x7f9ba4073f30 2024-04-26T23:42:31.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba8e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba40b4dc0 con 0x7f9ba40725a0 2024-04-26T23:42:31.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba8e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba40b50c0 con 0x7f9ba4072ec0 2024-04-26T23:42:31.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ba4073f30 0x7f9ba41336f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ba4073f30 0x7f9ba41336f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43114/0 (socket says 172.21.15.137:43114) 2024-04-26T23:42:31.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.500+0000 7f9ba2800640 1 -- 172.21.15.137:0/491465482 learned_addr learned my addr 172.21.15.137:0/491465482 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:31.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.504+0000 7f9b99400640 1 --2- 172.21.15.137:0/491465482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ba4072ec0 0x7f9ba413c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.504+0000 7f9ba1e00640 1 --2- 172.21.15.137:0/491465482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ba40725a0 0x7f9ba415ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.504+0000 7f9ba2800640 1 -- 172.21.15.137:0/491465482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ba4072ec0 msgr2=0x7f9ba413c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:31.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.504+0000 7f9ba2800640 1 --2- 172.21.15.137:0/491465482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ba4072ec0 0x7f9ba413c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.504+0000 7f9ba2800640 1 -- 172.21.15.137:0/491465482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ba40725a0 msgr2=0x7f9ba415ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:31.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.504+0000 7f9ba2800640 1 --2- 172.21.15.137:0/491465482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ba40725a0 0x7f9ba415ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.504+0000 7f9ba2800640 1 -- 172.21.15.137:0/491465482 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba413ba90 con 0x7f9ba4073f30 2024-04-26T23:42:31.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.504+0000 7f9ba1e00640 1 --2- 172.21.15.137:0/491465482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ba40725a0 0x7f9ba415ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:31.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.504+0000 7f9ba2800640 1 --2- 172.21.15.137:0/491465482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ba4073f30 0x7f9ba41336f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0b1040 tx=0x7f9b9c01b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:31.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.504+0000 7f9b9aa00640 1 -- 172.21.15.137:0/491465482 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c009600 con 0x7f9ba4073f30 2024-04-26T23:42:31.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.504+0000 7f9b9aa00640 1 -- 172.21.15.137:0/491465482 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b9c0097c0 con 0x7f9ba4073f30 2024-04-26T23:42:31.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.504+0000 7f9b9aa00640 1 -- 172.21.15.137:0/491465482 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c009bb0 con 0x7f9ba4073f30 2024-04-26T23:42:31.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.504+0000 7f9ba8e00640 1 -- 172.21.15.137:0/491465482 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba415b380 con 0x7f9ba4073f30 2024-04-26T23:42:31.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.504+0000 7f9ba8e00640 1 -- 172.21.15.137:0/491465482 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba413c010 con 0x7f9ba4073f30 2024-04-26T23:42:31.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.504+0000 7f9ba8e00640 1 -- 172.21.15.137:0/491465482 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba406a4b0 con 0x7f9ba4073f30 2024-04-26T23:42:31.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.504+0000 7f9b9aa00640 1 -- 172.21.15.137:0/491465482 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9b9c0c0030 con 0x7f9ba4073f30 2024-04-26T23:42:31.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.504+0000 7f9b9aa00640 1 --2- 172.21.15.137:0/491465482 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b80068380 0x7f9b8006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:31.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.504+0000 7f9b9aa00640 1 -- 172.21.15.137:0/491465482 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f9b9c121870 con 0x7f9ba4073f30 2024-04-26T23:42:31.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.504+0000 7f9ba1e00640 1 --2- 172.21.15.137:0/491465482 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b80068380 0x7f9b8006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:31.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.508+0000 7f9ba1e00640 1 --2- 172.21.15.137:0/491465482 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b80068380 0x7f9b8006a840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400ba50 tx=0x7f9b94008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:31.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.512+0000 7f9b9aa00640 1 -- 172.21.15.137:0/491465482 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9b9c0c7020 con 0x7f9ba4073f30 2024-04-26T23:42:31.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.704+0000 7f9ba8e00640 1 -- 172.21.15.137:0/491465482 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9ba41434f0 con 0x7f9ba4073f30 2024-04-26T23:42:31.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.704+0000 7f9b9aa00640 1 -- 172.21.15.137:0/491465482 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f9b9c0187e0 con 0x7f9ba4073f30 2024-04-26T23:42:31.711 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:42:31.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.708+0000 7f9ba8e00640 1 -- 172.21.15.137:0/491465482 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b80068380 msgr2=0x7f9b8006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:31.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.708+0000 7f9ba8e00640 1 --2- 172.21.15.137:0/491465482 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b80068380 0x7f9b8006a840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400ba50 tx=0x7f9b94008040 comp rx=0 tx=0).stop 2024-04-26T23:42:31.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.708+0000 7f9ba8e00640 1 -- 172.21.15.137:0/491465482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ba4073f30 msgr2=0x7f9ba41336f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:31.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.708+0000 7f9ba8e00640 1 --2- 172.21.15.137:0/491465482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ba4073f30 0x7f9ba41336f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0b1040 tx=0x7f9b9c01b960 comp rx=0 tx=0).stop 2024-04-26T23:42:31.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.708+0000 7f9ba8e00640 1 -- 172.21.15.137:0/491465482 shutdown_connections 2024-04-26T23:42:31.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.708+0000 7f9ba8e00640 1 --2- 172.21.15.137:0/491465482 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b80068380 0x7f9b8006a840 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.708+0000 7f9ba8e00640 1 --2- 172.21.15.137:0/491465482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ba4073f30 0x7f9ba41336f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.708+0000 7f9ba8e00640 1 --2- 172.21.15.137:0/491465482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ba4072ec0 0x7f9ba413c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.708+0000 7f9ba8e00640 1 --2- 172.21.15.137:0/491465482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ba40725a0 0x7f9ba415ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:31.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.708+0000 7f9ba8e00640 1 -- 172.21.15.137:0/491465482 >> 172.21.15.137:0/491465482 conn(0x7f9ba406c5d0 msgr2=0x7f9ba413fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:31.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.708+0000 7f9ba8e00640 1 -- 172.21.15.137:0/491465482 shutdown_connections 2024-04-26T23:42:31.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31.708+0000 7f9ba8e00640 1 -- 172.21.15.137:0/491465482 wait complete. 2024-04-26T23:42:31.731 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:42:31.731 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:42:31.731 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T23:42:31.731 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T23:42:31.731 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T23:42:31.731 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:42:31.731 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:42:31.731 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:42:31.731 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:42:31.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:31.732 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T23:42:31.740 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:42:31.740 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:42:31.741 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:42:31.741 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:31.741 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T23:42:31.741 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:31.741 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:42:31.741 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T23:42:31.741 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T23:42:31.741 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:42:31.741 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T23:42:31.741 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T23:42:31.741 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:42:31.741 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:42:31.741 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:42:31.741 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:42:31.742 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:42:31.742 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42411sec preferred_lft 42411sec 2024-04-26T23:42:31.742 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link 2024-04-26T23:42:31.742 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:31.742 INFO:teuthology.orchestra.run.smithi137.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:42:31.742 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 02:42:f4:6f:af:56 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:42:31.742 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:42:31.742 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:31.742 INFO:teuthology.orchestra.run.smithi137.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:42:31.742 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:42:31.742 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:42:31.742 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:31.742 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T23:42:31.742 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:31.743 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:42:31.743 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:42:31.743 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:42:31.743 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:31.743 INFO:teuthology.orchestra.run.smithi137.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:42:31.743 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:42:31.743 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-26T23:42:31.743 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:31.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:31.744 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:42:31.804 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T23:42:31.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:31.807 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T23:42:31.859 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T23:42:31.859 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:42:31.859 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:42:31.859 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:42:31.859 INFO:teuthology.orchestra.run.smithi137.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:42:31.859 INFO:teuthology.orchestra.run.smithi137.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:42:31.859 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:42:31.859 INFO:teuthology.orchestra.run.smithi137.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:42:31.859 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:42:31.859 INFO:teuthology.orchestra.run.smithi137.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:42:31.859 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:42:31.860 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:42:31.860 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T23:42:31.860 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:42:31.860 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:42:31.860 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:42:31.860 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T23:42:31.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:42:31.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:42:31.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:31.993 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T23:42:32.002 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T23:42:32.003 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T23:42:32.003 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:42:32.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:32.003 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-26T23:42:32.062 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-26T23:42:32.063 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:42:32.063 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T23:42:32.115 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:42:32.115 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:42:32.115 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:42:32.162 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-26T23:42:32.223 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:42:32.272 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-26T23:42:32.272 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-26T23:42:32.272 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-26T23:42:32.272 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-26T23:42:32.272 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-26T23:42:32.273 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-26T23:42:32.273 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-26T23:42:32.273 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-26T23:42:32.273 INFO:teuthology.orchestra.run.smithi137.stdout:/run/lock 2024-04-26T23:42:32.273 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-26T23:42:32.273 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-26T23:42:32.273 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-26T23:42:32.273 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:42:32.273 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-26T23:42:32.273 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-26T23:42:32.273 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-26T23:42:32.273 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-26T23:42:32.273 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/fs/nfsd 2024-04-26T23:42:32.273 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-26T23:42:32.273 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-26T23:42:32.274 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:42:32.274 INFO:teuthology.orchestra.run.smithi137.stdout:/run/rpc_pipefs 2024-04-26T23:42:32.274 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-26T23:42:32.274 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-26T23:42:32.274 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:42:32.274 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:42:32.274 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:42:32.274 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:42:32.274 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-26T23:42:32.274 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:42:32.274 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:42:32.274 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:42:32.274 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:42:32.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:32.275 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-26T23:42:32.327 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T23:42:32.327 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-26T23:42:32.370 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-26T23:42:32.390 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:42:32.440 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-26T23:42:32.441 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-26T23:42:32.441 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-26T23:42:32.441 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-26T23:42:32.441 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-26T23:42:32.441 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-26T23:42:32.441 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-26T23:42:32.441 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-26T23:42:32.441 INFO:teuthology.orchestra.run.smithi137.stdout:/run/lock 2024-04-26T23:42:32.441 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-26T23:42:32.441 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-26T23:42:32.441 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-26T23:42:32.441 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:42:32.441 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-26T23:42:32.442 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-26T23:42:32.442 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-26T23:42:32.442 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-26T23:42:32.442 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/fs/nfsd 2024-04-26T23:42:32.442 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-26T23:42:32.442 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-26T23:42:32.442 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:42:32.442 INFO:teuthology.orchestra.run.smithi137.stdout:/run/rpc_pipefs 2024-04-26T23:42:32.442 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-26T23:42:32.442 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-26T23:42:32.442 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:42:32.442 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:42:32.442 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:42:32.442 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:42:32.443 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-26T23:42:32.443 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:42:32.443 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:42:32.443 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:42:32.443 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:42:32.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:32.444 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-26T23:42:32.462 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:2024-04-26T23:42:32.456+0000 7fb0b2248580 -1 init, newargv = 0x562d11f859c0 newargc=15 2024-04-26T23:42:32.463 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:ceph-fuse[37875]: starting ceph client 2024-04-26T23:42:32.470 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:ceph-fuse[37875]: starting fuse 2024-04-26T23:42:32.472 INFO:teuthology.orchestra.run.smithi137.stdout:44 2024-04-26T23:42:32.472 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T23:42:32.472 DEBUG:teuthology.orchestra.run.smithi137:> sudo stdin-killer -- python3 -c ' 2024-04-26T23:42:32.473 DEBUG:teuthology.orchestra.run.smithi137:> import glob 2024-04-26T23:42:32.473 DEBUG:teuthology.orchestra.run.smithi137:> import re 2024-04-26T23:42:32.473 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T23:42:32.473 DEBUG:teuthology.orchestra.run.smithi137:> import subprocess 2024-04-26T23:42:32.473 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:42:32.473 DEBUG:teuthology.orchestra.run.smithi137:> def _find_admin_socket(client_name): 2024-04-26T23:42:32.473 DEBUG:teuthology.orchestra.run.smithi137:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T23:42:32.473 DEBUG:teuthology.orchestra.run.smithi137:> files = glob.glob(asok_path) 2024-04-26T23:42:32.473 DEBUG:teuthology.orchestra.run.smithi137:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T23:42:32.473 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:42:32.473 DEBUG:teuthology.orchestra.run.smithi137:> # Given a non-glob path, it better be there 2024-04-26T23:42:32.473 DEBUG:teuthology.orchestra.run.smithi137:> if "*" not in asok_path: 2024-04-26T23:42:32.473 DEBUG:teuthology.orchestra.run.smithi137:> assert(len(files) == 1) 2024-04-26T23:42:32.473 DEBUG:teuthology.orchestra.run.smithi137:> return files[0] 2024-04-26T23:42:32.473 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:42:32.473 DEBUG:teuthology.orchestra.run.smithi137:> for f in files: 2024-04-26T23:42:32.473 DEBUG:teuthology.orchestra.run.smithi137:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T23:42:32.473 DEBUG:teuthology.orchestra.run.smithi137:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T23:42:32.474 DEBUG:teuthology.orchestra.run.smithi137:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T23:42:32.474 DEBUG:teuthology.orchestra.run.smithi137:> contents = proc_f.read() 2024-04-26T23:42:32.474 DEBUG:teuthology.orchestra.run.smithi137:> if mountpoint in contents: 2024-04-26T23:42:32.474 DEBUG:teuthology.orchestra.run.smithi137:> return f 2024-04-26T23:42:32.474 DEBUG:teuthology.orchestra.run.smithi137:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T23:42:32.474 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:42:32.474 DEBUG:teuthology.orchestra.run.smithi137:> print(_find_admin_socket("client.0")) 2024-04-26T23:42:32.474 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T23:42:32.595 INFO:teuthology.orchestra.run.smithi137.stdout:/var/run/ceph/ceph-client.0.37875.asok 2024-04-26T23:42:32.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:42:32.606 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37875.asok 2024-04-26T23:42:32.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:32.607 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37875.asok status 2024-04-26T23:42:32.778 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:42:32.778 INFO:teuthology.orchestra.run.smithi137.stdout: "metadata": { 2024-04-26T23:42:32.779 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T23:42:32.779 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T23:42:32.779 INFO:teuthology.orchestra.run.smithi137.stdout: "entity_id": "0", 2024-04-26T23:42:32.779 INFO:teuthology.orchestra.run.smithi137.stdout: "hostname": "smithi137", 2024-04-26T23:42:32.779 INFO:teuthology.orchestra.run.smithi137.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-26T23:42:32.779 INFO:teuthology.orchestra.run.smithi137.stdout: "pid": "37875", 2024-04-26T23:42:32.779 INFO:teuthology.orchestra.run.smithi137.stdout: "root": "/" 2024-04-26T23:42:32.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:32.779 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_count": 0, 2024-04-26T23:42:32.779 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_pinned_count": 0, 2024-04-26T23:42:32.779 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 5445, 2024-04-26T23:42:32.779 INFO:teuthology.orchestra.run.smithi137.stdout: "inst": { 2024-04-26T23:42:32.780 INFO:teuthology.orchestra.run.smithi137.stdout: "name": { 2024-04-26T23:42:32.780 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "client", 2024-04-26T23:42:32.780 INFO:teuthology.orchestra.run.smithi137.stdout: "num": 5445 2024-04-26T23:42:32.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:32.780 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2024-04-26T23:42:32.780 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-26T23:42:32.780 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:42:32.780 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 103595678 2024-04-26T23:42:32.780 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:32.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:32.780 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2024-04-26T23:42:32.780 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-26T23:42:32.780 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:42:32.780 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 103595678 2024-04-26T23:42:32.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:32.780 INFO:teuthology.orchestra.run.smithi137.stdout: "inst_str": "client.5445 192.168.0.1:0/103595678", 2024-04-26T23:42:32.781 INFO:teuthology.orchestra.run.smithi137.stdout: "addr_str": "192.168.0.1:0/103595678", 2024-04-26T23:42:32.781 INFO:teuthology.orchestra.run.smithi137.stdout: "inode_count": 1, 2024-04-26T23:42:32.781 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_epoch": 17, 2024-04-26T23:42:32.781 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch": 33, 2024-04-26T23:42:32.781 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch_barrier": 0, 2024-04-26T23:42:32.781 INFO:teuthology.orchestra.run.smithi137.stdout: "blocklisted": false, 2024-04-26T23:42:32.781 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs" 2024-04-26T23:42:32.781 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:42:32.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:32.794 DEBUG:teuthology.orchestra.run.smithi137:> stat --file-system '--printf=%T 2024-04-26T23:42:32.794 DEBUG:teuthology.orchestra.run.smithi137:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-26T23:42:32.803 INFO:teuthology.orchestra.run.smithi137.stdout:fuseblk 2024-04-26T23:42:32.803 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-26T23:42:32.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:32.804 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:42:32.871 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:42:33.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.044+0000 7ff04c400640 1 Processor -- start 2024-04-26T23:42:33.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.044+0000 7ff04c400640 1 -- start start 2024-04-26T23:42:33.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.044+0000 7ff04c400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff044148950 0x7ff04415fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:33.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.044+0000 7ff04c400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff0440b4ad0 0x7ff04406f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:33.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.044+0000 7ff04c400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff044148d30 con 0x7ff04406f6d0 2024-04-26T23:42:33.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.044+0000 7ff04c400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff04406fb30 con 0x7ff0440b4ad0 2024-04-26T23:42:33.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.044+0000 7ff04c400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff044073540 con 0x7ff044148950 2024-04-26T23:42:33.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.044+0000 7ff049000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff0440b4ad0 0x7ff04406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:33.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.044+0000 7ff04a400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7ff04406f6d0 0x7ff0440b5140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50130/0 (socket says 172.21.15.137:50130) 2024-04-26T23:42:33.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.048+0000 7ff04a400640 1 -- 172.21.15.137:0/1469413395 learned_addr learned my addr 172.21.15.137:0/1469413395 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:33.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.048+0000 7ff049a00640 1 --2- 172.21.15.137:0/1469413395 >> v2:172.21.15.170:3300/0 conn(0x7ff044148950 0x7ff04415fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:33.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.048+0000 7ff049000640 1 -- 172.21.15.137:0/1469413395 >> v2:172.21.15.170:3300/0 conn(0x7ff044148950 msgr2=0x7ff04415fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:33.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.048+0000 7ff049000640 1 --2- 172.21.15.137:0/1469413395 >> v2:172.21.15.170:3300/0 conn(0x7ff044148950 0x7ff04415fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:33.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.048+0000 7ff049000640 1 -- 172.21.15.137:0/1469413395 >> v1:172.21.15.137:6789/0 conn(0x7ff04406f6d0 legacy=0x7ff0440b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:33.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.048+0000 7ff049000640 1 -- 172.21.15.137:0/1469413395 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff044073820 con 0x7ff0440b4ad0 2024-04-26T23:42:33.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.048+0000 7ff049a00640 1 --2- 172.21.15.137:0/1469413395 >> v2:172.21.15.170:3300/0 conn(0x7ff044148950 0x7ff04415fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:33.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.048+0000 7ff049000640 1 --2- 172.21.15.137:0/1469413395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0440b4ad0 0x7ff04406f190 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff0440b0530 tx=0x7ff03001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59025f6bf1853b1e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:33.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.048+0000 7ff043e00640 1 -- 172.21.15.137:0/1469413395 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0300b0070 con 0x7ff0440b4ad0 2024-04-26T23:42:33.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.048+0000 7ff043e00640 1 -- 172.21.15.137:0/1469413395 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0300ab600 con 0x7ff0440b4ad0 2024-04-26T23:42:33.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.048+0000 7ff043e00640 1 -- 172.21.15.137:0/1469413395 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0300ab9d0 con 0x7ff0440b4ad0 2024-04-26T23:42:33.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff04c400640 1 -- 172.21.15.137:0/1469413395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0440b4ad0 msgr2=0x7ff04406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:33.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff04c400640 1 --2- 172.21.15.137:0/1469413395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0440b4ad0 0x7ff04406f190 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff0440b0530 tx=0x7ff03001c450 comp rx=0 tx=0).stop 2024-04-26T23:42:33.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff04c400640 1 -- 172.21.15.137:0/1469413395 shutdown_connections 2024-04-26T23:42:33.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff04c400640 1 --2- 172.21.15.137:0/1469413395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0440b4ad0 0x7ff04406f190 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:33.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff04c400640 1 --2- 172.21.15.137:0/1469413395 >> v2:172.21.15.170:3300/0 conn(0x7ff044148950 0x7ff04415fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:33.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff04c400640 1 -- 172.21.15.137:0/1469413395 >> 172.21.15.137:0/1469413395 conn(0x7ff04406c5d0 msgr2=0x7ff04406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:33.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff04c400640 1 -- 172.21.15.137:0/1469413395 shutdown_connections 2024-04-26T23:42:33.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff04c400640 1 -- 172.21.15.137:0/1469413395 wait complete. 2024-04-26T23:42:33.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff04c400640 1 Processor -- start 2024-04-26T23:42:33.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff04c400640 1 -- start start 2024-04-26T23:42:33.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff04c400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff04406f6d0 0x7ff044145560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:33.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff04c400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0440b4ad0 0x7ff0440b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:33.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff04c400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff044148950 0x7ff044143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:33.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff04c400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff044074480 con 0x7ff04406f6d0 2024-04-26T23:42:33.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff04c400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff044074300 con 0x7ff0440b4ad0 2024-04-26T23:42:33.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff04c400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff044160300 con 0x7ff044148950 2024-04-26T23:42:33.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff049a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff04406f6d0 0x7ff044145560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:33.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff049a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff04406f6d0 0x7ff044145560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43144/0 (socket says 172.21.15.137:43144) 2024-04-26T23:42:33.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff049a00640 1 -- 172.21.15.137:0/4024348204 learned_addr learned my addr 172.21.15.137:0/4024348204 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:33.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff049a00640 1 -- 172.21.15.137:0/4024348204 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff044148950 msgr2=0x7ff044143830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:33.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff049a00640 1 --2- 172.21.15.137:0/4024348204 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff044148950 0x7ff044143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:33.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff049a00640 1 -- 172.21.15.137:0/4024348204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0440b4ad0 msgr2=0x7ff0440b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:33.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff049a00640 1 --2- 172.21.15.137:0/4024348204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0440b4ad0 0x7ff0440b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:33.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff049a00640 1 -- 172.21.15.137:0/4024348204 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff044140620 con 0x7ff04406f6d0 2024-04-26T23:42:33.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff049a00640 1 --2- 172.21.15.137:0/4024348204 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff04406f6d0 0x7ff044145560 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff03800c7f0 tx=0x7ff03800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:33.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff041600640 1 -- 172.21.15.137:0/4024348204 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038007a30 con 0x7ff04406f6d0 2024-04-26T23:42:33.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.052+0000 7ff041600640 1 -- 172.21.15.137:0/4024348204 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff038007bd0 con 0x7ff04406f6d0 2024-04-26T23:42:33.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.056+0000 7ff04c400640 1 -- 172.21.15.137:0/4024348204 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff044140900 con 0x7ff04406f6d0 2024-04-26T23:42:33.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.056+0000 7ff041600640 1 -- 172.21.15.137:0/4024348204 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0380113f0 con 0x7ff04406f6d0 2024-04-26T23:42:33.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.056+0000 7ff04c400640 1 -- 172.21.15.137:0/4024348204 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff044140ec0 con 0x7ff04406f6d0 2024-04-26T23:42:33.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.056+0000 7ff04c400640 1 -- 172.21.15.137:0/4024348204 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff04406a4b0 con 0x7ff04406f6d0 2024-04-26T23:42:33.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.056+0000 7ff041600640 1 -- 172.21.15.137:0/4024348204 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff038011590 con 0x7ff04406f6d0 2024-04-26T23:42:33.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.056+0000 7ff041600640 1 --2- 172.21.15.137:0/4024348204 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff024068380 0x7ff02406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:33.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.056+0000 7ff041600640 1 -- 172.21.15.137:0/4024348204 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7ff038086c90 con 0x7ff04406f6d0 2024-04-26T23:42:33.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.056+0000 7ff049000640 1 --2- 172.21.15.137:0/4024348204 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff024068380 0x7ff02406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:33.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.056+0000 7ff049000640 1 --2- 172.21.15.137:0/4024348204 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff024068380 0x7ff02406a840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff0300ad000 tx=0x7ff030004740 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:33.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.060+0000 7ff041600640 1 -- 172.21.15.137:0/4024348204 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff038015020 con 0x7ff04406f6d0 2024-04-26T23:42:33.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.252+0000 7ff04c400640 1 -- 172.21.15.137:0/4024348204 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff04415fed0 con 0x7ff04406f6d0 2024-04-26T23:42:33.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.252+0000 7ff041600640 1 -- 172.21.15.137:0/4024348204 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7ff0380571b0 con 0x7ff04406f6d0 2024-04-26T23:42:33.331 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:42:33.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.256+0000 7ff04c400640 1 -- 172.21.15.137:0/4024348204 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff024068380 msgr2=0x7ff02406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:33.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.256+0000 7ff04c400640 1 --2- 172.21.15.137:0/4024348204 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff024068380 0x7ff02406a840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff0300ad000 tx=0x7ff030004740 comp rx=0 tx=0).stop 2024-04-26T23:42:33.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.256+0000 7ff04c400640 1 -- 172.21.15.137:0/4024348204 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff04406f6d0 msgr2=0x7ff044145560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:33.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.256+0000 7ff04c400640 1 --2- 172.21.15.137:0/4024348204 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff04406f6d0 0x7ff044145560 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff03800c7f0 tx=0x7ff03800ccb0 comp rx=0 tx=0).stop 2024-04-26T23:42:33.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.256+0000 7ff04c400640 1 -- 172.21.15.137:0/4024348204 shutdown_connections 2024-04-26T23:42:33.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.256+0000 7ff04c400640 1 --2- 172.21.15.137:0/4024348204 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff024068380 0x7ff02406a840 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:33.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.256+0000 7ff04c400640 1 --2- 172.21.15.137:0/4024348204 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff044148950 0x7ff044143830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:33.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.256+0000 7ff04c400640 1 --2- 172.21.15.137:0/4024348204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0440b4ad0 0x7ff0440b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:33.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.256+0000 7ff04c400640 1 --2- 172.21.15.137:0/4024348204 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff04406f6d0 0x7ff044145560 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:33.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.256+0000 7ff04c400640 1 -- 172.21.15.137:0/4024348204 >> 172.21.15.137:0/4024348204 conn(0x7ff04406c5d0 msgr2=0x7ff0440b5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:33.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.256+0000 7ff04c400640 1 -- 172.21.15.137:0/4024348204 shutdown_connections 2024-04-26T23:42:33.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:33.256+0000 7ff04c400640 1 -- 172.21.15.137:0/4024348204 wait complete. 2024-04-26T23:42:33.333 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:42:33.333 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:42:33.333 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi170.front.sepia.ceph.com 2024-04-26T23:42:33.333 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-26T23:42:33.334 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T23:42:33.334 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:42:33.334 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:42:33.334 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:42:33.334 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:42:33.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:33.334 DEBUG:teuthology.orchestra.run.smithi170:> ip addr 2024-04-26T23:42:33.344 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:42:33.344 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:42:33.344 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:42:33.344 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:33.344 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2024-04-26T23:42:33.344 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:33.344 INFO:teuthology.orchestra.run.smithi170.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:42:33.344 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:54 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:42:33.344 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f0 2024-04-26T23:42:33.344 INFO:teuthology.orchestra.run.smithi170.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:42:33.345 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:55 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:42:33.345 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f1 2024-04-26T23:42:33.345 INFO:teuthology.orchestra.run.smithi170.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:42:33.345 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:54 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:42:33.345 INFO:teuthology.orchestra.run.smithi170.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:42:33.345 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:55 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:42:33.345 INFO:teuthology.orchestra.run.smithi170.stdout: inet 172.21.15.170/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:42:33.345 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft 42413sec preferred_lft 42413sec 2024-04-26T23:42:33.345 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::ec4:7aff:fe88:7255/64 scope link 2024-04-26T23:42:33.345 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:33.345 INFO:teuthology.orchestra.run.smithi170.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:42:33.345 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 02:42:23:a7:19:38 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:42:33.345 INFO:teuthology.orchestra.run.smithi170.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:42:33.345 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:33.345 INFO:teuthology.orchestra.run.smithi170.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:42:33.346 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:42:33.346 INFO:teuthology.orchestra.run.smithi170.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:42:33.346 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:33.346 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T23:42:33.346 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:33.346 INFO:teuthology.orchestra.run.smithi170.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:42:33.346 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:42:33.346 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:42:33.346 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:33.346 INFO:teuthology.orchestra.run.smithi170.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:42:33.346 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:42:33.346 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-26T23:42:33.346 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:33.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:33.347 DEBUG:teuthology.orchestra.run.smithi170:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:42:33.409 INFO:teuthology.orchestra.run.smithi170.stdout:1 2024-04-26T23:42:33.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:33.411 DEBUG:teuthology.orchestra.run.smithi170:> route 2024-04-26T23:42:33.465 INFO:teuthology.orchestra.run.smithi170.stdout:Kernel IP routing table 2024-04-26T23:42:33.465 INFO:teuthology.orchestra.run.smithi170.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:42:33.466 INFO:teuthology.orchestra.run.smithi170.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:42:33.466 INFO:teuthology.orchestra.run.smithi170.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:42:33.466 INFO:teuthology.orchestra.run.smithi170.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:42:33.466 INFO:teuthology.orchestra.run.smithi170.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:42:33.466 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:42:33.466 INFO:teuthology.orchestra.run.smithi170.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:42:33.466 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:42:33.466 INFO:teuthology.orchestra.run.smithi170.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:42:33.466 INFO:teuthology.orchestra.run.smithi170.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:42:33.466 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:42:33.467 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-04-26T23:42:33.467 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:42:33.467 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:42:33.467 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:42:33.467 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-04-26T23:42:33.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:42:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:42:33.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:42:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:42:33.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:33.612 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-04-26T23:42:33.621 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T23:42:33.621 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-26T23:42:33.621 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:42:33.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:33.622 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set brx.0 up 2024-04-26T23:42:33.685 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-26T23:42:33.685 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:42:33.686 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-26T23:42:33.737 INFO:teuthology.orchestra.run.smithi170.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:42:33.737 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:42:33.738 DEBUG:teuthology.orchestra.run.smithi170:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:42:33.789 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2024-04-26T23:42:33.853 DEBUG:teuthology.orchestra.run.smithi170:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:42:33.902 INFO:teuthology.orchestra.run.smithi170.stdout:/sys 2024-04-26T23:42:33.902 INFO:teuthology.orchestra.run.smithi170.stdout:/proc 2024-04-26T23:42:33.903 INFO:teuthology.orchestra.run.smithi170.stdout:/dev 2024-04-26T23:42:33.903 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/pts 2024-04-26T23:42:33.903 INFO:teuthology.orchestra.run.smithi170.stdout:/run 2024-04-26T23:42:33.903 INFO:teuthology.orchestra.run.smithi170.stdout:/ 2024-04-26T23:42:33.903 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/security 2024-04-26T23:42:33.903 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/shm 2024-04-26T23:42:33.903 INFO:teuthology.orchestra.run.smithi170.stdout:/run/lock 2024-04-26T23:42:33.903 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/cgroup 2024-04-26T23:42:33.903 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/pstore 2024-04-26T23:42:33.903 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/bpf 2024-04-26T23:42:33.903 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:42:33.903 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/hugepages 2024-04-26T23:42:33.903 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/mqueue 2024-04-26T23:42:33.903 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/debug 2024-04-26T23:42:33.904 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/tracing 2024-04-26T23:42:33.904 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/fs/nfsd 2024-04-26T23:42:33.904 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/fuse/connections 2024-04-26T23:42:33.904 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/config 2024-04-26T23:42:33.904 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:42:33.904 INFO:teuthology.orchestra.run.smithi170.stdout:/run/rpc_pipefs 2024-04-26T23:42:33.904 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/1000 2024-04-26T23:42:33.904 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph 2024-04-26T23:42:33.904 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:42:33.904 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:42:33.904 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:42:33.904 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:42:33.904 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns 2024-04-26T23:42:33.904 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:42:33.904 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:42:33.905 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:42:33.905 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:42:33.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:33.906 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2024-04-26T23:42:33.960 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T23:42:33.961 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-26T23:42:34.004 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2024-04-26T23:42:34.024 DEBUG:teuthology.orchestra.run.smithi170:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:42:34.075 INFO:teuthology.orchestra.run.smithi170.stdout:/sys 2024-04-26T23:42:34.075 INFO:teuthology.orchestra.run.smithi170.stdout:/proc 2024-04-26T23:42:34.075 INFO:teuthology.orchestra.run.smithi170.stdout:/dev 2024-04-26T23:42:34.075 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/pts 2024-04-26T23:42:34.075 INFO:teuthology.orchestra.run.smithi170.stdout:/run 2024-04-26T23:42:34.075 INFO:teuthology.orchestra.run.smithi170.stdout:/ 2024-04-26T23:42:34.075 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/security 2024-04-26T23:42:34.075 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/shm 2024-04-26T23:42:34.076 INFO:teuthology.orchestra.run.smithi170.stdout:/run/lock 2024-04-26T23:42:34.076 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/cgroup 2024-04-26T23:42:34.076 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/pstore 2024-04-26T23:42:34.076 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/bpf 2024-04-26T23:42:34.076 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:42:34.076 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/hugepages 2024-04-26T23:42:34.076 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/mqueue 2024-04-26T23:42:34.076 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/debug 2024-04-26T23:42:34.076 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/tracing 2024-04-26T23:42:34.076 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/fs/nfsd 2024-04-26T23:42:34.076 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/fuse/connections 2024-04-26T23:42:34.076 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/config 2024-04-26T23:42:34.076 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:42:34.076 INFO:teuthology.orchestra.run.smithi170.stdout:/run/rpc_pipefs 2024-04-26T23:42:34.076 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/1000 2024-04-26T23:42:34.076 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph 2024-04-26T23:42:34.077 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:42:34.077 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:42:34.077 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:42:34.077 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:42:34.077 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns 2024-04-26T23:42:34.077 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:42:34.077 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:42:34.077 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:42:34.077 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:42:34.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:34.078 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2024-04-26T23:42:34.097 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:2024-04-26T23:42:34.088+0000 7f217e42c580 -1 init, newargv = 0x558f205716c0 newargc=15 2024-04-26T23:42:34.097 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:ceph-fuse[32424]: starting ceph client 2024-04-26T23:42:34.105 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:ceph-fuse[32424]: starting fuse 2024-04-26T23:42:34.106 INFO:teuthology.orchestra.run.smithi170.stdout:44 2024-04-26T23:42:34.106 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T23:42:34.107 DEBUG:teuthology.orchestra.run.smithi170:> sudo stdin-killer -- python3 -c ' 2024-04-26T23:42:34.107 DEBUG:teuthology.orchestra.run.smithi170:> import glob 2024-04-26T23:42:34.107 DEBUG:teuthology.orchestra.run.smithi170:> import re 2024-04-26T23:42:34.107 DEBUG:teuthology.orchestra.run.smithi170:> import os 2024-04-26T23:42:34.107 DEBUG:teuthology.orchestra.run.smithi170:> import subprocess 2024-04-26T23:42:34.107 DEBUG:teuthology.orchestra.run.smithi170:> 2024-04-26T23:42:34.107 DEBUG:teuthology.orchestra.run.smithi170:> def _find_admin_socket(client_name): 2024-04-26T23:42:34.107 DEBUG:teuthology.orchestra.run.smithi170:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-26T23:42:34.107 DEBUG:teuthology.orchestra.run.smithi170:> files = glob.glob(asok_path) 2024-04-26T23:42:34.107 DEBUG:teuthology.orchestra.run.smithi170:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-26T23:42:34.107 DEBUG:teuthology.orchestra.run.smithi170:> 2024-04-26T23:42:34.107 DEBUG:teuthology.orchestra.run.smithi170:> # Given a non-glob path, it better be there 2024-04-26T23:42:34.107 DEBUG:teuthology.orchestra.run.smithi170:> if "*" not in asok_path: 2024-04-26T23:42:34.107 DEBUG:teuthology.orchestra.run.smithi170:> assert(len(files) == 1) 2024-04-26T23:42:34.107 DEBUG:teuthology.orchestra.run.smithi170:> return files[0] 2024-04-26T23:42:34.108 DEBUG:teuthology.orchestra.run.smithi170:> 2024-04-26T23:42:34.108 DEBUG:teuthology.orchestra.run.smithi170:> for f in files: 2024-04-26T23:42:34.108 DEBUG:teuthology.orchestra.run.smithi170:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T23:42:34.108 DEBUG:teuthology.orchestra.run.smithi170:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T23:42:34.108 DEBUG:teuthology.orchestra.run.smithi170:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T23:42:34.108 DEBUG:teuthology.orchestra.run.smithi170:> contents = proc_f.read() 2024-04-26T23:42:34.108 DEBUG:teuthology.orchestra.run.smithi170:> if mountpoint in contents: 2024-04-26T23:42:34.108 DEBUG:teuthology.orchestra.run.smithi170:> return f 2024-04-26T23:42:34.108 DEBUG:teuthology.orchestra.run.smithi170:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T23:42:34.108 DEBUG:teuthology.orchestra.run.smithi170:> 2024-04-26T23:42:34.108 DEBUG:teuthology.orchestra.run.smithi170:> print(_find_admin_socket("client.1")) 2024-04-26T23:42:34.108 DEBUG:teuthology.orchestra.run.smithi170:> ' 2024-04-26T23:42:34.229 INFO:teuthology.orchestra.run.smithi170.stdout:/var/run/ceph/ceph-client.1.32424.asok 2024-04-26T23:42:34.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:42:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:42:34.240 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.32424.asok 2024-04-26T23:42:34.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:34.240 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.32424.asok status 2024-04-26T23:42:34.411 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-26T23:42:34.412 INFO:teuthology.orchestra.run.smithi170.stdout: "metadata": { 2024-04-26T23:42:34.412 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T23:42:34.412 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T23:42:34.412 INFO:teuthology.orchestra.run.smithi170.stdout: "entity_id": "1", 2024-04-26T23:42:34.412 INFO:teuthology.orchestra.run.smithi170.stdout: "hostname": "smithi170", 2024-04-26T23:42:34.412 INFO:teuthology.orchestra.run.smithi170.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-26T23:42:34.412 INFO:teuthology.orchestra.run.smithi170.stdout: "pid": "32424", 2024-04-26T23:42:34.412 INFO:teuthology.orchestra.run.smithi170.stdout: "root": "/" 2024-04-26T23:42:34.412 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-26T23:42:34.412 INFO:teuthology.orchestra.run.smithi170.stdout: "dentry_count": 0, 2024-04-26T23:42:34.412 INFO:teuthology.orchestra.run.smithi170.stdout: "dentry_pinned_count": 0, 2024-04-26T23:42:34.412 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 5281, 2024-04-26T23:42:34.412 INFO:teuthology.orchestra.run.smithi170.stdout: "inst": { 2024-04-26T23:42:34.413 INFO:teuthology.orchestra.run.smithi170.stdout: "name": { 2024-04-26T23:42:34.413 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "client", 2024-04-26T23:42:34.413 INFO:teuthology.orchestra.run.smithi170.stdout: "num": 5281 2024-04-26T23:42:34.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-26T23:42:34.413 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": { 2024-04-26T23:42:34.413 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2024-04-26T23:42:34.413 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:42:34.413 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 3380789593 2024-04-26T23:42:34.413 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-26T23:42:34.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-26T23:42:34.413 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": { 2024-04-26T23:42:34.413 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2024-04-26T23:42:34.413 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:42:34.413 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 3380789593 2024-04-26T23:42:34.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-26T23:42:34.413 INFO:teuthology.orchestra.run.smithi170.stdout: "inst_str": "client.5281 192.168.0.1:0/3380789593", 2024-04-26T23:42:34.414 INFO:teuthology.orchestra.run.smithi170.stdout: "addr_str": "192.168.0.1:0/3380789593", 2024-04-26T23:42:34.414 INFO:teuthology.orchestra.run.smithi170.stdout: "inode_count": 1, 2024-04-26T23:42:34.414 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_epoch": 17, 2024-04-26T23:42:34.414 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_epoch": 33, 2024-04-26T23:42:34.414 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_epoch_barrier": 0, 2024-04-26T23:42:34.414 INFO:teuthology.orchestra.run.smithi170.stdout: "blocklisted": false, 2024-04-26T23:42:34.414 INFO:teuthology.orchestra.run.smithi170.stdout: "fs_name": "cephfs" 2024-04-26T23:42:34.414 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-26T23:42:34.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:34.428 DEBUG:teuthology.orchestra.run.smithi170:> stat --file-system '--printf=%T 2024-04-26T23:42:34.428 DEBUG:teuthology.orchestra.run.smithi170:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-26T23:42:34.437 INFO:teuthology.orchestra.run.smithi170.stdout:fuseblk 2024-04-26T23:42:34.437 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-26T23:42:34.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:34.437 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:42:34.496 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds ms_async_reap_threshold 1 2024-04-26T23:42:34.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.640+0000 7f844ee00640 1 Processor -- start 2024-04-26T23:42:34.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.640+0000 7f844ee00640 1 -- start start 2024-04-26T23:42:34.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.644+0000 7f844ee00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84480afbc0 0x7f844815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:34.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.644+0000 7f844ee00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f84480affa0 0x7f84480ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:34.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.644+0000 7f844ee00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8448072860 con 0x7f8448073f20 2024-04-26T23:42:34.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.644+0000 7f844ee00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f84480743b0 con 0x7f84480affa0 2024-04-26T23:42:34.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.644+0000 7f844ee00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8448072b00 con 0x7f84480afbc0 2024-04-26T23:42:34.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.644+0000 7f844ce00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f84480affa0 0x7f84480ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:34.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.644+0000 7f843f400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f8448073f20 0x7f84480735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50146/0 (socket says 172.21.15.137:50146) 2024-04-26T23:42:34.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.644+0000 7f844ce00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f84480affa0 0x7f84480ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43156/0 (socket says 172.21.15.137:43156) 2024-04-26T23:42:34.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.644+0000 7f843f400640 1 -- 172.21.15.137:0/4135969550 learned_addr learned my addr 172.21.15.137:0/4135969550 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:34.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.644+0000 7f8447e00640 1 --2- 172.21.15.137:0/4135969550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84480afbc0 0x7f844815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:34.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.644+0000 7f844ce00640 1 -- 172.21.15.137:0/4135969550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84480afbc0 msgr2=0x7f844815df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:34.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.644+0000 7f844ce00640 1 --2- 172.21.15.137:0/4135969550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84480afbc0 0x7f844815df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.644+0000 7f844ce00640 1 -- 172.21.15.137:0/4135969550 >> v1:172.21.15.137:6789/0 conn(0x7f8448073f20 legacy=0x7f84480735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:34.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.644+0000 7f844ce00640 1 -- 172.21.15.137:0/4135969550 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8448072de0 con 0x7f84480affa0 2024-04-26T23:42:34.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.644+0000 7f8447e00640 1 --2- 172.21.15.137:0/4135969550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84480afbc0 0x7f844815df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:42:34.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.644+0000 7f8447400640 1 -- 172.21.15.137:0/4135969550 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 952863585 0 0) 0x7f8448072860 con 0x7f8448073f20 2024-04-26T23:42:34.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.648+0000 7f844ce00640 1 --2- 172.21.15.137:0/4135969550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84480affa0 0x7f84480ce3b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8440009d90 tx=0x7f844001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0885524cb342ec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:34.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.648+0000 7f8447400640 1 -- 172.21.15.137:0/4135969550 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84400b2070 con 0x7f84480affa0 2024-04-26T23:42:34.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.648+0000 7f8447400640 1 -- 172.21.15.137:0/4135969550 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84400a5830 con 0x7f84480affa0 2024-04-26T23:42:34.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.648+0000 7f8447400640 1 -- 172.21.15.137:0/4135969550 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84400a5c00 con 0x7f84480affa0 2024-04-26T23:42:34.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.648+0000 7f844ee00640 1 -- 172.21.15.137:0/4135969550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84480affa0 msgr2=0x7f84480ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:34.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.648+0000 7f844ee00640 1 --2- 172.21.15.137:0/4135969550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84480affa0 0x7f84480ce3b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8440009d90 tx=0x7f844001c970 comp rx=0 tx=0).stop 2024-04-26T23:42:34.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.648+0000 7f844ee00640 1 -- 172.21.15.137:0/4135969550 shutdown_connections 2024-04-26T23:42:34.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.648+0000 7f844ee00640 1 --2- 172.21.15.137:0/4135969550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84480affa0 0x7f84480ce3b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.648+0000 7f844ee00640 1 --2- 172.21.15.137:0/4135969550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84480afbc0 0x7f844815df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.648+0000 7f844ee00640 1 -- 172.21.15.137:0/4135969550 >> 172.21.15.137:0/4135969550 conn(0x7f844806c800 msgr2=0x7f844806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:34.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.648+0000 7f844ee00640 1 -- 172.21.15.137:0/4135969550 shutdown_connections 2024-04-26T23:42:34.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.648+0000 7f844ee00640 1 -- 172.21.15.137:0/4135969550 wait complete. 2024-04-26T23:42:34.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.648+0000 7f844ee00640 1 Processor -- start 2024-04-26T23:42:34.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.648+0000 7f844ee00640 1 -- start start 2024-04-26T23:42:34.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f844ee00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84480afbc0 0x7f84481363d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:34.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f844ee00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84480affa0 0x7f844814da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:34.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f844ee00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f844814ba40 0x7f844814e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:34.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f844ee00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f844806f3e0 con 0x7f84480afbc0 2024-04-26T23:42:34.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f844ee00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f844806f260 con 0x7f84480affa0 2024-04-26T23:42:34.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f844ee00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f844806f560 con 0x7f844814ba40 2024-04-26T23:42:34.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f8447e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84480afbc0 0x7f84481363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:34.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f8447e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84480afbc0 0x7f84481363d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43162/0 (socket says 172.21.15.137:43162) 2024-04-26T23:42:34.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f8447e00640 1 -- 172.21.15.137:0/2897669967 learned_addr learned my addr 172.21.15.137:0/2897669967 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:34.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f844ce00640 1 --2- 172.21.15.137:0/2897669967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f844814ba40 0x7f844814e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:34.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f843f400640 1 --2- 172.21.15.137:0/2897669967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84480affa0 0x7f844814da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:34.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f8447e00640 1 -- 172.21.15.137:0/2897669967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f844814ba40 msgr2=0x7f844814e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:34.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f8447e00640 1 --2- 172.21.15.137:0/2897669967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f844814ba40 0x7f844814e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f8447e00640 1 -- 172.21.15.137:0/2897669967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84480affa0 msgr2=0x7f844814da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:34.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f8447e00640 1 --2- 172.21.15.137:0/2897669967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84480affa0 0x7f844814da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f8447e00640 1 -- 172.21.15.137:0/2897669967 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84480b38d0 con 0x7f84480afbc0 2024-04-26T23:42:34.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f844ce00640 1 --2- 172.21.15.137:0/2897669967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f844814ba40 0x7f844814e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:34.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f8447e00640 1 --2- 172.21.15.137:0/2897669967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84480afbc0 0x7f84481363d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f843800ec40 tx=0x7f843800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:34.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f8444c00640 1 -- 172.21.15.137:0/2897669967 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8438017070 con 0x7f84480afbc0 2024-04-26T23:42:34.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f8444c00640 1 -- 172.21.15.137:0/2897669967 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f843800cc30 con 0x7f84480afbc0 2024-04-26T23:42:34.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f8444c00640 1 -- 172.21.15.137:0/2897669967 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8438013470 con 0x7f84480afbc0 2024-04-26T23:42:34.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f844ee00640 1 -- 172.21.15.137:0/2897669967 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8448153090 con 0x7f84480afbc0 2024-04-26T23:42:34.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f844ee00640 1 -- 172.21.15.137:0/2897669967 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f844814e410 con 0x7f84480afbc0 2024-04-26T23:42:34.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.652+0000 7f844ee00640 1 -- 172.21.15.137:0/2897669967 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f844806a410 con 0x7f84480afbc0 2024-04-26T23:42:34.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.656+0000 7f8444c00640 1 -- 172.21.15.137:0/2897669967 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f843801a070 con 0x7f84480afbc0 2024-04-26T23:42:34.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.656+0000 7f8444c00640 1 --2- 172.21.15.137:0/2897669967 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8424068380 0x7f842406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:34.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.656+0000 7f8444c00640 1 -- 172.21.15.137:0/2897669967 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f84380868d0 con 0x7f84480afbc0 2024-04-26T23:42:34.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.656+0000 7f843f400640 1 --2- 172.21.15.137:0/2897669967 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8424068380 0x7f842406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:34.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.656+0000 7f843f400640 1 --2- 172.21.15.137:0/2897669967 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8424068380 0x7f842406a840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f84480cf170 tx=0x7f8430007b80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:34.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.660+0000 7f8444c00640 1 -- 172.21.15.137:0/2897669967 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8438056e90 con 0x7f84480afbc0 2024-04-26T23:42:34.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.816+0000 7f844ee00640 1 -- 172.21.15.137:0/2897669967 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command([{prefix=config set, name=ms_async_reap_threshold}] v 0) -- 0x7f8448160870 con 0x7f84480afbc0 2024-04-26T23:42:34.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.824+0000 7f8444c00640 1 -- 172.21.15.137:0/2897669967 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=ms_async_reap_threshold}]=0 v11)=0 v11) ==== 121+0+0 (secure 0 0 0) 0x7f8438056790 con 0x7f84480afbc0 2024-04-26T23:42:34.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.824+0000 7f844ee00640 1 -- 172.21.15.137:0/2897669967 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8424068380 msgr2=0x7f842406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:34.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.824+0000 7f844ee00640 1 --2- 172.21.15.137:0/2897669967 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8424068380 0x7f842406a840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f84480cf170 tx=0x7f8430007b80 comp rx=0 tx=0).stop 2024-04-26T23:42:34.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.824+0000 7f844ee00640 1 -- 172.21.15.137:0/2897669967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84480afbc0 msgr2=0x7f84481363d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:34.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.824+0000 7f844ee00640 1 --2- 172.21.15.137:0/2897669967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84480afbc0 0x7f84481363d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f843800ec40 tx=0x7f843800c520 comp rx=0 tx=0).stop 2024-04-26T23:42:34.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.824+0000 7f844ee00640 1 -- 172.21.15.137:0/2897669967 shutdown_connections 2024-04-26T23:42:34.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.824+0000 7f844ee00640 1 --2- 172.21.15.137:0/2897669967 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8424068380 0x7f842406a840 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.824+0000 7f844ee00640 1 --2- 172.21.15.137:0/2897669967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f844814ba40 0x7f844814e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.824+0000 7f844ee00640 1 --2- 172.21.15.137:0/2897669967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84480affa0 0x7f844814da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.824+0000 7f844ee00640 1 --2- 172.21.15.137:0/2897669967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84480afbc0 0x7f84481363d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.824+0000 7f844ee00640 1 -- 172.21.15.137:0/2897669967 >> 172.21.15.137:0/2897669967 conn(0x7f844806c800 msgr2=0x7f844806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:34.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.824+0000 7f844ee00640 1 -- 172.21.15.137:0/2897669967 shutdown_connections 2024-04-26T23:42:34.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:34.824+0000 7f844ee00640 1 -- 172.21.15.137:0/2897669967 wait complete. 2024-04-26T23:42:34.849 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:42:34.850 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:42:34.858 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:42:35.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.031+0000 7fe5a8600640 1 Processor -- start 2024-04-26T23:42:35.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.031+0000 7fe5a8600640 1 -- start start 2024-04-26T23:42:35.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.031+0000 7fe5a8600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe5a00ce3e0 0x7fe5a0073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:35.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.031+0000 7fe5a8600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe5a00ce7c0 0x7fe5a0146210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:35.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.031+0000 7fe5a8600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5a0073010 con 0x7fe5a015de80 2024-04-26T23:42:35.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.031+0000 7fe5a8600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe5a00cef90 con 0x7fe5a00ce3e0 2024-04-26T23:42:35.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.031+0000 7fe5a8600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe5a0073280 con 0x7fe5a00ce7c0 2024-04-26T23:42:35.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.031+0000 7fe5a5c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe5a00ce3e0 0x7fe5a0073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:35.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.031+0000 7fe5a5c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe5a00ce3e0 0x7fe5a0073d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43168/0 (socket says 172.21.15.137:43168) 2024-04-26T23:42:35.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.031+0000 7fe5a5c00640 1 -- 172.21.15.137:0/976164326 learned_addr learned my addr 172.21.15.137:0/976164326 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:35.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.031+0000 7fe5a6600640 1 --2- 172.21.15.137:0/976164326 >> v2:172.21.15.170:3300/0 conn(0x7fe5a00ce7c0 0x7fe5a0146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:35.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.031+0000 7fe5a5c00640 1 -- 172.21.15.137:0/976164326 >> v2:172.21.15.170:3300/0 conn(0x7fe5a00ce7c0 msgr2=0x7fe5a0146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:35.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.031+0000 7fe5a5c00640 1 --2- 172.21.15.137:0/976164326 >> v2:172.21.15.170:3300/0 conn(0x7fe5a00ce7c0 0x7fe5a0146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.031+0000 7fe5a5c00640 1 -- 172.21.15.137:0/976164326 >> v1:172.21.15.170:6789/0 conn(0x7fe5a015de80 legacy=0x7fe5a00d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:35.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.031+0000 7fe5a5c00640 1 -- 172.21.15.137:0/976164326 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a0073560 con 0x7fe5a00ce3e0 2024-04-26T23:42:35.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.035+0000 7fe5a5c00640 1 --2- 172.21.15.137:0/976164326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5a00ce3e0 0x7fe5a0073d60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe594009870 tx=0x7fe59401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a2471b014ec967 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:35.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.035+0000 7fe59fe00640 1 -- 172.21.15.137:0/976164326 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5940b1070 con 0x7fe5a00ce3e0 2024-04-26T23:42:35.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.035+0000 7fe59fe00640 1 -- 172.21.15.137:0/976164326 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5940ac620 con 0x7fe5a00ce3e0 2024-04-26T23:42:35.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.035+0000 7fe59fe00640 1 -- 172.21.15.137:0/976164326 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5940ac9f0 con 0x7fe5a00ce3e0 2024-04-26T23:42:35.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.035+0000 7fe5a8600640 1 -- 172.21.15.137:0/976164326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5a00ce3e0 msgr2=0x7fe5a0073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:35.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.035+0000 7fe5a8600640 1 --2- 172.21.15.137:0/976164326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5a00ce3e0 0x7fe5a0073d60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe594009870 tx=0x7fe59401c4b0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.035+0000 7fe5a8600640 1 -- 172.21.15.137:0/976164326 shutdown_connections 2024-04-26T23:42:35.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.035+0000 7fe5a8600640 1 --2- 172.21.15.137:0/976164326 >> v2:172.21.15.170:3300/0 conn(0x7fe5a00ce7c0 0x7fe5a0146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.035+0000 7fe5a8600640 1 --2- 172.21.15.137:0/976164326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5a00ce3e0 0x7fe5a0073d60 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.035+0000 7fe5a8600640 1 -- 172.21.15.137:0/976164326 >> 172.21.15.137:0/976164326 conn(0x7fe5a006c5d0 msgr2=0x7fe5a006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:35.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.035+0000 7fe5a8600640 1 -- 172.21.15.137:0/976164326 shutdown_connections 2024-04-26T23:42:35.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.035+0000 7fe5a8600640 1 -- 172.21.15.137:0/976164326 wait complete. 2024-04-26T23:42:35.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a8600640 1 Processor -- start 2024-04-26T23:42:35.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a8600640 1 -- start start 2024-04-26T23:42:35.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a8600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a00ce3e0 0x7fe5a015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:35.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a8600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5a00ce7c0 0x7fe5a00b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:35.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a8600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5a015de80 0x7fe5a00b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:35.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a8600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a006f0e0 con 0x7fe5a00ce7c0 2024-04-26T23:42:35.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a8600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a006ef60 con 0x7fe5a00ce3e0 2024-04-26T23:42:35.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a8600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe5a006f260 con 0x7fe5a015de80 2024-04-26T23:42:35.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a5200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5a00ce7c0 0x7fe5a00b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a5c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a00ce3e0 0x7fe5a015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a5200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5a00ce7c0 0x7fe5a00b1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43180/0 (socket says 172.21.15.137:43180) 2024-04-26T23:42:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a5200640 1 -- 172.21.15.137:0/2758444562 learned_addr learned my addr 172.21.15.137:0/2758444562 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a5c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a00ce3e0 0x7fe5a015ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:57442/0 (socket says 172.21.15.137:57442) 2024-04-26T23:42:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a6600640 1 --2- 172.21.15.137:0/2758444562 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5a015de80 0x7fe5a00b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a5200640 1 -- 172.21.15.137:0/2758444562 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5a015de80 msgr2=0x7fe5a00b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a5200640 1 --2- 172.21.15.137:0/2758444562 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5a015de80 0x7fe5a00b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a5200640 1 -- 172.21.15.137:0/2758444562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a00ce3e0 msgr2=0x7fe5a015ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a5200640 1 --2- 172.21.15.137:0/2758444562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a00ce3e0 0x7fe5a015ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a5200640 1 -- 172.21.15.137:0/2758444562 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a0141400 con 0x7fe5a00ce7c0 2024-04-26T23:42:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a5c00640 1 --2- 172.21.15.137:0/2758444562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a00ce3e0 0x7fe5a015ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:42:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a5200640 1 --2- 172.21.15.137:0/2758444562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5a00ce7c0 0x7fe5a00b1680 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe58c00c410 tx=0x7fe58c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe59d600640 1 -- 172.21.15.137:0/2758444562 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58c011790 con 0x7fe5a00ce7c0 2024-04-26T23:42:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe59d600640 1 -- 172.21.15.137:0/2758444562 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe58c017070 con 0x7fe5a00ce7c0 2024-04-26T23:42:35.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe59d600640 1 -- 172.21.15.137:0/2758444562 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58c011bb0 con 0x7fe5a00ce7c0 2024-04-26T23:42:35.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a8600640 1 -- 172.21.15.137:0/2758444562 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5a0139ae0 con 0x7fe5a00ce7c0 2024-04-26T23:42:35.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.039+0000 7fe5a8600640 1 -- 172.21.15.137:0/2758444562 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5a01424c0 con 0x7fe5a00ce7c0 2024-04-26T23:42:35.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.043+0000 7fe5a8600640 1 -- 172.21.15.137:0/2758444562 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5a006a4b0 con 0x7fe5a00ce7c0 2024-04-26T23:42:35.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.043+0000 7fe59d600640 1 -- 172.21.15.137:0/2758444562 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe58c01c460 con 0x7fe5a00ce7c0 2024-04-26T23:42:35.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.043+0000 7fe59d600640 1 --2- 172.21.15.137:0/2758444562 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe580068380 0x7fe58006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:35.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.043+0000 7fe59d600640 1 -- 172.21.15.137:0/2758444562 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe58c086550 con 0x7fe5a00ce7c0 2024-04-26T23:42:35.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.043+0000 7fe5a5c00640 1 --2- 172.21.15.137:0/2758444562 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe580068380 0x7fe58006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:35.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.043+0000 7fe5a5c00640 1 --2- 172.21.15.137:0/2758444562 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe580068380 0x7fe58006a840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe5940ae000 tx=0x7fe5940b6040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:35.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.047+0000 7fe59d600640 1 -- 172.21.15.137:0/2758444562 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe58c021020 con 0x7fe5a00ce7c0 2024-04-26T23:42:35.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.207+0000 7fe5a8600640 1 -- 172.21.15.137:0/2758444562 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe5a015e780 con 0x7fe5a00ce7c0 2024-04-26T23:42:35.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.207+0000 7fe59d600640 1 -- 172.21.15.137:0/2758444562 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16717 (secure 0 0 0) 0x7fe58c056420 con 0x7fe5a00ce7c0 2024-04-26T23:42:35.213 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:35.214 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":33,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:42:26.483092+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:42:22.570062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:42:23.822598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:42:35.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.207+0000 7fe5a8600640 1 -- 172.21.15.137:0/2758444562 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe580068380 msgr2=0x7fe58006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:35.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.207+0000 7fe5a8600640 1 --2- 172.21.15.137:0/2758444562 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe580068380 0x7fe58006a840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe5940ae000 tx=0x7fe5940b6040 comp rx=0 tx=0).stop 2024-04-26T23:42:35.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.207+0000 7fe5a8600640 1 -- 172.21.15.137:0/2758444562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5a00ce7c0 msgr2=0x7fe5a00b1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:35.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.207+0000 7fe5a8600640 1 --2- 172.21.15.137:0/2758444562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5a00ce7c0 0x7fe5a00b1680 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe58c00c410 tx=0x7fe58c00c8d0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.207+0000 7fe5a8600640 1 -- 172.21.15.137:0/2758444562 shutdown_connections 2024-04-26T23:42:35.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.207+0000 7fe5a8600640 1 --2- 172.21.15.137:0/2758444562 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe580068380 0x7fe58006a840 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.207+0000 7fe5a8600640 1 --2- 172.21.15.137:0/2758444562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5a00ce7c0 0x7fe5a00b1680 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.207+0000 7fe5a8600640 1 --2- 172.21.15.137:0/2758444562 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5a015de80 0x7fe5a00b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.207+0000 7fe5a8600640 1 --2- 172.21.15.137:0/2758444562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a00ce3e0 0x7fe5a015ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.207+0000 7fe5a8600640 1 -- 172.21.15.137:0/2758444562 >> 172.21.15.137:0/2758444562 conn(0x7fe5a006c5d0 msgr2=0x7fe5a00cd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:35.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.207+0000 7fe5a8600640 1 -- 172.21.15.137:0/2758444562 shutdown_connections 2024-04-26T23:42:35.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.211+0000 7fe5a8600640 1 -- 172.21.15.137:0/2758444562 wait complete. 2024-04-26T23:42:35.235 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:42:22.570062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:42:23.822598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:42:35.236 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:42:35.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.367+0000 7fdbcb800640 1 Processor -- start 2024-04-26T23:42:35.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.367+0000 7fdbcb800640 1 -- start start 2024-04-26T23:42:35.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.367+0000 7fdbcb800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fdbc40b5ee0 0x7fdbc415f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:35.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.367+0000 7fdbcb800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdbc415fe30 0x7fdbc4144d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:35.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.367+0000 7fdbcb800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbc40cffa0 con 0x7fdbc40b54e0 2024-04-26T23:42:35.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.367+0000 7fdbcb800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fdbc40b3d90 con 0x7fdbc40b5ee0 2024-04-26T23:42:35.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.367+0000 7fdbcb800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdbc40d0840 con 0x7fdbc415fe30 2024-04-26T23:42:35.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.367+0000 7fdbc3e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fdbc40b5ee0 0x7fdbc415f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:35.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.367+0000 7fdbc9800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdbc415fe30 0x7fdbc4144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:35.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.367+0000 7fdbc8e00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fdbc40b54e0 0x7fdbc40cd710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:42292/0 (socket says 172.21.15.137:42292) 2024-04-26T23:42:35.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.367+0000 7fdbc8e00640 1 -- 172.21.15.137:0/2881481117 learned_addr learned my addr 172.21.15.137:0/2881481117 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:35.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.371+0000 7fdbc3e00640 1 -- 172.21.15.137:0/2881481117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdbc415fe30 msgr2=0x7fdbc4144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:35.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.371+0000 7fdbc3e00640 1 --2- 172.21.15.137:0/2881481117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdbc415fe30 0x7fdbc4144d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.371+0000 7fdbc3e00640 1 -- 172.21.15.137:0/2881481117 >> v1:172.21.15.170:6789/0 conn(0x7fdbc40b54e0 legacy=0x7fdbc40cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:35.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.371+0000 7fdbc3e00640 1 -- 172.21.15.137:0/2881481117 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc40d0280 con 0x7fdbc40b5ee0 2024-04-26T23:42:35.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.371+0000 7fdbc3e00640 1 --2- 172.21.15.137:0/2881481117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdbc40b5ee0 0x7fdbc415f8f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00097c0 tx=0x7fdbb001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6aecf1f4287c62f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:35.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.371+0000 7fdbc3400640 1 -- 172.21.15.137:0/2881481117 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb00b0070 con 0x7fdbc40b5ee0 2024-04-26T23:42:35.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.371+0000 7fdbc3400640 1 -- 172.21.15.137:0/2881481117 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc4145a70 con 0x7fdbc40b5ee0 2024-04-26T23:42:35.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.371+0000 7fdbc3400640 1 -- 172.21.15.137:0/2881481117 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb00ab820 con 0x7fdbc40b5ee0 2024-04-26T23:42:35.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.371+0000 7fdbcb800640 1 -- 172.21.15.137:0/2881481117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdbc40b5ee0 msgr2=0x7fdbc415f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:35.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.371+0000 7fdbcb800640 1 --2- 172.21.15.137:0/2881481117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdbc40b5ee0 0x7fdbc415f8f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00097c0 tx=0x7fdbb001c4a0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.371+0000 7fdbcb800640 1 -- 172.21.15.137:0/2881481117 shutdown_connections 2024-04-26T23:42:35.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.371+0000 7fdbcb800640 1 --2- 172.21.15.137:0/2881481117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdbc415fe30 0x7fdbc4144d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.371+0000 7fdbcb800640 1 --2- 172.21.15.137:0/2881481117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdbc40b5ee0 0x7fdbc415f8f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.371+0000 7fdbcb800640 1 -- 172.21.15.137:0/2881481117 >> 172.21.15.137:0/2881481117 conn(0x7fdbc406c800 msgr2=0x7fdbc406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:35.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbcb800640 1 -- 172.21.15.137:0/2881481117 shutdown_connections 2024-04-26T23:42:35.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbcb800640 1 -- 172.21.15.137:0/2881481117 wait complete. 2024-04-26T23:42:35.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbcb800640 1 Processor -- start 2024-04-26T23:42:35.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbcb800640 1 -- start start 2024-04-26T23:42:35.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbcb800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdbc40b54e0 0x7fdbc406f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:35.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbcb800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdbc40b5ee0 0x7fdbc406fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:35.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbcb800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdbc415fe30 0x7fdbc4158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:35.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbcb800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc4072630 con 0x7fdbc40b54e0 2024-04-26T23:42:35.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbcb800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc40724b0 con 0x7fdbc40b5ee0 2024-04-26T23:42:35.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbcb800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdbc40727b0 con 0x7fdbc415fe30 2024-04-26T23:42:35.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbc8e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdbc40b54e0 0x7fdbc406f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:35.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbc8e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdbc40b54e0 0x7fdbc406f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43186/0 (socket says 172.21.15.137:43186) 2024-04-26T23:42:35.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbc8e00640 1 -- 172.21.15.137:0/1793461862 learned_addr learned my addr 172.21.15.137:0/1793461862 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:35.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbc3e00640 1 --2- 172.21.15.137:0/1793461862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdbc40b5ee0 0x7fdbc406fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:35.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbc9800640 1 --2- 172.21.15.137:0/1793461862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdbc415fe30 0x7fdbc4158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:35.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbc8e00640 1 -- 172.21.15.137:0/1793461862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdbc415fe30 msgr2=0x7fdbc4158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:35.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbc8e00640 1 --2- 172.21.15.137:0/1793461862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdbc415fe30 0x7fdbc4158f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbc8e00640 1 -- 172.21.15.137:0/1793461862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdbc40b5ee0 msgr2=0x7fdbc406fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:35.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbc8e00640 1 --2- 172.21.15.137:0/1793461862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdbc40b5ee0 0x7fdbc406fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbc8e00640 1 -- 172.21.15.137:0/1793461862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc4159bd0 con 0x7fdbc40b54e0 2024-04-26T23:42:35.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbc9800640 1 --2- 172.21.15.137:0/1793461862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdbc415fe30 0x7fdbc4158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:35.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbc8e00640 1 --2- 172.21.15.137:0/1793461862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdbc40b54e0 0x7fdbc406f500 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400c450 tx=0x7fdbb400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:35.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbc0c00640 1 -- 172.21.15.137:0/1793461862 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4017070 con 0x7fdbc40b54e0 2024-04-26T23:42:35.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbc0c00640 1 -- 172.21.15.137:0/1793461862 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbb4005cf0 con 0x7fdbc40b54e0 2024-04-26T23:42:35.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbcb800640 1 -- 172.21.15.137:0/1793461862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc4159eb0 con 0x7fdbc40b54e0 2024-04-26T23:42:35.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbc0c00640 1 -- 172.21.15.137:0/1793461862 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4007290 con 0x7fdbc40b54e0 2024-04-26T23:42:35.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.375+0000 7fdbcb800640 1 -- 172.21.15.137:0/1793461862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc415a470 con 0x7fdbc40b54e0 2024-04-26T23:42:35.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.379+0000 7fdbcb800640 1 -- 172.21.15.137:0/1793461862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbc41f62f0 con 0x7fdbc40b54e0 2024-04-26T23:42:35.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.379+0000 7fdbc0c00640 1 -- 172.21.15.137:0/1793461862 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdbb401a070 con 0x7fdbc40b54e0 2024-04-26T23:42:35.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.379+0000 7fdbc0c00640 1 --2- 172.21.15.137:0/1793461862 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdba40683b0 0x7fdba406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:35.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.379+0000 7fdbc0c00640 1 -- 172.21.15.137:0/1793461862 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fdbb4085d70 con 0x7fdbc40b54e0 2024-04-26T23:42:35.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.379+0000 7fdbc3e00640 1 --2- 172.21.15.137:0/1793461862 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdba40683b0 0x7fdba406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:35.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.379+0000 7fdbc3e00640 1 --2- 172.21.15.137:0/1793461862 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdba40683b0 0x7fdba406a870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00ad000 tx=0x7fdbb0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:35.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.383+0000 7fdbc0c00640 1 -- 172.21.15.137:0/1793461862 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdbc41f62f0 con 0x7fdbc40b54e0 2024-04-26T23:42:35.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.539+0000 7fdbcb800640 1 -- 172.21.15.137:0/1793461862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdbc406a410 con 0x7fdbc40b54e0 2024-04-26T23:42:35.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.543+0000 7fdbc0c00640 1 -- 172.21.15.137:0/1793461862 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) ==== 93+0+10 (secure 0 0 0) 0x7fdbb40562a0 con 0x7fdbc40b54e0 2024-04-26T23:42:35.548 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:42:35.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.543+0000 7fdbcb800640 1 -- 172.21.15.137:0/1793461862 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdba40683b0 msgr2=0x7fdba406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:35.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.543+0000 7fdbcb800640 1 --2- 172.21.15.137:0/1793461862 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdba40683b0 0x7fdba406a870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00ad000 tx=0x7fdbb0008040 comp rx=0 tx=0).stop 2024-04-26T23:42:35.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.543+0000 7fdbcb800640 1 -- 172.21.15.137:0/1793461862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdbc40b54e0 msgr2=0x7fdbc406f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:35.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.543+0000 7fdbcb800640 1 --2- 172.21.15.137:0/1793461862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdbc40b54e0 0x7fdbc406f500 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400c450 tx=0x7fdbb400c910 comp rx=0 tx=0).stop 2024-04-26T23:42:35.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.543+0000 7fdbcb800640 1 -- 172.21.15.137:0/1793461862 shutdown_connections 2024-04-26T23:42:35.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.543+0000 7fdbcb800640 1 --2- 172.21.15.137:0/1793461862 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdba40683b0 0x7fdba406a870 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.543+0000 7fdbcb800640 1 --2- 172.21.15.137:0/1793461862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdbc415fe30 0x7fdbc4158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.543+0000 7fdbcb800640 1 --2- 172.21.15.137:0/1793461862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdbc40b5ee0 0x7fdbc406fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.543+0000 7fdbcb800640 1 --2- 172.21.15.137:0/1793461862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdbc40b54e0 0x7fdbc406f500 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.543+0000 7fdbcb800640 1 -- 172.21.15.137:0/1793461862 >> 172.21.15.137:0/1793461862 conn(0x7fdbc406c800 msgr2=0x7fdbc40cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:35.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.543+0000 7fdbcb800640 1 -- 172.21.15.137:0/1793461862 shutdown_connections 2024-04-26T23:42:35.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.543+0000 7fdbcb800640 1 -- 172.21.15.137:0/1793461862 wait complete. 2024-04-26T23:42:35.569 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:42:35.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.703+0000 7f8dc1200640 1 Processor -- start 2024-04-26T23:42:35.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.703+0000 7f8dc1200640 1 -- start start 2024-04-26T23:42:35.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.703+0000 7f8dc1200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8dbc0afbc0 0x7f8dbc15df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:35.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.703+0000 7f8dc1200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dbc072860 con 0x7f8dbc0affa0 2024-04-26T23:42:35.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.703+0000 7f8dc1200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dbc0743b0 con 0x7f8dbc073f20 2024-04-26T23:42:35.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.703+0000 7f8dc1200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8dbc072b00 con 0x7f8dbc0afbc0 2024-04-26T23:42:35.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.703+0000 7f8dba800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f8dbc0affa0 0x7f8dbc0ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50156/0 (socket says 172.21.15.137:50156) 2024-04-26T23:42:35.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.703+0000 7f8dba800640 1 -- 172.21.15.137:0/3113485061 learned_addr learned my addr 172.21.15.137:0/3113485061 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:35.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.703+0000 7f8db9e00640 1 --2- 172.21.15.137:0/3113485061 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8dbc0afbc0 0x7f8dbc15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:35.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.703+0000 7f8db8a00640 1 -- 172.21.15.137:0/3113485061 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2250194880 0 0) 0x7f8dbc072860 con 0x7f8dbc0affa0 2024-04-26T23:42:35.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.703+0000 7f8db8a00640 1 -- 172.21.15.137:0/3113485061 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8da0003530 con 0x7f8dbc0affa0 2024-04-26T23:42:35.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.703+0000 7f8db8a00640 1 -- 172.21.15.137:0/3113485061 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3858422604 0 0) 0x7f8dbc0743b0 con 0x7f8dbc073f20 2024-04-26T23:42:35.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.703+0000 7f8db8a00640 1 -- 172.21.15.137:0/3113485061 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dbc072860 con 0x7f8dbc073f20 2024-04-26T23:42:35.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.703+0000 7f8db9e00640 1 -- 172.21.15.137:0/3113485061 >> v1:172.21.15.170:6789/0 conn(0x7f8dbc073f20 legacy=0x7f8dbc0735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:35.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.703+0000 7f8db9e00640 1 -- 172.21.15.137:0/3113485061 >> v1:172.21.15.137:6789/0 conn(0x7f8dbc0affa0 legacy=0x7f8dbc0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:35.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.703+0000 7f8db9e00640 1 -- 172.21.15.137:0/3113485061 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dbc072de0 con 0x7f8dbc0afbc0 2024-04-26T23:42:35.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.707+0000 7f8db9e00640 1 --2- 172.21.15.137:0/3113485061 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8dbc0afbc0 0x7f8dbc15df90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0097f0 tx=0x7f8dac01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6a4cf32e1ae6a67 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:35.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.707+0000 7f8db8a00640 1 -- 172.21.15.137:0/3113485061 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0b1070 con 0x7f8dbc0afbc0 2024-04-26T23:42:35.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.707+0000 7f8db8a00640 1 -- 172.21.15.137:0/3113485061 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dac0ac5f0 con 0x7f8dbc0afbc0 2024-04-26T23:42:35.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.707+0000 7f8db8a00640 1 -- 172.21.15.137:0/3113485061 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0ac9a0 con 0x7f8dbc0afbc0 2024-04-26T23:42:35.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.707+0000 7f8dc1200640 1 -- 172.21.15.137:0/3113485061 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8dbc0afbc0 msgr2=0x7f8dbc15df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:35.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.707+0000 7f8dc1200640 1 --2- 172.21.15.137:0/3113485061 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8dbc0afbc0 0x7f8dbc15df90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0097f0 tx=0x7f8dac01c4e0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.707+0000 7f8dc1200640 1 -- 172.21.15.137:0/3113485061 shutdown_connections 2024-04-26T23:42:35.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.707+0000 7f8dc1200640 1 --2- 172.21.15.137:0/3113485061 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8dbc0afbc0 0x7f8dbc15df90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.707+0000 7f8dc1200640 1 -- 172.21.15.137:0/3113485061 >> 172.21.15.137:0/3113485061 conn(0x7f8dbc06c800 msgr2=0x7f8dbc06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:35.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.707+0000 7f8dc1200640 1 -- 172.21.15.137:0/3113485061 shutdown_connections 2024-04-26T23:42:35.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.707+0000 7f8dc1200640 1 -- 172.21.15.137:0/3113485061 wait complete. 2024-04-26T23:42:35.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8dc1200640 1 Processor -- start 2024-04-26T23:42:35.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8dc1200640 1 -- start start 2024-04-26T23:42:35.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8dc1200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8dbc0afbc0 0x7f8dbc14fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:35.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8dc1200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8dbc0affa0 0x7f8dbc147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:35.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8dc1200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8dbc147ec0 0x7f8dbc0b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:35.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8dc1200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc06ffe0 con 0x7f8dbc147ec0 2024-04-26T23:42:35.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8dc1200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc0ced10 con 0x7f8dbc0affa0 2024-04-26T23:42:35.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8dc1200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8dbc070160 con 0x7f8dbc0afbc0 2024-04-26T23:42:35.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8dba800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8dbc147ec0 0x7f8dbc0b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:35.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8dba800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8dbc147ec0 0x7f8dbc0b2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43190/0 (socket says 172.21.15.137:43190) 2024-04-26T23:42:35.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8dba800640 1 -- 172.21.15.137:0/2607663291 learned_addr learned my addr 172.21.15.137:0/2607663291 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:35.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8db9400640 1 --2- 172.21.15.137:0/2607663291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8dbc0affa0 0x7f8dbc147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:35.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8db9e00640 1 --2- 172.21.15.137:0/2607663291 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8dbc0afbc0 0x7f8dbc14fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:35.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8dba800640 1 -- 172.21.15.137:0/2607663291 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8dbc0afbc0 msgr2=0x7f8dbc14fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:35.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8dba800640 1 --2- 172.21.15.137:0/2607663291 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8dbc0afbc0 0x7f8dbc14fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8dba800640 1 -- 172.21.15.137:0/2607663291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8dbc0affa0 msgr2=0x7f8dbc147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:35.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8dba800640 1 --2- 172.21.15.137:0/2607663291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8dbc0affa0 0x7f8dbc147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8dba800640 1 -- 172.21.15.137:0/2607663291 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dbc150770 con 0x7f8dbc147ec0 2024-04-26T23:42:35.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8dba800640 1 --2- 172.21.15.137:0/2607663291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8dbc147ec0 0x7f8dbc0b2130 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8db400cb10 tx=0x7f8db400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:35.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8db2000640 1 -- 172.21.15.137:0/2607663291 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db4017070 con 0x7f8dbc147ec0 2024-04-26T23:42:35.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8db2000640 1 -- 172.21.15.137:0/2607663291 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db400ac70 con 0x7f8dbc147ec0 2024-04-26T23:42:35.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8db2000640 1 -- 172.21.15.137:0/2607663291 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db400ae60 con 0x7f8dbc147ec0 2024-04-26T23:42:35.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8dc1200640 1 -- 172.21.15.137:0/2607663291 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dbc150a50 con 0x7f8dbc147ec0 2024-04-26T23:42:35.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8dc1200640 1 -- 172.21.15.137:0/2607663291 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dbc151010 con 0x7f8dbc147ec0 2024-04-26T23:42:35.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.711+0000 7f8dc1200640 1 -- 172.21.15.137:0/2607663291 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dbc06a410 con 0x7f8dbc147ec0 2024-04-26T23:42:35.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.715+0000 7f8db2000640 1 -- 172.21.15.137:0/2607663291 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8db401a070 con 0x7f8dbc147ec0 2024-04-26T23:42:35.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.715+0000 7f8db2000640 1 --2- 172.21.15.137:0/2607663291 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8d9c068380 0x7f8d9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:35.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.715+0000 7f8db2000640 1 -- 172.21.15.137:0/2607663291 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f8db40867f0 con 0x7f8dbc147ec0 2024-04-26T23:42:35.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.715+0000 7f8db9e00640 1 --2- 172.21.15.137:0/2607663291 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8d9c068380 0x7f8d9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:35.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.715+0000 7f8db9e00640 1 --2- 172.21.15.137:0/2607663291 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8d9c068380 0x7f8d9c06a840 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0ae000 tx=0x7f8dac0a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:35.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.719+0000 7f8db2000640 1 -- 172.21.15.137:0/2607663291 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8db4056630 con 0x7f8dbc147ec0 2024-04-26T23:42:35.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.875+0000 7f8dc1200640 1 -- 172.21.15.137:0/2607663291 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8dbc1526f0 con 0x7f8dbc147ec0 2024-04-26T23:42:35.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.875+0000 7f8db2000640 1 -- 172.21.15.137:0/2607663291 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) ==== 104+0+11 (secure 0 0 0) 0x7f8db405a930 con 0x7f8dbc147ec0 2024-04-26T23:42:35.883 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:42:35.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.879+0000 7f8dc1200640 1 -- 172.21.15.137:0/2607663291 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8d9c068380 msgr2=0x7f8d9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:35.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.879+0000 7f8dc1200640 1 --2- 172.21.15.137:0/2607663291 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8d9c068380 0x7f8d9c06a840 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0ae000 tx=0x7f8dac0a7000 comp rx=0 tx=0).stop 2024-04-26T23:42:35.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.879+0000 7f8dc1200640 1 -- 172.21.15.137:0/2607663291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8dbc147ec0 msgr2=0x7f8dbc0b2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:35.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.879+0000 7f8dc1200640 1 --2- 172.21.15.137:0/2607663291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8dbc147ec0 0x7f8dbc0b2130 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8db400cb10 tx=0x7f8db400a060 comp rx=0 tx=0).stop 2024-04-26T23:42:35.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.879+0000 7f8dc1200640 1 -- 172.21.15.137:0/2607663291 shutdown_connections 2024-04-26T23:42:35.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.879+0000 7f8dc1200640 1 --2- 172.21.15.137:0/2607663291 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8d9c068380 0x7f8d9c06a840 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.879+0000 7f8dc1200640 1 --2- 172.21.15.137:0/2607663291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8dbc147ec0 0x7f8dbc0b2130 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.879+0000 7f8dc1200640 1 --2- 172.21.15.137:0/2607663291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8dbc0affa0 0x7f8dbc147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.879+0000 7f8dc1200640 1 --2- 172.21.15.137:0/2607663291 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8dbc0afbc0 0x7f8dbc14fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:35.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.879+0000 7f8dc1200640 1 -- 172.21.15.137:0/2607663291 >> 172.21.15.137:0/2607663291 conn(0x7f8dbc06c800 msgr2=0x7f8dbc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:35.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.879+0000 7f8dc1200640 1 -- 172.21.15.137:0/2607663291 shutdown_connections 2024-04-26T23:42:35.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:35.879+0000 7f8dc1200640 1 -- 172.21.15.137:0/2607663291 wait complete. 2024-04-26T23:42:35.904 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:42:36.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.035+0000 7f5a93000640 1 Processor -- start 2024-04-26T23:42:36.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.035+0000 7f5a93000640 1 -- start start 2024-04-26T23:42:36.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.039+0000 7f5a93000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a8c0afbc0 0x7f5a8c15df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:36.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.039+0000 7f5a93000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5a8c0affa0 0x7f5a8c0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:36.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.039+0000 7f5a93000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a8c072860 con 0x7f5a8c073f20 2024-04-26T23:42:36.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.039+0000 7f5a93000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5a8c0743b0 con 0x7f5a8c0affa0 2024-04-26T23:42:36.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.039+0000 7f5a93000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5a8c072b00 con 0x7f5a8c0afbc0 2024-04-26T23:42:36.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.039+0000 7f5a91000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5a8c0affa0 0x7f5a8c0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:36.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.039+0000 7f5a91000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5a8c0affa0 0x7f5a8c0ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43198/0 (socket says 172.21.15.137:43198) 2024-04-26T23:42:36.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.039+0000 7f5a91000640 1 -- 172.21.15.137:0/982689326 learned_addr learned my addr 172.21.15.137:0/982689326 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:36.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.039+0000 7f5a8be00640 1 --2- 172.21.15.137:0/982689326 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a8c0afbc0 0x7f5a8c15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:36.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.039+0000 7f5a91000640 1 -- 172.21.15.137:0/982689326 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a8c0afbc0 msgr2=0x7f5a8c15df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:36.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.039+0000 7f5a91000640 1 --2- 172.21.15.137:0/982689326 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a8c0afbc0 0x7f5a8c15df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.039+0000 7f5a91000640 1 -- 172.21.15.137:0/982689326 >> v1:172.21.15.170:6789/0 conn(0x7f5a8c073f20 legacy=0x7f5a8c0735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:36.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.039+0000 7f5a91000640 1 -- 172.21.15.137:0/982689326 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8c072de0 con 0x7f5a8c0affa0 2024-04-26T23:42:36.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.043+0000 7f5a91000640 1 --2- 172.21.15.137:0/982689326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a8c0affa0 0x7f5a8c0ce3b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5a84009e50 tx=0x7f5a8401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ee82248f8b049e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:36.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.043+0000 7f5a8b400640 1 -- 172.21.15.137:0/982689326 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a840a5700 con 0x7f5a8c0affa0 2024-04-26T23:42:36.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.043+0000 7f5a8b400640 1 -- 172.21.15.137:0/982689326 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a840a58a0 con 0x7f5a8c0affa0 2024-04-26T23:42:36.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.043+0000 7f5a8b400640 1 -- 172.21.15.137:0/982689326 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a840a5c70 con 0x7f5a8c0affa0 2024-04-26T23:42:36.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.043+0000 7f5a93000640 1 -- 172.21.15.137:0/982689326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a8c0affa0 msgr2=0x7f5a8c0ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:36.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.043+0000 7f5a93000640 1 --2- 172.21.15.137:0/982689326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a8c0affa0 0x7f5a8c0ce3b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5a84009e50 tx=0x7f5a8401ca30 comp rx=0 tx=0).stop 2024-04-26T23:42:36.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.043+0000 7f5a93000640 1 -- 172.21.15.137:0/982689326 shutdown_connections 2024-04-26T23:42:36.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.043+0000 7f5a93000640 1 --2- 172.21.15.137:0/982689326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a8c0affa0 0x7f5a8c0ce3b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.043+0000 7f5a93000640 1 --2- 172.21.15.137:0/982689326 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a8c0afbc0 0x7f5a8c15df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.043+0000 7f5a93000640 1 -- 172.21.15.137:0/982689326 >> 172.21.15.137:0/982689326 conn(0x7f5a8c06c800 msgr2=0x7f5a8c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:36.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.043+0000 7f5a93000640 1 -- 172.21.15.137:0/982689326 shutdown_connections 2024-04-26T23:42:36.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.043+0000 7f5a93000640 1 -- 172.21.15.137:0/982689326 wait complete. 2024-04-26T23:42:36.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.043+0000 7f5a93000640 1 Processor -- start 2024-04-26T23:42:36.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.043+0000 7f5a93000640 1 -- start start 2024-04-26T23:42:36.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.043+0000 7f5a93000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a8c0afbc0 0x7f5a8c152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:36.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.043+0000 7f5a93000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a8c0affa0 0x7f5a8c14d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:36.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.043+0000 7f5a93000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a8c15bbb0 0x7f5a8c15c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:36.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.043+0000 7f5a93000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8c06f3e0 con 0x7f5a8c0afbc0 2024-04-26T23:42:36.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.043+0000 7f5a93000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8c06f260 con 0x7f5a8c15bbb0 2024-04-26T23:42:36.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.043+0000 7f5a93000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5a8c06f560 con 0x7f5a8c0affa0 2024-04-26T23:42:36.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.047+0000 7f5a8be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a8c0afbc0 0x7f5a8c152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:36.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.047+0000 7f5a8be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a8c0afbc0 0x7f5a8c152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43208/0 (socket says 172.21.15.137:43208) 2024-04-26T23:42:36.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.047+0000 7f5a8be00640 1 -- 172.21.15.137:0/25390627 learned_addr learned my addr 172.21.15.137:0/25390627 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:36.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.047+0000 7f5a83e00640 1 --2- 172.21.15.137:0/25390627 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a8c0affa0 0x7f5a8c14d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:36.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.047+0000 7f5a91000640 1 --2- 172.21.15.137:0/25390627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a8c15bbb0 0x7f5a8c15c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:36.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.047+0000 7f5a8be00640 1 -- 172.21.15.137:0/25390627 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a8c0affa0 msgr2=0x7f5a8c14d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:36.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.047+0000 7f5a8be00640 1 --2- 172.21.15.137:0/25390627 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a8c0affa0 0x7f5a8c14d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.047+0000 7f5a8be00640 1 -- 172.21.15.137:0/25390627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a8c15bbb0 msgr2=0x7f5a8c15c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:36.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.047+0000 7f5a8be00640 1 --2- 172.21.15.137:0/25390627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a8c15bbb0 0x7f5a8c15c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.047+0000 7f5a8be00640 1 -- 172.21.15.137:0/25390627 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8c0b2f40 con 0x7f5a8c0afbc0 2024-04-26T23:42:36.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.047+0000 7f5a8be00640 1 --2- 172.21.15.137:0/25390627 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a8c0afbc0 0x7f5a8c152af0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c00d800 tx=0x7f5a7c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:36.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.047+0000 7f5a88c00640 1 -- 172.21.15.137:0/25390627 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c00b6c0 con 0x7f5a8c0afbc0 2024-04-26T23:42:36.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.047+0000 7f5a88c00640 1 -- 172.21.15.137:0/25390627 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a7c019070 con 0x7f5a8c0afbc0 2024-04-26T23:42:36.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.047+0000 7f5a93000640 1 -- 172.21.15.137:0/25390627 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a8c0b5870 con 0x7f5a8c0afbc0 2024-04-26T23:42:36.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.047+0000 7f5a88c00640 1 -- 172.21.15.137:0/25390627 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c00ba60 con 0x7f5a8c0afbc0 2024-04-26T23:42:36.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.047+0000 7f5a93000640 1 -- 172.21.15.137:0/25390627 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a8c155780 con 0x7f5a8c0afbc0 2024-04-26T23:42:36.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.047+0000 7f5a93000640 1 -- 172.21.15.137:0/25390627 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a8c06a410 con 0x7f5a8c0afbc0 2024-04-26T23:42:36.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.047+0000 7f5a88c00640 1 -- 172.21.15.137:0/25390627 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5a7c00bc00 con 0x7f5a8c0afbc0 2024-04-26T23:42:36.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.051+0000 7f5a88c00640 1 --2- 172.21.15.137:0/25390627 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5a680683d0 0x7f5a6806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:36.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.051+0000 7f5a88c00640 1 -- 172.21.15.137:0/25390627 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f5a7c086ed0 con 0x7f5a8c0afbc0 2024-04-26T23:42:36.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.051+0000 7f5a83e00640 1 --2- 172.21.15.137:0/25390627 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5a680683d0 0x7f5a6806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:36.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.051+0000 7f5a83e00640 1 --2- 172.21.15.137:0/25390627 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5a680683d0 0x7f5a6806a890 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c15e3a0 tx=0x7f5a74009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:36.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.055+0000 7f5a88c00640 1 -- 172.21.15.137:0/25390627 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5a7c057470 con 0x7f5a8c0afbc0 2024-04-26T23:42:36.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.211+0000 7f5a93000640 1 -- 172.21.15.137:0/25390627 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5a8c160870 con 0x7f5a8c0afbc0 2024-04-26T23:42:36.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.211+0000 7f5a88c00640 1 -- 172.21.15.137:0/25390627 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) ==== 100+0+11 (secure 0 0 0) 0x7f5a7c056d70 con 0x7f5a8c0afbc0 2024-04-26T23:42:36.217 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:42:36.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.211+0000 7f5a93000640 1 -- 172.21.15.137:0/25390627 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5a680683d0 msgr2=0x7f5a6806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:36.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.211+0000 7f5a93000640 1 --2- 172.21.15.137:0/25390627 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5a680683d0 0x7f5a6806a890 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c15e3a0 tx=0x7f5a74009040 comp rx=0 tx=0).stop 2024-04-26T23:42:36.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.211+0000 7f5a93000640 1 -- 172.21.15.137:0/25390627 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a8c0afbc0 msgr2=0x7f5a8c152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:36.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.211+0000 7f5a93000640 1 --2- 172.21.15.137:0/25390627 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a8c0afbc0 0x7f5a8c152af0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c00d800 tx=0x7f5a7c00dcc0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.211+0000 7f5a93000640 1 -- 172.21.15.137:0/25390627 shutdown_connections 2024-04-26T23:42:36.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.211+0000 7f5a93000640 1 --2- 172.21.15.137:0/25390627 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5a680683d0 0x7f5a6806a890 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.211+0000 7f5a93000640 1 --2- 172.21.15.137:0/25390627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a8c15bbb0 0x7f5a8c15c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.211+0000 7f5a93000640 1 --2- 172.21.15.137:0/25390627 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a8c0affa0 0x7f5a8c14d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.211+0000 7f5a93000640 1 --2- 172.21.15.137:0/25390627 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a8c0afbc0 0x7f5a8c152af0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.211+0000 7f5a93000640 1 -- 172.21.15.137:0/25390627 >> 172.21.15.137:0/25390627 conn(0x7f5a8c06c800 msgr2=0x7f5a8c0b0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:36.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.211+0000 7f5a93000640 1 -- 172.21.15.137:0/25390627 shutdown_connections 2024-04-26T23:42:36.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.211+0000 7f5a93000640 1 -- 172.21.15.137:0/25390627 wait complete. 2024-04-26T23:42:36.238 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:42:36.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.367+0000 7f7aa6200640 1 Processor -- start 2024-04-26T23:42:36.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.367+0000 7f7aa6200640 1 -- start start 2024-04-26T23:42:36.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.367+0000 7f7aa6200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7aa0148950 0x7f7aa015fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:36.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.367+0000 7f7aa6200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aa0148d30 con 0x7f7aa00b4ad0 2024-04-26T23:42:36.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.367+0000 7f7aa6200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aa0073540 con 0x7f7aa006f8a0 2024-04-26T23:42:36.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.367+0000 7f7aa6200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f7aa0073820 con 0x7f7aa0148950 2024-04-26T23:42:36.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.367+0000 7f7a96a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f7aa00b4ad0 0x7f7aa006f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50160/0 (socket says 172.21.15.137:50160) 2024-04-26T23:42:36.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.367+0000 7f7a96a00640 1 -- 172.21.15.137:0/1327343343 learned_addr learned my addr 172.21.15.137:0/1327343343 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:36.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a9f400640 1 --2- 172.21.15.137:0/1327343343 >> v2:172.21.15.170:3300/0 conn(0x7f7aa0148950 0x7f7aa015fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:36.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a9ea00640 1 -- 172.21.15.137:0/1327343343 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4233662618 0 0) 0x7f7aa0148d30 con 0x7f7aa00b4ad0 2024-04-26T23:42:36.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a9ea00640 1 -- 172.21.15.137:0/1327343343 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a84003530 con 0x7f7aa00b4ad0 2024-04-26T23:42:36.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a9ea00640 1 -- 172.21.15.137:0/1327343343 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1907813859 0 0) 0x7f7aa0073540 con 0x7f7aa006f8a0 2024-04-26T23:42:36.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a9ea00640 1 -- 172.21.15.137:0/1327343343 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7aa0148d30 con 0x7f7aa006f8a0 2024-04-26T23:42:36.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a9ea00640 1 -- 172.21.15.137:0/1327343343 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 493429277 0 0) 0x7f7a84003530 con 0x7f7aa00b4ad0 2024-04-26T23:42:36.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a9ea00640 1 -- 172.21.15.137:0/1327343343 >> v2:172.21.15.170:3300/0 conn(0x7f7aa0148950 msgr2=0x7f7aa015fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:36.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a9ea00640 1 --2- 172.21.15.137:0/1327343343 >> v2:172.21.15.170:3300/0 conn(0x7f7aa0148950 0x7f7aa015fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a9ea00640 1 -- 172.21.15.137:0/1327343343 >> v1:172.21.15.170:6789/0 conn(0x7f7aa006f8a0 legacy=0x7f7aa00ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:36.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a9ea00640 1 -- 172.21.15.137:0/1327343343 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa0073b00 con 0x7f7aa00b4ad0 2024-04-26T23:42:36.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a9ea00640 1 -- 172.21.15.137:0/1327343343 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f7a88001680 con 0x7f7aa00b4ad0 2024-04-26T23:42:36.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a9f400640 1 --2- 172.21.15.137:0/1327343343 >> v2:172.21.15.170:3300/0 conn(0x7f7aa0148950 0x7f7aa015fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:42:36.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a9ea00640 1 -- 172.21.15.137:0/1327343343 >> v1:172.21.15.137:6789/0 conn(0x7f7aa00b4ad0 legacy=0x7f7aa006f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:36.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a9ea00640 1 --2- 172.21.15.137:0/1327343343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a84003b50 0x7f7a84003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:36.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a9ea00640 1 --2- 172.21.15.137:0/1327343343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a84004810 0x7f7a84004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:36.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a9ea00640 1 --2- 172.21.15.137:0/1327343343 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7a840051d0 0x7f7a8400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:36.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a9ea00640 1 -- 172.21.15.137:0/1327343343 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa0073820 con 0x7f7a84004810 2024-04-26T23:42:36.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a9ea00640 1 -- 172.21.15.137:0/1327343343 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8400c050 con 0x7f7a84003b50 2024-04-26T23:42:36.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a9ea00640 1 -- 172.21.15.137:0/1327343343 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7a8400c250 con 0x7f7a840051d0 2024-04-26T23:42:36.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a96a00640 1 --2- 172.21.15.137:0/1327343343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a84004810 0x7f7a84004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:36.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a9f400640 1 --2- 172.21.15.137:0/1327343343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a84003b50 0x7f7a84003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:36.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a9fe00640 1 --2- 172.21.15.137:0/1327343343 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7a840051d0 0x7f7a8400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:36.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a96a00640 1 -- 172.21.15.137:0/1327343343 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7a840051d0 msgr2=0x7f7a8400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:36.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a96a00640 1 --2- 172.21.15.137:0/1327343343 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7a840051d0 0x7f7a8400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a96a00640 1 -- 172.21.15.137:0/1327343343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a84003b50 msgr2=0x7f7a84003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:36.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a96a00640 1 --2- 172.21.15.137:0/1327343343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a84003b50 0x7f7a84003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a96a00640 1 -- 172.21.15.137:0/1327343343 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a84003530 con 0x7f7a84004810 2024-04-26T23:42:36.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.371+0000 7f7a9fe00640 1 -- 172.21.15.137:0/1327343343 reap_dead start 2024-04-26T23:42:36.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.375+0000 7f7a96a00640 1 --2- 172.21.15.137:0/1327343343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a84004810 0x7f7a84004c90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800c190 tx=0x7f7a8801cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc258bce3981570 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:36.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.375+0000 7f7a9ea00640 1 -- 172.21.15.137:0/1327343343 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a88007cd0 con 0x7f7a84004810 2024-04-26T23:42:36.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.375+0000 7f7a9ea00640 1 -- 172.21.15.137:0/1327343343 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a880a9020 con 0x7f7a84004810 2024-04-26T23:42:36.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.375+0000 7f7a9ea00640 1 -- 172.21.15.137:0/1327343343 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a880a5b00 con 0x7f7a84004810 2024-04-26T23:42:36.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.375+0000 7f7aa6200640 1 -- 172.21.15.137:0/1327343343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a84004810 msgr2=0x7f7a84004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:36.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.375+0000 7f7aa6200640 1 --2- 172.21.15.137:0/1327343343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a84004810 0x7f7a84004c90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800c190 tx=0x7f7a8801cc00 comp rx=0 tx=0).stop 2024-04-26T23:42:36.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.375+0000 7f7aa6200640 1 -- 172.21.15.137:0/1327343343 shutdown_connections 2024-04-26T23:42:36.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.375+0000 7f7aa6200640 1 --2- 172.21.15.137:0/1327343343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a84004810 0x7f7a84004c90 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.375+0000 7f7aa6200640 1 -- 172.21.15.137:0/1327343343 >> 172.21.15.137:0/1327343343 conn(0x7f7aa006c5d0 msgr2=0x7f7aa006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:36.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.375+0000 7f7aa6200640 1 -- 172.21.15.137:0/1327343343 shutdown_connections 2024-04-26T23:42:36.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.375+0000 7f7aa6200640 1 -- 172.21.15.137:0/1327343343 wait complete. 2024-04-26T23:42:36.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.375+0000 7f7aa6200640 1 Processor -- start 2024-04-26T23:42:36.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.375+0000 7f7aa6200640 1 -- start start 2024-04-26T23:42:36.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.375+0000 7f7aa6200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7a84004810 0x7f7aa01420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:36.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.375+0000 7f7aa6200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7aa01e5650 0x7f7aa01f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:36.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.375+0000 7f7aa6200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7aa01f51c0 0x7f7aa01f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:36.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.375+0000 7f7aa6200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa0073320 con 0x7f7aa01e5650 2024-04-26T23:42:36.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.375+0000 7f7aa6200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa00731a0 con 0x7f7aa01f51c0 2024-04-26T23:42:36.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.375+0000 7f7aa6200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7aa0074300 con 0x7f7a84004810 2024-04-26T23:42:36.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.379+0000 7f7a96a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7aa01e5650 0x7f7aa01f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:36.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.379+0000 7f7a96a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7aa01e5650 0x7f7aa01f4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43230/0 (socket says 172.21.15.137:43230) 2024-04-26T23:42:36.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.379+0000 7f7a96a00640 1 -- 172.21.15.137:0/180671110 learned_addr learned my addr 172.21.15.137:0/180671110 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:36.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.379+0000 7f7a96a00640 1 -- 172.21.15.137:0/180671110 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7a84004810 msgr2=0x7f7aa01420d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:36.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.379+0000 7f7a96a00640 1 --2- 172.21.15.137:0/180671110 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7a84004810 0x7f7aa01420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.379+0000 7f7a96a00640 1 -- 172.21.15.137:0/180671110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7aa01f51c0 msgr2=0x7f7aa01f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:36.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.379+0000 7f7a96a00640 1 --2- 172.21.15.137:0/180671110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7aa01f51c0 0x7f7aa01f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.379+0000 7f7a96a00640 1 -- 172.21.15.137:0/180671110 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa0142610 con 0x7f7aa01e5650 2024-04-26T23:42:36.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.379+0000 7f7a96a00640 1 --2- 172.21.15.137:0/180671110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7aa01e5650 0x7f7aa01f4c80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7a880ab040 tx=0x7f7a84005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:36.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.379+0000 7f7a97e00640 1 -- 172.21.15.137:0/180671110 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a880a5d10 con 0x7f7aa01e5650 2024-04-26T23:42:36.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.379+0000 7f7a97e00640 1 -- 172.21.15.137:0/180671110 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a880b2070 con 0x7f7aa01e5650 2024-04-26T23:42:36.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.379+0000 7f7a97e00640 1 -- 172.21.15.137:0/180671110 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a880049f0 con 0x7f7aa01e5650 2024-04-26T23:42:36.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.379+0000 7f7aa6200640 1 -- 172.21.15.137:0/180671110 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa01f5b40 con 0x7f7aa01e5650 2024-04-26T23:42:36.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.379+0000 7f7aa6200640 1 -- 172.21.15.137:0/180671110 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aa00cf700 con 0x7f7aa01e5650 2024-04-26T23:42:36.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.379+0000 7f7aa6200640 1 -- 172.21.15.137:0/180671110 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aa006a4b0 con 0x7f7aa01e5650 2024-04-26T23:42:36.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.379+0000 7f7a97e00640 1 -- 172.21.15.137:0/180671110 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7a88004b90 con 0x7f7aa01e5650 2024-04-26T23:42:36.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.379+0000 7f7a97e00640 1 --2- 172.21.15.137:0/180671110 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7a7c068380 0x7f7a7c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:36.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.383+0000 7f7a97e00640 1 -- 172.21.15.137:0/180671110 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f7a88120390 con 0x7f7aa01e5650 2024-04-26T23:42:36.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.383+0000 7f7a9f400640 1 --2- 172.21.15.137:0/180671110 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7a7c068380 0x7f7a7c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:36.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.383+0000 7f7a9f400640 1 --2- 172.21.15.137:0/180671110 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7a7c068380 0x7f7a7c06a840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7a90011340 tx=0x7f7a90009750 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:36.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.387+0000 7f7a97e00640 1 -- 172.21.15.137:0/180671110 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7a88016910 con 0x7f7aa01e5650 2024-04-26T23:42:36.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.551+0000 7f7aa6200640 1 -- 172.21.15.137:0/180671110 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7aa0148110 con 0x7f7aa01e5650 2024-04-26T23:42:36.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.551+0000 7f7a97e00640 1 -- 172.21.15.137:0/180671110 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7f7a880f0950 con 0x7f7aa01e5650 2024-04-26T23:42:36.559 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T23:42:36.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.555+0000 7f7aa6200640 1 -- 172.21.15.137:0/180671110 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7a7c068380 msgr2=0x7f7a7c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:36.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.555+0000 7f7aa6200640 1 --2- 172.21.15.137:0/180671110 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7a7c068380 0x7f7a7c06a840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7a90011340 tx=0x7f7a90009750 comp rx=0 tx=0).stop 2024-04-26T23:42:36.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.555+0000 7f7aa6200640 1 -- 172.21.15.137:0/180671110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7aa01e5650 msgr2=0x7f7aa01f4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:36.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.555+0000 7f7aa6200640 1 --2- 172.21.15.137:0/180671110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7aa01e5650 0x7f7aa01f4c80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7a880ab040 tx=0x7f7a84005840 comp rx=0 tx=0).stop 2024-04-26T23:42:36.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.555+0000 7f7aa6200640 1 -- 172.21.15.137:0/180671110 shutdown_connections 2024-04-26T23:42:36.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.555+0000 7f7aa6200640 1 --2- 172.21.15.137:0/180671110 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7a7c068380 0x7f7a7c06a840 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.555+0000 7f7aa6200640 1 --2- 172.21.15.137:0/180671110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7aa01e5650 0x7f7aa01f4c80 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.555+0000 7f7aa6200640 1 --2- 172.21.15.137:0/180671110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7aa01f51c0 0x7f7aa01f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.555+0000 7f7aa6200640 1 --2- 172.21.15.137:0/180671110 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7a84004810 0x7f7aa01420d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.555+0000 7f7aa6200640 1 -- 172.21.15.137:0/180671110 >> 172.21.15.137:0/180671110 conn(0x7f7aa006c5d0 msgr2=0x7f7aa00b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:36.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.555+0000 7f7aa6200640 1 -- 172.21.15.137:0/180671110 shutdown_connections 2024-04-26T23:42:36.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.555+0000 7f7aa6200640 1 -- 172.21.15.137:0/180671110 wait complete. 2024-04-26T23:42:36.580 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:42:36.580 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:42:36.590 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:42:36.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.763+0000 7f508d800640 1 Processor -- start 2024-04-26T23:42:36.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.763+0000 7f508d800640 1 -- start start 2024-04-26T23:42:36.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.763+0000 7f508d800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f508806d410 0x7f508806d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:36.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.763+0000 7f508d800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f508806f710 con 0x7f50880af180 2024-04-26T23:42:36.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.763+0000 7f508d800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f508815d7b0 con 0x7f5088146b10 2024-04-26T23:42:36.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.763+0000 7f508d800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f508806ddb0 con 0x7f508806d410 2024-04-26T23:42:36.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.767+0000 7f5087400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f50880af180 0x7f50880af610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50170/0 (socket says 172.21.15.137:50170) 2024-04-26T23:42:36.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.767+0000 7f5087400640 1 -- 172.21.15.137:0/3601688426 learned_addr learned my addr 172.21.15.137:0/3601688426 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:36.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.767+0000 7f507e000640 1 --2- 172.21.15.137:0/3601688426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f508806d410 0x7f508806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:36.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.767+0000 7f5086000640 1 -- 172.21.15.137:0/3601688426 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1623618061 0 0) 0x7f508806f710 con 0x7f50880af180 2024-04-26T23:42:36.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.767+0000 7f5086000640 1 -- 172.21.15.137:0/3601688426 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f506c003530 con 0x7f50880af180 2024-04-26T23:42:36.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.767+0000 7f5086000640 1 -- 172.21.15.137:0/3601688426 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3976055114 0 0) 0x7f508815d7b0 con 0x7f5088146b10 2024-04-26T23:42:36.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.767+0000 7f5086000640 1 -- 172.21.15.137:0/3601688426 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f508806f710 con 0x7f5088146b10 2024-04-26T23:42:36.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.767+0000 7f507e000640 1 -- 172.21.15.137:0/3601688426 >> v1:172.21.15.170:6789/0 conn(0x7f5088146b10 legacy=0x7f508806f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:36.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.767+0000 7f507e000640 1 -- 172.21.15.137:0/3601688426 >> v1:172.21.15.137:6789/0 conn(0x7f50880af180 legacy=0x7f50880af610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:36.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.767+0000 7f507e000640 1 -- 172.21.15.137:0/3601688426 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508815da90 con 0x7f508806d410 2024-04-26T23:42:36.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.767+0000 7f507e000640 1 --2- 172.21.15.137:0/3601688426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f508806d410 0x7f508806d870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f50700097f0 tx=0x7f507001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=833dce2e10617576 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:36.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.767+0000 7f5086000640 1 -- 172.21.15.137:0/3601688426 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50700b0070 con 0x7f508806d410 2024-04-26T23:42:36.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.767+0000 7f5086000640 1 -- 172.21.15.137:0/3601688426 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50700ab600 con 0x7f508806d410 2024-04-26T23:42:36.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.767+0000 7f5086000640 1 -- 172.21.15.137:0/3601688426 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50700ab9d0 con 0x7f508806d410 2024-04-26T23:42:36.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f508d800640 1 -- 172.21.15.137:0/3601688426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f508806d410 msgr2=0x7f508806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:36.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f508d800640 1 --2- 172.21.15.137:0/3601688426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f508806d410 0x7f508806d870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f50700097f0 tx=0x7f507001c450 comp rx=0 tx=0).stop 2024-04-26T23:42:36.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f508d800640 1 -- 172.21.15.137:0/3601688426 shutdown_connections 2024-04-26T23:42:36.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f508d800640 1 --2- 172.21.15.137:0/3601688426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f508806d410 0x7f508806d870 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f508d800640 1 -- 172.21.15.137:0/3601688426 >> 172.21.15.137:0/3601688426 conn(0x7f5088073160 msgr2=0x7f5088073570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:36.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f508d800640 1 -- 172.21.15.137:0/3601688426 shutdown_connections 2024-04-26T23:42:36.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f508d800640 1 -- 172.21.15.137:0/3601688426 wait complete. 2024-04-26T23:42:36.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f508d800640 1 Processor -- start 2024-04-26T23:42:36.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f508d800640 1 -- start start 2024-04-26T23:42:36.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f508d800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f508806d410 0x7f508813f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:36.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f508d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50880af180 0x7f508815bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:36.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f508d800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5088146b10 0x7f5088164e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:36.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f508d800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5088071b20 con 0x7f50880af180 2024-04-26T23:42:36.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f508d800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f50880719a0 con 0x7f5088146b10 2024-04-26T23:42:36.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f508d800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f508816ac20 con 0x7f508806d410 2024-04-26T23:42:36.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f507e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50880af180 0x7f508815bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:36.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f507e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50880af180 0x7f508815bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43236/0 (socket says 172.21.15.137:43236) 2024-04-26T23:42:36.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f507e000640 1 -- 172.21.15.137:0/4285040735 learned_addr learned my addr 172.21.15.137:0/4285040735 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:36.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f5086a00640 1 --2- 172.21.15.137:0/4285040735 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f508806d410 0x7f508813f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:36.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f5087400640 1 --2- 172.21.15.137:0/4285040735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5088146b10 0x7f5088164e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:36.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f507e000640 1 -- 172.21.15.137:0/4285040735 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f508806d410 msgr2=0x7f508813f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:36.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f507e000640 1 --2- 172.21.15.137:0/4285040735 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f508806d410 0x7f508813f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f507e000640 1 -- 172.21.15.137:0/4285040735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5088146b10 msgr2=0x7f5088164e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:36.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f507e000640 1 --2- 172.21.15.137:0/4285040735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5088146b10 0x7f5088164e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f507e000640 1 -- 172.21.15.137:0/4285040735 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50881602b0 con 0x7f50880af180 2024-04-26T23:42:36.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.771+0000 7f507e000640 1 --2- 172.21.15.137:0/4285040735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50880af180 0x7f508815bdf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f50700097f0 tx=0x7f507001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:36.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.775+0000 7f507f400640 1 -- 172.21.15.137:0/4285040735 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50700b9070 con 0x7f50880af180 2024-04-26T23:42:36.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.775+0000 7f507f400640 1 -- 172.21.15.137:0/4285040735 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50700b4420 con 0x7f50880af180 2024-04-26T23:42:36.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.775+0000 7f507f400640 1 -- 172.21.15.137:0/4285040735 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50700b0040 con 0x7f50880af180 2024-04-26T23:42:36.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.775+0000 7f508d800640 1 -- 172.21.15.137:0/4285040735 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f508813e010 con 0x7f50880af180 2024-04-26T23:42:36.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.775+0000 7f508d800640 1 -- 172.21.15.137:0/4285040735 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f508813dd30 con 0x7f50880af180 2024-04-26T23:42:36.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.775+0000 7f508d800640 1 -- 172.21.15.137:0/4285040735 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5088160480 con 0x7f50880af180 2024-04-26T23:42:36.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.775+0000 7f507f400640 1 -- 172.21.15.137:0/4285040735 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f50700bc070 con 0x7f50880af180 2024-04-26T23:42:36.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.775+0000 7f507f400640 1 --2- 172.21.15.137:0/4285040735 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5064068380 0x7f506406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:36.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.775+0000 7f507f400640 1 -- 172.21.15.137:0/4285040735 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f507011fa80 con 0x7f50880af180 2024-04-26T23:42:36.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.775+0000 7f5086a00640 1 --2- 172.21.15.137:0/4285040735 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5064068380 0x7f506406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:36.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.775+0000 7f5086a00640 1 --2- 172.21.15.137:0/4285040735 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5064068380 0x7f506406a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f50780015e0 tx=0x7f5078009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:36.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.779+0000 7f507f400640 1 -- 172.21.15.137:0/4285040735 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f50700160d0 con 0x7f50880af180 2024-04-26T23:42:36.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.939+0000 7f508d800640 1 -- 172.21.15.137:0/4285040735 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f508806a4b0 con 0x7f50880af180 2024-04-26T23:42:36.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.939+0000 7f507f400640 1 -- 172.21.15.137:0/4285040735 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16717 (secure 0 0 0) 0x7f50700f0040 con 0x7f50880af180 2024-04-26T23:42:36.947 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:36.947 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":33,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:42:26.483092+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:42:22.570062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:42:23.822598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:42:36.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.943+0000 7f508d800640 1 -- 172.21.15.137:0/4285040735 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5064068380 msgr2=0x7f506406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:36.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.943+0000 7f508d800640 1 --2- 172.21.15.137:0/4285040735 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5064068380 0x7f506406a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f50780015e0 tx=0x7f5078009040 comp rx=0 tx=0).stop 2024-04-26T23:42:36.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.943+0000 7f508d800640 1 -- 172.21.15.137:0/4285040735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50880af180 msgr2=0x7f508815bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:36.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.943+0000 7f508d800640 1 --2- 172.21.15.137:0/4285040735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50880af180 0x7f508815bdf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f50700097f0 tx=0x7f507001ac90 comp rx=0 tx=0).stop 2024-04-26T23:42:36.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.943+0000 7f508d800640 1 -- 172.21.15.137:0/4285040735 shutdown_connections 2024-04-26T23:42:36.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.943+0000 7f508d800640 1 --2- 172.21.15.137:0/4285040735 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5064068380 0x7f506406a840 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.943+0000 7f508d800640 1 --2- 172.21.15.137:0/4285040735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50880af180 0x7f508815bdf0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.943+0000 7f508d800640 1 --2- 172.21.15.137:0/4285040735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5088146b10 0x7f5088164e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.943+0000 7f508d800640 1 --2- 172.21.15.137:0/4285040735 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f508806d410 0x7f508813f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:36.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.943+0000 7f508d800640 1 -- 172.21.15.137:0/4285040735 >> 172.21.15.137:0/4285040735 conn(0x7f5088073160 msgr2=0x7f508806efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:36.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.943+0000 7f508d800640 1 -- 172.21.15.137:0/4285040735 shutdown_connections 2024-04-26T23:42:36.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:36.943+0000 7f508d800640 1 -- 172.21.15.137:0/4285040735 wait complete. 2024-04-26T23:42:36.969 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:42:22.570062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:42:23.822598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:42:36.970 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:42:37.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.103+0000 7fe7f2200640 1 Processor -- start 2024-04-26T23:42:37.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.103+0000 7fe7f2200640 1 -- start start 2024-04-26T23:42:37.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.103+0000 7fe7f2200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7ec0afbc0 0x7fe7ec15df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:37.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.103+0000 7fe7f2200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe7ec073f20 0x7fe7ec0735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:37.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.103+0000 7fe7f2200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe7ec0affa0 0x7fe7ec0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:37.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.103+0000 7fe7f2200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe7ec073b20 con 0x7fe7ec0affa0 2024-04-26T23:42:37.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.103+0000 7fe7f2200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe7ec072860 con 0x7fe7ec073f20 2024-04-26T23:42:37.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.103+0000 7fe7f2200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe7ec0743b0 con 0x7fe7ec0afbc0 2024-04-26T23:42:37.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.103+0000 7fe7ebe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe7ec0affa0 0x7fe7ec0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:37.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.103+0000 7fe7ebe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe7ec0affa0 0x7fe7ec0ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43248/0 (socket says 172.21.15.137:43248) 2024-04-26T23:42:37.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.103+0000 7fe7ebe00640 1 -- 172.21.15.137:0/392072854 learned_addr learned my addr 172.21.15.137:0/392072854 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:37.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.103+0000 7fe7ebe00640 1 -- 172.21.15.137:0/392072854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7ec0afbc0 msgr2=0x7fe7ec15df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:37.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.103+0000 7fe7ebe00640 1 --2- 172.21.15.137:0/392072854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7ec0afbc0 0x7fe7ec15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.103+0000 7fe7ebe00640 1 -- 172.21.15.137:0/392072854 >> v2:172.21.15.170:3300/0 conn(0x7fe7ec073f20 msgr2=0x7fe7ec0735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:37.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.103+0000 7fe7e2a00640 1 --2- 172.21.15.137:0/392072854 >> v2:172.21.15.170:3300/0 conn(0x7fe7ec073f20 0x7fe7ec0735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:37.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.103+0000 7fe7ebe00640 1 --2- 172.21.15.137:0/392072854 >> v2:172.21.15.170:3300/0 conn(0x7fe7ec073f20 0x7fe7ec0735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.103+0000 7fe7ebe00640 1 -- 172.21.15.137:0/392072854 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ec072b00 con 0x7fe7ec0affa0 2024-04-26T23:42:37.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.103+0000 7fe7e2a00640 1 --2- 172.21.15.137:0/392072854 >> v2:172.21.15.170:3300/0 conn(0x7fe7ec073f20 0x7fe7ec0735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:37.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.107+0000 7fe7ebe00640 1 --2- 172.21.15.137:0/392072854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7ec0affa0 0x7fe7ec0ce3b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec06de70 tx=0x7fe7e401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb8513074d606da server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:37.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.107+0000 7fe7eaa00640 1 -- 172.21.15.137:0/392072854 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e40a5670 con 0x7fe7ec0affa0 2024-04-26T23:42:37.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.107+0000 7fe7eaa00640 1 -- 172.21.15.137:0/392072854 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7e40a5810 con 0x7fe7ec0affa0 2024-04-26T23:42:37.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.107+0000 7fe7eaa00640 1 -- 172.21.15.137:0/392072854 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e40a5be0 con 0x7fe7ec0affa0 2024-04-26T23:42:37.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.107+0000 7fe7f2200640 1 -- 172.21.15.137:0/392072854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7ec0affa0 msgr2=0x7fe7ec0ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:37.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.107+0000 7fe7f2200640 1 --2- 172.21.15.137:0/392072854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7ec0affa0 0x7fe7ec0ce3b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec06de70 tx=0x7fe7e401c9f0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.107+0000 7fe7f2200640 1 -- 172.21.15.137:0/392072854 shutdown_connections 2024-04-26T23:42:37.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.107+0000 7fe7f2200640 1 --2- 172.21.15.137:0/392072854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7ec0affa0 0x7fe7ec0ce3b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.107+0000 7fe7f2200640 1 --2- 172.21.15.137:0/392072854 >> v2:172.21.15.170:3300/0 conn(0x7fe7ec073f20 0x7fe7ec0735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.107+0000 7fe7f2200640 1 --2- 172.21.15.137:0/392072854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7ec0afbc0 0x7fe7ec15df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.107+0000 7fe7f2200640 1 -- 172.21.15.137:0/392072854 >> 172.21.15.137:0/392072854 conn(0x7fe7ec06c800 msgr2=0x7fe7ec06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:37.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.107+0000 7fe7f2200640 1 -- 172.21.15.137:0/392072854 shutdown_connections 2024-04-26T23:42:37.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.107+0000 7fe7f2200640 1 -- 172.21.15.137:0/392072854 wait complete. 2024-04-26T23:42:37.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.107+0000 7fe7f2200640 1 Processor -- start 2024-04-26T23:42:37.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7f2200640 1 -- start start 2024-04-26T23:42:37.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7f2200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7ec0afbc0 0x7fe7ec149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:37.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7f2200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7ec0affa0 0x7fe7ec0b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:37.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7f2200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7ec14e810 0x7fe7ec0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:37.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7f2200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec161490 con 0x7fe7ec0afbc0 2024-04-26T23:42:37.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7f2200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec161310 con 0x7fe7ec14e810 2024-04-26T23:42:37.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7f2200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe7ec161610 con 0x7fe7ec0affa0 2024-04-26T23:42:37.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7eb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7ec0afbc0 0x7fe7ec149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:37.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7eb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7ec0afbc0 0x7fe7ec149510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43262/0 (socket says 172.21.15.137:43262) 2024-04-26T23:42:37.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7eb400640 1 -- 172.21.15.137:0/2990520482 learned_addr learned my addr 172.21.15.137:0/2990520482 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:37.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7e2a00640 1 --2- 172.21.15.137:0/2990520482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7ec0affa0 0x7fe7ec0b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:37.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7ebe00640 1 --2- 172.21.15.137:0/2990520482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7ec14e810 0x7fe7ec0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:37.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7eb400640 1 -- 172.21.15.137:0/2990520482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7ec0affa0 msgr2=0x7fe7ec0b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:37.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7eb400640 1 --2- 172.21.15.137:0/2990520482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7ec0affa0 0x7fe7ec0b1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7eb400640 1 -- 172.21.15.137:0/2990520482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7ec14e810 msgr2=0x7fe7ec0b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:37.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7eb400640 1 --2- 172.21.15.137:0/2990520482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7ec14e810 0x7fe7ec0b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7eb400640 1 -- 172.21.15.137:0/2990520482 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ec0b1960 con 0x7fe7ec0afbc0 2024-04-26T23:42:37.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7e2a00640 1 --2- 172.21.15.137:0/2990520482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7ec0affa0 0x7fe7ec0b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:37.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7ebe00640 1 --2- 172.21.15.137:0/2990520482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7ec14e810 0x7fe7ec0b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:37.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7eb400640 1 --2- 172.21.15.137:0/2990520482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7ec0afbc0 0x7fe7ec149510 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc00b550 tx=0x7fe7dc00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:37.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7e3e00640 1 -- 172.21.15.137:0/2990520482 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc014070 con 0x7fe7ec0afbc0 2024-04-26T23:42:37.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7e3e00640 1 -- 172.21.15.137:0/2990520482 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7dc010890 con 0x7fe7ec0afbc0 2024-04-26T23:42:37.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7f2200640 1 -- 172.21.15.137:0/2990520482 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7ec0b1c00 con 0x7fe7ec0afbc0 2024-04-26T23:42:37.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7e3e00640 1 -- 172.21.15.137:0/2990520482 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc010c80 con 0x7fe7ec0afbc0 2024-04-26T23:42:37.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7f2200640 1 -- 172.21.15.137:0/2990520482 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7ec0b21c0 con 0x7fe7ec0afbc0 2024-04-26T23:42:37.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.111+0000 7fe7f2200640 1 -- 172.21.15.137:0/2990520482 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7ec06a410 con 0x7fe7ec0afbc0 2024-04-26T23:42:37.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.115+0000 7fe7e3e00640 1 -- 172.21.15.137:0/2990520482 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe7dc017070 con 0x7fe7ec0afbc0 2024-04-26T23:42:37.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.115+0000 7fe7e3e00640 1 --2- 172.21.15.137:0/2990520482 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe7c8068380 0x7fe7c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:37.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.115+0000 7fe7e3e00640 1 -- 172.21.15.137:0/2990520482 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe7dc086870 con 0x7fe7ec0afbc0 2024-04-26T23:42:37.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.115+0000 7fe7e2a00640 1 --2- 172.21.15.137:0/2990520482 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe7c8068380 0x7fe7c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:37.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.115+0000 7fe7e2a00640 1 --2- 172.21.15.137:0/2990520482 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe7c8068380 0x7fe7c806a840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4006fd0 tx=0x7fe7d4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:37.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.119+0000 7fe7e3e00640 1 -- 172.21.15.137:0/2990520482 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe7dc056d90 con 0x7fe7ec0afbc0 2024-04-26T23:42:37.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.275+0000 7fe7f2200640 1 -- 172.21.15.137:0/2990520482 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe7ec160870 con 0x7fe7ec0afbc0 2024-04-26T23:42:37.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.275+0000 7fe7e3e00640 1 -- 172.21.15.137:0/2990520482 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) ==== 93+0+10 (secure 0 0 0) 0x7fe7dc010e20 con 0x7fe7ec0afbc0 2024-04-26T23:42:37.281 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:42:37.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.275+0000 7fe7f2200640 1 -- 172.21.15.137:0/2990520482 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe7c8068380 msgr2=0x7fe7c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:37.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.275+0000 7fe7f2200640 1 --2- 172.21.15.137:0/2990520482 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe7c8068380 0x7fe7c806a840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4006fd0 tx=0x7fe7d4008040 comp rx=0 tx=0).stop 2024-04-26T23:42:37.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.275+0000 7fe7f2200640 1 -- 172.21.15.137:0/2990520482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7ec0afbc0 msgr2=0x7fe7ec149510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:37.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.275+0000 7fe7f2200640 1 --2- 172.21.15.137:0/2990520482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7ec0afbc0 0x7fe7ec149510 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc00b550 tx=0x7fe7dc00ba10 comp rx=0 tx=0).stop 2024-04-26T23:42:37.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.275+0000 7fe7f2200640 1 -- 172.21.15.137:0/2990520482 shutdown_connections 2024-04-26T23:42:37.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.275+0000 7fe7f2200640 1 --2- 172.21.15.137:0/2990520482 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe7c8068380 0x7fe7c806a840 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.275+0000 7fe7f2200640 1 --2- 172.21.15.137:0/2990520482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7ec14e810 0x7fe7ec0b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.275+0000 7fe7f2200640 1 --2- 172.21.15.137:0/2990520482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7ec0affa0 0x7fe7ec0b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.275+0000 7fe7f2200640 1 --2- 172.21.15.137:0/2990520482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7ec0afbc0 0x7fe7ec149510 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.275+0000 7fe7f2200640 1 -- 172.21.15.137:0/2990520482 >> 172.21.15.137:0/2990520482 conn(0x7fe7ec06c800 msgr2=0x7fe7ec0b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:37.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.275+0000 7fe7f2200640 1 -- 172.21.15.137:0/2990520482 shutdown_connections 2024-04-26T23:42:37.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.275+0000 7fe7f2200640 1 -- 172.21.15.137:0/2990520482 wait complete. 2024-04-26T23:42:37.301 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:42:37.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.435+0000 7fa6df800640 1 Processor -- start 2024-04-26T23:42:37.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.435+0000 7fa6df800640 1 -- start start 2024-04-26T23:42:37.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.435+0000 7fa6df800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa6d8073f20 0x7fa6d815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:37.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.435+0000 7fa6df800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6d80affa0 0x7fa6d80ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:37.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.435+0000 7fa6df800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6d8072860 con 0x7fa6d80afbc0 2024-04-26T23:42:37.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.435+0000 7fa6df800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa6d80743b0 con 0x7fa6d8073f20 2024-04-26T23:42:37.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.435+0000 7fa6df800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d8072b00 con 0x7fa6d80affa0 2024-04-26T23:42:37.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.435+0000 7fa6d7e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa6d8073f20 0x7fa6d815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:37.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.435+0000 7fa6d7e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa6d8073f20 0x7fa6d815df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43266/0 (socket says 172.21.15.137:43266) 2024-04-26T23:42:37.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.435+0000 7fa6d7e00640 1 -- 172.21.15.137:0/2811496015 learned_addr learned my addr 172.21.15.137:0/2811496015 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:37.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.435+0000 7fa6dce00640 1 --1- 172.21.15.137:0/2811496015 >> v1:172.21.15.137:6789/0 conn(0x7fa6d80afbc0 0x7fa6d80735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50178/0 (socket says 172.21.15.137:50178) 2024-04-26T23:42:37.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.435+0000 7fa6dd800640 1 --2- 172.21.15.137:0/2811496015 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6d80affa0 0x7fa6d80ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:37.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.435+0000 7fa6d7e00640 1 -- 172.21.15.137:0/2811496015 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6d80affa0 msgr2=0x7fa6d80ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:37.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.435+0000 7fa6d7e00640 1 --2- 172.21.15.137:0/2811496015 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6d80affa0 0x7fa6d80ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.435+0000 7fa6d7e00640 1 -- 172.21.15.137:0/2811496015 >> v1:172.21.15.137:6789/0 conn(0x7fa6d80afbc0 legacy=0x7fa6d80735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:37.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.435+0000 7fa6d7e00640 1 -- 172.21.15.137:0/2811496015 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d8072de0 con 0x7fa6d8073f20 2024-04-26T23:42:37.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.435+0000 7fa6dd800640 1 --2- 172.21.15.137:0/2811496015 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6d80affa0 0x7fa6d80ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:37.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.439+0000 7fa6d7e00640 1 --2- 172.21.15.137:0/2811496015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6d8073f20 0x7fa6d815df90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40098a0 tx=0x7fa6c401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d8cd7f0dd4afe7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:37.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.439+0000 7fa6d7400640 1 -- 172.21.15.137:0/2811496015 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c40b0070 con 0x7fa6d8073f20 2024-04-26T23:42:37.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.439+0000 7fa6d7400640 1 -- 172.21.15.137:0/2811496015 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6c40ab600 con 0x7fa6d8073f20 2024-04-26T23:42:37.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.439+0000 7fa6d7400640 1 -- 172.21.15.137:0/2811496015 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c40ab9d0 con 0x7fa6d8073f20 2024-04-26T23:42:37.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.439+0000 7fa6df800640 1 -- 172.21.15.137:0/2811496015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6d8073f20 msgr2=0x7fa6d815df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:37.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.439+0000 7fa6df800640 1 --2- 172.21.15.137:0/2811496015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6d8073f20 0x7fa6d815df90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40098a0 tx=0x7fa6c401c540 comp rx=0 tx=0).stop 2024-04-26T23:42:37.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.439+0000 7fa6df800640 1 -- 172.21.15.137:0/2811496015 shutdown_connections 2024-04-26T23:42:37.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.439+0000 7fa6df800640 1 --2- 172.21.15.137:0/2811496015 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6d80affa0 0x7fa6d80ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.439+0000 7fa6df800640 1 --2- 172.21.15.137:0/2811496015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6d8073f20 0x7fa6d815df90 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.439+0000 7fa6df800640 1 -- 172.21.15.137:0/2811496015 >> 172.21.15.137:0/2811496015 conn(0x7fa6d806c800 msgr2=0x7fa6d806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:37.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.439+0000 7fa6df800640 1 -- 172.21.15.137:0/2811496015 shutdown_connections 2024-04-26T23:42:37.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.439+0000 7fa6df800640 1 -- 172.21.15.137:0/2811496015 wait complete. 2024-04-26T23:42:37.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.439+0000 7fa6df800640 1 Processor -- start 2024-04-26T23:42:37.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6df800640 1 -- start start 2024-04-26T23:42:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6df800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6d80afbc0 0x7fa6d81f90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6df800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6d80affa0 0x7fa6d8143e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6df800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6d8159120 0x7fa6d81595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6df800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d806f360 con 0x7fa6d80afbc0 2024-04-26T23:42:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6df800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d806f1e0 con 0x7fa6d80affa0 2024-04-26T23:42:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6df800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d806f4e0 con 0x7fa6d8159120 2024-04-26T23:42:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6dce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6d80afbc0 0x7fa6d81f90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6dce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6d80afbc0 0x7fa6d81f90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43268/0 (socket says 172.21.15.137:43268) 2024-04-26T23:42:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6dce00640 1 -- 172.21.15.137:0/2666542653 learned_addr learned my addr 172.21.15.137:0/2666542653 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:37.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6d7e00640 1 --2- 172.21.15.137:0/2666542653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6d80affa0 0x7fa6d8143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:37.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6dd800640 1 --2- 172.21.15.137:0/2666542653 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6d8159120 0x7fa6d81595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:37.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6dce00640 1 -- 172.21.15.137:0/2666542653 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6d8159120 msgr2=0x7fa6d81595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:37.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6dce00640 1 --2- 172.21.15.137:0/2666542653 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6d8159120 0x7fa6d81595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6dce00640 1 -- 172.21.15.137:0/2666542653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6d80affa0 msgr2=0x7fa6d8143e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:37.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6dce00640 1 --2- 172.21.15.137:0/2666542653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6d80affa0 0x7fa6d8143e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6dce00640 1 -- 172.21.15.137:0/2666542653 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d81443d0 con 0x7fa6d80afbc0 2024-04-26T23:42:37.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6dce00640 1 --2- 172.21.15.137:0/2666542653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6d80afbc0 0x7fa6d81f90c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800c7c0 tx=0x7fa6c800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:37.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6d4c00640 1 -- 172.21.15.137:0/2666542653 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8017070 con 0x7fa6d80afbc0 2024-04-26T23:42:37.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6d4c00640 1 -- 172.21.15.137:0/2666542653 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6c800a640 con 0x7fa6d80afbc0 2024-04-26T23:42:37.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6df800640 1 -- 172.21.15.137:0/2666542653 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d80ad9e0 con 0x7fa6d80afbc0 2024-04-26T23:42:37.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6d4c00640 1 -- 172.21.15.137:0/2666542653 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c800aa70 con 0x7fa6d80afbc0 2024-04-26T23:42:37.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6df800640 1 -- 172.21.15.137:0/2666542653 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d815b9f0 con 0x7fa6d80afbc0 2024-04-26T23:42:37.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.443+0000 7fa6df800640 1 -- 172.21.15.137:0/2666542653 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6d806a410 con 0x7fa6d80afbc0 2024-04-26T23:42:37.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.447+0000 7fa6d4c00640 1 -- 172.21.15.137:0/2666542653 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa6c801a070 con 0x7fa6d80afbc0 2024-04-26T23:42:37.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.447+0000 7fa6d4c00640 1 --2- 172.21.15.137:0/2666542653 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa6b8068380 0x7fa6b806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:37.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.447+0000 7fa6d4c00640 1 -- 172.21.15.137:0/2666542653 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa6c8085f80 con 0x7fa6d80afbc0 2024-04-26T23:42:37.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.447+0000 7fa6d7e00640 1 --2- 172.21.15.137:0/2666542653 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa6b8068380 0x7fa6b806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:37.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.447+0000 7fa6d7e00640 1 --2- 172.21.15.137:0/2666542653 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa6b8068380 0x7fa6b806a840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa6d80727f0 tx=0x7fa6c4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:37.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.451+0000 7fa6d4c00640 1 -- 172.21.15.137:0/2666542653 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa6d81443d0 con 0x7fa6d80afbc0 2024-04-26T23:42:37.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.607+0000 7fa6df800640 1 -- 172.21.15.137:0/2666542653 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa6d8160870 con 0x7fa6d80afbc0 2024-04-26T23:42:37.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.607+0000 7fa6d4c00640 1 -- 172.21.15.137:0/2666542653 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) ==== 104+0+11 (secure 0 0 0) 0x7fa6c8055ee0 con 0x7fa6d80afbc0 2024-04-26T23:42:37.614 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:42:37.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.611+0000 7fa6df800640 1 -- 172.21.15.137:0/2666542653 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa6b8068380 msgr2=0x7fa6b806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:37.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.611+0000 7fa6df800640 1 --2- 172.21.15.137:0/2666542653 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa6b8068380 0x7fa6b806a840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa6d80727f0 tx=0x7fa6c4008040 comp rx=0 tx=0).stop 2024-04-26T23:42:37.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.611+0000 7fa6df800640 1 -- 172.21.15.137:0/2666542653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6d80afbc0 msgr2=0x7fa6d81f90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:37.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.611+0000 7fa6df800640 1 --2- 172.21.15.137:0/2666542653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6d80afbc0 0x7fa6d81f90c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800c7c0 tx=0x7fa6c800cc80 comp rx=0 tx=0).stop 2024-04-26T23:42:37.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.611+0000 7fa6df800640 1 -- 172.21.15.137:0/2666542653 shutdown_connections 2024-04-26T23:42:37.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.611+0000 7fa6df800640 1 --2- 172.21.15.137:0/2666542653 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa6b8068380 0x7fa6b806a840 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.611+0000 7fa6df800640 1 --2- 172.21.15.137:0/2666542653 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6d8159120 0x7fa6d81595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.611+0000 7fa6df800640 1 --2- 172.21.15.137:0/2666542653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6d80affa0 0x7fa6d8143e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.611+0000 7fa6df800640 1 --2- 172.21.15.137:0/2666542653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6d80afbc0 0x7fa6d81f90c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.611+0000 7fa6df800640 1 -- 172.21.15.137:0/2666542653 >> 172.21.15.137:0/2666542653 conn(0x7fa6d806c800 msgr2=0x7fa6d8068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:37.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.611+0000 7fa6df800640 1 -- 172.21.15.137:0/2666542653 shutdown_connections 2024-04-26T23:42:37.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.611+0000 7fa6df800640 1 -- 172.21.15.137:0/2666542653 wait complete. 2024-04-26T23:42:37.635 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:42:37.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.767+0000 7f552e200640 1 Processor -- start 2024-04-26T23:42:37.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.767+0000 7f552e200640 1 -- start start 2024-04-26T23:42:37.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.771+0000 7f552e200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f55280b54e0 0x7f55280b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:37.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.771+0000 7f552e200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55280cffa0 con 0x7f55280cd710 2024-04-26T23:42:37.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.771+0000 7f552e200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55280d0280 con 0x7f5528160000 2024-04-26T23:42:37.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.771+0000 7f552e200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f55280b3d90 con 0x7f55280b54e0 2024-04-26T23:42:37.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.771+0000 7f551ea00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f55280cd710 0x7f552815f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50190/0 (socket says 172.21.15.137:50190) 2024-04-26T23:42:37.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.771+0000 7f551ea00640 1 -- 172.21.15.137:0/951852855 learned_addr learned my addr 172.21.15.137:0/951852855 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:37.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.771+0000 7f5527400640 1 --2- 172.21.15.137:0/951852855 >> v2:172.21.15.170:3300/0 conn(0x7f55280b54e0 0x7f55280b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:37.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.771+0000 7f5526a00640 1 -- 172.21.15.137:0/951852855 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 634377321 0 0) 0x7f55280cffa0 con 0x7f55280cd710 2024-04-26T23:42:37.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.771+0000 7f5526a00640 1 -- 172.21.15.137:0/951852855 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f550c003530 con 0x7f55280cd710 2024-04-26T23:42:37.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.771+0000 7f5526a00640 1 -- 172.21.15.137:0/951852855 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 193253206 0 0) 0x7f55280d0280 con 0x7f5528160000 2024-04-26T23:42:37.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.771+0000 7f5526a00640 1 -- 172.21.15.137:0/951852855 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55280cffa0 con 0x7f5528160000 2024-04-26T23:42:37.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.771+0000 7f5527400640 1 -- 172.21.15.137:0/951852855 >> v1:172.21.15.170:6789/0 conn(0x7f5528160000 legacy=0x7f5528144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:37.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.771+0000 7f5527400640 1 -- 172.21.15.137:0/951852855 >> v1:172.21.15.137:6789/0 conn(0x7f55280cd710 legacy=0x7f552815f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:37.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.771+0000 7f5527400640 1 -- 172.21.15.137:0/951852855 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55280d0560 con 0x7f55280b54e0 2024-04-26T23:42:37.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.775+0000 7f5527400640 1 --2- 172.21.15.137:0/951852855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55280b54e0 0x7f55280b5ee0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f55180097f0 tx=0x7f551801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86ae804fba1c1b2c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:37.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.775+0000 7f5526a00640 1 -- 172.21.15.137:0/951852855 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55180b0070 con 0x7f55280b54e0 2024-04-26T23:42:37.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.775+0000 7f5526a00640 1 -- 172.21.15.137:0/951852855 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55180ab600 con 0x7f55280b54e0 2024-04-26T23:42:37.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.775+0000 7f5526a00640 1 -- 172.21.15.137:0/951852855 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55180ab9d0 con 0x7f55280b54e0 2024-04-26T23:42:37.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.775+0000 7f552e200640 1 -- 172.21.15.137:0/951852855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55280b54e0 msgr2=0x7f55280b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:37.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.775+0000 7f552e200640 1 --2- 172.21.15.137:0/951852855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55280b54e0 0x7f55280b5ee0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f55180097f0 tx=0x7f551801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.775+0000 7f552e200640 1 -- 172.21.15.137:0/951852855 shutdown_connections 2024-04-26T23:42:37.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.775+0000 7f552e200640 1 --2- 172.21.15.137:0/951852855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55280b54e0 0x7f55280b5ee0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.775+0000 7f552e200640 1 -- 172.21.15.137:0/951852855 >> 172.21.15.137:0/951852855 conn(0x7f552806c800 msgr2=0x7f552806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:37.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.775+0000 7f552e200640 1 -- 172.21.15.137:0/951852855 shutdown_connections 2024-04-26T23:42:37.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.775+0000 7f552e200640 1 -- 172.21.15.137:0/951852855 wait complete. 2024-04-26T23:42:37.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.775+0000 7f552e200640 1 Processor -- start 2024-04-26T23:42:37.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.775+0000 7f552e200640 1 -- start start 2024-04-26T23:42:37.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f552e200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55280b54e0 0x7f5528153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:37.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f552e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55280cd710 0x7f55281fb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:37.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f552e200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5528160000 0x7f5528140e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:37.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f552e200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5528073640 con 0x7f55280cd710 2024-04-26T23:42:37.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f552e200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f55280734c0 con 0x7f5528160000 2024-04-26T23:42:37.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f552e200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5528145840 con 0x7f55280b54e0 2024-04-26T23:42:37.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f551ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55280cd710 0x7f55281fb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:37.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f551ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55280cd710 0x7f55281fb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43276/0 (socket says 172.21.15.137:43276) 2024-04-26T23:42:37.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f551ea00640 1 -- 172.21.15.137:0/1922642087 learned_addr learned my addr 172.21.15.137:0/1922642087 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:37.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f5527400640 1 --2- 172.21.15.137:0/1922642087 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55280b54e0 0x7f5528153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:37.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f5527e00640 1 --2- 172.21.15.137:0/1922642087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5528160000 0x7f5528140e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:37.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f551ea00640 1 -- 172.21.15.137:0/1922642087 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55280b54e0 msgr2=0x7f5528153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:37.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f551ea00640 1 --2- 172.21.15.137:0/1922642087 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55280b54e0 0x7f5528153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f551ea00640 1 -- 172.21.15.137:0/1922642087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5528160000 msgr2=0x7f5528140e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:37.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f551ea00640 1 --2- 172.21.15.137:0/1922642087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5528160000 0x7f5528140e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f551ea00640 1 -- 172.21.15.137:0/1922642087 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55281fbf40 con 0x7f55280cd710 2024-04-26T23:42:37.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f5527400640 1 --2- 172.21.15.137:0/1922642087 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55280b54e0 0x7f5528153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:37.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f551ea00640 1 --2- 172.21.15.137:0/1922642087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55280cd710 0x7f55281fb7d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f551000c500 tx=0x7f551000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:37.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f551fe00640 1 -- 172.21.15.137:0/1922642087 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5510017070 con 0x7f55280cd710 2024-04-26T23:42:37.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f551fe00640 1 -- 172.21.15.137:0/1922642087 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5510005cf0 con 0x7f55280cd710 2024-04-26T23:42:37.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f551fe00640 1 -- 172.21.15.137:0/1922642087 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5510007330 con 0x7f55280cd710 2024-04-26T23:42:37.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f552e200640 1 -- 172.21.15.137:0/1922642087 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55281fc220 con 0x7f55280cd710 2024-04-26T23:42:37.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f552e200640 1 -- 172.21.15.137:0/1922642087 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5528169be0 con 0x7f55280cd710 2024-04-26T23:42:37.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f552e200640 1 -- 172.21.15.137:0/1922642087 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f552806a410 con 0x7f55280cd710 2024-04-26T23:42:37.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.779+0000 7f551fe00640 1 -- 172.21.15.137:0/1922642087 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f551001a070 con 0x7f55280cd710 2024-04-26T23:42:37.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.783+0000 7f551fe00640 1 --2- 172.21.15.137:0/1922642087 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5504068380 0x7f550406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:37.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.783+0000 7f551fe00640 1 -- 172.21.15.137:0/1922642087 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f5510085e40 con 0x7f55280cd710 2024-04-26T23:42:37.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.783+0000 7f5527400640 1 --2- 172.21.15.137:0/1922642087 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5504068380 0x7f550406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:37.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.783+0000 7f5527400640 1 --2- 172.21.15.137:0/1922642087 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5504068380 0x7f550406a840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f55180ad000 tx=0x7f5518008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:37.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.787+0000 7f551fe00640 1 -- 172.21.15.137:0/1922642087 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f55100563f0 con 0x7f55280cd710 2024-04-26T23:42:37.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.943+0000 7f552e200640 1 -- 172.21.15.137:0/1922642087 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5528169db0 con 0x7f55280cd710 2024-04-26T23:42:37.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.947+0000 7f551fe00640 1 -- 172.21.15.137:0/1922642087 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) ==== 100+0+11 (secure 0 0 0) 0x7f5510055cf0 con 0x7f55280cd710 2024-04-26T23:42:37.952 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:42:37.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.947+0000 7f552e200640 1 -- 172.21.15.137:0/1922642087 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5504068380 msgr2=0x7f550406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:37.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.947+0000 7f552e200640 1 --2- 172.21.15.137:0/1922642087 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5504068380 0x7f550406a840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f55180ad000 tx=0x7f5518008040 comp rx=0 tx=0).stop 2024-04-26T23:42:37.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.947+0000 7f552e200640 1 -- 172.21.15.137:0/1922642087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55280cd710 msgr2=0x7f55281fb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:37.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.947+0000 7f552e200640 1 --2- 172.21.15.137:0/1922642087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55280cd710 0x7f55281fb7d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f551000c500 tx=0x7f551000c9c0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.947+0000 7f552e200640 1 -- 172.21.15.137:0/1922642087 shutdown_connections 2024-04-26T23:42:37.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.947+0000 7f552e200640 1 --2- 172.21.15.137:0/1922642087 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5504068380 0x7f550406a840 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.947+0000 7f552e200640 1 --2- 172.21.15.137:0/1922642087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55280cd710 0x7f55281fb7d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.947+0000 7f552e200640 1 --2- 172.21.15.137:0/1922642087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5528160000 0x7f5528140e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.947+0000 7f552e200640 1 --2- 172.21.15.137:0/1922642087 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55280b54e0 0x7f5528153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:37.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.947+0000 7f552e200640 1 -- 172.21.15.137:0/1922642087 >> 172.21.15.137:0/1922642087 conn(0x7f552806c800 msgr2=0x7f5528144830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:37.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.947+0000 7f552e200640 1 -- 172.21.15.137:0/1922642087 shutdown_connections 2024-04-26T23:42:37.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:37.947+0000 7f552e200640 1 -- 172.21.15.137:0/1922642087 wait complete. 2024-04-26T23:42:37.973 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:42:38.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.103+0000 7f4f28000640 1 Processor -- start 2024-04-26T23:42:38.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.103+0000 7f4f28000640 1 -- start start 2024-04-26T23:42:38.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.103+0000 7f4f28000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4f2015de80 0x7f4f20073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:38.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.103+0000 7f4f28000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f200ce7c0 0x7f4f20146210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:38.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.103+0000 7f4f28000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f20073010 con 0x7f4f200ce3e0 2024-04-26T23:42:38.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.103+0000 7f4f28000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4f200cef90 con 0x7f4f2015de80 2024-04-26T23:42:38.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.103+0000 7f4f28000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4f20073280 con 0x7f4f200ce7c0 2024-04-26T23:42:38.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.103+0000 7f4f24c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4f2015de80 0x7f4f20073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:38.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.103+0000 7f4f24c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4f2015de80 0x7f4f20073d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43280/0 (socket says 172.21.15.137:43280) 2024-04-26T23:42:38.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.103+0000 7f4f24c00640 1 -- 172.21.15.137:0/1299009219 learned_addr learned my addr 172.21.15.137:0/1299009219 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:38.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.103+0000 7f4f26000640 1 --2- 172.21.15.137:0/1299009219 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f200ce7c0 0x7f4f20146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:38.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.103+0000 7f4f24c00640 1 -- 172.21.15.137:0/1299009219 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f200ce7c0 msgr2=0x7f4f20146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:38.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.103+0000 7f4f24c00640 1 --2- 172.21.15.137:0/1299009219 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f200ce7c0 0x7f4f20146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:38.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.103+0000 7f4f24c00640 1 -- 172.21.15.137:0/1299009219 >> v1:172.21.15.137:6789/0 conn(0x7f4f200ce3e0 legacy=0x7f4f200d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:38.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.103+0000 7f4f24c00640 1 -- 172.21.15.137:0/1299009219 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f20073560 con 0x7f4f2015de80 2024-04-26T23:42:38.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.107+0000 7f4f24c00640 1 --2- 172.21.15.137:0/1299009219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f2015de80 0x7f4f20073d60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0098a0 tx=0x7f4f0c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c7fa90cb08b510 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:38.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.107+0000 7f4f1fe00640 1 -- 172.21.15.137:0/1299009219 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c0ab620 con 0x7f4f2015de80 2024-04-26T23:42:38.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.107+0000 7f4f1fe00640 1 -- 172.21.15.137:0/1299009219 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f0c0b0070 con 0x7f4f2015de80 2024-04-26T23:42:38.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.107+0000 7f4f1fe00640 1 -- 172.21.15.137:0/1299009219 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c0ab9e0 con 0x7f4f2015de80 2024-04-26T23:42:38.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.107+0000 7f4f28000640 1 -- 172.21.15.137:0/1299009219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f2015de80 msgr2=0x7f4f20073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:38.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.107+0000 7f4f28000640 1 --2- 172.21.15.137:0/1299009219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f2015de80 0x7f4f20073d60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0098a0 tx=0x7f4f0c01c510 comp rx=0 tx=0).stop 2024-04-26T23:42:38.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.107+0000 7f4f28000640 1 -- 172.21.15.137:0/1299009219 shutdown_connections 2024-04-26T23:42:38.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.107+0000 7f4f28000640 1 --2- 172.21.15.137:0/1299009219 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f200ce7c0 0x7f4f20146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:38.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.107+0000 7f4f28000640 1 --2- 172.21.15.137:0/1299009219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f2015de80 0x7f4f20073d60 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:38.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.107+0000 7f4f28000640 1 -- 172.21.15.137:0/1299009219 >> 172.21.15.137:0/1299009219 conn(0x7f4f2006c5d0 msgr2=0x7f4f2006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:38.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.107+0000 7f4f28000640 1 -- 172.21.15.137:0/1299009219 shutdown_connections 2024-04-26T23:42:38.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.107+0000 7f4f28000640 1 -- 172.21.15.137:0/1299009219 wait complete. 2024-04-26T23:42:38.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f28000640 1 Processor -- start 2024-04-26T23:42:38.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f28000640 1 -- start start 2024-04-26T23:42:38.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f28000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f200ce3e0 0x7f4f201441b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:38.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f28000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f200ce7c0 0x7f4f200ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:38.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f28000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f2015de80 0x7f4f200aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:38.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f28000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2006f0a0 con 0x7f4f200ce3e0 2024-04-26T23:42:38.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f28000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2006ef20 con 0x7f4f200ce7c0 2024-04-26T23:42:38.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f28000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4f2006f220 con 0x7f4f2015de80 2024-04-26T23:42:38.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f25600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f200ce3e0 0x7f4f201441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:38.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f25600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f200ce3e0 0x7f4f201441b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43294/0 (socket says 172.21.15.137:43294) 2024-04-26T23:42:38.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f25600640 1 -- 172.21.15.137:0/1457683708 learned_addr learned my addr 172.21.15.137:0/1457683708 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:38.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f24c00640 1 --2- 172.21.15.137:0/1457683708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f200ce7c0 0x7f4f200ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:38.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f26000640 1 --2- 172.21.15.137:0/1457683708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f2015de80 0x7f4f200aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:38.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f25600640 1 -- 172.21.15.137:0/1457683708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f2015de80 msgr2=0x7f4f200aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:38.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f25600640 1 --2- 172.21.15.137:0/1457683708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f2015de80 0x7f4f200aee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:38.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f25600640 1 -- 172.21.15.137:0/1457683708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f200ce7c0 msgr2=0x7f4f200ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:38.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f25600640 1 --2- 172.21.15.137:0/1457683708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f200ce7c0 0x7f4f200ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:38.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f25600640 1 -- 172.21.15.137:0/1457683708 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2015afe0 con 0x7f4f200ce3e0 2024-04-26T23:42:38.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f26000640 1 --2- 172.21.15.137:0/1457683708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f2015de80 0x7f4f200aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:38.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f25600640 1 --2- 172.21.15.137:0/1457683708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f200ce3e0 0x7f4f201441b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4f1400c7c0 tx=0x7f4f1400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:38.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f1d600640 1 -- 172.21.15.137:0/1457683708 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f14016020 con 0x7f4f200ce3e0 2024-04-26T23:42:38.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f1d600640 1 -- 172.21.15.137:0/1457683708 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f14006d60 con 0x7f4f200ce3e0 2024-04-26T23:42:38.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f28000640 1 -- 172.21.15.137:0/1457683708 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f200b3f30 con 0x7f4f200ce3e0 2024-04-26T23:42:38.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f1d600640 1 -- 172.21.15.137:0/1457683708 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f14003bc0 con 0x7f4f200ce3e0 2024-04-26T23:42:38.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f28000640 1 -- 172.21.15.137:0/1457683708 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f200b44f0 con 0x7f4f200ce3e0 2024-04-26T23:42:38.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.111+0000 7f4f28000640 1 -- 172.21.15.137:0/1457683708 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f2006a4b0 con 0x7f4f200ce3e0 2024-04-26T23:42:38.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.115+0000 7f4f1d600640 1 -- 172.21.15.137:0/1457683708 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4f1400a850 con 0x7f4f200ce3e0 2024-04-26T23:42:38.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.115+0000 7f4f1d600640 1 --2- 172.21.15.137:0/1457683708 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4f00068380 0x7f4f0006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:38.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.115+0000 7f4f1d600640 1 -- 172.21.15.137:0/1457683708 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f4f14086650 con 0x7f4f200ce3e0 2024-04-26T23:42:38.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.115+0000 7f4f24c00640 1 --2- 172.21.15.137:0/1457683708 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4f00068380 0x7f4f0006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:38.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.115+0000 7f4f24c00640 1 --2- 172.21.15.137:0/1457683708 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4f00068380 0x7f4f0006a840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0af000 tx=0x7f4f0c0a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:38.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.119+0000 7f4f1d600640 1 -- 172.21.15.137:0/1457683708 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4f14020020 con 0x7f4f200ce3e0 2024-04-26T23:42:38.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.287+0000 7f4f28000640 1 -- 172.21.15.137:0/1457683708 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4f20072320 con 0x7f4f200ce3e0 2024-04-26T23:42:38.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.287+0000 7f4f1d600640 1 -- 172.21.15.137:0/1457683708 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7f4f14056c00 con 0x7f4f200ce3e0 2024-04-26T23:42:38.294 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T23:42:38.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.287+0000 7f4f28000640 1 -- 172.21.15.137:0/1457683708 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4f00068380 msgr2=0x7f4f0006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:38.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.287+0000 7f4f28000640 1 --2- 172.21.15.137:0/1457683708 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4f00068380 0x7f4f0006a840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0af000 tx=0x7f4f0c0a7000 comp rx=0 tx=0).stop 2024-04-26T23:42:38.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.287+0000 7f4f28000640 1 -- 172.21.15.137:0/1457683708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f200ce3e0 msgr2=0x7f4f201441b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:38.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.287+0000 7f4f28000640 1 --2- 172.21.15.137:0/1457683708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f200ce3e0 0x7f4f201441b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4f1400c7c0 tx=0x7f4f1400cc80 comp rx=0 tx=0).stop 2024-04-26T23:42:38.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.287+0000 7f4f28000640 1 -- 172.21.15.137:0/1457683708 shutdown_connections 2024-04-26T23:42:38.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.287+0000 7f4f28000640 1 --2- 172.21.15.137:0/1457683708 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4f00068380 0x7f4f0006a840 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:38.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.287+0000 7f4f28000640 1 --2- 172.21.15.137:0/1457683708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f2015de80 0x7f4f200aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:38.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.287+0000 7f4f28000640 1 --2- 172.21.15.137:0/1457683708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f200ce7c0 0x7f4f200ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:38.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.287+0000 7f4f28000640 1 --2- 172.21.15.137:0/1457683708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f200ce3e0 0x7f4f201441b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:38.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.291+0000 7f4f28000640 1 -- 172.21.15.137:0/1457683708 >> 172.21.15.137:0/1457683708 conn(0x7f4f2006c5d0 msgr2=0x7f4f2015c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:38.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.291+0000 7f4f28000640 1 -- 172.21.15.137:0/1457683708 shutdown_connections 2024-04-26T23:42:38.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:38.291+0000 7f4f28000640 1 -- 172.21.15.137:0/1457683708 wait complete. 2024-04-26T23:42:38.315 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi137.front.sepia.ceph.com... 2024-04-26T23:42:38.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:38.316 DEBUG:teuthology.orchestra.run.smithi137:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-26T23:42:38.333 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:ceph-fuse[37875]: fuse finished with error 0 and tester_r 0 2024-04-26T23:42:38.336 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:42:44.438 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T23:42:44.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:44.438 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T23:42:44.449 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:42:44.449 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:42:44.459 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:42:44.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.631+0000 7f615a600640 1 Processor -- start 2024-04-26T23:42:44.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.631+0000 7f615a600640 1 -- start start 2024-04-26T23:42:44.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.631+0000 7f615a600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f61540b60c0 0x7f615416a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:44.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.631+0000 7f615a600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f615415d210 con 0x7f6154075db0 2024-04-26T23:42:44.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.631+0000 7f615a600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6154160120 con 0x7f615415ce30 2024-04-26T23:42:44.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.631+0000 7f615a600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f6154160400 con 0x7f61540b60c0 2024-04-26T23:42:44.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.631+0000 7f614aa00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f6154075db0 0x7f61540b59b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:60584/0 (socket says 172.21.15.137:60584) 2024-04-26T23:42:44.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.631+0000 7f614aa00640 1 -- 172.21.15.137:0/2903125521 learned_addr learned my addr 172.21.15.137:0/2903125521 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:44.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.631+0000 7f6153e00640 1 --2- 172.21.15.137:0/2903125521 >> v2:172.21.15.170:3300/0 conn(0x7f61540b60c0 0x7f615416a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:44.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.631+0000 7f6152a00640 1 -- 172.21.15.137:0/2903125521 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1175641551 0 0) 0x7f613c001120 con 0x7f6154075db0 2024-04-26T23:42:44.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.631+0000 7f6152a00640 1 -- 172.21.15.137:0/2903125521 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6138003530 con 0x7f6154075db0 2024-04-26T23:42:44.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.631+0000 7f6152a00640 1 -- 172.21.15.137:0/2903125521 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2902709068 0 0) 0x7f6154160120 con 0x7f615415ce30 2024-04-26T23:42:44.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.631+0000 7f6152a00640 1 -- 172.21.15.137:0/2903125521 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f613c001120 con 0x7f615415ce30 2024-04-26T23:42:44.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.631+0000 7f6152a00640 1 -- 172.21.15.137:0/2903125521 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3664173071 0 0) 0x7f6138003530 con 0x7f6154075db0 2024-04-26T23:42:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.631+0000 7f6152a00640 1 -- 172.21.15.137:0/2903125521 >> v2:172.21.15.170:3300/0 conn(0x7f61540b60c0 msgr2=0x7f615416a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.631+0000 7f6152a00640 1 --2- 172.21.15.137:0/2903125521 >> v2:172.21.15.170:3300/0 conn(0x7f61540b60c0 0x7f615416a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.631+0000 7f6152a00640 1 -- 172.21.15.137:0/2903125521 >> v1:172.21.15.170:6789/0 conn(0x7f615415ce30 legacy=0x7f615415f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.631+0000 7f6152a00640 1 -- 172.21.15.137:0/2903125521 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61541606e0 con 0x7f6154075db0 2024-04-26T23:42:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.631+0000 7f6152a00640 1 -- 172.21.15.137:0/2903125521 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f613c001850 con 0x7f6154075db0 2024-04-26T23:42:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.635+0000 7f6153e00640 1 --2- 172.21.15.137:0/2903125521 >> v2:172.21.15.170:3300/0 conn(0x7f61540b60c0 0x7f615416a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:42:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.635+0000 7f6152a00640 1 -- 172.21.15.137:0/2903125521 >> v1:172.21.15.137:6789/0 conn(0x7f6154075db0 legacy=0x7f61540b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.635+0000 7f6152a00640 1 --2- 172.21.15.137:0/2903125521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6138003b50 0x7f6138003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.635+0000 7f6152a00640 1 --2- 172.21.15.137:0/2903125521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6138004810 0x7f6138004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.635+0000 7f6152a00640 1 --2- 172.21.15.137:0/2903125521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61380051d0 0x7f613800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.635+0000 7f6152a00640 1 -- 172.21.15.137:0/2903125521 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6154160400 con 0x7f6138004810 2024-04-26T23:42:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.635+0000 7f6152a00640 1 -- 172.21.15.137:0/2903125521 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f613800c050 con 0x7f61380051d0 2024-04-26T23:42:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.635+0000 7f6152a00640 1 -- 172.21.15.137:0/2903125521 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f613800c250 con 0x7f6138003b50 2024-04-26T23:42:44.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.635+0000 7f614aa00640 1 --2- 172.21.15.137:0/2903125521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6138004810 0x7f6138004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:44.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.635+0000 7f6153400640 1 --2- 172.21.15.137:0/2903125521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6138003b50 0x7f6138003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:44.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.635+0000 7f6153e00640 1 --2- 172.21.15.137:0/2903125521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61380051d0 0x7f613800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:44.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.635+0000 7f614aa00640 1 -- 172.21.15.137:0/2903125521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6138003b50 msgr2=0x7f6138003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:44.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.635+0000 7f614aa00640 1 --2- 172.21.15.137:0/2903125521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6138003b50 0x7f6138003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:44.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.635+0000 7f614aa00640 1 -- 172.21.15.137:0/2903125521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61380051d0 msgr2=0x7f613800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:44.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.635+0000 7f614aa00640 1 --2- 172.21.15.137:0/2903125521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61380051d0 0x7f613800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:44.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.635+0000 7f614aa00640 1 -- 172.21.15.137:0/2903125521 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6138003530 con 0x7f6138004810 2024-04-26T23:42:44.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.635+0000 7f6153e00640 1 -- 172.21.15.137:0/2903125521 reap_dead start 2024-04-26T23:42:44.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.635+0000 7f614aa00640 1 --2- 172.21.15.137:0/2903125521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6138004810 0x7f6138004c90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f613c00c490 tx=0x7f613c01cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8998118c16f20f26 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:44.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.635+0000 7f6152a00640 1 -- 172.21.15.137:0/2903125521 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613c00c0e0 con 0x7f6138004810 2024-04-26T23:42:44.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.635+0000 7f6152a00640 1 -- 172.21.15.137:0/2903125521 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f613c0a9020 con 0x7f6138004810 2024-04-26T23:42:44.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.635+0000 7f6152a00640 1 -- 172.21.15.137:0/2903125521 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613c005ae0 con 0x7f6138004810 2024-04-26T23:42:44.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f615a600640 1 -- 172.21.15.137:0/2903125521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6138004810 msgr2=0x7f6138004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:44.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f615a600640 1 --2- 172.21.15.137:0/2903125521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6138004810 0x7f6138004c90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f613c00c490 tx=0x7f613c01cbc0 comp rx=0 tx=0).stop 2024-04-26T23:42:44.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f615a600640 1 -- 172.21.15.137:0/2903125521 shutdown_connections 2024-04-26T23:42:44.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f615a600640 1 --2- 172.21.15.137:0/2903125521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6138004810 0x7f6138004c90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:44.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f615a600640 1 -- 172.21.15.137:0/2903125521 >> 172.21.15.137:0/2903125521 conn(0x7f6154073f50 msgr2=0x7f615406c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:44.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f615a600640 1 -- 172.21.15.137:0/2903125521 shutdown_connections 2024-04-26T23:42:44.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f615a600640 1 -- 172.21.15.137:0/2903125521 wait complete. 2024-04-26T23:42:44.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f615a600640 1 Processor -- start 2024-04-26T23:42:44.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f615a600640 1 -- start start 2024-04-26T23:42:44.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f615a600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6138004810 0x7f61540c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:44.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f615a600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61540b1d00 0x7f6154146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:44.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f615a600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61541614e0 0x7f6154161960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:44.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f615a600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f61540b59b0 con 0x7f61541614e0 2024-04-26T23:42:44.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f615a600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f615406f360 con 0x7f6138004810 2024-04-26T23:42:44.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f615a600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f61540b5b30 con 0x7f61540b1d00 2024-04-26T23:42:44.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f6153e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61541614e0 0x7f6154161960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:44.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f6153e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61541614e0 0x7f6154161960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41546/0 (socket says 172.21.15.137:41546) 2024-04-26T23:42:44.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f6153e00640 1 -- 172.21.15.137:0/336334721 learned_addr learned my addr 172.21.15.137:0/336334721 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:44.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f614aa00640 1 --2- 172.21.15.137:0/336334721 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61540b1d00 0x7f6154146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:44.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f6153400640 1 --2- 172.21.15.137:0/336334721 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6138004810 0x7f61540c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:44.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f6153e00640 1 -- 172.21.15.137:0/336334721 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61540b1d00 msgr2=0x7f6154146420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:44.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f6153e00640 1 --2- 172.21.15.137:0/336334721 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61540b1d00 0x7f6154146420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:44.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f6153e00640 1 -- 172.21.15.137:0/336334721 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6138004810 msgr2=0x7f61540c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:44.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f6153e00640 1 --2- 172.21.15.137:0/336334721 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6138004810 0x7f61540c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:44.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.639+0000 7f6153e00640 1 -- 172.21.15.137:0/336334721 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61540c7350 con 0x7f61541614e0 2024-04-26T23:42:44.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.643+0000 7f6153e00640 1 --2- 172.21.15.137:0/336334721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61541614e0 0x7f6154161960 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f61540730d0 tx=0x7f614c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:44.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.643+0000 7f614be00640 1 -- 172.21.15.137:0/336334721 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614c0039a0 con 0x7f61541614e0 2024-04-26T23:42:44.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.643+0000 7f614be00640 1 -- 172.21.15.137:0/336334721 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614c003b40 con 0x7f61541614e0 2024-04-26T23:42:44.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.643+0000 7f615a600640 1 -- 172.21.15.137:0/336334721 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6154146960 con 0x7f61541614e0 2024-04-26T23:42:44.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.643+0000 7f614be00640 1 -- 172.21.15.137:0/336334721 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614c004020 con 0x7f61541614e0 2024-04-26T23:42:44.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.643+0000 7f615a600640 1 -- 172.21.15.137:0/336334721 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61540cd6c0 con 0x7f61541614e0 2024-04-26T23:42:44.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.643+0000 7f615a600640 1 -- 172.21.15.137:0/336334721 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6154161ea0 con 0x7f61541614e0 2024-04-26T23:42:44.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.643+0000 7f614be00640 1 -- 172.21.15.137:0/336334721 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f614c0041c0 con 0x7f61541614e0 2024-04-26T23:42:44.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.643+0000 7f614be00640 1 --2- 172.21.15.137:0/336334721 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f61300683b0 0x7f613006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:44.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.643+0000 7f614be00640 1 -- 172.21.15.137:0/336334721 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f614c087700 con 0x7f61541614e0 2024-04-26T23:42:44.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.643+0000 7f6153400640 1 --2- 172.21.15.137:0/336334721 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f61300683b0 0x7f613006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:44.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.647+0000 7f6153400640 1 --2- 172.21.15.137:0/336334721 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f61300683b0 0x7f613006a870 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f61440079b0 tx=0x7f6144007940 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:44.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.651+0000 7f614be00640 1 -- 172.21.15.137:0/336334721 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f614c019030 con 0x7f61541614e0 2024-04-26T23:42:44.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.807+0000 7f615a600640 1 -- 172.21.15.137:0/336334721 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f615406a4b0 con 0x7f61541614e0 2024-04-26T23:42:44.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.807+0000 7f614be00640 1 -- 172.21.15.137:0/336334721 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16717 (secure 0 0 0) 0x7f614c010040 con 0x7f61541614e0 2024-04-26T23:42:44.815 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:44.815 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":33,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:42:26.483092+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:42:22.570062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:42:23.822598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:42:44.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.811+0000 7f615a600640 1 -- 172.21.15.137:0/336334721 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f61300683b0 msgr2=0x7f613006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:44.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.811+0000 7f615a600640 1 --2- 172.21.15.137:0/336334721 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f61300683b0 0x7f613006a870 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f61440079b0 tx=0x7f6144007940 comp rx=0 tx=0).stop 2024-04-26T23:42:44.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.811+0000 7f615a600640 1 -- 172.21.15.137:0/336334721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61541614e0 msgr2=0x7f6154161960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:44.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.811+0000 7f615a600640 1 --2- 172.21.15.137:0/336334721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61541614e0 0x7f6154161960 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f61540730d0 tx=0x7f614c00f580 comp rx=0 tx=0).stop 2024-04-26T23:42:44.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.811+0000 7f615a600640 1 -- 172.21.15.137:0/336334721 shutdown_connections 2024-04-26T23:42:44.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.811+0000 7f615a600640 1 --2- 172.21.15.137:0/336334721 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f61300683b0 0x7f613006a870 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:44.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.811+0000 7f615a600640 1 --2- 172.21.15.137:0/336334721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61541614e0 0x7f6154161960 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:44.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.811+0000 7f615a600640 1 --2- 172.21.15.137:0/336334721 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61540b1d00 0x7f6154146420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:44.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.811+0000 7f615a600640 1 --2- 172.21.15.137:0/336334721 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6138004810 0x7f61540c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:44.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.811+0000 7f615a600640 1 -- 172.21.15.137:0/336334721 >> 172.21.15.137:0/336334721 conn(0x7f6154073f50 msgr2=0x7f615415d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:44.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.811+0000 7f615a600640 1 -- 172.21.15.137:0/336334721 shutdown_connections 2024-04-26T23:42:44.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.811+0000 7f615a600640 1 -- 172.21.15.137:0/336334721 wait complete. 2024-04-26T23:42:44.838 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:42:22.570062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:42:23.822598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:42:44.838 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:42:44.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.971+0000 7fd1d2000640 1 Processor -- start 2024-04-26T23:42:44.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.971+0000 7fd1d2000640 1 -- start start 2024-04-26T23:42:44.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.975+0000 7fd1d2000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd1cc0b3b10 0x7fd1cc072bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:44.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.975+0000 7fd1d2000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd1cc0d0d10 0x7fd1cc0d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:44.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.975+0000 7fd1d2000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1cc0b5310 con 0x7fd1cc15bb80 2024-04-26T23:42:44.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.975+0000 7fd1d2000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd1cc0d16a0 con 0x7fd1cc0d0d10 2024-04-26T23:42:44.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.975+0000 7fd1d2000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fd1cc0b50b0 con 0x7fd1cc0b3b10 2024-04-26T23:42:44.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.975+0000 7fd1d0c00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fd1cc15bb80 0x7fd1cc0b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:60600/0 (socket says 172.21.15.137:60600) 2024-04-26T23:42:44.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.975+0000 7fd1d0c00640 1 -- 172.21.15.137:0/3245463352 learned_addr learned my addr 172.21.15.137:0/3245463352 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:44.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.975+0000 7fd1d1600640 1 --2- 172.21.15.137:0/3245463352 >> v2:172.21.15.137:3300/0 conn(0x7fd1cc0d0d10 0x7fd1cc0d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:44.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.975+0000 7fd1cbe00640 1 --2- 172.21.15.137:0/3245463352 >> v2:172.21.15.170:3300/0 conn(0x7fd1cc0b3b10 0x7fd1cc072bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:44.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.975+0000 7fd1d1600640 1 -- 172.21.15.137:0/3245463352 >> v2:172.21.15.170:3300/0 conn(0x7fd1cc0b3b10 msgr2=0x7fd1cc072bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:44.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.975+0000 7fd1d1600640 1 --2- 172.21.15.137:0/3245463352 >> v2:172.21.15.170:3300/0 conn(0x7fd1cc0b3b10 0x7fd1cc072bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:44.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.975+0000 7fd1d1600640 1 -- 172.21.15.137:0/3245463352 >> v1:172.21.15.137:6789/0 conn(0x7fd1cc15bb80 legacy=0x7fd1cc0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:44.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.975+0000 7fd1cb400640 1 -- 172.21.15.137:0/3245463352 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1242857713 0 0) 0x7fd1cc0b5310 con 0x7fd1cc15bb80 2024-04-26T23:42:44.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.975+0000 7fd1d1600640 1 -- 172.21.15.137:0/3245463352 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1cc072110 con 0x7fd1cc0d0d10 2024-04-26T23:42:44.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.975+0000 7fd1cbe00640 1 --2- 172.21.15.137:0/3245463352 >> v2:172.21.15.170:3300/0 conn(0x7fd1cc0b3b10 0x7fd1cc072bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:44.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.975+0000 7fd1d1600640 1 --2- 172.21.15.137:0/3245463352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1cc0d0d10 0x7fd1cc0d1160 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0b3fc0 tx=0x7fd1c401c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac88c224dae3cbdd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:44.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1cb400640 1 -- 172.21.15.137:0/3245463352 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c40b2070 con 0x7fd1cc0d0d10 2024-04-26T23:42:44.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1cb400640 1 -- 172.21.15.137:0/3245463352 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c40a57c0 con 0x7fd1cc0d0d10 2024-04-26T23:42:44.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1cb400640 1 -- 172.21.15.137:0/3245463352 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c40a5b90 con 0x7fd1cc0d0d10 2024-04-26T23:42:44.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1d2000640 1 -- 172.21.15.137:0/3245463352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1cc0d0d10 msgr2=0x7fd1cc0d1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:44.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1d2000640 1 --2- 172.21.15.137:0/3245463352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1cc0d0d10 0x7fd1cc0d1160 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0b3fc0 tx=0x7fd1c401c810 comp rx=0 tx=0).stop 2024-04-26T23:42:44.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1d2000640 1 -- 172.21.15.137:0/3245463352 shutdown_connections 2024-04-26T23:42:44.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1d2000640 1 --2- 172.21.15.137:0/3245463352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1cc0d0d10 0x7fd1cc0d1160 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:44.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1d2000640 1 --2- 172.21.15.137:0/3245463352 >> v2:172.21.15.170:3300/0 conn(0x7fd1cc0b3b10 0x7fd1cc072bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:44.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1d2000640 1 -- 172.21.15.137:0/3245463352 >> 172.21.15.137:0/3245463352 conn(0x7fd1cc06c5d0 msgr2=0x7fd1cc06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:44.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1d2000640 1 -- 172.21.15.137:0/3245463352 shutdown_connections 2024-04-26T23:42:44.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1d2000640 1 -- 172.21.15.137:0/3245463352 wait complete. 2024-04-26T23:42:44.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1d2000640 1 Processor -- start 2024-04-26T23:42:44.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1d2000640 1 -- start start 2024-04-26T23:42:44.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1d2000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1cc0b3b10 0x7fd1cc1503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:44.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1d2000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1cc0d0d10 0x7fd1cc142730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:44.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1d2000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1cc15bb80 0x7fd1cc159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:44.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1d2000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc0ce8d0 con 0x7fd1cc0b3b10 2024-04-26T23:42:44.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1d2000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc0ce750 con 0x7fd1cc15bb80 2024-04-26T23:42:44.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1d2000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd1cc0cea50 con 0x7fd1cc0d0d10 2024-04-26T23:42:44.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1d0c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1cc0b3b10 0x7fd1cc1503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:44.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1d0c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1cc0b3b10 0x7fd1cc1503e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41564/0 (socket says 172.21.15.137:41564) 2024-04-26T23:42:44.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1d0c00640 1 -- 172.21.15.137:0/3587258436 learned_addr learned my addr 172.21.15.137:0/3587258436 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:44.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.979+0000 7fd1d1600640 1 --2- 172.21.15.137:0/3587258436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1cc15bb80 0x7fd1cc159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:44.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.983+0000 7fd1cbe00640 1 --2- 172.21.15.137:0/3587258436 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1cc0d0d10 0x7fd1cc142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:44.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.983+0000 7fd1d0c00640 1 -- 172.21.15.137:0/3587258436 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1cc0d0d10 msgr2=0x7fd1cc142730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:44.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.983+0000 7fd1d0c00640 1 --2- 172.21.15.137:0/3587258436 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1cc0d0d10 0x7fd1cc142730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:44.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.983+0000 7fd1d0c00640 1 -- 172.21.15.137:0/3587258436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1cc15bb80 msgr2=0x7fd1cc159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:44.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.983+0000 7fd1d0c00640 1 --2- 172.21.15.137:0/3587258436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1cc15bb80 0x7fd1cc159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:44.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.983+0000 7fd1d0c00640 1 -- 172.21.15.137:0/3587258436 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1cc150a50 con 0x7fd1cc0b3b10 2024-04-26T23:42:44.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.983+0000 7fd1cbe00640 1 --2- 172.21.15.137:0/3587258436 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1cc0d0d10 0x7fd1cc142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:44.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.983+0000 7fd1d0c00640 1 --2- 172.21.15.137:0/3587258436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1cc0b3b10 0x7fd1cc1503e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd1c000c4b0 tx=0x7fd1c000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:44.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.983+0000 7fd1c8c00640 1 -- 172.21.15.137:0/3587258436 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0018070 con 0x7fd1cc0b3b10 2024-04-26T23:42:44.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.983+0000 7fd1c8c00640 1 -- 172.21.15.137:0/3587258436 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c0007500 con 0x7fd1cc0b3b10 2024-04-26T23:42:44.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.983+0000 7fd1c8c00640 1 -- 172.21.15.137:0/3587258436 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0004a30 con 0x7fd1cc0b3b10 2024-04-26T23:42:44.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.983+0000 7fd1d2000640 1 -- 172.21.15.137:0/3587258436 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1cc150d30 con 0x7fd1cc0b3b10 2024-04-26T23:42:44.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.983+0000 7fd1d2000640 1 -- 172.21.15.137:0/3587258436 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1cc1512f0 con 0x7fd1cc0b3b10 2024-04-26T23:42:44.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.983+0000 7fd1d2000640 1 -- 172.21.15.137:0/3587258436 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1cc06a300 con 0x7fd1cc0b3b10 2024-04-26T23:42:44.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.983+0000 7fd1c8c00640 1 -- 172.21.15.137:0/3587258436 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd1c0004bd0 con 0x7fd1cc0b3b10 2024-04-26T23:42:44.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.983+0000 7fd1c8c00640 1 --2- 172.21.15.137:0/3587258436 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd1ac068380 0x7fd1ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:44.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.983+0000 7fd1c8c00640 1 -- 172.21.15.137:0/3587258436 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fd1c0085be0 con 0x7fd1cc0b3b10 2024-04-26T23:42:44.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.983+0000 7fd1cbe00640 1 --2- 172.21.15.137:0/3587258436 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd1ac068380 0x7fd1ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:44.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.987+0000 7fd1cbe00640 1 --2- 172.21.15.137:0/3587258436 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd1ac068380 0x7fd1ac06a840 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc15f440 tx=0x7fd1b8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:44.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:44.987+0000 7fd1c8c00640 1 -- 172.21.15.137:0/3587258436 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd1c0056190 con 0x7fd1cc0b3b10 2024-04-26T23:42:45.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.143+0000 7fd1d2000640 1 -- 172.21.15.137:0/3587258436 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd1cc0cdb40 con 0x7fd1cc0b3b10 2024-04-26T23:42:45.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.143+0000 7fd1c8c00640 1 -- 172.21.15.137:0/3587258436 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) ==== 93+0+10 (secure 0 0 0) 0x7fd1c0055a90 con 0x7fd1cc0b3b10 2024-04-26T23:42:45.152 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:42:45.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.147+0000 7fd1d2000640 1 -- 172.21.15.137:0/3587258436 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd1ac068380 msgr2=0x7fd1ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:45.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.147+0000 7fd1d2000640 1 --2- 172.21.15.137:0/3587258436 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd1ac068380 0x7fd1ac06a840 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc15f440 tx=0x7fd1b8008040 comp rx=0 tx=0).stop 2024-04-26T23:42:45.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.147+0000 7fd1d2000640 1 -- 172.21.15.137:0/3587258436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1cc0b3b10 msgr2=0x7fd1cc1503e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:45.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.147+0000 7fd1d2000640 1 --2- 172.21.15.137:0/3587258436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1cc0b3b10 0x7fd1cc1503e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd1c000c4b0 tx=0x7fd1c000c970 comp rx=0 tx=0).stop 2024-04-26T23:42:45.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.147+0000 7fd1d2000640 1 -- 172.21.15.137:0/3587258436 shutdown_connections 2024-04-26T23:42:45.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.147+0000 7fd1d2000640 1 --2- 172.21.15.137:0/3587258436 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd1ac068380 0x7fd1ac06a840 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.147+0000 7fd1d2000640 1 --2- 172.21.15.137:0/3587258436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1cc15bb80 0x7fd1cc159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.147+0000 7fd1d2000640 1 --2- 172.21.15.137:0/3587258436 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1cc0d0d10 0x7fd1cc142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.147+0000 7fd1d2000640 1 --2- 172.21.15.137:0/3587258436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1cc0b3b10 0x7fd1cc1503e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.147+0000 7fd1d2000640 1 -- 172.21.15.137:0/3587258436 >> 172.21.15.137:0/3587258436 conn(0x7fd1cc06c5d0 msgr2=0x7fd1cc15ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:45.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.147+0000 7fd1d2000640 1 -- 172.21.15.137:0/3587258436 shutdown_connections 2024-04-26T23:42:45.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.147+0000 7fd1d2000640 1 -- 172.21.15.137:0/3587258436 wait complete. 2024-04-26T23:42:45.173 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:42:45.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.303+0000 7f89d3200640 1 Processor -- start 2024-04-26T23:42:45.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.303+0000 7f89d3200640 1 -- start start 2024-04-26T23:42:45.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.307+0000 7f89d3200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f89cc160450 0x7f89cc0d3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:45.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.307+0000 7f89d3200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89cc0b0470 0x7f89cc0d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:45.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.307+0000 7f89d3200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89cc0b0cb0 con 0x7f89cc0d17f0 2024-04-26T23:42:45.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.307+0000 7f89d3200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f89cc0d1c40 con 0x7f89cc160450 2024-04-26T23:42:45.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.307+0000 7f89d3200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f89cc0b0f90 con 0x7f89cc0b0470 2024-04-26T23:42:45.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.307+0000 7f89cbe00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f89cc160450 0x7f89cc0d3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:45.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.307+0000 7f89c3400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89cc0b0470 0x7f89cc0d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:45.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.307+0000 7f89d1200640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f89cc0d17f0 0x7f89cc160c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:39302/0 (socket says 172.21.15.137:39302) 2024-04-26T23:42:45.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.307+0000 7f89d1200640 1 -- 172.21.15.137:0/2923156854 learned_addr learned my addr 172.21.15.137:0/2923156854 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:45.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.307+0000 7f89cbe00640 1 -- 172.21.15.137:0/2923156854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89cc0b0470 msgr2=0x7f89cc0d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:45.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.307+0000 7f89cbe00640 1 --2- 172.21.15.137:0/2923156854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89cc0b0470 0x7f89cc0d12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.307+0000 7f89cbe00640 1 -- 172.21.15.137:0/2923156854 >> v1:172.21.15.170:6789/0 conn(0x7f89cc0d17f0 legacy=0x7f89cc160c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:45.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.307+0000 7f89cbe00640 1 -- 172.21.15.137:0/2923156854 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89cc0b1270 con 0x7f89cc160450 2024-04-26T23:42:45.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.311+0000 7f89cbe00640 1 --2- 172.21.15.137:0/2923156854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89cc160450 0x7f89cc0d3360 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009d90 tx=0x7f89bc01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=198c5cb4b603c72e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:45.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.311+0000 7f89cb400640 1 -- 172.21.15.137:0/2923156854 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89bc0b2070 con 0x7f89cc160450 2024-04-26T23:42:45.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.311+0000 7f89cb400640 1 -- 172.21.15.137:0/2923156854 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89bc0a5840 con 0x7f89cc160450 2024-04-26T23:42:45.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.311+0000 7f89cb400640 1 -- 172.21.15.137:0/2923156854 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89bc0a5c10 con 0x7f89cc160450 2024-04-26T23:42:45.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.311+0000 7f89d3200640 1 -- 172.21.15.137:0/2923156854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89cc160450 msgr2=0x7f89cc0d3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:45.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.311+0000 7f89d3200640 1 --2- 172.21.15.137:0/2923156854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89cc160450 0x7f89cc0d3360 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009d90 tx=0x7f89bc01c970 comp rx=0 tx=0).stop 2024-04-26T23:42:45.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.311+0000 7f89d3200640 1 -- 172.21.15.137:0/2923156854 shutdown_connections 2024-04-26T23:42:45.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.311+0000 7f89d3200640 1 --2- 172.21.15.137:0/2923156854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89cc0b0470 0x7f89cc0d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.311+0000 7f89d3200640 1 --2- 172.21.15.137:0/2923156854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89cc160450 0x7f89cc0d3360 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.311+0000 7f89d3200640 1 -- 172.21.15.137:0/2923156854 >> 172.21.15.137:0/2923156854 conn(0x7f89cc09ba60 msgr2=0x7f89cc09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:45.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.311+0000 7f89d3200640 1 -- 172.21.15.137:0/2923156854 shutdown_connections 2024-04-26T23:42:45.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.311+0000 7f89d3200640 1 -- 172.21.15.137:0/2923156854 wait complete. 2024-04-26T23:42:45.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.311+0000 7f89d3200640 1 Processor -- start 2024-04-26T23:42:45.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.311+0000 7f89d3200640 1 -- start start 2024-04-26T23:42:45.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89d3200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89cc0b0470 0x7f89cc14f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:45.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89d3200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89cc0d17f0 0x7f89cc0c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:45.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89d3200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89cc160450 0x7f89cc0cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:45.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89d3200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc1609b0 con 0x7f89cc160450 2024-04-26T23:42:45.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89d3200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc160830 con 0x7f89cc0b0470 2024-04-26T23:42:45.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89d3200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f89cc0b0850 con 0x7f89cc0d17f0 2024-04-26T23:42:45.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89d1200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89cc160450 0x7f89cc0cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:45.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89cbe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89cc0b0470 0x7f89cc14f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:45.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89cbe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89cc0b0470 0x7f89cc14f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:46192/0 (socket says 172.21.15.137:46192) 2024-04-26T23:42:45.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89cbe00640 1 -- 172.21.15.137:0/3014217820 learned_addr learned my addr 172.21.15.137:0/3014217820 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:45.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89c3400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89cc0d17f0 0x7f89cc0c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:45.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89cbe00640 1 -- 172.21.15.137:0/3014217820 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89cc0d17f0 msgr2=0x7f89cc0c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:45.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89cbe00640 1 --2- 172.21.15.137:0/3014217820 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89cc0d17f0 0x7f89cc0c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89cbe00640 1 -- 172.21.15.137:0/3014217820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89cc160450 msgr2=0x7f89cc0cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:45.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89cbe00640 1 --2- 172.21.15.137:0/3014217820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89cc160450 0x7f89cc0cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89cbe00640 1 -- 172.21.15.137:0/3014217820 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89cc0ca910 con 0x7f89cc0b0470 2024-04-26T23:42:45.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89d1200640 1 --2- 172.21.15.137:0/3014217820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89cc160450 0x7f89cc0cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:42:45.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89cbe00640 1 --2- 172.21.15.137:0/3014217820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89cc0b0470 0x7f89cc14f3d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f89bc0b0040 tx=0x7f89bc019710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:45.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89c8c00640 1 -- 172.21.15.137:0/3014217820 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89bc0b2040 con 0x7f89cc0b0470 2024-04-26T23:42:45.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89c8c00640 1 -- 172.21.15.137:0/3014217820 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89bc0bf070 con 0x7f89cc0b0470 2024-04-26T23:42:45.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89d3200640 1 -- 172.21.15.137:0/3014217820 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89cc0cabf0 con 0x7f89cc0b0470 2024-04-26T23:42:45.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89c8c00640 1 -- 172.21.15.137:0/3014217820 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89bc0b8670 con 0x7f89cc0b0470 2024-04-26T23:42:45.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89d3200640 1 -- 172.21.15.137:0/3014217820 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89cc070250 con 0x7f89cc0b0470 2024-04-26T23:42:45.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.315+0000 7f89d3200640 1 -- 172.21.15.137:0/3014217820 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89cc06a410 con 0x7f89cc0b0470 2024-04-26T23:42:45.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.319+0000 7f89c8c00640 1 -- 172.21.15.137:0/3014217820 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f89bc0e0ab0 con 0x7f89cc0b0470 2024-04-26T23:42:45.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.319+0000 7f89c8c00640 1 --2- 172.21.15.137:0/3014217820 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f89a8068380 0x7f89a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:45.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.319+0000 7f89c8c00640 1 -- 172.21.15.137:0/3014217820 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f89bc1219a0 con 0x7f89cc0b0470 2024-04-26T23:42:45.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.319+0000 7f89c3400640 1 --2- 172.21.15.137:0/3014217820 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f89a8068380 0x7f89a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:45.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.319+0000 7f89c3400640 1 --2- 172.21.15.137:0/3014217820 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f89a8068380 0x7f89a806a840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f89cc06d7c0 tx=0x7f89b4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:45.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.323+0000 7f89c8c00640 1 -- 172.21.15.137:0/3014217820 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f89bc016560 con 0x7f89cc0b0470 2024-04-26T23:42:45.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.479+0000 7f89d3200640 1 -- 172.21.15.137:0/3014217820 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f89cc06c780 con 0x7f89cc0b0470 2024-04-26T23:42:45.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.479+0000 7f89c8c00640 1 -- 172.21.15.137:0/3014217820 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) ==== 104+0+11 (secure 0 0 0) 0x7f89bc0f19f0 con 0x7f89cc0b0470 2024-04-26T23:42:45.488 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:42:45.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.483+0000 7f89d3200640 1 -- 172.21.15.137:0/3014217820 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f89a8068380 msgr2=0x7f89a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:45.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.483+0000 7f89d3200640 1 --2- 172.21.15.137:0/3014217820 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f89a8068380 0x7f89a806a840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f89cc06d7c0 tx=0x7f89b4009190 comp rx=0 tx=0).stop 2024-04-26T23:42:45.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.483+0000 7f89d3200640 1 -- 172.21.15.137:0/3014217820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89cc0b0470 msgr2=0x7f89cc14f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:45.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.483+0000 7f89d3200640 1 --2- 172.21.15.137:0/3014217820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89cc0b0470 0x7f89cc14f3d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f89bc0b0040 tx=0x7f89bc019710 comp rx=0 tx=0).stop 2024-04-26T23:42:45.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.483+0000 7f89d3200640 1 -- 172.21.15.137:0/3014217820 shutdown_connections 2024-04-26T23:42:45.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.483+0000 7f89d3200640 1 --2- 172.21.15.137:0/3014217820 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f89a8068380 0x7f89a806a840 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.483+0000 7f89d3200640 1 --2- 172.21.15.137:0/3014217820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89cc160450 0x7f89cc0cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.483+0000 7f89d3200640 1 --2- 172.21.15.137:0/3014217820 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89cc0d17f0 0x7f89cc0c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.483+0000 7f89d3200640 1 --2- 172.21.15.137:0/3014217820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89cc0b0470 0x7f89cc14f3d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.483+0000 7f89d3200640 1 -- 172.21.15.137:0/3014217820 >> 172.21.15.137:0/3014217820 conn(0x7f89cc09ba60 msgr2=0x7f89cc0d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:45.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.483+0000 7f89d3200640 1 -- 172.21.15.137:0/3014217820 shutdown_connections 2024-04-26T23:42:45.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.483+0000 7f89d3200640 1 -- 172.21.15.137:0/3014217820 wait complete. 2024-04-26T23:42:45.510 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:42:45.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.643+0000 7f02c0800640 1 Processor -- start 2024-04-26T23:42:45.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.643+0000 7f02c0800640 1 -- start start 2024-04-26T23:42:45.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.643+0000 7f02c0800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f02b80ceac0 0x7f02b815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:45.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.643+0000 7f02c0800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02b8072860 con 0x7f02b80afbc0 2024-04-26T23:42:45.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.643+0000 7f02c0800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02b80743b0 con 0x7f02b8073f20 2024-04-26T23:42:45.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.643+0000 7f02c0800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f02b8072b00 con 0x7f02b80ceac0 2024-04-26T23:42:45.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.643+0000 7f02bde00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f02b80afbc0 0x7f02b80735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:60608/0 (socket says 172.21.15.137:60608) 2024-04-26T23:42:45.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.643+0000 7f02bde00640 1 -- 172.21.15.137:0/3845323375 learned_addr learned my addr 172.21.15.137:0/3845323375 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:45.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.643+0000 7f02be800640 1 --2- 172.21.15.137:0/3845323375 >> v2:172.21.15.170:3300/0 conn(0x7f02b80ceac0 0x7f02b815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:45.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.643+0000 7f02bca00640 1 -- 172.21.15.137:0/3845323375 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2831910876 0 0) 0x7f02b8072860 con 0x7f02b80afbc0 2024-04-26T23:42:45.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.643+0000 7f02bca00640 1 -- 172.21.15.137:0/3845323375 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02a0003530 con 0x7f02b80afbc0 2024-04-26T23:42:45.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02bca00640 1 -- 172.21.15.137:0/3845323375 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2822130888 0 0) 0x7f02b80743b0 con 0x7f02b8073f20 2024-04-26T23:42:45.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02bca00640 1 -- 172.21.15.137:0/3845323375 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02b8072860 con 0x7f02b8073f20 2024-04-26T23:42:45.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02bca00640 1 -- 172.21.15.137:0/3845323375 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4209389859 0 0) 0x7f02a0003530 con 0x7f02b80afbc0 2024-04-26T23:42:45.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02bca00640 1 -- 172.21.15.137:0/3845323375 >> v2:172.21.15.170:3300/0 conn(0x7f02b80ceac0 msgr2=0x7f02b815df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:45.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02bca00640 1 --2- 172.21.15.137:0/3845323375 >> v2:172.21.15.170:3300/0 conn(0x7f02b80ceac0 0x7f02b815df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02bca00640 1 -- 172.21.15.137:0/3845323375 >> v1:172.21.15.170:6789/0 conn(0x7f02b8073f20 legacy=0x7f02b80ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:45.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02bca00640 1 -- 172.21.15.137:0/3845323375 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b8072de0 con 0x7f02b80afbc0 2024-04-26T23:42:45.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02bca00640 1 -- 172.21.15.137:0/3845323375 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f02ac001680 con 0x7f02b80afbc0 2024-04-26T23:42:45.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02bca00640 1 -- 172.21.15.137:0/3845323375 >> v1:172.21.15.137:6789/0 conn(0x7f02b80afbc0 legacy=0x7f02b80735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:45.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02bca00640 1 --2- 172.21.15.137:0/3845323375 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f02a0003b50 0x7f02a0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:45.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02bca00640 1 --2- 172.21.15.137:0/3845323375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02a0004810 0x7f02a0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:45.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02bca00640 1 --2- 172.21.15.137:0/3845323375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02a00051d0 0x7f02a000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:45.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02bca00640 1 -- 172.21.15.137:0/3845323375 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f02b8072b00 con 0x7f02a0004810 2024-04-26T23:42:45.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02bca00640 1 -- 172.21.15.137:0/3845323375 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f02a000c050 con 0x7f02a00051d0 2024-04-26T23:42:45.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02bca00640 1 -- 172.21.15.137:0/3845323375 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f02a000c250 con 0x7f02a0003b50 2024-04-26T23:42:45.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02bd400640 1 --2- 172.21.15.137:0/3845323375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02a0004810 0x7f02a0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:45.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02bde00640 1 --2- 172.21.15.137:0/3845323375 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f02a0003b50 0x7f02a0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:45.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02be800640 1 --2- 172.21.15.137:0/3845323375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02a00051d0 0x7f02a000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:45.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02bd400640 1 -- 172.21.15.137:0/3845323375 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f02a0003b50 msgr2=0x7f02a0003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:45.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02bd400640 1 --2- 172.21.15.137:0/3845323375 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f02a0003b50 0x7f02a0003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02bd400640 1 -- 172.21.15.137:0/3845323375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02a00051d0 msgr2=0x7f02a000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:45.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02bd400640 1 --2- 172.21.15.137:0/3845323375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02a00051d0 0x7f02a000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02bd400640 1 -- 172.21.15.137:0/3845323375 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a0003530 con 0x7f02a0004810 2024-04-26T23:42:45.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.647+0000 7f02be800640 1 -- 172.21.15.137:0/3845323375 reap_dead start 2024-04-26T23:42:45.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.651+0000 7f02bd400640 1 --2- 172.21.15.137:0/3845323375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02a0004810 0x7f02a0004c90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f02a80018d0 tx=0x7f02a801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b6c8914d78d9f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:45.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.651+0000 7f02bca00640 1 -- 172.21.15.137:0/3845323375 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a8001520 con 0x7f02a0004810 2024-04-26T23:42:45.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.651+0000 7f02bca00640 1 -- 172.21.15.137:0/3845323375 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02a80052f0 con 0x7f02a0004810 2024-04-26T23:42:45.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.651+0000 7f02bca00640 1 -- 172.21.15.137:0/3845323375 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a80a88f0 con 0x7f02a0004810 2024-04-26T23:42:45.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.651+0000 7f02c0800640 1 -- 172.21.15.137:0/3845323375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02a0004810 msgr2=0x7f02a0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:45.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.651+0000 7f02c0800640 1 --2- 172.21.15.137:0/3845323375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02a0004810 0x7f02a0004c90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f02a80018d0 tx=0x7f02a801ec90 comp rx=0 tx=0).stop 2024-04-26T23:42:45.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.651+0000 7f02c0800640 1 -- 172.21.15.137:0/3845323375 shutdown_connections 2024-04-26T23:42:45.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.651+0000 7f02c0800640 1 --2- 172.21.15.137:0/3845323375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02a0004810 0x7f02a0004c90 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.651+0000 7f02c0800640 1 -- 172.21.15.137:0/3845323375 >> 172.21.15.137:0/3845323375 conn(0x7f02b806c800 msgr2=0x7f02b806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:45.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.651+0000 7f02c0800640 1 -- 172.21.15.137:0/3845323375 shutdown_connections 2024-04-26T23:42:45.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.651+0000 7f02c0800640 1 -- 172.21.15.137:0/3845323375 wait complete. 2024-04-26T23:42:45.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.651+0000 7f02c0800640 1 Processor -- start 2024-04-26T23:42:45.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.651+0000 7f02c0800640 1 -- start start 2024-04-26T23:42:45.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.651+0000 7f02c0800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02a0004810 0x7f02b8157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:45.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.651+0000 7f02c0800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f02b8152b00 0x7f02b8153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:45.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.651+0000 7f02c0800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02b80b23c0 0x7f02b80b2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:45.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.651+0000 7f02c0800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f02b80affa0 con 0x7f02b80b23c0 2024-04-26T23:42:45.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.651+0000 7f02c0800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f02b80d0850 con 0x7f02a0004810 2024-04-26T23:42:45.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.651+0000 7f02c0800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f02b80b0120 con 0x7f02b8152b00 2024-04-26T23:42:45.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.651+0000 7f02be800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02b80b23c0 0x7f02b80b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:45.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.655+0000 7f02be800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02b80b23c0 0x7f02b80b2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41600/0 (socket says 172.21.15.137:41600) 2024-04-26T23:42:45.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.655+0000 7f02be800640 1 -- 172.21.15.137:0/1430492547 learned_addr learned my addr 172.21.15.137:0/1430492547 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:45.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.655+0000 7f02bd400640 1 --2- 172.21.15.137:0/1430492547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f02b8152b00 0x7f02b8153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:45.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.655+0000 7f02bde00640 1 --2- 172.21.15.137:0/1430492547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02a0004810 0x7f02b8157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:45.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.655+0000 7f02be800640 1 -- 172.21.15.137:0/1430492547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f02b8152b00 msgr2=0x7f02b8153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:45.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.655+0000 7f02be800640 1 --2- 172.21.15.137:0/1430492547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f02b8152b00 0x7f02b8153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.655+0000 7f02be800640 1 -- 172.21.15.137:0/1430492547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02a0004810 msgr2=0x7f02b8157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:45.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.655+0000 7f02be800640 1 --2- 172.21.15.137:0/1430492547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02a0004810 0x7f02b8157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.655+0000 7f02be800640 1 -- 172.21.15.137:0/1430492547 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b81581a0 con 0x7f02b80b23c0 2024-04-26T23:42:45.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.655+0000 7f02bde00640 1 --2- 172.21.15.137:0/1430492547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02a0004810 0x7f02b8157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:45.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.655+0000 7f02bd400640 1 --2- 172.21.15.137:0/1430492547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f02b8152b00 0x7f02b8153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:45.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.655+0000 7f02be800640 1 --2- 172.21.15.137:0/1430492547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02b80b23c0 0x7f02b80b2850 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f02b80cf270 tx=0x7f02b40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:45.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.655+0000 7f02b2000640 1 -- 172.21.15.137:0/1430492547 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b4011e40 con 0x7f02b80b23c0 2024-04-26T23:42:45.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.655+0000 7f02b2000640 1 -- 172.21.15.137:0/1430492547 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b401b070 con 0x7f02b80b23c0 2024-04-26T23:42:45.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.655+0000 7f02b2000640 1 -- 172.21.15.137:0/1430492547 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b40039a0 con 0x7f02b80b23c0 2024-04-26T23:42:45.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.655+0000 7f02c0800640 1 -- 172.21.15.137:0/1430492547 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02b8151a60 con 0x7f02b80b23c0 2024-04-26T23:42:45.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.655+0000 7f02c0800640 1 -- 172.21.15.137:0/1430492547 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02b8152020 con 0x7f02b80b23c0 2024-04-26T23:42:45.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.655+0000 7f02c0800640 1 -- 172.21.15.137:0/1430492547 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02b806a410 con 0x7f02b80b23c0 2024-04-26T23:42:45.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.655+0000 7f02b2000640 1 -- 172.21.15.137:0/1430492547 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f02b4003b40 con 0x7f02b80b23c0 2024-04-26T23:42:45.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.655+0000 7f02b2000640 1 --2- 172.21.15.137:0/1430492547 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f029c068380 0x7f029c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:45.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.655+0000 7f02b2000640 1 -- 172.21.15.137:0/1430492547 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f02b40872e0 con 0x7f02b80b23c0 2024-04-26T23:42:45.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.659+0000 7f02bde00640 1 --2- 172.21.15.137:0/1430492547 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f029c068380 0x7f029c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:45.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.659+0000 7f02bde00640 1 --2- 172.21.15.137:0/1430492547 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f029c068380 0x7f029c06a840 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f02ac001ec0 tx=0x7f02ac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:45.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.659+0000 7f02b2000640 1 -- 172.21.15.137:0/1430492547 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f02b4025020 con 0x7f02b80b23c0 2024-04-26T23:42:45.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.819+0000 7f02c0800640 1 -- 172.21.15.137:0/1430492547 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f02b8160870 con 0x7f02b80b23c0 2024-04-26T23:42:45.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.819+0000 7f02b2000640 1 -- 172.21.15.137:0/1430492547 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) ==== 100+0+11 (secure 0 0 0) 0x7f02b40578a0 con 0x7f02b80b23c0 2024-04-26T23:42:45.824 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:42:45.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.819+0000 7f02c0800640 1 -- 172.21.15.137:0/1430492547 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f029c068380 msgr2=0x7f029c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:45.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.819+0000 7f02c0800640 1 --2- 172.21.15.137:0/1430492547 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f029c068380 0x7f029c06a840 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f02ac001ec0 tx=0x7f02ac009040 comp rx=0 tx=0).stop 2024-04-26T23:42:45.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.819+0000 7f02c0800640 1 -- 172.21.15.137:0/1430492547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02b80b23c0 msgr2=0x7f02b80b2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:45.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.819+0000 7f02c0800640 1 --2- 172.21.15.137:0/1430492547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02b80b23c0 0x7f02b80b2850 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f02b80cf270 tx=0x7f02b40115a0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.819+0000 7f02c0800640 1 -- 172.21.15.137:0/1430492547 shutdown_connections 2024-04-26T23:42:45.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.819+0000 7f02c0800640 1 --2- 172.21.15.137:0/1430492547 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f029c068380 0x7f029c06a840 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.819+0000 7f02c0800640 1 --2- 172.21.15.137:0/1430492547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02b80b23c0 0x7f02b80b2850 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.819+0000 7f02c0800640 1 --2- 172.21.15.137:0/1430492547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f02b8152b00 0x7f02b8153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.819+0000 7f02c0800640 1 --2- 172.21.15.137:0/1430492547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02a0004810 0x7f02b8157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.819+0000 7f02c0800640 1 -- 172.21.15.137:0/1430492547 >> 172.21.15.137:0/1430492547 conn(0x7f02b806c800 msgr2=0x7f02b80b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:45.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.819+0000 7f02c0800640 1 -- 172.21.15.137:0/1430492547 shutdown_connections 2024-04-26T23:42:45.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.819+0000 7f02c0800640 1 -- 172.21.15.137:0/1430492547 wait complete. 2024-04-26T23:42:45.846 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:42:45.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.975+0000 7f4d8c400640 1 Processor -- start 2024-04-26T23:42:45.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.975+0000 7f4d8c400640 1 -- start start 2024-04-26T23:42:45.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.979+0000 7f4d8c400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4d840725a0 0x7f4d840cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:45.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.979+0000 7f4d8c400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4d84073f30 0x7f4d84072980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:45.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.979+0000 7f4d8c400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d840cfef0 con 0x7f4d84072ec0 2024-04-26T23:42:45.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.979+0000 7f4d8c400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4d840cddc0 con 0x7f4d84073f30 2024-04-26T23:42:45.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.979+0000 7f4d8c400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f4d840d01b0 con 0x7f4d840725a0 2024-04-26T23:42:45.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.979+0000 7f4d89000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4d84073f30 0x7f4d84072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:45.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.979+0000 7f4d89000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4d84073f30 0x7f4d84072980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41608/0 (socket says 172.21.15.137:41608) 2024-04-26T23:42:45.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.979+0000 7f4d8a400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4d84072ec0 0x7f4d840b4070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:60616/0 (socket says 172.21.15.137:60616) 2024-04-26T23:42:45.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.979+0000 7f4d89000640 1 -- 172.21.15.137:0/212340190 learned_addr learned my addr 172.21.15.137:0/212340190 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:45.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.979+0000 7f4d89a00640 1 --2- 172.21.15.137:0/212340190 >> v2:172.21.15.170:3300/0 conn(0x7f4d840725a0 0x7f4d840cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:45.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.979+0000 7f4d89000640 1 -- 172.21.15.137:0/212340190 >> v2:172.21.15.170:3300/0 conn(0x7f4d840725a0 msgr2=0x7f4d840cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:45.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.979+0000 7f4d89000640 1 --2- 172.21.15.137:0/212340190 >> v2:172.21.15.170:3300/0 conn(0x7f4d840725a0 0x7f4d840cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.979+0000 7f4d89000640 1 -- 172.21.15.137:0/212340190 >> v1:172.21.15.137:6789/0 conn(0x7f4d84072ec0 legacy=0x7f4d840b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:45.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.979+0000 7f4d89000640 1 -- 172.21.15.137:0/212340190 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d840d0490 con 0x7f4d84073f30 2024-04-26T23:42:45.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.979+0000 7f4d89a00640 1 --2- 172.21.15.137:0/212340190 >> v2:172.21.15.170:3300/0 conn(0x7f4d840725a0 0x7f4d840cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:45.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.979+0000 7f4d83e00640 1 -- 172.21.15.137:0/212340190 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2250504116 0 0) 0x7f4d840cfef0 con 0x7f4d84072ec0 2024-04-26T23:42:45.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.979+0000 7f4d89000640 1 --2- 172.21.15.137:0/212340190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d84073f30 0x7f4d84072980 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4d8406ffc0 tx=0x7f4d7001cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5cdc5e37ad9d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:45.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d83e00640 1 -- 172.21.15.137:0/212340190 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d700aa670 con 0x7f4d84073f30 2024-04-26T23:42:45.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d83e00640 1 -- 172.21.15.137:0/212340190 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d700af070 con 0x7f4d84073f30 2024-04-26T23:42:45.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d83e00640 1 -- 172.21.15.137:0/212340190 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d700aaa30 con 0x7f4d84073f30 2024-04-26T23:42:45.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d8c400640 1 -- 172.21.15.137:0/212340190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d84073f30 msgr2=0x7f4d84072980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:45.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d8c400640 1 --2- 172.21.15.137:0/212340190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d84073f30 0x7f4d84072980 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4d8406ffc0 tx=0x7f4d7001cf50 comp rx=0 tx=0).stop 2024-04-26T23:42:45.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d8c400640 1 -- 172.21.15.137:0/212340190 shutdown_connections 2024-04-26T23:42:45.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d8c400640 1 --2- 172.21.15.137:0/212340190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d84073f30 0x7f4d84072980 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d8c400640 1 --2- 172.21.15.137:0/212340190 >> v2:172.21.15.170:3300/0 conn(0x7f4d840725a0 0x7f4d840cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d8c400640 1 -- 172.21.15.137:0/212340190 >> 172.21.15.137:0/212340190 conn(0x7f4d8406c5d0 msgr2=0x7f4d8406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:45.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d8c400640 1 -- 172.21.15.137:0/212340190 shutdown_connections 2024-04-26T23:42:45.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d8c400640 1 -- 172.21.15.137:0/212340190 wait complete. 2024-04-26T23:42:45.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d8c400640 1 Processor -- start 2024-04-26T23:42:45.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d8c400640 1 -- start start 2024-04-26T23:42:45.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d8c400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d840725a0 0x7f4d8413bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:45.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d8c400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d84072ec0 0x7f4d8413e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:45.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d8c400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d84073f30 0x7f4d841446f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:45.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d8c400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4d840b5110 con 0x7f4d840725a0 2024-04-26T23:42:45.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d8c400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4d840b4f90 con 0x7f4d84073f30 2024-04-26T23:42:45.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d8c400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4d840b5290 con 0x7f4d84072ec0 2024-04-26T23:42:45.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d89a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d840725a0 0x7f4d8413bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:45.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d89a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d840725a0 0x7f4d8413bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41620/0 (socket says 172.21.15.137:41620) 2024-04-26T23:42:45.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d89a00640 1 -- 172.21.15.137:0/4036102477 learned_addr learned my addr 172.21.15.137:0/4036102477 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:45.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d89000640 1 --2- 172.21.15.137:0/4036102477 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d84072ec0 0x7f4d8413e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:45.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d8a400640 1 --2- 172.21.15.137:0/4036102477 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d84073f30 0x7f4d841446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:45.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d89a00640 1 -- 172.21.15.137:0/4036102477 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d84072ec0 msgr2=0x7f4d8413e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:45.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d89a00640 1 --2- 172.21.15.137:0/4036102477 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d84072ec0 0x7f4d8413e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d89a00640 1 -- 172.21.15.137:0/4036102477 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d84073f30 msgr2=0x7f4d841446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:45.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d89a00640 1 --2- 172.21.15.137:0/4036102477 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d84073f30 0x7f4d841446f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:45.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.983+0000 7f4d89a00640 1 -- 172.21.15.137:0/4036102477 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8413ee00 con 0x7f4d840725a0 2024-04-26T23:42:45.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.987+0000 7f4d89a00640 1 --2- 172.21.15.137:0/4036102477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d840725a0 0x7f4d8413bcc0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800d800 tx=0x7f4d7800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:45.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.987+0000 7f4d81600640 1 -- 172.21.15.137:0/4036102477 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7800b6c0 con 0x7f4d840725a0 2024-04-26T23:42:45.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.987+0000 7f4d81600640 1 -- 172.21.15.137:0/4036102477 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d78019070 con 0x7f4d840725a0 2024-04-26T23:42:45.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.987+0000 7f4d81600640 1 -- 172.21.15.137:0/4036102477 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7800baa0 con 0x7f4d840725a0 2024-04-26T23:42:45.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.987+0000 7f4d8c400640 1 -- 172.21.15.137:0/4036102477 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d8413f0e0 con 0x7f4d840725a0 2024-04-26T23:42:45.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.987+0000 7f4d8c400640 1 -- 172.21.15.137:0/4036102477 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d8415d9a0 con 0x7f4d840725a0 2024-04-26T23:42:45.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.987+0000 7f4d8c400640 1 -- 172.21.15.137:0/4036102477 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d8406a4b0 con 0x7f4d840725a0 2024-04-26T23:42:45.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.987+0000 7f4d81600640 1 -- 172.21.15.137:0/4036102477 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4d7800bc40 con 0x7f4d840725a0 2024-04-26T23:42:45.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.987+0000 7f4d81600640 1 --2- 172.21.15.137:0/4036102477 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4d640683b0 0x7f4d6406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:45.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.987+0000 7f4d81600640 1 -- 172.21.15.137:0/4036102477 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f4d78086e50 con 0x7f4d840725a0 2024-04-26T23:42:45.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.987+0000 7f4d89000640 1 --2- 172.21.15.137:0/4036102477 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4d640683b0 0x7f4d6406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:45.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.991+0000 7f4d89000640 1 --2- 172.21.15.137:0/4036102477 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4d640683b0 0x7f4d6406a870 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4d700ae000 tx=0x7f4d70004740 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:45.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:45.995+0000 7f4d81600640 1 -- 172.21.15.137:0/4036102477 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4d78057400 con 0x7f4d840725a0 2024-04-26T23:42:46.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.159+0000 7f4d8c400640 1 -- 172.21.15.137:0/4036102477 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4d840ce1d0 con 0x7f4d840725a0 2024-04-26T23:42:46.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.163+0000 7f4d81600640 1 -- 172.21.15.137:0/4036102477 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7f4d78056d00 con 0x7f4d840725a0 2024-04-26T23:42:46.168 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T23:42:46.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.163+0000 7f4d8c400640 1 -- 172.21.15.137:0/4036102477 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4d640683b0 msgr2=0x7f4d6406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:46.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.163+0000 7f4d8c400640 1 --2- 172.21.15.137:0/4036102477 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4d640683b0 0x7f4d6406a870 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4d700ae000 tx=0x7f4d70004740 comp rx=0 tx=0).stop 2024-04-26T23:42:46.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.163+0000 7f4d8c400640 1 -- 172.21.15.137:0/4036102477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d840725a0 msgr2=0x7f4d8413bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:46.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.163+0000 7f4d8c400640 1 --2- 172.21.15.137:0/4036102477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d840725a0 0x7f4d8413bcc0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800d800 tx=0x7f4d7800dcc0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.163+0000 7f4d8c400640 1 -- 172.21.15.137:0/4036102477 shutdown_connections 2024-04-26T23:42:46.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.163+0000 7f4d8c400640 1 --2- 172.21.15.137:0/4036102477 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4d640683b0 0x7f4d6406a870 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.163+0000 7f4d8c400640 1 --2- 172.21.15.137:0/4036102477 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d84073f30 0x7f4d841446f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.163+0000 7f4d8c400640 1 --2- 172.21.15.137:0/4036102477 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d84072ec0 0x7f4d8413e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.163+0000 7f4d8c400640 1 --2- 172.21.15.137:0/4036102477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d840725a0 0x7f4d8413bcc0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.163+0000 7f4d8c400640 1 -- 172.21.15.137:0/4036102477 >> 172.21.15.137:0/4036102477 conn(0x7f4d8406c5d0 msgr2=0x7f4d840af730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:46.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.163+0000 7f4d8c400640 1 -- 172.21.15.137:0/4036102477 shutdown_connections 2024-04-26T23:42:46.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.163+0000 7f4d8c400640 1 -- 172.21.15.137:0/4036102477 wait complete. 2024-04-26T23:42:46.190 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:42:46.190 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:42:46.200 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:42:46.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.327+0000 7f16f4a00640 1 Processor -- start 2024-04-26T23:42:46.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.327+0000 7f16f4a00640 1 -- start start 2024-04-26T23:42:46.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.331+0000 7f16f4a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f16f00ce3e0 0x7f16f0073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:46.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.331+0000 7f16f4a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f16f015de80 0x7f16f00d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:46.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.331+0000 7f16f4a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f0073010 con 0x7f16f00ce7c0 2024-04-26T23:42:46.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.331+0000 7f16f4a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f16f00cef90 con 0x7f16f00ce3e0 2024-04-26T23:42:46.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.331+0000 7f16f4a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f16f0073280 con 0x7f16f015de80 2024-04-26T23:42:46.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.331+0000 7f16ede00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f16f00ce3e0 0x7f16f0073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:46.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.331+0000 7f16ede00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f16f00ce3e0 0x7f16f0073d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41630/0 (socket says 172.21.15.137:41630) 2024-04-26T23:42:46.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.331+0000 7f16ede00640 1 -- 172.21.15.137:0/2447070141 learned_addr learned my addr 172.21.15.137:0/2447070141 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:46.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.331+0000 7f16ede00640 1 -- 172.21.15.137:0/2447070141 >> v2:172.21.15.170:3300/0 conn(0x7f16f015de80 msgr2=0x7f16f00d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:46.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.331+0000 7f16ede00640 1 --2- 172.21.15.137:0/2447070141 >> v2:172.21.15.170:3300/0 conn(0x7f16f015de80 0x7f16f00d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.331+0000 7f16ede00640 1 -- 172.21.15.137:0/2447070141 >> v1:172.21.15.170:6789/0 conn(0x7f16f00ce7c0 legacy=0x7f16f0146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:46.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.331+0000 7f16ede00640 1 -- 172.21.15.137:0/2447070141 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f0073560 con 0x7f16f00ce3e0 2024-04-26T23:42:46.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.335+0000 7f16ede00640 1 --2- 172.21.15.137:0/2447070141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f00ce3e0 0x7f16f0073d60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009e50 tx=0x7f16e001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79fedbdaae66097 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.335+0000 7f16eca00640 1 -- 172.21.15.137:0/2447070141 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e00a5860 con 0x7f16f00ce3e0 2024-04-26T23:42:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.335+0000 7f16eca00640 1 -- 172.21.15.137:0/2447070141 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e00a5a00 con 0x7f16f00ce3e0 2024-04-26T23:42:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.335+0000 7f16eca00640 1 -- 172.21.15.137:0/2447070141 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e00a5dd0 con 0x7f16f00ce3e0 2024-04-26T23:42:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.335+0000 7f16f4a00640 1 -- 172.21.15.137:0/2447070141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f00ce3e0 msgr2=0x7f16f0073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.335+0000 7f16f4a00640 1 --2- 172.21.15.137:0/2447070141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f00ce3e0 0x7f16f0073d60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009e50 tx=0x7f16e001c980 comp rx=0 tx=0).stop 2024-04-26T23:42:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.335+0000 7f16f4a00640 1 -- 172.21.15.137:0/2447070141 shutdown_connections 2024-04-26T23:42:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.335+0000 7f16f4a00640 1 --2- 172.21.15.137:0/2447070141 >> v2:172.21.15.170:3300/0 conn(0x7f16f015de80 0x7f16f00d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.335+0000 7f16f4a00640 1 --2- 172.21.15.137:0/2447070141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f00ce3e0 0x7f16f0073d60 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.335+0000 7f16f4a00640 1 -- 172.21.15.137:0/2447070141 >> 172.21.15.137:0/2447070141 conn(0x7f16f006c5d0 msgr2=0x7f16f006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.335+0000 7f16f4a00640 1 -- 172.21.15.137:0/2447070141 shutdown_connections 2024-04-26T23:42:46.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.335+0000 7f16f4a00640 1 -- 172.21.15.137:0/2447070141 wait complete. 2024-04-26T23:42:46.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.335+0000 7f16f4a00640 1 Processor -- start 2024-04-26T23:42:46.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.335+0000 7f16f4a00640 1 -- start start 2024-04-26T23:42:46.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.335+0000 7f16f4a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f00ce3e0 0x7f16f00ab530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:46.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16f4a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16f00ce7c0 0x7f16f00aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:46.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16f4a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16f015de80 0x7f16f00cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:46.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16f4a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f16f0146aa0 con 0x7f16f00ce3e0 2024-04-26T23:42:46.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16f4a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f16f0146920 con 0x7f16f00ce7c0 2024-04-26T23:42:46.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16f4a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f16f006ed10 con 0x7f16f015de80 2024-04-26T23:42:46.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16ede00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f00ce3e0 0x7f16f00ab530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:46.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16ede00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f00ce3e0 0x7f16f00ab530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41638/0 (socket says 172.21.15.137:41638) 2024-04-26T23:42:46.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16ede00640 1 -- 172.21.15.137:0/551659620 learned_addr learned my addr 172.21.15.137:0/551659620 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:46.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16ed400640 1 --2- 172.21.15.137:0/551659620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16f00ce7c0 0x7f16f00aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:46.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16ee800640 1 --2- 172.21.15.137:0/551659620 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16f015de80 0x7f16f00cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:46.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16ede00640 1 -- 172.21.15.137:0/551659620 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16f015de80 msgr2=0x7f16f00cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:46.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16ede00640 1 --2- 172.21.15.137:0/551659620 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16f015de80 0x7f16f00cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16ede00640 1 -- 172.21.15.137:0/551659620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16f00ce7c0 msgr2=0x7f16f00aa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:46.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16ede00640 1 --2- 172.21.15.137:0/551659620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16f00ce7c0 0x7f16f00aa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16ede00640 1 -- 172.21.15.137:0/551659620 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f0140ed0 con 0x7f16f00ce3e0 2024-04-26T23:42:46.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16ee800640 1 --2- 172.21.15.137:0/551659620 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16f015de80 0x7f16f00cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:46.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16ede00640 1 --2- 172.21.15.137:0/551659620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f00ce3e0 0x7f16f00ab530 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f16e00af040 tx=0x7f16e0019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:46.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16e6000640 1 -- 172.21.15.137:0/551659620 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e00b8880 con 0x7f16f00ce3e0 2024-04-26T23:42:46.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16e6000640 1 -- 172.21.15.137:0/551659620 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e00be070 con 0x7f16f00ce3e0 2024-04-26T23:42:46.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16f4a00640 1 -- 172.21.15.137:0/551659620 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f01411b0 con 0x7f16f00ce3e0 2024-04-26T23:42:46.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16e6000640 1 -- 172.21.15.137:0/551659620 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e00b8c60 con 0x7f16f00ce3e0 2024-04-26T23:42:46.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16f4a00640 1 -- 172.21.15.137:0/551659620 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f013ca60 con 0x7f16f00ce3e0 2024-04-26T23:42:46.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16f4a00640 1 -- 172.21.15.137:0/551659620 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f006a4b0 con 0x7f16f00ce3e0 2024-04-26T23:42:46.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.339+0000 7f16e6000640 1 -- 172.21.15.137:0/551659620 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f16e00c3460 con 0x7f16f00ce3e0 2024-04-26T23:42:46.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.343+0000 7f16e6000640 1 --2- 172.21.15.137:0/551659620 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f16d0068380 0x7f16d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:46.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.343+0000 7f16e6000640 1 -- 172.21.15.137:0/551659620 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f16e0121dd0 con 0x7f16f00ce3e0 2024-04-26T23:42:46.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.343+0000 7f16ed400640 1 --2- 172.21.15.137:0/551659620 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f16d0068380 0x7f16d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:46.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.343+0000 7f16ed400640 1 --2- 172.21.15.137:0/551659620 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f16d0068380 0x7f16d006a840 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f16dc006fd0 tx=0x7f16dc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:46.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.347+0000 7f16e6000640 1 -- 172.21.15.137:0/551659620 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f16e00165a0 con 0x7f16f00ce3e0 2024-04-26T23:42:46.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.503+0000 7f16f4a00640 1 -- 172.21.15.137:0/551659620 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16f006d410 con 0x7f16f00ce3e0 2024-04-26T23:42:46.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.503+0000 7f16e6000640 1 -- 172.21.15.137:0/551659620 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16717 (secure 0 0 0) 0x7f16e0123020 con 0x7f16f00ce3e0 2024-04-26T23:42:46.511 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:46.511 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":33,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:42:26.483092+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:42:22.570062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:42:23.822598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:42:46.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.507+0000 7f16f4a00640 1 -- 172.21.15.137:0/551659620 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f16d0068380 msgr2=0x7f16d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:46.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.507+0000 7f16f4a00640 1 --2- 172.21.15.137:0/551659620 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f16d0068380 0x7f16d006a840 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f16dc006fd0 tx=0x7f16dc008040 comp rx=0 tx=0).stop 2024-04-26T23:42:46.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.507+0000 7f16f4a00640 1 -- 172.21.15.137:0/551659620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f00ce3e0 msgr2=0x7f16f00ab530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:46.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.507+0000 7f16f4a00640 1 --2- 172.21.15.137:0/551659620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f00ce3e0 0x7f16f00ab530 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f16e00af040 tx=0x7f16e0019720 comp rx=0 tx=0).stop 2024-04-26T23:42:46.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.507+0000 7f16f4a00640 1 -- 172.21.15.137:0/551659620 shutdown_connections 2024-04-26T23:42:46.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.507+0000 7f16f4a00640 1 --2- 172.21.15.137:0/551659620 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f16d0068380 0x7f16d006a840 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.507+0000 7f16f4a00640 1 --2- 172.21.15.137:0/551659620 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16f015de80 0x7f16f00cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.507+0000 7f16f4a00640 1 --2- 172.21.15.137:0/551659620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16f00ce7c0 0x7f16f00aa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.507+0000 7f16f4a00640 1 --2- 172.21.15.137:0/551659620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16f00ce3e0 0x7f16f00ab530 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.507+0000 7f16f4a00640 1 -- 172.21.15.137:0/551659620 >> 172.21.15.137:0/551659620 conn(0x7f16f006c5d0 msgr2=0x7f16f01453d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:46.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.507+0000 7f16f4a00640 1 -- 172.21.15.137:0/551659620 shutdown_connections 2024-04-26T23:42:46.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.507+0000 7f16f4a00640 1 -- 172.21.15.137:0/551659620 wait complete. 2024-04-26T23:42:46.532 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:42:22.570062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:42:23.822598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:42:46.532 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:42:46.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.663+0000 7fa516600640 1 Processor -- start 2024-04-26T23:42:46.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.667+0000 7fa516600640 1 -- start start 2024-04-26T23:42:46.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.667+0000 7fa516600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa5100ceb00 0x7fa510152510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:46.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.667+0000 7fa516600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5100b3d90 0x7fa5100b4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:46.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.667+0000 7fa516600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa51015baf0 con 0x7fa5100738d0 2024-04-26T23:42:46.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.667+0000 7fa516600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa51015bdb0 con 0x7fa5100ceb00 2024-04-26T23:42:46.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.667+0000 7fa516600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa51015c090 con 0x7fa5100b3d90 2024-04-26T23:42:46.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.667+0000 7fa50f400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa5100ceb00 0x7fa510152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:46.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.667+0000 7fa506a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa5100738d0 0x7fa510073d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:60632/0 (socket says 172.21.15.137:60632) 2024-04-26T23:42:46.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.667+0000 7fa506a00640 1 -- 172.21.15.137:0/4001740576 learned_addr learned my addr 172.21.15.137:0/4001740576 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:46.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.667+0000 7fa50fe00640 1 --2- 172.21.15.137:0/4001740576 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5100b3d90 0x7fa5100b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:46.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.667+0000 7fa50f400640 1 -- 172.21.15.137:0/4001740576 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5100b3d90 msgr2=0x7fa5100b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:46.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.667+0000 7fa50f400640 1 --2- 172.21.15.137:0/4001740576 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5100b3d90 0x7fa5100b4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.667+0000 7fa50f400640 1 -- 172.21.15.137:0/4001740576 >> v1:172.21.15.137:6789/0 conn(0x7fa5100738d0 legacy=0x7fa510073d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:46.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.667+0000 7fa50f400640 1 -- 172.21.15.137:0/4001740576 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51015c370 con 0x7fa5100ceb00 2024-04-26T23:42:46.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.667+0000 7fa50ea00640 1 -- 172.21.15.137:0/4001740576 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2072298323 0 0) 0x7fa51015baf0 con 0x7fa5100738d0 2024-04-26T23:42:46.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.671+0000 7fa50f400640 1 --2- 172.21.15.137:0/4001740576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5100ceb00 0x7fa510152510 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa500009d90 tx=0x7fa50001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a4c50a9e75fc65 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:46.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.671+0000 7fa50ea00640 1 -- 172.21.15.137:0/4001740576 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5000b2070 con 0x7fa5100ceb00 2024-04-26T23:42:46.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.671+0000 7fa50ea00640 1 -- 172.21.15.137:0/4001740576 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5000a58b0 con 0x7fa5100ceb00 2024-04-26T23:42:46.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.671+0000 7fa50ea00640 1 -- 172.21.15.137:0/4001740576 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5000a5c80 con 0x7fa5100ceb00 2024-04-26T23:42:46.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.671+0000 7fa516600640 1 -- 172.21.15.137:0/4001740576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5100ceb00 msgr2=0x7fa510152510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:46.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.671+0000 7fa516600640 1 --2- 172.21.15.137:0/4001740576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5100ceb00 0x7fa510152510 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa500009d90 tx=0x7fa50001c8e0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.671+0000 7fa516600640 1 -- 172.21.15.137:0/4001740576 shutdown_connections 2024-04-26T23:42:46.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.671+0000 7fa516600640 1 --2- 172.21.15.137:0/4001740576 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5100b3d90 0x7fa5100b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.671+0000 7fa516600640 1 --2- 172.21.15.137:0/4001740576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5100ceb00 0x7fa510152510 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.671+0000 7fa516600640 1 -- 172.21.15.137:0/4001740576 >> 172.21.15.137:0/4001740576 conn(0x7fa51006c800 msgr2=0x7fa51006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:46.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.671+0000 7fa516600640 1 -- 172.21.15.137:0/4001740576 shutdown_connections 2024-04-26T23:42:46.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.671+0000 7fa516600640 1 -- 172.21.15.137:0/4001740576 wait complete. 2024-04-26T23:42:46.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.671+0000 7fa516600640 1 Processor -- start 2024-04-26T23:42:46.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.671+0000 7fa516600640 1 -- start start 2024-04-26T23:42:46.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa516600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5100738d0 0x7fa5100b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:46.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa516600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5100b3d90 0x7fa51014d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:46.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa516600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa510151210 0x7fa5101516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:46.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa516600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa51006f270 con 0x7fa510151210 2024-04-26T23:42:46.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa516600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa51006f0f0 con 0x7fa5100738d0 2024-04-26T23:42:46.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa516600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa51006f3f0 con 0x7fa5100b3d90 2024-04-26T23:42:46.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa50fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa510151210 0x7fa5101516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:46.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa50fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa510151210 0x7fa5101516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41652/0 (socket says 172.21.15.137:41652) 2024-04-26T23:42:46.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa50fe00640 1 -- 172.21.15.137:0/4156106748 learned_addr learned my addr 172.21.15.137:0/4156106748 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:46.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa50f400640 1 --2- 172.21.15.137:0/4156106748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5100738d0 0x7fa5100b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:46.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa506a00640 1 --2- 172.21.15.137:0/4156106748 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5100b3d90 0x7fa51014d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:46.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa50fe00640 1 -- 172.21.15.137:0/4156106748 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5100b3d90 msgr2=0x7fa51014d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:46.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa50fe00640 1 --2- 172.21.15.137:0/4156106748 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5100b3d90 0x7fa51014d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa50fe00640 1 -- 172.21.15.137:0/4156106748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5100738d0 msgr2=0x7fa5100b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:46.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa50fe00640 1 --2- 172.21.15.137:0/4156106748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5100738d0 0x7fa5100b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa50fe00640 1 -- 172.21.15.137:0/4156106748 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5100af5b0 con 0x7fa510151210 2024-04-26T23:42:46.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa50f400640 1 --2- 172.21.15.137:0/4156106748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5100738d0 0x7fa5100b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:46.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa50fe00640 1 --2- 172.21.15.137:0/4156106748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa510151210 0x7fa5101516c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa50800d560 tx=0x7fa50800da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:46.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa507e00640 1 -- 172.21.15.137:0/4156106748 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5080125f0 con 0x7fa510151210 2024-04-26T23:42:46.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa507e00640 1 -- 172.21.15.137:0/4156106748 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa508019070 con 0x7fa510151210 2024-04-26T23:42:46.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa516600640 1 -- 172.21.15.137:0/4156106748 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5100af890 con 0x7fa510151210 2024-04-26T23:42:46.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa507e00640 1 -- 172.21.15.137:0/4156106748 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5080129f0 con 0x7fa510151210 2024-04-26T23:42:46.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa516600640 1 -- 172.21.15.137:0/4156106748 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5100afe50 con 0x7fa510151210 2024-04-26T23:42:46.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa516600640 1 -- 172.21.15.137:0/4156106748 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa51006a410 con 0x7fa510151210 2024-04-26T23:42:46.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.675+0000 7fa507e00640 1 -- 172.21.15.137:0/4156106748 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa508012b90 con 0x7fa510151210 2024-04-26T23:42:46.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.679+0000 7fa507e00640 1 --2- 172.21.15.137:0/4156106748 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa4ec068380 0x7fa4ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:46.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.679+0000 7fa507e00640 1 -- 172.21.15.137:0/4156106748 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa508086ee0 con 0x7fa510151210 2024-04-26T23:42:46.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.679+0000 7fa50f400640 1 --2- 172.21.15.137:0/4156106748 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa4ec068380 0x7fa4ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:46.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.679+0000 7fa50f400640 1 --2- 172.21.15.137:0/4156106748 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa4ec068380 0x7fa4ec06a840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa5000af000 tx=0x7fa5000a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:46.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.683+0000 7fa507e00640 1 -- 172.21.15.137:0/4156106748 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa508057400 con 0x7fa510151210 2024-04-26T23:42:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.839+0000 7fa516600640 1 -- 172.21.15.137:0/4156106748 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa5100b5d50 con 0x7fa510151210 2024-04-26T23:42:46.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.839+0000 7fa507e00640 1 -- 172.21.15.137:0/4156106748 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) ==== 93+0+10 (secure 0 0 0) 0x7fa508056d00 con 0x7fa510151210 2024-04-26T23:42:46.846 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:42:46.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.843+0000 7fa516600640 1 -- 172.21.15.137:0/4156106748 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa4ec068380 msgr2=0x7fa4ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:46.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.843+0000 7fa516600640 1 --2- 172.21.15.137:0/4156106748 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa4ec068380 0x7fa4ec06a840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa5000af000 tx=0x7fa5000a7070 comp rx=0 tx=0).stop 2024-04-26T23:42:46.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.843+0000 7fa516600640 1 -- 172.21.15.137:0/4156106748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa510151210 msgr2=0x7fa5101516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:46.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.843+0000 7fa516600640 1 --2- 172.21.15.137:0/4156106748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa510151210 0x7fa5101516c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa50800d560 tx=0x7fa50800da20 comp rx=0 tx=0).stop 2024-04-26T23:42:46.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.843+0000 7fa516600640 1 -- 172.21.15.137:0/4156106748 shutdown_connections 2024-04-26T23:42:46.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.843+0000 7fa516600640 1 --2- 172.21.15.137:0/4156106748 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa4ec068380 0x7fa4ec06a840 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.843+0000 7fa516600640 1 --2- 172.21.15.137:0/4156106748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa510151210 0x7fa5101516c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.843+0000 7fa516600640 1 --2- 172.21.15.137:0/4156106748 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5100b3d90 0x7fa51014d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.843+0000 7fa516600640 1 --2- 172.21.15.137:0/4156106748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5100738d0 0x7fa5100b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:46.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.843+0000 7fa516600640 1 -- 172.21.15.137:0/4156106748 >> 172.21.15.137:0/4156106748 conn(0x7fa51006c800 msgr2=0x7fa51006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:46.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.843+0000 7fa516600640 1 -- 172.21.15.137:0/4156106748 shutdown_connections 2024-04-26T23:42:46.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.843+0000 7fa516600640 1 -- 172.21.15.137:0/4156106748 wait complete. 2024-04-26T23:42:46.867 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:42:47.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.999+0000 7f4c76e00640 1 Processor -- start 2024-04-26T23:42:47.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:46.999+0000 7f4c76e00640 1 -- start start 2024-04-26T23:42:47.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.003+0000 7f4c76e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c700ceac0 0x7f4c7015df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:47.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.003+0000 7f4c76e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c70072860 con 0x7f4c70073f20 2024-04-26T23:42:47.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.003+0000 7f4c76e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c700743b0 con 0x7f4c700afbc0 2024-04-26T23:42:47.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.003+0000 7f4c76e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4c70072b00 con 0x7f4c700ceac0 2024-04-26T23:42:47.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.003+0000 7f4c67400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4c70073f20 0x7f4c700ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:60646/0 (socket says 172.21.15.137:60646) 2024-04-26T23:42:47.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.003+0000 7f4c67400640 1 -- 172.21.15.137:0/575862563 learned_addr learned my addr 172.21.15.137:0/575862563 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:47.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.003+0000 7f4c74e00640 1 --2- 172.21.15.137:0/575862563 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c700ceac0 0x7f4c7015df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:47.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.003+0000 7f4c6f400640 1 -- 172.21.15.137:0/575862563 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1909985761 0 0) 0x7f4c70072860 con 0x7f4c70073f20 2024-04-26T23:42:47.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.003+0000 7f4c6f400640 1 -- 172.21.15.137:0/575862563 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c54003530 con 0x7f4c70073f20 2024-04-26T23:42:47.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.003+0000 7f4c6f400640 1 -- 172.21.15.137:0/575862563 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2638450043 0 0) 0x7f4c700743b0 con 0x7f4c700afbc0 2024-04-26T23:42:47.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.003+0000 7f4c6f400640 1 -- 172.21.15.137:0/575862563 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c70072860 con 0x7f4c700afbc0 2024-04-26T23:42:47.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.003+0000 7f4c74e00640 1 -- 172.21.15.137:0/575862563 >> v1:172.21.15.170:6789/0 conn(0x7f4c700afbc0 legacy=0x7f4c700735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:47.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.003+0000 7f4c74e00640 1 -- 172.21.15.137:0/575862563 >> v1:172.21.15.137:6789/0 conn(0x7f4c70073f20 legacy=0x7f4c700ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:47.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.003+0000 7f4c74e00640 1 -- 172.21.15.137:0/575862563 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c70072de0 con 0x7f4c700ceac0 2024-04-26T23:42:47.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.007+0000 7f4c74e00640 1 --2- 172.21.15.137:0/575862563 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c700ceac0 0x7f4c7015df90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4c68009820 tx=0x7f4c6801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cff04ebe13d9635 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:47.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.007+0000 7f4c6f400640 1 -- 172.21.15.137:0/575862563 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c680b0070 con 0x7f4c700ceac0 2024-04-26T23:42:47.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.007+0000 7f4c6f400640 1 -- 172.21.15.137:0/575862563 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c680ab600 con 0x7f4c700ceac0 2024-04-26T23:42:47.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.007+0000 7f4c6f400640 1 -- 172.21.15.137:0/575862563 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c680ab9d0 con 0x7f4c700ceac0 2024-04-26T23:42:47.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.007+0000 7f4c76e00640 1 -- 172.21.15.137:0/575862563 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c700ceac0 msgr2=0x7f4c7015df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:47.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.007+0000 7f4c76e00640 1 --2- 172.21.15.137:0/575862563 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c700ceac0 0x7f4c7015df90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4c68009820 tx=0x7f4c6801c4c0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.007+0000 7f4c76e00640 1 -- 172.21.15.137:0/575862563 shutdown_connections 2024-04-26T23:42:47.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.007+0000 7f4c76e00640 1 --2- 172.21.15.137:0/575862563 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c700ceac0 0x7f4c7015df90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.007+0000 7f4c76e00640 1 -- 172.21.15.137:0/575862563 >> 172.21.15.137:0/575862563 conn(0x7f4c7006c800 msgr2=0x7f4c7006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:47.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.007+0000 7f4c76e00640 1 -- 172.21.15.137:0/575862563 shutdown_connections 2024-04-26T23:42:47.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.007+0000 7f4c76e00640 1 -- 172.21.15.137:0/575862563 wait complete. 2024-04-26T23:42:47.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.007+0000 7f4c76e00640 1 Processor -- start 2024-04-26T23:42:47.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.007+0000 7f4c76e00640 1 -- start start 2024-04-26T23:42:47.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.007+0000 7f4c76e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c700afbc0 0x7f4c70151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:47.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.007+0000 7f4c76e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c700ceac0 0x7f4c70146310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:47.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.007+0000 7f4c76e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c701420f0 0x7f4c700ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:47.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.007+0000 7f4c76e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7006ffe0 con 0x7f4c701420f0 2024-04-26T23:42:47.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.007+0000 7f4c76e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4c700b01f0 con 0x7f4c700ceac0 2024-04-26T23:42:47.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.007+0000 7f4c76e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4c70070160 con 0x7f4c700afbc0 2024-04-26T23:42:47.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.007+0000 7f4c74e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c701420f0 0x7f4c700ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:47.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.007+0000 7f4c74e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c701420f0 0x7f4c700ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41654/0 (socket says 172.21.15.137:41654) 2024-04-26T23:42:47.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.007+0000 7f4c74e00640 1 -- 172.21.15.137:0/1455233737 learned_addr learned my addr 172.21.15.137:0/1455233737 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:47.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.011+0000 7f4c6fe00640 1 --2- 172.21.15.137:0/1455233737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c700afbc0 0x7f4c70151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:47.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.011+0000 7f4c67400640 1 --2- 172.21.15.137:0/1455233737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c700ceac0 0x7f4c70146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:47.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.011+0000 7f4c74e00640 1 -- 172.21.15.137:0/1455233737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c700afbc0 msgr2=0x7f4c70151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:47.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.011+0000 7f4c74e00640 1 --2- 172.21.15.137:0/1455233737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c700afbc0 0x7f4c70151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.011+0000 7f4c74e00640 1 -- 172.21.15.137:0/1455233737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c700ceac0 msgr2=0x7f4c70146310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:47.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.011+0000 7f4c74e00640 1 --2- 172.21.15.137:0/1455233737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c700ceac0 0x7f4c70146310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.011+0000 7f4c74e00640 1 -- 172.21.15.137:0/1455233737 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c70146850 con 0x7f4c701420f0 2024-04-26T23:42:47.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.011+0000 7f4c74e00640 1 --2- 172.21.15.137:0/1455233737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c701420f0 0x7f4c700ae8d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4c6801a0f0 tx=0x7f4c68019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:47.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.011+0000 7f4c6cc00640 1 -- 172.21.15.137:0/1455233737 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c680b0040 con 0x7f4c701420f0 2024-04-26T23:42:47.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.011+0000 7f4c6cc00640 1 -- 172.21.15.137:0/1455233737 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c680bd070 con 0x7f4c701420f0 2024-04-26T23:42:47.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.011+0000 7f4c76e00640 1 -- 172.21.15.137:0/1455233737 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c700b4270 con 0x7f4c701420f0 2024-04-26T23:42:47.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.011+0000 7f4c6cc00640 1 -- 172.21.15.137:0/1455233737 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c680b5680 con 0x7f4c701420f0 2024-04-26T23:42:47.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.011+0000 7f4c76e00640 1 -- 172.21.15.137:0/1455233737 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c700b4830 con 0x7f4c701420f0 2024-04-26T23:42:47.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.011+0000 7f4c76e00640 1 -- 172.21.15.137:0/1455233737 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c7006a410 con 0x7f4c701420f0 2024-04-26T23:42:47.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.011+0000 7f4c6cc00640 1 -- 172.21.15.137:0/1455233737 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4c680b3070 con 0x7f4c701420f0 2024-04-26T23:42:47.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.015+0000 7f4c6cc00640 1 --2- 172.21.15.137:0/1455233737 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4c4c0683b0 0x7f4c4c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:47.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.015+0000 7f4c6cc00640 1 -- 172.21.15.137:0/1455233737 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f4c68120490 con 0x7f4c701420f0 2024-04-26T23:42:47.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.015+0000 7f4c6fe00640 1 --2- 172.21.15.137:0/1455233737 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4c4c0683b0 0x7f4c4c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:47.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.015+0000 7f4c6fe00640 1 --2- 172.21.15.137:0/1455233737 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4c4c0683b0 0x7f4c4c06a870 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4c60007fd0 tx=0x7f4c60009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:47.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.019+0000 7f4c6cc00640 1 -- 172.21.15.137:0/1455233737 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4c680c6020 con 0x7f4c701420f0 2024-04-26T23:42:47.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.171+0000 7f4c76e00640 1 -- 172.21.15.137:0/1455233737 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4c70142b50 con 0x7f4c701420f0 2024-04-26T23:42:47.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.175+0000 7f4c6cc00640 1 -- 172.21.15.137:0/1455233737 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) ==== 104+0+11 (secure 0 0 0) 0x7f4c680160b0 con 0x7f4c701420f0 2024-04-26T23:42:47.180 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:42:47.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.175+0000 7f4c76e00640 1 -- 172.21.15.137:0/1455233737 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4c4c0683b0 msgr2=0x7f4c4c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:47.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.175+0000 7f4c76e00640 1 --2- 172.21.15.137:0/1455233737 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4c4c0683b0 0x7f4c4c06a870 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4c60007fd0 tx=0x7f4c60009040 comp rx=0 tx=0).stop 2024-04-26T23:42:47.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.175+0000 7f4c76e00640 1 -- 172.21.15.137:0/1455233737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c701420f0 msgr2=0x7f4c700ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:47.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.175+0000 7f4c76e00640 1 --2- 172.21.15.137:0/1455233737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c701420f0 0x7f4c700ae8d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4c6801a0f0 tx=0x7f4c68019260 comp rx=0 tx=0).stop 2024-04-26T23:42:47.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.175+0000 7f4c76e00640 1 -- 172.21.15.137:0/1455233737 shutdown_connections 2024-04-26T23:42:47.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.175+0000 7f4c76e00640 1 --2- 172.21.15.137:0/1455233737 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4c4c0683b0 0x7f4c4c06a870 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.175+0000 7f4c76e00640 1 --2- 172.21.15.137:0/1455233737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c701420f0 0x7f4c700ae8d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.175+0000 7f4c76e00640 1 --2- 172.21.15.137:0/1455233737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c700ceac0 0x7f4c70146310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.175+0000 7f4c76e00640 1 --2- 172.21.15.137:0/1455233737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c700afbc0 0x7f4c70151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.175+0000 7f4c76e00640 1 -- 172.21.15.137:0/1455233737 >> 172.21.15.137:0/1455233737 conn(0x7f4c7006c800 msgr2=0x7f4c70152fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:47.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.175+0000 7f4c76e00640 1 -- 172.21.15.137:0/1455233737 shutdown_connections 2024-04-26T23:42:47.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.175+0000 7f4c76e00640 1 -- 172.21.15.137:0/1455233737 wait complete. 2024-04-26T23:42:47.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:42:47.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.331+0000 7f1f5c800640 1 Processor -- start 2024-04-26T23:42:47.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.331+0000 7f1f5c800640 1 -- start start 2024-04-26T23:42:47.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.335+0000 7f1f5c800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1f540b54e0 0x7f1f540b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:47.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.335+0000 7f1f5c800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f540cd710 0x7f1f5415f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:47.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.335+0000 7f1f5c800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f540cffa0 con 0x7f1f5415fe30 2024-04-26T23:42:47.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.335+0000 7f1f5c800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f1f540b3d90 con 0x7f1f540b54e0 2024-04-26T23:42:47.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.335+0000 7f1f5c800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1f540d0840 con 0x7f1f540cd710 2024-04-26T23:42:47.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.335+0000 7f1f5a800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f1f5415fe30 0x7f1f54144d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:60662/0 (socket says 172.21.15.137:60662) 2024-04-26T23:42:47.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.335+0000 7f1f5a800640 1 -- 172.21.15.137:0/3141181801 learned_addr learned my addr 172.21.15.137:0/3141181801 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:47.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.335+0000 7f1f59e00640 1 --2- 172.21.15.137:0/3141181801 >> v2:172.21.15.170:3300/0 conn(0x7f1f540b54e0 0x7f1f540b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:47.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.335+0000 7f1f59400640 1 --2- 172.21.15.137:0/3141181801 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f540cd710 0x7f1f5415f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:47.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.335+0000 7f1f58a00640 1 -- 172.21.15.137:0/3141181801 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2741446285 0 0) 0x7f1f540cffa0 con 0x7f1f5415fe30 2024-04-26T23:42:47.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.335+0000 7f1f58a00640 1 -- 172.21.15.137:0/3141181801 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f3c003530 con 0x7f1f5415fe30 2024-04-26T23:42:47.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.335+0000 7f1f59e00640 1 -- 172.21.15.137:0/3141181801 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f540cd710 msgr2=0x7f1f5415f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:47.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.335+0000 7f1f59e00640 1 --2- 172.21.15.137:0/3141181801 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f540cd710 0x7f1f5415f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.335+0000 7f1f59e00640 1 -- 172.21.15.137:0/3141181801 >> v1:172.21.15.137:6789/0 conn(0x7f1f5415fe30 legacy=0x7f1f54144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:47.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.335+0000 7f1f59e00640 1 -- 172.21.15.137:0/3141181801 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f540d0280 con 0x7f1f540b54e0 2024-04-26T23:42:47.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.339+0000 7f1f59e00640 1 --2- 172.21.15.137:0/3141181801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f540b54e0 0x7f1f540b5ee0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1f480097c0 tx=0x7f1f4801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67b9795f64baa6bf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:47.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.339+0000 7f1f58a00640 1 -- 172.21.15.137:0/3141181801 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f480b1070 con 0x7f1f540b54e0 2024-04-26T23:42:47.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.339+0000 7f1f58a00640 1 -- 172.21.15.137:0/3141181801 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f480ac410 con 0x7f1f540b54e0 2024-04-26T23:42:47.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.339+0000 7f1f58a00640 1 -- 172.21.15.137:0/3141181801 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f480ac7e0 con 0x7f1f540b54e0 2024-04-26T23:42:47.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.339+0000 7f1f5c800640 1 -- 172.21.15.137:0/3141181801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f540b54e0 msgr2=0x7f1f540b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:47.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.339+0000 7f1f5c800640 1 --2- 172.21.15.137:0/3141181801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f540b54e0 0x7f1f540b5ee0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1f480097c0 tx=0x7f1f4801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.339+0000 7f1f5c800640 1 -- 172.21.15.137:0/3141181801 shutdown_connections 2024-04-26T23:42:47.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.339+0000 7f1f5c800640 1 --2- 172.21.15.137:0/3141181801 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f540cd710 0x7f1f5415f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.339+0000 7f1f5c800640 1 --2- 172.21.15.137:0/3141181801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f540b54e0 0x7f1f540b5ee0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.339+0000 7f1f5c800640 1 -- 172.21.15.137:0/3141181801 >> 172.21.15.137:0/3141181801 conn(0x7f1f5406c800 msgr2=0x7f1f5406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:47.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.339+0000 7f1f5c800640 1 -- 172.21.15.137:0/3141181801 shutdown_connections 2024-04-26T23:42:47.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.339+0000 7f1f5c800640 1 -- 172.21.15.137:0/3141181801 wait complete. 2024-04-26T23:42:47.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.339+0000 7f1f5c800640 1 Processor -- start 2024-04-26T23:42:47.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.339+0000 7f1f5c800640 1 -- start start 2024-04-26T23:42:47.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f5c800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f540b54e0 0x7f1f54166210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:47.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f5c800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f540cd710 0x7f1f540b1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:47.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f5c800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f5415fe30 0x7f1f5412dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:47.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f5c800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1f540cdb20 con 0x7f1f540cd710 2024-04-26T23:42:47.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f5c800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1f54145840 con 0x7f1f540b54e0 2024-04-26T23:42:47.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f5c800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1f540b19d0 con 0x7f1f5415fe30 2024-04-26T23:42:47.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f59400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f540cd710 0x7f1f540b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:47.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f59400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f540cd710 0x7f1f540b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41666/0 (socket says 172.21.15.137:41666) 2024-04-26T23:42:47.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f59400640 1 -- 172.21.15.137:0/1867045846 learned_addr learned my addr 172.21.15.137:0/1867045846 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:47.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f59e00640 1 --2- 172.21.15.137:0/1867045846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f540b54e0 0x7f1f54166210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:47.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f5a800640 1 --2- 172.21.15.137:0/1867045846 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f5415fe30 0x7f1f5412dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:47.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f59400640 1 -- 172.21.15.137:0/1867045846 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f5415fe30 msgr2=0x7f1f5412dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:47.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f59400640 1 --2- 172.21.15.137:0/1867045846 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f5415fe30 0x7f1f5412dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f59400640 1 -- 172.21.15.137:0/1867045846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f540b54e0 msgr2=0x7f1f54166210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:47.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f59400640 1 --2- 172.21.15.137:0/1867045846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f540b54e0 0x7f1f54166210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f59400640 1 -- 172.21.15.137:0/1867045846 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5415d920 con 0x7f1f540cd710 2024-04-26T23:42:47.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f5a800640 1 --2- 172.21.15.137:0/1867045846 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f5415fe30 0x7f1f5412dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:47.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f59400640 1 --2- 172.21.15.137:0/1867045846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f540cd710 0x7f1f540b1490 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400e8a0 tx=0x7f1f4400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:47.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f4e000640 1 -- 172.21.15.137:0/1867045846 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44017070 con 0x7f1f540cd710 2024-04-26T23:42:47.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f4e000640 1 -- 172.21.15.137:0/1867045846 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f4400c940 con 0x7f1f540cd710 2024-04-26T23:42:47.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f5c800640 1 -- 172.21.15.137:0/1867045846 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5415dc00 con 0x7f1f540cd710 2024-04-26T23:42:47.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f4e000640 1 -- 172.21.15.137:0/1867045846 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4400ccf0 con 0x7f1f540cd710 2024-04-26T23:42:47.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f5c800640 1 -- 172.21.15.137:0/1867045846 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f5415e1c0 con 0x7f1f540cd710 2024-04-26T23:42:47.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.343+0000 7f1f5c800640 1 -- 172.21.15.137:0/1867045846 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f5406a410 con 0x7f1f540cd710 2024-04-26T23:42:47.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.347+0000 7f1f4e000640 1 -- 172.21.15.137:0/1867045846 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1f4401a070 con 0x7f1f540cd710 2024-04-26T23:42:47.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.347+0000 7f1f4e000640 1 --2- 172.21.15.137:0/1867045846 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1f38068380 0x7f1f3806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:47.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.347+0000 7f1f4e000640 1 -- 172.21.15.137:0/1867045846 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1f44086cb0 con 0x7f1f540cd710 2024-04-26T23:42:47.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.347+0000 7f1f59e00640 1 --2- 172.21.15.137:0/1867045846 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1f38068380 0x7f1f3806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:47.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.347+0000 7f1f59e00640 1 --2- 172.21.15.137:0/1867045846 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1f38068380 0x7f1f3806a840 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1f480ae000 tx=0x7f1f48008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:47.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.351+0000 7f1f4e000640 1 -- 172.21.15.137:0/1867045846 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1f44056af0 con 0x7f1f540cd710 2024-04-26T23:42:47.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.507+0000 7f1f5c800640 1 -- 172.21.15.137:0/1867045846 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1f5415bd40 con 0x7f1f540cd710 2024-04-26T23:42:47.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.507+0000 7f1f4e000640 1 -- 172.21.15.137:0/1867045846 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) ==== 100+0+11 (secure 0 0 0) 0x7f1f4405adf0 con 0x7f1f540cd710 2024-04-26T23:42:47.514 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:42:47.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.511+0000 7f1f5c800640 1 -- 172.21.15.137:0/1867045846 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1f38068380 msgr2=0x7f1f3806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:47.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.511+0000 7f1f5c800640 1 --2- 172.21.15.137:0/1867045846 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1f38068380 0x7f1f3806a840 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1f480ae000 tx=0x7f1f48008040 comp rx=0 tx=0).stop 2024-04-26T23:42:47.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.511+0000 7f1f5c800640 1 -- 172.21.15.137:0/1867045846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f540cd710 msgr2=0x7f1f540b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:47.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.511+0000 7f1f5c800640 1 --2- 172.21.15.137:0/1867045846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f540cd710 0x7f1f540b1490 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400e8a0 tx=0x7f1f4400eca0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.511+0000 7f1f5c800640 1 -- 172.21.15.137:0/1867045846 shutdown_connections 2024-04-26T23:42:47.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.511+0000 7f1f5c800640 1 --2- 172.21.15.137:0/1867045846 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1f38068380 0x7f1f3806a840 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.511+0000 7f1f5c800640 1 --2- 172.21.15.137:0/1867045846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f540cd710 0x7f1f540b1490 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.511+0000 7f1f5c800640 1 --2- 172.21.15.137:0/1867045846 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f5415fe30 0x7f1f5412dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.511+0000 7f1f5c800640 1 --2- 172.21.15.137:0/1867045846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f540b54e0 0x7f1f54166210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.511+0000 7f1f5c800640 1 -- 172.21.15.137:0/1867045846 >> 172.21.15.137:0/1867045846 conn(0x7f1f5406c800 msgr2=0x7f1f5406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:47.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.511+0000 7f1f5c800640 1 -- 172.21.15.137:0/1867045846 shutdown_connections 2024-04-26T23:42:47.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.511+0000 7f1f5c800640 1 -- 172.21.15.137:0/1867045846 wait complete. 2024-04-26T23:42:47.536 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:42:47.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.667+0000 7f44f6600640 1 Processor -- start 2024-04-26T23:42:47.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.667+0000 7f44f6600640 1 -- start start 2024-04-26T23:42:47.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.667+0000 7f44f6600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44f00725a0 0x7f44f00cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:47.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.667+0000 7f44f6600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44f00cfef0 con 0x7f44f0073f30 2024-04-26T23:42:47.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.667+0000 7f44f6600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44f00cddc0 con 0x7f44f00b5080 2024-04-26T23:42:47.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.667+0000 7f44f6600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f44f00d01b0 con 0x7f44f00725a0 2024-04-26T23:42:47.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.667+0000 7f44e6a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f44f0073f30 0x7f44f0072980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:60672/0 (socket says 172.21.15.137:60672) 2024-04-26T23:42:47.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.667+0000 7f44e6a00640 1 -- 172.21.15.137:0/3015820205 learned_addr learned my addr 172.21.15.137:0/3015820205 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:47.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.667+0000 7f44ef400640 1 --2- 172.21.15.137:0/3015820205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44f00725a0 0x7f44f00cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:47.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.667+0000 7f44eea00640 1 -- 172.21.15.137:0/3015820205 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4255600225 0 0) 0x7f44f00cfef0 con 0x7f44f0073f30 2024-04-26T23:42:47.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.667+0000 7f44eea00640 1 -- 172.21.15.137:0/3015820205 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44d4003530 con 0x7f44f0073f30 2024-04-26T23:42:47.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.671+0000 7f44eea00640 1 -- 172.21.15.137:0/3015820205 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 738085624 0 0) 0x7f44d4003530 con 0x7f44f0073f30 2024-04-26T23:42:47.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.671+0000 7f44eea00640 1 -- 172.21.15.137:0/3015820205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44f00725a0 msgr2=0x7f44f00cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:47.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.671+0000 7f44eea00640 1 --2- 172.21.15.137:0/3015820205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44f00725a0 0x7f44f00cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.671+0000 7f44eea00640 1 -- 172.21.15.137:0/3015820205 >> v1:172.21.15.170:6789/0 conn(0x7f44f00b5080 legacy=0x7f44f0165930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:47.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.671+0000 7f44eea00640 1 -- 172.21.15.137:0/3015820205 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f00d0490 con 0x7f44f0073f30 2024-04-26T23:42:47.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.671+0000 7f44eea00640 1 -- 172.21.15.137:0/3015820205 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f44d8001680 con 0x7f44f0073f30 2024-04-26T23:42:47.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.671+0000 7f44eea00640 1 -- 172.21.15.137:0/3015820205 >> v1:172.21.15.137:6789/0 conn(0x7f44f0073f30 legacy=0x7f44f0072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:47.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.671+0000 7f44eea00640 1 --2- 172.21.15.137:0/3015820205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d40039f0 0x7f44d4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:47.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.671+0000 7f44eea00640 1 --2- 172.21.15.137:0/3015820205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44d4004810 0x7f44d4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:47.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.671+0000 7f44eea00640 1 --2- 172.21.15.137:0/3015820205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44f00725a0 0x7f44d40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:47.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.671+0000 7f44eea00640 1 -- 172.21.15.137:0/3015820205 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f44f00d01b0 con 0x7f44d4004810 2024-04-26T23:42:47.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.671+0000 7f44eea00640 1 -- 172.21.15.137:0/3015820205 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f44d400ba80 con 0x7f44d40039f0 2024-04-26T23:42:47.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.671+0000 7f44eea00640 1 -- 172.21.15.137:0/3015820205 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f44d400de90 con 0x7f44f00725a0 2024-04-26T23:42:47.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.671+0000 7f44e6a00640 1 --2- 172.21.15.137:0/3015820205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44d4004810 0x7f44d4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:47.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.671+0000 7f44ef400640 1 --2- 172.21.15.137:0/3015820205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d40039f0 0x7f44d4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:47.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.671+0000 7f44efe00640 1 --2- 172.21.15.137:0/3015820205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44f00725a0 0x7f44d40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:47.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.671+0000 7f44e6a00640 1 -- 172.21.15.137:0/3015820205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44f00725a0 msgr2=0x7f44d40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:47.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.671+0000 7f44e6a00640 1 --2- 172.21.15.137:0/3015820205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44f00725a0 0x7f44d40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.671+0000 7f44e6a00640 1 -- 172.21.15.137:0/3015820205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d40039f0 msgr2=0x7f44d4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:47.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.671+0000 7f44e6a00640 1 --2- 172.21.15.137:0/3015820205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d40039f0 0x7f44d4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.671+0000 7f44e6a00640 1 -- 172.21.15.137:0/3015820205 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d4003530 con 0x7f44d4004810 2024-04-26T23:42:47.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.671+0000 7f44e6a00640 1 --2- 172.21.15.137:0/3015820205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44d4004810 0x7f44d4004c90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f44d800c210 tx=0x7f44d801f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f98859eee78c816 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:47.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.675+0000 7f44eea00640 1 -- 172.21.15.137:0/3015820205 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d8007d20 con 0x7f44d4004810 2024-04-26T23:42:47.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.675+0000 7f44eea00640 1 -- 172.21.15.137:0/3015820205 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44d8005ae0 con 0x7f44d4004810 2024-04-26T23:42:47.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.675+0000 7f44eea00640 1 -- 172.21.15.137:0/3015820205 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d8007070 con 0x7f44d4004810 2024-04-26T23:42:47.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.675+0000 7f44f6600640 1 -- 172.21.15.137:0/3015820205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44d4004810 msgr2=0x7f44d4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:47.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.675+0000 7f44f6600640 1 --2- 172.21.15.137:0/3015820205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44d4004810 0x7f44d4004c90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f44d800c210 tx=0x7f44d801f390 comp rx=0 tx=0).stop 2024-04-26T23:42:47.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.675+0000 7f44efe00640 1 -- 172.21.15.137:0/3015820205 reap_dead start 2024-04-26T23:42:47.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.675+0000 7f44f6600640 1 -- 172.21.15.137:0/3015820205 shutdown_connections 2024-04-26T23:42:47.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.675+0000 7f44f6600640 1 -- 172.21.15.137:0/3015820205 >> 172.21.15.137:0/3015820205 conn(0x7f44f006c5d0 msgr2=0x7f44f006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:47.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.675+0000 7f44f6600640 1 -- 172.21.15.137:0/3015820205 shutdown_connections 2024-04-26T23:42:47.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.675+0000 7f44f6600640 1 -- 172.21.15.137:0/3015820205 wait complete. 2024-04-26T23:42:47.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.675+0000 7f44f6600640 1 Processor -- start 2024-04-26T23:42:47.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.675+0000 7f44f6600640 1 -- start start 2024-04-26T23:42:47.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.675+0000 7f44f6600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44d4004810 0x7f44f00ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:47.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.675+0000 7f44f6600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44f01f9560 0x7f44f015b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:47.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.675+0000 7f44f6600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44f0140170 0x7f44f01405f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:47.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.675+0000 7f44f6600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f44f0073090 con 0x7f44d4004810 2024-04-26T23:42:47.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.675+0000 7f44f6600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f44f0074390 con 0x7f44f0140170 2024-04-26T23:42:47.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.675+0000 7f44f6600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f44f0073210 con 0x7f44f01f9560 2024-04-26T23:42:47.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.675+0000 7f44ef400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44d4004810 0x7f44f00ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:47.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.675+0000 7f44ef400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44d4004810 0x7f44f00ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41686/0 (socket says 172.21.15.137:41686) 2024-04-26T23:42:47.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.675+0000 7f44ef400640 1 -- 172.21.15.137:0/1483719058 learned_addr learned my addr 172.21.15.137:0/1483719058 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:47.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.675+0000 7f44efe00640 1 --2- 172.21.15.137:0/1483719058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44f0140170 0x7f44f01405f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:47.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.679+0000 7f44ef400640 1 -- 172.21.15.137:0/1483719058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44f01f9560 msgr2=0x7f44f015b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:47.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.679+0000 7f44e6a00640 1 --2- 172.21.15.137:0/1483719058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44f01f9560 0x7f44f015b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:47.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.679+0000 7f44ef400640 1 --2- 172.21.15.137:0/1483719058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44f01f9560 0x7f44f015b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.679+0000 7f44ef400640 1 -- 172.21.15.137:0/1483719058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44f0140170 msgr2=0x7f44f01405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:47.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.679+0000 7f44ef400640 1 --2- 172.21.15.137:0/1483719058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44f0140170 0x7f44f01405f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.679+0000 7f44ef400640 1 -- 172.21.15.137:0/1483719058 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f01f99e0 con 0x7f44d4004810 2024-04-26T23:42:47.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.679+0000 7f44efe00640 1 --2- 172.21.15.137:0/1483719058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44f0140170 0x7f44f01405f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:47.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.679+0000 7f44e6a00640 1 --2- 172.21.15.137:0/1483719058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44f01f9560 0x7f44f015b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:47.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.679+0000 7f44ef400640 1 --2- 172.21.15.137:0/1483719058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44d4004810 0x7f44f00ae8d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f44e0011a00 tx=0x7f44e0011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:47.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.679+0000 7f44e7e00640 1 -- 172.21.15.137:0/1483719058 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e000faf0 con 0x7f44d4004810 2024-04-26T23:42:47.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.679+0000 7f44e7e00640 1 -- 172.21.15.137:0/1483719058 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44e000fc90 con 0x7f44d4004810 2024-04-26T23:42:47.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.679+0000 7f44e7e00640 1 -- 172.21.15.137:0/1483719058 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e0014440 con 0x7f44d4004810 2024-04-26T23:42:47.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.679+0000 7f44f6600640 1 -- 172.21.15.137:0/1483719058 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f00aefd0 con 0x7f44d4004810 2024-04-26T23:42:47.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.679+0000 7f44f6600640 1 -- 172.21.15.137:0/1483719058 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f00af590 con 0x7f44d4004810 2024-04-26T23:42:47.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.679+0000 7f44f6600640 1 -- 172.21.15.137:0/1483719058 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f0140b30 con 0x7f44d4004810 2024-04-26T23:42:47.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.679+0000 7f44e7e00640 1 -- 172.21.15.137:0/1483719058 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f44e0012040 con 0x7f44d4004810 2024-04-26T23:42:47.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.679+0000 7f44e7e00640 1 --2- 172.21.15.137:0/1483719058 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f44cc068380 0x7f44cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:47.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.679+0000 7f44e7e00640 1 -- 172.21.15.137:0/1483719058 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f44e0087060 con 0x7f44d4004810 2024-04-26T23:42:47.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.679+0000 7f44e6a00640 1 --2- 172.21.15.137:0/1483719058 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f44cc068380 0x7f44cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:47.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.683+0000 7f44e6a00640 1 --2- 172.21.15.137:0/1483719058 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f44cc068380 0x7f44cc06a840 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f44d80af000 tx=0x7f44d80aa000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:47.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.683+0000 7f44e7e00640 1 -- 172.21.15.137:0/1483719058 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f44e0019030 con 0x7f44d4004810 2024-04-26T23:42:47.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.851+0000 7f44f6600640 1 -- 172.21.15.137:0/1483719058 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f44f006a4b0 con 0x7f44d4004810 2024-04-26T23:42:47.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.855+0000 7f44e7e00640 1 -- 172.21.15.137:0/1483719058 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7f44e001c360 con 0x7f44d4004810 2024-04-26T23:42:47.860 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T23:42:47.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.855+0000 7f44f6600640 1 -- 172.21.15.137:0/1483719058 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f44cc068380 msgr2=0x7f44cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:47.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.855+0000 7f44f6600640 1 --2- 172.21.15.137:0/1483719058 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f44cc068380 0x7f44cc06a840 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f44d80af000 tx=0x7f44d80aa000 comp rx=0 tx=0).stop 2024-04-26T23:42:47.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.855+0000 7f44f6600640 1 -- 172.21.15.137:0/1483719058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44d4004810 msgr2=0x7f44f00ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:47.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.855+0000 7f44f6600640 1 --2- 172.21.15.137:0/1483719058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44d4004810 0x7f44f00ae8d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f44e0011a00 tx=0x7f44e0011ec0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.855+0000 7f44f6600640 1 -- 172.21.15.137:0/1483719058 shutdown_connections 2024-04-26T23:42:47.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.855+0000 7f44f6600640 1 --2- 172.21.15.137:0/1483719058 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f44cc068380 0x7f44cc06a840 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.855+0000 7f44f6600640 1 --2- 172.21.15.137:0/1483719058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44f0140170 0x7f44f01405f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.855+0000 7f44f6600640 1 --2- 172.21.15.137:0/1483719058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44f01f9560 0x7f44f015b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.855+0000 7f44f6600640 1 --2- 172.21.15.137:0/1483719058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44d4004810 0x7f44f00ae8d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:47.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.855+0000 7f44f6600640 1 -- 172.21.15.137:0/1483719058 >> 172.21.15.137:0/1483719058 conn(0x7f44f006c5d0 msgr2=0x7f44f006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:47.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.855+0000 7f44f6600640 1 -- 172.21.15.137:0/1483719058 shutdown_connections 2024-04-26T23:42:47.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:47.855+0000 7f44f6600640 1 -- 172.21.15.137:0/1483719058 wait complete. 2024-04-26T23:42:47.882 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi170.front.sepia.ceph.com... 2024-04-26T23:42:47.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:47.882 DEBUG:teuthology.orchestra.run.smithi170:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-04-26T23:42:47.901 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:ceph-fuse[32424]: fuse finished with error 0 and tester_r 0 2024-04-26T23:42:47.904 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:42:48.524 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:42:48.528 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:42:54.006 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T23:42:54.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:54.006 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-26T23:42:54.017 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:42:54.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.155+0000 7f2b81400640 1 Processor -- start 2024-04-26T23:42:54.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.155+0000 7f2b81400640 1 -- start start 2024-04-26T23:42:54.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.159+0000 7f2b81400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2b7c0725a0 0x7f2b7c0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:54.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.159+0000 7f2b81400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b7c073f30 0x7f2b7c072980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:54.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.159+0000 7f2b81400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b7c0cfef0 con 0x7f2b7c072ec0 2024-04-26T23:42:54.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.159+0000 7f2b81400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2b7c0cddc0 con 0x7f2b7c0725a0 2024-04-26T23:42:54.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.159+0000 7f2b81400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2b7c0d01b0 con 0x7f2b7c073f30 2024-04-26T23:42:54.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.159+0000 7f2b7a800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2b7c0725a0 0x7f2b7c0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:54.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.159+0000 7f2b7a800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2b7c0725a0 0x7f2b7c0cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34256/0 (socket says 172.21.15.137:34256) 2024-04-26T23:42:54.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.159+0000 7f2b7a800640 1 -- 172.21.15.137:0/3555582119 learned_addr learned my addr 172.21.15.137:0/3555582119 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:54.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.159+0000 7f2b79e00640 1 --2- 172.21.15.137:0/3555582119 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b7c073f30 0x7f2b7c072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:54.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.159+0000 7f2b7a800640 1 -- 172.21.15.137:0/3555582119 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b7c073f30 msgr2=0x7f2b7c072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:54.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.159+0000 7f2b7a800640 1 --2- 172.21.15.137:0/3555582119 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b7c073f30 0x7f2b7c072980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.159+0000 7f2b7a800640 1 -- 172.21.15.137:0/3555582119 >> v1:172.21.15.170:6789/0 conn(0x7f2b7c072ec0 legacy=0x7f2b7c0b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:54.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.159+0000 7f2b7a800640 1 -- 172.21.15.137:0/3555582119 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b7c0d0490 con 0x7f2b7c0725a0 2024-04-26T23:42:54.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.163+0000 7f2b7a800640 1 --2- 172.21.15.137:0/3555582119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b7c0725a0 0x7f2b7c0cd770 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009e50 tx=0x7f2b6c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de357277952d56a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:54.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.163+0000 7f2b79400640 1 -- 172.21.15.137:0/3555582119 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c0a5860 con 0x7f2b7c0725a0 2024-04-26T23:42:54.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.163+0000 7f2b79400640 1 -- 172.21.15.137:0/3555582119 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b6c0a5a00 con 0x7f2b7c0725a0 2024-04-26T23:42:54.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.163+0000 7f2b79400640 1 -- 172.21.15.137:0/3555582119 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c0a5dd0 con 0x7f2b7c0725a0 2024-04-26T23:42:54.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.163+0000 7f2b81400640 1 -- 172.21.15.137:0/3555582119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b7c0725a0 msgr2=0x7f2b7c0cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:54.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.163+0000 7f2b81400640 1 --2- 172.21.15.137:0/3555582119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b7c0725a0 0x7f2b7c0cd770 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009e50 tx=0x7f2b6c01c9c0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.163+0000 7f2b81400640 1 -- 172.21.15.137:0/3555582119 shutdown_connections 2024-04-26T23:42:54.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.163+0000 7f2b81400640 1 --2- 172.21.15.137:0/3555582119 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b7c073f30 0x7f2b7c072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.163+0000 7f2b81400640 1 --2- 172.21.15.137:0/3555582119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b7c0725a0 0x7f2b7c0cd770 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.163+0000 7f2b81400640 1 -- 172.21.15.137:0/3555582119 >> 172.21.15.137:0/3555582119 conn(0x7f2b7c06c5d0 msgr2=0x7f2b7c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:54.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.163+0000 7f2b81400640 1 -- 172.21.15.137:0/3555582119 shutdown_connections 2024-04-26T23:42:54.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.163+0000 7f2b81400640 1 -- 172.21.15.137:0/3555582119 wait complete. 2024-04-26T23:42:54.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.163+0000 7f2b81400640 1 Processor -- start 2024-04-26T23:42:54.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.163+0000 7f2b81400640 1 -- start start 2024-04-26T23:42:54.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.163+0000 7f2b81400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b7c0725a0 0x7f2b7c1574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:54.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b81400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b7c072ec0 0x7f2b7c0b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:54.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b81400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b7c073f30 0x7f2b7c145d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:54.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b81400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7c0b5110 con 0x7f2b7c073f30 2024-04-26T23:42:54.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b81400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7c0b4f90 con 0x7f2b7c0725a0 2024-04-26T23:42:54.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b81400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2b7c0b5290 con 0x7f2b7c072ec0 2024-04-26T23:42:54.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b7b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b7c073f30 0x7f2b7c145d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:54.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b7b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b7c073f30 0x7f2b7c145d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34262/0 (socket says 172.21.15.137:34262) 2024-04-26T23:42:54.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b7b200640 1 -- 172.21.15.137:0/3303967733 learned_addr learned my addr 172.21.15.137:0/3303967733 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:54.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b7a800640 1 --2- 172.21.15.137:0/3303967733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b7c0725a0 0x7f2b7c1574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:54.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b79e00640 1 --2- 172.21.15.137:0/3303967733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b7c072ec0 0x7f2b7c0b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:54.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b7b200640 1 -- 172.21.15.137:0/3303967733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b7c072ec0 msgr2=0x7f2b7c0b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:54.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b7b200640 1 --2- 172.21.15.137:0/3303967733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b7c072ec0 0x7f2b7c0b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b7b200640 1 -- 172.21.15.137:0/3303967733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b7c0725a0 msgr2=0x7f2b7c1574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:54.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b7b200640 1 --2- 172.21.15.137:0/3303967733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b7c0725a0 0x7f2b7c1574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b7b200640 1 -- 172.21.15.137:0/3303967733 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b7c0b0980 con 0x7f2b7c073f30 2024-04-26T23:42:54.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b7b200640 1 --2- 172.21.15.137:0/3303967733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b7c073f30 0x7f2b7c145d30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400c3c0 tx=0x7f2b7400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:54.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b72a00640 1 -- 172.21.15.137:0/3303967733 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74011790 con 0x7f2b7c073f30 2024-04-26T23:42:54.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b72a00640 1 -- 172.21.15.137:0/3303967733 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b74017070 con 0x7f2b7c073f30 2024-04-26T23:42:54.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b81400640 1 -- 172.21.15.137:0/3303967733 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b7c0b0c60 con 0x7f2b7c073f30 2024-04-26T23:42:54.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b72a00640 1 -- 172.21.15.137:0/3303967733 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74011b70 con 0x7f2b7c073f30 2024-04-26T23:42:54.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b81400640 1 -- 172.21.15.137:0/3303967733 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b7c13a1a0 con 0x7f2b7c073f30 2024-04-26T23:42:54.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b81400640 1 -- 172.21.15.137:0/3303967733 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b7c06a4b0 con 0x7f2b7c073f30 2024-04-26T23:42:54.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.167+0000 7f2b72a00640 1 -- 172.21.15.137:0/3303967733 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2b74011d10 con 0x7f2b7c073f30 2024-04-26T23:42:54.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.171+0000 7f2b72a00640 1 --2- 172.21.15.137:0/3303967733 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2b5c068380 0x7f2b5c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:54.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.171+0000 7f2b72a00640 1 -- 172.21.15.137:0/3303967733 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f2b740866e0 con 0x7f2b7c073f30 2024-04-26T23:42:54.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.171+0000 7f2b7a800640 1 --2- 172.21.15.137:0/3303967733 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2b5c068380 0x7f2b5c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:54.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.171+0000 7f2b7a800640 1 --2- 172.21.15.137:0/3303967733 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2b5c068380 0x7f2b5c06a840 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0ae000 tx=0x7f2b6c0a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:54.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.175+0000 7f2b72a00640 1 -- 172.21.15.137:0/3303967733 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2b74056640 con 0x7f2b7c073f30 2024-04-26T23:42:54.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.363+0000 7f2b81400640 1 -- 172.21.15.137:0/3303967733 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b7c072380 con 0x7f2b7c073f30 2024-04-26T23:42:54.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.363+0000 7f2b72a00640 1 -- 172.21.15.137:0/3303967733 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5198 (secure 0 0 0) 0x7f2b7405a940 con 0x7f2b7c073f30 2024-04-26T23:42:54.371 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:54.371 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1345232353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1345232353},{"type":"v1","addr":"172.21.15.137:6836","nonce":1345232353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1274585662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1274585662},{"type":"v1","addr":"172.21.15.137:6837","nonce":1274585662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4079333736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4079333736},{"type":"v1","addr":"172.21.15.170:6834","nonce":4079333736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:42:24.865468+0000","modified":"2024-04-26T23:42:27.876394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34808},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34808":{"gid":34808,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/3364296586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3364296586},{"type":"v1","addr":"172.21.15.170:6835","nonce":3364296586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34808,"qdb_cluster":[34808]},"id":2}]} 2024-04-26T23:42:54.371 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 17 2024-04-26T23:42:54.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.367+0000 7f2b81400640 1 -- 172.21.15.137:0/3303967733 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2b5c068380 msgr2=0x7f2b5c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:54.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.367+0000 7f2b81400640 1 --2- 172.21.15.137:0/3303967733 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2b5c068380 0x7f2b5c06a840 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0ae000 tx=0x7f2b6c0a7070 comp rx=0 tx=0).stop 2024-04-26T23:42:54.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.367+0000 7f2b81400640 1 -- 172.21.15.137:0/3303967733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b7c073f30 msgr2=0x7f2b7c145d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:54.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.367+0000 7f2b81400640 1 --2- 172.21.15.137:0/3303967733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b7c073f30 0x7f2b7c145d30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400c3c0 tx=0x7f2b7400c880 comp rx=0 tx=0).stop 2024-04-26T23:42:54.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.367+0000 7f2b81400640 1 -- 172.21.15.137:0/3303967733 shutdown_connections 2024-04-26T23:42:54.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.367+0000 7f2b81400640 1 --2- 172.21.15.137:0/3303967733 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2b5c068380 0x7f2b5c06a840 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.367+0000 7f2b81400640 1 --2- 172.21.15.137:0/3303967733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b7c073f30 0x7f2b7c145d30 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.367+0000 7f2b81400640 1 --2- 172.21.15.137:0/3303967733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b7c072ec0 0x7f2b7c0b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.367+0000 7f2b81400640 1 --2- 172.21.15.137:0/3303967733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b7c0725a0 0x7f2b7c1574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.367+0000 7f2b81400640 1 -- 172.21.15.137:0/3303967733 >> 172.21.15.137:0/3303967733 conn(0x7f2b7c06c5d0 msgr2=0x7f2b7c06c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:54.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.367+0000 7f2b81400640 1 -- 172.21.15.137:0/3303967733 shutdown_connections 2024-04-26T23:42:54.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.367+0000 7f2b81400640 1 -- 172.21.15.137:0/3303967733 wait complete. 2024-04-26T23:42:54.392 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json perf dump 2024-04-26T23:42:54.559 INFO:teuthology.orchestra.run.smithi170.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":28,"msgr_send_messages":30,"msgr_recv_bytes":7529,"msgr_send_bytes":15958,"msgr_created_connections":7,"msgr_active_connections":2,"msgr_running_total_time":0.010093335,"msgr_running_send_time":0.000768637,"msgr_running_recv_time":0.004142223,"msgr_running_fast_dispatch_time":0.000997519,"msgr_send_messages_queue_lat":{"avgcount":28,"sum":0.110139932,"avgtime":0.003933569},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":84,"msgr_send_messages":72,"msgr_recv_bytes":119068,"msgr_send_bytes":42758,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.013734356,"msgr_running_send_time":0.002744168,"msgr_running_recv_time":0.015482974,"msgr_running_fast_dispatch_time":0.000705939,"msgr_send_messages_queue_lat":{"avgcount":72,"sum":0.056323762,"avgtime":0.000782274},"msgr_handle_ack_lat":{"avgcount":19,"sum":0.000003387,"avgtime":0.000000178},"msgr_recv_encrypted_bytes":113920,"msgr_send_encrypted_bytes":14752},"AsyncMessenger::Worker-2":{"msgr_recv_messages":31,"msgr_send_messages":27,"msgr_recv_bytes":9685,"msgr_send_bytes":80483,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.008926715,"msgr_running_send_time":0.002497791,"msgr_running_recv_time":0.004770740,"msgr_running_fast_dispatch_time":0.001229533,"msgr_send_messages_queue_lat":{"avgcount":26,"sum":0.026854576,"avgtime":0.001032868},"msgr_handle_ack_lat":{"avgcount":22,"sum":0.000015278,"avgtime":0.000000694},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":68704},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":36,"sum":0.002594850,"avgtime":0.000072079}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000025884,"avgtime":0.000012942}},"mds":{"request":3,"reply":3,"reply_latency":{"avgcount":3,"sum":0.000991847,"avgtime":0.000330615},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":0,"caps":0,"subtrees":2,"traverse":5,"traverse_hit":5,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":7,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197223,"rdpos":0,"jlat":{"avgcount":5,"sum":0.011237589,"avgtime":0.002247517},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":0,"cap+":2,"cap-":2,"rss":42456,"heap":231732},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":3,"handle_client_session":8,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":2,"sum":0.000583964,"avgtime":0.000291982},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000407883,"avgtime":0.000407883},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":2,"session_remove":2,"sessions_open":0,"sessions_stale":0,"total_load":2,"average_load":1,"avg_session_uptime":13,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":221411,"buffer_anon_items":62,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5312,"osdmap_items":75,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":52352,"mds_co_items":211,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":44,"op_send_bytes":14129,"op_resend":37,"op_reply":44,"op_latency":{"avgcount":44,"sum":1.115982218,"avgtime":0.025363232},"op_inflight":0,"oplen_avg":{"avgcount":44,"sum":68},"op":44,"op_r":0,"op_w":44,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":5,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":33,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":138,"get_sum":119243,"get_or_fail_fail":0,"get_or_fail_success":138,"take":0,"take_sum":0,"put":138,"put_sum":119243,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":14129,"put":44,"put_sum":14129,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":44,"put":44,"put_sum":44,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55bea5242780":{"val":0,"max":3758096384,"get_started":0,"get":7,"get_sum":2919,"get_or_fail_fail":0,"get_or_fail_success":7,"take":0,"take_sum":0,"put":5,"put_sum":2919,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-04-26T23:42:54.561 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 7529, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 28, "msgr_running_fast_dispatch_time": 0.000997519, "msgr_running_recv_time": 0.004142223, "msgr_running_send_time": 0.000768637, "msgr_running_total_time": 0.010093335, "msgr_send_bytes": 15958, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 30, "msgr_send_messages_queue_lat": { "avgcount": 28, "avgtime": 0.003933569, "sum": 0.110139932 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 19, "avgtime": 1.78e-07, "sum": 3.387e-06 }, "msgr_recv_bytes": 119068, "msgr_recv_encrypted_bytes": 113920, "msgr_recv_messages": 84, "msgr_running_fast_dispatch_time": 0.000705939, "msgr_running_recv_time": 0.015482974, "msgr_running_send_time": 0.002744168, "msgr_running_total_time": 0.013734356, "msgr_send_bytes": 42758, "msgr_send_encrypted_bytes": 14752, "msgr_send_messages": 72, "msgr_send_messages_queue_lat": { "avgcount": 72, "avgtime": 0.000782274, "sum": 0.056323762 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 22, "avgtime": 6.94e-07, "sum": 1.5278e-05 }, "msgr_recv_bytes": 9685, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 31, "msgr_running_fast_dispatch_time": 0.001229533, "msgr_running_recv_time": 0.00477074, "msgr_running_send_time": 0.002497791, "msgr_running_total_time": 0.008926715, "msgr_send_bytes": 80483, "msgr_send_encrypted_bytes": 68704, "msgr_send_messages": 27, "msgr_send_messages_queue_lat": { "avgcount": 26, "avgtime": 0.001032868, "sum": 0.026854576 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 36, "avgtime": 7.2079e-05, "sum": 0.00259485 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 1.2942e-05, "sum": 2.5884e-05 }, "queue_len": 0 }, "mds": { "caps": 0, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 0, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 3, "reply_latency": { "avgcount": 3, "avgtime": 0.000330615, "sum": 0.000991847 }, "request": 3, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 5, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 5, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 7, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.002247517, "sum": 0.011237589 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4197223 }, "mds_mem": { "cap": 0, "cap+": 2, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 231732, "ino": 13, "ino+": 13, "ino-": 0, "rss": 42456 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 3, "handle_client_session": 8, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 2, "avgtime": 0.000291982, "sum": 0.000583964 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000407883, "sum": 0.000407883 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 13, "mdthresh_evicted": 0, "session_add": 2, "session_count": 0, "session_remove": 2, "sessions_open": 0, "sessions_stale": 0, "total_load": 2 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 221411, "buffer_anon_items": 62, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 52352, "mds_co_items": 211, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5312, "osdmap_items": 75, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 33, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 44, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 44, "avgtime": 0.025363232, "sum": 1.115982218 }, "op_pg": 0, "op_r": 0, "op_reply": 44, "op_resend": 37, "op_rmw": 0, "op_send": 44, "op_send_bytes": 14129, "op_w": 44, "oplen_avg": { "avgcount": 44, "sum": 68 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 138, "get_or_fail_fail": 0, "get_or_fail_success": 138, "get_started": 0, "get_sum": 119243, "max": 104857600, "put": 138, "put_sum": 119243, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 44, "put_sum": 14129, "take": 44, "take_sum": 14129, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 44, "put_sum": 44, "take": 44, "take_sum": 44, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55bea5242780": { "get": 7, "get_or_fail_fail": 0, "get_or_fail_success": 7, "get_started": 0, "get_sum": 2919, "max": 3758096384, "put": 5, "put_sum": 2919, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-04-26T23:42:54.561 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:42:54.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.691+0000 7f25f9c00640 1 Processor -- start 2024-04-26T23:42:54.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.691+0000 7f25f9c00640 1 -- start start 2024-04-26T23:42:54.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.691+0000 7f25f9c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f25f40725a0 0x7f25f40cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:54.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.691+0000 7f25f9c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f25f4073f30 0x7f25f4072980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:54.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.691+0000 7f25f9c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25f40cfef0 con 0x7f25f4072ec0 2024-04-26T23:42:54.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.695+0000 7f25f9c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f25f40cddc0 con 0x7f25f4073f30 2024-04-26T23:42:54.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.695+0000 7f25f9c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f25f40d01b0 con 0x7f25f40725a0 2024-04-26T23:42:54.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.695+0000 7f25ea000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f25f4073f30 0x7f25f4072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:54.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.695+0000 7f25ea000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f25f4073f30 0x7f25f4072980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34272/0 (socket says 172.21.15.137:34272) 2024-04-26T23:42:54.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.695+0000 7f25ea000640 1 -- 172.21.15.137:0/2243244566 learned_addr learned my addr 172.21.15.137:0/2243244566 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:54.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.695+0000 7f25f2a00640 1 --2- 172.21.15.137:0/2243244566 >> v2:172.21.15.170:3300/0 conn(0x7f25f40725a0 0x7f25f40cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:54.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.695+0000 7f25ea000640 1 -- 172.21.15.137:0/2243244566 >> v2:172.21.15.170:3300/0 conn(0x7f25f40725a0 msgr2=0x7f25f40cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:54.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.695+0000 7f25ea000640 1 --2- 172.21.15.137:0/2243244566 >> v2:172.21.15.170:3300/0 conn(0x7f25f40725a0 0x7f25f40cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.695+0000 7f25ea000640 1 -- 172.21.15.137:0/2243244566 >> v1:172.21.15.170:6789/0 conn(0x7f25f4072ec0 legacy=0x7f25f40b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:54.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.695+0000 7f25ea000640 1 -- 172.21.15.137:0/2243244566 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f40d0490 con 0x7f25f4073f30 2024-04-26T23:42:54.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.695+0000 7f25ea000640 1 --2- 172.21.15.137:0/2243244566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25f4073f30 0x7f25f4072980 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f25f406ffc0 tx=0x7f25dc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2ed40ad00ca572 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:54.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.695+0000 7f25f2000640 1 -- 172.21.15.137:0/2243244566 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25dc0aa5f0 con 0x7f25f4073f30 2024-04-26T23:42:54.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.695+0000 7f25f2000640 1 -- 172.21.15.137:0/2243244566 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25dc0af070 con 0x7f25f4073f30 2024-04-26T23:42:54.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.695+0000 7f25f2000640 1 -- 172.21.15.137:0/2243244566 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25dc0aa9b0 con 0x7f25f4073f30 2024-04-26T23:42:54.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25f9c00640 1 -- 172.21.15.137:0/2243244566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25f4073f30 msgr2=0x7f25f4072980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:54.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25f9c00640 1 --2- 172.21.15.137:0/2243244566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25f4073f30 0x7f25f4072980 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f25f406ffc0 tx=0x7f25dc01c4f0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25f9c00640 1 -- 172.21.15.137:0/2243244566 shutdown_connections 2024-04-26T23:42:54.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25f9c00640 1 --2- 172.21.15.137:0/2243244566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25f4073f30 0x7f25f4072980 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25f9c00640 1 --2- 172.21.15.137:0/2243244566 >> v2:172.21.15.170:3300/0 conn(0x7f25f40725a0 0x7f25f40cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25f9c00640 1 -- 172.21.15.137:0/2243244566 >> 172.21.15.137:0/2243244566 conn(0x7f25f406c5d0 msgr2=0x7f25f406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:54.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25f9c00640 1 -- 172.21.15.137:0/2243244566 shutdown_connections 2024-04-26T23:42:54.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25f9c00640 1 -- 172.21.15.137:0/2243244566 wait complete. 2024-04-26T23:42:54.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25f9c00640 1 Processor -- start 2024-04-26T23:42:54.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25f9c00640 1 -- start start 2024-04-26T23:42:54.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25f9c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25f40725a0 0x7f25f4154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:54.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25f9c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25f4072ec0 0x7f25f40b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:54.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25f9c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f25f4073f30 0x7f25f40b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:54.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25f9c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f25f40b5110 con 0x7f25f4072ec0 2024-04-26T23:42:54.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25f9c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f25f40b4f90 con 0x7f25f40725a0 2024-04-26T23:42:54.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25f9c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f25f40b5290 con 0x7f25f4073f30 2024-04-26T23:42:54.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25ea000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25f4072ec0 0x7f25f40b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:54.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25ea000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25f4072ec0 0x7f25f40b0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34286/0 (socket says 172.21.15.137:34286) 2024-04-26T23:42:54.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25ea000640 1 -- 172.21.15.137:0/1070808920 learned_addr learned my addr 172.21.15.137:0/1070808920 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:54.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25f2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25f40725a0 0x7f25f4154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:54.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25f3400640 1 --2- 172.21.15.137:0/1070808920 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f25f4073f30 0x7f25f40b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:54.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25ea000640 1 -- 172.21.15.137:0/1070808920 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f25f4073f30 msgr2=0x7f25f40b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:54.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25ea000640 1 --2- 172.21.15.137:0/1070808920 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f25f4073f30 0x7f25f40b17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25ea000640 1 -- 172.21.15.137:0/1070808920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25f40725a0 msgr2=0x7f25f4154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:54.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25ea000640 1 --2- 172.21.15.137:0/1070808920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25f40725a0 0x7f25f4154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.699+0000 7f25ea000640 1 -- 172.21.15.137:0/1070808920 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f415de40 con 0x7f25f4072ec0 2024-04-26T23:42:54.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.703+0000 7f25ea000640 1 --2- 172.21.15.137:0/1070808920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25f4072ec0 0x7f25f40b0a60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f25dc01a120 tx=0x7f25dc019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:54.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.703+0000 7f25eb400640 1 -- 172.21.15.137:0/1070808920 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25dc0aae60 con 0x7f25f4072ec0 2024-04-26T23:42:54.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.703+0000 7f25eb400640 1 -- 172.21.15.137:0/1070808920 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25dc0be610 con 0x7f25f4072ec0 2024-04-26T23:42:54.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.703+0000 7f25eb400640 1 -- 172.21.15.137:0/1070808920 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25dc0bea00 con 0x7f25f4072ec0 2024-04-26T23:42:54.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.703+0000 7f25f9c00640 1 -- 172.21.15.137:0/1070808920 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25f415e120 con 0x7f25f4072ec0 2024-04-26T23:42:54.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.703+0000 7f25f9c00640 1 -- 172.21.15.137:0/1070808920 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25f415e6e0 con 0x7f25f4072ec0 2024-04-26T23:42:54.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.703+0000 7f25f9c00640 1 -- 172.21.15.137:0/1070808920 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25f406a4b0 con 0x7f25f4072ec0 2024-04-26T23:42:54.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.703+0000 7f25eb400640 1 -- 172.21.15.137:0/1070808920 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f25dc0bc020 con 0x7f25f4072ec0 2024-04-26T23:42:54.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.703+0000 7f25eb400640 1 --2- 172.21.15.137:0/1070808920 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f25d0068380 0x7f25d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:54.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.703+0000 7f25eb400640 1 -- 172.21.15.137:0/1070808920 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f25dc120760 con 0x7f25f4072ec0 2024-04-26T23:42:54.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.703+0000 7f25f2a00640 1 --2- 172.21.15.137:0/1070808920 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f25d0068380 0x7f25d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:54.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.707+0000 7f25f2a00640 1 --2- 172.21.15.137:0/1070808920 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f25d0068380 0x7f25d006a840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f25e4009ac0 tx=0x7f25e4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:54.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.707+0000 7f25eb400640 1 -- 172.21.15.137:0/1070808920 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f25dc0c5070 con 0x7f25f4072ec0 2024-04-26T23:42:54.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.899+0000 7f25f9c00640 1 -- 172.21.15.137:0/1070808920 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f25f4072380 con 0x7f25f4072ec0 2024-04-26T23:42:54.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.899+0000 7f25eb400640 1 -- 172.21.15.137:0/1070808920 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f25dc016110 con 0x7f25f4072ec0 2024-04-26T23:42:54.908 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:42:54.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.903+0000 7f25f9c00640 1 -- 172.21.15.137:0/1070808920 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f25d0068380 msgr2=0x7f25d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:54.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.903+0000 7f25f9c00640 1 --2- 172.21.15.137:0/1070808920 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f25d0068380 0x7f25d006a840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f25e4009ac0 tx=0x7f25e4009190 comp rx=0 tx=0).stop 2024-04-26T23:42:54.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.903+0000 7f25f9c00640 1 -- 172.21.15.137:0/1070808920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25f4072ec0 msgr2=0x7f25f40b0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:54.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.903+0000 7f25f9c00640 1 --2- 172.21.15.137:0/1070808920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25f4072ec0 0x7f25f40b0a60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f25dc01a120 tx=0x7f25dc019290 comp rx=0 tx=0).stop 2024-04-26T23:42:54.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.903+0000 7f25f9c00640 1 -- 172.21.15.137:0/1070808920 shutdown_connections 2024-04-26T23:42:54.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.903+0000 7f25f9c00640 1 --2- 172.21.15.137:0/1070808920 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f25d0068380 0x7f25d006a840 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.903+0000 7f25f9c00640 1 --2- 172.21.15.137:0/1070808920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25f4072ec0 0x7f25f40b0a60 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.903+0000 7f25f9c00640 1 --2- 172.21.15.137:0/1070808920 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f25f4073f30 0x7f25f40b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.903+0000 7f25f9c00640 1 --2- 172.21.15.137:0/1070808920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25f40725a0 0x7f25f4154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.903+0000 7f25f9c00640 1 -- 172.21.15.137:0/1070808920 >> 172.21.15.137:0/1070808920 conn(0x7f25f406c5d0 msgr2=0x7f25f4144010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:54.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.903+0000 7f25f9c00640 1 -- 172.21.15.137:0/1070808920 shutdown_connections 2024-04-26T23:42:54.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:54.903+0000 7f25f9c00640 1 -- 172.21.15.137:0/1070808920 wait complete. 2024-04-26T23:42:54.929 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:42:54.929 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:42:54.929 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T23:42:54.929 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T23:42:54.929 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T23:42:54.929 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:42:54.929 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:42:54.929 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:42:54.929 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:42:54.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:54.930 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T23:42:54.938 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:42:54.938 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:42:54.939 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:42:54.939 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:54.939 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T23:42:54.939 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:54.939 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:42:54.939 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T23:42:54.939 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T23:42:54.939 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:42:54.939 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T23:42:54.939 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T23:42:54.939 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:42:54.939 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:42:54.939 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:42:54.939 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:42:54.940 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:42:54.940 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42388sec preferred_lft 42388sec 2024-04-26T23:42:54.940 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link 2024-04-26T23:42:54.940 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:54.940 INFO:teuthology.orchestra.run.smithi137.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:42:54.940 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 02:42:f4:6f:af:56 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:42:54.940 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:42:54.940 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:54.940 INFO:teuthology.orchestra.run.smithi137.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:42:54.940 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:42:54.940 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:42:54.940 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:54.940 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T23:42:54.940 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:54.941 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:42:54.941 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:42:54.941 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:42:54.941 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:54.941 INFO:teuthology.orchestra.run.smithi137.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:42:54.941 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:42:54.941 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-26T23:42:54.941 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:42:54.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:54.942 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:42:55.004 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T23:42:55.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:55.006 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T23:42:55.063 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T23:42:55.063 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:42:55.063 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:42:55.063 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:42:55.063 INFO:teuthology.orchestra.run.smithi137.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:42:55.063 INFO:teuthology.orchestra.run.smithi137.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:42:55.063 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:42:55.063 INFO:teuthology.orchestra.run.smithi137.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:42:55.063 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:42:55.064 INFO:teuthology.orchestra.run.smithi137.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:42:55.064 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:42:55.064 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:42:55.064 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T23:42:55.064 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:42:55.064 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:42:55.064 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:42:55.064 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T23:42:55.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:42:55.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:42:55.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:55.196 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T23:42:55.204 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T23:42:55.204 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T23:42:55.205 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:42:55.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:55.205 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-26T23:42:55.270 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-26T23:42:55.270 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:42:55.270 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T23:42:55.323 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:42:55.323 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:42:55.323 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:42:55.378 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-26T23:42:55.439 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:42:55.496 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-26T23:42:55.497 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-26T23:42:55.497 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-26T23:42:55.497 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-26T23:42:55.497 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-26T23:42:55.497 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-26T23:42:55.497 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-26T23:42:55.497 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-26T23:42:55.497 INFO:teuthology.orchestra.run.smithi137.stdout:/run/lock 2024-04-26T23:42:55.497 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-26T23:42:55.497 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-26T23:42:55.497 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-26T23:42:55.497 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:42:55.498 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-26T23:42:55.498 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-26T23:42:55.498 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-26T23:42:55.498 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-26T23:42:55.498 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/fs/nfsd 2024-04-26T23:42:55.498 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-26T23:42:55.498 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-26T23:42:55.498 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:42:55.498 INFO:teuthology.orchestra.run.smithi137.stdout:/run/rpc_pipefs 2024-04-26T23:42:55.498 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-26T23:42:55.498 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-26T23:42:55.498 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:42:55.498 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:42:55.498 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:42:55.499 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:42:55.499 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-26T23:42:55.499 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:42:55.499 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:42:55.499 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:42:55.499 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:42:55.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:55.500 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-26T23:42:55.555 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T23:42:55.555 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-26T23:42:55.602 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-26T23:42:55.622 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:42:55.673 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-26T23:42:55.673 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-26T23:42:55.674 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-26T23:42:55.674 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-26T23:42:55.674 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-26T23:42:55.674 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-26T23:42:55.674 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-26T23:42:55.674 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-26T23:42:55.674 INFO:teuthology.orchestra.run.smithi137.stdout:/run/lock 2024-04-26T23:42:55.674 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-26T23:42:55.674 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-26T23:42:55.674 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-26T23:42:55.674 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:42:55.674 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-26T23:42:55.675 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-26T23:42:55.675 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-26T23:42:55.675 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-26T23:42:55.675 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/fs/nfsd 2024-04-26T23:42:55.675 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-26T23:42:55.675 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-26T23:42:55.675 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:42:55.675 INFO:teuthology.orchestra.run.smithi137.stdout:/run/rpc_pipefs 2024-04-26T23:42:55.675 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-26T23:42:55.675 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-26T23:42:55.675 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:42:55.675 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:42:55.675 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:42:55.675 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:42:55.676 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-26T23:42:55.676 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:42:55.676 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:42:55.676 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:42:55.676 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:42:55.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:55.678 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-26T23:42:55.698 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:2024-04-26T23:42:55.691+0000 7f555c8e2580 -1 init, newargv = 0x55aebee61540 newargc=15 2024-04-26T23:42:55.698 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:ceph-fuse[38586]: starting ceph client 2024-04-26T23:42:55.705 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:ceph-fuse[38586]: starting fuse 2024-04-26T23:42:55.706 INFO:teuthology.orchestra.run.smithi137.stdout:44 2024-04-26T23:42:55.707 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T23:42:55.707 DEBUG:teuthology.orchestra.run.smithi137:> sudo stdin-killer -- python3 -c ' 2024-04-26T23:42:55.707 DEBUG:teuthology.orchestra.run.smithi137:> import glob 2024-04-26T23:42:55.707 DEBUG:teuthology.orchestra.run.smithi137:> import re 2024-04-26T23:42:55.707 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T23:42:55.707 DEBUG:teuthology.orchestra.run.smithi137:> import subprocess 2024-04-26T23:42:55.707 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:42:55.707 DEBUG:teuthology.orchestra.run.smithi137:> def _find_admin_socket(client_name): 2024-04-26T23:42:55.707 DEBUG:teuthology.orchestra.run.smithi137:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T23:42:55.707 DEBUG:teuthology.orchestra.run.smithi137:> files = glob.glob(asok_path) 2024-04-26T23:42:55.707 DEBUG:teuthology.orchestra.run.smithi137:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T23:42:55.708 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:42:55.708 DEBUG:teuthology.orchestra.run.smithi137:> # Given a non-glob path, it better be there 2024-04-26T23:42:55.708 DEBUG:teuthology.orchestra.run.smithi137:> if "*" not in asok_path: 2024-04-26T23:42:55.708 DEBUG:teuthology.orchestra.run.smithi137:> assert(len(files) == 1) 2024-04-26T23:42:55.708 DEBUG:teuthology.orchestra.run.smithi137:> return files[0] 2024-04-26T23:42:55.708 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:42:55.708 DEBUG:teuthology.orchestra.run.smithi137:> for f in files: 2024-04-26T23:42:55.708 DEBUG:teuthology.orchestra.run.smithi137:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T23:42:55.708 DEBUG:teuthology.orchestra.run.smithi137:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T23:42:55.708 DEBUG:teuthology.orchestra.run.smithi137:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T23:42:55.708 DEBUG:teuthology.orchestra.run.smithi137:> contents = proc_f.read() 2024-04-26T23:42:55.708 DEBUG:teuthology.orchestra.run.smithi137:> if mountpoint in contents: 2024-04-26T23:42:55.708 DEBUG:teuthology.orchestra.run.smithi137:> return f 2024-04-26T23:42:55.708 DEBUG:teuthology.orchestra.run.smithi137:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T23:42:55.708 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:42:55.708 DEBUG:teuthology.orchestra.run.smithi137:> print(_find_admin_socket("client.0")) 2024-04-26T23:42:55.709 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T23:42:55.826 INFO:teuthology.orchestra.run.smithi137.stdout:/var/run/ceph/ceph-client.0.38586.asok 2024-04-26T23:42:55.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:42:55.838 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.38586.asok 2024-04-26T23:42:55.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:55.838 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.38586.asok status 2024-04-26T23:42:56.006 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:42:56.006 INFO:teuthology.orchestra.run.smithi137.stdout: "metadata": { 2024-04-26T23:42:56.006 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T23:42:56.006 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T23:42:56.006 INFO:teuthology.orchestra.run.smithi137.stdout: "entity_id": "0", 2024-04-26T23:42:56.006 INFO:teuthology.orchestra.run.smithi137.stdout: "hostname": "smithi137", 2024-04-26T23:42:56.006 INFO:teuthology.orchestra.run.smithi137.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-26T23:42:56.007 INFO:teuthology.orchestra.run.smithi137.stdout: "pid": "38586", 2024-04-26T23:42:56.007 INFO:teuthology.orchestra.run.smithi137.stdout: "root": "/" 2024-04-26T23:42:56.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:56.007 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_count": 0, 2024-04-26T23:42:56.007 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_pinned_count": 0, 2024-04-26T23:42:56.007 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 5613, 2024-04-26T23:42:56.007 INFO:teuthology.orchestra.run.smithi137.stdout: "inst": { 2024-04-26T23:42:56.007 INFO:teuthology.orchestra.run.smithi137.stdout: "name": { 2024-04-26T23:42:56.007 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "client", 2024-04-26T23:42:56.007 INFO:teuthology.orchestra.run.smithi137.stdout: "num": 5613 2024-04-26T23:42:56.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:56.007 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2024-04-26T23:42:56.007 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-26T23:42:56.007 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:42:56.008 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 4082356519 2024-04-26T23:42:56.008 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:42:56.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:56.008 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2024-04-26T23:42:56.008 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-26T23:42:56.008 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:42:56.008 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 4082356519 2024-04-26T23:42:56.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:42:56.008 INFO:teuthology.orchestra.run.smithi137.stdout: "inst_str": "client.5613 192.168.0.1:0/4082356519", 2024-04-26T23:42:56.008 INFO:teuthology.orchestra.run.smithi137.stdout: "addr_str": "192.168.0.1:0/4082356519", 2024-04-26T23:42:56.008 INFO:teuthology.orchestra.run.smithi137.stdout: "inode_count": 1, 2024-04-26T23:42:56.008 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_epoch": 17, 2024-04-26T23:42:56.008 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch": 33, 2024-04-26T23:42:56.008 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch_barrier": 0, 2024-04-26T23:42:56.009 INFO:teuthology.orchestra.run.smithi137.stdout: "blocklisted": false, 2024-04-26T23:42:56.009 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs" 2024-04-26T23:42:56.009 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:42:56.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:56.023 DEBUG:teuthology.orchestra.run.smithi137:> stat --file-system '--printf=%T 2024-04-26T23:42:56.023 DEBUG:teuthology.orchestra.run.smithi137:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-26T23:42:56.032 INFO:teuthology.orchestra.run.smithi137.stdout:fuseblk 2024-04-26T23:42:56.032 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-26T23:42:56.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:56.032 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:42:56.094 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json perf dump 2024-04-26T23:42:56.261 INFO:teuthology.orchestra.run.smithi170.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":29,"msgr_send_messages":31,"msgr_recv_bytes":7775,"msgr_send_bytes":16717,"msgr_created_connections":7,"msgr_active_connections":2,"msgr_running_total_time":0.010316469,"msgr_running_send_time":0.000805109,"msgr_running_recv_time":0.004186407,"msgr_running_fast_dispatch_time":0.001049498,"msgr_send_messages_queue_lat":{"avgcount":29,"sum":0.110166910,"avgtime":0.003798858},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":87,"msgr_send_messages":75,"msgr_recv_bytes":119896,"msgr_send_bytes":43600,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.014370501,"msgr_running_send_time":0.002899520,"msgr_running_recv_time":0.015961362,"msgr_running_fast_dispatch_time":0.000705939,"msgr_send_messages_queue_lat":{"avgcount":75,"sum":0.056459882,"avgtime":0.000752798},"msgr_handle_ack_lat":{"avgcount":25,"sum":0.000004190,"avgtime":0.000000167},"msgr_recv_encrypted_bytes":113920,"msgr_send_encrypted_bytes":14752},"AsyncMessenger::Worker-2":{"msgr_recv_messages":31,"msgr_send_messages":27,"msgr_recv_bytes":9685,"msgr_send_bytes":80483,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.008926715,"msgr_running_send_time":0.002497791,"msgr_running_recv_time":0.004770740,"msgr_running_fast_dispatch_time":0.001229533,"msgr_send_messages_queue_lat":{"avgcount":26,"sum":0.026854576,"avgtime":0.001032868},"msgr_handle_ack_lat":{"avgcount":22,"sum":0.000015278,"avgtime":0.000000694},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":68704},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":38,"sum":0.002701293,"avgtime":0.000071086}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000025884,"avgtime":0.000012942}},"mds":{"request":4,"reply":4,"reply_latency":{"avgcount":4,"sum":0.001155661,"avgtime":0.000288915},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":7,"traverse_hit":7,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":8,"evex":0,"evtrm":0,"ev":8,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197664,"rdpos":0,"jlat":{"avgcount":6,"sum":0.013257141,"avgtime":0.002209523},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":1,"cap+":3,"cap-":2,"rss":42456,"heap":231732},"mds_server":{"dispatch_client_request":4,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":10,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":3,"sum":0.000747778,"avgtime":0.000249259},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000407883,"avgtime":0.000407883},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":3,"session_remove":2,"sessions_open":1,"sessions_stale":0,"total_load":3,"average_load":3,"avg_session_uptime":13,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":221411,"buffer_anon_items":62,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5312,"osdmap_items":75,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":52352,"mds_co_items":211,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":45,"op_send_bytes":14570,"op_resend":37,"op_reply":45,"op_latency":{"avgcount":45,"sum":1.115982218,"avgtime":0.024799604},"op_inflight":0,"oplen_avg":{"avgcount":45,"sum":69},"op":45,"op_r":0,"op_w":45,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":6,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":33,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":142,"get_sum":119957,"get_or_fail_fail":0,"get_or_fail_success":142,"take":0,"take_sum":0,"put":142,"put_sum":119957,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":45,"take_sum":14570,"put":45,"put_sum":14570,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":45,"take_sum":45,"put":45,"put_sum":45,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55bea5242780":{"val":0,"max":3758096384,"get_started":0,"get":8,"get_sum":3360,"get_or_fail_fail":0,"get_or_fail_success":8,"take":0,"take_sum":0,"put":6,"put_sum":3360,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-04-26T23:42:56.263 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 7775, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 29, "msgr_running_fast_dispatch_time": 0.001049498, "msgr_running_recv_time": 0.004186407, "msgr_running_send_time": 0.000805109, "msgr_running_total_time": 0.010316469, "msgr_send_bytes": 16717, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 31, "msgr_send_messages_queue_lat": { "avgcount": 29, "avgtime": 0.003798858, "sum": 0.11016691 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 25, "avgtime": 1.67e-07, "sum": 4.19e-06 }, "msgr_recv_bytes": 119896, "msgr_recv_encrypted_bytes": 113920, "msgr_recv_messages": 87, "msgr_running_fast_dispatch_time": 0.000705939, "msgr_running_recv_time": 0.015961362, "msgr_running_send_time": 0.00289952, "msgr_running_total_time": 0.014370501, "msgr_send_bytes": 43600, "msgr_send_encrypted_bytes": 14752, "msgr_send_messages": 75, "msgr_send_messages_queue_lat": { "avgcount": 75, "avgtime": 0.000752798, "sum": 0.056459882 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 22, "avgtime": 6.94e-07, "sum": 1.5278e-05 }, "msgr_recv_bytes": 9685, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 31, "msgr_running_fast_dispatch_time": 0.001229533, "msgr_running_recv_time": 0.00477074, "msgr_running_send_time": 0.002497791, "msgr_running_total_time": 0.008926715, "msgr_send_bytes": 80483, "msgr_send_encrypted_bytes": 68704, "msgr_send_messages": 27, "msgr_send_messages_queue_lat": { "avgcount": 26, "avgtime": 0.001032868, "sum": 0.026854576 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 38, "avgtime": 7.1086e-05, "sum": 0.002701293 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 1.2942e-05, "sum": 2.5884e-05 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 4, "reply_latency": { "avgcount": 4, "avgtime": 0.000288915, "sum": 0.001155661 }, "request": 4, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 7, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 7, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 8, "evadd": 8, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 6, "avgtime": 0.002209523, "sum": 0.013257141 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4197664 }, "mds_mem": { "cap": 1, "cap+": 3, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 231732, "ino": 13, "ino+": 13, "ino-": 0, "rss": 42456 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 4, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 10, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 3, "avgtime": 0.000249259, "sum": 0.000747778 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000407883, "sum": 0.000407883 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 3, "avg_session_uptime": 13, "mdthresh_evicted": 0, "session_add": 3, "session_count": 1, "session_remove": 2, "sessions_open": 1, "sessions_stale": 0, "total_load": 3 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 221411, "buffer_anon_items": 62, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 52352, "mds_co_items": 211, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5312, "osdmap_items": 75, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 33, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 45, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 45, "avgtime": 0.024799604, "sum": 1.115982218 }, "op_pg": 0, "op_r": 0, "op_reply": 45, "op_resend": 37, "op_rmw": 0, "op_send": 45, "op_send_bytes": 14570, "op_w": 45, "oplen_avg": { "avgcount": 45, "sum": 69 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 6, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 142, "get_or_fail_fail": 0, "get_or_fail_success": 142, "get_started": 0, "get_sum": 119957, "max": 104857600, "put": 142, "put_sum": 119957, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 45, "put_sum": 14570, "take": 45, "take_sum": 14570, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 45, "put_sum": 45, "take": 45, "take_sum": 45, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55bea5242780": { "get": 8, "get_or_fail_fail": 0, "get_or_fail_success": 8, "get_started": 0, "get_sum": 3360, "max": 3758096384, "put": 6, "put_sum": 3360, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-04-26T23:42:56.263 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:42:56.263 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:42:56.272 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:42:56.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.447+0000 7f4e49200640 1 Processor -- start 2024-04-26T23:42:56.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.447+0000 7f4e49200640 1 -- start start 2024-04-26T23:42:56.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.447+0000 7f4e49200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4e440725a0 0x7f4e440cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:56.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.447+0000 7f4e49200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e440b5080 0x7f4e44165930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:56.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.447+0000 7f4e49200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e440cfef0 con 0x7f4e44073f30 2024-04-26T23:42:56.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.447+0000 7f4e49200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4e440cddc0 con 0x7f4e440725a0 2024-04-26T23:42:56.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.447+0000 7f4e49200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4e440d01b0 con 0x7f4e440b5080 2024-04-26T23:42:56.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.447+0000 7f4e41e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4e440725a0 0x7f4e440cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:56.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.447+0000 7f4e41e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4e440725a0 0x7f4e440cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34288/0 (socket says 172.21.15.137:34288) 2024-04-26T23:42:56.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.447+0000 7f4e41e00640 1 -- 172.21.15.137:0/2566412064 learned_addr learned my addr 172.21.15.137:0/2566412064 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:56.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.447+0000 7f4e41400640 1 --1- 172.21.15.137:0/2566412064 >> v1:172.21.15.137:6789/0 conn(0x7f4e44073f30 0x7f4e44072980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40342/0 (socket says 172.21.15.137:40342) 2024-04-26T23:42:56.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.447+0000 7f4e42800640 1 --2- 172.21.15.137:0/2566412064 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e440b5080 0x7f4e44165930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:56.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.447+0000 7f4e41e00640 1 -- 172.21.15.137:0/2566412064 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e440b5080 msgr2=0x7f4e44165930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:56.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.447+0000 7f4e41e00640 1 --2- 172.21.15.137:0/2566412064 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e440b5080 0x7f4e44165930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:56.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.447+0000 7f4e41e00640 1 -- 172.21.15.137:0/2566412064 >> v1:172.21.15.137:6789/0 conn(0x7f4e44073f30 legacy=0x7f4e44072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:56.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.447+0000 7f4e41e00640 1 -- 172.21.15.137:0/2566412064 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e440d0490 con 0x7f4e440725a0 2024-04-26T23:42:56.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.451+0000 7f4e41e00640 1 --2- 172.21.15.137:0/2566412064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e440725a0 0x7f4e440cd770 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4e34009870 tx=0x7f4e3401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a8733475a78fbb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:56.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.451+0000 7f4e40a00640 1 -- 172.21.15.137:0/2566412064 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e340ab640 con 0x7f4e440725a0 2024-04-26T23:42:56.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.451+0000 7f4e40a00640 1 -- 172.21.15.137:0/2566412064 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e340b0070 con 0x7f4e440725a0 2024-04-26T23:42:56.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.451+0000 7f4e40a00640 1 -- 172.21.15.137:0/2566412064 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e340aba00 con 0x7f4e440725a0 2024-04-26T23:42:56.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.451+0000 7f4e49200640 1 -- 172.21.15.137:0/2566412064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e440725a0 msgr2=0x7f4e440cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:56.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.451+0000 7f4e49200640 1 --2- 172.21.15.137:0/2566412064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e440725a0 0x7f4e440cd770 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4e34009870 tx=0x7f4e3401c530 comp rx=0 tx=0).stop 2024-04-26T23:42:56.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.451+0000 7f4e49200640 1 -- 172.21.15.137:0/2566412064 shutdown_connections 2024-04-26T23:42:56.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.451+0000 7f4e49200640 1 --2- 172.21.15.137:0/2566412064 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e440b5080 0x7f4e44165930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:56.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.451+0000 7f4e49200640 1 --2- 172.21.15.137:0/2566412064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e440725a0 0x7f4e440cd770 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:56.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.451+0000 7f4e49200640 1 -- 172.21.15.137:0/2566412064 >> 172.21.15.137:0/2566412064 conn(0x7f4e4406c5d0 msgr2=0x7f4e4406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:56.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.451+0000 7f4e49200640 1 -- 172.21.15.137:0/2566412064 shutdown_connections 2024-04-26T23:42:56.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.451+0000 7f4e49200640 1 -- 172.21.15.137:0/2566412064 wait complete. 2024-04-26T23:42:56.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e49200640 1 Processor -- start 2024-04-26T23:42:56.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e49200640 1 -- start start 2024-04-26T23:42:56.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e49200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e440725a0 0x7f4e44160650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:56.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e49200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e44073f30 0x7f4e44134580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:56.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e49200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e440b5080 0x7f4e4406ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:56.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e49200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4e44168a20 con 0x7f4e440b5080 2024-04-26T23:42:56.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e49200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4e441688a0 con 0x7f4e44073f30 2024-04-26T23:42:56.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e49200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4e44168ba0 con 0x7f4e440725a0 2024-04-26T23:42:56.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e42800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e440b5080 0x7f4e4406ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:56.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e42800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e440b5080 0x7f4e4406ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34294/0 (socket says 172.21.15.137:34294) 2024-04-26T23:42:56.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e42800640 1 -- 172.21.15.137:0/1987422524 learned_addr learned my addr 172.21.15.137:0/1987422524 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:56.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e41e00640 1 --2- 172.21.15.137:0/1987422524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e440725a0 0x7f4e44160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:56.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e41400640 1 --2- 172.21.15.137:0/1987422524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e44073f30 0x7f4e44134580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:56.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e42800640 1 -- 172.21.15.137:0/1987422524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e440725a0 msgr2=0x7f4e44160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:56.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e42800640 1 --2- 172.21.15.137:0/1987422524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e440725a0 0x7f4e44160650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:56.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e42800640 1 -- 172.21.15.137:0/1987422524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e44073f30 msgr2=0x7f4e44134580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:56.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e42800640 1 --2- 172.21.15.137:0/1987422524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e44073f30 0x7f4e44134580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:56.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e42800640 1 -- 172.21.15.137:0/1987422524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e44145470 con 0x7f4e440b5080 2024-04-26T23:42:56.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e41400640 1 --2- 172.21.15.137:0/1987422524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e44073f30 0x7f4e44134580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:56.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e42800640 1 --2- 172.21.15.137:0/1987422524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e440b5080 0x7f4e4406ed90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c007e30 tx=0x7f4e3c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:56.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e3a000640 1 -- 172.21.15.137:0/1987422524 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c014620 con 0x7f4e440b5080 2024-04-26T23:42:56.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e3a000640 1 -- 172.21.15.137:0/1987422524 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e3c019070 con 0x7f4e440b5080 2024-04-26T23:42:56.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e3a000640 1 -- 172.21.15.137:0/1987422524 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c014a00 con 0x7f4e440b5080 2024-04-26T23:42:56.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e49200640 1 -- 172.21.15.137:0/1987422524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e4415f890 con 0x7f4e440b5080 2024-04-26T23:42:56.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.455+0000 7f4e49200640 1 -- 172.21.15.137:0/1987422524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e4415fe50 con 0x7f4e440b5080 2024-04-26T23:42:56.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.459+0000 7f4e49200640 1 -- 172.21.15.137:0/1987422524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e4406a4b0 con 0x7f4e440b5080 2024-04-26T23:42:56.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.459+0000 7f4e3a000640 1 -- 172.21.15.137:0/1987422524 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4e3c014ba0 con 0x7f4e440b5080 2024-04-26T23:42:56.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.459+0000 7f4e3a000640 1 --2- 172.21.15.137:0/1987422524 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4e20068380 0x7f4e2006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:56.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.459+0000 7f4e3a000640 1 -- 172.21.15.137:0/1987422524 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f4e3c0872c0 con 0x7f4e440b5080 2024-04-26T23:42:56.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.459+0000 7f4e41e00640 1 --2- 172.21.15.137:0/1987422524 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4e20068380 0x7f4e2006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:56.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.459+0000 7f4e41e00640 1 --2- 172.21.15.137:0/1987422524 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4e20068380 0x7f4e2006a840 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4e340af000 tx=0x7f4e340a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:56.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.463+0000 7f4e3a000640 1 -- 172.21.15.137:0/1987422524 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4e3c0577e0 con 0x7f4e440b5080 2024-04-26T23:42:56.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.623+0000 7f4e49200640 1 -- 172.21.15.137:0/1987422524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e44072380 con 0x7f4e440b5080 2024-04-26T23:42:56.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.623+0000 7f4e3a000640 1 -- 172.21.15.137:0/1987422524 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16717 (secure 0 0 0) 0x7f4e3c0570e0 con 0x7f4e440b5080 2024-04-26T23:42:56.632 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:56.632 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":33,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:42:26.483092+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:42:22.570062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:42:23.822598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:42:56.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.627+0000 7f4e49200640 1 -- 172.21.15.137:0/1987422524 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4e20068380 msgr2=0x7f4e2006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:56.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.627+0000 7f4e49200640 1 --2- 172.21.15.137:0/1987422524 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4e20068380 0x7f4e2006a840 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4e340af000 tx=0x7f4e340a7000 comp rx=0 tx=0).stop 2024-04-26T23:42:56.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.627+0000 7f4e49200640 1 -- 172.21.15.137:0/1987422524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e440b5080 msgr2=0x7f4e4406ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:56.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.627+0000 7f4e49200640 1 --2- 172.21.15.137:0/1987422524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e440b5080 0x7f4e4406ed90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c007e30 tx=0x7f4e3c00e4b0 comp rx=0 tx=0).stop 2024-04-26T23:42:56.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.627+0000 7f4e49200640 1 -- 172.21.15.137:0/1987422524 shutdown_connections 2024-04-26T23:42:56.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.627+0000 7f4e49200640 1 --2- 172.21.15.137:0/1987422524 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4e20068380 0x7f4e2006a840 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:56.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.627+0000 7f4e49200640 1 --2- 172.21.15.137:0/1987422524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e440b5080 0x7f4e4406ed90 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:56.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.627+0000 7f4e49200640 1 --2- 172.21.15.137:0/1987422524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e44073f30 0x7f4e44134580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:56.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.627+0000 7f4e49200640 1 --2- 172.21.15.137:0/1987422524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e440725a0 0x7f4e44160650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:56.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.627+0000 7f4e49200640 1 -- 172.21.15.137:0/1987422524 >> 172.21.15.137:0/1987422524 conn(0x7f4e4406c5d0 msgr2=0x7f4e440b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:56.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.627+0000 7f4e49200640 1 -- 172.21.15.137:0/1987422524 shutdown_connections 2024-04-26T23:42:56.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.627+0000 7f4e49200640 1 -- 172.21.15.137:0/1987422524 wait complete. 2024-04-26T23:42:56.653 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:42:22.570062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:42:23.822598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:42:56.654 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:42:56.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.787+0000 7f5c6f800640 1 Processor -- start 2024-04-26T23:42:56.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.787+0000 7f5c6f800640 1 -- start start 2024-04-26T23:42:56.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.787+0000 7f5c6f800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5c680b54e0 0x7f5c680b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:56.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.787+0000 7f5c6f800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c680cffa0 con 0x7f5c68160000 2024-04-26T23:42:56.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.787+0000 7f5c6f800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c680d0280 con 0x7f5c680cd710 2024-04-26T23:42:56.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.787+0000 7f5c6f800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f5c680b3d90 con 0x7f5c680b54e0 2024-04-26T23:42:56.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.791+0000 7f5c6d800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f5c68160000 0x7f5c68144d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40344/0 (socket says 172.21.15.137:40344) 2024-04-26T23:42:56.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.791+0000 7f5c6d800640 1 -- 172.21.15.137:0/4133706089 learned_addr learned my addr 172.21.15.137:0/4133706089 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:56.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.791+0000 7f5c6ce00640 1 --2- 172.21.15.137:0/4133706089 >> v2:172.21.15.170:3300/0 conn(0x7f5c680b54e0 0x7f5c680b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:56.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.791+0000 7f5c67e00640 1 -- 172.21.15.137:0/4133706089 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2082178815 0 0) 0x7f5c680cffa0 con 0x7f5c68160000 2024-04-26T23:42:56.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.791+0000 7f5c67e00640 1 -- 172.21.15.137:0/4133706089 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c4c003530 con 0x7f5c68160000 2024-04-26T23:42:56.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.791+0000 7f5c67e00640 1 -- 172.21.15.137:0/4133706089 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3214252421 0 0) 0x7f5c680d0280 con 0x7f5c680cd710 2024-04-26T23:42:56.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.791+0000 7f5c67e00640 1 -- 172.21.15.137:0/4133706089 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c680cffa0 con 0x7f5c680cd710 2024-04-26T23:42:56.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.791+0000 7f5c6ce00640 1 -- 172.21.15.137:0/4133706089 >> v1:172.21.15.170:6789/0 conn(0x7f5c680cd710 legacy=0x7f5c6815f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:56.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.791+0000 7f5c6ce00640 1 -- 172.21.15.137:0/4133706089 >> v1:172.21.15.137:6789/0 conn(0x7f5c68160000 legacy=0x7f5c68144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:56.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.791+0000 7f5c6ce00640 1 -- 172.21.15.137:0/4133706089 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c680d0560 con 0x7f5c680b54e0 2024-04-26T23:42:56.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.791+0000 7f5c6ce00640 1 --2- 172.21.15.137:0/4133706089 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c680b54e0 0x7f5c680b5ee0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5c580097f0 tx=0x7f5c5801c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da7135d213477542 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:56.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.791+0000 7f5c67e00640 1 -- 172.21.15.137:0/4133706089 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c580b0070 con 0x7f5c680b54e0 2024-04-26T23:42:56.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.791+0000 7f5c67e00640 1 -- 172.21.15.137:0/4133706089 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c580ab600 con 0x7f5c680b54e0 2024-04-26T23:42:56.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.791+0000 7f5c67e00640 1 -- 172.21.15.137:0/4133706089 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c580ab9d0 con 0x7f5c680b54e0 2024-04-26T23:42:56.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6f800640 1 -- 172.21.15.137:0/4133706089 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c680b54e0 msgr2=0x7f5c680b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:56.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6f800640 1 --2- 172.21.15.137:0/4133706089 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c680b54e0 0x7f5c680b5ee0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5c580097f0 tx=0x7f5c5801c460 comp rx=0 tx=0).stop 2024-04-26T23:42:56.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6f800640 1 -- 172.21.15.137:0/4133706089 shutdown_connections 2024-04-26T23:42:56.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6f800640 1 --2- 172.21.15.137:0/4133706089 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c680b54e0 0x7f5c680b5ee0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:56.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6f800640 1 -- 172.21.15.137:0/4133706089 >> 172.21.15.137:0/4133706089 conn(0x7f5c6806c800 msgr2=0x7f5c6806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:56.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6f800640 1 -- 172.21.15.137:0/4133706089 shutdown_connections 2024-04-26T23:42:56.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6f800640 1 -- 172.21.15.137:0/4133706089 wait complete. 2024-04-26T23:42:56.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6f800640 1 Processor -- start 2024-04-26T23:42:56.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6f800640 1 -- start start 2024-04-26T23:42:56.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6f800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c680b54e0 0x7f5c68141070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:56.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6f800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c680cd710 0x7f5c68154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:56.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6f800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c68160000 0x7f5c680b2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:56.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6f800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5c68073640 con 0x7f5c68160000 2024-04-26T23:42:56.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6f800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5c680734c0 con 0x7f5c680b54e0 2024-04-26T23:42:56.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6f800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5c68145840 con 0x7f5c680cd710 2024-04-26T23:42:56.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c68160000 0x7f5c680b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:56.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6ce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c680b54e0 0x7f5c68141070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:56.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c68160000 0x7f5c680b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34296/0 (socket says 172.21.15.137:34296) 2024-04-26T23:42:56.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6d800640 1 -- 172.21.15.137:0/2515029407 learned_addr learned my addr 172.21.15.137:0/2515029407 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:56.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c5fe00640 1 --2- 172.21.15.137:0/2515029407 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c680cd710 0x7f5c68154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:56.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6d800640 1 -- 172.21.15.137:0/2515029407 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c680cd710 msgr2=0x7f5c68154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:56.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6d800640 1 --2- 172.21.15.137:0/2515029407 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c680cd710 0x7f5c68154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:56.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6d800640 1 -- 172.21.15.137:0/2515029407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c680b54e0 msgr2=0x7f5c68141070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:56.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6d800640 1 --2- 172.21.15.137:0/2515029407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c680b54e0 0x7f5c68141070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:56.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.795+0000 7f5c6d800640 1 -- 172.21.15.137:0/2515029407 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c6806ecd0 con 0x7f5c68160000 2024-04-26T23:42:56.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.799+0000 7f5c6d800640 1 --2- 172.21.15.137:0/2515029407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c68160000 0x7f5c680b2450 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5c6000cad0 tx=0x7f5c6000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:56.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.799+0000 7f5c65600640 1 -- 172.21.15.137:0/2515029407 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c60017070 con 0x7f5c68160000 2024-04-26T23:42:56.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.799+0000 7f5c65600640 1 -- 172.21.15.137:0/2515029407 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c6000ac30 con 0x7f5c68160000 2024-04-26T23:42:56.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.799+0000 7f5c6f800640 1 -- 172.21.15.137:0/2515029407 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c680b13b0 con 0x7f5c68160000 2024-04-26T23:42:56.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.799+0000 7f5c65600640 1 -- 172.21.15.137:0/2515029407 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c60012400 con 0x7f5c68160000 2024-04-26T23:42:56.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.799+0000 7f5c6f800640 1 -- 172.21.15.137:0/2515029407 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c680b1970 con 0x7f5c68160000 2024-04-26T23:42:56.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.799+0000 7f5c6f800640 1 -- 172.21.15.137:0/2515029407 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c6806a410 con 0x7f5c68160000 2024-04-26T23:42:56.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.799+0000 7f5c65600640 1 -- 172.21.15.137:0/2515029407 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5c6001a070 con 0x7f5c68160000 2024-04-26T23:42:56.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.799+0000 7f5c65600640 1 --2- 172.21.15.137:0/2515029407 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5c44068380 0x7f5c4406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:56.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.799+0000 7f5c65600640 1 -- 172.21.15.137:0/2515029407 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f5c60086770 con 0x7f5c68160000 2024-04-26T23:42:56.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.799+0000 7f5c6ce00640 1 --2- 172.21.15.137:0/2515029407 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5c44068380 0x7f5c4406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:56.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.803+0000 7f5c6ce00640 1 --2- 172.21.15.137:0/2515029407 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5c44068380 0x7f5c4406a840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5c580ad000 tx=0x7f5c58008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:56.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.803+0000 7f5c65600640 1 -- 172.21.15.137:0/2515029407 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5c60056640 con 0x7f5c68160000 2024-04-26T23:42:56.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.963+0000 7f5c6f800640 1 -- 172.21.15.137:0/2515029407 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5c6806d410 con 0x7f5c68160000 2024-04-26T23:42:56.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.963+0000 7f5c65600640 1 -- 172.21.15.137:0/2515029407 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) ==== 93+0+10 (secure 0 0 0) 0x7f5c6005a940 con 0x7f5c68160000 2024-04-26T23:42:56.970 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:42:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.967+0000 7f5c6f800640 1 -- 172.21.15.137:0/2515029407 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5c44068380 msgr2=0x7f5c4406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.967+0000 7f5c6f800640 1 --2- 172.21.15.137:0/2515029407 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5c44068380 0x7f5c4406a840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5c580ad000 tx=0x7f5c58008040 comp rx=0 tx=0).stop 2024-04-26T23:42:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.967+0000 7f5c6f800640 1 -- 172.21.15.137:0/2515029407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c68160000 msgr2=0x7f5c680b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.967+0000 7f5c6f800640 1 --2- 172.21.15.137:0/2515029407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c68160000 0x7f5c680b2450 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5c6000cad0 tx=0x7f5c6000cf90 comp rx=0 tx=0).stop 2024-04-26T23:42:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.967+0000 7f5c6f800640 1 -- 172.21.15.137:0/2515029407 shutdown_connections 2024-04-26T23:42:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.967+0000 7f5c6f800640 1 --2- 172.21.15.137:0/2515029407 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5c44068380 0x7f5c4406a840 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.967+0000 7f5c6f800640 1 --2- 172.21.15.137:0/2515029407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c68160000 0x7f5c680b2450 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.967+0000 7f5c6f800640 1 --2- 172.21.15.137:0/2515029407 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c680cd710 0x7f5c68154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.967+0000 7f5c6f800640 1 --2- 172.21.15.137:0/2515029407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c680b54e0 0x7f5c68141070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.967+0000 7f5c6f800640 1 -- 172.21.15.137:0/2515029407 >> 172.21.15.137:0/2515029407 conn(0x7f5c6806c800 msgr2=0x7f5c68073a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.967+0000 7f5c6f800640 1 -- 172.21.15.137:0/2515029407 shutdown_connections 2024-04-26T23:42:56.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:56.967+0000 7f5c6f800640 1 -- 172.21.15.137:0/2515029407 wait complete. 2024-04-26T23:42:56.992 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:42:57.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.123+0000 7f0af7e00640 1 Processor -- start 2024-04-26T23:42:57.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.123+0000 7f0af7e00640 1 -- start start 2024-04-26T23:42:57.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.123+0000 7f0af7e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0af00b5ee0 0x7f0af015f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:57.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.123+0000 7f0af7e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0af00cffa0 con 0x7f0af015fe30 2024-04-26T23:42:57.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.123+0000 7f0af7e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0af00d0280 con 0x7f0af00b54e0 2024-04-26T23:42:57.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.123+0000 7f0af7e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0af00b3d90 con 0x7f0af00b5ee0 2024-04-26T23:42:57.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.123+0000 7f0af5e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f0af015fe30 0x7f0af0144d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40352/0 (socket says 172.21.15.137:40352) 2024-04-26T23:42:57.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.123+0000 7f0af5e00640 1 -- 172.21.15.137:0/1149401454 learned_addr learned my addr 172.21.15.137:0/1149401454 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:57.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.123+0000 7f0af4a00640 1 --2- 172.21.15.137:0/1149401454 >> v2:172.21.15.170:3300/0 conn(0x7f0af00b5ee0 0x7f0af015f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:57.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.127+0000 7f0aefe00640 1 -- 172.21.15.137:0/1149401454 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2062419676 0 0) 0x7f0af00cffa0 con 0x7f0af015fe30 2024-04-26T23:42:57.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.127+0000 7f0aefe00640 1 -- 172.21.15.137:0/1149401454 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ad8003530 con 0x7f0af015fe30 2024-04-26T23:42:57.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.127+0000 7f0aefe00640 1 -- 172.21.15.137:0/1149401454 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2131036371 0 0) 0x7f0af00d0280 con 0x7f0af00b54e0 2024-04-26T23:42:57.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.127+0000 7f0aefe00640 1 -- 172.21.15.137:0/1149401454 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0af00cffa0 con 0x7f0af00b54e0 2024-04-26T23:42:57.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.127+0000 7f0af4a00640 1 -- 172.21.15.137:0/1149401454 >> v1:172.21.15.170:6789/0 conn(0x7f0af00b54e0 legacy=0x7f0af00cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:57.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.127+0000 7f0af4a00640 1 -- 172.21.15.137:0/1149401454 >> v1:172.21.15.137:6789/0 conn(0x7f0af015fe30 legacy=0x7f0af0144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:57.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.127+0000 7f0af4a00640 1 -- 172.21.15.137:0/1149401454 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af00d0560 con 0x7f0af00b5ee0 2024-04-26T23:42:57.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.127+0000 7f0af4a00640 1 --2- 172.21.15.137:0/1149401454 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0af00b5ee0 0x7f0af015f8f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0097c0 tx=0x7f0adc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a29f49ca84e7fe1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:57.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.127+0000 7f0aefe00640 1 -- 172.21.15.137:0/1149401454 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc0b0070 con 0x7f0af00b5ee0 2024-04-26T23:42:57.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.127+0000 7f0aefe00640 1 -- 172.21.15.137:0/1149401454 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0adc0ab600 con 0x7f0af00b5ee0 2024-04-26T23:42:57.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.127+0000 7f0aefe00640 1 -- 172.21.15.137:0/1149401454 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc0ab9d0 con 0x7f0af00b5ee0 2024-04-26T23:42:57.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af7e00640 1 -- 172.21.15.137:0/1149401454 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0af00b5ee0 msgr2=0x7f0af015f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:57.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af7e00640 1 --2- 172.21.15.137:0/1149401454 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0af00b5ee0 0x7f0af015f8f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0097c0 tx=0x7f0adc01c4a0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af7e00640 1 -- 172.21.15.137:0/1149401454 shutdown_connections 2024-04-26T23:42:57.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af7e00640 1 --2- 172.21.15.137:0/1149401454 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0af00b5ee0 0x7f0af015f8f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af7e00640 1 -- 172.21.15.137:0/1149401454 >> 172.21.15.137:0/1149401454 conn(0x7f0af006c800 msgr2=0x7f0af006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:57.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af7e00640 1 -- 172.21.15.137:0/1149401454 shutdown_connections 2024-04-26T23:42:57.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af7e00640 1 -- 172.21.15.137:0/1149401454 wait complete. 2024-04-26T23:42:57.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af7e00640 1 Processor -- start 2024-04-26T23:42:57.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af7e00640 1 -- start start 2024-04-26T23:42:57.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0af00b54e0 0x7f0af015b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:57.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0af00b5ee0 0x7f0af01f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:57.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af7e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0af015fe30 0x7f0af0166d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:57.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af7e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0af0145840 con 0x7f0af00b54e0 2024-04-26T23:42:57.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af7e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0af0160240 con 0x7f0af00b5ee0 2024-04-26T23:42:57.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af7e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0af01459c0 con 0x7f0af015fe30 2024-04-26T23:42:57.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af5400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0af00b54e0 0x7f0af015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:57.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af5400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0af00b54e0 0x7f0af015b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34302/0 (socket says 172.21.15.137:34302) 2024-04-26T23:42:57.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af5400640 1 -- 172.21.15.137:0/1420075787 learned_addr learned my addr 172.21.15.137:0/1420075787 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:57.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af4a00640 1 --2- 172.21.15.137:0/1420075787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0af00b5ee0 0x7f0af01f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:57.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af5e00640 1 --2- 172.21.15.137:0/1420075787 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0af015fe30 0x7f0af0166d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:57.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af5400640 1 -- 172.21.15.137:0/1420075787 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0af015fe30 msgr2=0x7f0af0166d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:57.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af5400640 1 --2- 172.21.15.137:0/1420075787 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0af015fe30 0x7f0af0166d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af5400640 1 -- 172.21.15.137:0/1420075787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0af00b5ee0 msgr2=0x7f0af01f3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:57.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af5400640 1 --2- 172.21.15.137:0/1420075787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0af00b5ee0 0x7f0af01f3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af5400640 1 -- 172.21.15.137:0/1420075787 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af00b0c70 con 0x7f0af00b54e0 2024-04-26T23:42:57.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af4a00640 1 --2- 172.21.15.137:0/1420075787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0af00b5ee0 0x7f0af01f3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:57.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0af5400640 1 --2- 172.21.15.137:0/1420075787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0af00b54e0 0x7f0af015b770 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0ae400c530 tx=0x7f0ae400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:57.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0aed600640 1 -- 172.21.15.137:0/1420075787 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae40052d0 con 0x7f0af00b54e0 2024-04-26T23:42:57.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0aed600640 1 -- 172.21.15.137:0/1420075787 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae4005490 con 0x7f0af00b54e0 2024-04-26T23:42:57.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.131+0000 7f0aed600640 1 -- 172.21.15.137:0/1420075787 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4012850 con 0x7f0af00b54e0 2024-04-26T23:42:57.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.135+0000 7f0af7e00640 1 -- 172.21.15.137:0/1420075787 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0af00b0f50 con 0x7f0af00b54e0 2024-04-26T23:42:57.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.135+0000 7f0af7e00640 1 -- 172.21.15.137:0/1420075787 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0af00b1510 con 0x7f0af00b54e0 2024-04-26T23:42:57.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.135+0000 7f0af7e00640 1 -- 172.21.15.137:0/1420075787 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0af006a410 con 0x7f0af00b54e0 2024-04-26T23:42:57.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.135+0000 7f0aed600640 1 -- 172.21.15.137:0/1420075787 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0ae40129f0 con 0x7f0af00b54e0 2024-04-26T23:42:57.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.135+0000 7f0aed600640 1 --2- 172.21.15.137:0/1420075787 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0ad00683b0 0x7f0ad006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:57.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.135+0000 7f0aed600640 1 -- 172.21.15.137:0/1420075787 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f0ae4086650 con 0x7f0af00b54e0 2024-04-26T23:42:57.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.135+0000 7f0af4a00640 1 --2- 172.21.15.137:0/1420075787 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0ad00683b0 0x7f0ad006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:57.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.135+0000 7f0af4a00640 1 --2- 172.21.15.137:0/1420075787 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0ad00683b0 0x7f0ad006a870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0ad000 tx=0x7f0adc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:57.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.139+0000 7f0aed600640 1 -- 172.21.15.137:0/1420075787 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0ae4056b80 con 0x7f0af00b54e0 2024-04-26T23:42:57.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.295+0000 7f0af7e00640 1 -- 172.21.15.137:0/1420075787 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0af0074160 con 0x7f0af00b54e0 2024-04-26T23:42:57.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.295+0000 7f0aed600640 1 -- 172.21.15.137:0/1420075787 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) ==== 104+0+11 (secure 0 0 0) 0x7f0ae4056480 con 0x7f0af00b54e0 2024-04-26T23:42:57.303 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:42:57.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.299+0000 7f0af7e00640 1 -- 172.21.15.137:0/1420075787 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0ad00683b0 msgr2=0x7f0ad006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:57.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.299+0000 7f0af7e00640 1 --2- 172.21.15.137:0/1420075787 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0ad00683b0 0x7f0ad006a870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0ad000 tx=0x7f0adc008040 comp rx=0 tx=0).stop 2024-04-26T23:42:57.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.299+0000 7f0af7e00640 1 -- 172.21.15.137:0/1420075787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0af00b54e0 msgr2=0x7f0af015b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:57.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.299+0000 7f0af7e00640 1 --2- 172.21.15.137:0/1420075787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0af00b54e0 0x7f0af015b770 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0ae400c530 tx=0x7f0ae400c9f0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.299+0000 7f0af7e00640 1 -- 172.21.15.137:0/1420075787 shutdown_connections 2024-04-26T23:42:57.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.299+0000 7f0af7e00640 1 --2- 172.21.15.137:0/1420075787 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0ad00683b0 0x7f0ad006a870 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.299+0000 7f0af7e00640 1 --2- 172.21.15.137:0/1420075787 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0af015fe30 0x7f0af0166d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.299+0000 7f0af7e00640 1 --2- 172.21.15.137:0/1420075787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0af00b5ee0 0x7f0af01f3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.299+0000 7f0af7e00640 1 --2- 172.21.15.137:0/1420075787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0af00b54e0 0x7f0af015b770 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.299+0000 7f0af7e00640 1 -- 172.21.15.137:0/1420075787 >> 172.21.15.137:0/1420075787 conn(0x7f0af006c800 msgr2=0x7f0af015e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:57.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.299+0000 7f0af7e00640 1 -- 172.21.15.137:0/1420075787 shutdown_connections 2024-04-26T23:42:57.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.299+0000 7f0af7e00640 1 -- 172.21.15.137:0/1420075787 wait complete. 2024-04-26T23:42:57.324 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:42:57.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.455+0000 7f42bde00640 1 Processor -- start 2024-04-26T23:42:57.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.455+0000 7f42bde00640 1 -- start start 2024-04-26T23:42:57.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.459+0000 7f42bde00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42b81463e0 0x7f42b815de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:57.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.459+0000 7f42bde00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f42b80d1420 0x7f42b80cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:57.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.459+0000 7f42bde00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42b815e370 con 0x7f42b806dfd0 2024-04-26T23:42:57.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.459+0000 7f42bde00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f42b80cf030 con 0x7f42b80d1420 2024-04-26T23:42:57.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.459+0000 7f42bde00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f42b806e4d0 con 0x7f42b81463e0 2024-04-26T23:42:57.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.459+0000 7f42bd400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f42b80d1420 0x7f42b80cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:57.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.459+0000 7f42bd400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f42b80d1420 0x7f42b80cf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34308/0 (socket says 172.21.15.137:34308) 2024-04-26T23:42:57.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.459+0000 7f42afe00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f42b806dfd0 0x7f42b80d0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40366/0 (socket says 172.21.15.137:40366) 2024-04-26T23:42:57.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.459+0000 7f42bd400640 1 -- 172.21.15.137:0/1966871667 learned_addr learned my addr 172.21.15.137:0/1966871667 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:57.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.459+0000 7f42bca00640 1 --2- 172.21.15.137:0/1966871667 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42b81463e0 0x7f42b815de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:57.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.459+0000 7f42bd400640 1 -- 172.21.15.137:0/1966871667 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42b81463e0 msgr2=0x7f42b815de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:57.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.459+0000 7f42bd400640 1 --2- 172.21.15.137:0/1966871667 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42b81463e0 0x7f42b815de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.459+0000 7f42bd400640 1 -- 172.21.15.137:0/1966871667 >> v1:172.21.15.137:6789/0 conn(0x7f42b806dfd0 legacy=0x7f42b80d0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:57.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.459+0000 7f42bd400640 1 -- 172.21.15.137:0/1966871667 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b806e7b0 con 0x7f42b80d1420 2024-04-26T23:42:57.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.459+0000 7f42b7e00640 1 -- 172.21.15.137:0/1966871667 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1121960889 0 0) 0x7f42a0001120 con 0x7f42b806dfd0 2024-04-26T23:42:57.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.463+0000 7f42bd400640 1 --2- 172.21.15.137:0/1966871667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42b80d1420 0x7f42b80cf4a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f42b0009e50 tx=0x7f42b001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf8d8dc62ea5237 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:57.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.463+0000 7f42b7e00640 1 -- 172.21.15.137:0/1966871667 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b00a5700 con 0x7f42b80d1420 2024-04-26T23:42:57.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.463+0000 7f42b7e00640 1 -- 172.21.15.137:0/1966871667 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b00a58a0 con 0x7f42b80d1420 2024-04-26T23:42:57.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.463+0000 7f42b7e00640 1 -- 172.21.15.137:0/1966871667 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b00a5c70 con 0x7f42b80d1420 2024-04-26T23:42:57.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.463+0000 7f42bde00640 1 -- 172.21.15.137:0/1966871667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42b80d1420 msgr2=0x7f42b80cf4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:57.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.463+0000 7f42bde00640 1 --2- 172.21.15.137:0/1966871667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42b80d1420 0x7f42b80cf4a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f42b0009e50 tx=0x7f42b001ca30 comp rx=0 tx=0).stop 2024-04-26T23:42:57.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.463+0000 7f42bde00640 1 -- 172.21.15.137:0/1966871667 shutdown_connections 2024-04-26T23:42:57.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.463+0000 7f42bde00640 1 --2- 172.21.15.137:0/1966871667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42b80d1420 0x7f42b80cf4a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.463+0000 7f42bde00640 1 --2- 172.21.15.137:0/1966871667 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42b81463e0 0x7f42b815de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.463+0000 7f42bde00640 1 -- 172.21.15.137:0/1966871667 >> 172.21.15.137:0/1966871667 conn(0x7f42b806c5d0 msgr2=0x7f42b806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:57.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.463+0000 7f42bde00640 1 -- 172.21.15.137:0/1966871667 shutdown_connections 2024-04-26T23:42:57.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.463+0000 7f42bde00640 1 -- 172.21.15.137:0/1966871667 wait complete. 2024-04-26T23:42:57.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.463+0000 7f42bde00640 1 Processor -- start 2024-04-26T23:42:57.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.463+0000 7f42bde00640 1 -- start start 2024-04-26T23:42:57.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.463+0000 7f42bde00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42b806dfd0 0x7f42b813a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:57.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.463+0000 7f42bde00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42b80d1420 0x7f42b815c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:57.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.467+0000 7f42bde00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42b81463e0 0x7f42b815c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:57.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.467+0000 7f42bde00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f42b8169b10 con 0x7f42b806dfd0 2024-04-26T23:42:57.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.467+0000 7f42bde00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f42b8169c90 con 0x7f42b80d1420 2024-04-26T23:42:57.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.467+0000 7f42bde00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f42b8169e10 con 0x7f42b81463e0 2024-04-26T23:42:57.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.467+0000 7f42bca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42b806dfd0 0x7f42b813a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:57.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.467+0000 7f42bca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42b806dfd0 0x7f42b813a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34320/0 (socket says 172.21.15.137:34320) 2024-04-26T23:42:57.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.467+0000 7f42bca00640 1 -- 172.21.15.137:0/2418464249 learned_addr learned my addr 172.21.15.137:0/2418464249 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:57.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.467+0000 7f42bca00640 1 -- 172.21.15.137:0/2418464249 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42b81463e0 msgr2=0x7f42b815c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:57.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.467+0000 7f42bca00640 1 --2- 172.21.15.137:0/2418464249 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42b81463e0 0x7f42b815c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.467+0000 7f42bca00640 1 -- 172.21.15.137:0/2418464249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42b80d1420 msgr2=0x7f42b815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:57.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.467+0000 7f42bca00640 1 --2- 172.21.15.137:0/2418464249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42b80d1420 0x7f42b815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.467+0000 7f42bca00640 1 -- 172.21.15.137:0/2418464249 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b81406b0 con 0x7f42b806dfd0 2024-04-26T23:42:57.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.467+0000 7f42bca00640 1 --2- 172.21.15.137:0/2418464249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42b806dfd0 0x7f42b813a4e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f42a800e8a0 tx=0x7f42a800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:57.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.467+0000 7f42b5600640 1 -- 172.21.15.137:0/2418464249 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a8017070 con 0x7f42b806dfd0 2024-04-26T23:42:57.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.467+0000 7f42b5600640 1 -- 172.21.15.137:0/2418464249 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42a800c940 con 0x7f42b806dfd0 2024-04-26T23:42:57.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.467+0000 7f42bde00640 1 -- 172.21.15.137:0/2418464249 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b8140990 con 0x7f42b806dfd0 2024-04-26T23:42:57.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.467+0000 7f42b5600640 1 -- 172.21.15.137:0/2418464249 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a800ccf0 con 0x7f42b806dfd0 2024-04-26T23:42:57.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.467+0000 7f42bde00640 1 -- 172.21.15.137:0/2418464249 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b8140f50 con 0x7f42b806dfd0 2024-04-26T23:42:57.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.467+0000 7f42bde00640 1 -- 172.21.15.137:0/2418464249 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b806a300 con 0x7f42b806dfd0 2024-04-26T23:42:57.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.467+0000 7f42b5600640 1 -- 172.21.15.137:0/2418464249 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f42a801a070 con 0x7f42b806dfd0 2024-04-26T23:42:57.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.471+0000 7f42b5600640 1 --2- 172.21.15.137:0/2418464249 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4294068380 0x7f429406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:57.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.471+0000 7f42b5600640 1 -- 172.21.15.137:0/2418464249 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f42a8086c70 con 0x7f42b806dfd0 2024-04-26T23:42:57.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.471+0000 7f42afe00640 1 --2- 172.21.15.137:0/2418464249 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4294068380 0x7f429406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:57.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.471+0000 7f42afe00640 1 --2- 172.21.15.137:0/2418464249 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4294068380 0x7f429406a840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f42b813b530 tx=0x7f42a0001320 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:57.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.475+0000 7f42b5600640 1 -- 172.21.15.137:0/2418464249 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f42a8057230 con 0x7f42b806dfd0 2024-04-26T23:42:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.639+0000 7f42bde00640 1 -- 172.21.15.137:0/2418464249 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f42b815dc10 con 0x7f42b806dfd0 2024-04-26T23:42:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.639+0000 7f42b5600640 1 -- 172.21.15.137:0/2418464249 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) ==== 100+0+11 (secure 0 0 0) 0x7f42a8056b30 con 0x7f42b806dfd0 2024-04-26T23:42:57.644 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:42:57.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.639+0000 7f42bde00640 1 -- 172.21.15.137:0/2418464249 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4294068380 msgr2=0x7f429406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:57.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.639+0000 7f42bde00640 1 --2- 172.21.15.137:0/2418464249 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4294068380 0x7f429406a840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f42b813b530 tx=0x7f42a0001320 comp rx=0 tx=0).stop 2024-04-26T23:42:57.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.639+0000 7f42bde00640 1 -- 172.21.15.137:0/2418464249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42b806dfd0 msgr2=0x7f42b813a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.639+0000 7f42bde00640 1 --2- 172.21.15.137:0/2418464249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42b806dfd0 0x7f42b813a4e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f42a800e8a0 tx=0x7f42a800eca0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.639+0000 7f42bde00640 1 -- 172.21.15.137:0/2418464249 shutdown_connections 2024-04-26T23:42:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.639+0000 7f42bde00640 1 --2- 172.21.15.137:0/2418464249 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4294068380 0x7f429406a840 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.639+0000 7f42bde00640 1 --2- 172.21.15.137:0/2418464249 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42b81463e0 0x7f42b815c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.639+0000 7f42bde00640 1 --2- 172.21.15.137:0/2418464249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42b80d1420 0x7f42b815c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.639+0000 7f42bde00640 1 --2- 172.21.15.137:0/2418464249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42b806dfd0 0x7f42b813a4e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.639+0000 7f42bde00640 1 -- 172.21.15.137:0/2418464249 >> 172.21.15.137:0/2418464249 conn(0x7f42b806c5d0 msgr2=0x7f42b80d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.639+0000 7f42bde00640 1 -- 172.21.15.137:0/2418464249 shutdown_connections 2024-04-26T23:42:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.639+0000 7f42bde00640 1 -- 172.21.15.137:0/2418464249 wait complete. 2024-04-26T23:42:57.666 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:42:57.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.799+0000 7fee5a000640 1 Processor -- start 2024-04-26T23:42:57.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.799+0000 7fee5a000640 1 -- start start 2024-04-26T23:42:57.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.799+0000 7fee5a000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fee5415de80 0x7fee54073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:57.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.799+0000 7fee5a000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee540ce7c0 0x7fee54146210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:57.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.799+0000 7fee5a000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee54073010 con 0x7fee540ce3e0 2024-04-26T23:42:57.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.799+0000 7fee5a000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fee540cef90 con 0x7fee5415de80 2024-04-26T23:42:57.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.799+0000 7fee5a000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fee54073280 con 0x7fee540ce7c0 2024-04-26T23:42:57.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.799+0000 7fee53400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fee540ce3e0 0x7fee540d04e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40370/0 (socket says 172.21.15.137:40370) 2024-04-26T23:42:57.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.799+0000 7fee53400640 1 -- 172.21.15.137:0/1074379324 learned_addr learned my addr 172.21.15.137:0/1074379324 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:57.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.799+0000 7fee53e00640 1 --2- 172.21.15.137:0/1074379324 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee540ce7c0 0x7fee54146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:57.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.799+0000 7fee52a00640 1 --2- 172.21.15.137:0/1074379324 >> v2:172.21.15.170:3300/0 conn(0x7fee5415de80 0x7fee54073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:57.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.799+0000 7fee52000640 1 -- 172.21.15.137:0/1074379324 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2949441822 0 0) 0x7fee54073010 con 0x7fee540ce3e0 2024-04-26T23:42:57.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.799+0000 7fee52000640 1 -- 172.21.15.137:0/1074379324 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee38003530 con 0x7fee540ce3e0 2024-04-26T23:42:57.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.799+0000 7fee53e00640 1 -- 172.21.15.137:0/1074379324 >> v2:172.21.15.170:3300/0 conn(0x7fee5415de80 msgr2=0x7fee54073d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:57.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.799+0000 7fee53e00640 1 --2- 172.21.15.137:0/1074379324 >> v2:172.21.15.170:3300/0 conn(0x7fee5415de80 0x7fee54073d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.799+0000 7fee53e00640 1 -- 172.21.15.137:0/1074379324 >> v1:172.21.15.137:6789/0 conn(0x7fee540ce3e0 legacy=0x7fee540d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:57.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.799+0000 7fee53e00640 1 -- 172.21.15.137:0/1074379324 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee54073560 con 0x7fee540ce7c0 2024-04-26T23:42:57.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.799+0000 7fee52a00640 1 --2- 172.21.15.137:0/1074379324 >> v2:172.21.15.170:3300/0 conn(0x7fee5415de80 0x7fee54073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:42:57.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.803+0000 7fee53e00640 1 --2- 172.21.15.137:0/1074379324 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee540ce7c0 0x7fee54146210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009dc0 tx=0x7fee4c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a90d11b30dd87156 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:57.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.803+0000 7fee52000640 1 -- 172.21.15.137:0/1074379324 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4c0b2070 con 0x7fee540ce7c0 2024-04-26T23:42:57.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.803+0000 7fee52000640 1 -- 172.21.15.137:0/1074379324 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee4c0a58f0 con 0x7fee540ce7c0 2024-04-26T23:42:57.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.803+0000 7fee52000640 1 -- 172.21.15.137:0/1074379324 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4c0a5cc0 con 0x7fee540ce7c0 2024-04-26T23:42:57.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.803+0000 7fee5a000640 1 -- 172.21.15.137:0/1074379324 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee540ce7c0 msgr2=0x7fee54146210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:57.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.803+0000 7fee5a000640 1 --2- 172.21.15.137:0/1074379324 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee540ce7c0 0x7fee54146210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009dc0 tx=0x7fee4c01c920 comp rx=0 tx=0).stop 2024-04-26T23:42:57.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.803+0000 7fee5a000640 1 -- 172.21.15.137:0/1074379324 shutdown_connections 2024-04-26T23:42:57.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.803+0000 7fee5a000640 1 --2- 172.21.15.137:0/1074379324 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee540ce7c0 0x7fee54146210 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.803+0000 7fee5a000640 1 --2- 172.21.15.137:0/1074379324 >> v2:172.21.15.170:3300/0 conn(0x7fee5415de80 0x7fee54073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.803+0000 7fee5a000640 1 -- 172.21.15.137:0/1074379324 >> 172.21.15.137:0/1074379324 conn(0x7fee5406c5d0 msgr2=0x7fee5406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:57.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.803+0000 7fee5a000640 1 -- 172.21.15.137:0/1074379324 shutdown_connections 2024-04-26T23:42:57.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.803+0000 7fee5a000640 1 -- 172.21.15.137:0/1074379324 wait complete. 2024-04-26T23:42:57.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee5a000640 1 Processor -- start 2024-04-26T23:42:57.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee5a000640 1 -- start start 2024-04-26T23:42:57.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee5a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee540ce3e0 0x7fee5413ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:57.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee5a000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee540ce7c0 0x7fee540b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:57.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee5a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee5415de80 0x7fee5415e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:57.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee5a000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee5406f0a0 con 0x7fee540ce3e0 2024-04-26T23:42:57.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee5a000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fee5406ef20 con 0x7fee5415de80 2024-04-26T23:42:57.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee5a000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fee5406f220 con 0x7fee540ce7c0 2024-04-26T23:42:57.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee53400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee540ce3e0 0x7fee5413ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:57.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee53400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee540ce3e0 0x7fee5413ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34326/0 (socket says 172.21.15.137:34326) 2024-04-26T23:42:57.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee53400640 1 -- 172.21.15.137:0/2107679480 learned_addr learned my addr 172.21.15.137:0/2107679480 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:57.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee53e00640 1 --2- 172.21.15.137:0/2107679480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee5415de80 0x7fee5415e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:57.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee52a00640 1 --2- 172.21.15.137:0/2107679480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee540ce7c0 0x7fee540b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:57.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee53400640 1 -- 172.21.15.137:0/2107679480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee540ce7c0 msgr2=0x7fee540b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:57.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee53400640 1 --2- 172.21.15.137:0/2107679480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee540ce7c0 0x7fee540b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee53400640 1 -- 172.21.15.137:0/2107679480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee5415de80 msgr2=0x7fee5415e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:57.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee53400640 1 --2- 172.21.15.137:0/2107679480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee5415de80 0x7fee5415e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee53400640 1 -- 172.21.15.137:0/2107679480 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee5413f3b0 con 0x7fee540ce3e0 2024-04-26T23:42:57.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee53e00640 1 --2- 172.21.15.137:0/2107679480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee5415de80 0x7fee5415e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:57.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee53400640 1 --2- 172.21.15.137:0/2107679480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee540ce3e0 0x7fee5413ee70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fee4400c480 tx=0x7fee4400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:57.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee4b400640 1 -- 172.21.15.137:0/2107679480 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee44017070 con 0x7fee540ce3e0 2024-04-26T23:42:57.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee4b400640 1 -- 172.21.15.137:0/2107679480 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee44005cf0 con 0x7fee540ce3e0 2024-04-26T23:42:57.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee5a000640 1 -- 172.21.15.137:0/2107679480 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee5413f890 con 0x7fee540ce3e0 2024-04-26T23:42:57.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee4b400640 1 -- 172.21.15.137:0/2107679480 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee44007290 con 0x7fee540ce3e0 2024-04-26T23:42:57.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee5a000640 1 -- 172.21.15.137:0/2107679480 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee5413fe50 con 0x7fee540ce3e0 2024-04-26T23:42:57.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.807+0000 7fee5a000640 1 -- 172.21.15.137:0/2107679480 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee5406a4b0 con 0x7fee540ce3e0 2024-04-26T23:42:57.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.811+0000 7fee4b400640 1 -- 172.21.15.137:0/2107679480 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fee4401a070 con 0x7fee540ce3e0 2024-04-26T23:42:57.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.811+0000 7fee4b400640 1 --2- 172.21.15.137:0/2107679480 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fee34068380 0x7fee3406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:57.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.811+0000 7fee4b400640 1 -- 172.21.15.137:0/2107679480 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fee44085e30 con 0x7fee540ce3e0 2024-04-26T23:42:57.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.811+0000 7fee52a00640 1 --2- 172.21.15.137:0/2107679480 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fee34068380 0x7fee3406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:57.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.811+0000 7fee52a00640 1 --2- 172.21.15.137:0/2107679480 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fee34068380 0x7fee3406a840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fee5413e960 tx=0x7fee40008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:57.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.815+0000 7fee4b400640 1 -- 172.21.15.137:0/2107679480 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fee440563e0 con 0x7fee540ce3e0 2024-04-26T23:42:57.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.983+0000 7fee5a000640 1 -- 172.21.15.137:0/2107679480 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fee540b5b30 con 0x7fee540ce3e0 2024-04-26T23:42:57.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.983+0000 7fee4b400640 1 -- 172.21.15.137:0/2107679480 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7fee44055ce0 con 0x7fee540ce3e0 2024-04-26T23:42:57.991 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T23:42:57.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.987+0000 7fee5a000640 1 -- 172.21.15.137:0/2107679480 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fee34068380 msgr2=0x7fee3406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:57.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.987+0000 7fee5a000640 1 --2- 172.21.15.137:0/2107679480 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fee34068380 0x7fee3406a840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fee5413e960 tx=0x7fee40008040 comp rx=0 tx=0).stop 2024-04-26T23:42:57.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.987+0000 7fee5a000640 1 -- 172.21.15.137:0/2107679480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee540ce3e0 msgr2=0x7fee5413ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:57.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.987+0000 7fee5a000640 1 --2- 172.21.15.137:0/2107679480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee540ce3e0 0x7fee5413ee70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fee4400c480 tx=0x7fee4400c940 comp rx=0 tx=0).stop 2024-04-26T23:42:57.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.987+0000 7fee5a000640 1 -- 172.21.15.137:0/2107679480 shutdown_connections 2024-04-26T23:42:57.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.987+0000 7fee5a000640 1 --2- 172.21.15.137:0/2107679480 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fee34068380 0x7fee3406a840 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.987+0000 7fee5a000640 1 --2- 172.21.15.137:0/2107679480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee5415de80 0x7fee5415e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.987+0000 7fee5a000640 1 --2- 172.21.15.137:0/2107679480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee540ce7c0 0x7fee540b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.987+0000 7fee5a000640 1 --2- 172.21.15.137:0/2107679480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee540ce3e0 0x7fee5413ee70 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:57.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.987+0000 7fee5a000640 1 -- 172.21.15.137:0/2107679480 >> 172.21.15.137:0/2107679480 conn(0x7fee5406c5d0 msgr2=0x7fee5406c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:57.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.987+0000 7fee5a000640 1 -- 172.21.15.137:0/2107679480 shutdown_connections 2024-04-26T23:42:57.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:57.987+0000 7fee5a000640 1 -- 172.21.15.137:0/2107679480 wait complete. 2024-04-26T23:42:58.012 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:42:58.012 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:42:58.022 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:42:58.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.191+0000 7f0203c00640 1 Processor -- start 2024-04-26T23:42:58.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.191+0000 7f0203c00640 1 -- start start 2024-04-26T23:42:58.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.191+0000 7f0203c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f01fc15de80 0x7f01fc073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:58.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.191+0000 7f0203c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01fc073010 con 0x7f01fc0ce7c0 2024-04-26T23:42:58.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.191+0000 7f0203c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01fc0cef90 con 0x7f01fc0ce3e0 2024-04-26T23:42:58.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.191+0000 7f0203c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f01fc073280 con 0x7f01fc15de80 2024-04-26T23:42:58.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.191+0000 7f01f3e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f01fc15de80 0x7f01fc073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:58.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.191+0000 7f0201c00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f01fc0ce7c0 0x7f01fc146210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40382/0 (socket says 172.21.15.137:40382) 2024-04-26T23:42:58.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.191+0000 7f0201c00640 1 -- 172.21.15.137:0/2317679460 learned_addr learned my addr 172.21.15.137:0/2317679460 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:58.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.191+0000 7f01f3e00640 1 -- 172.21.15.137:0/2317679460 >> v1:172.21.15.170:6789/0 conn(0x7f01fc0ce3e0 legacy=0x7f01fc0d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:58.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.191+0000 7f01f3e00640 1 -- 172.21.15.137:0/2317679460 >> v1:172.21.15.137:6789/0 conn(0x7f01fc0ce7c0 legacy=0x7f01fc146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:58.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.191+0000 7f01fbe00640 1 -- 172.21.15.137:0/2317679460 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2983489369 0 0) 0x7f01fc0cef90 con 0x7f01fc0ce3e0 2024-04-26T23:42:58.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.195+0000 7f01f3e00640 1 -- 172.21.15.137:0/2317679460 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01fc073560 con 0x7f01fc15de80 2024-04-26T23:42:58.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.195+0000 7f01f3e00640 1 --2- 172.21.15.137:0/2317679460 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01fc15de80 0x7f01fc073d60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f01e40097f0 tx=0x7f01e401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8588903dfb4bc070 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:58.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.195+0000 7f01fbe00640 1 -- 172.21.15.137:0/2317679460 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e40b1070 con 0x7f01fc15de80 2024-04-26T23:42:58.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.195+0000 7f01fbe00640 1 -- 172.21.15.137:0/2317679460 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e40ac640 con 0x7f01fc15de80 2024-04-26T23:42:58.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.195+0000 7f01fbe00640 1 -- 172.21.15.137:0/2317679460 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e40aca10 con 0x7f01fc15de80 2024-04-26T23:42:58.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.195+0000 7f0203c00640 1 -- 172.21.15.137:0/2317679460 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01fc15de80 msgr2=0x7f01fc073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:58.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.195+0000 7f0203c00640 1 --2- 172.21.15.137:0/2317679460 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01fc15de80 0x7f01fc073d60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f01e40097f0 tx=0x7f01e401c330 comp rx=0 tx=0).stop 2024-04-26T23:42:58.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.195+0000 7f0203c00640 1 -- 172.21.15.137:0/2317679460 shutdown_connections 2024-04-26T23:42:58.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.195+0000 7f0203c00640 1 --2- 172.21.15.137:0/2317679460 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01fc15de80 0x7f01fc073d60 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:58.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.195+0000 7f0203c00640 1 -- 172.21.15.137:0/2317679460 >> 172.21.15.137:0/2317679460 conn(0x7f01fc06c5d0 msgr2=0x7f01fc06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:58.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.195+0000 7f0203c00640 1 -- 172.21.15.137:0/2317679460 shutdown_connections 2024-04-26T23:42:58.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.195+0000 7f0203c00640 1 -- 172.21.15.137:0/2317679460 wait complete. 2024-04-26T23:42:58.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f0203c00640 1 Processor -- start 2024-04-26T23:42:58.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f0203c00640 1 -- start start 2024-04-26T23:42:58.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f0203c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01fc0ce3e0 0x7f01fc15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:58.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f0203c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01fc0ce7c0 0x7f01fc1f6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:58.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f0203c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01fc15de80 0x7f01fc13b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:58.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f0203c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc146920 con 0x7f01fc0ce3e0 2024-04-26T23:42:58.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f0203c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc15e320 con 0x7f01fc0ce7c0 2024-04-26T23:42:58.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f0203c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f01fc146aa0 con 0x7f01fc15de80 2024-04-26T23:42:58.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f0201200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01fc0ce3e0 0x7f01fc15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:58.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f0201200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01fc0ce3e0 0x7f01fc15c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34346/0 (socket says 172.21.15.137:34346) 2024-04-26T23:42:58.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f0201200640 1 -- 172.21.15.137:0/1207009083 learned_addr learned my addr 172.21.15.137:0/1207009083 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:58.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f0201c00640 1 --2- 172.21.15.137:0/1207009083 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01fc15de80 0x7f01fc13b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:58.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f01f3e00640 1 --2- 172.21.15.137:0/1207009083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01fc0ce7c0 0x7f01fc1f6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:58.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f0201200640 1 -- 172.21.15.137:0/1207009083 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01fc15de80 msgr2=0x7f01fc13b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:58.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f0201200640 1 --2- 172.21.15.137:0/1207009083 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01fc15de80 0x7f01fc13b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:58.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f0201200640 1 -- 172.21.15.137:0/1207009083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01fc0ce7c0 msgr2=0x7f01fc1f6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:58.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f0201200640 1 --2- 172.21.15.137:0/1207009083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01fc0ce7c0 0x7f01fc1f6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:58.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f0201200640 1 -- 172.21.15.137:0/1207009083 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01fc13a840 con 0x7f01fc0ce3e0 2024-04-26T23:42:58.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f01f3e00640 1 --2- 172.21.15.137:0/1207009083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01fc0ce7c0 0x7f01fc1f6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:58.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f0201c00640 1 --2- 172.21.15.137:0/1207009083 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01fc15de80 0x7f01fc13b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:58.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f0201200640 1 --2- 172.21.15.137:0/1207009083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01fc0ce3e0 0x7f01fc15c0c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00c750 tx=0x7f01ec00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:58.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f01f9600640 1 -- 172.21.15.137:0/1207009083 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec005270 con 0x7f01fc0ce3e0 2024-04-26T23:42:58.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f01f9600640 1 -- 172.21.15.137:0/1207009083 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01ec005410 con 0x7f01fc0ce3e0 2024-04-26T23:42:58.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f0203c00640 1 -- 172.21.15.137:0/1207009083 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01fc13ab20 con 0x7f01fc0ce3e0 2024-04-26T23:42:58.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f01f9600640 1 -- 172.21.15.137:0/1207009083 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec00a840 con 0x7f01fc0ce3e0 2024-04-26T23:42:58.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.199+0000 7f0203c00640 1 -- 172.21.15.137:0/1207009083 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01fc1f6570 con 0x7f01fc0ce3e0 2024-04-26T23:42:58.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.203+0000 7f0203c00640 1 -- 172.21.15.137:0/1207009083 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01fc06a4b0 con 0x7f01fc0ce3e0 2024-04-26T23:42:58.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.203+0000 7f01f9600640 1 -- 172.21.15.137:0/1207009083 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f01ec00a9e0 con 0x7f01fc0ce3e0 2024-04-26T23:42:58.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.203+0000 7f01f9600640 1 --2- 172.21.15.137:0/1207009083 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f01d8068380 0x7f01d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:58.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.203+0000 7f01f9600640 1 -- 172.21.15.137:0/1207009083 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f01ec086760 con 0x7f01fc0ce3e0 2024-04-26T23:42:58.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.203+0000 7f01f3e00640 1 --2- 172.21.15.137:0/1207009083 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f01d8068380 0x7f01d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:58.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.203+0000 7f01f3e00640 1 --2- 172.21.15.137:0/1207009083 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f01d8068380 0x7f01d806a840 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f01e40ae000 tx=0x7f01e40a6070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:58.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.207+0000 7f01f9600640 1 -- 172.21.15.137:0/1207009083 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f01ec019300 con 0x7f01fc0ce3e0 2024-04-26T23:42:58.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.367+0000 7f0203c00640 1 -- 172.21.15.137:0/1207009083 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01fc161680 con 0x7f01fc0ce3e0 2024-04-26T23:42:58.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.367+0000 7f01f9600640 1 -- 172.21.15.137:0/1207009083 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16717 (secure 0 0 0) 0x7f01ec056d10 con 0x7f01fc0ce3e0 2024-04-26T23:42:58.374 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:42:58.374 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":33,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:42:26.483092+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:42:22.570062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:42:23.822598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:42:58.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.371+0000 7f0203c00640 1 -- 172.21.15.137:0/1207009083 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f01d8068380 msgr2=0x7f01d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:58.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.371+0000 7f0203c00640 1 --2- 172.21.15.137:0/1207009083 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f01d8068380 0x7f01d806a840 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f01e40ae000 tx=0x7f01e40a6070 comp rx=0 tx=0).stop 2024-04-26T23:42:58.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.371+0000 7f0203c00640 1 -- 172.21.15.137:0/1207009083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01fc0ce3e0 msgr2=0x7f01fc15c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:58.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.371+0000 7f0203c00640 1 --2- 172.21.15.137:0/1207009083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01fc0ce3e0 0x7f01fc15c0c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00c750 tx=0x7f01ec00cc10 comp rx=0 tx=0).stop 2024-04-26T23:42:58.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.371+0000 7f0203c00640 1 -- 172.21.15.137:0/1207009083 shutdown_connections 2024-04-26T23:42:58.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.371+0000 7f0203c00640 1 --2- 172.21.15.137:0/1207009083 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f01d8068380 0x7f01d806a840 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:58.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.371+0000 7f0203c00640 1 --2- 172.21.15.137:0/1207009083 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01fc15de80 0x7f01fc13b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:58.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.371+0000 7f0203c00640 1 --2- 172.21.15.137:0/1207009083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01fc0ce7c0 0x7f01fc1f6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:58.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.371+0000 7f0203c00640 1 --2- 172.21.15.137:0/1207009083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01fc0ce3e0 0x7f01fc15c0c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:58.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.371+0000 7f0203c00640 1 -- 172.21.15.137:0/1207009083 >> 172.21.15.137:0/1207009083 conn(0x7f01fc06c5d0 msgr2=0x7f01fc06c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:58.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.371+0000 7f0203c00640 1 -- 172.21.15.137:0/1207009083 shutdown_connections 2024-04-26T23:42:58.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.371+0000 7f0203c00640 1 -- 172.21.15.137:0/1207009083 wait complete. 2024-04-26T23:42:58.395 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:42:22.570062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:42:23.822598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:42:58.395 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:42:58.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.527+0000 7f29d0000640 1 Processor -- start 2024-04-26T23:42:58.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.527+0000 7f29d0000640 1 -- start start 2024-04-26T23:42:58.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.527+0000 7f29d0000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f29c80b54e0 0x7f29c80b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:58.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.527+0000 7f29d0000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f29c80cd710 0x7f29c815f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:58.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.527+0000 7f29d0000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29c80cffa0 con 0x7f29c815fe30 2024-04-26T23:42:58.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.527+0000 7f29d0000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f29c80b3d90 con 0x7f29c80cd710 2024-04-26T23:42:58.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.527+0000 7f29d0000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f29c80d0840 con 0x7f29c80b54e0 2024-04-26T23:42:58.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.531+0000 7f29ccc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f29c80cd710 0x7f29c815f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:58.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.531+0000 7f29ccc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f29c80cd710 0x7f29c815f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34356/0 (socket says 172.21.15.137:34356) 2024-04-26T23:42:58.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.531+0000 7f29ccc00640 1 -- 172.21.15.137:0/626863291 learned_addr learned my addr 172.21.15.137:0/626863291 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:58.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.531+0000 7f29cd600640 1 --2- 172.21.15.137:0/626863291 >> v2:172.21.15.170:3300/0 conn(0x7f29c80b54e0 0x7f29c80b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:58.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.531+0000 7f29ccc00640 1 -- 172.21.15.137:0/626863291 >> v2:172.21.15.170:3300/0 conn(0x7f29c80b54e0 msgr2=0x7f29c80b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:58.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.531+0000 7f29ccc00640 1 --2- 172.21.15.137:0/626863291 >> v2:172.21.15.170:3300/0 conn(0x7f29c80b54e0 0x7f29c80b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:58.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.531+0000 7f29ccc00640 1 -- 172.21.15.137:0/626863291 >> v1:172.21.15.170:6789/0 conn(0x7f29c815fe30 legacy=0x7f29c8144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:58.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.531+0000 7f29ccc00640 1 -- 172.21.15.137:0/626863291 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c80d0280 con 0x7f29c80cd710 2024-04-26T23:42:58.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.531+0000 7f29ccc00640 1 --2- 172.21.15.137:0/626863291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29c80cd710 0x7f29c815f8f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f29c806de40 tx=0x7f29b401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06c61a5d54e9c15 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:58.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.531+0000 7f29c7e00640 1 -- 172.21.15.137:0/626863291 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b40ab430 con 0x7f29c80cd710 2024-04-26T23:42:58.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.531+0000 7f29c7e00640 1 -- 172.21.15.137:0/626863291 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b40b0070 con 0x7f29c80cd710 2024-04-26T23:42:58.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.531+0000 7f29c7e00640 1 -- 172.21.15.137:0/626863291 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b40ab7f0 con 0x7f29c80cd710 2024-04-26T23:42:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29d0000640 1 -- 172.21.15.137:0/626863291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29c80cd710 msgr2=0x7f29c815f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29d0000640 1 --2- 172.21.15.137:0/626863291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29c80cd710 0x7f29c815f8f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f29c806de40 tx=0x7f29b401c520 comp rx=0 tx=0).stop 2024-04-26T23:42:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29d0000640 1 -- 172.21.15.137:0/626863291 shutdown_connections 2024-04-26T23:42:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29d0000640 1 --2- 172.21.15.137:0/626863291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29c80cd710 0x7f29c815f8f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29d0000640 1 --2- 172.21.15.137:0/626863291 >> v2:172.21.15.170:3300/0 conn(0x7f29c80b54e0 0x7f29c80b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29d0000640 1 -- 172.21.15.137:0/626863291 >> 172.21.15.137:0/626863291 conn(0x7f29c806c800 msgr2=0x7f29c806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29d0000640 1 -- 172.21.15.137:0/626863291 shutdown_connections 2024-04-26T23:42:58.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29d0000640 1 -- 172.21.15.137:0/626863291 wait complete. 2024-04-26T23:42:58.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29d0000640 1 Processor -- start 2024-04-26T23:42:58.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29d0000640 1 -- start start 2024-04-26T23:42:58.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29d0000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29c80b54e0 0x7f29c813d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:58.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29d0000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29c80cd710 0x7f29c806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:58.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29d0000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29c815fe30 0x7f29c806f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:58.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29d0000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f29c8145840 con 0x7f29c80b54e0 2024-04-26T23:42:58.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29d0000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f29c80cded0 con 0x7f29c80cd710 2024-04-26T23:42:58.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29d0000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f29c81459c0 con 0x7f29c815fe30 2024-04-26T23:42:58.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29cd600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29c80b54e0 0x7f29c813d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:58.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29cd600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29c80b54e0 0x7f29c813d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34358/0 (socket says 172.21.15.137:34358) 2024-04-26T23:42:58.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29cd600640 1 -- 172.21.15.137:0/1017045200 learned_addr learned my addr 172.21.15.137:0/1017045200 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:58.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29ccc00640 1 --2- 172.21.15.137:0/1017045200 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29c80cd710 0x7f29c806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:58.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29ce000640 1 --2- 172.21.15.137:0/1017045200 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29c815fe30 0x7f29c806f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:58.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29cd600640 1 -- 172.21.15.137:0/1017045200 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29c815fe30 msgr2=0x7f29c806f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:58.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29cd600640 1 --2- 172.21.15.137:0/1017045200 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29c815fe30 0x7f29c806f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:58.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29cd600640 1 -- 172.21.15.137:0/1017045200 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29c80cd710 msgr2=0x7f29c806ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:58.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29cd600640 1 --2- 172.21.15.137:0/1017045200 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29c80cd710 0x7f29c806ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:58.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29cd600640 1 -- 172.21.15.137:0/1017045200 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c813dee0 con 0x7f29c80b54e0 2024-04-26T23:42:58.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.535+0000 7f29cd600640 1 --2- 172.21.15.137:0/1017045200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29c80b54e0 0x7f29c813d480 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00d5f0 tx=0x7f29bc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:58.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.539+0000 7f29c5600640 1 -- 172.21.15.137:0/1017045200 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc0125f0 con 0x7f29c80b54e0 2024-04-26T23:42:58.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.539+0000 7f29c5600640 1 -- 172.21.15.137:0/1017045200 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29bc019070 con 0x7f29c80b54e0 2024-04-26T23:42:58.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.539+0000 7f29d0000640 1 -- 172.21.15.137:0/1017045200 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c813e1c0 con 0x7f29c80b54e0 2024-04-26T23:42:58.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.539+0000 7f29c5600640 1 -- 172.21.15.137:0/1017045200 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc0129d0 con 0x7f29c80b54e0 2024-04-26T23:42:58.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.539+0000 7f29d0000640 1 -- 172.21.15.137:0/1017045200 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c813e780 con 0x7f29c80b54e0 2024-04-26T23:42:58.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.539+0000 7f29d0000640 1 -- 172.21.15.137:0/1017045200 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29c806a410 con 0x7f29c80b54e0 2024-04-26T23:42:58.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.539+0000 7f29c5600640 1 -- 172.21.15.137:0/1017045200 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f29bc012b70 con 0x7f29c80b54e0 2024-04-26T23:42:58.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.539+0000 7f29c5600640 1 --2- 172.21.15.137:0/1017045200 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f29a8068380 0x7f29a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:58.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.539+0000 7f29c5600640 1 -- 172.21.15.137:0/1017045200 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f29bc086e60 con 0x7f29c80b54e0 2024-04-26T23:42:58.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.539+0000 7f29ccc00640 1 --2- 172.21.15.137:0/1017045200 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f29a8068380 0x7f29a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:58.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.539+0000 7f29ccc00640 1 --2- 172.21.15.137:0/1017045200 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f29a8068380 0x7f29a806a840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f29b40af000 tx=0x7f29b4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:58.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.543+0000 7f29c5600640 1 -- 172.21.15.137:0/1017045200 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f29bc057380 con 0x7f29c80b54e0 2024-04-26T23:42:58.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.703+0000 7f29d0000640 1 -- 172.21.15.137:0/1017045200 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f29c806d410 con 0x7f29c80b54e0 2024-04-26T23:42:58.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.703+0000 7f29c5600640 1 -- 172.21.15.137:0/1017045200 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) ==== 93+0+10 (secure 0 0 0) 0x7f29bc056c80 con 0x7f29c80b54e0 2024-04-26T23:42:58.711 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:42:58.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.707+0000 7f29d0000640 1 -- 172.21.15.137:0/1017045200 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f29a8068380 msgr2=0x7f29a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:58.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.707+0000 7f29d0000640 1 --2- 172.21.15.137:0/1017045200 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f29a8068380 0x7f29a806a840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f29b40af000 tx=0x7f29b4008040 comp rx=0 tx=0).stop 2024-04-26T23:42:58.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.707+0000 7f29d0000640 1 -- 172.21.15.137:0/1017045200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29c80b54e0 msgr2=0x7f29c813d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:58.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.707+0000 7f29d0000640 1 --2- 172.21.15.137:0/1017045200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29c80b54e0 0x7f29c813d480 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00d5f0 tx=0x7f29bc00dab0 comp rx=0 tx=0).stop 2024-04-26T23:42:58.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.707+0000 7f29d0000640 1 -- 172.21.15.137:0/1017045200 shutdown_connections 2024-04-26T23:42:58.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.707+0000 7f29d0000640 1 --2- 172.21.15.137:0/1017045200 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f29a8068380 0x7f29a806a840 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:58.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.707+0000 7f29d0000640 1 --2- 172.21.15.137:0/1017045200 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29c815fe30 0x7f29c806f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:58.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.707+0000 7f29d0000640 1 --2- 172.21.15.137:0/1017045200 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29c80cd710 0x7f29c806ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:58.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.707+0000 7f29d0000640 1 --2- 172.21.15.137:0/1017045200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29c80b54e0 0x7f29c813d480 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:58.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.707+0000 7f29d0000640 1 -- 172.21.15.137:0/1017045200 >> 172.21.15.137:0/1017045200 conn(0x7f29c806c800 msgr2=0x7f29c8068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:58.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.707+0000 7f29d0000640 1 -- 172.21.15.137:0/1017045200 shutdown_connections 2024-04-26T23:42:58.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.707+0000 7f29d0000640 1 -- 172.21.15.137:0/1017045200 wait complete. 2024-04-26T23:42:58.732 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:42:58.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.863+0000 7f4a4b000640 1 Processor -- start 2024-04-26T23:42:58.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.863+0000 7f4a4b000640 1 -- start start 2024-04-26T23:42:58.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.867+0000 7f4a4b000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4a440ceac0 0x7f4a4415df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:58.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.867+0000 7f4a4b000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a44072860 con 0x7f4a44073f20 2024-04-26T23:42:58.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.867+0000 7f4a4b000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a440743b0 con 0x7f4a440afbc0 2024-04-26T23:42:58.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.867+0000 7f4a4b000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f4a44072b00 con 0x7f4a440ceac0 2024-04-26T23:42:58.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.867+0000 7f4a43400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4a44073f20 0x7f4a440ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40384/0 (socket says 172.21.15.137:40384) 2024-04-26T23:42:58.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.867+0000 7f4a43400640 1 -- 172.21.15.137:0/3397871744 learned_addr learned my addr 172.21.15.137:0/3397871744 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:58.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.867+0000 7f4a49000640 1 --2- 172.21.15.137:0/3397871744 >> v2:172.21.15.170:3300/0 conn(0x7f4a440ceac0 0x7f4a4415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:58.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.867+0000 7f4a42a00640 1 -- 172.21.15.137:0/3397871744 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 329942980 0 0) 0x7f4a44072860 con 0x7f4a44073f20 2024-04-26T23:42:58.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.867+0000 7f4a42a00640 1 -- 172.21.15.137:0/3397871744 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a28003530 con 0x7f4a44073f20 2024-04-26T23:42:58.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.867+0000 7f4a49000640 1 -- 172.21.15.137:0/3397871744 >> v1:172.21.15.170:6789/0 conn(0x7f4a440afbc0 legacy=0x7f4a440735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:58.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.867+0000 7f4a49000640 1 -- 172.21.15.137:0/3397871744 >> v1:172.21.15.137:6789/0 conn(0x7f4a44073f20 legacy=0x7f4a440ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:58.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.867+0000 7f4a49000640 1 -- 172.21.15.137:0/3397871744 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a44072de0 con 0x7f4a440ceac0 2024-04-26T23:42:58.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.871+0000 7f4a49000640 1 --2- 172.21.15.137:0/3397871744 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a440ceac0 0x7f4a4415df90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c009dc0 tx=0x7f4a3c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c69f5fd9f8219f3e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:58.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.871+0000 7f4a42a00640 1 -- 172.21.15.137:0/3397871744 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c0b2070 con 0x7f4a440ceac0 2024-04-26T23:42:58.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.871+0000 7f4a42a00640 1 -- 172.21.15.137:0/3397871744 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a3c0a58c0 con 0x7f4a440ceac0 2024-04-26T23:42:58.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.871+0000 7f4a42a00640 1 -- 172.21.15.137:0/3397871744 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c0a5c70 con 0x7f4a440ceac0 2024-04-26T23:42:58.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.871+0000 7f4a4b000640 1 -- 172.21.15.137:0/3397871744 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a440ceac0 msgr2=0x7f4a4415df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:58.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.871+0000 7f4a4b000640 1 --2- 172.21.15.137:0/3397871744 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a440ceac0 0x7f4a4415df90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c009dc0 tx=0x7f4a3c01c950 comp rx=0 tx=0).stop 2024-04-26T23:42:58.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.871+0000 7f4a4b000640 1 -- 172.21.15.137:0/3397871744 shutdown_connections 2024-04-26T23:42:58.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.871+0000 7f4a4b000640 1 --2- 172.21.15.137:0/3397871744 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a440ceac0 0x7f4a4415df90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:58.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.871+0000 7f4a4b000640 1 -- 172.21.15.137:0/3397871744 >> 172.21.15.137:0/3397871744 conn(0x7f4a4406c800 msgr2=0x7f4a4406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:58.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.871+0000 7f4a4b000640 1 -- 172.21.15.137:0/3397871744 shutdown_connections 2024-04-26T23:42:58.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.871+0000 7f4a4b000640 1 -- 172.21.15.137:0/3397871744 wait complete. 2024-04-26T23:42:58.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.871+0000 7f4a4b000640 1 Processor -- start 2024-04-26T23:42:58.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.871+0000 7f4a4b000640 1 -- start start 2024-04-26T23:42:58.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a4b000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a440afbc0 0x7f4a440b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:58.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a4b000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a440ceac0 0x7f4a440b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:58.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a4b000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a4414e9b0 0x7f4a441f7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:58.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a4b000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4406ffe0 con 0x7f4a4414e9b0 2024-04-26T23:42:58.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a4b000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4a440b01f0 con 0x7f4a440ceac0 2024-04-26T23:42:58.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a4b000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4a44070160 con 0x7f4a440afbc0 2024-04-26T23:42:58.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a49000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a4414e9b0 0x7f4a441f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:58.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a49000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a4414e9b0 0x7f4a441f7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34360/0 (socket says 172.21.15.137:34360) 2024-04-26T23:42:58.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a49000640 1 -- 172.21.15.137:0/4037480080 learned_addr learned my addr 172.21.15.137:0/4037480080 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:58.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a43e00640 1 --2- 172.21.15.137:0/4037480080 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a440afbc0 0x7f4a440b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:58.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a43400640 1 --2- 172.21.15.137:0/4037480080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a440ceac0 0x7f4a440b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:58.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a49000640 1 -- 172.21.15.137:0/4037480080 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a440afbc0 msgr2=0x7f4a440b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:58.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a49000640 1 --2- 172.21.15.137:0/4037480080 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a440afbc0 0x7f4a440b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:58.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a49000640 1 -- 172.21.15.137:0/4037480080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a440ceac0 msgr2=0x7f4a440b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:58.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a49000640 1 --2- 172.21.15.137:0/4037480080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a440ceac0 0x7f4a440b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:58.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a49000640 1 -- 172.21.15.137:0/4037480080 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a44152030 con 0x7f4a4414e9b0 2024-04-26T23:42:58.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a43400640 1 --2- 172.21.15.137:0/4037480080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a440ceac0 0x7f4a440b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:58.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a49000640 1 --2- 172.21.15.137:0/4037480080 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a4414e9b0 0x7f4a441f7960 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c009dc0 tx=0x7f4a3c0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:58.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a3be00640 1 -- 172.21.15.137:0/4037480080 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c0b2050 con 0x7f4a4414e9b0 2024-04-26T23:42:58.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a3be00640 1 -- 172.21.15.137:0/4037480080 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a3c0b3040 con 0x7f4a4414e9b0 2024-04-26T23:42:58.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a4b000640 1 -- 172.21.15.137:0/4037480080 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a441504d0 con 0x7f4a4414e9b0 2024-04-26T23:42:58.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a3be00640 1 -- 172.21.15.137:0/4037480080 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c003bb0 con 0x7f4a4414e9b0 2024-04-26T23:42:58.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a4b000640 1 -- 172.21.15.137:0/4037480080 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a44152590 con 0x7f4a4414e9b0 2024-04-26T23:42:58.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a4b000640 1 -- 172.21.15.137:0/4037480080 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a4406a410 con 0x7f4a4414e9b0 2024-04-26T23:42:58.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.875+0000 7f4a3be00640 1 -- 172.21.15.137:0/4037480080 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4a3c0c0020 con 0x7f4a4414e9b0 2024-04-26T23:42:58.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.879+0000 7f4a3be00640 1 --2- 172.21.15.137:0/4037480080 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4a24068380 0x7f4a2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:58.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.879+0000 7f4a3be00640 1 -- 172.21.15.137:0/4037480080 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f4a3c121230 con 0x7f4a4414e9b0 2024-04-26T23:42:58.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.879+0000 7f4a43e00640 1 --2- 172.21.15.137:0/4037480080 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4a24068380 0x7f4a2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:58.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.879+0000 7f4a43e00640 1 --2- 172.21.15.137:0/4037480080 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4a24068380 0x7f4a2406a840 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4a34007fd0 tx=0x7f4a34009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:58.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:58.883+0000 7f4a3be00640 1 -- 172.21.15.137:0/4037480080 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4a44152030 con 0x7f4a4414e9b0 2024-04-26T23:42:59.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.039+0000 7f4a4b000640 1 -- 172.21.15.137:0/4037480080 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4a44160870 con 0x7f4a4414e9b0 2024-04-26T23:42:59.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.039+0000 7f4a3be00640 1 -- 172.21.15.137:0/4037480080 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) ==== 104+0+11 (secure 0 0 0) 0x7f4a3c016540 con 0x7f4a4414e9b0 2024-04-26T23:42:59.045 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:42:59.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.039+0000 7f4a4b000640 1 -- 172.21.15.137:0/4037480080 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4a24068380 msgr2=0x7f4a2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:59.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.039+0000 7f4a4b000640 1 --2- 172.21.15.137:0/4037480080 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4a24068380 0x7f4a2406a840 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4a34007fd0 tx=0x7f4a34009040 comp rx=0 tx=0).stop 2024-04-26T23:42:59.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.039+0000 7f4a4b000640 1 -- 172.21.15.137:0/4037480080 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a4414e9b0 msgr2=0x7f4a441f7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:59.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.039+0000 7f4a4b000640 1 --2- 172.21.15.137:0/4037480080 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a4414e9b0 0x7f4a441f7960 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c009dc0 tx=0x7f4a3c0196f0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.039+0000 7f4a4b000640 1 -- 172.21.15.137:0/4037480080 shutdown_connections 2024-04-26T23:42:59.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.039+0000 7f4a4b000640 1 --2- 172.21.15.137:0/4037480080 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4a24068380 0x7f4a2406a840 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.039+0000 7f4a4b000640 1 --2- 172.21.15.137:0/4037480080 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a4414e9b0 0x7f4a441f7960 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.039+0000 7f4a4b000640 1 --2- 172.21.15.137:0/4037480080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a440ceac0 0x7f4a440b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.039+0000 7f4a4b000640 1 --2- 172.21.15.137:0/4037480080 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a440afbc0 0x7f4a440b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.039+0000 7f4a4b000640 1 -- 172.21.15.137:0/4037480080 >> 172.21.15.137:0/4037480080 conn(0x7f4a4406c800 msgr2=0x7f4a440ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:59.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.039+0000 7f4a4b000640 1 -- 172.21.15.137:0/4037480080 shutdown_connections 2024-04-26T23:42:59.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.039+0000 7f4a4b000640 1 -- 172.21.15.137:0/4037480080 wait complete. 2024-04-26T23:42:59.066 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:42:59.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.199+0000 7f50b7600640 1 Processor -- start 2024-04-26T23:42:59.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.199+0000 7f50b7600640 1 -- start start 2024-04-26T23:42:59.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.199+0000 7f50b7600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f50b00afbc0 0x7f50b015df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:59.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.199+0000 7f50b7600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f50b0073f20 0x7f50b00735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:59.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.199+0000 7f50b7600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50b0073b20 con 0x7f50b00affa0 2024-04-26T23:42:59.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.199+0000 7f50b7600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f50b0072860 con 0x7f50b00afbc0 2024-04-26T23:42:59.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.199+0000 7f50b7600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f50b00743b0 con 0x7f50b0073f20 2024-04-26T23:42:59.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.199+0000 7f50b4c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f50b00afbc0 0x7f50b015df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:59.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.199+0000 7f50b5600640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f50b00affa0 0x7f50b00ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40398/0 (socket says 172.21.15.137:40398) 2024-04-26T23:42:59.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.199+0000 7f50b4c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f50b00afbc0 0x7f50b015df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34374/0 (socket says 172.21.15.137:34374) 2024-04-26T23:42:59.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.199+0000 7f50b5600640 1 -- 172.21.15.137:0/3448348846 learned_addr learned my addr 172.21.15.137:0/3448348846 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:42:59.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.199+0000 7f50afe00640 1 --2- 172.21.15.137:0/3448348846 >> v2:172.21.15.170:3300/0 conn(0x7f50b0073f20 0x7f50b00735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:59.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.199+0000 7f50b4c00640 1 -- 172.21.15.137:0/3448348846 >> v2:172.21.15.170:3300/0 conn(0x7f50b0073f20 msgr2=0x7f50b00735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:59.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.199+0000 7f50b4c00640 1 --2- 172.21.15.137:0/3448348846 >> v2:172.21.15.170:3300/0 conn(0x7f50b0073f20 0x7f50b00735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.199+0000 7f50b4c00640 1 -- 172.21.15.137:0/3448348846 >> v1:172.21.15.137:6789/0 conn(0x7f50b00affa0 legacy=0x7f50b00ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:59.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.199+0000 7f50b4c00640 1 -- 172.21.15.137:0/3448348846 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b0072b00 con 0x7f50b00afbc0 2024-04-26T23:42:59.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.199+0000 7f50af400640 1 -- 172.21.15.137:0/3448348846 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1431896929 0 0) 0x7f50b0073b20 con 0x7f50b00affa0 2024-04-26T23:42:59.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.203+0000 7f50b4c00640 1 --2- 172.21.15.137:0/3448348846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50b00afbc0 0x7f50b015df90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f50a40097c0 tx=0x7f50a401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84fa4cae8599c9e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:59.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.203+0000 7f50af400640 1 -- 172.21.15.137:0/3448348846 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a40b0070 con 0x7f50b00afbc0 2024-04-26T23:42:59.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.203+0000 7f50af400640 1 -- 172.21.15.137:0/3448348846 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50a4004230 con 0x7f50b00afbc0 2024-04-26T23:42:59.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.203+0000 7f50af400640 1 -- 172.21.15.137:0/3448348846 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a4003620 con 0x7f50b00afbc0 2024-04-26T23:42:59.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.203+0000 7f50b7600640 1 -- 172.21.15.137:0/3448348846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50b00afbc0 msgr2=0x7f50b015df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:59.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.203+0000 7f50b7600640 1 --2- 172.21.15.137:0/3448348846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50b00afbc0 0x7f50b015df90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f50a40097c0 tx=0x7f50a401c460 comp rx=0 tx=0).stop 2024-04-26T23:42:59.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.203+0000 7f50b7600640 1 -- 172.21.15.137:0/3448348846 shutdown_connections 2024-04-26T23:42:59.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.203+0000 7f50b7600640 1 --2- 172.21.15.137:0/3448348846 >> v2:172.21.15.170:3300/0 conn(0x7f50b0073f20 0x7f50b00735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.203+0000 7f50b7600640 1 --2- 172.21.15.137:0/3448348846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50b00afbc0 0x7f50b015df90 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.203+0000 7f50b7600640 1 -- 172.21.15.137:0/3448348846 >> 172.21.15.137:0/3448348846 conn(0x7f50b006c800 msgr2=0x7f50b006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:59.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.203+0000 7f50b7600640 1 -- 172.21.15.137:0/3448348846 shutdown_connections 2024-04-26T23:42:59.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.203+0000 7f50b7600640 1 -- 172.21.15.137:0/3448348846 wait complete. 2024-04-26T23:42:59.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.203+0000 7f50b7600640 1 Processor -- start 2024-04-26T23:42:59.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50b7600640 1 -- start start 2024-04-26T23:42:59.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50b7600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50b00afbc0 0x7f50b014e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:59.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50b7600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50b00affa0 0x7f50b0151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:59.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50b7600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50b0151970 0x7f50b00b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:59.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50b7600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f50b00cec40 con 0x7f50b0151970 2024-04-26T23:42:59.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50b7600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f50b00ceac0 con 0x7f50b00afbc0 2024-04-26T23:42:59.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50b7600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f50b006efd0 con 0x7f50b00affa0 2024-04-26T23:42:59.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50b5600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50b0151970 0x7f50b00b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:59.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50b5600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50b0151970 0x7f50b00b0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34386/0 (socket says 172.21.15.137:34386) 2024-04-26T23:42:59.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50b5600640 1 -- 172.21.15.137:0/3196789654 learned_addr learned my addr 172.21.15.137:0/3196789654 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:59.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50afe00640 1 --2- 172.21.15.137:0/3196789654 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50b00affa0 0x7f50b0151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:59.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50b4c00640 1 --2- 172.21.15.137:0/3196789654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50b00afbc0 0x7f50b014e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:59.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50b5600640 1 -- 172.21.15.137:0/3196789654 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50b00affa0 msgr2=0x7f50b0151430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:59.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50b5600640 1 --2- 172.21.15.137:0/3196789654 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50b00affa0 0x7f50b0151430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50b5600640 1 -- 172.21.15.137:0/3196789654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50b00afbc0 msgr2=0x7f50b014e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:59.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50b5600640 1 --2- 172.21.15.137:0/3196789654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50b00afbc0 0x7f50b014e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50b5600640 1 -- 172.21.15.137:0/3196789654 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b00701e0 con 0x7f50b0151970 2024-04-26T23:42:59.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50b5600640 1 --2- 172.21.15.137:0/3196789654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50b0151970 0x7f50b00b0670 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f50a800c780 tx=0x7f50a800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:59.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50acc00640 1 -- 172.21.15.137:0/3196789654 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a8018070 con 0x7f50b0151970 2024-04-26T23:42:59.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50acc00640 1 -- 172.21.15.137:0/3196789654 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50a800a640 con 0x7f50b0151970 2024-04-26T23:42:59.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50acc00640 1 -- 172.21.15.137:0/3196789654 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a800a9f0 con 0x7f50b0151970 2024-04-26T23:42:59.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50b7600640 1 -- 172.21.15.137:0/3196789654 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50b014ed00 con 0x7f50b0151970 2024-04-26T23:42:59.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50b7600640 1 -- 172.21.15.137:0/3196789654 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50b00b1250 con 0x7f50b0151970 2024-04-26T23:42:59.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.207+0000 7f50b7600640 1 -- 172.21.15.137:0/3196789654 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50b006a410 con 0x7f50b0151970 2024-04-26T23:42:59.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.211+0000 7f50acc00640 1 -- 172.21.15.137:0/3196789654 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f50a800ab90 con 0x7f50b0151970 2024-04-26T23:42:59.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.211+0000 7f50acc00640 1 --2- 172.21.15.137:0/3196789654 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f50900683b0 0x7f509006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:59.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.211+0000 7f50acc00640 1 -- 172.21.15.137:0/3196789654 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f50a8085f40 con 0x7f50b0151970 2024-04-26T23:42:59.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.211+0000 7f50b4c00640 1 --2- 172.21.15.137:0/3196789654 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f50900683b0 0x7f509006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:59.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.211+0000 7f50b4c00640 1 --2- 172.21.15.137:0/3196789654 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f50900683b0 0x7f509006a870 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f50a40ad000 tx=0x7f50a4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:59.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.215+0000 7f50acc00640 1 -- 172.21.15.137:0/3196789654 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f50b014ed00 con 0x7f50b0151970 2024-04-26T23:42:59.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.371+0000 7f50b7600640 1 -- 172.21.15.137:0/3196789654 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f50b00b3fa0 con 0x7f50b0151970 2024-04-26T23:42:59.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.371+0000 7f50acc00640 1 -- 172.21.15.137:0/3196789654 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) ==== 100+0+11 (secure 0 0 0) 0x7f50a8055e10 con 0x7f50b0151970 2024-04-26T23:42:59.377 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:42:59.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.371+0000 7f50b7600640 1 -- 172.21.15.137:0/3196789654 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f50900683b0 msgr2=0x7f509006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:59.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.371+0000 7f50b7600640 1 --2- 172.21.15.137:0/3196789654 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f50900683b0 0x7f509006a870 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f50a40ad000 tx=0x7f50a4008040 comp rx=0 tx=0).stop 2024-04-26T23:42:59.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.371+0000 7f50b7600640 1 -- 172.21.15.137:0/3196789654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50b0151970 msgr2=0x7f50b00b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:59.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.371+0000 7f50b7600640 1 --2- 172.21.15.137:0/3196789654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50b0151970 0x7f50b00b0670 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f50a800c780 tx=0x7f50a800cc40 comp rx=0 tx=0).stop 2024-04-26T23:42:59.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.371+0000 7f50b7600640 1 -- 172.21.15.137:0/3196789654 shutdown_connections 2024-04-26T23:42:59.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.371+0000 7f50b7600640 1 --2- 172.21.15.137:0/3196789654 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f50900683b0 0x7f509006a870 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.371+0000 7f50b7600640 1 --2- 172.21.15.137:0/3196789654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50b0151970 0x7f50b00b0670 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.371+0000 7f50b7600640 1 --2- 172.21.15.137:0/3196789654 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50b00affa0 0x7f50b0151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.371+0000 7f50b7600640 1 --2- 172.21.15.137:0/3196789654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50b00afbc0 0x7f50b014e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.371+0000 7f50b7600640 1 -- 172.21.15.137:0/3196789654 >> 172.21.15.137:0/3196789654 conn(0x7f50b006c800 msgr2=0x7f50b00ccf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:59.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.371+0000 7f50b7600640 1 -- 172.21.15.137:0/3196789654 shutdown_connections 2024-04-26T23:42:59.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.371+0000 7f50b7600640 1 -- 172.21.15.137:0/3196789654 wait complete. 2024-04-26T23:42:59.399 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:42:59.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.527+0000 7fd202c00640 1 Processor -- start 2024-04-26T23:42:59.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.527+0000 7fd202c00640 1 -- start start 2024-04-26T23:42:59.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.531+0000 7fd202c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd1fc15de80 0x7fd1fc073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:59.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.531+0000 7fd202c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd1fc0ce7c0 0x7fd1fc146210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:59.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.531+0000 7fd202c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1fc073010 con 0x7fd1fc0ce3e0 2024-04-26T23:42:59.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.531+0000 7fd202c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd1fc0cef90 con 0x7fd1fc0ce7c0 2024-04-26T23:42:59.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.531+0000 7fd202c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fd1fc073280 con 0x7fd1fc15de80 2024-04-26T23:42:59.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.531+0000 7fd200c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd1fc0ce7c0 0x7fd1fc146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:59.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.531+0000 7fd200c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd1fc0ce7c0 0x7fd1fc146210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34400/0 (socket says 172.21.15.137:34400) 2024-04-26T23:42:59.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.531+0000 7fd200c00640 1 -- 172.21.15.137:0/988339197 learned_addr learned my addr 172.21.15.137:0/988339197 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:59.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.531+0000 7fd1f3400640 1 --2- 172.21.15.137:0/988339197 >> v2:172.21.15.170:3300/0 conn(0x7fd1fc15de80 0x7fd1fc073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:59.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.531+0000 7fd200c00640 1 -- 172.21.15.137:0/988339197 >> v2:172.21.15.170:3300/0 conn(0x7fd1fc15de80 msgr2=0x7fd1fc073d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:59.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.531+0000 7fd200c00640 1 --2- 172.21.15.137:0/988339197 >> v2:172.21.15.170:3300/0 conn(0x7fd1fc15de80 0x7fd1fc073d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.531+0000 7fd200c00640 1 -- 172.21.15.137:0/988339197 >> v1:172.21.15.170:6789/0 conn(0x7fd1fc0ce3e0 legacy=0x7fd1fc0d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:59.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.531+0000 7fd200c00640 1 -- 172.21.15.137:0/988339197 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1fc073560 con 0x7fd1fc0ce7c0 2024-04-26T23:42:59.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.531+0000 7fd200c00640 1 --2- 172.21.15.137:0/988339197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1fc0ce7c0 0x7fd1fc146210 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009e50 tx=0x7fd1f401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d46e51fbdbf0187 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:59.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd1fb400640 1 -- 172.21.15.137:0/988339197 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f40a5750 con 0x7fd1fc0ce7c0 2024-04-26T23:42:59.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd1fb400640 1 -- 172.21.15.137:0/988339197 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f40a58f0 con 0x7fd1fc0ce7c0 2024-04-26T23:42:59.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd1fb400640 1 -- 172.21.15.137:0/988339197 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f40a5cc0 con 0x7fd1fc0ce7c0 2024-04-26T23:42:59.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd202c00640 1 -- 172.21.15.137:0/988339197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1fc0ce7c0 msgr2=0x7fd1fc146210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:59.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd202c00640 1 --2- 172.21.15.137:0/988339197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1fc0ce7c0 0x7fd1fc146210 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009e50 tx=0x7fd1f401c980 comp rx=0 tx=0).stop 2024-04-26T23:42:59.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd202c00640 1 -- 172.21.15.137:0/988339197 shutdown_connections 2024-04-26T23:42:59.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd202c00640 1 --2- 172.21.15.137:0/988339197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1fc0ce7c0 0x7fd1fc146210 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd202c00640 1 --2- 172.21.15.137:0/988339197 >> v2:172.21.15.170:3300/0 conn(0x7fd1fc15de80 0x7fd1fc073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd202c00640 1 -- 172.21.15.137:0/988339197 >> 172.21.15.137:0/988339197 conn(0x7fd1fc06c5d0 msgr2=0x7fd1fc06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:59.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd202c00640 1 -- 172.21.15.137:0/988339197 shutdown_connections 2024-04-26T23:42:59.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd202c00640 1 -- 172.21.15.137:0/988339197 wait complete. 2024-04-26T23:42:59.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd202c00640 1 Processor -- start 2024-04-26T23:42:59.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd202c00640 1 -- start start 2024-04-26T23:42:59.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd202c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1fc0ce3e0 0x7fd1fc13f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:59.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd202c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1fc0ce7c0 0x7fd1fc1412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:59.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd202c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1fc15de80 0x7fd1fc141820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:59.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd202c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd1fc06f0a0 con 0x7fd1fc15de80 2024-04-26T23:42:59.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd202c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd1fc06ef20 con 0x7fd1fc0ce3e0 2024-04-26T23:42:59.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd202c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd1fc06f220 con 0x7fd1fc0ce7c0 2024-04-26T23:42:59.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd200c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1fc15de80 0x7fd1fc141820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:59.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd200c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1fc15de80 0x7fd1fc141820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34408/0 (socket says 172.21.15.137:34408) 2024-04-26T23:42:59.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd200c00640 1 -- 172.21.15.137:0/1784799851 learned_addr learned my addr 172.21.15.137:0/1784799851 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:42:59.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd1f3400640 1 --2- 172.21.15.137:0/1784799851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1fc0ce7c0 0x7fd1fc1412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:59.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.535+0000 7fd1fbe00640 1 --2- 172.21.15.137:0/1784799851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1fc0ce3e0 0x7fd1fc13f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:59.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.539+0000 7fd200c00640 1 -- 172.21.15.137:0/1784799851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1fc0ce7c0 msgr2=0x7fd1fc1412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:59.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.539+0000 7fd200c00640 1 --2- 172.21.15.137:0/1784799851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1fc0ce7c0 0x7fd1fc1412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.539+0000 7fd200c00640 1 -- 172.21.15.137:0/1784799851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1fc0ce3e0 msgr2=0x7fd1fc13f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:59.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.539+0000 7fd200c00640 1 --2- 172.21.15.137:0/1784799851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1fc0ce3e0 0x7fd1fc13f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.539+0000 7fd200c00640 1 -- 172.21.15.137:0/1784799851 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1fc142060 con 0x7fd1fc15de80 2024-04-26T23:42:59.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.539+0000 7fd1fbe00640 1 --2- 172.21.15.137:0/1784799851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1fc0ce3e0 0x7fd1fc13f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:42:59.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.539+0000 7fd200c00640 1 --2- 172.21.15.137:0/1784799851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1fc15de80 0x7fd1fc141820 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd1f401a5b0 tx=0x7fd1f4019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:59.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.539+0000 7fd1f8c00640 1 -- 172.21.15.137:0/1784799851 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f40bc020 con 0x7fd1fc15de80 2024-04-26T23:42:59.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.539+0000 7fd1f8c00640 1 -- 172.21.15.137:0/1784799851 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f40b8670 con 0x7fd1fc15de80 2024-04-26T23:42:59.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.539+0000 7fd1f8c00640 1 -- 172.21.15.137:0/1784799851 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f40b8a20 con 0x7fd1fc15de80 2024-04-26T23:42:59.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.539+0000 7fd202c00640 1 -- 172.21.15.137:0/1784799851 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1fc142340 con 0x7fd1fc15de80 2024-04-26T23:42:59.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.539+0000 7fd202c00640 1 -- 172.21.15.137:0/1784799851 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1fc142900 con 0x7fd1fc15de80 2024-04-26T23:42:59.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.539+0000 7fd202c00640 1 -- 172.21.15.137:0/1784799851 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1fc06a4b0 con 0x7fd1fc15de80 2024-04-26T23:42:59.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.539+0000 7fd1f8c00640 1 -- 172.21.15.137:0/1784799851 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd1f40bf020 con 0x7fd1fc15de80 2024-04-26T23:42:59.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.539+0000 7fd1f8c00640 1 --2- 172.21.15.137:0/1784799851 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd1d8068380 0x7fd1d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:59.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.539+0000 7fd1f8c00640 1 -- 172.21.15.137:0/1784799851 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fd1f4121a40 con 0x7fd1fc15de80 2024-04-26T23:42:59.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.539+0000 7fd1fbe00640 1 --2- 172.21.15.137:0/1784799851 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd1d8068380 0x7fd1d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:59.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.543+0000 7fd1fbe00640 1 --2- 172.21.15.137:0/1784799851 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd1d8068380 0x7fd1d806a840 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec00a850 tx=0x7fd1ec008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:59.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.543+0000 7fd1f8c00640 1 -- 172.21.15.137:0/1784799851 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd1f40c6030 con 0x7fd1fc15de80 2024-04-26T23:42:59.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.715+0000 7fd202c00640 1 -- 172.21.15.137:0/1784799851 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd1fc141d60 con 0x7fd1fc15de80 2024-04-26T23:42:59.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.715+0000 7fd1f8c00640 1 -- 172.21.15.137:0/1784799851 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7fd1f40165a0 con 0x7fd1fc15de80 2024-04-26T23:42:59.722 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T23:42:59.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.719+0000 7fd202c00640 1 -- 172.21.15.137:0/1784799851 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd1d8068380 msgr2=0x7fd1d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:59.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.719+0000 7fd202c00640 1 --2- 172.21.15.137:0/1784799851 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd1d8068380 0x7fd1d806a840 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec00a850 tx=0x7fd1ec008040 comp rx=0 tx=0).stop 2024-04-26T23:42:59.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.719+0000 7fd202c00640 1 -- 172.21.15.137:0/1784799851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1fc15de80 msgr2=0x7fd1fc141820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:59.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.719+0000 7fd202c00640 1 --2- 172.21.15.137:0/1784799851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1fc15de80 0x7fd1fc141820 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd1f401a5b0 tx=0x7fd1f4019720 comp rx=0 tx=0).stop 2024-04-26T23:42:59.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.719+0000 7fd202c00640 1 -- 172.21.15.137:0/1784799851 shutdown_connections 2024-04-26T23:42:59.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.719+0000 7fd202c00640 1 --2- 172.21.15.137:0/1784799851 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd1d8068380 0x7fd1d806a840 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.719+0000 7fd202c00640 1 --2- 172.21.15.137:0/1784799851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1fc15de80 0x7fd1fc141820 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.719+0000 7fd202c00640 1 --2- 172.21.15.137:0/1784799851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1fc0ce7c0 0x7fd1fc1412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.719+0000 7fd202c00640 1 --2- 172.21.15.137:0/1784799851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1fc0ce3e0 0x7fd1fc13f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.719+0000 7fd202c00640 1 -- 172.21.15.137:0/1784799851 >> 172.21.15.137:0/1784799851 conn(0x7fd1fc06c5d0 msgr2=0x7fd1fc15e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:59.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.719+0000 7fd202c00640 1 -- 172.21.15.137:0/1784799851 shutdown_connections 2024-04-26T23:42:59.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:42:59.719+0000 7fd202c00640 1 -- 172.21.15.137:0/1784799851 wait complete. 2024-04-26T23:42:59.745 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi137.front.sepia.ceph.com... 2024-04-26T23:42:59.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:42:59.745 DEBUG:teuthology.orchestra.run.smithi137:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-26T23:42:59.762 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:ceph-fuse[38586]: fuse finished with error 0 and tester_r 0 2024-04-26T23:42:59.765 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:43:05.867 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T23:43:05.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:05.867 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T23:43:05.878 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json perf dump 2024-04-26T23:43:06.044 INFO:teuthology.orchestra.run.smithi170.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":30,"msgr_send_messages":32,"msgr_recv_bytes":8021,"msgr_send_bytes":17176,"msgr_created_connections":7,"msgr_active_connections":2,"msgr_running_total_time":0.010475416,"msgr_running_send_time":0.000856138,"msgr_running_recv_time":0.004210227,"msgr_running_fast_dispatch_time":0.001098400,"msgr_send_messages_queue_lat":{"avgcount":30,"sum":0.110207114,"avgtime":0.003673570},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":96,"msgr_send_messages":80,"msgr_recv_bytes":122620,"msgr_send_bytes":45756,"msgr_created_connections":8,"msgr_active_connections":3,"msgr_running_total_time":0.015751774,"msgr_running_send_time":0.003440387,"msgr_running_recv_time":0.016427281,"msgr_running_fast_dispatch_time":0.000991594,"msgr_send_messages_queue_lat":{"avgcount":80,"sum":0.056669844,"avgtime":0.000708373},"msgr_handle_ack_lat":{"avgcount":32,"sum":0.000005176,"avgtime":0.000000161},"msgr_recv_encrypted_bytes":114736,"msgr_send_encrypted_bytes":16672},"AsyncMessenger::Worker-2":{"msgr_recv_messages":31,"msgr_send_messages":29,"msgr_recv_bytes":9685,"msgr_send_bytes":84099,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.009053701,"msgr_running_send_time":0.002601130,"msgr_running_recv_time":0.004770740,"msgr_running_fast_dispatch_time":0.001229533,"msgr_send_messages_queue_lat":{"avgcount":28,"sum":0.026971859,"avgtime":0.000963280},"msgr_handle_ack_lat":{"avgcount":22,"sum":0.000015278,"avgtime":0.000000694},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":72320},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":40,"sum":0.002776516,"avgtime":0.000069412}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000025884,"avgtime":0.000012942}},"mds":{"request":4,"reply":4,"reply_latency":{"avgcount":4,"sum":0.001155661,"avgtime":0.000288915},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":0,"caps":0,"subtrees":2,"traverse":7,"traverse_hit":7,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":9,"evex":0,"evtrm":0,"ev":9,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197805,"rdpos":0,"jlat":{"avgcount":7,"sum":0.015616910,"avgtime":0.002230987},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":0,"cap+":3,"cap-":3,"rss":42968,"heap":231732},"mds_server":{"dispatch_client_request":4,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":12,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":3,"sum":0.000747778,"avgtime":0.000249259},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000407883,"avgtime":0.000407883},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":3,"session_remove":3,"sessions_open":0,"sessions_stale":0,"total_load":3,"average_load":3,"avg_session_uptime":1,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":221723,"buffer_anon_items":65,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5312,"osdmap_items":75,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":52352,"mds_co_items":211,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":46,"op_send_bytes":14711,"op_resend":37,"op_reply":46,"op_latency":{"avgcount":46,"sum":1.119982175,"avgtime":0.024347438},"op_inflight":0,"oplen_avg":{"avgcount":46,"sum":70},"op":46,"op_r":0,"op_w":46,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":7,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":33,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":152,"get_sum":121871,"get_or_fail_fail":0,"get_or_fail_success":152,"take":0,"take_sum":0,"put":152,"put_sum":121871,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":46,"take_sum":14711,"put":46,"put_sum":14711,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":46,"take_sum":46,"put":46,"put_sum":46,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55bea5242780":{"val":0,"max":3758096384,"get_started":0,"get":9,"get_sum":3501,"get_or_fail_fail":0,"get_or_fail_success":9,"take":0,"take_sum":0,"put":7,"put_sum":3501,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-04-26T23:43:06.046 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 8021, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 30, "msgr_running_fast_dispatch_time": 0.0010984, "msgr_running_recv_time": 0.004210227, "msgr_running_send_time": 0.000856138, "msgr_running_total_time": 0.010475416, "msgr_send_bytes": 17176, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 32, "msgr_send_messages_queue_lat": { "avgcount": 30, "avgtime": 0.00367357, "sum": 0.110207114 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 32, "avgtime": 1.61e-07, "sum": 5.176e-06 }, "msgr_recv_bytes": 122620, "msgr_recv_encrypted_bytes": 114736, "msgr_recv_messages": 96, "msgr_running_fast_dispatch_time": 0.000991594, "msgr_running_recv_time": 0.016427281, "msgr_running_send_time": 0.003440387, "msgr_running_total_time": 0.015751774, "msgr_send_bytes": 45756, "msgr_send_encrypted_bytes": 16672, "msgr_send_messages": 80, "msgr_send_messages_queue_lat": { "avgcount": 80, "avgtime": 0.000708373, "sum": 0.056669844 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 22, "avgtime": 6.94e-07, "sum": 1.5278e-05 }, "msgr_recv_bytes": 9685, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 31, "msgr_running_fast_dispatch_time": 0.001229533, "msgr_running_recv_time": 0.00477074, "msgr_running_send_time": 0.00260113, "msgr_running_total_time": 0.009053701, "msgr_send_bytes": 84099, "msgr_send_encrypted_bytes": 72320, "msgr_send_messages": 29, "msgr_send_messages_queue_lat": { "avgcount": 28, "avgtime": 0.00096328, "sum": 0.026971859 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 40, "avgtime": 6.9412e-05, "sum": 0.002776516 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 1.2942e-05, "sum": 2.5884e-05 }, "queue_len": 0 }, "mds": { "caps": 0, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 0, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 4, "reply_latency": { "avgcount": 4, "avgtime": 0.000288915, "sum": 0.001155661 }, "request": 4, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 7, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 7, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 9, "evadd": 9, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 7, "avgtime": 0.002230987, "sum": 0.01561691 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4197805 }, "mds_mem": { "cap": 0, "cap+": 3, "cap-": 3, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 231732, "ino": 13, "ino+": 13, "ino-": 0, "rss": 42968 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 4, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 12, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 3, "avgtime": 0.000249259, "sum": 0.000747778 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000407883, "sum": 0.000407883 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 3, "avg_session_uptime": 1, "mdthresh_evicted": 0, "session_add": 3, "session_count": 0, "session_remove": 3, "sessions_open": 0, "sessions_stale": 0, "total_load": 3 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 221723, "buffer_anon_items": 65, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 52352, "mds_co_items": 211, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5312, "osdmap_items": 75, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 33, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 46, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 46, "avgtime": 0.024347438, "sum": 1.119982175 }, "op_pg": 0, "op_r": 0, "op_reply": 46, "op_resend": 37, "op_rmw": 0, "op_send": 46, "op_send_bytes": 14711, "op_w": 46, "oplen_avg": { "avgcount": 46, "sum": 70 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 7, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 152, "get_or_fail_fail": 0, "get_or_fail_success": 152, "get_started": 0, "get_sum": 121871, "max": 104857600, "put": 152, "put_sum": 121871, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 46, "put_sum": 14711, "take": 46, "take_sum": 14711, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 46, "put_sum": 46, "take": 46, "take_sum": 46, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55bea5242780": { "get": 9, "get_or_fail_fail": 0, "get_or_fail_success": 9, "get_started": 0, "get_sum": 3501, "max": 3758096384, "put": 7, "put_sum": 3501, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-04-26T23:43:06.046 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-26T23:43:06.046 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T23:43:06.046 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:43:06.130 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:43:06.216 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T23:43:06.216 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:43:06.216 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:43:06.216 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:43:06.225 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4511 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:43:06.225 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:43:06.225 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:43:06.226 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:43:06.234 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4843 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:43:06.235 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:43:06.235 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:43:06.235 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:43:06.275 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4511 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:43:06.276 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:43:06.276 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:43:06.276 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:43:06.288 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4843 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:43:06.289 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:43:06.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.455+0000 7f6683a00640 1 Processor -- start 2024-04-26T23:43:06.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.455+0000 7f6683a00640 1 -- start start 2024-04-26T23:43:06.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.455+0000 7f6683a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f667c0ce3e0 0x7f667c073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:06.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.455+0000 7f6683a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f667c15de80 0x7f667c0d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:06.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.455+0000 7f6683a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f667c073010 con 0x7f667c0ce7c0 2024-04-26T23:43:06.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.455+0000 7f6683a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f667c0cef90 con 0x7f667c0ce3e0 2024-04-26T23:43:06.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.455+0000 7f6683a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f667c073280 con 0x7f667c15de80 2024-04-26T23:43:06.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.455+0000 7f6681000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f667c0ce3e0 0x7f667c073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:06.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.455+0000 7f6681a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f667c0ce7c0 0x7f667c146210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55156/0 (socket says 172.21.15.137:55156) 2024-04-26T23:43:06.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.455+0000 7f6681a00640 1 -- 172.21.15.137:0/1939003901 learned_addr learned my addr 172.21.15.137:0/1939003901 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:06.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.455+0000 7f6673e00640 1 --2- 172.21.15.137:0/1939003901 >> v2:172.21.15.170:3300/0 conn(0x7f667c15de80 0x7f667c0d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:06.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.459+0000 7f6681000640 1 -- 172.21.15.137:0/1939003901 >> v2:172.21.15.170:3300/0 conn(0x7f667c15de80 msgr2=0x7f667c0d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:06.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.459+0000 7f6681000640 1 --2- 172.21.15.137:0/1939003901 >> v2:172.21.15.170:3300/0 conn(0x7f667c15de80 0x7f667c0d04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:06.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.459+0000 7f6681000640 1 -- 172.21.15.137:0/1939003901 >> v1:172.21.15.137:6789/0 conn(0x7f667c0ce7c0 legacy=0x7f667c146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:06.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.459+0000 7f6681000640 1 -- 172.21.15.137:0/1939003901 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f667c073560 con 0x7f667c0ce3e0 2024-04-26T23:43:06.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.459+0000 7f667be00640 1 -- 172.21.15.137:0/1939003901 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1681510315 0 0) 0x7f667c073010 con 0x7f667c0ce7c0 2024-04-26T23:43:06.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.459+0000 7f6681000640 1 --2- 172.21.15.137:0/1939003901 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f667c0ce3e0 0x7f667c073d60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f666c0097c0 tx=0x7f666c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8720a2f342d3c964 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:06.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.459+0000 7f667be00640 1 -- 172.21.15.137:0/1939003901 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666c0ab650 con 0x7f667c0ce3e0 2024-04-26T23:43:06.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.459+0000 7f667be00640 1 -- 172.21.15.137:0/1939003901 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f666c0b0070 con 0x7f667c0ce3e0 2024-04-26T23:43:06.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.459+0000 7f667be00640 1 -- 172.21.15.137:0/1939003901 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666c0aba10 con 0x7f667c0ce3e0 2024-04-26T23:43:06.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.459+0000 7f6683a00640 1 -- 172.21.15.137:0/1939003901 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f667c0ce3e0 msgr2=0x7f667c073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:06.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.459+0000 7f6683a00640 1 --2- 172.21.15.137:0/1939003901 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f667c0ce3e0 0x7f667c073d60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f666c0097c0 tx=0x7f666c01c430 comp rx=0 tx=0).stop 2024-04-26T23:43:06.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.459+0000 7f6683a00640 1 -- 172.21.15.137:0/1939003901 shutdown_connections 2024-04-26T23:43:06.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.459+0000 7f6683a00640 1 --2- 172.21.15.137:0/1939003901 >> v2:172.21.15.170:3300/0 conn(0x7f667c15de80 0x7f667c0d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:06.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.459+0000 7f6683a00640 1 --2- 172.21.15.137:0/1939003901 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f667c0ce3e0 0x7f667c073d60 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:06.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.459+0000 7f6683a00640 1 -- 172.21.15.137:0/1939003901 >> 172.21.15.137:0/1939003901 conn(0x7f667c06c5d0 msgr2=0x7f667c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:06.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6683a00640 1 -- 172.21.15.137:0/1939003901 shutdown_connections 2024-04-26T23:43:06.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6683a00640 1 -- 172.21.15.137:0/1939003901 wait complete. 2024-04-26T23:43:06.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6683a00640 1 Processor -- start 2024-04-26T23:43:06.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6683a00640 1 -- start start 2024-04-26T23:43:06.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6683a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f667c0ce3e0 0x7f667c13fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:06.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6683a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f667c0ce7c0 0x7f667c0b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:06.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6683a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f667c15de80 0x7f667c0ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:06.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6683a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f667c146aa0 con 0x7f667c0ce7c0 2024-04-26T23:43:06.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6683a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f667c146920 con 0x7f667c15de80 2024-04-26T23:43:06.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6683a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f667c06ed10 con 0x7f667c0ce3e0 2024-04-26T23:43:06.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6673e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f667c0ce7c0 0x7f667c0b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:06.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6673e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f667c0ce7c0 0x7f667c0b1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41338/0 (socket says 172.21.15.137:41338) 2024-04-26T23:43:06.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6673e00640 1 -- 172.21.15.137:0/1508203164 learned_addr learned my addr 172.21.15.137:0/1508203164 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:06.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6681000640 1 --2- 172.21.15.137:0/1508203164 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f667c0ce3e0 0x7f667c13fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:06.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6681a00640 1 --2- 172.21.15.137:0/1508203164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f667c15de80 0x7f667c0ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:06.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6673e00640 1 -- 172.21.15.137:0/1508203164 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f667c0ce3e0 msgr2=0x7f667c13fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:06.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6673e00640 1 --2- 172.21.15.137:0/1508203164 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f667c0ce3e0 0x7f667c13fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:06.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6673e00640 1 -- 172.21.15.137:0/1508203164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f667c15de80 msgr2=0x7f667c0ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:06.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6673e00640 1 --2- 172.21.15.137:0/1508203164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f667c15de80 0x7f667c0ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:06.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6673e00640 1 -- 172.21.15.137:0/1508203164 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f667c1406e0 con 0x7f667c0ce7c0 2024-04-26T23:43:06.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6673e00640 1 --2- 172.21.15.137:0/1508203164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f667c0ce7c0 0x7f667c0b1040 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f666400d7d0 tx=0x7f666400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:06.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6679600640 1 -- 172.21.15.137:0/1508203164 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666400b6c0 con 0x7f667c0ce7c0 2024-04-26T23:43:06.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6679600640 1 -- 172.21.15.137:0/1508203164 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6664019070 con 0x7f667c0ce7c0 2024-04-26T23:43:06.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6683a00640 1 -- 172.21.15.137:0/1508203164 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f667c1409c0 con 0x7f667c0ce7c0 2024-04-26T23:43:06.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.463+0000 7f6679600640 1 -- 172.21.15.137:0/1508203164 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666400ba80 con 0x7f667c0ce7c0 2024-04-26T23:43:06.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.467+0000 7f6683a00640 1 -- 172.21.15.137:0/1508203164 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f667c140f80 con 0x7f667c0ce7c0 2024-04-26T23:43:06.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.467+0000 7f6683a00640 1 -- 172.21.15.137:0/1508203164 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f667c06a4b0 con 0x7f667c0ce7c0 2024-04-26T23:43:06.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.467+0000 7f6679600640 1 -- 172.21.15.137:0/1508203164 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f666400bc20 con 0x7f667c0ce7c0 2024-04-26T23:43:06.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.467+0000 7f6679600640 1 --2- 172.21.15.137:0/1508203164 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66580683b0 0x7f665806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:06.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.467+0000 7f6679600640 1 -- 172.21.15.137:0/1508203164 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f6664086cc0 con 0x7f667c0ce7c0 2024-04-26T23:43:06.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.467+0000 7f6681000640 1 --2- 172.21.15.137:0/1508203164 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66580683b0 0x7f665806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:06.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.467+0000 7f6681000640 1 --2- 172.21.15.137:0/1508203164 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66580683b0 0x7f665806a870 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f666c0af000 tx=0x7f666c0a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:06.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.471+0000 7f6679600640 1 -- 172.21.15.137:0/1508203164 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6664056b90 con 0x7f667c0ce7c0 2024-04-26T23:43:06.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.663+0000 7f6683a00640 1 -- 172.21.15.137:0/1508203164 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f667c15ede0 con 0x7f667c0ce7c0 2024-04-26T23:43:06.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.663+0000 7f6679600640 1 -- 172.21.15.137:0/1508203164 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5198 (secure 0 0 0) 0x7f666405ae90 con 0x7f667c0ce7c0 2024-04-26T23:43:06.670 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:06.670 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1345232353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1345232353},{"type":"v1","addr":"172.21.15.137:6836","nonce":1345232353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1274585662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1274585662},{"type":"v1","addr":"172.21.15.137:6837","nonce":1274585662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4079333736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4079333736},{"type":"v1","addr":"172.21.15.170:6834","nonce":4079333736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:42:24.865468+0000","modified":"2024-04-26T23:42:27.876394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34808},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34808":{"gid":34808,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/3364296586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3364296586},{"type":"v1","addr":"172.21.15.170:6835","nonce":3364296586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34808,"qdb_cluster":[34808]},"id":2}]} 2024-04-26T23:43:06.671 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 17 2024-04-26T23:43:06.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.663+0000 7f6683a00640 1 -- 172.21.15.137:0/1508203164 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66580683b0 msgr2=0x7f665806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:06.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.663+0000 7f6683a00640 1 --2- 172.21.15.137:0/1508203164 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66580683b0 0x7f665806a870 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f666c0af000 tx=0x7f666c0a7000 comp rx=0 tx=0).stop 2024-04-26T23:43:06.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.663+0000 7f6683a00640 1 -- 172.21.15.137:0/1508203164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f667c0ce7c0 msgr2=0x7f667c0b1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:06.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.663+0000 7f6683a00640 1 --2- 172.21.15.137:0/1508203164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f667c0ce7c0 0x7f667c0b1040 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f666400d7d0 tx=0x7f666400dc90 comp rx=0 tx=0).stop 2024-04-26T23:43:06.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.667+0000 7f6683a00640 1 -- 172.21.15.137:0/1508203164 shutdown_connections 2024-04-26T23:43:06.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.667+0000 7f6683a00640 1 --2- 172.21.15.137:0/1508203164 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66580683b0 0x7f665806a870 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:06.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.667+0000 7f6683a00640 1 --2- 172.21.15.137:0/1508203164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f667c0ce7c0 0x7f667c0b1040 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:06.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.667+0000 7f6683a00640 1 --2- 172.21.15.137:0/1508203164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f667c15de80 0x7f667c0ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:06.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.667+0000 7f6683a00640 1 --2- 172.21.15.137:0/1508203164 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f667c0ce3e0 0x7f667c13fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:06.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.667+0000 7f6683a00640 1 -- 172.21.15.137:0/1508203164 >> 172.21.15.137:0/1508203164 conn(0x7f667c06c5d0 msgr2=0x7f667c06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:06.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.667+0000 7f6683a00640 1 -- 172.21.15.137:0/1508203164 shutdown_connections 2024-04-26T23:43:06.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.667+0000 7f6683a00640 1 -- 172.21.15.137:0/1508203164 wait complete. 2024-04-26T23:43:06.691 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:43:06.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.823+0000 7fd553200640 1 Processor -- start 2024-04-26T23:43:06.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.823+0000 7fd553200640 1 -- start start 2024-04-26T23:43:06.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.823+0000 7fd553200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd54c15ced0 0x7fd54c0d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:06.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.823+0000 7fd553200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd54c15d2b0 0x7fd54c0d18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:06.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.823+0000 7fd553200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54c0b1b30 con 0x7fd54c0b0d90 2024-04-26T23:43:06.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.823+0000 7fd553200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd54c0b18f0 con 0x7fd54c15d2b0 2024-04-26T23:43:06.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.823+0000 7fd553200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fd54c0b1e10 con 0x7fd54c15ced0 2024-04-26T23:43:06.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.823+0000 7fd54b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd54c15d2b0 0x7fd54c0d18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:06.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.823+0000 7fd54b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd54c15d2b0 0x7fd54c0d18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41346/0 (socket says 172.21.15.137:41346) 2024-04-26T23:43:06.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.823+0000 7fd54b400640 1 -- 172.21.15.137:0/205914028 learned_addr learned my addr 172.21.15.137:0/205914028 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:06.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.823+0000 7fd54be00640 1 --2- 172.21.15.137:0/205914028 >> v2:172.21.15.170:3300/0 conn(0x7fd54c15ced0 0x7fd54c0d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:06.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.823+0000 7fd54b400640 1 -- 172.21.15.137:0/205914028 >> v2:172.21.15.170:3300/0 conn(0x7fd54c15ced0 msgr2=0x7fd54c0d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:06.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.823+0000 7fd54b400640 1 --2- 172.21.15.137:0/205914028 >> v2:172.21.15.170:3300/0 conn(0x7fd54c15ced0 0x7fd54c0d13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:06.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.823+0000 7fd54b400640 1 -- 172.21.15.137:0/205914028 >> v1:172.21.15.170:6789/0 conn(0x7fd54c0b0d90 legacy=0x7fd54c0b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:06.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.823+0000 7fd54b400640 1 -- 172.21.15.137:0/205914028 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54c0b23f0 con 0x7fd54c15d2b0 2024-04-26T23:43:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.827+0000 7fd54b400640 1 --2- 172.21.15.137:0/205914028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd54c15d2b0 0x7fd54c0d18f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0d0880 tx=0x7fd53801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba525a4c80060bec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.827+0000 7fd54aa00640 1 -- 172.21.15.137:0/205914028 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5380ab430 con 0x7fd54c15d2b0 2024-04-26T23:43:06.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.827+0000 7fd54aa00640 1 -- 172.21.15.137:0/205914028 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5380b0070 con 0x7fd54c15d2b0 2024-04-26T23:43:06.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.827+0000 7fd54aa00640 1 -- 172.21.15.137:0/205914028 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5380ab7f0 con 0x7fd54c15d2b0 2024-04-26T23:43:06.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.827+0000 7fd553200640 1 -- 172.21.15.137:0/205914028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd54c15d2b0 msgr2=0x7fd54c0d18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:06.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.827+0000 7fd553200640 1 --2- 172.21.15.137:0/205914028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd54c15d2b0 0x7fd54c0d18f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0d0880 tx=0x7fd53801c520 comp rx=0 tx=0).stop 2024-04-26T23:43:06.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.827+0000 7fd553200640 1 -- 172.21.15.137:0/205914028 shutdown_connections 2024-04-26T23:43:06.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.827+0000 7fd553200640 1 --2- 172.21.15.137:0/205914028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd54c15d2b0 0x7fd54c0d18f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:06.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.827+0000 7fd553200640 1 --2- 172.21.15.137:0/205914028 >> v2:172.21.15.170:3300/0 conn(0x7fd54c15ced0 0x7fd54c0d13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:06.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.827+0000 7fd553200640 1 -- 172.21.15.137:0/205914028 >> 172.21.15.137:0/205914028 conn(0x7fd54c09ba60 msgr2=0x7fd54c09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:06.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.827+0000 7fd553200640 1 -- 172.21.15.137:0/205914028 shutdown_connections 2024-04-26T23:43:06.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.827+0000 7fd553200640 1 -- 172.21.15.137:0/205914028 wait complete. 2024-04-26T23:43:06.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd553200640 1 Processor -- start 2024-04-26T23:43:06.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd553200640 1 -- start start 2024-04-26T23:43:06.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd553200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd54c0b0d90 0x7fd54c0c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:06.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd553200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd54c15ced0 0x7fd54c0b8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:06.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd553200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd54c15d2b0 0x7fd54c14b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:06.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd553200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c0b3810 con 0x7fd54c15d2b0 2024-04-26T23:43:06.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd553200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c0b3690 con 0x7fd54c0b0d90 2024-04-26T23:43:06.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd553200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd54c0b3990 con 0x7fd54c15ced0 2024-04-26T23:43:06.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd551200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd54c15d2b0 0x7fd54c14b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:06.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd54b400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd54c15ced0 0x7fd54c0b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:06.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd54be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd54c0b0d90 0x7fd54c0c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:06.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd551200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd54c15d2b0 0x7fd54c14b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41356/0 (socket says 172.21.15.137:41356) 2024-04-26T23:43:06.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd551200640 1 -- 172.21.15.137:0/1967090672 learned_addr learned my addr 172.21.15.137:0/1967090672 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:06.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd551200640 1 -- 172.21.15.137:0/1967090672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd54c15ced0 msgr2=0x7fd54c0b8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:06.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd551200640 1 --2- 172.21.15.137:0/1967090672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd54c15ced0 0x7fd54c0b8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:06.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd551200640 1 -- 172.21.15.137:0/1967090672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd54c0b0d90 msgr2=0x7fd54c0c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:06.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd551200640 1 --2- 172.21.15.137:0/1967090672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd54c0b0d90 0x7fd54c0c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:06.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd551200640 1 -- 172.21.15.137:0/1967090672 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54c0b8910 con 0x7fd54c15d2b0 2024-04-26T23:43:06.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd551200640 1 --2- 172.21.15.137:0/1967090672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd54c15d2b0 0x7fd54c14b060 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd54400c430 tx=0x7fd54400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:06.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd543e00640 1 -- 172.21.15.137:0/1967090672 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544005220 con 0x7fd54c15d2b0 2024-04-26T23:43:06.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd543e00640 1 -- 172.21.15.137:0/1967090672 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5440053c0 con 0x7fd54c15d2b0 2024-04-26T23:43:06.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd543e00640 1 -- 172.21.15.137:0/1967090672 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544007270 con 0x7fd54c15d2b0 2024-04-26T23:43:06.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd553200640 1 -- 172.21.15.137:0/1967090672 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd54c1591d0 con 0x7fd54c15d2b0 2024-04-26T23:43:06.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.831+0000 7fd553200640 1 -- 172.21.15.137:0/1967090672 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd54c158ee0 con 0x7fd54c15d2b0 2024-04-26T23:43:06.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.835+0000 7fd553200640 1 -- 172.21.15.137:0/1967090672 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd54c06a4b0 con 0x7fd54c15d2b0 2024-04-26T23:43:06.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.835+0000 7fd543e00640 1 -- 172.21.15.137:0/1967090672 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd544019020 con 0x7fd54c15d2b0 2024-04-26T23:43:06.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.835+0000 7fd543e00640 1 --2- 172.21.15.137:0/1967090672 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd52c068380 0x7fd52c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:06.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.835+0000 7fd543e00640 1 -- 172.21.15.137:0/1967090672 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fd544085cc0 con 0x7fd54c15d2b0 2024-04-26T23:43:06.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.835+0000 7fd54be00640 1 --2- 172.21.15.137:0/1967090672 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd52c068380 0x7fd52c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:06.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.835+0000 7fd54be00640 1 --2- 172.21.15.137:0/1967090672 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd52c068380 0x7fd52c06a840 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0113e0 tx=0x7fd53c00b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:06.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.839+0000 7fd543e00640 1 -- 172.21.15.137:0/1967090672 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd54408c080 con 0x7fd54c15d2b0 2024-04-26T23:43:07.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.995+0000 7fd553200640 1 -- 172.21.15.137:0/1967090672 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd54c070530 con 0x7fd54c15d2b0 2024-04-26T23:43:07.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.999+0000 7fd543e00640 1 -- 172.21.15.137:0/1967090672 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16717 (secure 0 0 0) 0x7fd544055b90 con 0x7fd54c15d2b0 2024-04-26T23:43:07.004 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:07.004 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":33,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:42:26.483092+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:42:22.570062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:42:23.822598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:43:07.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.999+0000 7fd553200640 1 -- 172.21.15.137:0/1967090672 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd52c068380 msgr2=0x7fd52c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:07.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.999+0000 7fd553200640 1 --2- 172.21.15.137:0/1967090672 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd52c068380 0x7fd52c06a840 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0113e0 tx=0x7fd53c00b040 comp rx=0 tx=0).stop 2024-04-26T23:43:07.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.999+0000 7fd553200640 1 -- 172.21.15.137:0/1967090672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd54c15d2b0 msgr2=0x7fd54c14b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:07.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.999+0000 7fd553200640 1 --2- 172.21.15.137:0/1967090672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd54c15d2b0 0x7fd54c14b060 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd54400c430 tx=0x7fd54400c8f0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.999+0000 7fd553200640 1 -- 172.21.15.137:0/1967090672 shutdown_connections 2024-04-26T23:43:07.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.999+0000 7fd553200640 1 --2- 172.21.15.137:0/1967090672 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd52c068380 0x7fd52c06a840 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.999+0000 7fd553200640 1 --2- 172.21.15.137:0/1967090672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd54c15d2b0 0x7fd54c14b060 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.999+0000 7fd553200640 1 --2- 172.21.15.137:0/1967090672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd54c15ced0 0x7fd54c0b8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.999+0000 7fd553200640 1 --2- 172.21.15.137:0/1967090672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd54c0b0d90 0x7fd54c0c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.999+0000 7fd553200640 1 -- 172.21.15.137:0/1967090672 >> 172.21.15.137:0/1967090672 conn(0x7fd54c09ba60 msgr2=0x7fd54c0b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:07.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.999+0000 7fd553200640 1 -- 172.21.15.137:0/1967090672 shutdown_connections 2024-04-26T23:43:07.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:06.999+0000 7fd553200640 1 -- 172.21.15.137:0/1967090672 wait complete. 2024-04-26T23:43:07.026 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:42:22.570062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:42:23.822598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:43:07.026 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:43:07.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.159+0000 7f1aad600640 1 Processor -- start 2024-04-26T23:43:07.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.159+0000 7f1aad600640 1 -- start start 2024-04-26T23:43:07.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.159+0000 7f1aad600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa80afbc0 0x7f1aa815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:07.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.159+0000 7f1aad600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1aa80affa0 0x7f1aa80ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:07.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.159+0000 7f1aad600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aa8072860 con 0x7f1aa8073f20 2024-04-26T23:43:07.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.159+0000 7f1aad600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f1aa80743b0 con 0x7f1aa80affa0 2024-04-26T23:43:07.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.159+0000 7f1aad600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa8072b00 con 0x7f1aa80afbc0 2024-04-26T23:43:07.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.159+0000 7f1aa7400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1aa80affa0 0x7f1aa80ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:07.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.159+0000 7f1aa6a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa80afbc0 0x7f1aa815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:07.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.159+0000 7f1aa7400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1aa80affa0 0x7f1aa80ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:35594/0 (socket says 172.21.15.137:35594) 2024-04-26T23:43:07.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.159+0000 7f1aa6a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa80afbc0 0x7f1aa815df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:44190/0 (socket says 172.21.15.137:44190) 2024-04-26T23:43:07.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.159+0000 7f1aa7400640 1 -- 172.21.15.137:0/269428927 learned_addr learned my addr 172.21.15.137:0/269428927 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:07.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.159+0000 7f1a9e000640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f1aa8073f20 0x7f1aa80735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:33242/0 (socket says 172.21.15.137:33242) 2024-04-26T23:43:07.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.159+0000 7f1aa7400640 1 -- 172.21.15.137:0/269428927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa80afbc0 msgr2=0x7f1aa815df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:07.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.159+0000 7f1aa7400640 1 --2- 172.21.15.137:0/269428927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa80afbc0 0x7f1aa815df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.159+0000 7f1aa7400640 1 -- 172.21.15.137:0/269428927 >> v1:172.21.15.170:6789/0 conn(0x7f1aa8073f20 legacy=0x7f1aa80735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:07.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.159+0000 7f1aa7400640 1 -- 172.21.15.137:0/269428927 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa8072de0 con 0x7f1aa80affa0 2024-04-26T23:43:07.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.159+0000 7f1aa6a00640 1 --2- 172.21.15.137:0/269428927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa80afbc0 0x7f1aa815df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:43:07.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.163+0000 7f1aa7400640 1 --2- 172.21.15.137:0/269428927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1aa80affa0 0x7f1aa80ce3b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009870 tx=0x7f1aa001c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df623b1ed6a96996 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:07.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.163+0000 7f1aa6000640 1 -- 172.21.15.137:0/269428927 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa00b2070 con 0x7f1aa80affa0 2024-04-26T23:43:07.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.163+0000 7f1aa6000640 1 -- 172.21.15.137:0/269428927 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aa00a9070 con 0x7f1aa80affa0 2024-04-26T23:43:07.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.163+0000 7f1aa6000640 1 -- 172.21.15.137:0/269428927 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa00ad880 con 0x7f1aa80affa0 2024-04-26T23:43:07.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.163+0000 7f1aad600640 1 -- 172.21.15.137:0/269428927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1aa80affa0 msgr2=0x7f1aa80ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:07.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.163+0000 7f1aad600640 1 --2- 172.21.15.137:0/269428927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1aa80affa0 0x7f1aa80ce3b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009870 tx=0x7f1aa001c560 comp rx=0 tx=0).stop 2024-04-26T23:43:07.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.163+0000 7f1aad600640 1 -- 172.21.15.137:0/269428927 shutdown_connections 2024-04-26T23:43:07.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.163+0000 7f1aad600640 1 --2- 172.21.15.137:0/269428927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1aa80affa0 0x7f1aa80ce3b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.163+0000 7f1aad600640 1 --2- 172.21.15.137:0/269428927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa80afbc0 0x7f1aa815df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.163+0000 7f1aad600640 1 -- 172.21.15.137:0/269428927 >> 172.21.15.137:0/269428927 conn(0x7f1aa806c800 msgr2=0x7f1aa806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:07.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.163+0000 7f1aad600640 1 -- 172.21.15.137:0/269428927 shutdown_connections 2024-04-26T23:43:07.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.163+0000 7f1aad600640 1 -- 172.21.15.137:0/269428927 wait complete. 2024-04-26T23:43:07.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1aad600640 1 Processor -- start 2024-04-26T23:43:07.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1aad600640 1 -- start start 2024-04-26T23:43:07.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1aad600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1aa80afbc0 0x7f1aa81555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:07.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1aad600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1aa80affa0 0x7f1aa80b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:07.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1aad600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa8154d30 0x7f1aa80ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:07.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1aad600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa806f3e0 con 0x7f1aa80affa0 2024-04-26T23:43:07.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1aad600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa806f260 con 0x7f1aa80afbc0 2024-04-26T23:43:07.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1aad600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa806f560 con 0x7f1aa8154d30 2024-04-26T23:43:07.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1a9e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1aa80affa0 0x7f1aa80b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:07.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1a9e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1aa80affa0 0x7f1aa80b23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41358/0 (socket says 172.21.15.137:41358) 2024-04-26T23:43:07.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1a9e000640 1 -- 172.21.15.137:0/2838565101 learned_addr learned my addr 172.21.15.137:0/2838565101 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:07.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1aa6a00640 1 --2- 172.21.15.137:0/2838565101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1aa80afbc0 0x7f1aa81555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:07.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1aa7400640 1 --2- 172.21.15.137:0/2838565101 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa8154d30 0x7f1aa80ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:07.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1a9e000640 1 -- 172.21.15.137:0/2838565101 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa8154d30 msgr2=0x7f1aa80ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:07.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1a9e000640 1 --2- 172.21.15.137:0/2838565101 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa8154d30 0x7f1aa80ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1a9e000640 1 -- 172.21.15.137:0/2838565101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1aa80afbc0 msgr2=0x7f1aa81555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:07.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1a9e000640 1 --2- 172.21.15.137:0/2838565101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1aa80afbc0 0x7f1aa81555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1a9e000640 1 -- 172.21.15.137:0/2838565101 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa81fb7e0 con 0x7f1aa80affa0 2024-04-26T23:43:07.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1a9e000640 1 --2- 172.21.15.137:0/2838565101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1aa80affa0 0x7f1aa80b23c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000c450 tx=0x7f1a9000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:07.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1a9f400640 1 -- 172.21.15.137:0/2838565101 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a90018070 con 0x7f1aa80affa0 2024-04-26T23:43:07.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1a9f400640 1 -- 172.21.15.137:0/2838565101 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a90007480 con 0x7f1aa80affa0 2024-04-26T23:43:07.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1a9f400640 1 -- 172.21.15.137:0/2838565101 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a900047f0 con 0x7f1aa80affa0 2024-04-26T23:43:07.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1aad600640 1 -- 172.21.15.137:0/2838565101 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa81fba80 con 0x7f1aa80affa0 2024-04-26T23:43:07.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1aad600640 1 -- 172.21.15.137:0/2838565101 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa8155230 con 0x7f1aa80affa0 2024-04-26T23:43:07.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.167+0000 7f1aad600640 1 -- 172.21.15.137:0/2838565101 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa806a410 con 0x7f1aa80affa0 2024-04-26T23:43:07.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.171+0000 7f1a9f400640 1 -- 172.21.15.137:0/2838565101 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1a90004990 con 0x7f1aa80affa0 2024-04-26T23:43:07.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.171+0000 7f1a9f400640 1 --2- 172.21.15.137:0/2838565101 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1a840683b0 0x7f1a8406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:07.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.171+0000 7f1a9f400640 1 -- 172.21.15.137:0/2838565101 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1a90085af0 con 0x7f1aa80affa0 2024-04-26T23:43:07.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.171+0000 7f1aa6a00640 1 --2- 172.21.15.137:0/2838565101 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1a840683b0 0x7f1a8406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:07.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.171+0000 7f1aa6a00640 1 --2- 172.21.15.137:0/2838565101 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1a840683b0 0x7f1a8406a870 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009bd0 tx=0x7f1a9800b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:07.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.175+0000 7f1a9f400640 1 -- 172.21.15.137:0/2838565101 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1a900559c0 con 0x7f1aa80affa0 2024-04-26T23:43:07.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.331+0000 7f1aad600640 1 -- 172.21.15.137:0/2838565101 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1aa81560b0 con 0x7f1aa80affa0 2024-04-26T23:43:07.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.331+0000 7f1a9f400640 1 -- 172.21.15.137:0/2838565101 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) ==== 93+0+10 (secure 0 0 0) 0x7f1a90059cc0 con 0x7f1aa80affa0 2024-04-26T23:43:07.339 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:43:07.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.335+0000 7f1aad600640 1 -- 172.21.15.137:0/2838565101 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1a840683b0 msgr2=0x7f1a8406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:07.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.335+0000 7f1aad600640 1 --2- 172.21.15.137:0/2838565101 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1a840683b0 0x7f1a8406a870 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009bd0 tx=0x7f1a9800b040 comp rx=0 tx=0).stop 2024-04-26T23:43:07.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.335+0000 7f1aad600640 1 -- 172.21.15.137:0/2838565101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1aa80affa0 msgr2=0x7f1aa80b23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:07.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.335+0000 7f1aad600640 1 --2- 172.21.15.137:0/2838565101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1aa80affa0 0x7f1aa80b23c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000c450 tx=0x7f1a9000c910 comp rx=0 tx=0).stop 2024-04-26T23:43:07.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.335+0000 7f1aad600640 1 -- 172.21.15.137:0/2838565101 shutdown_connections 2024-04-26T23:43:07.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.335+0000 7f1aad600640 1 --2- 172.21.15.137:0/2838565101 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1a840683b0 0x7f1a8406a870 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.335+0000 7f1aad600640 1 --2- 172.21.15.137:0/2838565101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1aa80affa0 0x7f1aa80b23c0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.335+0000 7f1aad600640 1 --2- 172.21.15.137:0/2838565101 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa8154d30 0x7f1aa80ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.335+0000 7f1aad600640 1 --2- 172.21.15.137:0/2838565101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1aa80afbc0 0x7f1aa81555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.335+0000 7f1aad600640 1 -- 172.21.15.137:0/2838565101 >> 172.21.15.137:0/2838565101 conn(0x7f1aa806c800 msgr2=0x7f1aa80b49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:07.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.335+0000 7f1aad600640 1 -- 172.21.15.137:0/2838565101 shutdown_connections 2024-04-26T23:43:07.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.335+0000 7f1aad600640 1 -- 172.21.15.137:0/2838565101 wait complete. 2024-04-26T23:43:07.360 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:43:07.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.491+0000 7f3dc2800640 1 Processor -- start 2024-04-26T23:43:07.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.491+0000 7f3dc2800640 1 -- start start 2024-04-26T23:43:07.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.491+0000 7f3dc2800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dbc06d370 0x7f3dbc0b2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:07.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.491+0000 7f3dc2800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3dbc06c610 0x7f3dbc0cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:07.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.491+0000 7f3dc2800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dbc0d0680 con 0x7f3dbc15f4d0 2024-04-26T23:43:07.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.491+0000 7f3dc2800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3dbc0d0f80 con 0x7f3dbc06c610 2024-04-26T23:43:07.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.491+0000 7f3dc2800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3dbc0cfbb0 con 0x7f3dbc06d370 2024-04-26T23:43:07.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.491+0000 7f3dbbe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3dbc06c610 0x7f3dbc0cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:07.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.491+0000 7f3dbbe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3dbc06c610 0x7f3dbc0cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41360/0 (socket says 172.21.15.137:41360) 2024-04-26T23:43:07.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.491+0000 7f3dbbe00640 1 -- 172.21.15.137:0/54592035 learned_addr learned my addr 172.21.15.137:0/54592035 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:07.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.491+0000 7f3dbaa00640 1 --2- 172.21.15.137:0/54592035 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dbc06d370 0x7f3dbc0b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:07.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.491+0000 7f3dbbe00640 1 -- 172.21.15.137:0/54592035 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dbc06d370 msgr2=0x7f3dbc0b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:07.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.491+0000 7f3dbbe00640 1 --2- 172.21.15.137:0/54592035 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dbc06d370 0x7f3dbc0b2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.491+0000 7f3dbbe00640 1 -- 172.21.15.137:0/54592035 >> v1:172.21.15.170:6789/0 conn(0x7f3dbc15f4d0 legacy=0x7f3dbc06cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:07.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.491+0000 7f3dbbe00640 1 -- 172.21.15.137:0/54592035 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dbc0cfde0 con 0x7f3dbc06c610 2024-04-26T23:43:07.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.495+0000 7f3dbbe00640 1 --2- 172.21.15.137:0/54592035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc06c610 0x7f3dbc0cf670 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009870 tx=0x7f3db401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f99b6bb6b29a1e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:07.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.495+0000 7f3dba000640 1 -- 172.21.15.137:0/54592035 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db40a7070 con 0x7f3dbc06c610 2024-04-26T23:43:07.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.495+0000 7f3dba000640 1 -- 172.21.15.137:0/54592035 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3db40b0070 con 0x7f3dbc06c610 2024-04-26T23:43:07.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.495+0000 7f3dba000640 1 -- 172.21.15.137:0/54592035 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db40ab890 con 0x7f3dbc06c610 2024-04-26T23:43:07.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.495+0000 7f3dc2800640 1 -- 172.21.15.137:0/54592035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc06c610 msgr2=0x7f3dbc0cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:07.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.495+0000 7f3dc2800640 1 --2- 172.21.15.137:0/54592035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc06c610 0x7f3dbc0cf670 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009870 tx=0x7f3db401c560 comp rx=0 tx=0).stop 2024-04-26T23:43:07.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.495+0000 7f3dc2800640 1 -- 172.21.15.137:0/54592035 shutdown_connections 2024-04-26T23:43:07.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.495+0000 7f3dc2800640 1 --2- 172.21.15.137:0/54592035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc06c610 0x7f3dbc0cf670 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.495+0000 7f3dc2800640 1 --2- 172.21.15.137:0/54592035 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dbc06d370 0x7f3dbc0b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.495+0000 7f3dc2800640 1 -- 172.21.15.137:0/54592035 >> 172.21.15.137:0/54592035 conn(0x7f3dbc09ba60 msgr2=0x7f3dbc09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:07.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.495+0000 7f3dc2800640 1 -- 172.21.15.137:0/54592035 shutdown_connections 2024-04-26T23:43:07.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.495+0000 7f3dc2800640 1 -- 172.21.15.137:0/54592035 wait complete. 2024-04-26T23:43:07.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3dc2800640 1 Processor -- start 2024-04-26T23:43:07.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3dc2800640 1 -- start start 2024-04-26T23:43:07.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3dc2800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dbc06c610 0x7f3dbc158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:07.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3dc2800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc06d370 0x7f3dbc159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:07.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3dc2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc15f4d0 0x7f3dbc15b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:07.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3dc2800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc0d2060 con 0x7f3dbc15f4d0 2024-04-26T23:43:07.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3dc2800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc0d1ee0 con 0x7f3dbc06d370 2024-04-26T23:43:07.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3dc2800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3dbc0d21e0 con 0x7f3dbc06c610 2024-04-26T23:43:07.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3dbbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc15f4d0 0x7f3dbc15b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:07.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3dbbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc15f4d0 0x7f3dbc15b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41362/0 (socket says 172.21.15.137:41362) 2024-04-26T23:43:07.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3dbbe00640 1 -- 172.21.15.137:0/1020172916 learned_addr learned my addr 172.21.15.137:0/1020172916 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:07.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3dbb400640 1 --2- 172.21.15.137:0/1020172916 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dbc06c610 0x7f3dbc158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:07.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3dbaa00640 1 --2- 172.21.15.137:0/1020172916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc06d370 0x7f3dbc159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:07.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3dbbe00640 1 -- 172.21.15.137:0/1020172916 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dbc06c610 msgr2=0x7f3dbc158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:07.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3dbbe00640 1 --2- 172.21.15.137:0/1020172916 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dbc06c610 0x7f3dbc158380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3dbbe00640 1 -- 172.21.15.137:0/1020172916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc06d370 msgr2=0x7f3dbc159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:07.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3dbbe00640 1 --2- 172.21.15.137:0/1020172916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc06d370 0x7f3dbc159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3dbbe00640 1 -- 172.21.15.137:0/1020172916 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dbc1537b0 con 0x7f3dbc15f4d0 2024-04-26T23:43:07.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3dbbe00640 1 --2- 172.21.15.137:0/1020172916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc15f4d0 0x7f3dbc15b0b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3db40ad040 tx=0x7f3db401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:07.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3db3400640 1 -- 172.21.15.137:0/1020172916 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db40be5f0 con 0x7f3dbc15f4d0 2024-04-26T23:43:07.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3db3400640 1 -- 172.21.15.137:0/1020172916 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3db40be790 con 0x7f3dbc15f4d0 2024-04-26T23:43:07.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3dc2800640 1 -- 172.21.15.137:0/1020172916 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dbc153a90 con 0x7f3dbc15f4d0 2024-04-26T23:43:07.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3db3400640 1 -- 172.21.15.137:0/1020172916 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db40beb80 con 0x7f3dbc15f4d0 2024-04-26T23:43:07.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.499+0000 7f3dc2800640 1 -- 172.21.15.137:0/1020172916 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dbc154050 con 0x7f3dbc15f4d0 2024-04-26T23:43:07.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.503+0000 7f3dc2800640 1 -- 172.21.15.137:0/1020172916 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dbc06a410 con 0x7f3dbc15f4d0 2024-04-26T23:43:07.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.503+0000 7f3db3400640 1 -- 172.21.15.137:0/1020172916 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3db40b43f0 con 0x7f3dbc15f4d0 2024-04-26T23:43:07.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.503+0000 7f3db3400640 1 --2- 172.21.15.137:0/1020172916 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3d9c068380 0x7f3d9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:07.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.503+0000 7f3db3400640 1 -- 172.21.15.137:0/1020172916 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f3db41215b0 con 0x7f3dbc15f4d0 2024-04-26T23:43:07.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.503+0000 7f3dbb400640 1 --2- 172.21.15.137:0/1020172916 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3d9c068380 0x7f3d9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:07.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.503+0000 7f3dbb400640 1 --2- 172.21.15.137:0/1020172916 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3d9c068380 0x7f3d9c06a840 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3dac001e00 tx=0x7f3dac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:07.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.507+0000 7f3db3400640 1 -- 172.21.15.137:0/1020172916 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3db40c4060 con 0x7f3dbc15f4d0 2024-04-26T23:43:07.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.663+0000 7f3dc2800640 1 -- 172.21.15.137:0/1020172916 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3dbc068dd0 con 0x7f3dbc15f4d0 2024-04-26T23:43:07.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.663+0000 7f3db3400640 1 -- 172.21.15.137:0/1020172916 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) ==== 104+0+11 (secure 0 0 0) 0x7f3db4016150 con 0x7f3dbc15f4d0 2024-04-26T23:43:07.671 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:43:07.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.667+0000 7f3dc2800640 1 -- 172.21.15.137:0/1020172916 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3d9c068380 msgr2=0x7f3d9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:07.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.667+0000 7f3dc2800640 1 --2- 172.21.15.137:0/1020172916 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3d9c068380 0x7f3d9c06a840 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3dac001e00 tx=0x7f3dac009040 comp rx=0 tx=0).stop 2024-04-26T23:43:07.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.667+0000 7f3dc2800640 1 -- 172.21.15.137:0/1020172916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc15f4d0 msgr2=0x7f3dbc15b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:07.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.667+0000 7f3dc2800640 1 --2- 172.21.15.137:0/1020172916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc15f4d0 0x7f3dbc15b0b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3db40ad040 tx=0x7f3db401ada0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.667+0000 7f3dc2800640 1 -- 172.21.15.137:0/1020172916 shutdown_connections 2024-04-26T23:43:07.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.667+0000 7f3dc2800640 1 --2- 172.21.15.137:0/1020172916 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3d9c068380 0x7f3d9c06a840 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.667+0000 7f3dc2800640 1 --2- 172.21.15.137:0/1020172916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc15f4d0 0x7f3dbc15b0b0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.667+0000 7f3dc2800640 1 --2- 172.21.15.137:0/1020172916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc06d370 0x7f3dbc159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.667+0000 7f3dc2800640 1 --2- 172.21.15.137:0/1020172916 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dbc06c610 0x7f3dbc158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.667+0000 7f3dc2800640 1 -- 172.21.15.137:0/1020172916 >> 172.21.15.137:0/1020172916 conn(0x7f3dbc09ba60 msgr2=0x7f3dbc070830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:07.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.667+0000 7f3dc2800640 1 -- 172.21.15.137:0/1020172916 shutdown_connections 2024-04-26T23:43:07.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.667+0000 7f3dc2800640 1 -- 172.21.15.137:0/1020172916 wait complete. 2024-04-26T23:43:07.693 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:43:07.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.827+0000 7fa76ee00640 1 Processor -- start 2024-04-26T23:43:07.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.827+0000 7fa76ee00640 1 -- start start 2024-04-26T23:43:07.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.827+0000 7fa76ee00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa76806ff60 0x7fa768073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:07.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.827+0000 7fa76ee00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa76806ef90 0x7fa7680b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:07.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.827+0000 7fa76ee00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7680b5300 0x7fa76806d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:07.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.827+0000 7fa76ee00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa768163c10 con 0x7fa76806ff60 2024-04-26T23:43:07.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.827+0000 7fa76ee00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fa768074510 con 0x7fa76806ef90 2024-04-26T23:43:07.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.827+0000 7fa76ee00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa7680b14b0 con 0x7fa7680b5300 2024-04-26T23:43:07.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.827+0000 7fa767e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa76806ff60 0x7fa768073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:07.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.827+0000 7fa767e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa76806ff60 0x7fa768073fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41364/0 (socket says 172.21.15.137:41364) 2024-04-26T23:43:07.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.827+0000 7fa767e00640 1 -- 172.21.15.137:0/2910080788 learned_addr learned my addr 172.21.15.137:0/2910080788 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:07.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.827+0000 7fa75f400640 1 --2- 172.21.15.137:0/2910080788 >> v2:172.21.15.170:3300/0 conn(0x7fa76806ef90 0x7fa7680b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:07.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.827+0000 7fa76ce00640 1 --2- 172.21.15.137:0/2910080788 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7680b5300 0x7fa76806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:07.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.827+0000 7fa767e00640 1 -- 172.21.15.137:0/2910080788 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7680b5300 msgr2=0x7fa76806d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:07.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.827+0000 7fa767e00640 1 --2- 172.21.15.137:0/2910080788 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7680b5300 0x7fa76806d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.827+0000 7fa767e00640 1 -- 172.21.15.137:0/2910080788 >> v2:172.21.15.170:3300/0 conn(0x7fa76806ef90 msgr2=0x7fa7680b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:07.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.827+0000 7fa767e00640 1 --2- 172.21.15.137:0/2910080788 >> v2:172.21.15.170:3300/0 conn(0x7fa76806ef90 0x7fa7680b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.827+0000 7fa767e00640 1 -- 172.21.15.137:0/2910080788 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7680b6ac0 con 0x7fa76806ff60 2024-04-26T23:43:07.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.827+0000 7fa75f400640 1 --2- 172.21.15.137:0/2910080788 >> v2:172.21.15.170:3300/0 conn(0x7fa76806ef90 0x7fa7680b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:07.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.831+0000 7fa767e00640 1 --2- 172.21.15.137:0/2910080788 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa76806ff60 0x7fa768073fd0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa7680b3a50 tx=0x7fa75801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6298644bfb618f59 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:07.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.831+0000 7fa767400640 1 -- 172.21.15.137:0/2910080788 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7580b0070 con 0x7fa76806ff60 2024-04-26T23:43:07.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.831+0000 7fa767400640 1 -- 172.21.15.137:0/2910080788 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7580ab600 con 0x7fa76806ff60 2024-04-26T23:43:07.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.831+0000 7fa767400640 1 -- 172.21.15.137:0/2910080788 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7580ab9d0 con 0x7fa76806ff60 2024-04-26T23:43:07.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.831+0000 7fa76ee00640 1 -- 172.21.15.137:0/2910080788 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa76806ff60 msgr2=0x7fa768073fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:07.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.831+0000 7fa76ee00640 1 --2- 172.21.15.137:0/2910080788 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa76806ff60 0x7fa768073fd0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa7680b3a50 tx=0x7fa75801c490 comp rx=0 tx=0).stop 2024-04-26T23:43:07.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.831+0000 7fa76ee00640 1 -- 172.21.15.137:0/2910080788 shutdown_connections 2024-04-26T23:43:07.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.831+0000 7fa76ee00640 1 --2- 172.21.15.137:0/2910080788 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7680b5300 0x7fa76806d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.831+0000 7fa76ee00640 1 --2- 172.21.15.137:0/2910080788 >> v2:172.21.15.170:3300/0 conn(0x7fa76806ef90 0x7fa7680b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.831+0000 7fa76ee00640 1 --2- 172.21.15.137:0/2910080788 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa76806ff60 0x7fa768073fd0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.831+0000 7fa76ee00640 1 -- 172.21.15.137:0/2910080788 >> 172.21.15.137:0/2910080788 conn(0x7fa768073210 msgr2=0x7fa768073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:07.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.831+0000 7fa76ee00640 1 -- 172.21.15.137:0/2910080788 shutdown_connections 2024-04-26T23:43:07.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.831+0000 7fa76ee00640 1 -- 172.21.15.137:0/2910080788 wait complete. 2024-04-26T23:43:07.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa76ee00640 1 Processor -- start 2024-04-26T23:43:07.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa76ee00640 1 -- start start 2024-04-26T23:43:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa76ee00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa76806ef90 0x7fa76815af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa76ee00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa76806ff60 0x7fa7680b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa76ee00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7680b5300 0x7fa7680b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa76ee00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa7680b7240 con 0x7fa7680b5300 2024-04-26T23:43:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa76ee00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa76806dd60 con 0x7fa76806ff60 2024-04-26T23:43:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa76ee00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa768070340 con 0x7fa76806ef90 2024-04-26T23:43:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa76ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7680b5300 0x7fa7680b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa76ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7680b5300 0x7fa7680b3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41378/0 (socket says 172.21.15.137:41378) 2024-04-26T23:43:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa76ce00640 1 -- 172.21.15.137:0/1451230021 learned_addr learned my addr 172.21.15.137:0/1451230021 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:07.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa75f400640 1 --2- 172.21.15.137:0/1451230021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa76806ff60 0x7fa7680b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:07.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa767e00640 1 --2- 172.21.15.137:0/1451230021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa76806ef90 0x7fa76815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:07.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa76ce00640 1 -- 172.21.15.137:0/1451230021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa76806ef90 msgr2=0x7fa76815af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:07.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa76ce00640 1 --2- 172.21.15.137:0/1451230021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa76806ef90 0x7fa76815af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa76ce00640 1 -- 172.21.15.137:0/1451230021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa76806ff60 msgr2=0x7fa7680b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:07.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa76ce00640 1 --2- 172.21.15.137:0/1451230021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa76806ff60 0x7fa7680b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:07.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa76ce00640 1 -- 172.21.15.137:0/1451230021 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7681556f0 con 0x7fa7680b5300 2024-04-26T23:43:07.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa76ce00640 1 --2- 172.21.15.137:0/1451230021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7680b5300 0x7fa7680b3190 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa760007e40 tx=0x7fa76000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:07.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa764c00640 1 -- 172.21.15.137:0/1451230021 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760014620 con 0x7fa7680b5300 2024-04-26T23:43:07.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa764c00640 1 -- 172.21.15.137:0/1451230021 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa760019070 con 0x7fa7680b5300 2024-04-26T23:43:07.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa764c00640 1 -- 172.21.15.137:0/1451230021 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760014a20 con 0x7fa7680b5300 2024-04-26T23:43:07.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa76ee00640 1 -- 172.21.15.137:0/1451230021 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7681559d0 con 0x7fa7680b5300 2024-04-26T23:43:07.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.835+0000 7fa76ee00640 1 -- 172.21.15.137:0/1451230021 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa768155f90 con 0x7fa7680b5300 2024-04-26T23:43:07.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.839+0000 7fa76ee00640 1 -- 172.21.15.137:0/1451230021 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa76806a410 con 0x7fa7680b5300 2024-04-26T23:43:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.839+0000 7fa764c00640 1 -- 172.21.15.137:0/1451230021 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa760014bc0 con 0x7fa7680b5300 2024-04-26T23:43:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.839+0000 7fa764c00640 1 --2- 172.21.15.137:0/1451230021 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa744068380 0x7fa74406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.839+0000 7fa764c00640 1 -- 172.21.15.137:0/1451230021 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa760087140 con 0x7fa7680b5300 2024-04-26T23:43:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.839+0000 7fa767e00640 1 --2- 172.21.15.137:0/1451230021 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa744068380 0x7fa74406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.839+0000 7fa767e00640 1 --2- 172.21.15.137:0/1451230021 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa744068380 0x7fa74406a840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa7580ad000 tx=0x7fa758008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:07.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.843+0000 7fa764c00640 1 -- 172.21.15.137:0/1451230021 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa760057090 con 0x7fa7680b5300 2024-04-26T23:43:08.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.999+0000 7fa76ee00640 1 -- 172.21.15.137:0/1451230021 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa7680d1b00 con 0x7fa7680b5300 2024-04-26T23:43:08.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:07.999+0000 7fa764c00640 1 -- 172.21.15.137:0/1451230021 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) ==== 100+0+11 (secure 0 0 0) 0x7fa76005b390 con 0x7fa7680b5300 2024-04-26T23:43:08.007 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:43:08.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.003+0000 7fa76ee00640 1 -- 172.21.15.137:0/1451230021 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa744068380 msgr2=0x7fa74406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:08.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.003+0000 7fa76ee00640 1 --2- 172.21.15.137:0/1451230021 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa744068380 0x7fa74406a840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa7580ad000 tx=0x7fa758008040 comp rx=0 tx=0).stop 2024-04-26T23:43:08.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.003+0000 7fa76ee00640 1 -- 172.21.15.137:0/1451230021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7680b5300 msgr2=0x7fa7680b3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:08.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.003+0000 7fa76ee00640 1 --2- 172.21.15.137:0/1451230021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7680b5300 0x7fa7680b3190 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa760007e40 tx=0x7fa76000e4b0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.003+0000 7fa76ee00640 1 -- 172.21.15.137:0/1451230021 shutdown_connections 2024-04-26T23:43:08.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.003+0000 7fa76ee00640 1 --2- 172.21.15.137:0/1451230021 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa744068380 0x7fa74406a840 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.003+0000 7fa76ee00640 1 --2- 172.21.15.137:0/1451230021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7680b5300 0x7fa7680b3190 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.003+0000 7fa76ee00640 1 --2- 172.21.15.137:0/1451230021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa76806ff60 0x7fa7680b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.003+0000 7fa76ee00640 1 --2- 172.21.15.137:0/1451230021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa76806ef90 0x7fa76815af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.003+0000 7fa76ee00640 1 -- 172.21.15.137:0/1451230021 >> 172.21.15.137:0/1451230021 conn(0x7fa768073210 msgr2=0x7fa768157ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:08.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.003+0000 7fa76ee00640 1 -- 172.21.15.137:0/1451230021 shutdown_connections 2024-04-26T23:43:08.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.003+0000 7fa76ee00640 1 -- 172.21.15.137:0/1451230021 wait complete. 2024-04-26T23:43:08.029 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:43:08.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.159+0000 7fbcb9000640 1 Processor -- start 2024-04-26T23:43:08.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.159+0000 7fbcb9000640 1 -- start start 2024-04-26T23:43:08.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.159+0000 7fbcb9000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbcb40b4ad0 0x7fbcb406f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:08.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.159+0000 7fbcb9000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcb406f6d0 0x7fbcb40ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:08.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.159+0000 7fbcb9000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcb4148d30 con 0x7fbcb4148950 2024-04-26T23:43:08.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.159+0000 7fbcb9000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fbcb406fb80 con 0x7fbcb40b4ad0 2024-04-26T23:43:08.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.159+0000 7fbcb9000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbcb41604d0 con 0x7fbcb406f6d0 2024-04-26T23:43:08.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.159+0000 7fbca9400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbcb40b4ad0 0x7fbcb406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:08.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.159+0000 7fbca9400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbcb40b4ad0 0x7fbcb406f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41388/0 (socket says 172.21.15.137:41388) 2024-04-26T23:43:08.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.159+0000 7fbcb2800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcb406f6d0 0x7fbcb40ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:08.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.159+0000 7fbca9400640 1 -- 172.21.15.137:0/3250552131 learned_addr learned my addr 172.21.15.137:0/3250552131 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:08.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.159+0000 7fbcb1e00640 1 --1- 172.21.15.137:0/3250552131 >> v1:172.21.15.170:6789/0 conn(0x7fbcb4148950 0x7fbcb415fdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:33262/0 (socket says 172.21.15.137:33262) 2024-04-26T23:43:08.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.159+0000 7fbca9400640 1 -- 172.21.15.137:0/3250552131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcb406f6d0 msgr2=0x7fbcb40ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:08.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.159+0000 7fbca9400640 1 --2- 172.21.15.137:0/3250552131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcb406f6d0 0x7fbcb40ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.159+0000 7fbca9400640 1 -- 172.21.15.137:0/3250552131 >> v1:172.21.15.170:6789/0 conn(0x7fbcb4148950 legacy=0x7fbcb415fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:08.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.159+0000 7fbca9400640 1 -- 172.21.15.137:0/3250552131 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb4073540 con 0x7fbcb40b4ad0 2024-04-26T23:43:08.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.163+0000 7fbca9400640 1 --2- 172.21.15.137:0/3250552131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcb40b4ad0 0x7fbcb406f190 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c009870 tx=0x7fbc9c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9504ab3276f6b87f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:08.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.163+0000 7fbcb1400640 1 -- 172.21.15.137:0/3250552131 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0a95f0 con 0x7fbcb40b4ad0 2024-04-26T23:43:08.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.163+0000 7fbcb1400640 1 -- 172.21.15.137:0/3250552131 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc9c0a9790 con 0x7fbcb40b4ad0 2024-04-26T23:43:08.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.163+0000 7fbcb1400640 1 -- 172.21.15.137:0/3250552131 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0a9b60 con 0x7fbcb40b4ad0 2024-04-26T23:43:08.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.163+0000 7fbcb9000640 1 -- 172.21.15.137:0/3250552131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcb40b4ad0 msgr2=0x7fbcb406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:08.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.163+0000 7fbcb9000640 1 --2- 172.21.15.137:0/3250552131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcb40b4ad0 0x7fbcb406f190 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c009870 tx=0x7fbc9c01c530 comp rx=0 tx=0).stop 2024-04-26T23:43:08.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.163+0000 7fbcb9000640 1 -- 172.21.15.137:0/3250552131 shutdown_connections 2024-04-26T23:43:08.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.163+0000 7fbcb9000640 1 --2- 172.21.15.137:0/3250552131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcb406f6d0 0x7fbcb40ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.163+0000 7fbcb9000640 1 --2- 172.21.15.137:0/3250552131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcb40b4ad0 0x7fbcb406f190 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.163+0000 7fbcb9000640 1 -- 172.21.15.137:0/3250552131 >> 172.21.15.137:0/3250552131 conn(0x7fbcb406c5d0 msgr2=0x7fbcb406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:08.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.163+0000 7fbcb9000640 1 -- 172.21.15.137:0/3250552131 shutdown_connections 2024-04-26T23:43:08.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.163+0000 7fbcb9000640 1 -- 172.21.15.137:0/3250552131 wait complete. 2024-04-26T23:43:08.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbcb9000640 1 Processor -- start 2024-04-26T23:43:08.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbcb9000640 1 -- start start 2024-04-26T23:43:08.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbcb9000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcb406f6d0 0x7fbcb413bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:08.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbcb9000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcb40b4ad0 0x7fbcb413b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:08.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbcb9000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcb4148950 0x7fbcb4146730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:08.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbcb9000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb4073320 con 0x7fbcb40b4ad0 2024-04-26T23:43:08.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbcb9000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb40731a0 con 0x7fbcb4148950 2024-04-26T23:43:08.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbcb9000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbcb4074300 con 0x7fbcb406f6d0 2024-04-26T23:43:08.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbca9400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcb40b4ad0 0x7fbcb413b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:08.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbca9400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcb40b4ad0 0x7fbcb413b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41390/0 (socket says 172.21.15.137:41390) 2024-04-26T23:43:08.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbca9400640 1 -- 172.21.15.137:0/357173131 learned_addr learned my addr 172.21.15.137:0/357173131 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:08.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbcb1e00640 1 --2- 172.21.15.137:0/357173131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcb406f6d0 0x7fbcb413bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:08.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbcb2800640 1 --2- 172.21.15.137:0/357173131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcb4148950 0x7fbcb4146730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:08.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbca9400640 1 -- 172.21.15.137:0/357173131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcb406f6d0 msgr2=0x7fbcb413bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:08.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbca9400640 1 --2- 172.21.15.137:0/357173131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcb406f6d0 0x7fbcb413bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbca9400640 1 -- 172.21.15.137:0/357173131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcb4148950 msgr2=0x7fbcb4146730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:08.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbca9400640 1 --2- 172.21.15.137:0/357173131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcb4148950 0x7fbcb4146730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbca9400640 1 -- 172.21.15.137:0/357173131 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb4146c70 con 0x7fbcb40b4ad0 2024-04-26T23:43:08.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbcb2800640 1 --2- 172.21.15.137:0/357173131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcb4148950 0x7fbcb4146730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:08.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbca9400640 1 --2- 172.21.15.137:0/357173131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcb40b4ad0 0x7fbcb413b440 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c01a160 tx=0x7fbc9c01ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:08.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbcaaa00640 1 -- 172.21.15.137:0/357173131 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0bc450 con 0x7fbcb40b4ad0 2024-04-26T23:43:08.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbcaaa00640 1 -- 172.21.15.137:0/357173131 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc9c0bc610 con 0x7fbcb40b4ad0 2024-04-26T23:43:08.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbcaaa00640 1 -- 172.21.15.137:0/357173131 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0bca00 con 0x7fbcb40b4ad0 2024-04-26T23:43:08.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbcb9000640 1 -- 172.21.15.137:0/357173131 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb413c0c0 con 0x7fbcb40b4ad0 2024-04-26T23:43:08.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.167+0000 7fbcb9000640 1 -- 172.21.15.137:0/357173131 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb413c680 con 0x7fbcb40b4ad0 2024-04-26T23:43:08.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.171+0000 7fbcb9000640 1 -- 172.21.15.137:0/357173131 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcb406a4b0 con 0x7fbcb40b4ad0 2024-04-26T23:43:08.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.171+0000 7fbcaaa00640 1 -- 172.21.15.137:0/357173131 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbc9c0b13f0 con 0x7fbcb40b4ad0 2024-04-26T23:43:08.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.171+0000 7fbcaaa00640 1 --2- 172.21.15.137:0/357173131 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbc90068380 0x7fbc9006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:08.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.171+0000 7fbcaaa00640 1 -- 172.21.15.137:0/357173131 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fbc9c120c70 con 0x7fbcb40b4ad0 2024-04-26T23:43:08.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.171+0000 7fbcb1e00640 1 --2- 172.21.15.137:0/357173131 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbc90068380 0x7fbc9006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:08.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.171+0000 7fbcb1e00640 1 --2- 172.21.15.137:0/357173131 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbc90068380 0x7fbc9006a840 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbca4000f70 tx=0x7fbca4007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:08.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.175+0000 7fbcaaa00640 1 -- 172.21.15.137:0/357173131 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbc9c0c3030 con 0x7fbcb40b4ad0 2024-04-26T23:43:08.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.367+0000 7fbcb9000640 1 -- 172.21.15.137:0/357173131 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbcb40b3d60 con 0x7fbcb40b4ad0 2024-04-26T23:43:08.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.367+0000 7fbcaaa00640 1 -- 172.21.15.137:0/357173131 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5198 (secure 0 0 0) 0x7fbc9c0ad020 con 0x7fbcb40b4ad0 2024-04-26T23:43:08.373 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:08.373 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1345232353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1345232353},{"type":"v1","addr":"172.21.15.137:6836","nonce":1345232353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1274585662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1274585662},{"type":"v1","addr":"172.21.15.137:6837","nonce":1274585662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4079333736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4079333736},{"type":"v1","addr":"172.21.15.170:6834","nonce":4079333736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:42:24.865468+0000","modified":"2024-04-26T23:42:27.876394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34808},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34808":{"gid":34808,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/3364296586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3364296586},{"type":"v1","addr":"172.21.15.170:6835","nonce":3364296586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34808,"qdb_cluster":[34808]},"id":2}]} 2024-04-26T23:43:08.373 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 17 2024-04-26T23:43:08.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.367+0000 7fbcb9000640 1 -- 172.21.15.137:0/357173131 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbc90068380 msgr2=0x7fbc9006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:08.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.367+0000 7fbcb9000640 1 --2- 172.21.15.137:0/357173131 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbc90068380 0x7fbc9006a840 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbca4000f70 tx=0x7fbca4007e90 comp rx=0 tx=0).stop 2024-04-26T23:43:08.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.367+0000 7fbcb9000640 1 -- 172.21.15.137:0/357173131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcb40b4ad0 msgr2=0x7fbcb413b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:08.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.367+0000 7fbcb9000640 1 --2- 172.21.15.137:0/357173131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcb40b4ad0 0x7fbcb413b440 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c01a160 tx=0x7fbc9c01ad70 comp rx=0 tx=0).stop 2024-04-26T23:43:08.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.367+0000 7fbcb9000640 1 -- 172.21.15.137:0/357173131 shutdown_connections 2024-04-26T23:43:08.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.367+0000 7fbcb9000640 1 --2- 172.21.15.137:0/357173131 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbc90068380 0x7fbc9006a840 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.367+0000 7fbcb9000640 1 --2- 172.21.15.137:0/357173131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcb40b4ad0 0x7fbcb413b440 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.367+0000 7fbcb9000640 1 --2- 172.21.15.137:0/357173131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcb4148950 0x7fbcb4146730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.367+0000 7fbcb9000640 1 --2- 172.21.15.137:0/357173131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcb406f6d0 0x7fbcb413bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.367+0000 7fbcb9000640 1 -- 172.21.15.137:0/357173131 >> 172.21.15.137:0/357173131 conn(0x7fbcb406c5d0 msgr2=0x7fbcb40af9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:08.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.367+0000 7fbcb9000640 1 -- 172.21.15.137:0/357173131 shutdown_connections 2024-04-26T23:43:08.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.367+0000 7fbcb9000640 1 -- 172.21.15.137:0/357173131 wait complete. 2024-04-26T23:43:08.394 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:43:08.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.523+0000 7f8a90400640 1 Processor -- start 2024-04-26T23:43:08.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.523+0000 7f8a90400640 1 -- start start 2024-04-26T23:43:08.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.527+0000 7f8a90400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8a88073090 0x7f8a880cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:08.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.527+0000 7f8a90400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a880cfef0 con 0x7f8a880725a0 2024-04-26T23:43:08.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.527+0000 7f8a90400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a880cddc0 con 0x7f8a880b5080 2024-04-26T23:43:08.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.527+0000 7f8a90400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f8a880d01b0 con 0x7f8a88073090 2024-04-26T23:43:08.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.527+0000 7f8a8da00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f8a880725a0 0x7f8a88073f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55168/0 (socket says 172.21.15.137:55168) 2024-04-26T23:43:08.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.527+0000 7f8a8da00640 1 -- 172.21.15.137:0/1857685102 learned_addr learned my addr 172.21.15.137:0/1857685102 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:08.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.527+0000 7f8a8e400640 1 --2- 172.21.15.137:0/1857685102 >> v2:172.21.15.170:3300/0 conn(0x7f8a88073090 0x7f8a880cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:08.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.527+0000 7f8a87e00640 1 -- 172.21.15.137:0/1857685102 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 121209650 0 0) 0x7f8a880cfef0 con 0x7f8a880725a0 2024-04-26T23:43:08.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.527+0000 7f8a87e00640 1 -- 172.21.15.137:0/1857685102 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a70003530 con 0x7f8a880725a0 2024-04-26T23:43:08.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.527+0000 7f8a8e400640 1 -- 172.21.15.137:0/1857685102 >> v1:172.21.15.170:6789/0 conn(0x7f8a880b5080 legacy=0x7f8a88072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:08.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.527+0000 7f8a8e400640 1 -- 172.21.15.137:0/1857685102 >> v1:172.21.15.137:6789/0 conn(0x7f8a880725a0 legacy=0x7f8a88073f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:08.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.527+0000 7f8a8e400640 1 -- 172.21.15.137:0/1857685102 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a880d0490 con 0x7f8a88073090 2024-04-26T23:43:08.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a8e400640 1 --2- 172.21.15.137:0/1857685102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a88073090 0x7f8a880cd770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009dc0 tx=0x7f8a8001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b956de900702d0ed server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:08.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a87e00640 1 -- 172.21.15.137:0/1857685102 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a800b2070 con 0x7f8a88073090 2024-04-26T23:43:08.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a87e00640 1 -- 172.21.15.137:0/1857685102 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a800a5a00 con 0x7f8a88073090 2024-04-26T23:43:08.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a87e00640 1 -- 172.21.15.137:0/1857685102 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a800a5dd0 con 0x7f8a88073090 2024-04-26T23:43:08.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a90400640 1 -- 172.21.15.137:0/1857685102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a88073090 msgr2=0x7f8a880cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:08.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a90400640 1 --2- 172.21.15.137:0/1857685102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a88073090 0x7f8a880cd770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009dc0 tx=0x7f8a8001c920 comp rx=0 tx=0).stop 2024-04-26T23:43:08.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a90400640 1 -- 172.21.15.137:0/1857685102 shutdown_connections 2024-04-26T23:43:08.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a90400640 1 --2- 172.21.15.137:0/1857685102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a88073090 0x7f8a880cd770 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a90400640 1 -- 172.21.15.137:0/1857685102 >> 172.21.15.137:0/1857685102 conn(0x7f8a8806c5d0 msgr2=0x7f8a8806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:08.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a90400640 1 -- 172.21.15.137:0/1857685102 shutdown_connections 2024-04-26T23:43:08.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a90400640 1 -- 172.21.15.137:0/1857685102 wait complete. 2024-04-26T23:43:08.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a90400640 1 Processor -- start 2024-04-26T23:43:08.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a90400640 1 -- start start 2024-04-26T23:43:08.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a90400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a880725a0 0x7f8a8815ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:08.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a90400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a88073090 0x7f8a8813eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:08.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a90400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a880b5080 0x7f8a88142290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:08.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a90400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8a88169900 con 0x7f8a880b5080 2024-04-26T23:43:08.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a90400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8a88169780 con 0x7f8a880725a0 2024-04-26T23:43:08.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a90400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8a88169a80 con 0x7f8a88073090 2024-04-26T23:43:08.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a8e400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a880b5080 0x7f8a88142290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:08.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a8e400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a880b5080 0x7f8a88142290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41392/0 (socket says 172.21.15.137:41392) 2024-04-26T23:43:08.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a8e400640 1 -- 172.21.15.137:0/3794189573 learned_addr learned my addr 172.21.15.137:0/3794189573 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:08.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.531+0000 7f8a8d000640 1 --2- 172.21.15.137:0/3794189573 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a88073090 0x7f8a8813eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:08.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.535+0000 7f8a8da00640 1 --2- 172.21.15.137:0/3794189573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a880725a0 0x7f8a8815ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:08.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.535+0000 7f8a8e400640 1 -- 172.21.15.137:0/3794189573 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a88073090 msgr2=0x7f8a8813eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:08.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.535+0000 7f8a8e400640 1 --2- 172.21.15.137:0/3794189573 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a88073090 0x7f8a8813eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.535+0000 7f8a8e400640 1 -- 172.21.15.137:0/3794189573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a880725a0 msgr2=0x7f8a8815ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:08.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.535+0000 7f8a8e400640 1 --2- 172.21.15.137:0/3794189573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a880725a0 0x7f8a8815ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.535+0000 7f8a8e400640 1 -- 172.21.15.137:0/3794189573 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8815b2e0 con 0x7f8a880b5080 2024-04-26T23:43:08.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.535+0000 7f8a8da00640 1 --2- 172.21.15.137:0/3794189573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a880725a0 0x7f8a8815ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:08.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.535+0000 7f8a8e400640 1 --2- 172.21.15.137:0/3794189573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a880b5080 0x7f8a88142290 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8a8001a550 tx=0x7f8a800196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:08.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.535+0000 7f8a85600640 1 -- 172.21.15.137:0/3794189573 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a800b2050 con 0x7f8a880b5080 2024-04-26T23:43:08.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.535+0000 7f8a85600640 1 -- 172.21.15.137:0/3794189573 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a800be070 con 0x7f8a880b5080 2024-04-26T23:43:08.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.535+0000 7f8a90400640 1 -- 172.21.15.137:0/3794189573 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a880b08f0 con 0x7f8a880b5080 2024-04-26T23:43:08.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.535+0000 7f8a85600640 1 -- 172.21.15.137:0/3794189573 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a800adc40 con 0x7f8a880b5080 2024-04-26T23:43:08.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.535+0000 7f8a90400640 1 -- 172.21.15.137:0/3794189573 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a880b0eb0 con 0x7f8a880b5080 2024-04-26T23:43:08.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.535+0000 7f8a90400640 1 -- 172.21.15.137:0/3794189573 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a8806a4b0 con 0x7f8a880b5080 2024-04-26T23:43:08.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.535+0000 7f8a85600640 1 -- 172.21.15.137:0/3794189573 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8a800b9450 con 0x7f8a880b5080 2024-04-26T23:43:08.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.535+0000 7f8a85600640 1 --2- 172.21.15.137:0/3794189573 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8a680683b0 0x7f8a6806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:08.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.535+0000 7f8a85600640 1 -- 172.21.15.137:0/3794189573 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f8a80121800 con 0x7f8a880b5080 2024-04-26T23:43:08.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.535+0000 7f8a8da00640 1 --2- 172.21.15.137:0/3794189573 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8a680683b0 0x7f8a6806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:08.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.539+0000 7f8a8da00640 1 --2- 172.21.15.137:0/3794189573 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8a680683b0 0x7f8a6806a870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c0011f0 tx=0x7f8a7c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:08.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.543+0000 7f8a85600640 1 -- 172.21.15.137:0/3794189573 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8a800c7020 con 0x7f8a880b5080 2024-04-26T23:43:08.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.699+0000 7f8a90400640 1 -- 172.21.15.137:0/3794189573 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a88072380 con 0x7f8a880b5080 2024-04-26T23:43:08.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.703+0000 7f8a85600640 1 -- 172.21.15.137:0/3794189573 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16717 (secure 0 0 0) 0x7f8a8815b2e0 con 0x7f8a880b5080 2024-04-26T23:43:08.709 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:08.709 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":33,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:42:26.483092+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:42:22.570062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:42:23.822598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:43:08.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.703+0000 7f8a90400640 1 -- 172.21.15.137:0/3794189573 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8a680683b0 msgr2=0x7f8a6806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:08.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.703+0000 7f8a90400640 1 --2- 172.21.15.137:0/3794189573 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8a680683b0 0x7f8a6806a870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c0011f0 tx=0x7f8a7c009040 comp rx=0 tx=0).stop 2024-04-26T23:43:08.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.703+0000 7f8a90400640 1 -- 172.21.15.137:0/3794189573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a880b5080 msgr2=0x7f8a88142290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:08.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.703+0000 7f8a90400640 1 --2- 172.21.15.137:0/3794189573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a880b5080 0x7f8a88142290 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8a8001a550 tx=0x7f8a800196c0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.703+0000 7f8a90400640 1 -- 172.21.15.137:0/3794189573 shutdown_connections 2024-04-26T23:43:08.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.703+0000 7f8a90400640 1 --2- 172.21.15.137:0/3794189573 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8a680683b0 0x7f8a6806a870 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.703+0000 7f8a90400640 1 --2- 172.21.15.137:0/3794189573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a880b5080 0x7f8a88142290 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.703+0000 7f8a90400640 1 --2- 172.21.15.137:0/3794189573 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a88073090 0x7f8a8813eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.703+0000 7f8a90400640 1 --2- 172.21.15.137:0/3794189573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a880725a0 0x7f8a8815ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.703+0000 7f8a90400640 1 -- 172.21.15.137:0/3794189573 >> 172.21.15.137:0/3794189573 conn(0x7f8a8806c5d0 msgr2=0x7f8a8813c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:08.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.703+0000 7f8a90400640 1 -- 172.21.15.137:0/3794189573 shutdown_connections 2024-04-26T23:43:08.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.703+0000 7f8a90400640 1 -- 172.21.15.137:0/3794189573 wait complete. 2024-04-26T23:43:08.731 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T23:43:08.731 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:43:08.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.859+0000 7f75f4000640 1 Processor -- start 2024-04-26T23:43:08.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.859+0000 7f75f4000640 1 -- start start 2024-04-26T23:43:08.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.859+0000 7f75f4000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75ec148950 0x7f75ec15fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:08.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.859+0000 7f75f4000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f75ec0b4ad0 0x7f75ec06f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:08.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.859+0000 7f75f4000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f75ec06f6d0 0x7f75ec0b5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:08.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.859+0000 7f75f4000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f75ec06fb80 con 0x7f75ec06f6d0 2024-04-26T23:43:08.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.859+0000 7f75f4000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f75ec148d30 con 0x7f75ec0b4ad0 2024-04-26T23:43:08.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.859+0000 7f75f4000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f75ec073540 con 0x7f75ec148950 2024-04-26T23:43:08.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.863+0000 7f75f2000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f75ec06f6d0 0x7f75ec0b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:08.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.863+0000 7f75f2000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f75ec06f6d0 0x7f75ec0b5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41404/0 (socket says 172.21.15.137:41404) 2024-04-26T23:43:08.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.863+0000 7f75f2000640 1 -- 172.21.15.137:0/1852125947 learned_addr learned my addr 172.21.15.137:0/1852125947 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:08.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.863+0000 7f75f1600640 1 --2- 172.21.15.137:0/1852125947 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75ec148950 0x7f75ec15fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:08.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.863+0000 7f75f0c00640 1 --2- 172.21.15.137:0/1852125947 >> v2:172.21.15.170:3300/0 conn(0x7f75ec0b4ad0 0x7f75ec06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:08.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.863+0000 7f75f2000640 1 -- 172.21.15.137:0/1852125947 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75ec148950 msgr2=0x7f75ec15fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:08.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.863+0000 7f75f2000640 1 --2- 172.21.15.137:0/1852125947 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75ec148950 0x7f75ec15fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.863+0000 7f75f2000640 1 -- 172.21.15.137:0/1852125947 >> v2:172.21.15.170:3300/0 conn(0x7f75ec0b4ad0 msgr2=0x7f75ec06f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:08.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.863+0000 7f75f2000640 1 --2- 172.21.15.137:0/1852125947 >> v2:172.21.15.170:3300/0 conn(0x7f75ec0b4ad0 0x7f75ec06f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.863+0000 7f75f2000640 1 -- 172.21.15.137:0/1852125947 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec073820 con 0x7f75ec06f6d0 2024-04-26T23:43:08.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.863+0000 7f75f2000640 1 --2- 172.21.15.137:0/1852125947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75ec06f6d0 0x7f75ec0b5140 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0b0560 tx=0x7f75e401c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02891c24e53bdac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:08.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.863+0000 7f75ebe00640 1 -- 172.21.15.137:0/1852125947 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e40b0070 con 0x7f75ec06f6d0 2024-04-26T23:43:08.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.863+0000 7f75ebe00640 1 -- 172.21.15.137:0/1852125947 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e40ab600 con 0x7f75ec06f6d0 2024-04-26T23:43:08.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.863+0000 7f75ebe00640 1 -- 172.21.15.137:0/1852125947 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e40ab9d0 con 0x7f75ec06f6d0 2024-04-26T23:43:08.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f4000640 1 -- 172.21.15.137:0/1852125947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75ec06f6d0 msgr2=0x7f75ec0b5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:08.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f4000640 1 --2- 172.21.15.137:0/1852125947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75ec06f6d0 0x7f75ec0b5140 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0b0560 tx=0x7f75e401c230 comp rx=0 tx=0).stop 2024-04-26T23:43:08.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f4000640 1 -- 172.21.15.137:0/1852125947 shutdown_connections 2024-04-26T23:43:08.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f4000640 1 --2- 172.21.15.137:0/1852125947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75ec06f6d0 0x7f75ec0b5140 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f4000640 1 --2- 172.21.15.137:0/1852125947 >> v2:172.21.15.170:3300/0 conn(0x7f75ec0b4ad0 0x7f75ec06f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f4000640 1 --2- 172.21.15.137:0/1852125947 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75ec148950 0x7f75ec15fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f4000640 1 -- 172.21.15.137:0/1852125947 >> 172.21.15.137:0/1852125947 conn(0x7f75ec06c5d0 msgr2=0x7f75ec06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:08.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f4000640 1 -- 172.21.15.137:0/1852125947 shutdown_connections 2024-04-26T23:43:08.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f4000640 1 -- 172.21.15.137:0/1852125947 wait complete. 2024-04-26T23:43:08.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f4000640 1 Processor -- start 2024-04-26T23:43:08.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f4000640 1 -- start start 2024-04-26T23:43:08.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f4000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75ec06f6d0 0x7f75ec1450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:08.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f4000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75ec0b4ad0 0x7f75ec15ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:08.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f4000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75ec148950 0x7f75ec143570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:08.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f4000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec074480 con 0x7f75ec0b4ad0 2024-04-26T23:43:08.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f4000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec074300 con 0x7f75ec148950 2024-04-26T23:43:08.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f4000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f75ec160300 con 0x7f75ec06f6d0 2024-04-26T23:43:08.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f0c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75ec0b4ad0 0x7f75ec15ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:08.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f0c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75ec0b4ad0 0x7f75ec15ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41416/0 (socket says 172.21.15.137:41416) 2024-04-26T23:43:08.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f0c00640 1 -- 172.21.15.137:0/1421419581 learned_addr learned my addr 172.21.15.137:0/1421419581 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:08.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f1600640 1 --2- 172.21.15.137:0/1421419581 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75ec06f6d0 0x7f75ec1450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:08.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f2000640 1 --2- 172.21.15.137:0/1421419581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75ec148950 0x7f75ec143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:08.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f0c00640 1 -- 172.21.15.137:0/1421419581 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75ec06f6d0 msgr2=0x7f75ec1450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:08.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f0c00640 1 --2- 172.21.15.137:0/1421419581 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75ec06f6d0 0x7f75ec1450b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f0c00640 1 -- 172.21.15.137:0/1421419581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75ec148950 msgr2=0x7f75ec143570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:08.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f0c00640 1 --2- 172.21.15.137:0/1421419581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75ec148950 0x7f75ec143570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:08.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.867+0000 7f75f0c00640 1 -- 172.21.15.137:0/1421419581 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec144010 con 0x7f75ec0b4ad0 2024-04-26T23:43:08.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.871+0000 7f75f0c00640 1 --2- 172.21.15.137:0/1421419581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75ec0b4ad0 0x7f75ec15ec00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f75d800d800 tx=0x7f75d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:08.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.871+0000 7f75e9600640 1 -- 172.21.15.137:0/1421419581 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d800b6c0 con 0x7f75ec0b4ad0 2024-04-26T23:43:08.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.871+0000 7f75e9600640 1 -- 172.21.15.137:0/1421419581 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d8019070 con 0x7f75ec0b4ad0 2024-04-26T23:43:08.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.871+0000 7f75f4000640 1 -- 172.21.15.137:0/1421419581 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ec1442f0 con 0x7f75ec0b4ad0 2024-04-26T23:43:08.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.871+0000 7f75e9600640 1 -- 172.21.15.137:0/1421419581 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d800ba60 con 0x7f75ec0b4ad0 2024-04-26T23:43:08.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.871+0000 7f75f4000640 1 -- 172.21.15.137:0/1421419581 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ec1448b0 con 0x7f75ec0b4ad0 2024-04-26T23:43:08.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.871+0000 7f75f4000640 1 -- 172.21.15.137:0/1421419581 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75ec145650 con 0x7f75ec0b4ad0 2024-04-26T23:43:08.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.871+0000 7f75e9600640 1 -- 172.21.15.137:0/1421419581 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f75d800bc00 con 0x7f75ec0b4ad0 2024-04-26T23:43:08.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.871+0000 7f75e9600640 1 --2- 172.21.15.137:0/1421419581 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f75cc068380 0x7f75cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:08.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.871+0000 7f75e9600640 1 -- 172.21.15.137:0/1421419581 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f75d8086cb0 con 0x7f75ec0b4ad0 2024-04-26T23:43:08.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.871+0000 7f75f1600640 1 --2- 172.21.15.137:0/1421419581 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f75cc068380 0x7f75cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:08.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.875+0000 7f75f1600640 1 --2- 172.21.15.137:0/1421419581 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f75cc068380 0x7f75cc06a840 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f75e00039f0 tx=0x7f75e0009830 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:08.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:08.875+0000 7f75e9600640 1 -- 172.21.15.137:0/1421419581 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f75d8056cb0 con 0x7f75ec0b4ad0 2024-04-26T23:43:09.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.067+0000 7f75f4000640 1 -- 172.21.15.137:0/1421419581 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75ec06a4b0 con 0x7f75ec0b4ad0 2024-04-26T23:43:09.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.067+0000 7f75e9600640 1 -- 172.21.15.137:0/1421419581 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5198 (secure 0 0 0) 0x7f75d805afb0 con 0x7f75ec0b4ad0 2024-04-26T23:43:09.074 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:09.074 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1345232353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1345232353},{"type":"v1","addr":"172.21.15.137:6836","nonce":1345232353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1274585662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1274585662},{"type":"v1","addr":"172.21.15.137:6837","nonce":1274585662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4079333736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4079333736},{"type":"v1","addr":"172.21.15.170:6834","nonce":4079333736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:42:24.865468+0000","modified":"2024-04-26T23:42:27.876394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34808},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34808":{"gid":34808,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/3364296586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3364296586},{"type":"v1","addr":"172.21.15.170:6835","nonce":3364296586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34808,"qdb_cluster":[34808]},"id":2}]} 2024-04-26T23:43:09.075 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 17 2024-04-26T23:43:09.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.071+0000 7f75f4000640 1 -- 172.21.15.137:0/1421419581 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f75cc068380 msgr2=0x7f75cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:09.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.071+0000 7f75f4000640 1 --2- 172.21.15.137:0/1421419581 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f75cc068380 0x7f75cc06a840 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f75e00039f0 tx=0x7f75e0009830 comp rx=0 tx=0).stop 2024-04-26T23:43:09.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.071+0000 7f75f4000640 1 -- 172.21.15.137:0/1421419581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75ec0b4ad0 msgr2=0x7f75ec15ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:09.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.071+0000 7f75f4000640 1 --2- 172.21.15.137:0/1421419581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75ec0b4ad0 0x7f75ec15ec00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f75d800d800 tx=0x7f75d800dcc0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.071+0000 7f75f4000640 1 -- 172.21.15.137:0/1421419581 shutdown_connections 2024-04-26T23:43:09.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.071+0000 7f75f4000640 1 --2- 172.21.15.137:0/1421419581 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f75cc068380 0x7f75cc06a840 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.071+0000 7f75f4000640 1 --2- 172.21.15.137:0/1421419581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75ec0b4ad0 0x7f75ec15ec00 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.071+0000 7f75f4000640 1 --2- 172.21.15.137:0/1421419581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75ec148950 0x7f75ec143570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.071+0000 7f75f4000640 1 --2- 172.21.15.137:0/1421419581 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75ec06f6d0 0x7f75ec1450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.071+0000 7f75f4000640 1 -- 172.21.15.137:0/1421419581 >> 172.21.15.137:0/1421419581 conn(0x7f75ec06c5d0 msgr2=0x7f75ec0b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:09.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.071+0000 7f75f4000640 1 -- 172.21.15.137:0/1421419581 shutdown_connections 2024-04-26T23:43:09.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.071+0000 7f75f4000640 1 -- 172.21.15.137:0/1421419581 wait complete. 2024-04-26T23:43:09.095 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:43:09.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.223+0000 7f5702600640 1 Processor -- start 2024-04-26T23:43:09.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.223+0000 7f5702600640 1 -- start start 2024-04-26T23:43:09.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.227+0000 7f5702600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f56fc0ce3e0 0x7f56fc073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.227+0000 7f5702600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f56fc0ce7c0 0x7f56fc146210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.227+0000 7f5702600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56fc073010 con 0x7f56fc15de80 2024-04-26T23:43:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.227+0000 7f5702600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f56fc0cef90 con 0x7f56fc0ce3e0 2024-04-26T23:43:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.227+0000 7f5702600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f56fc073280 con 0x7f56fc0ce7c0 2024-04-26T23:43:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.227+0000 7f56fb400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f56fc0ce3e0 0x7f56fc073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.227+0000 7f56fb400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f56fc0ce3e0 0x7f56fc073d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41426/0 (socket says 172.21.15.137:41426) 2024-04-26T23:43:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.227+0000 7f56fb400640 1 -- 172.21.15.137:0/4172043733 learned_addr learned my addr 172.21.15.137:0/4172043733 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.227+0000 7f56fbe00640 1 --2- 172.21.15.137:0/4172043733 >> v2:172.21.15.170:3300/0 conn(0x7f56fc0ce7c0 0x7f56fc146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.227+0000 7f56fb400640 1 -- 172.21.15.137:0/4172043733 >> v2:172.21.15.170:3300/0 conn(0x7f56fc0ce7c0 msgr2=0x7f56fc146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:09.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.227+0000 7f56fb400640 1 --2- 172.21.15.137:0/4172043733 >> v2:172.21.15.170:3300/0 conn(0x7f56fc0ce7c0 0x7f56fc146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.227+0000 7f56fb400640 1 -- 172.21.15.137:0/4172043733 >> v1:172.21.15.170:6789/0 conn(0x7f56fc15de80 legacy=0x7f56fc0d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:09.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.227+0000 7f56fb400640 1 -- 172.21.15.137:0/4172043733 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56fc073560 con 0x7f56fc0ce3e0 2024-04-26T23:43:09.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.231+0000 7f56fb400640 1 --2- 172.21.15.137:0/4172043733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56fc0ce3e0 0x7f56fc073d60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009870 tx=0x7f56ec01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe1728314c6d40e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:09.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.231+0000 7f56faa00640 1 -- 172.21.15.137:0/4172043733 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec0ab600 con 0x7f56fc0ce3e0 2024-04-26T23:43:09.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.231+0000 7f56faa00640 1 -- 172.21.15.137:0/4172043733 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56ec0b0070 con 0x7f56fc0ce3e0 2024-04-26T23:43:09.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.231+0000 7f56faa00640 1 -- 172.21.15.137:0/4172043733 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec0ab9c0 con 0x7f56fc0ce3e0 2024-04-26T23:43:09.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.231+0000 7f5702600640 1 -- 172.21.15.137:0/4172043733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56fc0ce3e0 msgr2=0x7f56fc073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:09.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.231+0000 7f5702600640 1 --2- 172.21.15.137:0/4172043733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56fc0ce3e0 0x7f56fc073d60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009870 tx=0x7f56ec01c4f0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.231+0000 7f5702600640 1 -- 172.21.15.137:0/4172043733 shutdown_connections 2024-04-26T23:43:09.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.231+0000 7f5702600640 1 --2- 172.21.15.137:0/4172043733 >> v2:172.21.15.170:3300/0 conn(0x7f56fc0ce7c0 0x7f56fc146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.231+0000 7f5702600640 1 --2- 172.21.15.137:0/4172043733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56fc0ce3e0 0x7f56fc073d60 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.231+0000 7f5702600640 1 -- 172.21.15.137:0/4172043733 >> 172.21.15.137:0/4172043733 conn(0x7f56fc06c5d0 msgr2=0x7f56fc06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:09.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.231+0000 7f5702600640 1 -- 172.21.15.137:0/4172043733 shutdown_connections 2024-04-26T23:43:09.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.231+0000 7f5702600640 1 -- 172.21.15.137:0/4172043733 wait complete. 2024-04-26T23:43:09.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.231+0000 7f5702600640 1 Processor -- start 2024-04-26T23:43:09.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.231+0000 7f5702600640 1 -- start start 2024-04-26T23:43:09.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.231+0000 7f5702600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56fc0ce3e0 0x7f56fc0af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:09.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.231+0000 7f5702600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56fc0ce7c0 0x7f56fc15c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:09.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.231+0000 7f5702600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56fc15de80 0x7f56fc136210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:09.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.231+0000 7f5702600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f56fc06f0e0 con 0x7f56fc0ce7c0 2024-04-26T23:43:09.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.231+0000 7f5702600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f56fc06ef60 con 0x7f56fc15de80 2024-04-26T23:43:09.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.231+0000 7f5702600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f56fc06f260 con 0x7f56fc0ce3e0 2024-04-26T23:43:09.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.235+0000 7f56f2a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56fc0ce7c0 0x7f56fc15c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:09.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.235+0000 7f56f2a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56fc0ce7c0 0x7f56fc15c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41428/0 (socket says 172.21.15.137:41428) 2024-04-26T23:43:09.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.235+0000 7f56f2a00640 1 -- 172.21.15.137:0/4285408912 learned_addr learned my addr 172.21.15.137:0/4285408912 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:09.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.235+0000 7f56fb400640 1 --2- 172.21.15.137:0/4285408912 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56fc0ce3e0 0x7f56fc0af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:09.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.235+0000 7f56fbe00640 1 --2- 172.21.15.137:0/4285408912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56fc15de80 0x7f56fc136210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:09.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.235+0000 7f56f2a00640 1 -- 172.21.15.137:0/4285408912 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56fc0ce3e0 msgr2=0x7f56fc0af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:09.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.235+0000 7f56f2a00640 1 --2- 172.21.15.137:0/4285408912 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56fc0ce3e0 0x7f56fc0af4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.235+0000 7f56f2a00640 1 -- 172.21.15.137:0/4285408912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56fc15de80 msgr2=0x7f56fc136210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:09.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.235+0000 7f56f2a00640 1 --2- 172.21.15.137:0/4285408912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56fc15de80 0x7f56fc136210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.235+0000 7f56f2a00640 1 -- 172.21.15.137:0/4285408912 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56fc136750 con 0x7f56fc0ce7c0 2024-04-26T23:43:09.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.235+0000 7f56fbe00640 1 --2- 172.21.15.137:0/4285408912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56fc15de80 0x7f56fc136210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:09.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.235+0000 7f56f2a00640 1 --2- 172.21.15.137:0/4285408912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56fc0ce7c0 0x7f56fc15c5e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f56e400c430 tx=0x7f56e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:09.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.235+0000 7f56f3e00640 1 -- 172.21.15.137:0/4285408912 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e40052d0 con 0x7f56fc0ce7c0 2024-04-26T23:43:09.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.235+0000 7f56f3e00640 1 -- 172.21.15.137:0/4285408912 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e4005470 con 0x7f56fc0ce7c0 2024-04-26T23:43:09.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.235+0000 7f56f3e00640 1 -- 172.21.15.137:0/4285408912 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e4007260 con 0x7f56fc0ce7c0 2024-04-26T23:43:09.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.235+0000 7f5702600640 1 -- 172.21.15.137:0/4285408912 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56fc0b4230 con 0x7f56fc0ce7c0 2024-04-26T23:43:09.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.235+0000 7f5702600640 1 -- 172.21.15.137:0/4285408912 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56fc0b47f0 con 0x7f56fc0ce7c0 2024-04-26T23:43:09.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.235+0000 7f5702600640 1 -- 172.21.15.137:0/4285408912 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56fc06a4b0 con 0x7f56fc0ce7c0 2024-04-26T23:43:09.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.235+0000 7f56f3e00640 1 -- 172.21.15.137:0/4285408912 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f56e4007400 con 0x7f56fc0ce7c0 2024-04-26T23:43:09.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.239+0000 7f56f3e00640 1 --2- 172.21.15.137:0/4285408912 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f56d8068380 0x7f56d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:09.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.239+0000 7f56f3e00640 1 -- 172.21.15.137:0/4285408912 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f56e4085f00 con 0x7f56fc0ce7c0 2024-04-26T23:43:09.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.239+0000 7f56fb400640 1 --2- 172.21.15.137:0/4285408912 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f56d8068380 0x7f56d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:09.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.239+0000 7f56fb400640 1 --2- 172.21.15.137:0/4285408912 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f56d8068380 0x7f56d806a840 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0af000 tx=0x7f56ec0a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:09.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.243+0000 7f56f3e00640 1 -- 172.21.15.137:0/4285408912 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f56e4055dd0 con 0x7f56fc0ce7c0 2024-04-26T23:43:09.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.431+0000 7f5702600640 1 -- 172.21.15.137:0/4285408912 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56fc145c80 con 0x7f56fc0ce7c0 2024-04-26T23:43:09.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.431+0000 7f56f3e00640 1 -- 172.21.15.137:0/4285408912 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5198 (secure 0 0 0) 0x7f56e405a0d0 con 0x7f56fc0ce7c0 2024-04-26T23:43:09.438 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:09.438 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1345232353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1345232353},{"type":"v1","addr":"172.21.15.137:6836","nonce":1345232353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1274585662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1274585662},{"type":"v1","addr":"172.21.15.137:6837","nonce":1274585662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4079333736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4079333736},{"type":"v1","addr":"172.21.15.170:6834","nonce":4079333736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:42:24.865468+0000","modified":"2024-04-26T23:42:27.876394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34808},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34808":{"gid":34808,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/3364296586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3364296586},{"type":"v1","addr":"172.21.15.170:6835","nonce":3364296586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34808,"qdb_cluster":[34808]},"id":2}]} 2024-04-26T23:43:09.438 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 17 2024-04-26T23:43:09.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.431+0000 7f5702600640 1 -- 172.21.15.137:0/4285408912 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f56d8068380 msgr2=0x7f56d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:09.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.431+0000 7f5702600640 1 --2- 172.21.15.137:0/4285408912 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f56d8068380 0x7f56d806a840 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0af000 tx=0x7f56ec0a7000 comp rx=0 tx=0).stop 2024-04-26T23:43:09.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.431+0000 7f5702600640 1 -- 172.21.15.137:0/4285408912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56fc0ce7c0 msgr2=0x7f56fc15c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:09.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.431+0000 7f5702600640 1 --2- 172.21.15.137:0/4285408912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56fc0ce7c0 0x7f56fc15c5e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f56e400c430 tx=0x7f56e400c8f0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.431+0000 7f5702600640 1 -- 172.21.15.137:0/4285408912 shutdown_connections 2024-04-26T23:43:09.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.431+0000 7f5702600640 1 --2- 172.21.15.137:0/4285408912 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f56d8068380 0x7f56d806a840 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.431+0000 7f5702600640 1 --2- 172.21.15.137:0/4285408912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56fc0ce7c0 0x7f56fc15c5e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.431+0000 7f5702600640 1 --2- 172.21.15.137:0/4285408912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56fc15de80 0x7f56fc136210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.431+0000 7f5702600640 1 --2- 172.21.15.137:0/4285408912 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56fc0ce3e0 0x7f56fc0af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.431+0000 7f5702600640 1 -- 172.21.15.137:0/4285408912 >> 172.21.15.137:0/4285408912 conn(0x7f56fc06c5d0 msgr2=0x7f56fc0cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:09.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.431+0000 7f5702600640 1 -- 172.21.15.137:0/4285408912 shutdown_connections 2024-04-26T23:43:09.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.431+0000 7f5702600640 1 -- 172.21.15.137:0/4285408912 wait complete. 2024-04-26T23:43:09.460 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:43:09.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc763800640 1 Processor -- start 2024-04-26T23:43:09.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc763800640 1 -- start start 2024-04-26T23:43:09.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc763800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc75c1596f0 0x7fc75c15f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:09.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc763800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc75c0b5290 0x7fc75c072930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:09.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc763800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc75c159ad0 con 0x7fc75c072e70 2024-04-26T23:43:09.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc763800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc75c0732e0 con 0x7fc75c0b5290 2024-04-26T23:43:09.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc763800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc75c0b5a70 con 0x7fc75c1596f0 2024-04-26T23:43:09.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc761800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc75c072e70 0x7fc75c162c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55170/0 (socket says 172.21.15.137:55170) 2024-04-26T23:43:09.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc761800640 1 -- 172.21.15.137:0/470847097 learned_addr learned my addr 172.21.15.137:0/470847097 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:09.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc760e00640 1 --2- 172.21.15.137:0/470847097 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc75c1596f0 0x7fc75c15f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:09.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75be00640 1 --2- 172.21.15.137:0/470847097 >> v2:172.21.15.170:3300/0 conn(0x7fc75c0b5290 0x7fc75c072930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:09.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75b400640 1 -- 172.21.15.137:0/470847097 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1238710727 0 0) 0x7fc75c159ad0 con 0x7fc75c072e70 2024-04-26T23:43:09.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75b400640 1 -- 172.21.15.137:0/470847097 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc744003530 con 0x7fc75c072e70 2024-04-26T23:43:09.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75b400640 1 -- 172.21.15.137:0/470847097 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1267678778 0 0) 0x7fc744003530 con 0x7fc75c072e70 2024-04-26T23:43:09.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75b400640 1 -- 172.21.15.137:0/470847097 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc75c1596f0 msgr2=0x7fc75c15f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:09.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75b400640 1 --2- 172.21.15.137:0/470847097 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc75c1596f0 0x7fc75c15f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75b400640 1 -- 172.21.15.137:0/470847097 >> v2:172.21.15.170:3300/0 conn(0x7fc75c0b5290 msgr2=0x7fc75c072930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:09.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75b400640 1 --2- 172.21.15.137:0/470847097 >> v2:172.21.15.170:3300/0 conn(0x7fc75c0b5290 0x7fc75c072930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75b400640 1 -- 172.21.15.137:0/470847097 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75c0b5d50 con 0x7fc75c072e70 2024-04-26T23:43:09.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75b400640 1 -- 172.21.15.137:0/470847097 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fc754001a00 con 0x7fc75c072e70 2024-04-26T23:43:09.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75b400640 1 -- 172.21.15.137:0/470847097 >> v1:172.21.15.137:6789/0 conn(0x7fc75c072e70 legacy=0x7fc75c162c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:09.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75b400640 1 --2- 172.21.15.137:0/470847097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7440039c0 0x7fc744003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:09.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75b400640 1 --2- 172.21.15.137:0/470847097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc744004810 0x7fc744004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:09.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75b400640 1 --2- 172.21.15.137:0/470847097 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7440051d0 0x7fc74400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:09.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75b400640 1 -- 172.21.15.137:0/470847097 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc75c0732e0 con 0x7fc744004810 2024-04-26T23:43:09.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75b400640 1 -- 172.21.15.137:0/470847097 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc75c0b5a70 con 0x7fc7440039c0 2024-04-26T23:43:09.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75b400640 1 -- 172.21.15.137:0/470847097 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc74400bf10 con 0x7fc7440051d0 2024-04-26T23:43:09.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc760e00640 1 --2- 172.21.15.137:0/470847097 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc75c1596f0 0x7fc75c15f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:43:09.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75be00640 1 --2- 172.21.15.137:0/470847097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc744004810 0x7fc744004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:09.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc761800640 1 --2- 172.21.15.137:0/470847097 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7440051d0 0x7fc74400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:09.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc760e00640 1 --2- 172.21.15.137:0/470847097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7440039c0 0x7fc744003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:09.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75be00640 1 -- 172.21.15.137:0/470847097 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7440051d0 msgr2=0x7fc74400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:09.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75be00640 1 --2- 172.21.15.137:0/470847097 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7440051d0 0x7fc74400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75be00640 1 -- 172.21.15.137:0/470847097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7440039c0 msgr2=0x7fc744003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:09.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75be00640 1 --2- 172.21.15.137:0/470847097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7440039c0 0x7fc744003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.591+0000 7fc75be00640 1 -- 172.21.15.137:0/470847097 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc744003530 con 0x7fc744004810 2024-04-26T23:43:09.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.595+0000 7fc75be00640 1 --2- 172.21.15.137:0/470847097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc744004810 0x7fc744004c90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc748009b10 tx=0x7fc74801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275ff2e9fb0aa154 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:09.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.595+0000 7fc75b400640 1 -- 172.21.15.137:0/470847097 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7480b2070 con 0x7fc744004810 2024-04-26T23:43:09.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.595+0000 7fc75b400640 1 -- 172.21.15.137:0/470847097 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7480a56a0 con 0x7fc744004810 2024-04-26T23:43:09.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.595+0000 7fc75b400640 1 -- 172.21.15.137:0/470847097 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7480096b0 con 0x7fc744004810 2024-04-26T23:43:09.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.595+0000 7fc763800640 1 -- 172.21.15.137:0/470847097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc744004810 msgr2=0x7fc744004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:09.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.595+0000 7fc763800640 1 --2- 172.21.15.137:0/470847097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc744004810 0x7fc744004c90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc748009b10 tx=0x7fc74801cab0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.595+0000 7fc761800640 1 -- 172.21.15.137:0/470847097 reap_dead start 2024-04-26T23:43:09.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.595+0000 7fc763800640 1 -- 172.21.15.137:0/470847097 shutdown_connections 2024-04-26T23:43:09.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.595+0000 7fc763800640 1 -- 172.21.15.137:0/470847097 >> 172.21.15.137:0/470847097 conn(0x7fc75c0b3370 msgr2=0x7fc75c0b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:09.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.595+0000 7fc763800640 1 -- 172.21.15.137:0/470847097 shutdown_connections 2024-04-26T23:43:09.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.595+0000 7fc763800640 1 -- 172.21.15.137:0/470847097 wait complete. 2024-04-26T23:43:09.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc763800640 1 Processor -- start 2024-04-26T23:43:09.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc763800640 1 -- start start 2024-04-26T23:43:09.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc763800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc744004810 0x7fc75c0b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:09.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc763800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc75c06fc10 0x7fc75c070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:09.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc763800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc75c142d20 0x7fc75c1431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:09.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc763800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc75c0af5f0 con 0x7fc75c142d20 2024-04-26T23:43:09.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc763800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc75c0b6310 con 0x7fc75c06fc10 2024-04-26T23:43:09.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc763800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc75c0b5710 con 0x7fc744004810 2024-04-26T23:43:09.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc761800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc75c142d20 0x7fc75c1431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:09.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc761800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc75c142d20 0x7fc75c1431a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41442/0 (socket says 172.21.15.137:41442) 2024-04-26T23:43:09.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc761800640 1 -- 172.21.15.137:0/1358998884 learned_addr learned my addr 172.21.15.137:0/1358998884 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:09.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc760e00640 1 --2- 172.21.15.137:0/1358998884 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc744004810 0x7fc75c0b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:09.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc75be00640 1 --2- 172.21.15.137:0/1358998884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc75c06fc10 0x7fc75c070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:09.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc761800640 1 -- 172.21.15.137:0/1358998884 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc744004810 msgr2=0x7fc75c0b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:09.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc761800640 1 --2- 172.21.15.137:0/1358998884 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc744004810 0x7fc75c0b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc761800640 1 -- 172.21.15.137:0/1358998884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc75c06fc10 msgr2=0x7fc75c070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:09.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc761800640 1 --2- 172.21.15.137:0/1358998884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc75c06fc10 0x7fc75c070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc761800640 1 -- 172.21.15.137:0/1358998884 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75c0afb30 con 0x7fc75c142d20 2024-04-26T23:43:09.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc761800640 1 --2- 172.21.15.137:0/1358998884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc75c142d20 0x7fc75c1431a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc75c06e850 tx=0x7fc754007bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:09.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc758c00640 1 -- 172.21.15.137:0/1358998884 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75401c070 con 0x7fc75c142d20 2024-04-26T23:43:09.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc758c00640 1 -- 172.21.15.137:0/1358998884 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc754011840 con 0x7fc75c142d20 2024-04-26T23:43:09.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc763800640 1 -- 172.21.15.137:0/1358998884 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc75c0b3020 con 0x7fc75c142d20 2024-04-26T23:43:09.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc758c00640 1 -- 172.21.15.137:0/1358998884 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc754010040 con 0x7fc75c142d20 2024-04-26T23:43:09.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.599+0000 7fc763800640 1 -- 172.21.15.137:0/1358998884 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc75c140e70 con 0x7fc75c142d20 2024-04-26T23:43:09.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.603+0000 7fc763800640 1 -- 172.21.15.137:0/1358998884 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc75c06a4b0 con 0x7fc75c142d20 2024-04-26T23:43:09.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.603+0000 7fc758c00640 1 -- 172.21.15.137:0/1358998884 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc75401f070 con 0x7fc75c142d20 2024-04-26T23:43:09.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.603+0000 7fc758c00640 1 --2- 172.21.15.137:0/1358998884 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc73c0683b0 0x7fc73c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:09.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.603+0000 7fc758c00640 1 -- 172.21.15.137:0/1358998884 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fc754089500 con 0x7fc75c142d20 2024-04-26T23:43:09.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.603+0000 7fc760e00640 1 --2- 172.21.15.137:0/1358998884 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc73c0683b0 0x7fc73c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:09.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.603+0000 7fc760e00640 1 --2- 172.21.15.137:0/1358998884 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc73c0683b0 0x7fc73c06a870 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0b6d60 tx=0x7fc750008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:09.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.607+0000 7fc758c00640 1 -- 172.21.15.137:0/1358998884 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc75c0afb30 con 0x7fc75c142d20 2024-04-26T23:43:09.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.767+0000 7fc763800640 1 -- 172.21.15.137:0/1358998884 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc75c161130 con 0x7fc75c142d20 2024-04-26T23:43:09.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.771+0000 7fc758c00640 1 -- 172.21.15.137:0/1358998884 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16717 (secure 0 0 0) 0x7fc754059ac0 con 0x7fc75c142d20 2024-04-26T23:43:09.777 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:09.777 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":33,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:42:26.483092+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:42:22.570062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:42:23.822598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:43:09.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.771+0000 7fc763800640 1 -- 172.21.15.137:0/1358998884 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc73c0683b0 msgr2=0x7fc73c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:09.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.771+0000 7fc763800640 1 --2- 172.21.15.137:0/1358998884 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc73c0683b0 0x7fc73c06a870 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0b6d60 tx=0x7fc750008040 comp rx=0 tx=0).stop 2024-04-26T23:43:09.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.771+0000 7fc763800640 1 -- 172.21.15.137:0/1358998884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc75c142d20 msgr2=0x7fc75c1431a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:09.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.771+0000 7fc763800640 1 --2- 172.21.15.137:0/1358998884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc75c142d20 0x7fc75c1431a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc75c06e850 tx=0x7fc754007bb0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.771+0000 7fc763800640 1 -- 172.21.15.137:0/1358998884 shutdown_connections 2024-04-26T23:43:09.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.771+0000 7fc763800640 1 --2- 172.21.15.137:0/1358998884 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc73c0683b0 0x7fc73c06a870 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.771+0000 7fc763800640 1 --2- 172.21.15.137:0/1358998884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc75c142d20 0x7fc75c1431a0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.771+0000 7fc763800640 1 --2- 172.21.15.137:0/1358998884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc75c06fc10 0x7fc75c070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.771+0000 7fc763800640 1 --2- 172.21.15.137:0/1358998884 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc744004810 0x7fc75c0b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.771+0000 7fc763800640 1 -- 172.21.15.137:0/1358998884 >> 172.21.15.137:0/1358998884 conn(0x7fc75c0b3370 msgr2=0x7fc75c1607b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:09.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.771+0000 7fc763800640 1 -- 172.21.15.137:0/1358998884 shutdown_connections 2024-04-26T23:43:09.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.771+0000 7fc763800640 1 -- 172.21.15.137:0/1358998884 wait complete. 2024-04-26T23:43:09.798 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T23:43:09.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.927+0000 7fb647c00640 1 Processor -- start 2024-04-26T23:43:09.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.927+0000 7fb647c00640 1 -- start start 2024-04-26T23:43:09.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.931+0000 7fb647c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6400ce3e0 0x7fb640073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:09.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.931+0000 7fb647c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb64015de80 0x7fb6400d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:09.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.931+0000 7fb647c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb640073010 con 0x7fb6400ce7c0 2024-04-26T23:43:09.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.931+0000 7fb647c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb6400cef90 con 0x7fb64015de80 2024-04-26T23:43:09.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.931+0000 7fb647c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb640073280 con 0x7fb6400ce3e0 2024-04-26T23:43:09.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.931+0000 7fb637e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb64015de80 0x7fb6400d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:09.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.931+0000 7fb637e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb64015de80 0x7fb6400d04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41452/0 (socket says 172.21.15.137:41452) 2024-04-26T23:43:09.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.931+0000 7fb637e00640 1 -- 172.21.15.137:0/2268575667 learned_addr learned my addr 172.21.15.137:0/2268575667 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:09.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.931+0000 7fb645200640 1 --2- 172.21.15.137:0/2268575667 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6400ce3e0 0x7fb640073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:09.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.931+0000 7fb637e00640 1 -- 172.21.15.137:0/2268575667 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6400ce3e0 msgr2=0x7fb640073d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:09.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.931+0000 7fb637e00640 1 --2- 172.21.15.137:0/2268575667 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6400ce3e0 0x7fb640073d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.931+0000 7fb637e00640 1 -- 172.21.15.137:0/2268575667 >> v1:172.21.15.170:6789/0 conn(0x7fb6400ce7c0 legacy=0x7fb640146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:09.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.931+0000 7fb637e00640 1 -- 172.21.15.137:0/2268575667 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb640073560 con 0x7fb64015de80 2024-04-26T23:43:09.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.931+0000 7fb645200640 1 --2- 172.21.15.137:0/2268575667 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6400ce3e0 0x7fb640073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:43:09.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.931+0000 7fb637e00640 1 --2- 172.21.15.137:0/2268575667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb64015de80 0x7fb6400d04e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb628009870 tx=0x7fb62801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6f558f7af99703 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:09.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.935+0000 7fb63fe00640 1 -- 172.21.15.137:0/2268575667 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6280aa430 con 0x7fb64015de80 2024-04-26T23:43:09.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.935+0000 7fb63fe00640 1 -- 172.21.15.137:0/2268575667 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6280af070 con 0x7fb64015de80 2024-04-26T23:43:09.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.935+0000 7fb63fe00640 1 -- 172.21.15.137:0/2268575667 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6280aa7f0 con 0x7fb64015de80 2024-04-26T23:43:09.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.935+0000 7fb647c00640 1 -- 172.21.15.137:0/2268575667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb64015de80 msgr2=0x7fb6400d04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:09.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.935+0000 7fb647c00640 1 --2- 172.21.15.137:0/2268575667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb64015de80 0x7fb6400d04e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb628009870 tx=0x7fb62801c4f0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.935+0000 7fb647c00640 1 -- 172.21.15.137:0/2268575667 shutdown_connections 2024-04-26T23:43:09.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.935+0000 7fb647c00640 1 --2- 172.21.15.137:0/2268575667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb64015de80 0x7fb6400d04e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.935+0000 7fb647c00640 1 --2- 172.21.15.137:0/2268575667 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6400ce3e0 0x7fb640073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.935+0000 7fb647c00640 1 -- 172.21.15.137:0/2268575667 >> 172.21.15.137:0/2268575667 conn(0x7fb64006c5d0 msgr2=0x7fb64006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:09.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.935+0000 7fb647c00640 1 -- 172.21.15.137:0/2268575667 shutdown_connections 2024-04-26T23:43:09.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.935+0000 7fb647c00640 1 -- 172.21.15.137:0/2268575667 wait complete. 2024-04-26T23:43:09.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.935+0000 7fb647c00640 1 Processor -- start 2024-04-26T23:43:09.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.935+0000 7fb647c00640 1 -- start start 2024-04-26T23:43:09.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.935+0000 7fb647c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6400ce3e0 0x7fb64013e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:09.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.935+0000 7fb647c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6400ce7c0 0x7fb64015c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:09.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.935+0000 7fb647c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb64015de80 0x7fb6400ab770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:09.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.935+0000 7fb647c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb640146aa0 con 0x7fb6400ce7c0 2024-04-26T23:43:09.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.935+0000 7fb647c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb640146920 con 0x7fb6400ce3e0 2024-04-26T23:43:09.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.935+0000 7fb647c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb64006ed10 con 0x7fb64015de80 2024-04-26T23:43:09.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.935+0000 7fb637e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6400ce7c0 0x7fb64015c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:09.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.935+0000 7fb637e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6400ce7c0 0x7fb64015c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41454/0 (socket says 172.21.15.137:41454) 2024-04-26T23:43:09.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.935+0000 7fb637e00640 1 -- 172.21.15.137:0/1021534057 learned_addr learned my addr 172.21.15.137:0/1021534057 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:09.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.939+0000 7fb645200640 1 --2- 172.21.15.137:0/1021534057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6400ce3e0 0x7fb64013e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:09.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.939+0000 7fb645c00640 1 --2- 172.21.15.137:0/1021534057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb64015de80 0x7fb6400ab770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:09.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.939+0000 7fb637e00640 1 -- 172.21.15.137:0/1021534057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb64015de80 msgr2=0x7fb6400ab770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:09.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.939+0000 7fb637e00640 1 --2- 172.21.15.137:0/1021534057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb64015de80 0x7fb6400ab770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.939+0000 7fb637e00640 1 -- 172.21.15.137:0/1021534057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6400ce3e0 msgr2=0x7fb64013e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:09.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.939+0000 7fb637e00640 1 --2- 172.21.15.137:0/1021534057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6400ce3e0 0x7fb64013e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:09.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.939+0000 7fb637e00640 1 -- 172.21.15.137:0/1021534057 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6401450d0 con 0x7fb6400ce7c0 2024-04-26T23:43:09.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.939+0000 7fb645200640 1 --2- 172.21.15.137:0/1021534057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6400ce3e0 0x7fb64013e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:09.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.939+0000 7fb645c00640 1 --2- 172.21.15.137:0/1021534057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb64015de80 0x7fb6400ab770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:09.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.939+0000 7fb637e00640 1 --2- 172.21.15.137:0/1021534057 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6400ce7c0 0x7fb64015c5a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb62801cd90 tx=0x7fb62801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:09.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.939+0000 7fb63d600640 1 -- 172.21.15.137:0/1021534057 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6280b3800 con 0x7fb6400ce7c0 2024-04-26T23:43:09.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.939+0000 7fb63d600640 1 -- 172.21.15.137:0/1021534057 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6280b39c0 con 0x7fb6400ce7c0 2024-04-26T23:43:09.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.939+0000 7fb647c00640 1 -- 172.21.15.137:0/1021534057 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6401453b0 con 0x7fb6400ce7c0 2024-04-26T23:43:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.939+0000 7fb63d600640 1 -- 172.21.15.137:0/1021534057 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6280b3db0 con 0x7fb6400ce7c0 2024-04-26T23:43:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.939+0000 7fb647c00640 1 -- 172.21.15.137:0/1021534057 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6400ab250 con 0x7fb6400ce7c0 2024-04-26T23:43:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.939+0000 7fb647c00640 1 -- 172.21.15.137:0/1021534057 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb64006a4b0 con 0x7fb6400ce7c0 2024-04-26T23:43:09.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.939+0000 7fb63d600640 1 -- 172.21.15.137:0/1021534057 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb6280c6390 con 0x7fb6400ce7c0 2024-04-26T23:43:09.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.939+0000 7fb63d600640 1 --2- 172.21.15.137:0/1021534057 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb61c068380 0x7fb61c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:09.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.939+0000 7fb63d600640 1 -- 172.21.15.137:0/1021534057 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fb628120fd0 con 0x7fb6400ce7c0 2024-04-26T23:43:09.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.939+0000 7fb645200640 1 --2- 172.21.15.137:0/1021534057 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb61c068380 0x7fb61c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:09.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.943+0000 7fb645200640 1 --2- 172.21.15.137:0/1021534057 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb61c068380 0x7fb61c06a840 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb630006fd0 tx=0x7fb630008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:09.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:09.943+0000 7fb63d600640 1 -- 172.21.15.137:0/1021534057 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb6280c3060 con 0x7fb6400ce7c0 2024-04-26T23:43:10.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.135+0000 7fb647c00640 1 -- 172.21.15.137:0/1021534057 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb640069690 con 0x7fb6400ce7c0 2024-04-26T23:43:10.142 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-04-26T23:43:10.135+0000 7f1be8800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T23:43:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.139+0000 7fb63d600640 1 -- 172.21.15.137:0/1021534057 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) ==== 161+0+0 (secure 0 0 0) 0x7fb628016110 con 0x7fb6400ce7c0 2024-04-26T23:43:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T23:43:10.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.143+0000 7fb647c00640 1 -- 172.21.15.137:0/1021534057 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb61c068380 msgr2=0x7fb61c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:10.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.143+0000 7fb647c00640 1 --2- 172.21.15.137:0/1021534057 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb61c068380 0x7fb61c06a840 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb630006fd0 tx=0x7fb630008040 comp rx=0 tx=0).stop 2024-04-26T23:43:10.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.143+0000 7fb647c00640 1 -- 172.21.15.137:0/1021534057 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6400ce7c0 msgr2=0x7fb64015c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:10.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.143+0000 7fb647c00640 1 --2- 172.21.15.137:0/1021534057 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6400ce7c0 0x7fb64015c5a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb62801cd90 tx=0x7fb62801ad30 comp rx=0 tx=0).stop 2024-04-26T23:43:10.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.143+0000 7fb647c00640 1 -- 172.21.15.137:0/1021534057 shutdown_connections 2024-04-26T23:43:10.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.143+0000 7fb647c00640 1 --2- 172.21.15.137:0/1021534057 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb61c068380 0x7fb61c06a840 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:10.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.143+0000 7fb647c00640 1 --2- 172.21.15.137:0/1021534057 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6400ce7c0 0x7fb64015c5a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:10.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.143+0000 7fb647c00640 1 --2- 172.21.15.137:0/1021534057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb64015de80 0x7fb6400ab770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:10.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.143+0000 7fb647c00640 1 --2- 172.21.15.137:0/1021534057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6400ce3e0 0x7fb64013e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:10.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.143+0000 7fb647c00640 1 -- 172.21.15.137:0/1021534057 >> 172.21.15.137:0/1021534057 conn(0x7fb64006c5d0 msgr2=0x7fb64013f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:10.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.143+0000 7fb647c00640 1 -- 172.21.15.137:0/1021534057 shutdown_connections 2024-04-26T23:43:10.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.143+0000 7fb647c00640 1 -- 172.21.15.137:0/1021534057 wait complete. 2024-04-26T23:43:10.153 INFO:tasks.ceph.mds.d.smithi170.stderr: -3369> 2024-04-26T23:42:17.605+0000 7fb944200640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-04-26T23:43:10.156 INFO:tasks.ceph.mds.d.smithi170.stderr: -2106> 2024-04-26T23:42:29.436+0000 7fb93ca00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:43:10.169 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T23:43:10.206 INFO:tasks.ceph.mds.d.smithi170.stdout:starting mds.d at 2024-04-26T23:43:10.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.299+0000 7fe702800640 1 Processor -- start 2024-04-26T23:43:10.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.299+0000 7fe702800640 1 -- start start 2024-04-26T23:43:10.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.303+0000 7fe702800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe6fc0b54e0 0x7fe6fc0b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:10.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.303+0000 7fe702800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe6fc0cd710 0x7fe6fc15f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:10.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.303+0000 7fe702800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6fc0cffa0 con 0x7fe6fc15fe30 2024-04-26T23:43:10.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.303+0000 7fe702800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe6fc0b3d90 con 0x7fe6fc0b54e0 2024-04-26T23:43:10.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.303+0000 7fe702800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe6fc0d0840 con 0x7fe6fc0cd710 2024-04-26T23:43:10.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.303+0000 7fe6fb400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe6fc0b54e0 0x7fe6fc0b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:10.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.303+0000 7fe6fb400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe6fc0b54e0 0x7fe6fc0b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41466/0 (socket says 172.21.15.137:41466) 2024-04-26T23:43:10.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.303+0000 7fe6fb400640 1 -- 172.21.15.137:0/2780830052 learned_addr learned my addr 172.21.15.137:0/2780830052 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:10.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.303+0000 7fe6f2a00640 1 --2- 172.21.15.137:0/2780830052 >> v2:172.21.15.170:3300/0 conn(0x7fe6fc0cd710 0x7fe6fc15f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:10.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.303+0000 7fe6fb400640 1 -- 172.21.15.137:0/2780830052 >> v2:172.21.15.170:3300/0 conn(0x7fe6fc0cd710 msgr2=0x7fe6fc15f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:10.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.303+0000 7fe6fb400640 1 --2- 172.21.15.137:0/2780830052 >> v2:172.21.15.170:3300/0 conn(0x7fe6fc0cd710 0x7fe6fc15f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:10.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.303+0000 7fe6fb400640 1 -- 172.21.15.137:0/2780830052 >> v1:172.21.15.170:6789/0 conn(0x7fe6fc15fe30 legacy=0x7fe6fc144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:10.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.303+0000 7fe6fb400640 1 -- 172.21.15.137:0/2780830052 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6fc0d0280 con 0x7fe6fc0b54e0 2024-04-26T23:43:10.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.307+0000 7fe6fb400640 1 --2- 172.21.15.137:0/2780830052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6fc0b54e0 0x7fe6fc0b5ee0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc070130 tx=0x7fe6ec01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564f24b872ac65f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:10.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.307+0000 7fe6faa00640 1 -- 172.21.15.137:0/2780830052 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0b0070 con 0x7fe6fc0b54e0 2024-04-26T23:43:10.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.307+0000 7fe6faa00640 1 -- 172.21.15.137:0/2780830052 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ec0ab600 con 0x7fe6fc0b54e0 2024-04-26T23:43:10.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.307+0000 7fe6faa00640 1 -- 172.21.15.137:0/2780830052 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0ab9d0 con 0x7fe6fc0b54e0 2024-04-26T23:43:10.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.307+0000 7fe702800640 1 -- 172.21.15.137:0/2780830052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6fc0b54e0 msgr2=0x7fe6fc0b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:10.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.307+0000 7fe702800640 1 --2- 172.21.15.137:0/2780830052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6fc0b54e0 0x7fe6fc0b5ee0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc070130 tx=0x7fe6ec01c520 comp rx=0 tx=0).stop 2024-04-26T23:43:10.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.307+0000 7fe702800640 1 -- 172.21.15.137:0/2780830052 shutdown_connections 2024-04-26T23:43:10.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.307+0000 7fe702800640 1 --2- 172.21.15.137:0/2780830052 >> v2:172.21.15.170:3300/0 conn(0x7fe6fc0cd710 0x7fe6fc15f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:10.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.307+0000 7fe702800640 1 --2- 172.21.15.137:0/2780830052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6fc0b54e0 0x7fe6fc0b5ee0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:10.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.307+0000 7fe702800640 1 -- 172.21.15.137:0/2780830052 >> 172.21.15.137:0/2780830052 conn(0x7fe6fc06c800 msgr2=0x7fe6fc06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:10.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.307+0000 7fe702800640 1 -- 172.21.15.137:0/2780830052 shutdown_connections 2024-04-26T23:43:10.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.307+0000 7fe702800640 1 -- 172.21.15.137:0/2780830052 wait complete. 2024-04-26T23:43:10.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.307+0000 7fe702800640 1 Processor -- start 2024-04-26T23:43:10.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.307+0000 7fe702800640 1 -- start start 2024-04-26T23:43:10.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe702800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6fc0b54e0 0x7fe6fc13b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:10.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe702800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6fc0cd710 0x7fe6fc142820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:10.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe702800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6fc15fe30 0x7fe6fc0b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:10.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe702800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc0cdb20 con 0x7fe6fc0b54e0 2024-04-26T23:43:10.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe702800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc145840 con 0x7fe6fc0cd710 2024-04-26T23:43:10.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe702800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe6fc13b770 con 0x7fe6fc15fe30 2024-04-26T23:43:10.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe6fb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6fc0b54e0 0x7fe6fc13b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:10.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe6fb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6fc0b54e0 0x7fe6fc13b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41482/0 (socket says 172.21.15.137:41482) 2024-04-26T23:43:10.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe6fb400640 1 -- 172.21.15.137:0/213529593 learned_addr learned my addr 172.21.15.137:0/213529593 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:10.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe6f2a00640 1 --2- 172.21.15.137:0/213529593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6fc0cd710 0x7fe6fc142820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:10.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe6fbe00640 1 --2- 172.21.15.137:0/213529593 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6fc15fe30 0x7fe6fc0b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:10.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe6fb400640 1 -- 172.21.15.137:0/213529593 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6fc15fe30 msgr2=0x7fe6fc0b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:10.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe6fb400640 1 --2- 172.21.15.137:0/213529593 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6fc15fe30 0x7fe6fc0b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:10.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe6fb400640 1 -- 172.21.15.137:0/213529593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6fc0cd710 msgr2=0x7fe6fc142820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:10.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe6fb400640 1 --2- 172.21.15.137:0/213529593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6fc0cd710 0x7fe6fc142820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:10.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe6fb400640 1 -- 172.21.15.137:0/213529593 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6fc142d60 con 0x7fe6fc0b54e0 2024-04-26T23:43:10.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe6fb400640 1 --2- 172.21.15.137:0/213529593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6fc0b54e0 0x7fe6fc13b230 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0ae040 tx=0x7fe6ec01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:10.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe6f3e00640 1 -- 172.21.15.137:0/213529593 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0ba020 con 0x7fe6fc0b54e0 2024-04-26T23:43:10.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe6f3e00640 1 -- 172.21.15.137:0/213529593 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ec0b6620 con 0x7fe6fc0b54e0 2024-04-26T23:43:10.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe702800640 1 -- 172.21.15.137:0/213529593 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6fc13dbf0 con 0x7fe6fc0b54e0 2024-04-26T23:43:10.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe6f3e00640 1 -- 172.21.15.137:0/213529593 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0b0040 con 0x7fe6fc0b54e0 2024-04-26T23:43:10.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe702800640 1 -- 172.21.15.137:0/213529593 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6fc13d630 con 0x7fe6fc0b54e0 2024-04-26T23:43:10.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe702800640 1 -- 172.21.15.137:0/213529593 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6fc06a410 con 0x7fe6fc0b54e0 2024-04-26T23:43:10.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.311+0000 7fe6f3e00640 1 -- 172.21.15.137:0/213529593 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe6ec0bd020 con 0x7fe6fc0b54e0 2024-04-26T23:43:10.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.315+0000 7fe6f3e00640 1 --2- 172.21.15.137:0/213529593 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6d8068380 0x7fe6d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:10.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.315+0000 7fe6f3e00640 1 -- 172.21.15.137:0/213529593 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5795+0+0 (secure 0 0 0) 0x7fe6ec120b70 con 0x7fe6fc0b54e0 2024-04-26T23:43:10.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.315+0000 7fe6f2a00640 1 --2- 172.21.15.137:0/213529593 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6d8068380 0x7fe6d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:10.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.315+0000 7fe6f2a00640 1 --2- 172.21.15.137:0/213529593 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6d8068380 0x7fe6d806a840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc0cd660 tx=0x7fe6e4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:10.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.319+0000 7fe6f3e00640 1 -- 172.21.15.137:0/213529593 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe6ec0c4030 con 0x7fe6fc0b54e0 2024-04-26T23:43:10.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:10.511+0000 7fe702800640 1 -- 172.21.15.137:0/213529593 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe6fc0b2a20 con 0x7fe6fc0b54e0 2024-04-26T23:43:11.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.143+0000 7fe6f3e00640 1 -- 172.21.15.137:0/213529593 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7fe6ec016110 con 0x7fe6fc0b54e0 2024-04-26T23:43:11.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.143+0000 7fe702800640 1 -- 172.21.15.137:0/213529593 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6d8068380 msgr2=0x7fe6d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:11.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.143+0000 7fe702800640 1 --2- 172.21.15.137:0/213529593 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6d8068380 0x7fe6d806a840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc0cd660 tx=0x7fe6e4008040 comp rx=0 tx=0).stop 2024-04-26T23:43:11.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.143+0000 7fe702800640 1 -- 172.21.15.137:0/213529593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6fc0b54e0 msgr2=0x7fe6fc13b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:11.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.143+0000 7fe702800640 1 --2- 172.21.15.137:0/213529593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6fc0b54e0 0x7fe6fc13b230 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0ae040 tx=0x7fe6ec01ad60 comp rx=0 tx=0).stop 2024-04-26T23:43:11.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.143+0000 7fe702800640 1 -- 172.21.15.137:0/213529593 shutdown_connections 2024-04-26T23:43:11.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.143+0000 7fe702800640 1 --2- 172.21.15.137:0/213529593 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6d8068380 0x7fe6d806a840 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:11.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.143+0000 7fe702800640 1 --2- 172.21.15.137:0/213529593 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6fc15fe30 0x7fe6fc0b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:11.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.143+0000 7fe702800640 1 --2- 172.21.15.137:0/213529593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6fc0cd710 0x7fe6fc142820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:11.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.143+0000 7fe702800640 1 --2- 172.21.15.137:0/213529593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6fc0b54e0 0x7fe6fc13b230 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:11.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.143+0000 7fe702800640 1 -- 172.21.15.137:0/213529593 >> 172.21.15.137:0/213529593 conn(0x7fe6fc06c800 msgr2=0x7fe6fc06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:11.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.143+0000 7fe702800640 1 -- 172.21.15.137:0/213529593 shutdown_connections 2024-04-26T23:43:11.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.143+0000 7fe702800640 1 -- 172.21.15.137:0/213529593 wait complete. 2024-04-26T23:43:11.172 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T23:43:11.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.307+0000 7f7ca0e00640 1 Processor -- start 2024-04-26T23:43:11.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.307+0000 7f7ca0e00640 1 -- start start 2024-04-26T23:43:11.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.307+0000 7f7ca0e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7c9c13f110 0x7f7c9c073a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:11.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.307+0000 7f7ca0e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c9c073f40 0x7f7c9c0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:11.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.307+0000 7f7ca0e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c9c06d240 con 0x7f7c9c0cfc00 2024-04-26T23:43:11.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.307+0000 7f7ca0e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7c9c13f660 con 0x7f7c9c13f110 2024-04-26T23:43:11.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.307+0000 7f7ca0e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7c9c0d0410 con 0x7f7c9c073f40 2024-04-26T23:43:11.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.307+0000 7f7c99e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7c9c13f110 0x7f7c9c073a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:11.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.307+0000 7f7c99e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7c9c13f110 0x7f7c9c073a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43722/0 (socket says 172.21.15.137:43722) 2024-04-26T23:43:11.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.307+0000 7f7c99e00640 1 -- 172.21.15.137:0/4018670809 learned_addr learned my addr 172.21.15.137:0/4018670809 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:11.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.307+0000 7f7c99400640 1 --2- 172.21.15.137:0/4018670809 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c9c073f40 0x7f7c9c0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:11.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.307+0000 7f7c99e00640 1 -- 172.21.15.137:0/4018670809 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c9c073f40 msgr2=0x7f7c9c0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:11.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.307+0000 7f7c99e00640 1 --2- 172.21.15.137:0/4018670809 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c9c073f40 0x7f7c9c0cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:11.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.307+0000 7f7c99e00640 1 -- 172.21.15.137:0/4018670809 >> v1:172.21.15.170:6789/0 conn(0x7f7c9c0cfc00 legacy=0x7f7c9c1416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:11.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.307+0000 7f7c99e00640 1 -- 172.21.15.137:0/4018670809 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9c0d06f0 con 0x7f7c9c13f110 2024-04-26T23:43:11.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.307+0000 7f7c99400640 1 --2- 172.21.15.137:0/4018670809 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c9c073f40 0x7f7c9c0cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:43:11.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.311+0000 7f7c99e00640 1 --2- 172.21.15.137:0/4018670809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c9c13f110 0x7f7c9c073a00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c009870 tx=0x7f7c8c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da87db4eb09ae0c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:11.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.311+0000 7f7c98a00640 1 -- 172.21.15.137:0/4018670809 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c0aa660 con 0x7f7c9c13f110 2024-04-26T23:43:11.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.311+0000 7f7c98a00640 1 -- 172.21.15.137:0/4018670809 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c8c0af070 con 0x7f7c9c13f110 2024-04-26T23:43:11.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.311+0000 7f7c98a00640 1 -- 172.21.15.137:0/4018670809 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c0aaa20 con 0x7f7c9c13f110 2024-04-26T23:43:11.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.311+0000 7f7ca0e00640 1 -- 172.21.15.137:0/4018670809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c9c13f110 msgr2=0x7f7c9c073a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:11.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.311+0000 7f7ca0e00640 1 --2- 172.21.15.137:0/4018670809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c9c13f110 0x7f7c9c073a00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c009870 tx=0x7f7c8c01c520 comp rx=0 tx=0).stop 2024-04-26T23:43:11.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.311+0000 7f7ca0e00640 1 -- 172.21.15.137:0/4018670809 shutdown_connections 2024-04-26T23:43:11.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.311+0000 7f7ca0e00640 1 --2- 172.21.15.137:0/4018670809 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c9c073f40 0x7f7c9c0cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:11.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.311+0000 7f7ca0e00640 1 --2- 172.21.15.137:0/4018670809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c9c13f110 0x7f7c9c073a00 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:11.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.311+0000 7f7ca0e00640 1 -- 172.21.15.137:0/4018670809 >> 172.21.15.137:0/4018670809 conn(0x7f7c9c06e2d0 msgr2=0x7f7c9c06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:11.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.311+0000 7f7ca0e00640 1 -- 172.21.15.137:0/4018670809 shutdown_connections 2024-04-26T23:43:11.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.311+0000 7f7ca0e00640 1 -- 172.21.15.137:0/4018670809 wait complete. 2024-04-26T23:43:11.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.311+0000 7f7ca0e00640 1 Processor -- start 2024-04-26T23:43:11.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7ca0e00640 1 -- start start 2024-04-26T23:43:11.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7ca0e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c9c073f40 0x7f7c9c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:11.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7ca0e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c9c0cfc00 0x7f7c9c137140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:11.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7ca0e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c9c13f110 0x7f7c9c154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:11.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7ca0e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c0d01d0 con 0x7f7c9c13f110 2024-04-26T23:43:11.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7ca0e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c0d0050 con 0x7f7c9c073f40 2024-04-26T23:43:11.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7ca0e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7c9c166c00 con 0x7f7c9c0cfc00 2024-04-26T23:43:11.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7c9a800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c9c13f110 0x7f7c9c154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:11.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7c99400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c9c0cfc00 0x7f7c9c137140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:11.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7c9a800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c9c13f110 0x7f7c9c154fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43730/0 (socket says 172.21.15.137:43730) 2024-04-26T23:43:11.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7c9a800640 1 -- 172.21.15.137:0/3023224358 learned_addr learned my addr 172.21.15.137:0/3023224358 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:11.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7c99e00640 1 --2- 172.21.15.137:0/3023224358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c9c073f40 0x7f7c9c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:11.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7c9a800640 1 -- 172.21.15.137:0/3023224358 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c9c0cfc00 msgr2=0x7f7c9c137140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:11.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7c9a800640 1 --2- 172.21.15.137:0/3023224358 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c9c0cfc00 0x7f7c9c137140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:11.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7c9a800640 1 -- 172.21.15.137:0/3023224358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c9c073f40 msgr2=0x7f7c9c15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:11.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7c9a800640 1 --2- 172.21.15.137:0/3023224358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c9c073f40 0x7f7c9c15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:11.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7c9a800640 1 -- 172.21.15.137:0/3023224358 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9c137680 con 0x7f7c9c13f110 2024-04-26T23:43:11.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7c9a800640 1 --2- 172.21.15.137:0/3023224358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c9c13f110 0x7f7c9c154fb0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400c7b0 tx=0x7f7c9400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:11.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7c92000640 1 -- 172.21.15.137:0/3023224358 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c94004b70 con 0x7f7c9c13f110 2024-04-26T23:43:11.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7c92000640 1 -- 172.21.15.137:0/3023224358 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c94004d10 con 0x7f7c9c13f110 2024-04-26T23:43:11.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7c92000640 1 -- 172.21.15.137:0/3023224358 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9400aa90 con 0x7f7c9c13f110 2024-04-26T23:43:11.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7ca0e00640 1 -- 172.21.15.137:0/3023224358 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c9c155c10 con 0x7f7c9c13f110 2024-04-26T23:43:11.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7ca0e00640 1 -- 172.21.15.137:0/3023224358 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c9c155eb0 con 0x7f7c9c13f110 2024-04-26T23:43:11.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.315+0000 7f7ca0e00640 1 -- 172.21.15.137:0/3023224358 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c9c0765d0 con 0x7f7c9c13f110 2024-04-26T23:43:11.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.319+0000 7f7c92000640 1 -- 172.21.15.137:0/3023224358 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7c9400ac30 con 0x7f7c9c13f110 2024-04-26T23:43:11.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.319+0000 7f7c92000640 1 --2- 172.21.15.137:0/3023224358 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c7c068380 0x7f7c7c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:11.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.319+0000 7f7c92000640 1 -- 172.21.15.137:0/3023224358 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5795+0+0 (secure 0 0 0) 0x7f7c94086a80 con 0x7f7c9c13f110 2024-04-26T23:43:11.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.319+0000 7f7c99e00640 1 --2- 172.21.15.137:0/3023224358 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c7c068380 0x7f7c7c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:11.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.319+0000 7f7c99e00640 1 --2- 172.21.15.137:0/3023224358 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c7c068380 0x7f7c7c06a840 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c0ae000 tx=0x7f7c8c0a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:11.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.323+0000 7f7c92000640 1 -- 172.21.15.137:0/3023224358 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7c94020070 con 0x7f7c9c13f110 2024-04-26T23:43:11.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:11.483+0000 7f7ca0e00640 1 -- 172.21.15.137:0/3023224358 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7c9c13d5f0 con 0x7f7c9c13f110 2024-04-26T23:43:12.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.147+0000 7f7c92000640 1 -- 172.21.15.137:0/3023224358 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) ==== 181+0+0 (secure 0 0 0) 0x7f7c94056a20 con 0x7f7c9c13f110 2024-04-26T23:43:12.153 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' removed 2024-04-26T23:43:12.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.151+0000 7f7ca0e00640 1 -- 172.21.15.137:0/3023224358 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c7c068380 msgr2=0x7f7c7c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:12.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.151+0000 7f7ca0e00640 1 --2- 172.21.15.137:0/3023224358 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c7c068380 0x7f7c7c06a840 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c0ae000 tx=0x7f7c8c0a7000 comp rx=0 tx=0).stop 2024-04-26T23:43:12.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.151+0000 7f7ca0e00640 1 -- 172.21.15.137:0/3023224358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c9c13f110 msgr2=0x7f7c9c154fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:12.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.151+0000 7f7ca0e00640 1 --2- 172.21.15.137:0/3023224358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c9c13f110 0x7f7c9c154fb0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400c7b0 tx=0x7f7c9400cc70 comp rx=0 tx=0).stop 2024-04-26T23:43:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.151+0000 7f7ca0e00640 1 -- 172.21.15.137:0/3023224358 shutdown_connections 2024-04-26T23:43:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.151+0000 7f7ca0e00640 1 --2- 172.21.15.137:0/3023224358 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c7c068380 0x7f7c7c06a840 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.151+0000 7f7ca0e00640 1 --2- 172.21.15.137:0/3023224358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c9c13f110 0x7f7c9c154fb0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.151+0000 7f7ca0e00640 1 --2- 172.21.15.137:0/3023224358 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c9c0cfc00 0x7f7c9c137140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.151+0000 7f7ca0e00640 1 --2- 172.21.15.137:0/3023224358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c9c073f40 0x7f7c9c15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.151+0000 7f7ca0e00640 1 -- 172.21.15.137:0/3023224358 >> 172.21.15.137:0/3023224358 conn(0x7f7c9c06e2d0 msgr2=0x7f7c9c06eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.151+0000 7f7ca0e00640 1 -- 172.21.15.137:0/3023224358 shutdown_connections 2024-04-26T23:43:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.151+0000 7f7ca0e00640 1 -- 172.21.15.137:0/3023224358 wait complete. 2024-04-26T23:43:12.180 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T23:43:12.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f7fc00640 1 Processor -- start 2024-04-26T23:43:12.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f7fc00640 1 -- start start 2024-04-26T23:43:12.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f7fc00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7f7815fa00 0x7f7f78073490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:12.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f7fc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f780739d0 0x7f7f780cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:12.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f7fc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f7806d240 con 0x7f7f780b6a30 2024-04-26T23:43:12.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f7fc00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f7f780cf790 con 0x7f7f7815fa00 2024-04-26T23:43:12.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f7fc00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7f780741f0 con 0x7f7f780739d0 2024-04-26T23:43:12.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f7d200640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f7f780b6a30 0x7f7f7815f2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:38030/0 (socket says 172.21.15.137:38030) 2024-04-26T23:43:12.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f7d200640 1 -- 172.21.15.137:0/2145432927 learned_addr learned my addr 172.21.15.137:0/2145432927 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:12.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f77e00640 1 --2- 172.21.15.137:0/2145432927 >> v2:172.21.15.170:3300/0 conn(0x7f7f7815fa00 0x7f7f78073490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:12.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f7dc00640 1 --2- 172.21.15.137:0/2145432927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f780739d0 0x7f7f780cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:12.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f77400640 1 -- 172.21.15.137:0/2145432927 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3943670758 0 0) 0x7f7f7806d240 con 0x7f7f780b6a30 2024-04-26T23:43:12.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f77400640 1 -- 172.21.15.137:0/2145432927 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f60003530 con 0x7f7f780b6a30 2024-04-26T23:43:12.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f77400640 1 -- 172.21.15.137:0/2145432927 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1355215229 0 0) 0x7f7f60003530 con 0x7f7f780b6a30 2024-04-26T23:43:12.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f77400640 1 -- 172.21.15.137:0/2145432927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f780739d0 msgr2=0x7f7f780cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:12.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f77400640 1 --2- 172.21.15.137:0/2145432927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f780739d0 0x7f7f780cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:12.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f77400640 1 -- 172.21.15.137:0/2145432927 >> v2:172.21.15.170:3300/0 conn(0x7f7f7815fa00 msgr2=0x7f7f78073490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:12.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f77400640 1 --2- 172.21.15.137:0/2145432927 >> v2:172.21.15.170:3300/0 conn(0x7f7f7815fa00 0x7f7f78073490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:12.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f77400640 1 -- 172.21.15.137:0/2145432927 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f780cf140 con 0x7f7f780b6a30 2024-04-26T23:43:12.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f77400640 1 -- 172.21.15.137:0/2145432927 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f7f6c001680 con 0x7f7f780b6a30 2024-04-26T23:43:12.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f77400640 1 -- 172.21.15.137:0/2145432927 >> v1:172.21.15.137:6789/0 conn(0x7f7f780b6a30 legacy=0x7f7f7815f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:12.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f77400640 1 --2- 172.21.15.137:0/2145432927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f780739d0 0x7f7f600039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:12.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f77400640 1 --2- 172.21.15.137:0/2145432927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f60003f40 0x7f7f60004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:12.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f77400640 1 --2- 172.21.15.137:0/2145432927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f60004d50 0x7f7f600051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:12.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f77400640 1 -- 172.21.15.137:0/2145432927 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7f780cf790 con 0x7f7f60004d50 2024-04-26T23:43:12.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f77400640 1 -- 172.21.15.137:0/2145432927 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7f780741f0 con 0x7f7f60003f40 2024-04-26T23:43:12.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f77400640 1 -- 172.21.15.137:0/2145432927 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7f6000b9d0 con 0x7f7f780739d0 2024-04-26T23:43:12.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f77e00640 1 --2- 172.21.15.137:0/2145432927 >> v2:172.21.15.170:3300/0 conn(0x7f7f7815fa00 0x7f7f78073490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:43:12.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f7dc00640 1 --2- 172.21.15.137:0/2145432927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f60004d50 0x7f7f600051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:12.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f7d200640 1 --2- 172.21.15.137:0/2145432927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f780739d0 0x7f7f600039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:12.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f77e00640 1 --2- 172.21.15.137:0/2145432927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f60003f40 0x7f7f60004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:12.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f7dc00640 1 -- 172.21.15.137:0/2145432927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f780739d0 msgr2=0x7f7f600039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:12.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f7dc00640 1 --2- 172.21.15.137:0/2145432927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f780739d0 0x7f7f600039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:12.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f7dc00640 1 -- 172.21.15.137:0/2145432927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f60003f40 msgr2=0x7f7f60004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:12.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f7dc00640 1 --2- 172.21.15.137:0/2145432927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f60003f40 0x7f7f60004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:12.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.315+0000 7f7f7dc00640 1 -- 172.21.15.137:0/2145432927 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f60003530 con 0x7f7f60004d50 2024-04-26T23:43:12.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.319+0000 7f7f7dc00640 1 --2- 172.21.15.137:0/2145432927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f60004d50 0x7f7f600051d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009fc0 tx=0x7f7f7001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3de589a25c0f97 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:12.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.319+0000 7f7f77400640 1 -- 172.21.15.137:0/2145432927 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f700b2070 con 0x7f7f60004d50 2024-04-26T23:43:12.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.319+0000 7f7f77400640 1 -- 172.21.15.137:0/2145432927 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f700a5c90 con 0x7f7f60004d50 2024-04-26T23:43:12.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.319+0000 7f7f77400640 1 -- 172.21.15.137:0/2145432927 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f70009c10 con 0x7f7f60004d50 2024-04-26T23:43:12.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.319+0000 7f7f7fc00640 1 -- 172.21.15.137:0/2145432927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f60004d50 msgr2=0x7f7f600051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:12.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.319+0000 7f7f7fc00640 1 --2- 172.21.15.137:0/2145432927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f60004d50 0x7f7f600051d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009fc0 tx=0x7f7f7001cc20 comp rx=0 tx=0).stop 2024-04-26T23:43:12.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.319+0000 7f7f7dc00640 1 -- 172.21.15.137:0/2145432927 reap_dead start 2024-04-26T23:43:12.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.319+0000 7f7f7fc00640 1 -- 172.21.15.137:0/2145432927 shutdown_connections 2024-04-26T23:43:12.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.319+0000 7f7f7fc00640 1 -- 172.21.15.137:0/2145432927 >> 172.21.15.137:0/2145432927 conn(0x7f7f7806e2d0 msgr2=0x7f7f7806e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:12.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.319+0000 7f7f7fc00640 1 -- 172.21.15.137:0/2145432927 shutdown_connections 2024-04-26T23:43:12.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.319+0000 7f7f7fc00640 1 -- 172.21.15.137:0/2145432927 wait complete. 2024-04-26T23:43:12.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f7fc00640 1 Processor -- start 2024-04-26T23:43:12.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f7fc00640 1 -- start start 2024-04-26T23:43:12.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f7fc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f60004d50 0x7f7f7815b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:12.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f7fc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f781f58a0 0x7f7f7813d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:12.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f7fc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f7813d890 0x7f7f7815e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:12.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f7fc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7f780b6e10 con 0x7f7f781f58a0 2024-04-26T23:43:12.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f7fc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7f780cee30 con 0x7f7f60004d50 2024-04-26T23:43:12.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f7fc00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7f78073e40 con 0x7f7f7813d890 2024-04-26T23:43:12.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f77e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f781f58a0 0x7f7f7813d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:12.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f77e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f781f58a0 0x7f7f7813d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43752/0 (socket says 172.21.15.137:43752) 2024-04-26T23:43:12.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f77e00640 1 -- 172.21.15.137:0/3167954330 learned_addr learned my addr 172.21.15.137:0/3167954330 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:12.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f7d200640 1 --2- 172.21.15.137:0/3167954330 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f60004d50 0x7f7f7815b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:12.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f7dc00640 1 --2- 172.21.15.137:0/3167954330 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f7813d890 0x7f7f7815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:12.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f77e00640 1 -- 172.21.15.137:0/3167954330 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f7813d890 msgr2=0x7f7f7815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:12.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f77e00640 1 --2- 172.21.15.137:0/3167954330 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f7813d890 0x7f7f7815e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:12.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f77e00640 1 -- 172.21.15.137:0/3167954330 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f60004d50 msgr2=0x7f7f7815b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:12.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f77e00640 1 --2- 172.21.15.137:0/3167954330 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f60004d50 0x7f7f7815b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:12.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f77e00640 1 -- 172.21.15.137:0/3167954330 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f78138f40 con 0x7f7f781f58a0 2024-04-26T23:43:12.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f77e00640 1 --2- 172.21.15.137:0/3167954330 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f781f58a0 0x7f7f7813d350 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7f64011930 tx=0x7f7f64011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:12.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f74c00640 1 -- 172.21.15.137:0/3167954330 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6400fbd0 con 0x7f7f781f58a0 2024-04-26T23:43:12.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f74c00640 1 -- 172.21.15.137:0/3167954330 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f6400fd70 con 0x7f7f781f58a0 2024-04-26T23:43:12.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f7fc00640 1 -- 172.21.15.137:0/3167954330 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f781391e0 con 0x7f7f781f58a0 2024-04-26T23:43:12.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f74c00640 1 -- 172.21.15.137:0/3167954330 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64015660 con 0x7f7f781f58a0 2024-04-26T23:43:12.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.323+0000 7f7f7fc00640 1 -- 172.21.15.137:0/3167954330 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f781397a0 con 0x7f7f781f58a0 2024-04-26T23:43:12.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.327+0000 7f7f7fc00640 1 -- 172.21.15.137:0/3167954330 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f780765d0 con 0x7f7f781f58a0 2024-04-26T23:43:12.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.327+0000 7f7f74c00640 1 -- 172.21.15.137:0/3167954330 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7f64015800 con 0x7f7f781f58a0 2024-04-26T23:43:12.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.327+0000 7f7f74c00640 1 --2- 172.21.15.137:0/3167954330 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7f58068380 0x7f7f5806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:12.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.327+0000 7f7f74c00640 1 -- 172.21.15.137:0/3167954330 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5357+0+0 (secure 0 0 0) 0x7f7f64087270 con 0x7f7f781f58a0 2024-04-26T23:43:12.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.327+0000 7f7f7d200640 1 --2- 172.21.15.137:0/3167954330 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7f58068380 0x7f7f5806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:12.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.327+0000 7f7f7d200640 1 --2- 172.21.15.137:0/3167954330 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7f58068380 0x7f7f5806a840 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7f7813e0d0 tx=0x7f7f6c007900 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:12.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.331+0000 7f7f74c00640 1 -- 172.21.15.137:0/3167954330 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7f64019030 con 0x7f7f781f58a0 2024-04-26T23:43:12.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:12.491+0000 7f7f7fc00640 1 -- 172.21.15.137:0/3167954330 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7f7815b740 con 0x7f7f781f58a0 2024-04-26T23:43:13.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.151+0000 7f7f74c00640 1 -- 172.21.15.137:0/3167954330 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) ==== 169+0+0 (secure 0 0 0) 0x7f7f64057980 con 0x7f7f781f58a0 2024-04-26T23:43:13.159 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' removed 2024-04-26T23:43:13.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.155+0000 7f7f7fc00640 1 -- 172.21.15.137:0/3167954330 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7f58068380 msgr2=0x7f7f5806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:13.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.155+0000 7f7f7fc00640 1 --2- 172.21.15.137:0/3167954330 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7f58068380 0x7f7f5806a840 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7f7813e0d0 tx=0x7f7f6c007900 comp rx=0 tx=0).stop 2024-04-26T23:43:13.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.155+0000 7f7f7fc00640 1 -- 172.21.15.137:0/3167954330 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f781f58a0 msgr2=0x7f7f7813d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:13.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.155+0000 7f7f7fc00640 1 --2- 172.21.15.137:0/3167954330 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f781f58a0 0x7f7f7813d350 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7f64011930 tx=0x7f7f64011d30 comp rx=0 tx=0).stop 2024-04-26T23:43:13.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.155+0000 7f7f7fc00640 1 -- 172.21.15.137:0/3167954330 shutdown_connections 2024-04-26T23:43:13.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.155+0000 7f7f7fc00640 1 --2- 172.21.15.137:0/3167954330 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7f58068380 0x7f7f5806a840 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:13.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.155+0000 7f7f7fc00640 1 --2- 172.21.15.137:0/3167954330 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f781f58a0 0x7f7f7813d350 secure :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7f64011930 tx=0x7f7f64011d30 comp rx=0 tx=0).stop 2024-04-26T23:43:13.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.155+0000 7f7f7fc00640 1 --2- 172.21.15.137:0/3167954330 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f7813d890 0x7f7f7815e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:13.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.155+0000 7f7f7fc00640 1 --2- 172.21.15.137:0/3167954330 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f60004d50 0x7f7f7815b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:13.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.155+0000 7f7f7fc00640 1 -- 172.21.15.137:0/3167954330 >> 172.21.15.137:0/3167954330 conn(0x7f7f7806e2d0 msgr2=0x7f7f780727f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:13.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.159+0000 7f7f7fc00640 1 -- 172.21.15.137:0/3167954330 shutdown_connections 2024-04-26T23:43:13.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.159+0000 7f7f7fc00640 1 -- 172.21.15.137:0/3167954330 wait complete. 2024-04-26T23:43:13.195 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-26T23:43:13.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.327+0000 7f13d3c00640 1 Processor -- start 2024-04-26T23:43:13.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.327+0000 7f13d3c00640 1 -- start start 2024-04-26T23:43:13.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.331+0000 7f13d3c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f13cc0b54e0 0x7f13cc0b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:13.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.331+0000 7f13d3c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13cc160000 0x7f13cc144d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:13.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.331+0000 7f13d3c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13cc0cffa0 con 0x7f13cc0cd710 2024-04-26T23:43:13.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.331+0000 7f13d3c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f13cc0b3d90 con 0x7f13cc0b54e0 2024-04-26T23:43:13.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.331+0000 7f13d3c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f13cc0d0840 con 0x7f13cc160000 2024-04-26T23:43:13.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.331+0000 7f13d1200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f13cc0b54e0 0x7f13cc0b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:13.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.331+0000 7f13cbe00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f13cc0cd710 0x7f13cc15f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:38042/0 (socket says 172.21.15.137:38042) 2024-04-26T23:43:13.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.331+0000 7f13d1200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f13cc0b54e0 0x7f13cc0b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43766/0 (socket says 172.21.15.137:43766) 2024-04-26T23:43:13.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.331+0000 7f13cbe00640 1 -- 172.21.15.137:0/2926137494 learned_addr learned my addr 172.21.15.137:0/2926137494 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:13.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.331+0000 7f13d1c00640 1 --2- 172.21.15.137:0/2926137494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13cc160000 0x7f13cc144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:13.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.331+0000 7f13d1200640 1 -- 172.21.15.137:0/2926137494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13cc160000 msgr2=0x7f13cc144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:13.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.331+0000 7f13d1200640 1 --2- 172.21.15.137:0/2926137494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13cc160000 0x7f13cc144d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:13.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.331+0000 7f13d1200640 1 -- 172.21.15.137:0/2926137494 >> v1:172.21.15.137:6789/0 conn(0x7f13cc0cd710 legacy=0x7f13cc15f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:13.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.331+0000 7f13cb400640 1 -- 172.21.15.137:0/2926137494 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2861364607 0 0) 0x7f13cc0cffa0 con 0x7f13cc0cd710 2024-04-26T23:43:13.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.331+0000 7f13d1200640 1 -- 172.21.15.137:0/2926137494 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13cc0d0280 con 0x7f13cc0b54e0 2024-04-26T23:43:13.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.331+0000 7f13d1c00640 1 --2- 172.21.15.137:0/2926137494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13cc160000 0x7f13cc144d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:43:13.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.335+0000 7f13d1200640 1 --2- 172.21.15.137:0/2926137494 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13cc0b54e0 0x7f13cc0b5ee0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f13c000ba60 tx=0x7f13c001eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61348b37fc6f9224 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:13.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.335+0000 7f13cb400640 1 -- 172.21.15.137:0/2926137494 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c00b4070 con 0x7f13cc0b54e0 2024-04-26T23:43:13.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.335+0000 7f13cb400640 1 -- 172.21.15.137:0/2926137494 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13cc145a70 con 0x7f13cc0b54e0 2024-04-26T23:43:13.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.335+0000 7f13cb400640 1 -- 172.21.15.137:0/2926137494 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c00a7e50 con 0x7f13cc0b54e0 2024-04-26T23:43:13.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.335+0000 7f13d3c00640 1 -- 172.21.15.137:0/2926137494 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13cc0b54e0 msgr2=0x7f13cc0b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:13.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.335+0000 7f13d3c00640 1 --2- 172.21.15.137:0/2926137494 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13cc0b54e0 0x7f13cc0b5ee0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f13c000ba60 tx=0x7f13c001eb40 comp rx=0 tx=0).stop 2024-04-26T23:43:13.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.335+0000 7f13d3c00640 1 -- 172.21.15.137:0/2926137494 shutdown_connections 2024-04-26T23:43:13.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.335+0000 7f13d3c00640 1 --2- 172.21.15.137:0/2926137494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13cc160000 0x7f13cc144d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:13.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.335+0000 7f13d3c00640 1 --2- 172.21.15.137:0/2926137494 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13cc0b54e0 0x7f13cc0b5ee0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:13.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.335+0000 7f13d3c00640 1 -- 172.21.15.137:0/2926137494 >> 172.21.15.137:0/2926137494 conn(0x7f13cc06c800 msgr2=0x7f13cc06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:13.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.335+0000 7f13d3c00640 1 -- 172.21.15.137:0/2926137494 shutdown_connections 2024-04-26T23:43:13.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.335+0000 7f13d3c00640 1 -- 172.21.15.137:0/2926137494 wait complete. 2024-04-26T23:43:13.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.335+0000 7f13d3c00640 1 Processor -- start 2024-04-26T23:43:13.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.335+0000 7f13d3c00640 1 -- start start 2024-04-26T23:43:13.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13d3c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13cc0b54e0 0x7f13cc1349e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:13.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13d3c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13cc0cd710 0x7f13cc1fb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:13.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13d3c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13cc160000 0x7f13cc1fb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:13.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13d3c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc06ef60 con 0x7f13cc0cd710 2024-04-26T23:43:13.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13d3c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc0cdb40 con 0x7f13cc0b54e0 2024-04-26T23:43:13.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13d3c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f13cc06f0e0 con 0x7f13cc160000 2024-04-26T23:43:13.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13cbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13cc0cd710 0x7f13cc1fb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:13.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13cbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13cc0cd710 0x7f13cc1fb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43772/0 (socket says 172.21.15.137:43772) 2024-04-26T23:43:13.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13cbe00640 1 -- 172.21.15.137:0/826317102 learned_addr learned my addr 172.21.15.137:0/826317102 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:13.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13d1200640 1 --2- 172.21.15.137:0/826317102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13cc0b54e0 0x7f13cc1349e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:13.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13d1c00640 1 --2- 172.21.15.137:0/826317102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13cc160000 0x7f13cc1fb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:13.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13cbe00640 1 -- 172.21.15.137:0/826317102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13cc160000 msgr2=0x7f13cc1fb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:13.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13cbe00640 1 --2- 172.21.15.137:0/826317102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13cc160000 0x7f13cc1fb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:13.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13cbe00640 1 -- 172.21.15.137:0/826317102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13cc0b54e0 msgr2=0x7f13cc1349e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:13.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13cbe00640 1 --2- 172.21.15.137:0/826317102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13cc0b54e0 0x7f13cc1349e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:13.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13cbe00640 1 -- 172.21.15.137:0/826317102 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13cc131840 con 0x7f13cc0cd710 2024-04-26T23:43:13.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13cbe00640 1 --2- 172.21.15.137:0/826317102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13cc0cd710 0x7f13cc1fb1c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f13b800c520 tx=0x7f13b800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:13.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13c8c00640 1 -- 172.21.15.137:0/826317102 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8018070 con 0x7f13cc0cd710 2024-04-26T23:43:13.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13c8c00640 1 -- 172.21.15.137:0/826317102 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b80074e0 con 0x7f13cc0cd710 2024-04-26T23:43:13.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13c8c00640 1 -- 172.21.15.137:0/826317102 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b80049f0 con 0x7f13cc0cd710 2024-04-26T23:43:13.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13d3c00640 1 -- 172.21.15.137:0/826317102 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13cc131b20 con 0x7f13cc0cd710 2024-04-26T23:43:13.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13d3c00640 1 -- 172.21.15.137:0/826317102 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13cc1320e0 con 0x7f13cc0cd710 2024-04-26T23:43:13.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13d3c00640 1 -- 172.21.15.137:0/826317102 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13cc06a410 con 0x7f13cc0cd710 2024-04-26T23:43:13.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.339+0000 7f13c8c00640 1 -- 172.21.15.137:0/826317102 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f13b801b070 con 0x7f13cc0cd710 2024-04-26T23:43:13.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.343+0000 7f13c8c00640 1 --2- 172.21.15.137:0/826317102 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f13ac0683b0 0x7f13ac06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:13.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.343+0000 7f13c8c00640 1 -- 172.21.15.137:0/826317102 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f13b8085ac0 con 0x7f13cc0cd710 2024-04-26T23:43:13.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.343+0000 7f13d1200640 1 --2- 172.21.15.137:0/826317102 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f13ac0683b0 0x7f13ac06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:13.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.343+0000 7f13d1200640 1 --2- 172.21.15.137:0/826317102 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f13ac0683b0 0x7f13ac06a870 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f13c00b1000 tx=0x7f13c00a9070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:13.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.347+0000 7f13c8c00640 1 -- 172.21.15.137:0/826317102 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f13b8055c90 con 0x7f13cc0cd710 2024-04-26T23:43:13.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.507+0000 7f13d3c00640 1 -- 172.21.15.137:0/826317102 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f13cc15b880 con 0x7f13cc0cd710 2024-04-26T23:43:13.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.511+0000 7f13c8c00640 1 -- 172.21.15.137:0/826317102 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v12) ==== 104+0+0 (secure 0 0 0) 0x7f13b8059f90 con 0x7f13cc0cd710 2024-04-26T23:43:13.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.511+0000 7f13d3c00640 1 -- 172.21.15.137:0/826317102 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f13ac0683b0 msgr2=0x7f13ac06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:13.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.511+0000 7f13d3c00640 1 --2- 172.21.15.137:0/826317102 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f13ac0683b0 0x7f13ac06a870 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f13c00b1000 tx=0x7f13c00a9070 comp rx=0 tx=0).stop 2024-04-26T23:43:13.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.511+0000 7f13d3c00640 1 -- 172.21.15.137:0/826317102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13cc0cd710 msgr2=0x7f13cc1fb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:13.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.511+0000 7f13d3c00640 1 --2- 172.21.15.137:0/826317102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13cc0cd710 0x7f13cc1fb1c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f13b800c520 tx=0x7f13b800c9e0 comp rx=0 tx=0).stop 2024-04-26T23:43:13.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.511+0000 7f13d3c00640 1 -- 172.21.15.137:0/826317102 shutdown_connections 2024-04-26T23:43:13.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.511+0000 7f13d3c00640 1 --2- 172.21.15.137:0/826317102 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f13ac0683b0 0x7f13ac06a870 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:13.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.511+0000 7f13d3c00640 1 --2- 172.21.15.137:0/826317102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13cc0cd710 0x7f13cc1fb1c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:13.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.511+0000 7f13d3c00640 1 --2- 172.21.15.137:0/826317102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13cc160000 0x7f13cc1fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:13.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.511+0000 7f13d3c00640 1 --2- 172.21.15.137:0/826317102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13cc0b54e0 0x7f13cc1349e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:13.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.511+0000 7f13d3c00640 1 -- 172.21.15.137:0/826317102 >> 172.21.15.137:0/826317102 conn(0x7f13cc06c800 msgr2=0x7f13cc072ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:13.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.511+0000 7f13d3c00640 1 -- 172.21.15.137:0/826317102 shutdown_connections 2024-04-26T23:43:13.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.511+0000 7f13d3c00640 1 -- 172.21.15.137:0/826317102 wait complete. 2024-04-26T23:43:13.538 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds ms_async_reap_threshold 2024-04-26T23:43:13.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.671+0000 7f00db000640 1 Processor -- start 2024-04-26T23:43:13.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.671+0000 7f00db000640 1 -- start start 2024-04-26T23:43:13.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.671+0000 7f00db000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f00d40ceac0 0x7f00d415df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:13.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.671+0000 7f00db000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00d4072860 con 0x7f00d4073f20 2024-04-26T23:43:13.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.671+0000 7f00db000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00d40743b0 con 0x7f00d40afbc0 2024-04-26T23:43:13.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.671+0000 7f00db000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f00d4072b00 con 0x7f00d40ceac0 2024-04-26T23:43:13.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.671+0000 7f00d3400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f00d4073f20 0x7f00d40ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:38048/0 (socket says 172.21.15.137:38048) 2024-04-26T23:43:13.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.671+0000 7f00d3400640 1 -- 172.21.15.137:0/3560184946 learned_addr learned my addr 172.21.15.137:0/3560184946 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:13.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.671+0000 7f00d9000640 1 --2- 172.21.15.137:0/3560184946 >> v2:172.21.15.170:3300/0 conn(0x7f00d40ceac0 0x7f00d415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:13.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.671+0000 7f00d2a00640 1 -- 172.21.15.137:0/3560184946 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1058448068 0 0) 0x7f00d4072860 con 0x7f00d4073f20 2024-04-26T23:43:13.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.671+0000 7f00d2a00640 1 -- 172.21.15.137:0/3560184946 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00b8003530 con 0x7f00d4073f20 2024-04-26T23:43:13.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.671+0000 7f00d2a00640 1 -- 172.21.15.137:0/3560184946 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2965015605 0 0) 0x7f00d40743b0 con 0x7f00d40afbc0 2024-04-26T23:43:13.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.671+0000 7f00d2a00640 1 -- 172.21.15.137:0/3560184946 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00d4072860 con 0x7f00d40afbc0 2024-04-26T23:43:13.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.671+0000 7f00d2a00640 1 -- 172.21.15.137:0/3560184946 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1435358561 0 0) 0x7f00b8003530 con 0x7f00d4073f20 2024-04-26T23:43:13.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.671+0000 7f00d9000640 1 -- 172.21.15.137:0/3560184946 >> v1:172.21.15.170:6789/0 conn(0x7f00d40afbc0 legacy=0x7f00d40735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:13.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.671+0000 7f00d9000640 1 -- 172.21.15.137:0/3560184946 >> v1:172.21.15.137:6789/0 conn(0x7f00d4073f20 legacy=0x7f00d40ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:13.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.671+0000 7f00d9000640 1 -- 172.21.15.137:0/3560184946 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d4072de0 con 0x7f00d40ceac0 2024-04-26T23:43:13.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.675+0000 7f00d9000640 1 --2- 172.21.15.137:0/3560184946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00d40ceac0 0x7f00d415df90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f00cc009dc0 tx=0x7f00cc01c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3b9b0db79313e16 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:13.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.675+0000 7f00d2a00640 1 -- 172.21.15.137:0/3560184946 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0b2070 con 0x7f00d40ceac0 2024-04-26T23:43:13.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.675+0000 7f00d2a00640 1 -- 172.21.15.137:0/3560184946 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00cc0a55a0 con 0x7f00d40ceac0 2024-04-26T23:43:13.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.675+0000 7f00d2a00640 1 -- 172.21.15.137:0/3560184946 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c0001680 con 0x7f00d40ceac0 2024-04-26T23:43:13.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.675+0000 7f00db000640 1 -- 172.21.15.137:0/3560184946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00d40ceac0 msgr2=0x7f00d415df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:13.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.675+0000 7f00db000640 1 --2- 172.21.15.137:0/3560184946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00d40ceac0 0x7f00d415df90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f00cc009dc0 tx=0x7f00cc01c870 comp rx=0 tx=0).stop 2024-04-26T23:43:13.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.675+0000 7f00db000640 1 -- 172.21.15.137:0/3560184946 shutdown_connections 2024-04-26T23:43:13.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.675+0000 7f00db000640 1 --2- 172.21.15.137:0/3560184946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00d40ceac0 0x7f00d415df90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:13.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.675+0000 7f00db000640 1 -- 172.21.15.137:0/3560184946 >> 172.21.15.137:0/3560184946 conn(0x7f00d406c800 msgr2=0x7f00d406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:13.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.675+0000 7f00db000640 1 -- 172.21.15.137:0/3560184946 shutdown_connections 2024-04-26T23:43:13.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.675+0000 7f00db000640 1 -- 172.21.15.137:0/3560184946 wait complete. 2024-04-26T23:43:13.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00db000640 1 Processor -- start 2024-04-26T23:43:13.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00db000640 1 -- start start 2024-04-26T23:43:13.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00db000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00d40afbc0 0x7f00d40b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:13.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00db000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00d40ceac0 0x7f00d4155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:13.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00db000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00d4155ca0 0x7f00d414ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:13.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00db000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f00d406ffe0 con 0x7f00d4155ca0 2024-04-26T23:43:13.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00db000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f00d40b01f0 con 0x7f00d40afbc0 2024-04-26T23:43:13.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00db000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f00d4070160 con 0x7f00d40ceac0 2024-04-26T23:43:13.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00d9000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00d4155ca0 0x7f00d414ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:13.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00d9000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00d4155ca0 0x7f00d414ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43776/0 (socket says 172.21.15.137:43776) 2024-04-26T23:43:13.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00d9000640 1 -- 172.21.15.137:0/1787859719 learned_addr learned my addr 172.21.15.137:0/1787859719 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:13.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00d3400640 1 --2- 172.21.15.137:0/1787859719 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00d40ceac0 0x7f00d4155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:13.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00d3e00640 1 --2- 172.21.15.137:0/1787859719 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00d40afbc0 0x7f00d40b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:13.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00d9000640 1 -- 172.21.15.137:0/1787859719 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00d40ceac0 msgr2=0x7f00d4155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:13.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00d9000640 1 --2- 172.21.15.137:0/1787859719 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00d40ceac0 0x7f00d4155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:13.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00d9000640 1 -- 172.21.15.137:0/1787859719 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00d40afbc0 msgr2=0x7f00d40b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:13.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00d9000640 1 --2- 172.21.15.137:0/1787859719 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00d40afbc0 0x7f00d40b0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:13.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00d9000640 1 -- 172.21.15.137:0/1787859719 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d4156400 con 0x7f00d4155ca0 2024-04-26T23:43:13.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00d9000640 1 --2- 172.21.15.137:0/1787859719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00d4155ca0 0x7f00d414ab60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f00cc0b0040 tx=0x7f00cc019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:13.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00cbe00640 1 -- 172.21.15.137:0/1787859719 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0bd020 con 0x7f00d4155ca0 2024-04-26T23:43:13.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00cbe00640 1 -- 172.21.15.137:0/1787859719 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00cc0b3040 con 0x7f00d4155ca0 2024-04-26T23:43:13.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00db000640 1 -- 172.21.15.137:0/1787859719 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00d4153bd0 con 0x7f00d4155ca0 2024-04-26T23:43:13.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00cbe00640 1 -- 172.21.15.137:0/1787859719 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0b2050 con 0x7f00d4155ca0 2024-04-26T23:43:13.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00db000640 1 -- 172.21.15.137:0/1787859719 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00d4154190 con 0x7f00d4155ca0 2024-04-26T23:43:13.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.679+0000 7f00db000640 1 -- 172.21.15.137:0/1787859719 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00d406a410 con 0x7f00d4155ca0 2024-04-26T23:43:13.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.683+0000 7f00cbe00640 1 -- 172.21.15.137:0/1787859719 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f00cc0b9450 con 0x7f00d4155ca0 2024-04-26T23:43:13.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.683+0000 7f00cbe00640 1 --2- 172.21.15.137:0/1787859719 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f00b4068380 0x7f00b406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:13.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.683+0000 7f00cbe00640 1 -- 172.21.15.137:0/1787859719 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f00cc120fe0 con 0x7f00d4155ca0 2024-04-26T23:43:13.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.683+0000 7f00d3e00640 1 --2- 172.21.15.137:0/1787859719 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f00b4068380 0x7f00b406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:13.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.683+0000 7f00d3e00640 1 --2- 172.21.15.137:0/1787859719 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f00b4068380 0x7f00b406a840 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f00c40011f0 tx=0x7f00c4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:13.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.687+0000 7f00cbe00640 1 -- 172.21.15.137:0/1787859719 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f00cc0c7020 con 0x7f00d4155ca0 2024-04-26T23:43:13.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.847+0000 7f00db000640 1 -- 172.21.15.137:0/1787859719 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "ms_async_reap_threshold"} v 0) -- 0x7f00d4160870 con 0x7f00d4155ca0 2024-04-26T23:43:13.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.851+0000 7f00cbe00640 1 -- 172.21.15.137:0/1787859719 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "ms_async_reap_threshold"}]=0 v13) ==== 106+0+0 (secure 0 0 0) 0x7f00cc0164a0 con 0x7f00d4155ca0 2024-04-26T23:43:13.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.855+0000 7f00db000640 1 -- 172.21.15.137:0/1787859719 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f00b4068380 msgr2=0x7f00b406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:13.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.855+0000 7f00db000640 1 --2- 172.21.15.137:0/1787859719 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f00b4068380 0x7f00b406a840 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f00c40011f0 tx=0x7f00c4009040 comp rx=0 tx=0).stop 2024-04-26T23:43:13.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.855+0000 7f00db000640 1 -- 172.21.15.137:0/1787859719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00d4155ca0 msgr2=0x7f00d414ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:13.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.855+0000 7f00db000640 1 --2- 172.21.15.137:0/1787859719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00d4155ca0 0x7f00d414ab60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f00cc0b0040 tx=0x7f00cc019610 comp rx=0 tx=0).stop 2024-04-26T23:43:13.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.855+0000 7f00db000640 1 -- 172.21.15.137:0/1787859719 shutdown_connections 2024-04-26T23:43:13.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.855+0000 7f00db000640 1 --2- 172.21.15.137:0/1787859719 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f00b4068380 0x7f00b406a840 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:13.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.855+0000 7f00db000640 1 --2- 172.21.15.137:0/1787859719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00d4155ca0 0x7f00d414ab60 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:13.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.855+0000 7f00db000640 1 --2- 172.21.15.137:0/1787859719 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00d40ceac0 0x7f00d4155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:13.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.855+0000 7f00db000640 1 --2- 172.21.15.137:0/1787859719 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00d40afbc0 0x7f00d40b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:13.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.855+0000 7f00db000640 1 -- 172.21.15.137:0/1787859719 >> 172.21.15.137:0/1787859719 conn(0x7f00d406c800 msgr2=0x7f00d406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:13.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.855+0000 7f00db000640 1 -- 172.21.15.137:0/1787859719 shutdown_connections 2024-04-26T23:43:13.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:13.855+0000 7f00db000640 1 -- 172.21.15.137:0/1787859719 wait complete. 2024-04-26T23:43:13.881 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close' 2024-04-26T23:43:14.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.011+0000 7f5355800640 1 Processor -- start 2024-04-26T23:43:14.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.011+0000 7f5355800640 1 -- start start 2024-04-26T23:43:14.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.015+0000 7f5355800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f53500ce3e0 0x7f5350073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:14.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.015+0000 7f5355800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f535015de80 0x7f53500d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:14.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.015+0000 7f5355800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5350073010 con 0x7f53500ce7c0 2024-04-26T23:43:14.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.015+0000 7f5355800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f53500cef90 con 0x7f53500ce3e0 2024-04-26T23:43:14.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.015+0000 7f5355800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5350073280 con 0x7f535015de80 2024-04-26T23:43:14.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.015+0000 7f5346000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f535015de80 0x7f53500d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:14.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.015+0000 7f534ea00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f53500ce3e0 0x7f5350073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:14.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.015+0000 7f5346000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f535015de80 0x7f53500d04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:55518/0 (socket says 172.21.15.137:55518) 2024-04-26T23:43:14.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.015+0000 7f5346000640 1 -- 172.21.15.137:0/2930353301 learned_addr learned my addr 172.21.15.137:0/2930353301 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:14.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.015+0000 7f534f400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f53500ce7c0 0x7f5350146210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:58688/0 (socket says 172.21.15.137:58688) 2024-04-26T23:43:14.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.015+0000 7f534ea00640 1 -- 172.21.15.137:0/2930353301 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f535015de80 msgr2=0x7f53500d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:14.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.015+0000 7f534ea00640 1 --2- 172.21.15.137:0/2930353301 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f535015de80 0x7f53500d04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:14.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.015+0000 7f534ea00640 1 -- 172.21.15.137:0/2930353301 >> v1:172.21.15.170:6789/0 conn(0x7f53500ce7c0 legacy=0x7f5350146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:14.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.015+0000 7f534ea00640 1 -- 172.21.15.137:0/2930353301 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5350073560 con 0x7f53500ce3e0 2024-04-26T23:43:14.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.015+0000 7f5346000640 1 --2- 172.21.15.137:0/2930353301 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f535015de80 0x7f53500d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:43:14.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.019+0000 7f534ea00640 1 --2- 172.21.15.137:0/2930353301 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53500ce3e0 0x7f5350073d60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5340009d90 tx=0x7f534001c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca59d89ff7d5de4d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:14.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.019+0000 7f534e000640 1 -- 172.21.15.137:0/2930353301 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53400b2070 con 0x7f53500ce3e0 2024-04-26T23:43:14.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.019+0000 7f534e000640 1 -- 172.21.15.137:0/2930353301 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53400a5820 con 0x7f53500ce3e0 2024-04-26T23:43:14.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.019+0000 7f534e000640 1 -- 172.21.15.137:0/2930353301 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53400a5bf0 con 0x7f53500ce3e0 2024-04-26T23:43:14.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.019+0000 7f5355800640 1 -- 172.21.15.137:0/2930353301 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53500ce3e0 msgr2=0x7f5350073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:14.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.019+0000 7f5355800640 1 --2- 172.21.15.137:0/2930353301 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53500ce3e0 0x7f5350073d60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5340009d90 tx=0x7f534001c800 comp rx=0 tx=0).stop 2024-04-26T23:43:14.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.019+0000 7f5355800640 1 -- 172.21.15.137:0/2930353301 shutdown_connections 2024-04-26T23:43:14.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.019+0000 7f5355800640 1 --2- 172.21.15.137:0/2930353301 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f535015de80 0x7f53500d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:14.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.019+0000 7f5355800640 1 --2- 172.21.15.137:0/2930353301 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53500ce3e0 0x7f5350073d60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:14.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.019+0000 7f5355800640 1 -- 172.21.15.137:0/2930353301 >> 172.21.15.137:0/2930353301 conn(0x7f535006c5d0 msgr2=0x7f535006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:14.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.019+0000 7f5355800640 1 -- 172.21.15.137:0/2930353301 shutdown_connections 2024-04-26T23:43:14.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.019+0000 7f5355800640 1 -- 172.21.15.137:0/2930353301 wait complete. 2024-04-26T23:43:14.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.019+0000 7f5355800640 1 Processor -- start 2024-04-26T23:43:14.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f5355800640 1 -- start start 2024-04-26T23:43:14.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f5355800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53500ce3e0 0x7f53501f56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:14.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f5355800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53500ce7c0 0x7f53500b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:14.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f5355800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f535015de80 0x7f535013e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:14.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f5355800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f53500d0a20 con 0x7f535015de80 2024-04-26T23:43:14.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f5355800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f535015e320 con 0x7f53500ce3e0 2024-04-26T23:43:14.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f5355800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5350146920 con 0x7f53500ce7c0 2024-04-26T23:43:14.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f534f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f535015de80 0x7f535013e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:14.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f534f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f535015de80 0x7f535013e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43792/0 (socket says 172.21.15.137:43792) 2024-04-26T23:43:14.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f534f400640 1 -- 172.21.15.137:0/1794707158 learned_addr learned my addr 172.21.15.137:0/1794707158 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:14.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f534ea00640 1 --2- 172.21.15.137:0/1794707158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53500ce3e0 0x7f53501f56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:14.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f5346000640 1 --2- 172.21.15.137:0/1794707158 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53500ce7c0 0x7f53500b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:14.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f534f400640 1 -- 172.21.15.137:0/1794707158 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53500ce7c0 msgr2=0x7f53500b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:14.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f534f400640 1 --2- 172.21.15.137:0/1794707158 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53500ce7c0 0x7f53500b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:14.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f534f400640 1 -- 172.21.15.137:0/1794707158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53500ce3e0 msgr2=0x7f53501f56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:14.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f534f400640 1 --2- 172.21.15.137:0/1794707158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53500ce3e0 0x7f53501f56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:14.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f534f400640 1 -- 172.21.15.137:0/1794707158 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53501f5c20 con 0x7f535015de80 2024-04-26T23:43:14.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f5346000640 1 --2- 172.21.15.137:0/1794707158 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53500ce7c0 0x7f53500b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:14.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f534f400640 1 --2- 172.21.15.137:0/1794707158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f535015de80 0x7f535013e6e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5348009ec0 tx=0x7f534800c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:14.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f5347400640 1 -- 172.21.15.137:0/1794707158 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5348019070 con 0x7f535015de80 2024-04-26T23:43:14.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f5347400640 1 -- 172.21.15.137:0/1794707158 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5348007a30 con 0x7f535015de80 2024-04-26T23:43:14.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f5355800640 1 -- 172.21.15.137:0/1794707158 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f535013d0d0 con 0x7f535015de80 2024-04-26T23:43:14.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f5347400640 1 -- 172.21.15.137:0/1794707158 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5348007e00 con 0x7f535015de80 2024-04-26T23:43:14.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f5355800640 1 -- 172.21.15.137:0/1794707158 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f535013d690 con 0x7f535015de80 2024-04-26T23:43:14.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.023+0000 7f5355800640 1 -- 172.21.15.137:0/1794707158 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f535006a4b0 con 0x7f535015de80 2024-04-26T23:43:14.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.027+0000 7f5347400640 1 -- 172.21.15.137:0/1794707158 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f534801c070 con 0x7f535015de80 2024-04-26T23:43:14.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.027+0000 7f5347400640 1 --2- 172.21.15.137:0/1794707158 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f532c068380 0x7f532c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:14.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.027+0000 7f5347400640 1 -- 172.21.15.137:0/1794707158 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f53480883f0 con 0x7f535015de80 2024-04-26T23:43:14.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.027+0000 7f534ea00640 1 --2- 172.21.15.137:0/1794707158 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f532c068380 0x7f532c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:14.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.027+0000 7f534ea00640 1 --2- 172.21.15.137:0/1794707158 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f532c068380 0x7f532c06a840 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f53400af000 tx=0x7f53400a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:14.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.031+0000 7f5347400640 1 -- 172.21.15.137:0/1794707158 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f53480585c0 con 0x7f535015de80 2024-04-26T23:43:14.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:14.243+0000 7f5355800640 1 -- 172.21.15.137:0/1794707158 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]} v 0) -- 0x7f53500d07e0 con 0x7f535015de80 2024-04-26T23:43:15.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.155+0000 7f5347400640 1 -- 172.21.15.137:0/1794707158 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]}]=0 v127) ==== 144+0+0 (secure 0 0 0) 0x7f534805c8c0 con 0x7f535015de80 2024-04-26T23:43:15.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.159+0000 7f5355800640 1 -- 172.21.15.137:0/1794707158 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f532c068380 msgr2=0x7f532c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.159+0000 7f5355800640 1 --2- 172.21.15.137:0/1794707158 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f532c068380 0x7f532c06a840 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f53400af000 tx=0x7f53400a7070 comp rx=0 tx=0).stop 2024-04-26T23:43:15.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.159+0000 7f5355800640 1 -- 172.21.15.137:0/1794707158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f535015de80 msgr2=0x7f535013e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.159+0000 7f5355800640 1 --2- 172.21.15.137:0/1794707158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f535015de80 0x7f535013e6e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5348009ec0 tx=0x7f534800c430 comp rx=0 tx=0).stop 2024-04-26T23:43:15.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.159+0000 7f5355800640 1 -- 172.21.15.137:0/1794707158 shutdown_connections 2024-04-26T23:43:15.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.159+0000 7f5355800640 1 --2- 172.21.15.137:0/1794707158 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f532c068380 0x7f532c06a840 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.159+0000 7f5355800640 1 --2- 172.21.15.137:0/1794707158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f535015de80 0x7f535013e6e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.159+0000 7f5355800640 1 --2- 172.21.15.137:0/1794707158 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53500ce7c0 0x7f53500b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.159+0000 7f5355800640 1 --2- 172.21.15.137:0/1794707158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53500ce3e0 0x7f53501f56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.159+0000 7f5355800640 1 -- 172.21.15.137:0/1794707158 >> 172.21.15.137:0/1794707158 conn(0x7f535006c5d0 msgr2=0x7f53500b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:15.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.159+0000 7f5355800640 1 -- 172.21.15.137:0/1794707158 shutdown_connections 2024-04-26T23:43:15.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.159+0000 7f5355800640 1 -- 172.21.15.137:0/1794707158 wait complete. 2024-04-26T23:43:15.189 INFO:tasks.cephfs_test_runner:That when a client unmounts, the thread count on the MDS goes back ... ok 2024-04-26T23:43:15.189 INFO:tasks.cephfs_test_runner:Starting test: test_session_evict_blocklisted (tasks.cephfs.test_sessionmap.TestSessionMap) Check that mds evicts blocklisted client 2024-04-26T23:43:15.189 INFO:tasks.cephfs_test_runner:test_session_evict_blocklisted (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-04-26T23:43:15.190 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:43:15.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.323+0000 7fcedf200640 1 Processor -- start 2024-04-26T23:43:15.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.323+0000 7fcedf200640 1 -- start start 2024-04-26T23:43:15.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.323+0000 7fcedf200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fced8148950 0x7fced815fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.323+0000 7fcedf200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fced80b4ad0 0x7fced806f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.323+0000 7fcedf200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fced806f6d0 0x7fced80b5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.323+0000 7fcedf200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fced806fb80 con 0x7fced806f6d0 2024-04-26T23:43:15.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.323+0000 7fcedf200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fced8148d30 con 0x7fced80b4ad0 2024-04-26T23:43:15.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.323+0000 7fcedf200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fced8073540 con 0x7fced8148950 2024-04-26T23:43:15.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.323+0000 7fcedd200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fced806f6d0 0x7fced80b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.323+0000 7fcedd200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fced806f6d0 0x7fced80b5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43794/0 (socket says 172.21.15.137:43794) 2024-04-26T23:43:15.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.323+0000 7fcedd200640 1 -- 172.21.15.137:0/678724643 learned_addr learned my addr 172.21.15.137:0/678724643 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:15.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.323+0000 7fcecfe00640 1 --2- 172.21.15.137:0/678724643 >> v2:172.21.15.170:3300/0 conn(0x7fced80b4ad0 0x7fced806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.323+0000 7fced7e00640 1 --2- 172.21.15.137:0/678724643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fced8148950 0x7fced815fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.323+0000 7fcedd200640 1 -- 172.21.15.137:0/678724643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fced8148950 msgr2=0x7fced815fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:15.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.323+0000 7fcedd200640 1 --2- 172.21.15.137:0/678724643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fced8148950 0x7fced815fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.323+0000 7fcedd200640 1 -- 172.21.15.137:0/678724643 >> v2:172.21.15.170:3300/0 conn(0x7fced80b4ad0 msgr2=0x7fced806f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:15.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.323+0000 7fcedd200640 1 --2- 172.21.15.137:0/678724643 >> v2:172.21.15.170:3300/0 conn(0x7fced80b4ad0 0x7fced806f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.323+0000 7fcedd200640 1 -- 172.21.15.137:0/678724643 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced8073820 con 0x7fced806f6d0 2024-04-26T23:43:15.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.323+0000 7fced7e00640 1 --2- 172.21.15.137:0/678724643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fced8148950 0x7fced815fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:15.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.327+0000 7fcedd200640 1 --2- 172.21.15.137:0/678724643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced806f6d0 0x7fced80b5140 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fced80b0560 tx=0x7fced001c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1b490da0460a07 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:15.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.327+0000 7fced7400640 1 -- 172.21.15.137:0/678724643 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced00a5580 con 0x7fced806f6d0 2024-04-26T23:43:15.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.327+0000 7fced7400640 1 -- 172.21.15.137:0/678724643 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fced00a5720 con 0x7fced806f6d0 2024-04-26T23:43:15.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.327+0000 7fced7400640 1 -- 172.21.15.137:0/678724643 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced00a5af0 con 0x7fced806f6d0 2024-04-26T23:43:15.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.327+0000 7fcedf200640 1 -- 172.21.15.137:0/678724643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced806f6d0 msgr2=0x7fced80b5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.327+0000 7fcedf200640 1 --2- 172.21.15.137:0/678724643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced806f6d0 0x7fced80b5140 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fced80b0560 tx=0x7fced001c700 comp rx=0 tx=0).stop 2024-04-26T23:43:15.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.327+0000 7fcedf200640 1 -- 172.21.15.137:0/678724643 shutdown_connections 2024-04-26T23:43:15.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.327+0000 7fcedf200640 1 --2- 172.21.15.137:0/678724643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced806f6d0 0x7fced80b5140 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.327+0000 7fcedf200640 1 --2- 172.21.15.137:0/678724643 >> v2:172.21.15.170:3300/0 conn(0x7fced80b4ad0 0x7fced806f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.327+0000 7fcedf200640 1 --2- 172.21.15.137:0/678724643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fced8148950 0x7fced815fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.327+0000 7fcedf200640 1 -- 172.21.15.137:0/678724643 >> 172.21.15.137:0/678724643 conn(0x7fced806c5d0 msgr2=0x7fced806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:15.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.327+0000 7fcedf200640 1 -- 172.21.15.137:0/678724643 shutdown_connections 2024-04-26T23:43:15.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.327+0000 7fcedf200640 1 -- 172.21.15.137:0/678724643 wait complete. 2024-04-26T23:43:15.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fcedf200640 1 Processor -- start 2024-04-26T23:43:15.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fcedf200640 1 -- start start 2024-04-26T23:43:15.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fcedf200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced806f6d0 0x7fced8144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fcedf200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fced80b4ad0 0x7fced80af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fcedf200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fced8148950 0x7fced80af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fcedf200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fced8074480 con 0x7fced806f6d0 2024-04-26T23:43:15.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fcedf200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fced8074300 con 0x7fced80b4ad0 2024-04-26T23:43:15.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fcedf200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fced8160300 con 0x7fced8148950 2024-04-26T23:43:15.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fced7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced806f6d0 0x7fced8144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fced7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced806f6d0 0x7fced8144950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43800/0 (socket says 172.21.15.137:43800) 2024-04-26T23:43:15.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fced7e00640 1 -- 172.21.15.137:0/3817575881 learned_addr learned my addr 172.21.15.137:0/3817575881 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:15.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fcecfe00640 1 --2- 172.21.15.137:0/3817575881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fced80b4ad0 0x7fced80af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fcedd200640 1 --2- 172.21.15.137:0/3817575881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fced8148950 0x7fced80af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fced7e00640 1 -- 172.21.15.137:0/3817575881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fced8148950 msgr2=0x7fced80af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fced7e00640 1 --2- 172.21.15.137:0/3817575881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fced8148950 0x7fced80af6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fced7e00640 1 -- 172.21.15.137:0/3817575881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fced80b4ad0 msgr2=0x7fced80af190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fced7e00640 1 --2- 172.21.15.137:0/3817575881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fced80b4ad0 0x7fced80af190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fced7e00640 1 -- 172.21.15.137:0/3817575881 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced8144e90 con 0x7fced806f6d0 2024-04-26T23:43:15.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fced7e00640 1 --2- 172.21.15.137:0/3817575881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced806f6d0 0x7fced8144950 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fcec800d800 tx=0x7fcec800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:15.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fced4c00640 1 -- 172.21.15.137:0/3817575881 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec800b6c0 con 0x7fced806f6d0 2024-04-26T23:43:15.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fced4c00640 1 -- 172.21.15.137:0/3817575881 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcec8019070 con 0x7fced806f6d0 2024-04-26T23:43:15.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fcedf200640 1 -- 172.21.15.137:0/3817575881 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced8145150 con 0x7fced806f6d0 2024-04-26T23:43:15.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fced4c00640 1 -- 172.21.15.137:0/3817575881 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec800baa0 con 0x7fced806f6d0 2024-04-26T23:43:15.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fcedf200640 1 -- 172.21.15.137:0/3817575881 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced8145710 con 0x7fced806f6d0 2024-04-26T23:43:15.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.331+0000 7fcedf200640 1 -- 172.21.15.137:0/3817575881 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fced806a4b0 con 0x7fced806f6d0 2024-04-26T23:43:15.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.335+0000 7fced4c00640 1 -- 172.21.15.137:0/3817575881 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcec800bc40 con 0x7fced806f6d0 2024-04-26T23:43:15.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.335+0000 7fced4c00640 1 --2- 172.21.15.137:0/3817575881 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fceb40683b0 0x7fceb406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.335+0000 7fced4c00640 1 -- 172.21.15.137:0/3817575881 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fcec8086970 con 0x7fced806f6d0 2024-04-26T23:43:15.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.335+0000 7fcecfe00640 1 --2- 172.21.15.137:0/3817575881 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fceb40683b0 0x7fceb406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.335+0000 7fcecfe00640 1 --2- 172.21.15.137:0/3817575881 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fceb40683b0 0x7fceb406a870 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fced813acd0 tx=0x7fcec0009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:15.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.339+0000 7fced4c00640 1 -- 172.21.15.137:0/3817575881 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcec8056be0 con 0x7fced806f6d0 2024-04-26T23:43:15.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.499+0000 7fcedf200640 1 -- 172.21.15.137:0/3817575881 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fced8147b10 con 0x7fced806f6d0 2024-04-26T23:43:15.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.499+0000 7fced4c00640 1 -- 172.21.15.137:0/3817575881 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+13070 (secure 0 0 0) 0x7fcec805aee0 con 0x7fced806f6d0 2024-04-26T23:43:15.507 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:15.507 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":36,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:43:13.151558+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:6835/3364296586":"2024-04-27T23:43:10.140331+0000","172.21.15.170:6833/3364296586":"2024-04-27T23:43:10.140331+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:43:15.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.503+0000 7fcedf200640 1 -- 172.21.15.137:0/3817575881 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fceb40683b0 msgr2=0x7fceb406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.503+0000 7fcedf200640 1 --2- 172.21.15.137:0/3817575881 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fceb40683b0 0x7fceb406a870 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fced813acd0 tx=0x7fcec0009190 comp rx=0 tx=0).stop 2024-04-26T23:43:15.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.503+0000 7fcedf200640 1 -- 172.21.15.137:0/3817575881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced806f6d0 msgr2=0x7fced8144950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.503+0000 7fcedf200640 1 --2- 172.21.15.137:0/3817575881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced806f6d0 0x7fced8144950 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fcec800d800 tx=0x7fcec800dcc0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.503+0000 7fcedf200640 1 -- 172.21.15.137:0/3817575881 shutdown_connections 2024-04-26T23:43:15.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.503+0000 7fcedf200640 1 --2- 172.21.15.137:0/3817575881 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fceb40683b0 0x7fceb406a870 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.503+0000 7fcedf200640 1 --2- 172.21.15.137:0/3817575881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fced8148950 0x7fced80af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.503+0000 7fcedf200640 1 --2- 172.21.15.137:0/3817575881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fced80b4ad0 0x7fced80af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.503+0000 7fcedf200640 1 --2- 172.21.15.137:0/3817575881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced806f6d0 0x7fced8144950 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.503+0000 7fcedf200640 1 -- 172.21.15.137:0/3817575881 >> 172.21.15.137:0/3817575881 conn(0x7fced806c5d0 msgr2=0x7fced806c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:15.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.503+0000 7fcedf200640 1 -- 172.21.15.137:0/3817575881 shutdown_connections 2024-04-26T23:43:15.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.503+0000 7fcedf200640 1 -- 172.21.15.137:0/3817575881 wait complete. 2024-04-26T23:43:15.529 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:43:15.529 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:43:15.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.663+0000 7fc238800640 1 Processor -- start 2024-04-26T23:43:15.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.663+0000 7fc238800640 1 -- start start 2024-04-26T23:43:15.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.663+0000 7fc238800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc2300afbc0 0x7fc23015df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.663+0000 7fc238800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc2300affa0 0x7fc2300ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.663+0000 7fc238800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc230072860 con 0x7fc230073f20 2024-04-26T23:43:15.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.663+0000 7fc238800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc2300743b0 con 0x7fc2300affa0 2024-04-26T23:43:15.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.663+0000 7fc238800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc230072b00 con 0x7fc2300afbc0 2024-04-26T23:43:15.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.663+0000 7fc235e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc2300afbc0 0x7fc23015df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.663+0000 7fc235400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fc230073f20 0x7fc2300735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:58698/0 (socket says 172.21.15.137:58698) 2024-04-26T23:43:15.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.663+0000 7fc236800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc2300affa0 0x7fc2300ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.663+0000 7fc235400640 1 -- 172.21.15.137:0/3952188679 learned_addr learned my addr 172.21.15.137:0/3952188679 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:15.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.663+0000 7fc236800640 1 -- 172.21.15.137:0/3952188679 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc2300afbc0 msgr2=0x7fc23015df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:15.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.663+0000 7fc236800640 1 --2- 172.21.15.137:0/3952188679 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc2300afbc0 0x7fc23015df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.663+0000 7fc236800640 1 -- 172.21.15.137:0/3952188679 >> v1:172.21.15.170:6789/0 conn(0x7fc230073f20 legacy=0x7fc2300735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.663+0000 7fc236800640 1 -- 172.21.15.137:0/3952188679 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc230072de0 con 0x7fc2300affa0 2024-04-26T23:43:15.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.663+0000 7fc234a00640 1 -- 172.21.15.137:0/3952188679 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1205806265 0 0) 0x7fc230072860 con 0x7fc230073f20 2024-04-26T23:43:15.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.667+0000 7fc236800640 1 --2- 172.21.15.137:0/3952188679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2300affa0 0x7fc2300ce3b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009d90 tx=0x7fc22c01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a049c9e097a4ee00 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:15.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.667+0000 7fc234a00640 1 -- 172.21.15.137:0/3952188679 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c0b2070 con 0x7fc2300affa0 2024-04-26T23:43:15.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.667+0000 7fc234a00640 1 -- 172.21.15.137:0/3952188679 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc22c0a5830 con 0x7fc2300affa0 2024-04-26T23:43:15.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.667+0000 7fc234a00640 1 -- 172.21.15.137:0/3952188679 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c0a5c00 con 0x7fc2300affa0 2024-04-26T23:43:15.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.667+0000 7fc238800640 1 -- 172.21.15.137:0/3952188679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2300affa0 msgr2=0x7fc2300ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.667+0000 7fc238800640 1 --2- 172.21.15.137:0/3952188679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2300affa0 0x7fc2300ce3b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009d90 tx=0x7fc22c01c970 comp rx=0 tx=0).stop 2024-04-26T23:43:15.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.667+0000 7fc238800640 1 -- 172.21.15.137:0/3952188679 shutdown_connections 2024-04-26T23:43:15.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.667+0000 7fc238800640 1 --2- 172.21.15.137:0/3952188679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2300affa0 0x7fc2300ce3b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.667+0000 7fc238800640 1 --2- 172.21.15.137:0/3952188679 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc2300afbc0 0x7fc23015df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.667+0000 7fc238800640 1 -- 172.21.15.137:0/3952188679 >> 172.21.15.137:0/3952188679 conn(0x7fc23006c800 msgr2=0x7fc23006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:15.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.667+0000 7fc238800640 1 -- 172.21.15.137:0/3952188679 shutdown_connections 2024-04-26T23:43:15.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.667+0000 7fc238800640 1 -- 172.21.15.137:0/3952188679 wait complete. 2024-04-26T23:43:15.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc238800640 1 Processor -- start 2024-04-26T23:43:15.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc238800640 1 -- start start 2024-04-26T23:43:15.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc238800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2300afbc0 0x7fc23013e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc238800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc2300affa0 0x7fc230153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc238800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2300b3b60 0x7fc2300b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc238800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc23006f3e0 con 0x7fc2300b3b60 2024-04-26T23:43:15.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc238800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc23006f260 con 0x7fc2300afbc0 2024-04-26T23:43:15.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc238800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc23006f560 con 0x7fc2300affa0 2024-04-26T23:43:15.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc236800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2300b3b60 0x7fc2300b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc236800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2300b3b60 0x7fc2300b4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43808/0 (socket says 172.21.15.137:43808) 2024-04-26T23:43:15.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc236800640 1 -- 172.21.15.137:0/820426460 learned_addr learned my addr 172.21.15.137:0/820426460 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:15.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc235400640 1 --2- 172.21.15.137:0/820426460 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc2300affa0 0x7fc230153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc235e00640 1 --2- 172.21.15.137:0/820426460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2300afbc0 0x7fc23013e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc236800640 1 -- 172.21.15.137:0/820426460 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc2300affa0 msgr2=0x7fc230153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc236800640 1 --2- 172.21.15.137:0/820426460 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc2300affa0 0x7fc230153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc236800640 1 -- 172.21.15.137:0/820426460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2300afbc0 msgr2=0x7fc23013e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc236800640 1 --2- 172.21.15.137:0/820426460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2300afbc0 0x7fc23013e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc236800640 1 -- 172.21.15.137:0/820426460 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2300b5c70 con 0x7fc2300b3b60 2024-04-26T23:43:15.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc236800640 1 --2- 172.21.15.137:0/820426460 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2300b3b60 0x7fc2300b4010 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0b0040 tx=0x7fc22c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:15.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc22a000640 1 -- 172.21.15.137:0/820426460 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c0b2050 con 0x7fc2300b3b60 2024-04-26T23:43:15.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc22a000640 1 -- 172.21.15.137:0/820426460 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc22c0be070 con 0x7fc2300b3b60 2024-04-26T23:43:15.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc238800640 1 -- 172.21.15.137:0/820426460 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc230156b90 con 0x7fc2300b3b60 2024-04-26T23:43:15.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc22a000640 1 -- 172.21.15.137:0/820426460 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c0ad870 con 0x7fc2300b3b60 2024-04-26T23:43:15.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.671+0000 7fc238800640 1 -- 172.21.15.137:0/820426460 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2300af130 con 0x7fc2300b3b60 2024-04-26T23:43:15.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.675+0000 7fc238800640 1 -- 172.21.15.137:0/820426460 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc23006a410 con 0x7fc2300b3b60 2024-04-26T23:43:15.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.675+0000 7fc22a000640 1 -- 172.21.15.137:0/820426460 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc22c0ada10 con 0x7fc2300b3b60 2024-04-26T23:43:15.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.675+0000 7fc22a000640 1 --2- 172.21.15.137:0/820426460 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc214068380 0x7fc21406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.675+0000 7fc22a000640 1 -- 172.21.15.137:0/820426460 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fc22c1216f0 con 0x7fc2300b3b60 2024-04-26T23:43:15.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.675+0000 7fc235e00640 1 --2- 172.21.15.137:0/820426460 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc214068380 0x7fc21406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.675+0000 7fc235e00640 1 --2- 172.21.15.137:0/820426460 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc214068380 0x7fc21406a840 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc224009af0 tx=0x7fc224008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:15.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.679+0000 7fc22a000640 1 -- 172.21.15.137:0/820426460 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc22c016560 con 0x7fc2300b3b60 2024-04-26T23:43:15.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.839+0000 7fc238800640 1 -- 172.21.15.137:0/820426460 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc230160870 con 0x7fc2300b3b60 2024-04-26T23:43:15.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.839+0000 7fc22a000640 1 -- 172.21.15.137:0/820426460 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) ==== 93+0+10 (secure 0 0 0) 0x7fc22c0f20c0 con 0x7fc2300b3b60 2024-04-26T23:43:15.845 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:43:15.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.839+0000 7fc238800640 1 -- 172.21.15.137:0/820426460 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc214068380 msgr2=0x7fc21406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.839+0000 7fc238800640 1 --2- 172.21.15.137:0/820426460 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc214068380 0x7fc21406a840 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc224009af0 tx=0x7fc224008040 comp rx=0 tx=0).stop 2024-04-26T23:43:15.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.839+0000 7fc238800640 1 -- 172.21.15.137:0/820426460 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2300b3b60 msgr2=0x7fc2300b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.839+0000 7fc238800640 1 --2- 172.21.15.137:0/820426460 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2300b3b60 0x7fc2300b4010 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0b0040 tx=0x7fc22c019710 comp rx=0 tx=0).stop 2024-04-26T23:43:15.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.839+0000 7fc238800640 1 -- 172.21.15.137:0/820426460 shutdown_connections 2024-04-26T23:43:15.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.839+0000 7fc238800640 1 --2- 172.21.15.137:0/820426460 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc214068380 0x7fc21406a840 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.839+0000 7fc238800640 1 --2- 172.21.15.137:0/820426460 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2300b3b60 0x7fc2300b4010 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.839+0000 7fc238800640 1 --2- 172.21.15.137:0/820426460 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc2300affa0 0x7fc230153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.839+0000 7fc238800640 1 --2- 172.21.15.137:0/820426460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2300afbc0 0x7fc23013e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.839+0000 7fc238800640 1 -- 172.21.15.137:0/820426460 >> 172.21.15.137:0/820426460 conn(0x7fc23006c800 msgr2=0x7fc2300b1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:15.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.839+0000 7fc238800640 1 -- 172.21.15.137:0/820426460 shutdown_connections 2024-04-26T23:43:15.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.839+0000 7fc238800640 1 -- 172.21.15.137:0/820426460 wait complete. 2024-04-26T23:43:15.866 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted' 2024-04-26T23:43:16.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.995+0000 7f669da00640 1 Processor -- start 2024-04-26T23:43:16.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.995+0000 7f669da00640 1 -- start start 2024-04-26T23:43:16.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.995+0000 7f669da00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f669815ced0 0x7f66980d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:16.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.995+0000 7f669da00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f669815d2b0 0x7f66980d18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:16.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.995+0000 7f669da00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f66980b0d90 0x7f66980b1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:16.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.995+0000 7f669da00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f66980b1b30 con 0x7f669815ced0 2024-04-26T23:43:16.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.995+0000 7f669da00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f66980b1e10 con 0x7f66980b0d90 2024-04-26T23:43:16.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.995+0000 7f669da00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f66980b23f0 con 0x7f669815d2b0 2024-04-26T23:43:16.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.995+0000 7f6696a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f669815ced0 0x7f66980d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:16.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.995+0000 7f6696a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f669815ced0 0x7f66980d13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43818/0 (socket says 172.21.15.137:43818) 2024-04-26T23:43:16.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.995+0000 7f6696a00640 1 -- 172.21.15.137:0/3342920123 learned_addr learned my addr 172.21.15.137:0/3342920123 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:16.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.995+0000 7f668e000640 1 --2- 172.21.15.137:0/3342920123 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f669815d2b0 0x7f66980d18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:16.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.995+0000 7f6697400640 1 --2- 172.21.15.137:0/3342920123 >> v2:172.21.15.170:3300/0 conn(0x7f66980b0d90 0x7f66980b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:16.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.995+0000 7f6696a00640 1 -- 172.21.15.137:0/3342920123 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f669815d2b0 msgr2=0x7f66980d18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:16.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.995+0000 7f6696a00640 1 --2- 172.21.15.137:0/3342920123 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f669815d2b0 0x7f66980d18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:16.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.995+0000 7f6696a00640 1 -- 172.21.15.137:0/3342920123 >> v2:172.21.15.170:3300/0 conn(0x7f66980b0d90 msgr2=0x7f66980b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:16.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.995+0000 7f6696a00640 1 --2- 172.21.15.137:0/3342920123 >> v2:172.21.15.170:3300/0 conn(0x7f66980b0d90 0x7f66980b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:16.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.995+0000 7f6696a00640 1 -- 172.21.15.137:0/3342920123 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66980b26d0 con 0x7f669815ced0 2024-04-26T23:43:16.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.995+0000 7f6697400640 1 --2- 172.21.15.137:0/3342920123 >> v2:172.21.15.170:3300/0 conn(0x7f66980b0d90 0x7f66980b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:16.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.999+0000 7f6696a00640 1 --2- 172.21.15.137:0/3342920123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f669815ced0 0x7f66980d13b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f66980cd440 tx=0x7f668801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78737ebfeb40a74c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:16.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.999+0000 7f6696000640 1 -- 172.21.15.137:0/3342920123 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66880a5780 con 0x7f669815ced0 2024-04-26T23:43:16.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.999+0000 7f6696000640 1 -- 172.21.15.137:0/3342920123 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66880a5920 con 0x7f669815ced0 2024-04-26T23:43:16.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.999+0000 7f6696000640 1 -- 172.21.15.137:0/3342920123 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66880a5cf0 con 0x7f669815ced0 2024-04-26T23:43:16.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.999+0000 7f669da00640 1 -- 172.21.15.137:0/3342920123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f669815ced0 msgr2=0x7f66980d13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:16.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.999+0000 7f669da00640 1 --2- 172.21.15.137:0/3342920123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f669815ced0 0x7f66980d13b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f66980cd440 tx=0x7f668801c9f0 comp rx=0 tx=0).stop 2024-04-26T23:43:16.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.999+0000 7f669da00640 1 -- 172.21.15.137:0/3342920123 shutdown_connections 2024-04-26T23:43:16.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.999+0000 7f669da00640 1 --2- 172.21.15.137:0/3342920123 >> v2:172.21.15.170:3300/0 conn(0x7f66980b0d90 0x7f66980b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:16.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.999+0000 7f669da00640 1 --2- 172.21.15.137:0/3342920123 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f669815d2b0 0x7f66980d18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:16.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.999+0000 7f669da00640 1 --2- 172.21.15.137:0/3342920123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f669815ced0 0x7f66980d13b0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:16.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.999+0000 7f669da00640 1 -- 172.21.15.137:0/3342920123 >> 172.21.15.137:0/3342920123 conn(0x7f669809ba60 msgr2=0x7f669809be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:16.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.999+0000 7f669da00640 1 -- 172.21.15.137:0/3342920123 shutdown_connections 2024-04-26T23:43:16.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:15.999+0000 7f669da00640 1 -- 172.21.15.137:0/3342920123 wait complete. 2024-04-26T23:43:16.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f669da00640 1 Processor -- start 2024-04-26T23:43:16.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f669da00640 1 -- start start 2024-04-26T23:43:16.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f669da00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f66980b0d90 0x7f6698150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:16.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f669da00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f669815ced0 0x7f66980b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:16.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f669da00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f669815d2b0 0x7f6698153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:16.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f669da00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f66980b0660 con 0x7f669815ced0 2024-04-26T23:43:16.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f669da00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f66980b04e0 con 0x7f669815d2b0 2024-04-26T23:43:16.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f669da00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f66980b07e0 con 0x7f66980b0d90 2024-04-26T23:43:16.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f668e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f669815ced0 0x7f66980b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:16.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f668e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f669815ced0 0x7f66980b5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43820/0 (socket says 172.21.15.137:43820) 2024-04-26T23:43:16.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f668e000640 1 -- 172.21.15.137:0/71297741 learned_addr learned my addr 172.21.15.137:0/71297741 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:16.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f6696a00640 1 --2- 172.21.15.137:0/71297741 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f66980b0d90 0x7f6698150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:16.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f6697400640 1 --2- 172.21.15.137:0/71297741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f669815d2b0 0x7f6698153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:16.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f668e000640 1 -- 172.21.15.137:0/71297741 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f66980b0d90 msgr2=0x7f6698150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:16.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f668e000640 1 --2- 172.21.15.137:0/71297741 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f66980b0d90 0x7f6698150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:16.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f668e000640 1 -- 172.21.15.137:0/71297741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f669815d2b0 msgr2=0x7f6698153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:16.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f668e000640 1 --2- 172.21.15.137:0/71297741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f669815d2b0 0x7f6698153850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:16.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f668e000640 1 -- 172.21.15.137:0/71297741 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66981527b0 con 0x7f669815ced0 2024-04-26T23:43:16.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f668e000640 1 --2- 172.21.15.137:0/71297741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f669815ced0 0x7f66980b5c40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f668000d620 tx=0x7f668000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:16.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f668f400640 1 -- 172.21.15.137:0/71297741 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668000b620 con 0x7f669815ced0 2024-04-26T23:43:16.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f668f400640 1 -- 172.21.15.137:0/71297741 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6680019070 con 0x7f669815ced0 2024-04-26T23:43:16.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f668f400640 1 -- 172.21.15.137:0/71297741 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668000b9e0 con 0x7f669815ced0 2024-04-26T23:43:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f669da00640 1 -- 172.21.15.137:0/71297741 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6698152a90 con 0x7f669815ced0 2024-04-26T23:43:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.003+0000 7f669da00640 1 -- 172.21.15.137:0/71297741 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6698153050 con 0x7f669815ced0 2024-04-26T23:43:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.007+0000 7f669da00640 1 -- 172.21.15.137:0/71297741 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f669806a4b0 con 0x7f669815ced0 2024-04-26T23:43:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.007+0000 7f668f400640 1 -- 172.21.15.137:0/71297741 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f668000bb80 con 0x7f669815ced0 2024-04-26T23:43:16.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.007+0000 7f668f400640 1 --2- 172.21.15.137:0/71297741 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66740683b0 0x7f667406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:16.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.007+0000 7f668f400640 1 -- 172.21.15.137:0/71297741 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f6680086990 con 0x7f669815ced0 2024-04-26T23:43:16.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.007+0000 7f6696a00640 1 --2- 172.21.15.137:0/71297741 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66740683b0 0x7f667406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:16.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.007+0000 7f6696a00640 1 --2- 172.21.15.137:0/71297741 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66740683b0 0x7f667406a870 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f66880ae000 tx=0x7f66880a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:16.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.011+0000 7f668f400640 1 -- 172.21.15.137:0/71297741 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6680057240 con 0x7f669815ced0 2024-04-26T23:43:16.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:16.227+0000 7f669da00640 1 -- 172.21.15.137:0/71297741 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]} v 0) -- 0x7f669806c7d0 con 0x7f669815ced0 2024-04-26T23:43:17.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.163+0000 7f668f400640 1 -- 172.21.15.137:0/71297741 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]}]=0 v129) ==== 156+0+0 (secure 0 0 0) 0x7f6680056b40 con 0x7f669815ced0 2024-04-26T23:43:17.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.167+0000 7f669da00640 1 -- 172.21.15.137:0/71297741 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66740683b0 msgr2=0x7f667406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:17.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.167+0000 7f669da00640 1 --2- 172.21.15.137:0/71297741 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66740683b0 0x7f667406a870 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f66880ae000 tx=0x7f66880a7070 comp rx=0 tx=0).stop 2024-04-26T23:43:17.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.167+0000 7f669da00640 1 -- 172.21.15.137:0/71297741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f669815ced0 msgr2=0x7f66980b5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:17.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.167+0000 7f669da00640 1 --2- 172.21.15.137:0/71297741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f669815ced0 0x7f66980b5c40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f668000d620 tx=0x7f668000dae0 comp rx=0 tx=0).stop 2024-04-26T23:43:17.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.167+0000 7f669da00640 1 -- 172.21.15.137:0/71297741 shutdown_connections 2024-04-26T23:43:17.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.167+0000 7f669da00640 1 --2- 172.21.15.137:0/71297741 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f66740683b0 0x7f667406a870 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:17.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.167+0000 7f669da00640 1 --2- 172.21.15.137:0/71297741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f669815ced0 0x7f66980b5c40 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:17.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.167+0000 7f669da00640 1 --2- 172.21.15.137:0/71297741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f669815d2b0 0x7f6698153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:17.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.167+0000 7f669da00640 1 --2- 172.21.15.137:0/71297741 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f66980b0d90 0x7f6698150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:17.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.167+0000 7f669da00640 1 -- 172.21.15.137:0/71297741 >> 172.21.15.137:0/71297741 conn(0x7f669809ba60 msgr2=0x7f6698154310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:17.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.167+0000 7f669da00640 1 -- 172.21.15.137:0/71297741 shutdown_connections 2024-04-26T23:43:17.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.167+0000 7f669da00640 1 -- 172.21.15.137:0/71297741 wait complete. 2024-04-26T23:43:17.197 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T23:43:17.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.331+0000 7f97d8a00640 1 Processor -- start 2024-04-26T23:43:17.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.331+0000 7f97d8a00640 1 -- start start 2024-04-26T23:43:17.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.335+0000 7f97d8a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97d4072de0 0x7f97d40b0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:17.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.335+0000 7f97d8a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97d4073270 con 0x7f97d4072930 2024-04-26T23:43:17.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.335+0000 7f97d8a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97d40b59a0 con 0x7f97d4159560 2024-04-26T23:43:17.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.335+0000 7f97d8a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f97d40b5c50 con 0x7f97d4072de0 2024-04-26T23:43:17.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.335+0000 7f97c9400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f97d4072930 0x7f97d40afc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:38058/0 (socket says 172.21.15.137:38058) 2024-04-26T23:43:17.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.335+0000 7f97c9400640 1 -- 172.21.15.137:0/1852761401 learned_addr learned my addr 172.21.15.137:0/1852761401 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:17.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.335+0000 7f97d2800640 1 --2- 172.21.15.137:0/1852761401 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97d4072de0 0x7f97d40b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:17.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.335+0000 7f97d1400640 1 -- 172.21.15.137:0/1852761401 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3740290460 0 0) 0x7f97d4073270 con 0x7f97d4072930 2024-04-26T23:43:17.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.335+0000 7f97d1400640 1 -- 172.21.15.137:0/1852761401 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97b8003530 con 0x7f97d4072930 2024-04-26T23:43:17.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.335+0000 7f97d1400640 1 -- 172.21.15.137:0/1852761401 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2560644589 0 0) 0x7f97d40b59a0 con 0x7f97d4159560 2024-04-26T23:43:17.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.335+0000 7f97d1400640 1 -- 172.21.15.137:0/1852761401 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97d4073270 con 0x7f97d4159560 2024-04-26T23:43:17.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.335+0000 7f97d1400640 1 -- 172.21.15.137:0/1852761401 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 409589778 0 0) 0x7f97b8003530 con 0x7f97d4072930 2024-04-26T23:43:17.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.335+0000 7f97d2800640 1 -- 172.21.15.137:0/1852761401 >> v1:172.21.15.170:6789/0 conn(0x7f97d4159560 legacy=0x7f97d40b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:17.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.335+0000 7f97d2800640 1 -- 172.21.15.137:0/1852761401 >> v1:172.21.15.137:6789/0 conn(0x7f97d4072930 legacy=0x7f97d40afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:17.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.335+0000 7f97d2800640 1 -- 172.21.15.137:0/1852761401 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d40b5f30 con 0x7f97d4072de0 2024-04-26T23:43:17.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.339+0000 7f97d2800640 1 --2- 172.21.15.137:0/1852761401 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97d4072de0 0x7f97d40b0390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009dc0 tx=0x7f97cc01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0aa6438a28d9a6b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:17.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.339+0000 7f97d1400640 1 -- 172.21.15.137:0/1852761401 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0b2070 con 0x7f97d4072de0 2024-04-26T23:43:17.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.339+0000 7f97d1400640 1 -- 172.21.15.137:0/1852761401 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97cc0a55e0 con 0x7f97d4072de0 2024-04-26T23:43:17.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.339+0000 7f97d1400640 1 -- 172.21.15.137:0/1852761401 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc001680 con 0x7f97d4072de0 2024-04-26T23:43:17.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.339+0000 7f97d8a00640 1 -- 172.21.15.137:0/1852761401 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97d4072de0 msgr2=0x7f97d40b0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:17.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.339+0000 7f97d8a00640 1 --2- 172.21.15.137:0/1852761401 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97d4072de0 0x7f97d40b0390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009dc0 tx=0x7f97cc01c8b0 comp rx=0 tx=0).stop 2024-04-26T23:43:17.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.339+0000 7f97d8a00640 1 -- 172.21.15.137:0/1852761401 shutdown_connections 2024-04-26T23:43:17.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.339+0000 7f97d8a00640 1 --2- 172.21.15.137:0/1852761401 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97d4072de0 0x7f97d40b0390 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:17.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.339+0000 7f97d8a00640 1 -- 172.21.15.137:0/1852761401 >> 172.21.15.137:0/1852761401 conn(0x7f97d40b3370 msgr2=0x7f97d40b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:17.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.339+0000 7f97d8a00640 1 -- 172.21.15.137:0/1852761401 shutdown_connections 2024-04-26T23:43:17.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.339+0000 7f97d8a00640 1 -- 172.21.15.137:0/1852761401 wait complete. 2024-04-26T23:43:17.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.339+0000 7f97d8a00640 1 Processor -- start 2024-04-26T23:43:17.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.339+0000 7f97d8a00640 1 -- start start 2024-04-26T23:43:17.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97d8a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97d4072930 0x7f97d4158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:17.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97d8a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97d4072de0 0x7f97d4148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:17.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97d8a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97d4159560 0x7f97d414b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:17.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97d8a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f97d4159ac0 con 0x7f97d4072930 2024-04-26T23:43:17.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97d8a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f97d4159940 con 0x7f97d4159560 2024-04-26T23:43:17.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97d8a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f97d415f7d0 con 0x7f97d4072de0 2024-04-26T23:43:17.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97d1e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97d4072930 0x7f97d4158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:17.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97d1e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97d4072930 0x7f97d4158150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43826/0 (socket says 172.21.15.137:43826) 2024-04-26T23:43:17.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97d1e00640 1 -- 172.21.15.137:0/1663551746 learned_addr learned my addr 172.21.15.137:0/1663551746 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:17.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97c9400640 1 --2- 172.21.15.137:0/1663551746 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97d4072de0 0x7f97d4148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:17.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97d2800640 1 --2- 172.21.15.137:0/1663551746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97d4159560 0x7f97d414b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:17.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97d1e00640 1 -- 172.21.15.137:0/1663551746 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97d4072de0 msgr2=0x7f97d4148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:17.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97d1e00640 1 --2- 172.21.15.137:0/1663551746 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97d4072de0 0x7f97d4148890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:17.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97d1e00640 1 -- 172.21.15.137:0/1663551746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97d4159560 msgr2=0x7f97d414b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:17.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97d1e00640 1 --2- 172.21.15.137:0/1663551746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97d4159560 0x7f97d414b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:17.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97d1e00640 1 -- 172.21.15.137:0/1663551746 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d41570b0 con 0x7f97d4072930 2024-04-26T23:43:17.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97d2800640 1 --2- 172.21.15.137:0/1663551746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97d4159560 0x7f97d414b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:17.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97d1e00640 1 --2- 172.21.15.137:0/1663551746 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97d4072930 0x7f97d4158150 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f97c400c4c0 tx=0x7f97c400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:17.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97caa00640 1 -- 172.21.15.137:0/1663551746 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c40052d0 con 0x7f97d4072930 2024-04-26T23:43:17.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97caa00640 1 -- 172.21.15.137:0/1663551746 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97c4005470 con 0x7f97d4072930 2024-04-26T23:43:17.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97d8a00640 1 -- 172.21.15.137:0/1663551746 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d4157390 con 0x7f97d4072930 2024-04-26T23:43:17.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97caa00640 1 -- 172.21.15.137:0/1663551746 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c4012870 con 0x7f97d4072930 2024-04-26T23:43:17.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97d8a00640 1 -- 172.21.15.137:0/1663551746 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d4157950 con 0x7f97d4072930 2024-04-26T23:43:17.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97d8a00640 1 -- 172.21.15.137:0/1663551746 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97d406a410 con 0x7f97d4072930 2024-04-26T23:43:17.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.343+0000 7f97caa00640 1 -- 172.21.15.137:0/1663551746 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f97c4012a10 con 0x7f97d4072930 2024-04-26T23:43:17.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.347+0000 7f97caa00640 1 --2- 172.21.15.137:0/1663551746 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f97b00683b0 0x7f97b006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:17.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.347+0000 7f97caa00640 1 -- 172.21.15.137:0/1663551746 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f97c4086380 con 0x7f97d4072930 2024-04-26T23:43:17.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.347+0000 7f97c9400640 1 --2- 172.21.15.137:0/1663551746 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f97b00683b0 0x7f97b006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:17.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.347+0000 7f97c9400640 1 --2- 172.21.15.137:0/1663551746 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f97b00683b0 0x7f97b006a870 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f97d4156a80 tx=0x7f97bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:17.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.351+0000 7f97caa00640 1 -- 172.21.15.137:0/1663551746 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f97c4056bc0 con 0x7f97d4072930 2024-04-26T23:43:17.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.511+0000 7f97d8a00640 1 -- 172.21.15.137:0/1663551746 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f97d414dc00 con 0x7f97d4072930 2024-04-26T23:43:17.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.515+0000 7f97caa00640 1 -- 172.21.15.137:0/1663551746 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f97c40564c0 con 0x7f97d4072930 2024-04-26T23:43:17.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.519+0000 7f97d8a00640 1 -- 172.21.15.137:0/1663551746 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f97b00683b0 msgr2=0x7f97b006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:17.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.519+0000 7f97d8a00640 1 --2- 172.21.15.137:0/1663551746 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f97b00683b0 0x7f97b006a870 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f97d4156a80 tx=0x7f97bc009040 comp rx=0 tx=0).stop 2024-04-26T23:43:17.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.519+0000 7f97d8a00640 1 -- 172.21.15.137:0/1663551746 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97d4072930 msgr2=0x7f97d4158150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:17.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.519+0000 7f97d8a00640 1 --2- 172.21.15.137:0/1663551746 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97d4072930 0x7f97d4158150 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f97c400c4c0 tx=0x7f97c400c980 comp rx=0 tx=0).stop 2024-04-26T23:43:17.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.519+0000 7f97d8a00640 1 -- 172.21.15.137:0/1663551746 shutdown_connections 2024-04-26T23:43:17.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.519+0000 7f97d8a00640 1 --2- 172.21.15.137:0/1663551746 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f97b00683b0 0x7f97b006a870 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:17.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.519+0000 7f97d8a00640 1 --2- 172.21.15.137:0/1663551746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97d4159560 0x7f97d414b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:17.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.519+0000 7f97d8a00640 1 --2- 172.21.15.137:0/1663551746 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97d4072de0 0x7f97d4148890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:17.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.519+0000 7f97d8a00640 1 --2- 172.21.15.137:0/1663551746 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97d4072930 0x7f97d4158150 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:17.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.519+0000 7f97d8a00640 1 -- 172.21.15.137:0/1663551746 >> 172.21.15.137:0/1663551746 conn(0x7f97d40b3370 msgr2=0x7f97d415fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:17.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.519+0000 7f97d8a00640 1 -- 172.21.15.137:0/1663551746 shutdown_connections 2024-04-26T23:43:17.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.519+0000 7f97d8a00640 1 -- 172.21.15.137:0/1663551746 wait complete. 2024-04-26T23:43:17.543 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T23:43:17.543 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:43:17.626 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:43:17.697 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T23:43:17.697 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:43:17.697 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:43:17.706 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4511 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:43:17.706 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:43:17.706 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:43:17.716 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4843 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:43:17.716 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:43:17.716 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:43:17.755 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4511 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:43:17.756 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:43:17.756 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:43:17.769 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4843 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:43:17.769 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-26T23:43:17.770 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:43:17.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.927+0000 7ff0ada00640 1 Processor -- start 2024-04-26T23:43:17.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.927+0000 7ff0ada00640 1 -- start start 2024-04-26T23:43:17.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.927+0000 7ff0ada00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff0a815f080 0x7ff0a80b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:17.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.927+0000 7ff0ada00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff0a8073fe0 0x7ff0a80b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:17.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.927+0000 7ff0ada00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0a80b44b0 0x7ff0a8162b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:17.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.927+0000 7ff0ada00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff0a8072c10 con 0x7ff0a8073fe0 2024-04-26T23:43:17.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.927+0000 7ff0ada00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff0a80ae990 con 0x7ff0a815f080 2024-04-26T23:43:17.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.927+0000 7ff0ada00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a8072e60 con 0x7ff0a80b44b0 2024-04-26T23:43:17.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.927+0000 7ff0a7400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff0a8073fe0 0x7ff0a80b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:17.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.927+0000 7ff0a7400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff0a8073fe0 0x7ff0a80b3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43836/0 (socket says 172.21.15.137:43836) 2024-04-26T23:43:17.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.927+0000 7ff0a7400640 1 -- 172.21.15.137:0/2559270200 learned_addr learned my addr 172.21.15.137:0/2559270200 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:17.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.931+0000 7ff0a7400640 1 -- 172.21.15.137:0/2559270200 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0a80b44b0 msgr2=0x7ff0a8162b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:17.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.931+0000 7ff0a7400640 1 --2- 172.21.15.137:0/2559270200 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0a80b44b0 0x7ff0a8162b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:17.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.931+0000 7ff0a7e00640 1 --2- 172.21.15.137:0/2559270200 >> v2:172.21.15.170:3300/0 conn(0x7ff0a815f080 0x7ff0a80b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:17.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.931+0000 7ff0a7400640 1 -- 172.21.15.137:0/2559270200 >> v2:172.21.15.170:3300/0 conn(0x7ff0a815f080 msgr2=0x7ff0a80b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:17.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.931+0000 7ff0a7400640 1 --2- 172.21.15.137:0/2559270200 >> v2:172.21.15.170:3300/0 conn(0x7ff0a815f080 0x7ff0a80b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:17.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.931+0000 7ff0a7400640 1 -- 172.21.15.137:0/2559270200 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a8073140 con 0x7ff0a8073fe0 2024-04-26T23:43:17.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.931+0000 7ff0a7e00640 1 --2- 172.21.15.137:0/2559270200 >> v2:172.21.15.170:3300/0 conn(0x7ff0a815f080 0x7ff0a80b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:43:17.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.931+0000 7ff0a7400640 1 --2- 172.21.15.137:0/2559270200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a8073fe0 0x7ff0a80b3f70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80d1b20 tx=0x7ff09401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3796cf843e7829 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:17.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.931+0000 7ff0a6a00640 1 -- 172.21.15.137:0/2559270200 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0940b0070 con 0x7ff0a8073fe0 2024-04-26T23:43:17.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.931+0000 7ff0a6a00640 1 -- 172.21.15.137:0/2559270200 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0940ab600 con 0x7ff0a8073fe0 2024-04-26T23:43:17.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.931+0000 7ff0a6a00640 1 -- 172.21.15.137:0/2559270200 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0940ab9d0 con 0x7ff0a8073fe0 2024-04-26T23:43:17.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.931+0000 7ff0ada00640 1 -- 172.21.15.137:0/2559270200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a8073fe0 msgr2=0x7ff0a80b3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:17.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.931+0000 7ff0ada00640 1 --2- 172.21.15.137:0/2559270200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a8073fe0 0x7ff0a80b3f70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80d1b20 tx=0x7ff09401c520 comp rx=0 tx=0).stop 2024-04-26T23:43:17.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0ada00640 1 -- 172.21.15.137:0/2559270200 shutdown_connections 2024-04-26T23:43:17.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0ada00640 1 --2- 172.21.15.137:0/2559270200 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0a80b44b0 0x7ff0a8162b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:17.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0ada00640 1 --2- 172.21.15.137:0/2559270200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a8073fe0 0x7ff0a80b3f70 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:17.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0ada00640 1 --2- 172.21.15.137:0/2559270200 >> v2:172.21.15.170:3300/0 conn(0x7ff0a815f080 0x7ff0a80b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:17.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0ada00640 1 -- 172.21.15.137:0/2559270200 >> 172.21.15.137:0/2559270200 conn(0x7ff0a80b2730 msgr2=0x7ff0a80b2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:17.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0ada00640 1 -- 172.21.15.137:0/2559270200 shutdown_connections 2024-04-26T23:43:17.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0ada00640 1 -- 172.21.15.137:0/2559270200 wait complete. 2024-04-26T23:43:17.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0ada00640 1 Processor -- start 2024-04-26T23:43:17.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0ada00640 1 -- start start 2024-04-26T23:43:17.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0ada00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a8073fe0 0x7ff0a80ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:17.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0ada00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0a80b44b0 0x7ff0a814f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:17.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0ada00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0a815f080 0x7ff0a814fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:17.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0ada00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a80af190 con 0x7ff0a8073fe0 2024-04-26T23:43:17.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0ada00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a80af010 con 0x7ff0a80b44b0 2024-04-26T23:43:17.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0ada00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a80af310 con 0x7ff0a815f080 2024-04-26T23:43:17.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0a7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a8073fe0 0x7ff0a80ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:17.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0a7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a8073fe0 0x7ff0a80ce240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43844/0 (socket says 172.21.15.137:43844) 2024-04-26T23:43:17.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0a7e00640 1 -- 172.21.15.137:0/3267429007 learned_addr learned my addr 172.21.15.137:0/3267429007 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:17.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0a7400640 1 --2- 172.21.15.137:0/3267429007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0a80b44b0 0x7ff0a814f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:17.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0ad000640 1 --2- 172.21.15.137:0/3267429007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0a815f080 0x7ff0a814fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:17.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0a7e00640 1 -- 172.21.15.137:0/3267429007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0a815f080 msgr2=0x7ff0a814fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:17.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0a7e00640 1 --2- 172.21.15.137:0/3267429007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0a815f080 0x7ff0a814fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:17.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0a7e00640 1 -- 172.21.15.137:0/3267429007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0a80b44b0 msgr2=0x7ff0a814f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:17.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0a7e00640 1 --2- 172.21.15.137:0/3267429007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0a80b44b0 0x7ff0a814f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:17.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0a7e00640 1 -- 172.21.15.137:0/3267429007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a80ce890 con 0x7ff0a8073fe0 2024-04-26T23:43:17.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0ad000640 1 --2- 172.21.15.137:0/3267429007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0a815f080 0x7ff0a814fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:17.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff0a7e00640 1 --2- 172.21.15.137:0/3267429007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a8073fe0 0x7ff0a80ce240 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff09800ce30 tx=0x7ff09800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:17.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff09fe00640 1 -- 172.21.15.137:0/3267429007 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09800f890 con 0x7ff0a8073fe0 2024-04-26T23:43:17.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff09fe00640 1 -- 172.21.15.137:0/3267429007 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff09800fa30 con 0x7ff0a8073fe0 2024-04-26T23:43:17.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.935+0000 7ff09fe00640 1 -- 172.21.15.137:0/3267429007 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09800fe00 con 0x7ff0a8073fe0 2024-04-26T23:43:17.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.939+0000 7ff0ada00640 1 -- 172.21.15.137:0/3267429007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a80ceb70 con 0x7ff0a8073fe0 2024-04-26T23:43:17.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.939+0000 7ff0ada00640 1 -- 172.21.15.137:0/3267429007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a80cf130 con 0x7ff0a8073fe0 2024-04-26T23:43:17.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.939+0000 7ff0ada00640 1 -- 172.21.15.137:0/3267429007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a806a410 con 0x7ff0a8073fe0 2024-04-26T23:43:17.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.939+0000 7ff09fe00640 1 -- 172.21.15.137:0/3267429007 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff098018400 con 0x7ff0a8073fe0 2024-04-26T23:43:17.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.939+0000 7ff09fe00640 1 --2- 172.21.15.137:0/3267429007 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff0880683b0 0x7ff08806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:17.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.939+0000 7ff09fe00640 1 -- 172.21.15.137:0/3267429007 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7ff098087420 con 0x7ff0a8073fe0 2024-04-26T23:43:17.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.939+0000 7ff0a7400640 1 --2- 172.21.15.137:0/3267429007 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff0880683b0 0x7ff08806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:17.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.939+0000 7ff0a7400640 1 --2- 172.21.15.137:0/3267429007 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff0880683b0 0x7ff08806a870 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff0940ad000 tx=0x7ff094008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:17.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:17.943+0000 7ff09fe00640 1 -- 172.21.15.137:0/3267429007 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff098014030 con 0x7ff0a8073fe0 2024-04-26T23:43:18.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.131+0000 7ff0ada00640 1 -- 172.21.15.137:0/3267429007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0a8068dd0 con 0x7ff0a8073fe0 2024-04-26T23:43:18.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.131+0000 7ff09fe00640 1 -- 172.21.15.137:0/3267429007 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+3881 (secure 0 0 0) 0x7ff09800ae20 con 0x7ff0a8073fe0 2024-04-26T23:43:18.139 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:18.139 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1345232353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1345232353},{"type":"v1","addr":"172.21.15.137:6836","nonce":1345232353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1274585662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1274585662},{"type":"v1","addr":"172.21.15.137:6837","nonce":1274585662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4079333736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4079333736},{"type":"v1","addr":"172.21.15.170:6834","nonce":4079333736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1909909588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":1909909588},{"type":"v1","addr":"172.21.15.170:6835","nonce":1909909588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[]} 2024-04-26T23:43:18.139 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 19 2024-04-26T23:43:18.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.135+0000 7ff0ada00640 1 -- 172.21.15.137:0/3267429007 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff0880683b0 msgr2=0x7ff08806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:18.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.135+0000 7ff0ada00640 1 --2- 172.21.15.137:0/3267429007 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff0880683b0 0x7ff08806a870 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff0940ad000 tx=0x7ff094008040 comp rx=0 tx=0).stop 2024-04-26T23:43:18.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.135+0000 7ff0ada00640 1 -- 172.21.15.137:0/3267429007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a8073fe0 msgr2=0x7ff0a80ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:18.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.135+0000 7ff0ada00640 1 --2- 172.21.15.137:0/3267429007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a8073fe0 0x7ff0a80ce240 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff09800ce30 tx=0x7ff09800a650 comp rx=0 tx=0).stop 2024-04-26T23:43:18.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.135+0000 7ff0ada00640 1 -- 172.21.15.137:0/3267429007 shutdown_connections 2024-04-26T23:43:18.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.135+0000 7ff0ada00640 1 --2- 172.21.15.137:0/3267429007 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff0880683b0 0x7ff08806a870 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:18.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.135+0000 7ff0ada00640 1 --2- 172.21.15.137:0/3267429007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0a815f080 0x7ff0a814fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:18.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.135+0000 7ff0ada00640 1 --2- 172.21.15.137:0/3267429007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0a80b44b0 0x7ff0a814f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:18.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.135+0000 7ff0ada00640 1 --2- 172.21.15.137:0/3267429007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a8073fe0 0x7ff0a80ce240 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:18.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.135+0000 7ff0ada00640 1 -- 172.21.15.137:0/3267429007 >> 172.21.15.137:0/3267429007 conn(0x7ff0a80b2730 msgr2=0x7ff0a80720c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:18.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.135+0000 7ff0ada00640 1 -- 172.21.15.137:0/3267429007 shutdown_connections 2024-04-26T23:43:18.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.135+0000 7ff0ada00640 1 -- 172.21.15.137:0/3267429007 wait complete. 2024-04-26T23:43:18.161 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T23:43:18.161 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-26T23:43:18.161 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T23:43:18.161 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:43:18.162 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T23:43:18.162 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-26T23:43:18.162 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T23:43:18.162 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:43:18.162 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T23:43:18.162 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-26T23:43:18.163 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T23:43:18.163 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:43:18.163 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T23:43:18.163 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-26T23:43:18.163 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T23:43:18.163 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:43:18.175 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T23:43:18.175 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T23:43:18.176 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T23:43:18.176 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T23:43:18.178 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T23:43:18.178 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T23:43:18.179 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T23:43:18.179 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T23:43:18.218 INFO:tasks.ceph.mds.c:Started 2024-04-26T23:43:18.219 DEBUG:teuthology.parallel:result is None 2024-04-26T23:43:18.220 INFO:tasks.ceph.mds.a:Started 2024-04-26T23:43:18.220 DEBUG:teuthology.parallel:result is None 2024-04-26T23:43:18.223 INFO:tasks.ceph.mds.b:Started 2024-04-26T23:43:18.224 DEBUG:teuthology.parallel:result is None 2024-04-26T23:43:18.225 INFO:tasks.ceph.mds.d:Started 2024-04-26T23:43:18.225 DEBUG:teuthology.parallel:result is None 2024-04-26T23:43:18.225 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-26T23:43:18.304 INFO:tasks.ceph.mds.a.smithi137.stdout:starting mds.a at 2024-04-26T23:43:18.304 INFO:tasks.ceph.mds.c.smithi137.stdout:starting mds.c at 2024-04-26T23:43:18.312 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2024-04-26T23:43:18.312 INFO:tasks.ceph.mds.d.smithi170.stdout:starting mds.d at 2024-04-26T23:43:18.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.363+0000 7f4a74a00640 1 Processor -- start 2024-04-26T23:43:18.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.363+0000 7f4a74a00640 1 -- start start 2024-04-26T23:43:18.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.363+0000 7f4a74a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a700d1ac0 0x7f4a700b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:18.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.363+0000 7f4a74a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4a7015d2b0 0x7f4a700b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:18.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.363+0000 7f4a74a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a700b1b30 con 0x7f4a7015ced0 2024-04-26T23:43:18.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.363+0000 7f4a74a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4a700b1e10 con 0x7f4a7015d2b0 2024-04-26T23:43:18.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.363+0000 7f4a74a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4a700b23f0 con 0x7f4a700d1ac0 2024-04-26T23:43:18.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.363+0000 7f4a6e800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4a7015d2b0 0x7f4a700b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:18.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.363+0000 7f4a6e800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4a7015d2b0 0x7f4a700b12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43896/0 (socket says 172.21.15.137:43896) 2024-04-26T23:43:18.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.363+0000 7f4a6e800640 1 -- 172.21.15.137:0/975647067 learned_addr learned my addr 172.21.15.137:0/975647067 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:18.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.363+0000 7f4a65400640 1 --2- 172.21.15.137:0/975647067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a700d1ac0 0x7f4a700b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:18.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.367+0000 7f4a6e800640 1 -- 172.21.15.137:0/975647067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a700d1ac0 msgr2=0x7f4a700b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:18.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.367+0000 7f4a6e800640 1 --2- 172.21.15.137:0/975647067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a700d1ac0 0x7f4a700b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:18.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.367+0000 7f4a6e800640 1 -- 172.21.15.137:0/975647067 >> v1:172.21.15.170:6789/0 conn(0x7f4a7015ced0 legacy=0x7f4a700d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:18.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.367+0000 7f4a6e800640 1 -- 172.21.15.137:0/975647067 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a700b26d0 con 0x7f4a7015d2b0 2024-04-26T23:43:18.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.367+0000 7f4a65400640 1 --2- 172.21.15.137:0/975647067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a700d1ac0 0x7f4a700b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:43:18.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.367+0000 7f4a6e800640 1 --2- 172.21.15.137:0/975647067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a7015d2b0 0x7f4a700b12d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009870 tx=0x7f4a6801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c9fd80111d8c2b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:18.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.367+0000 7f4a6d400640 1 -- 172.21.15.137:0/975647067 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a680a7070 con 0x7f4a7015d2b0 2024-04-26T23:43:18.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.367+0000 7f4a6d400640 1 -- 172.21.15.137:0/975647067 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a680b0070 con 0x7f4a7015d2b0 2024-04-26T23:43:18.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.367+0000 7f4a6d400640 1 -- 172.21.15.137:0/975647067 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a680ab890 con 0x7f4a7015d2b0 2024-04-26T23:43:18.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a74a00640 1 -- 172.21.15.137:0/975647067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a7015d2b0 msgr2=0x7f4a700b12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:18.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a74a00640 1 --2- 172.21.15.137:0/975647067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a7015d2b0 0x7f4a700b12d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009870 tx=0x7f4a6801c560 comp rx=0 tx=0).stop 2024-04-26T23:43:18.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a74a00640 1 -- 172.21.15.137:0/975647067 shutdown_connections 2024-04-26T23:43:18.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a74a00640 1 --2- 172.21.15.137:0/975647067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a7015d2b0 0x7f4a700b12d0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:18.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a74a00640 1 --2- 172.21.15.137:0/975647067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a700d1ac0 0x7f4a700b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:18.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a74a00640 1 -- 172.21.15.137:0/975647067 >> 172.21.15.137:0/975647067 conn(0x7f4a7009ba60 msgr2=0x7f4a7009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:18.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a74a00640 1 -- 172.21.15.137:0/975647067 shutdown_connections 2024-04-26T23:43:18.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a74a00640 1 -- 172.21.15.137:0/975647067 wait complete. 2024-04-26T23:43:18.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a74a00640 1 Processor -- start 2024-04-26T23:43:18.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a74a00640 1 -- start start 2024-04-26T23:43:18.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a74a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a700d1ac0 0x7f4a70155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:18.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a74a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a7015ced0 0x7f4a70158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:18.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a74a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a7015d2b0 0x7f4a70159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:18.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a74a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4a700b3790 con 0x7f4a7015ced0 2024-04-26T23:43:18.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a74a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4a700b3610 con 0x7f4a7015d2b0 2024-04-26T23:43:18.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a74a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4a700b3910 con 0x7f4a700d1ac0 2024-04-26T23:43:18.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a65400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a7015ced0 0x7f4a70158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:18.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a65400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a7015ced0 0x7f4a70158e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43898/0 (socket says 172.21.15.137:43898) 2024-04-26T23:43:18.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a65400640 1 -- 172.21.15.137:0/1783913949 learned_addr learned my addr 172.21.15.137:0/1783913949 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:18.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a6de00640 1 --2- 172.21.15.137:0/1783913949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a700d1ac0 0x7f4a70155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:18.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a6e800640 1 --2- 172.21.15.137:0/1783913949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a7015d2b0 0x7f4a70159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:18.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a65400640 1 -- 172.21.15.137:0/1783913949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a700d1ac0 msgr2=0x7f4a70155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:18.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a65400640 1 --2- 172.21.15.137:0/1783913949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a700d1ac0 0x7f4a70155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:18.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a65400640 1 -- 172.21.15.137:0/1783913949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a7015d2b0 msgr2=0x7f4a70159390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:18.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a65400640 1 --2- 172.21.15.137:0/1783913949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a7015d2b0 0x7f4a70159390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:18.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a65400640 1 -- 172.21.15.137:0/1783913949 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a70159f30 con 0x7f4a7015ced0 2024-04-26T23:43:18.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a6e800640 1 --2- 172.21.15.137:0/1783913949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a7015d2b0 0x7f4a70159390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:43:18.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.371+0000 7f4a65400640 1 --2- 172.21.15.137:0/1783913949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a7015ced0 0x7f4a70158e50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4a5800ebe0 tx=0x7f4a5800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:18.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.375+0000 7f4a66a00640 1 -- 172.21.15.137:0/1783913949 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a58017070 con 0x7f4a7015ced0 2024-04-26T23:43:18.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.375+0000 7f4a66a00640 1 -- 172.21.15.137:0/1783913949 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a5800cc30 con 0x7f4a7015ced0 2024-04-26T23:43:18.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.375+0000 7f4a66a00640 1 -- 172.21.15.137:0/1783913949 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a58013470 con 0x7f4a7015ced0 2024-04-26T23:43:18.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.375+0000 7f4a74a00640 1 -- 172.21.15.137:0/1783913949 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a70159970 con 0x7f4a7015ced0 2024-04-26T23:43:18.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.375+0000 7f4a74a00640 1 -- 172.21.15.137:0/1783913949 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a700cdfa0 con 0x7f4a7015ced0 2024-04-26T23:43:18.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.375+0000 7f4a74a00640 1 -- 172.21.15.137:0/1783913949 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a700cf920 con 0x7f4a7015ced0 2024-04-26T23:43:18.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.375+0000 7f4a66a00640 1 -- 172.21.15.137:0/1783913949 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4a5801a070 con 0x7f4a7015ced0 2024-04-26T23:43:18.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.375+0000 7f4a66a00640 1 --2- 172.21.15.137:0/1783913949 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4a4c068380 0x7f4a4c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:18.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.375+0000 7f4a66a00640 1 -- 172.21.15.137:0/1783913949 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f4a580865f0 con 0x7f4a7015ced0 2024-04-26T23:43:18.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.375+0000 7f4a6de00640 1 --2- 172.21.15.137:0/1783913949 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4a4c068380 0x7f4a4c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:18.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.379+0000 7f4a6de00640 1 --2- 172.21.15.137:0/1783913949 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4a4c068380 0x7f4a4c06a840 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4a70157000 tx=0x7f4a60009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:18.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.383+0000 7f4a66a00640 1 -- 172.21.15.137:0/1783913949 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4a700cf920 con 0x7f4a7015ced0 2024-04-26T23:43:18.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:18.559+0000 7f4a74a00640 1 -- 172.21.15.137:0/1783913949 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f4a700b8c70 con 0x7f4a7015ced0 2024-04-26T23:43:18.597 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:43:18.601 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:43:19.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.530+0000 7f4a66a00640 1 -- 172.21.15.137:0/1783913949 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v41) ==== 97+0+0 (secure 0 0 0) 0x7f4a58056ea0 con 0x7f4a7015ced0 2024-04-26T23:43:19.540 INFO:teuthology.orchestra.run.smithi137.stderr: removed all blocklist entries 2024-04-26T23:43:19.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.534+0000 7f4a74a00640 1 -- 172.21.15.137:0/1783913949 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4a4c068380 msgr2=0x7f4a4c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:19.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.534+0000 7f4a74a00640 1 --2- 172.21.15.137:0/1783913949 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4a4c068380 0x7f4a4c06a840 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4a70157000 tx=0x7f4a60009040 comp rx=0 tx=0).stop 2024-04-26T23:43:19.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.534+0000 7f4a74a00640 1 -- 172.21.15.137:0/1783913949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a7015ced0 msgr2=0x7f4a70158e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:19.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.534+0000 7f4a74a00640 1 --2- 172.21.15.137:0/1783913949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a7015ced0 0x7f4a70158e50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4a5800ebe0 tx=0x7f4a5800c520 comp rx=0 tx=0).stop 2024-04-26T23:43:19.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.534+0000 7f4a74a00640 1 -- 172.21.15.137:0/1783913949 shutdown_connections 2024-04-26T23:43:19.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.534+0000 7f4a74a00640 1 --2- 172.21.15.137:0/1783913949 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4a4c068380 0x7f4a4c06a840 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:19.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.534+0000 7f4a74a00640 1 --2- 172.21.15.137:0/1783913949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a7015ced0 0x7f4a70158e50 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:19.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.534+0000 7f4a74a00640 1 --2- 172.21.15.137:0/1783913949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a7015d2b0 0x7f4a70159390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:19.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.534+0000 7f4a74a00640 1 --2- 172.21.15.137:0/1783913949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a700d1ac0 0x7f4a70155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:19.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.534+0000 7f4a74a00640 1 -- 172.21.15.137:0/1783913949 >> 172.21.15.137:0/1783913949 conn(0x7f4a7009ba60 msgr2=0x7f4a700b3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:19.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.534+0000 7f4a74a00640 1 -- 172.21.15.137:0/1783913949 shutdown_connections 2024-04-26T23:43:19.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.534+0000 7f4a74a00640 1 -- 172.21.15.137:0/1783913949 wait complete. 2024-04-26T23:43:19.565 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-26T23:43:19.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.698+0000 7fed83600640 1 Processor -- start 2024-04-26T23:43:19.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.698+0000 7fed83600640 1 -- start start 2024-04-26T23:43:19.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.698+0000 7fed83600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed7c0b5c90 0x7fed7c15c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:19.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.698+0000 7fed83600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fed7c06e500 0x7fed7c06eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:19.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.698+0000 7fed83600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fed7c06e980 0x7fed7c155510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:19.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.698+0000 7fed83600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fed7c0d0850 con 0x7fed7c06e980 2024-04-26T23:43:19.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.698+0000 7fed83600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fed7c0cfca0 con 0x7fed7c06e500 2024-04-26T23:43:19.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.698+0000 7fed83600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fed7c15ca00 con 0x7fed7c0b5c90 2024-04-26T23:43:19.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.698+0000 7fed81600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fed7c06e980 0x7fed7c155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:19.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.698+0000 7fed81600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fed7c06e980 0x7fed7c155510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43900/0 (socket says 172.21.15.137:43900) 2024-04-26T23:43:19.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.698+0000 7fed81600640 1 -- 172.21.15.137:0/3225346125 learned_addr learned my addr 172.21.15.137:0/3225346125 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:19.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.698+0000 7fed7be00640 1 --2- 172.21.15.137:0/3225346125 >> v2:172.21.15.170:3300/0 conn(0x7fed7c06e500 0x7fed7c06eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:19.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.698+0000 7fed80c00640 1 --2- 172.21.15.137:0/3225346125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed7c0b5c90 0x7fed7c15c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:19.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.702+0000 7fed81600640 1 -- 172.21.15.137:0/3225346125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed7c0b5c90 msgr2=0x7fed7c15c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:19.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.702+0000 7fed81600640 1 --2- 172.21.15.137:0/3225346125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed7c0b5c90 0x7fed7c15c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:19.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.702+0000 7fed81600640 1 -- 172.21.15.137:0/3225346125 >> v2:172.21.15.170:3300/0 conn(0x7fed7c06e500 msgr2=0x7fed7c06eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:19.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.702+0000 7fed81600640 1 --2- 172.21.15.137:0/3225346125 >> v2:172.21.15.170:3300/0 conn(0x7fed7c06e500 0x7fed7c06eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:19.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.702+0000 7fed81600640 1 -- 172.21.15.137:0/3225346125 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7c0b3e30 con 0x7fed7c06e980 2024-04-26T23:43:19.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.702+0000 7fed81600640 1 --2- 172.21.15.137:0/3225346125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed7c06e980 0x7fed7c155510 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fed7c06fa10 tx=0x7fed7401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1ab22b74e68f29 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:19.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.702+0000 7fed7b400640 1 -- 172.21.15.137:0/3225346125 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed740aa5f0 con 0x7fed7c06e980 2024-04-26T23:43:19.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.702+0000 7fed7b400640 1 -- 172.21.15.137:0/3225346125 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed740af070 con 0x7fed7c06e980 2024-04-26T23:43:19.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.702+0000 7fed7b400640 1 -- 172.21.15.137:0/3225346125 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed740aa9b0 con 0x7fed7c06e980 2024-04-26T23:43:19.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.702+0000 7fed83600640 1 -- 172.21.15.137:0/3225346125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed7c06e980 msgr2=0x7fed7c155510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:19.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.702+0000 7fed83600640 1 --2- 172.21.15.137:0/3225346125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed7c06e980 0x7fed7c155510 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fed7c06fa10 tx=0x7fed7401c4d0 comp rx=0 tx=0).stop 2024-04-26T23:43:19.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.702+0000 7fed83600640 1 -- 172.21.15.137:0/3225346125 shutdown_connections 2024-04-26T23:43:19.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.702+0000 7fed83600640 1 --2- 172.21.15.137:0/3225346125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed7c06e980 0x7fed7c155510 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:19.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.702+0000 7fed83600640 1 --2- 172.21.15.137:0/3225346125 >> v2:172.21.15.170:3300/0 conn(0x7fed7c06e500 0x7fed7c06eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:19.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.702+0000 7fed83600640 1 --2- 172.21.15.137:0/3225346125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed7c0b5c90 0x7fed7c15c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:19.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.702+0000 7fed83600640 1 -- 172.21.15.137:0/3225346125 >> 172.21.15.137:0/3225346125 conn(0x7fed7c06c5d0 msgr2=0x7fed7c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:19.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.702+0000 7fed83600640 1 -- 172.21.15.137:0/3225346125 shutdown_connections 2024-04-26T23:43:19.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.702+0000 7fed83600640 1 -- 172.21.15.137:0/3225346125 wait complete. 2024-04-26T23:43:19.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed83600640 1 Processor -- start 2024-04-26T23:43:19.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed83600640 1 -- start start 2024-04-26T23:43:19.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed83600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed7c06e500 0x7fed7c0cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:19.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed83600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed7c06e980 0x7fed7c140c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:19.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed83600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed7c0b5c90 0x7fed7c0c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:19.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed83600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fed7c0b4b80 con 0x7fed7c06e980 2024-04-26T23:43:19.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed83600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fed7c0b61e0 con 0x7fed7c0b5c90 2024-04-26T23:43:19.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed83600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fed7c06f530 con 0x7fed7c06e500 2024-04-26T23:43:19.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed7be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed7c06e980 0x7fed7c140c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:19.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed7be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed7c06e980 0x7fed7c140c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43910/0 (socket says 172.21.15.137:43910) 2024-04-26T23:43:19.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed7be00640 1 -- 172.21.15.137:0/3038847626 learned_addr learned my addr 172.21.15.137:0/3038847626 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:19.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed80c00640 1 --2- 172.21.15.137:0/3038847626 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed7c06e500 0x7fed7c0cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:19.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed81600640 1 --2- 172.21.15.137:0/3038847626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed7c0b5c90 0x7fed7c0c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:19.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed7be00640 1 -- 172.21.15.137:0/3038847626 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed7c06e500 msgr2=0x7fed7c0cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:19.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed7be00640 1 --2- 172.21.15.137:0/3038847626 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed7c06e500 0x7fed7c0cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:19.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed7be00640 1 -- 172.21.15.137:0/3038847626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed7c0b5c90 msgr2=0x7fed7c0c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:19.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed7be00640 1 --2- 172.21.15.137:0/3038847626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed7c0b5c90 0x7fed7c0c5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:19.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed7be00640 1 -- 172.21.15.137:0/3038847626 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7c15ea10 con 0x7fed7c06e980 2024-04-26T23:43:19.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed7be00640 1 --2- 172.21.15.137:0/3038847626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed7c06e980 0x7fed7c140c00 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fed6800d800 tx=0x7fed6800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:19.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed78c00640 1 -- 172.21.15.137:0/3038847626 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6800b6c0 con 0x7fed7c06e980 2024-04-26T23:43:19.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed78c00640 1 -- 172.21.15.137:0/3038847626 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed68019070 con 0x7fed7c06e980 2024-04-26T23:43:19.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed83600640 1 -- 172.21.15.137:0/3038847626 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed7c141380 con 0x7fed7c06e980 2024-04-26T23:43:19.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.706+0000 7fed78c00640 1 -- 172.21.15.137:0/3038847626 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6800ba60 con 0x7fed7c06e980 2024-04-26T23:43:19.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.710+0000 7fed83600640 1 -- 172.21.15.137:0/3038847626 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed7c141940 con 0x7fed7c06e980 2024-04-26T23:43:19.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.710+0000 7fed83600640 1 -- 172.21.15.137:0/3038847626 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed7c142000 con 0x7fed7c06e980 2024-04-26T23:43:19.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.710+0000 7fed78c00640 1 -- 172.21.15.137:0/3038847626 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fed6800bc00 con 0x7fed7c06e980 2024-04-26T23:43:19.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.710+0000 7fed78c00640 1 --2- 172.21.15.137:0/3038847626 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fed5c068380 0x7fed5c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:19.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.710+0000 7fed78c00640 1 -- 172.21.15.137:0/3038847626 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7fed68086a80 con 0x7fed7c06e980 2024-04-26T23:43:19.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.710+0000 7fed80c00640 1 --2- 172.21.15.137:0/3038847626 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fed5c068380 0x7fed5c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:19.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.710+0000 7fed80c00640 1 --2- 172.21.15.137:0/3038847626 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fed5c068380 0x7fed5c06a840 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fed6c0039f0 tx=0x7fed6c009830 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:19.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.714+0000 7fed78c00640 1 -- 172.21.15.137:0/3038847626 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fed7c142000 con 0x7fed7c06e980 2024-04-26T23:43:19.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.926+0000 7fed83600640 1 -- 172.21.15.137:0/3038847626 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fed7c06a4b0 con 0x7fed7c06e980 2024-04-26T23:43:19.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.926+0000 7fed78c00640 1 -- 172.21.15.137:0/3038847626 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7fed68088e20 con 0x7fed7c06e980 2024-04-26T23:43:19.934 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:19.934 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:43:19.934 INFO:teuthology.orchestra.run.smithi137.stdout: "auth_dump": [ 2024-04-26T23:43:19.934 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:19.934 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.a", 2024-04-26T23:43:19.934 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBkOyxm8fEFJhAApnO8C5VzrzRze2CXBFDX+w==", 2024-04-26T23:43:19.935 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:43:19.935 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:43:19.935 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T23:43:19.935 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T23:43:19.935 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:43:19.935 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:19.935 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:19.935 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:19.935 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.b", 2024-04-26T23:43:19.935 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBkOyxmcIXMMRAAbatu788GHajE0CeUmSfG6g==", 2024-04-26T23:43:19.935 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:43:19.935 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:43:19.935 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T23:43:19.935 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T23:43:19.936 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:43:19.936 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:19.936 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:19.936 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:19.936 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.c", 2024-04-26T23:43:19.936 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBkOyxmxOM0LRAAqjFB1cWhxjLMmH2Hw08y4Q==", 2024-04-26T23:43:19.936 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:43:19.936 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:43:19.936 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T23:43:19.936 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T23:43:19.936 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:43:19.936 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:19.936 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:19.936 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:19.937 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.d", 2024-04-26T23:43:19.937 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBkOyxmtB0QORAA4pb1qkARdVDYWtrlHHLM8A==", 2024-04-26T23:43:19.937 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:43:19.937 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:43:19.937 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T23:43:19.937 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T23:43:19.937 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:43:19.937 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:19.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:19.937 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:19.937 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.0", 2024-04-26T23:43:19.937 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBoOyxmBpUlARAAFTI893hK3CG+M43N95QY0Q==", 2024-04-26T23:43:19.937 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:43:19.937 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:43:19.937 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:43:19.938 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:43:19.938 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:19.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:19.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:19.938 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.1", 2024-04-26T23:43:19.938 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBrOyxmOKoBDRAAEKl+f5dgrhKsrw9GLl/aZg==", 2024-04-26T23:43:19.938 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:43:19.938 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:43:19.938 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:43:19.938 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:43:19.938 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:19.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:19.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:19.938 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.2", 2024-04-26T23:43:19.939 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBuOyxmRCxpFxAAiugbUkmCpSi3PpcfSIqzag==", 2024-04-26T23:43:19.939 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:43:19.939 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:43:19.939 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:43:19.939 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:43:19.939 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:19.939 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:19.939 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:19.939 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.3", 2024-04-26T23:43:19.939 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBxOyxmAVDRHxAAn16e0bzh8lMn7IfompY4tg==", 2024-04-26T23:43:19.939 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:43:19.939 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:43:19.939 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:43:19.939 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:43:19.939 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:19.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:19.940 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:19.940 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.4", 2024-04-26T23:43:19.940 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQB1OyxmBaU+MRAADSzfJp0HfnkgWh57F6vmGw==", 2024-04-26T23:43:19.940 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:43:19.940 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:43:19.940 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:43:19.940 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:43:19.940 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:19.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:19.940 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:19.940 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.5", 2024-04-26T23:43:19.940 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQB4OyxmFhNFOhAAIqlQNOvaL8EMnodLeQMhDw==", 2024-04-26T23:43:19.940 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:43:19.940 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:43:19.941 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:43:19.941 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:43:19.941 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:19.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:19.941 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:19.941 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.6", 2024-04-26T23:43:19.941 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQB8Oyxm1y03BxAAZaVKAAMQ8CgZxR9QOSmmxg==", 2024-04-26T23:43:19.941 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:43:19.941 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:43:19.941 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:43:19.941 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:43:19.941 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:19.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:19.941 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:19.941 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.7", 2024-04-26T23:43:19.942 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQB/Oyxmnl5HERAAzW6LvTGUe02XbfzKUdE9Ww==", 2024-04-26T23:43:19.942 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:43:19.942 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:43:19.942 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:43:19.942 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:43:19.942 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:19.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:19.942 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:19.942 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.0", 2024-04-26T23:43:19.942 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBlOyxmNsaKARAAi0ecpgpB9GUVCXS04Xi03g==", 2024-04-26T23:43:19.942 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:43:19.942 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:43:19.942 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow r", 2024-04-26T23:43:19.942 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-26T23:43:19.943 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:19.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:19.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:19.943 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.1", 2024-04-26T23:43:19.943 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBlOyxmZdztChAA5CqZN408iUQConPiWOpzNA==", 2024-04-26T23:43:19.943 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:43:19.943 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:43:19.943 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T23:43:19.943 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T23:43:19.943 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T23:43:19.943 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:19.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:19.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:19.943 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.2", 2024-04-26T23:43:19.943 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBlOyxmtliOBxAADAAo7qWwq7kTIiAzKhdSEw==", 2024-04-26T23:43:19.944 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:43:19.944 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:43:19.944 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T23:43:19.944 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T23:43:19.944 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T23:43:19.944 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:19.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:19.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:19.944 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.3", 2024-04-26T23:43:19.944 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBlOyxmY+nwEBAAwfSl/XoOGWEecTT5NKOaUQ==", 2024-04-26T23:43:19.944 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:43:19.944 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:43:19.944 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T23:43:19.944 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T23:43:19.945 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T23:43:19.945 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:19.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:19.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:19.945 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.admin", 2024-04-26T23:43:19.945 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBkOyxmhPUIChAA9/bw/6JVN8b4Qg3isTXsuw==", 2024-04-26T23:43:19.945 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:43:19.945 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T23:43:19.945 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T23:43:19.945 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T23:43:19.945 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:43:19.945 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:19.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:19.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:19.945 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mgr.x", 2024-04-26T23:43:19.946 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBkOyxmXYSgIRAAYsHzI8tb+DSiNPdNJxRDag==", 2024-04-26T23:43:19.946 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:43:19.946 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T23:43:19.946 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile mgr", 2024-04-26T23:43:19.946 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:43:19.946 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:19.946 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:19.946 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:19.946 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mgr.y", 2024-04-26T23:43:19.946 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBkOyxmdEIZHhAAPO3gVpDHmMunKrxtjSmYxw==", 2024-04-26T23:43:19.946 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:43:19.946 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T23:43:19.946 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile mgr", 2024-04-26T23:43:19.946 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:43:19.947 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:19.947 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:19.947 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-26T23:43:19.947 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:43:19.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.930+0000 7fed83600640 1 -- 172.21.15.137:0/3038847626 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fed5c068380 msgr2=0x7fed5c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:19.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.930+0000 7fed83600640 1 --2- 172.21.15.137:0/3038847626 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fed5c068380 0x7fed5c06a840 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fed6c0039f0 tx=0x7fed6c009830 comp rx=0 tx=0).stop 2024-04-26T23:43:19.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.930+0000 7fed83600640 1 -- 172.21.15.137:0/3038847626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed7c06e980 msgr2=0x7fed7c140c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:19.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.930+0000 7fed83600640 1 --2- 172.21.15.137:0/3038847626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed7c06e980 0x7fed7c140c00 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fed6800d800 tx=0x7fed6800dcc0 comp rx=0 tx=0).stop 2024-04-26T23:43:19.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.930+0000 7fed83600640 1 -- 172.21.15.137:0/3038847626 shutdown_connections 2024-04-26T23:43:19.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.930+0000 7fed83600640 1 --2- 172.21.15.137:0/3038847626 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fed5c068380 0x7fed5c06a840 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:19.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.930+0000 7fed83600640 1 --2- 172.21.15.137:0/3038847626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed7c06e980 0x7fed7c140c00 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:19.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.930+0000 7fed83600640 1 --2- 172.21.15.137:0/3038847626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed7c0b5c90 0x7fed7c0c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:19.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.930+0000 7fed83600640 1 --2- 172.21.15.137:0/3038847626 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed7c06e500 0x7fed7c0cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:19.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.930+0000 7fed83600640 1 -- 172.21.15.137:0/3038847626 >> 172.21.15.137:0/3038847626 conn(0x7fed7c06c5d0 msgr2=0x7fed7c15ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:19.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.930+0000 7fed83600640 1 -- 172.21.15.137:0/3038847626 shutdown_connections 2024-04-26T23:43:19.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:19.930+0000 7fed83600640 1 -- 172.21.15.137:0/3038847626 wait complete. 2024-04-26T23:43:19.955 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:43:20.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.082+0000 7fb79f400640 1 Processor -- start 2024-04-26T23:43:20.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.082+0000 7fb79f400640 1 -- start start 2024-04-26T23:43:20.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.082+0000 7fb79f400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb7980ce3e0 0x7fb798073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.082+0000 7fb79f400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb79815de80 0x7fb7980d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.082+0000 7fb79f400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb7980ce7c0 0x7fb798146210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.082+0000 7fb79f400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb798073010 con 0x7fb7980ce3e0 2024-04-26T23:43:20.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.082+0000 7fb79f400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb7980cef90 con 0x7fb7980ce7c0 2024-04-26T23:43:20.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.082+0000 7fb79f400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb798073280 con 0x7fb79815de80 2024-04-26T23:43:20.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.086+0000 7fb79ca00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb7980ce3e0 0x7fb798073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:20.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.086+0000 7fb79ca00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb7980ce3e0 0x7fb798073d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43912/0 (socket says 172.21.15.137:43912) 2024-04-26T23:43:20.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.086+0000 7fb79ca00640 1 -- 172.21.15.137:0/598305551 learned_addr learned my addr 172.21.15.137:0/598305551 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:20.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.086+0000 7fb78fe00640 1 --2- 172.21.15.137:0/598305551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb79815de80 0x7fb7980d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:20.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.086+0000 7fb79d400640 1 --2- 172.21.15.137:0/598305551 >> v2:172.21.15.170:3300/0 conn(0x7fb7980ce7c0 0x7fb798146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:20.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.086+0000 7fb79ca00640 1 -- 172.21.15.137:0/598305551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb79815de80 msgr2=0x7fb7980d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:20.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.086+0000 7fb79ca00640 1 --2- 172.21.15.137:0/598305551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb79815de80 0x7fb7980d04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.086+0000 7fb79ca00640 1 -- 172.21.15.137:0/598305551 >> v2:172.21.15.170:3300/0 conn(0x7fb7980ce7c0 msgr2=0x7fb798146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:20.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.086+0000 7fb79ca00640 1 --2- 172.21.15.137:0/598305551 >> v2:172.21.15.170:3300/0 conn(0x7fb7980ce7c0 0x7fb798146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.086+0000 7fb79ca00640 1 -- 172.21.15.137:0/598305551 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb798073560 con 0x7fb7980ce3e0 2024-04-26T23:43:20.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.086+0000 7fb79ca00640 1 --2- 172.21.15.137:0/598305551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7980ce3e0 0x7fb798073d60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb7980cdb60 tx=0x7fb78801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f0f1787b36ca63 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:20.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.086+0000 7fb797e00640 1 -- 172.21.15.137:0/598305551 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7880b1070 con 0x7fb7980ce3e0 2024-04-26T23:43:20.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.086+0000 7fb797e00640 1 -- 172.21.15.137:0/598305551 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7880ac620 con 0x7fb7980ce3e0 2024-04-26T23:43:20.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.086+0000 7fb797e00640 1 -- 172.21.15.137:0/598305551 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7880ac9f0 con 0x7fb7980ce3e0 2024-04-26T23:43:20.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79f400640 1 -- 172.21.15.137:0/598305551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7980ce3e0 msgr2=0x7fb798073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:20.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79f400640 1 --2- 172.21.15.137:0/598305551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7980ce3e0 0x7fb798073d60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb7980cdb60 tx=0x7fb78801c4f0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79f400640 1 -- 172.21.15.137:0/598305551 shutdown_connections 2024-04-26T23:43:20.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79f400640 1 --2- 172.21.15.137:0/598305551 >> v2:172.21.15.170:3300/0 conn(0x7fb7980ce7c0 0x7fb798146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79f400640 1 --2- 172.21.15.137:0/598305551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb79815de80 0x7fb7980d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79f400640 1 --2- 172.21.15.137:0/598305551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7980ce3e0 0x7fb798073d60 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79f400640 1 -- 172.21.15.137:0/598305551 >> 172.21.15.137:0/598305551 conn(0x7fb79806c5d0 msgr2=0x7fb79806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:20.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79f400640 1 -- 172.21.15.137:0/598305551 shutdown_connections 2024-04-26T23:43:20.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79f400640 1 -- 172.21.15.137:0/598305551 wait complete. 2024-04-26T23:43:20.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79f400640 1 Processor -- start 2024-04-26T23:43:20.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79f400640 1 -- start start 2024-04-26T23:43:20.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7980ce3e0 0x7fb798141730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79f400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7980ce7c0 0x7fb798138870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb79815de80 0x7fb79815c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79f400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb79806ee90 con 0x7fb79815de80 2024-04-26T23:43:20.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79f400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb79806ed10 con 0x7fb7980ce3e0 2024-04-26T23:43:20.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79f400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb79806f010 con 0x7fb7980ce7c0 2024-04-26T23:43:20.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79d400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb79815de80 0x7fb79815c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:20.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79d400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb79815de80 0x7fb79815c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43916/0 (socket says 172.21.15.137:43916) 2024-04-26T23:43:20.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79ca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7980ce3e0 0x7fb798141730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:20.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79d400640 1 -- 172.21.15.137:0/1742817628 learned_addr learned my addr 172.21.15.137:0/1742817628 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:20.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb78fe00640 1 --2- 172.21.15.137:0/1742817628 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7980ce7c0 0x7fb798138870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:20.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79d400640 1 -- 172.21.15.137:0/1742817628 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7980ce7c0 msgr2=0x7fb798138870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:20.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79d400640 1 --2- 172.21.15.137:0/1742817628 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7980ce7c0 0x7fb798138870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79d400640 1 -- 172.21.15.137:0/1742817628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7980ce3e0 msgr2=0x7fb798141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:20.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79d400640 1 --2- 172.21.15.137:0/1742817628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7980ce3e0 0x7fb798141730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.090+0000 7fb79d400640 1 -- 172.21.15.137:0/1742817628 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7981fa7c0 con 0x7fb79815de80 2024-04-26T23:43:20.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.094+0000 7fb79d400640 1 --2- 172.21.15.137:0/1742817628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb79815de80 0x7fb79815c050 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb790007e60 tx=0x7fb79000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:20.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.094+0000 7fb795600640 1 -- 172.21.15.137:0/1742817628 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb790014420 con 0x7fb79815de80 2024-04-26T23:43:20.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.094+0000 7fb795600640 1 -- 172.21.15.137:0/1742817628 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb790019070 con 0x7fb79815de80 2024-04-26T23:43:20.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.094+0000 7fb79f400640 1 -- 172.21.15.137:0/1742817628 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7981f9c40 con 0x7fb79815de80 2024-04-26T23:43:20.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.094+0000 7fb795600640 1 -- 172.21.15.137:0/1742817628 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb790014820 con 0x7fb79815de80 2024-04-26T23:43:20.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.094+0000 7fb79f400640 1 -- 172.21.15.137:0/1742817628 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7981fa200 con 0x7fb79815de80 2024-04-26T23:43:20.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.094+0000 7fb79f400640 1 -- 172.21.15.137:0/1742817628 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb79806a4b0 con 0x7fb79815de80 2024-04-26T23:43:20.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.094+0000 7fb795600640 1 -- 172.21.15.137:0/1742817628 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb7900149c0 con 0x7fb79815de80 2024-04-26T23:43:20.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.094+0000 7fb795600640 1 --2- 172.21.15.137:0/1742817628 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb774068380 0x7fb77406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.094+0000 7fb795600640 1 -- 172.21.15.137:0/1742817628 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7fb790086d60 con 0x7fb79815de80 2024-04-26T23:43:20.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.094+0000 7fb79ca00640 1 --2- 172.21.15.137:0/1742817628 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb774068380 0x7fb77406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:20.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.098+0000 7fb79ca00640 1 --2- 172.21.15.137:0/1742817628 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb774068380 0x7fb77406a840 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb7880ae000 tx=0x7fb788008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:20.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.098+0000 7fb795600640 1 -- 172.21.15.137:0/1742817628 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb790057010 con 0x7fb79815de80 2024-04-26T23:43:20.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.258+0000 7fb79f400640 1 -- 172.21.15.137:0/1742817628 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb79806cc30 con 0x7fb79815de80 2024-04-26T23:43:20.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.262+0000 7fb795600640 1 -- 172.21.15.137:0/1742817628 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+12939 (secure 0 0 0) 0x7fb79005b310 con 0x7fb79815de80 2024-04-26T23:43:20.268 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:20.268 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":41,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:43:19.535379+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:43:20.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.262+0000 7fb79f400640 1 -- 172.21.15.137:0/1742817628 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb774068380 msgr2=0x7fb77406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:20.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.262+0000 7fb79f400640 1 --2- 172.21.15.137:0/1742817628 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb774068380 0x7fb77406a840 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb7880ae000 tx=0x7fb788008040 comp rx=0 tx=0).stop 2024-04-26T23:43:20.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.262+0000 7fb79f400640 1 -- 172.21.15.137:0/1742817628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb79815de80 msgr2=0x7fb79815c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:20.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.262+0000 7fb79f400640 1 --2- 172.21.15.137:0/1742817628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb79815de80 0x7fb79815c050 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb790007e60 tx=0x7fb79000e4b0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.262+0000 7fb79f400640 1 -- 172.21.15.137:0/1742817628 shutdown_connections 2024-04-26T23:43:20.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.262+0000 7fb79f400640 1 --2- 172.21.15.137:0/1742817628 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb774068380 0x7fb77406a840 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.262+0000 7fb79f400640 1 --2- 172.21.15.137:0/1742817628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb79815de80 0x7fb79815c050 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.262+0000 7fb79f400640 1 --2- 172.21.15.137:0/1742817628 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7980ce7c0 0x7fb798138870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.262+0000 7fb79f400640 1 --2- 172.21.15.137:0/1742817628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7980ce3e0 0x7fb798141730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.262+0000 7fb79f400640 1 -- 172.21.15.137:0/1742817628 >> 172.21.15.137:0/1742817628 conn(0x7fb79806c5d0 msgr2=0x7fb798068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:20.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.262+0000 7fb79f400640 1 -- 172.21.15.137:0/1742817628 shutdown_connections 2024-04-26T23:43:20.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.262+0000 7fb79f400640 1 -- 172.21.15.137:0/1742817628 wait complete. 2024-04-26T23:43:20.291 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:43:20.291 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:43:20.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.422+0000 7fccd6200640 1 Processor -- start 2024-04-26T23:43:20.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.422+0000 7fccd6200640 1 -- start start 2024-04-26T23:43:20.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.422+0000 7fccd6200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fccd00b54e0 0x7fccd00b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.422+0000 7fccd6200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccd00cd710 0x7fccd015f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.422+0000 7fccd6200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccd00cffa0 con 0x7fccd015fe30 2024-04-26T23:43:20.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.422+0000 7fccd6200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fccd00b3d90 con 0x7fccd00b54e0 2024-04-26T23:43:20.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.422+0000 7fccd6200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fccd00d0840 con 0x7fccd00cd710 2024-04-26T23:43:20.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.422+0000 7fcccf400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fccd00b54e0 0x7fccd00b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:20.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.422+0000 7fcccf400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fccd00b54e0 0x7fccd00b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43920/0 (socket says 172.21.15.137:43920) 2024-04-26T23:43:20.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.422+0000 7fcccf400640 1 -- 172.21.15.137:0/4223924523 learned_addr learned my addr 172.21.15.137:0/4223924523 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:20.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.422+0000 7fcccf400640 1 -- 172.21.15.137:0/4223924523 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccd00cd710 msgr2=0x7fccd015f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:20.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.422+0000 7fcccf400640 1 --2- 172.21.15.137:0/4223924523 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccd00cd710 0x7fccd015f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.422+0000 7fcccf400640 1 -- 172.21.15.137:0/4223924523 >> v1:172.21.15.170:6789/0 conn(0x7fccd015fe30 legacy=0x7fccd0144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:20.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.422+0000 7fcccf400640 1 -- 172.21.15.137:0/4223924523 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd00d0280 con 0x7fccd00b54e0 2024-04-26T23:43:20.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.426+0000 7fcccf400640 1 --2- 172.21.15.137:0/4223924523 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccd00b54e0 0x7fccd00b5ee0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fccc0009870 tx=0x7fccc001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399b098cfcb4a825 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:20.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.426+0000 7fccce000640 1 -- 172.21.15.137:0/4223924523 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc00b0070 con 0x7fccd00b54e0 2024-04-26T23:43:20.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.426+0000 7fccce000640 1 -- 172.21.15.137:0/4223924523 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc00ab600 con 0x7fccd00b54e0 2024-04-26T23:43:20.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.426+0000 7fccce000640 1 -- 172.21.15.137:0/4223924523 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc00ab9d0 con 0x7fccd00b54e0 2024-04-26T23:43:20.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.426+0000 7fccd6200640 1 -- 172.21.15.137:0/4223924523 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccd00b54e0 msgr2=0x7fccd00b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:20.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.426+0000 7fccd6200640 1 --2- 172.21.15.137:0/4223924523 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccd00b54e0 0x7fccd00b5ee0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fccc0009870 tx=0x7fccc001c520 comp rx=0 tx=0).stop 2024-04-26T23:43:20.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.426+0000 7fccd6200640 1 -- 172.21.15.137:0/4223924523 shutdown_connections 2024-04-26T23:43:20.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.426+0000 7fccd6200640 1 --2- 172.21.15.137:0/4223924523 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccd00cd710 0x7fccd015f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.426+0000 7fccd6200640 1 --2- 172.21.15.137:0/4223924523 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccd00b54e0 0x7fccd00b5ee0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.426+0000 7fccd6200640 1 -- 172.21.15.137:0/4223924523 >> 172.21.15.137:0/4223924523 conn(0x7fccd006c800 msgr2=0x7fccd006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:20.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.426+0000 7fccd6200640 1 -- 172.21.15.137:0/4223924523 shutdown_connections 2024-04-26T23:43:20.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.426+0000 7fccd6200640 1 -- 172.21.15.137:0/4223924523 wait complete. 2024-04-26T23:43:20.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.426+0000 7fccd6200640 1 Processor -- start 2024-04-26T23:43:20.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.426+0000 7fccd6200640 1 -- start start 2024-04-26T23:43:20.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fccd6200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccd00b54e0 0x7fccd00b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fccd6200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccd00cd710 0x7fccd0155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fccd6200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccd015fe30 0x7fccd013e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fccd6200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fccd0145840 con 0x7fccd00cd710 2024-04-26T23:43:20.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fccd6200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fccd00cdb60 con 0x7fccd015fe30 2024-04-26T23:43:20.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fccd6200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fccd01459c0 con 0x7fccd00b54e0 2024-04-26T23:43:20.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fcccea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccd00cd710 0x7fccd0155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:20.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fcccea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccd00cd710 0x7fccd0155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43932/0 (socket says 172.21.15.137:43932) 2024-04-26T23:43:20.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fcccea00640 1 -- 172.21.15.137:0/1851347962 learned_addr learned my addr 172.21.15.137:0/1851347962 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:20.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fcccf400640 1 --2- 172.21.15.137:0/1851347962 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccd00b54e0 0x7fccd00b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:20.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fcccfe00640 1 --2- 172.21.15.137:0/1851347962 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccd015fe30 0x7fccd013e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:20.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fcccea00640 1 -- 172.21.15.137:0/1851347962 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccd00b54e0 msgr2=0x7fccd00b2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:20.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fcccea00640 1 --2- 172.21.15.137:0/1851347962 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccd00b54e0 0x7fccd00b2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fcccea00640 1 -- 172.21.15.137:0/1851347962 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccd015fe30 msgr2=0x7fccd013e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:20.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fcccea00640 1 --2- 172.21.15.137:0/1851347962 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccd015fe30 0x7fccd013e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fcccea00640 1 -- 172.21.15.137:0/1851347962 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd00b1e40 con 0x7fccd00cd710 2024-04-26T23:43:20.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fcccea00640 1 --2- 172.21.15.137:0/1851347962 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccd00cd710 0x7fccd0155de0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fccbc00b410 tx=0x7fccbc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:20.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fccc7400640 1 -- 172.21.15.137:0/1851347962 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc015020 con 0x7fccd00cd710 2024-04-26T23:43:20.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fccc7400640 1 -- 172.21.15.137:0/1851347962 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccbc011830 con 0x7fccd00cd710 2024-04-26T23:43:20.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fccc7400640 1 -- 172.21.15.137:0/1851347962 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc011c20 con 0x7fccd00cd710 2024-04-26T23:43:20.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fccd6200640 1 -- 172.21.15.137:0/1851347962 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccd00b2120 con 0x7fccd00cd710 2024-04-26T23:43:20.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fccd6200640 1 -- 172.21.15.137:0/1851347962 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccd00b26e0 con 0x7fccd00cd710 2024-04-26T23:43:20.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fccd6200640 1 -- 172.21.15.137:0/1851347962 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccd006a410 con 0x7fccd00cd710 2024-04-26T23:43:20.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.430+0000 7fccc7400640 1 -- 172.21.15.137:0/1851347962 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fccbc018020 con 0x7fccd00cd710 2024-04-26T23:43:20.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.434+0000 7fccc7400640 1 --2- 172.21.15.137:0/1851347962 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fccb00683b0 0x7fccb006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.434+0000 7fccc7400640 1 -- 172.21.15.137:0/1851347962 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7fccbc0864e0 con 0x7fccd00cd710 2024-04-26T23:43:20.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.434+0000 7fcccf400640 1 --2- 172.21.15.137:0/1851347962 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fccb00683b0 0x7fccb006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:20.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.434+0000 7fcccf400640 1 --2- 172.21.15.137:0/1851347962 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fccb00683b0 0x7fccb006a870 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fccc00ad000 tx=0x7fccc00a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:20.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.438+0000 7fccc7400640 1 -- 172.21.15.137:0/1851347962 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fccbc01f020 con 0x7fccd00cd710 2024-04-26T23:43:20.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.594+0000 7fccd6200640 1 -- 172.21.15.137:0/1851347962 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fccd015db00 con 0x7fccd00cd710 2024-04-26T23:43:20.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.594+0000 7fccc7400640 1 -- 172.21.15.137:0/1851347962 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) ==== 93+0+10 (secure 0 0 0) 0x7fccbc056de0 con 0x7fccd00cd710 2024-04-26T23:43:20.602 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:43:20.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.598+0000 7fccd6200640 1 -- 172.21.15.137:0/1851347962 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fccb00683b0 msgr2=0x7fccb006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:20.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.598+0000 7fccd6200640 1 --2- 172.21.15.137:0/1851347962 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fccb00683b0 0x7fccb006a870 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fccc00ad000 tx=0x7fccc00a6000 comp rx=0 tx=0).stop 2024-04-26T23:43:20.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.598+0000 7fccd6200640 1 -- 172.21.15.137:0/1851347962 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccd00cd710 msgr2=0x7fccd0155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:20.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.598+0000 7fccd6200640 1 --2- 172.21.15.137:0/1851347962 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccd00cd710 0x7fccd0155de0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fccbc00b410 tx=0x7fccbc00b8d0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.598+0000 7fccd6200640 1 -- 172.21.15.137:0/1851347962 shutdown_connections 2024-04-26T23:43:20.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.598+0000 7fccd6200640 1 --2- 172.21.15.137:0/1851347962 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fccb00683b0 0x7fccb006a870 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.598+0000 7fccd6200640 1 --2- 172.21.15.137:0/1851347962 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccd00cd710 0x7fccd0155de0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.598+0000 7fccd6200640 1 --2- 172.21.15.137:0/1851347962 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccd015fe30 0x7fccd013e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.598+0000 7fccd6200640 1 --2- 172.21.15.137:0/1851347962 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccd00b54e0 0x7fccd00b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.598+0000 7fccd6200640 1 -- 172.21.15.137:0/1851347962 >> 172.21.15.137:0/1851347962 conn(0x7fccd006c800 msgr2=0x7fccd00b3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:20.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.598+0000 7fccd6200640 1 -- 172.21.15.137:0/1851347962 shutdown_connections 2024-04-26T23:43:20.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.598+0000 7fccd6200640 1 -- 172.21.15.137:0/1851347962 wait complete. 2024-04-26T23:43:20.624 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T23:43:20.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.750+0000 7f072bc00640 1 Processor -- start 2024-04-26T23:43:20.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.750+0000 7f072bc00640 1 -- start start 2024-04-26T23:43:20.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.754+0000 7f072bc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f07240ce3e0 0x7f0724073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.754+0000 7f072bc00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f07240ce7c0 0x7f0724146210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.754+0000 7f072bc00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0724073010 con 0x7f072415de80 2024-04-26T23:43:20.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.754+0000 7f072bc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f07240cef90 con 0x7f07240ce3e0 2024-04-26T23:43:20.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.754+0000 7f072bc00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0724073280 con 0x7f07240ce7c0 2024-04-26T23:43:20.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.754+0000 7f0729200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f07240ce3e0 0x7f0724073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:20.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.754+0000 7f0729200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f07240ce3e0 0x7f0724073d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43944/0 (socket says 172.21.15.137:43944) 2024-04-26T23:43:20.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.754+0000 7f0729200640 1 -- 172.21.15.137:0/440481975 learned_addr learned my addr 172.21.15.137:0/440481975 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:20.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.754+0000 7f0729c00640 1 --2- 172.21.15.137:0/440481975 >> v2:172.21.15.170:3300/0 conn(0x7f07240ce7c0 0x7f0724146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:20.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.754+0000 7f0729200640 1 -- 172.21.15.137:0/440481975 >> v2:172.21.15.170:3300/0 conn(0x7f07240ce7c0 msgr2=0x7f0724146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:20.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.754+0000 7f0729200640 1 --2- 172.21.15.137:0/440481975 >> v2:172.21.15.170:3300/0 conn(0x7f07240ce7c0 0x7f0724146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.754+0000 7f0729200640 1 -- 172.21.15.137:0/440481975 >> v1:172.21.15.170:6789/0 conn(0x7f072415de80 legacy=0x7f07240d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:20.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.754+0000 7f0729200640 1 -- 172.21.15.137:0/440481975 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0724073560 con 0x7f07240ce3e0 2024-04-26T23:43:20.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.754+0000 7f0729c00640 1 --2- 172.21.15.137:0/440481975 >> v2:172.21.15.170:3300/0 conn(0x7f07240ce7c0 0x7f0724146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:43:20.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.758+0000 7f0729200640 1 --2- 172.21.15.137:0/440481975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07240ce3e0 0x7f0724073d60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0714009870 tx=0x7f071401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ab8a9c758af95 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:20.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.758+0000 7f0723e00640 1 -- 172.21.15.137:0/440481975 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07140b1070 con 0x7f07240ce3e0 2024-04-26T23:43:20.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.758+0000 7f0723e00640 1 -- 172.21.15.137:0/440481975 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07140ac620 con 0x7f07240ce3e0 2024-04-26T23:43:20.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.758+0000 7f0723e00640 1 -- 172.21.15.137:0/440481975 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07140ac9f0 con 0x7f07240ce3e0 2024-04-26T23:43:20.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.758+0000 7f072bc00640 1 -- 172.21.15.137:0/440481975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07240ce3e0 msgr2=0x7f0724073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:20.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.758+0000 7f072bc00640 1 --2- 172.21.15.137:0/440481975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07240ce3e0 0x7f0724073d60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0714009870 tx=0x7f071401c4b0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.758+0000 7f072bc00640 1 -- 172.21.15.137:0/440481975 shutdown_connections 2024-04-26T23:43:20.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.758+0000 7f072bc00640 1 --2- 172.21.15.137:0/440481975 >> v2:172.21.15.170:3300/0 conn(0x7f07240ce7c0 0x7f0724146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.758+0000 7f072bc00640 1 --2- 172.21.15.137:0/440481975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07240ce3e0 0x7f0724073d60 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.758+0000 7f072bc00640 1 -- 172.21.15.137:0/440481975 >> 172.21.15.137:0/440481975 conn(0x7f072406c5d0 msgr2=0x7f072406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:20.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.758+0000 7f072bc00640 1 -- 172.21.15.137:0/440481975 shutdown_connections 2024-04-26T23:43:20.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.758+0000 7f072bc00640 1 -- 172.21.15.137:0/440481975 wait complete. 2024-04-26T23:43:20.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.758+0000 7f072bc00640 1 Processor -- start 2024-04-26T23:43:20.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.758+0000 7f072bc00640 1 -- start start 2024-04-26T23:43:20.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f072bc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07240ce3e0 0x7f072413c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f072bc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07240ce7c0 0x7f07240afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f072bc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f072415de80 0x7f07241597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f072bc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f072406f0e0 con 0x7f07240ce7c0 2024-04-26T23:43:20.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f072bc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f072406ef60 con 0x7f07240ce3e0 2024-04-26T23:43:20.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f072bc00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f072406f260 con 0x7f072415de80 2024-04-26T23:43:20.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f071be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07240ce7c0 0x7f07240afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:20.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f071be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07240ce7c0 0x7f07240afd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54758/0 (socket says 172.21.15.137:54758) 2024-04-26T23:43:20.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f0729200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07240ce3e0 0x7f072413c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:20.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f071be00640 1 -- 172.21.15.137:0/2378010958 learned_addr learned my addr 172.21.15.137:0/2378010958 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:20.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f0729c00640 1 --2- 172.21.15.137:0/2378010958 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f072415de80 0x7f07241597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:20.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f071be00640 1 -- 172.21.15.137:0/2378010958 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f072415de80 msgr2=0x7f07241597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:20.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f071be00640 1 --2- 172.21.15.137:0/2378010958 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f072415de80 0x7f07241597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f071be00640 1 -- 172.21.15.137:0/2378010958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07240ce3e0 msgr2=0x7f072413c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:20.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f071be00640 1 --2- 172.21.15.137:0/2378010958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07240ce3e0 0x7f072413c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f071be00640 1 -- 172.21.15.137:0/2378010958 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0724159ec0 con 0x7f07240ce7c0 2024-04-26T23:43:20.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f071be00640 1 --2- 172.21.15.137:0/2378010958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07240ce7c0 0x7f07240afd70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f070c00c410 tx=0x7f070c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:20.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f0721600640 1 -- 172.21.15.137:0/2378010958 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c011790 con 0x7f07240ce7c0 2024-04-26T23:43:20.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f0721600640 1 -- 172.21.15.137:0/2378010958 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f070c017070 con 0x7f07240ce7c0 2024-04-26T23:43:20.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f0721600640 1 -- 172.21.15.137:0/2378010958 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c011bb0 con 0x7f07240ce7c0 2024-04-26T23:43:20.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f072bc00640 1 -- 172.21.15.137:0/2378010958 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0724141210 con 0x7f07240ce7c0 2024-04-26T23:43:20.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f072bc00640 1 -- 172.21.15.137:0/2378010958 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07241417d0 con 0x7f07240ce7c0 2024-04-26T23:43:20.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f072bc00640 1 -- 172.21.15.137:0/2378010958 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f072406a4b0 con 0x7f07240ce7c0 2024-04-26T23:43:20.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.762+0000 7f0721600640 1 -- 172.21.15.137:0/2378010958 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f070c01c460 con 0x7f07240ce7c0 2024-04-26T23:43:20.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.766+0000 7f0721600640 1 --2- 172.21.15.137:0/2378010958 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f07000683b0 0x7f070006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.766+0000 7f0721600640 1 -- 172.21.15.137:0/2378010958 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f070c0861e0 con 0x7f07240ce7c0 2024-04-26T23:43:20.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.766+0000 7f0729200640 1 --2- 172.21.15.137:0/2378010958 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f07000683b0 0x7f070006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:20.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.766+0000 7f0729200640 1 --2- 172.21.15.137:0/2378010958 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f07000683b0 0x7f070006a870 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f07140ae000 tx=0x7f07140a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:20.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.770+0000 7f0721600640 1 -- 172.21.15.137:0/2378010958 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f070c021020 con 0x7f07240ce7c0 2024-04-26T23:43:20.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.930+0000 7f072bc00640 1 -- 172.21.15.137:0/2378010958 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f07240d0980 con 0x7f07240ce7c0 2024-04-26T23:43:20.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.930+0000 7f0721600640 1 -- 172.21.15.137:0/2378010958 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) ==== 84+0+65 (secure 0 0 0) 0x7f070c003810 con 0x7f07240ce7c0 2024-04-26T23:43:20.937 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:20.937 INFO:teuthology.orchestra.run.smithi137.stdout:[ 2024-04-26T23:43:20.937 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:20.937 INFO:teuthology.orchestra.run.smithi137.stdout: "poolnum": 1, 2024-04-26T23:43:20.937 INFO:teuthology.orchestra.run.smithi137.stdout: "poolname": ".mgr" 2024-04-26T23:43:20.937 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:20.937 INFO:teuthology.orchestra.run.smithi137.stdout:] 2024-04-26T23:43:20.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.930+0000 7f072bc00640 1 -- 172.21.15.137:0/2378010958 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f07000683b0 msgr2=0x7f070006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:20.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.930+0000 7f072bc00640 1 --2- 172.21.15.137:0/2378010958 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f07000683b0 0x7f070006a870 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f07140ae000 tx=0x7f07140a7000 comp rx=0 tx=0).stop 2024-04-26T23:43:20.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.930+0000 7f072bc00640 1 -- 172.21.15.137:0/2378010958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07240ce7c0 msgr2=0x7f07240afd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:20.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.930+0000 7f072bc00640 1 --2- 172.21.15.137:0/2378010958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07240ce7c0 0x7f07240afd70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f070c00c410 tx=0x7f070c00c8d0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.930+0000 7f072bc00640 1 -- 172.21.15.137:0/2378010958 shutdown_connections 2024-04-26T23:43:20.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.930+0000 7f072bc00640 1 --2- 172.21.15.137:0/2378010958 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f07000683b0 0x7f070006a870 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.930+0000 7f072bc00640 1 --2- 172.21.15.137:0/2378010958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07240ce7c0 0x7f07240afd70 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.930+0000 7f072bc00640 1 --2- 172.21.15.137:0/2378010958 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f072415de80 0x7f07241597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.930+0000 7f072bc00640 1 --2- 172.21.15.137:0/2378010958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07240ce3e0 0x7f072413c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.930+0000 7f072bc00640 1 -- 172.21.15.137:0/2378010958 >> 172.21.15.137:0/2378010958 conn(0x7f072406c5d0 msgr2=0x7f072415c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:20.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.930+0000 7f072bc00640 1 -- 172.21.15.137:0/2378010958 shutdown_connections 2024-04-26T23:43:20.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:20.930+0000 7f072bc00640 1 -- 172.21.15.137:0/2378010958 wait complete. 2024-04-26T23:43:20.957 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T23:43:20.958 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T23:43:21.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.090+0000 7f359d200640 1 Processor -- start 2024-04-26T23:43:21.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.090+0000 7f359d200640 1 -- start start 2024-04-26T23:43:21.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.090+0000 7f359d200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f359815f130 0x7f35980b2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:21.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.090+0000 7f359d200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35980d0f30 con 0x7f35980d2e30 2024-04-26T23:43:21.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.090+0000 7f359d200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35980d11b0 con 0x7f35980b2d40 2024-04-26T23:43:21.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.090+0000 7f359d200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f35980d0250 con 0x7f359815f130 2024-04-26T23:43:21.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.090+0000 7f3595e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f359815f130 0x7f35980b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:21.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.090+0000 7f3596800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f35980d2e30 0x7f35980d1990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52938/0 (socket says 172.21.15.137:52938) 2024-04-26T23:43:21.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.090+0000 7f3596800640 1 -- 172.21.15.137:0/537308345 learned_addr learned my addr 172.21.15.137:0/537308345 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:21.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.090+0000 7f3595e00640 1 -- 172.21.15.137:0/537308345 >> v1:172.21.15.170:6789/0 conn(0x7f35980b2d40 legacy=0x7f35980cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:21.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.090+0000 7f3595e00640 1 -- 172.21.15.137:0/537308345 >> v1:172.21.15.137:6789/0 conn(0x7f35980d2e30 legacy=0x7f35980d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:21.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.090+0000 7f3595e00640 1 -- 172.21.15.137:0/537308345 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35980d0530 con 0x7f359815f130 2024-04-26T23:43:21.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.090+0000 7f3595400640 1 -- 172.21.15.137:0/537308345 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2828299829 0 0) 0x7f3590001120 con 0x7f35980d2e30 2024-04-26T23:43:21.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.094+0000 7f3595e00640 1 --2- 172.21.15.137:0/537308345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f359815f130 0x7f35980b2800 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3588009d90 tx=0x7f358801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bb96dc846ec909 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:21.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.094+0000 7f3595400640 1 -- 172.21.15.137:0/537308345 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35880b2070 con 0x7f359815f130 2024-04-26T23:43:21.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.094+0000 7f3595400640 1 -- 172.21.15.137:0/537308345 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35880a5980 con 0x7f359815f130 2024-04-26T23:43:21.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.094+0000 7f3595400640 1 -- 172.21.15.137:0/537308345 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35880a5d50 con 0x7f359815f130 2024-04-26T23:43:21.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.094+0000 7f359d200640 1 -- 172.21.15.137:0/537308345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f359815f130 msgr2=0x7f35980b2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:21.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.094+0000 7f359d200640 1 --2- 172.21.15.137:0/537308345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f359815f130 0x7f35980b2800 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3588009d90 tx=0x7f358801c8e0 comp rx=0 tx=0).stop 2024-04-26T23:43:21.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.094+0000 7f359d200640 1 -- 172.21.15.137:0/537308345 shutdown_connections 2024-04-26T23:43:21.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.094+0000 7f359d200640 1 --2- 172.21.15.137:0/537308345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f359815f130 0x7f35980b2800 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:21.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.094+0000 7f359d200640 1 -- 172.21.15.137:0/537308345 >> 172.21.15.137:0/537308345 conn(0x7f359809ba60 msgr2=0x7f359809be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:21.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.094+0000 7f359d200640 1 -- 172.21.15.137:0/537308345 shutdown_connections 2024-04-26T23:43:21.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.094+0000 7f359d200640 1 -- 172.21.15.137:0/537308345 wait complete. 2024-04-26T23:43:21.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f359d200640 1 Processor -- start 2024-04-26T23:43:21.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f359d200640 1 -- start start 2024-04-26T23:43:21.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f359d200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35980b2d40 0x7f3598153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:21.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f359d200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35980d2e30 0x7f359815c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:21.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f359d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f359815f130 0x7f35980cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:21.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f359d200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f35980d3650 con 0x7f35980b2d40 2024-04-26T23:43:21.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f359d200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f35980cfe30 con 0x7f359815f130 2024-04-26T23:43:21.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f359d200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f35980cb2c0 con 0x7f35980d2e30 2024-04-26T23:43:21.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f3595e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35980b2d40 0x7f3598153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:21.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f3595e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35980b2d40 0x7f3598153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54778/0 (socket says 172.21.15.137:54778) 2024-04-26T23:43:21.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f3595e00640 1 -- 172.21.15.137:0/829357658 learned_addr learned my addr 172.21.15.137:0/829357658 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:21.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f3596800640 1 --2- 172.21.15.137:0/829357658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f359815f130 0x7f35980cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:21.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f358d400640 1 --2- 172.21.15.137:0/829357658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35980d2e30 0x7f359815c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:21.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f3595e00640 1 -- 172.21.15.137:0/829357658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35980d2e30 msgr2=0x7f359815c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:21.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f3595e00640 1 --2- 172.21.15.137:0/829357658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35980d2e30 0x7f359815c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:21.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f3595e00640 1 -- 172.21.15.137:0/829357658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f359815f130 msgr2=0x7f35980cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:21.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f3595e00640 1 --2- 172.21.15.137:0/829357658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f359815f130 0x7f35980cc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:21.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f3595e00640 1 -- 172.21.15.137:0/829357658 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35980cb510 con 0x7f35980b2d40 2024-04-26T23:43:21.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f3595e00640 1 --2- 172.21.15.137:0/829357658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35980b2d40 0x7f3598153430 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f3588009d90 tx=0x7f3588019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:21.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f358ea00640 1 -- 172.21.15.137:0/829357658 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35880bd030 con 0x7f35980b2d40 2024-04-26T23:43:21.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f358ea00640 1 -- 172.21.15.137:0/829357658 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35880ad5c0 con 0x7f35980b2d40 2024-04-26T23:43:21.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f358ea00640 1 -- 172.21.15.137:0/829357658 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35880b2040 con 0x7f35980b2d40 2024-04-26T23:43:21.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f359d200640 1 -- 172.21.15.137:0/829357658 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35980cb7f0 con 0x7f35980b2d40 2024-04-26T23:43:21.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.098+0000 7f359d200640 1 -- 172.21.15.137:0/829357658 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35980cbdb0 con 0x7f35980b2d40 2024-04-26T23:43:21.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.102+0000 7f359d200640 1 -- 172.21.15.137:0/829357658 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35980765d0 con 0x7f35980b2d40 2024-04-26T23:43:21.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.102+0000 7f358ea00640 1 -- 172.21.15.137:0/829357658 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f35880c0070 con 0x7f35980b2d40 2024-04-26T23:43:21.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.102+0000 7f358ea00640 1 --2- 172.21.15.137:0/829357658 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3574068380 0x7f357406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:21.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.102+0000 7f358ea00640 1 -- 172.21.15.137:0/829357658 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f35881212d0 con 0x7f35980b2d40 2024-04-26T23:43:21.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.102+0000 7f358d400640 1 --2- 172.21.15.137:0/829357658 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3574068380 0x7f357406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:21.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.102+0000 7f358d400640 1 --2- 172.21.15.137:0/829357658 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3574068380 0x7f357406a840 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f359806c9a0 tx=0x7f3580009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:21.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.106+0000 7f358ea00640 1 -- 172.21.15.137:0/829357658 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3588016560 con 0x7f35980b2d40 2024-04-26T23:43:21.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:21.266+0000 7f359d200640 1 -- 172.21.15.137:0/829357658 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3598074500 con 0x7f35980b2d40 2024-04-26T23:43:22.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.182+0000 7f358ea00640 1 -- 172.21.15.137:0/829357658 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v42) ==== 138+0+0 (secure 0 0 0) 0x7f35880f1b40 con 0x7f35980b2d40 2024-04-26T23:43:22.189 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' created 2024-04-26T23:43:22.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.186+0000 7f359d200640 1 -- 172.21.15.137:0/829357658 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3574068380 msgr2=0x7f357406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:22.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.186+0000 7f359d200640 1 --2- 172.21.15.137:0/829357658 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3574068380 0x7f357406a840 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f359806c9a0 tx=0x7f3580009040 comp rx=0 tx=0).stop 2024-04-26T23:43:22.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.186+0000 7f359d200640 1 -- 172.21.15.137:0/829357658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35980b2d40 msgr2=0x7f3598153430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:22.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.186+0000 7f359d200640 1 --2- 172.21.15.137:0/829357658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35980b2d40 0x7f3598153430 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f3588009d90 tx=0x7f3588019680 comp rx=0 tx=0).stop 2024-04-26T23:43:22.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.186+0000 7f359d200640 1 -- 172.21.15.137:0/829357658 shutdown_connections 2024-04-26T23:43:22.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.186+0000 7f359d200640 1 --2- 172.21.15.137:0/829357658 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3574068380 0x7f357406a840 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:22.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.186+0000 7f359d200640 1 --2- 172.21.15.137:0/829357658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f359815f130 0x7f35980cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:22.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.186+0000 7f359d200640 1 --2- 172.21.15.137:0/829357658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35980d2e30 0x7f359815c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:22.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.186+0000 7f359d200640 1 --2- 172.21.15.137:0/829357658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35980b2d40 0x7f3598153430 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:22.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.186+0000 7f359d200640 1 -- 172.21.15.137:0/829357658 >> 172.21.15.137:0/829357658 conn(0x7f359809ba60 msgr2=0x7f35980b3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:22.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.186+0000 7f359d200640 1 -- 172.21.15.137:0/829357658 shutdown_connections 2024-04-26T23:43:22.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.186+0000 7f359d200640 1 -- 172.21.15.137:0/829357658 wait complete. 2024-04-26T23:43:22.220 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T23:43:22.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.358+0000 7fa41c600640 1 Processor -- start 2024-04-26T23:43:22.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.358+0000 7fa41c600640 1 -- start start 2024-04-26T23:43:22.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.358+0000 7fa41c600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa4140ceac0 0x7fa41415df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:22.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.358+0000 7fa41c600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa414072860 con 0x7fa414073f20 2024-04-26T23:43:22.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.358+0000 7fa41c600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4140743b0 con 0x7fa4140afbc0 2024-04-26T23:43:22.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.358+0000 7fa41c600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fa414072b00 con 0x7fa4140ceac0 2024-04-26T23:43:22.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.358+0000 7fa419200640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa414073f20 0x7fa4140ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52950/0 (socket says 172.21.15.137:52950) 2024-04-26T23:43:22.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.358+0000 7fa419200640 1 -- 172.21.15.137:0/2210111820 learned_addr learned my addr 172.21.15.137:0/2210111820 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:22.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.358+0000 7fa41a600640 1 --2- 172.21.15.137:0/2210111820 >> v2:172.21.15.170:3300/0 conn(0x7fa4140ceac0 0x7fa41415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:22.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.358+0000 7fa413e00640 1 -- 172.21.15.137:0/2210111820 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3400749821 0 0) 0x7fa414072860 con 0x7fa414073f20 2024-04-26T23:43:22.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.362+0000 7fa413e00640 1 -- 172.21.15.137:0/2210111820 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3fc003530 con 0x7fa414073f20 2024-04-26T23:43:22.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.362+0000 7fa413e00640 1 -- 172.21.15.137:0/2210111820 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 268920958 0 0) 0x7fa4140743b0 con 0x7fa4140afbc0 2024-04-26T23:43:22.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.362+0000 7fa413e00640 1 -- 172.21.15.137:0/2210111820 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa414072860 con 0x7fa4140afbc0 2024-04-26T23:43:22.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.362+0000 7fa413e00640 1 -- 172.21.15.137:0/2210111820 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2685261574 0 0) 0x7fa3fc003530 con 0x7fa414073f20 2024-04-26T23:43:22.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.362+0000 7fa41a600640 1 -- 172.21.15.137:0/2210111820 >> v1:172.21.15.170:6789/0 conn(0x7fa4140afbc0 legacy=0x7fa4140735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:22.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.362+0000 7fa41a600640 1 -- 172.21.15.137:0/2210111820 >> v1:172.21.15.137:6789/0 conn(0x7fa414073f20 legacy=0x7fa4140ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:22.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.362+0000 7fa41a600640 1 -- 172.21.15.137:0/2210111820 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa414072de0 con 0x7fa4140ceac0 2024-04-26T23:43:22.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.362+0000 7fa41a600640 1 --2- 172.21.15.137:0/2210111820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4140ceac0 0x7fa41415df90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa40c009dc0 tx=0x7fa40c01c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f613685e100813b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:22.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.362+0000 7fa413e00640 1 -- 172.21.15.137:0/2210111820 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c0b2070 con 0x7fa4140ceac0 2024-04-26T23:43:22.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.362+0000 7fa413e00640 1 -- 172.21.15.137:0/2210111820 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa40c0a55a0 con 0x7fa4140ceac0 2024-04-26T23:43:22.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.362+0000 7fa413e00640 1 -- 172.21.15.137:0/2210111820 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa400001680 con 0x7fa4140ceac0 2024-04-26T23:43:22.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41c600640 1 -- 172.21.15.137:0/2210111820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4140ceac0 msgr2=0x7fa41415df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:22.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41c600640 1 --2- 172.21.15.137:0/2210111820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4140ceac0 0x7fa41415df90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa40c009dc0 tx=0x7fa40c01c870 comp rx=0 tx=0).stop 2024-04-26T23:43:22.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41c600640 1 -- 172.21.15.137:0/2210111820 shutdown_connections 2024-04-26T23:43:22.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41c600640 1 --2- 172.21.15.137:0/2210111820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4140ceac0 0x7fa41415df90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:22.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41c600640 1 -- 172.21.15.137:0/2210111820 >> 172.21.15.137:0/2210111820 conn(0x7fa41406c800 msgr2=0x7fa41406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:22.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41c600640 1 -- 172.21.15.137:0/2210111820 shutdown_connections 2024-04-26T23:43:22.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41c600640 1 -- 172.21.15.137:0/2210111820 wait complete. 2024-04-26T23:43:22.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41c600640 1 Processor -- start 2024-04-26T23:43:22.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41c600640 1 -- start start 2024-04-26T23:43:22.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41c600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4140afbc0 0x7fa4141513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:22.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41c600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4140ceac0 0x7fa414152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:22.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41c600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4140b5a50 0x7fa4140aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:22.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41c600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa41406ffe0 con 0x7fa4140b5a50 2024-04-26T23:43:22.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41c600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa4140b01f0 con 0x7fa4140afbc0 2024-04-26T23:43:22.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41c600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa414070160 con 0x7fa4140ceac0 2024-04-26T23:43:22.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41a600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4140b5a50 0x7fa4140aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:22.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41a600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4140b5a50 0x7fa4140aeb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54794/0 (socket says 172.21.15.137:54794) 2024-04-26T23:43:22.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41a600640 1 -- 172.21.15.137:0/3229968841 learned_addr learned my addr 172.21.15.137:0/3229968841 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:22.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa419c00640 1 --2- 172.21.15.137:0/3229968841 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4140afbc0 0x7fa4141513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:22.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa419200640 1 --2- 172.21.15.137:0/3229968841 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4140ceac0 0x7fa414152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:22.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41a600640 1 -- 172.21.15.137:0/3229968841 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4140ceac0 msgr2=0x7fa414152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:22.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41a600640 1 --2- 172.21.15.137:0/3229968841 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4140ceac0 0x7fa414152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:22.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41a600640 1 -- 172.21.15.137:0/3229968841 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4140afbc0 msgr2=0x7fa4141513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:22.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41a600640 1 --2- 172.21.15.137:0/3229968841 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4140afbc0 0x7fa4141513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:22.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa41a600640 1 -- 172.21.15.137:0/3229968841 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa41414ba80 con 0x7fa4140b5a50 2024-04-26T23:43:22.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa419200640 1 --2- 172.21.15.137:0/3229968841 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4140ceac0 0x7fa414152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:22.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.366+0000 7fa419c00640 1 --2- 172.21.15.137:0/3229968841 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4140afbc0 0x7fa4141513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:22.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.370+0000 7fa41a600640 1 --2- 172.21.15.137:0/3229968841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4140b5a50 0x7fa4140aeb30 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa40c0b0040 tx=0x7fa40c019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:22.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.370+0000 7fa411600640 1 -- 172.21.15.137:0/3229968841 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c0b2070 con 0x7fa4140b5a50 2024-04-26T23:43:22.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.370+0000 7fa411600640 1 -- 172.21.15.137:0/3229968841 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa40c0bc070 con 0x7fa4140b5a50 2024-04-26T23:43:22.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.370+0000 7fa411600640 1 -- 172.21.15.137:0/3229968841 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c009450 con 0x7fa4140b5a50 2024-04-26T23:43:22.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.370+0000 7fa41c600640 1 -- 172.21.15.137:0/3229968841 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa414151a00 con 0x7fa4140b5a50 2024-04-26T23:43:22.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.370+0000 7fa41c600640 1 -- 172.21.15.137:0/3229968841 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa414151fc0 con 0x7fa4140b5a50 2024-04-26T23:43:22.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.370+0000 7fa41c600640 1 -- 172.21.15.137:0/3229968841 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa41406a410 con 0x7fa4140b5a50 2024-04-26T23:43:22.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.370+0000 7fa411600640 1 -- 172.21.15.137:0/3229968841 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa40c004040 con 0x7fa4140b5a50 2024-04-26T23:43:22.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.370+0000 7fa411600640 1 --2- 172.21.15.137:0/3229968841 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa3f4068380 0x7fa3f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:22.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.370+0000 7fa411600640 1 -- 172.21.15.137:0/3229968841 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5227+0+0 (secure 0 0 0) 0x7fa40c120fd0 con 0x7fa4140b5a50 2024-04-26T23:43:22.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.370+0000 7fa419c00640 1 --2- 172.21.15.137:0/3229968841 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa3f4068380 0x7fa3f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:22.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.374+0000 7fa419c00640 1 --2- 172.21.15.137:0/3229968841 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa3f4068380 0x7fa3f406a840 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa4080011f0 tx=0x7fa408009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:22.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.378+0000 7fa411600640 1 -- 172.21.15.137:0/3229968841 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa40c0164a0 con 0x7fa4140b5a50 2024-04-26T23:43:22.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:22.534+0000 7fa41c600640 1 -- 172.21.15.137:0/3229968841 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa414160870 con 0x7fa4140b5a50 2024-04-26T23:43:23.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.186+0000 7fa411600640 1 -- 172.21.15.137:0/3229968841 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v43) ==== 170+0+0 (secure 0 0 0) 0x7fa40c0f1760 con 0x7fa4140b5a50 2024-04-26T23:43:23.192 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' created 2024-04-26T23:43:23.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.190+0000 7fa41c600640 1 -- 172.21.15.137:0/3229968841 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa3f4068380 msgr2=0x7fa3f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:23.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.190+0000 7fa41c600640 1 --2- 172.21.15.137:0/3229968841 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa3f4068380 0x7fa3f406a840 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa4080011f0 tx=0x7fa408009040 comp rx=0 tx=0).stop 2024-04-26T23:43:23.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.190+0000 7fa41c600640 1 -- 172.21.15.137:0/3229968841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4140b5a50 msgr2=0x7fa4140aeb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:23.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.190+0000 7fa41c600640 1 --2- 172.21.15.137:0/3229968841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4140b5a50 0x7fa4140aeb30 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa40c0b0040 tx=0x7fa40c019610 comp rx=0 tx=0).stop 2024-04-26T23:43:23.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.190+0000 7fa41c600640 1 -- 172.21.15.137:0/3229968841 shutdown_connections 2024-04-26T23:43:23.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.190+0000 7fa41c600640 1 --2- 172.21.15.137:0/3229968841 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa3f4068380 0x7fa3f406a840 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:23.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.190+0000 7fa41c600640 1 --2- 172.21.15.137:0/3229968841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4140b5a50 0x7fa4140aeb30 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:23.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.190+0000 7fa41c600640 1 --2- 172.21.15.137:0/3229968841 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4140ceac0 0x7fa414152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:23.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.190+0000 7fa41c600640 1 --2- 172.21.15.137:0/3229968841 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4140afbc0 0x7fa4141513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:23.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.190+0000 7fa41c600640 1 -- 172.21.15.137:0/3229968841 >> 172.21.15.137:0/3229968841 conn(0x7fa41406c800 msgr2=0x7fa4140b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:23.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.190+0000 7fa41c600640 1 -- 172.21.15.137:0/3229968841 shutdown_connections 2024-04-26T23:43:23.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.190+0000 7fa41c600640 1 -- 172.21.15.137:0/3229968841 wait complete. 2024-04-26T23:43:23.238 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T23:43:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.370+0000 7fd040800640 1 Processor -- start 2024-04-26T23:43:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.370+0000 7fd040800640 1 -- start start 2024-04-26T23:43:23.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.374+0000 7fd040800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd038073f20 0x7fd03815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:23.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.374+0000 7fd040800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd0380affa0 0x7fd0380ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:23.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.374+0000 7fd040800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd038072860 con 0x7fd0380afbc0 2024-04-26T23:43:23.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.374+0000 7fd040800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd0380743b0 con 0x7fd0380affa0 2024-04-26T23:43:23.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.374+0000 7fd040800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd038072b00 con 0x7fd038073f20 2024-04-26T23:43:23.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.374+0000 7fd03e800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd0380affa0 0x7fd0380ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:23.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.374+0000 7fd03e800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd0380affa0 0x7fd0380ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54800/0 (socket says 172.21.15.137:54800) 2024-04-26T23:43:23.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.374+0000 7fd03e800640 1 -- 172.21.15.137:0/1372535980 learned_addr learned my addr 172.21.15.137:0/1372535980 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:23.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.374+0000 7fd03d400640 1 --2- 172.21.15.137:0/1372535980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd038073f20 0x7fd03815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:23.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.374+0000 7fd03e800640 1 -- 172.21.15.137:0/1372535980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd038073f20 msgr2=0x7fd03815df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:23.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.374+0000 7fd03e800640 1 --2- 172.21.15.137:0/1372535980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd038073f20 0x7fd03815df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:23.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.374+0000 7fd03e800640 1 -- 172.21.15.137:0/1372535980 >> v1:172.21.15.170:6789/0 conn(0x7fd0380afbc0 legacy=0x7fd0380735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:23.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.374+0000 7fd03e800640 1 -- 172.21.15.137:0/1372535980 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd038072de0 con 0x7fd0380affa0 2024-04-26T23:43:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.374+0000 7fd03e800640 1 --2- 172.21.15.137:0/1372535980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0380affa0 0x7fd0380ce3b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd034009e50 tx=0x7fd03401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965bee2501722b78 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.374+0000 7fd03ca00640 1 -- 172.21.15.137:0/1372535980 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0340a5700 con 0x7fd0380affa0 2024-04-26T23:43:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.374+0000 7fd03ca00640 1 -- 172.21.15.137:0/1372535980 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0340a58a0 con 0x7fd0380affa0 2024-04-26T23:43:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.374+0000 7fd03ca00640 1 -- 172.21.15.137:0/1372535980 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0340a5c70 con 0x7fd0380affa0 2024-04-26T23:43:23.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd040800640 1 -- 172.21.15.137:0/1372535980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0380affa0 msgr2=0x7fd0380ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:23.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd040800640 1 --2- 172.21.15.137:0/1372535980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0380affa0 0x7fd0380ce3b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd034009e50 tx=0x7fd03401ca30 comp rx=0 tx=0).stop 2024-04-26T23:43:23.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd040800640 1 -- 172.21.15.137:0/1372535980 shutdown_connections 2024-04-26T23:43:23.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd040800640 1 --2- 172.21.15.137:0/1372535980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0380affa0 0x7fd0380ce3b0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:23.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd040800640 1 --2- 172.21.15.137:0/1372535980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd038073f20 0x7fd03815df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:23.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd040800640 1 -- 172.21.15.137:0/1372535980 >> 172.21.15.137:0/1372535980 conn(0x7fd03806c800 msgr2=0x7fd03806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:23.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd040800640 1 -- 172.21.15.137:0/1372535980 shutdown_connections 2024-04-26T23:43:23.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd040800640 1 -- 172.21.15.137:0/1372535980 wait complete. 2024-04-26T23:43:23.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd040800640 1 Processor -- start 2024-04-26T23:43:23.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd040800640 1 -- start start 2024-04-26T23:43:23.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd040800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0380afbc0 0x7fd0381409b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:23.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd040800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0380affa0 0x7fd03814fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:23.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd040800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd038150530 0x7fd038150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:23.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd040800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd03806f3a0 con 0x7fd038150530 2024-04-26T23:43:23.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd040800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd03806f220 con 0x7fd0380afbc0 2024-04-26T23:43:23.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd040800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd03806f520 con 0x7fd0380affa0 2024-04-26T23:43:23.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd03e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd038150530 0x7fd038150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:23.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd03e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd038150530 0x7fd038150c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54808/0 (socket says 172.21.15.137:54808) 2024-04-26T23:43:23.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd03e800640 1 -- 172.21.15.137:0/3485734799 learned_addr learned my addr 172.21.15.137:0/3485734799 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:23.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd03de00640 1 --2- 172.21.15.137:0/3485734799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0380afbc0 0x7fd0381409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:23.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd03d400640 1 --2- 172.21.15.137:0/3485734799 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0380affa0 0x7fd03814fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:23.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd03e800640 1 -- 172.21.15.137:0/3485734799 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0380affa0 msgr2=0x7fd03814fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:23.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd03e800640 1 --2- 172.21.15.137:0/3485734799 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0380affa0 0x7fd03814fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:23.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd03e800640 1 -- 172.21.15.137:0/3485734799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0380afbc0 msgr2=0x7fd0381409b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:23.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd03e800640 1 --2- 172.21.15.137:0/3485734799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0380afbc0 0x7fd0381409b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:23.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.378+0000 7fd03e800640 1 -- 172.21.15.137:0/3485734799 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0380b05d0 con 0x7fd038150530 2024-04-26T23:43:23.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.382+0000 7fd03d400640 1 --2- 172.21.15.137:0/3485734799 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0380affa0 0x7fd03814fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:23.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.382+0000 7fd03e800640 1 --2- 172.21.15.137:0/3485734799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd038150530 0x7fd038150c40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd034009e50 tx=0x7fd0340197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:23.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.382+0000 7fd032000640 1 -- 172.21.15.137:0/3485734799 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd034009510 con 0x7fd038150530 2024-04-26T23:43:23.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.382+0000 7fd032000640 1 -- 172.21.15.137:0/3485734799 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0340be070 con 0x7fd038150530 2024-04-26T23:43:23.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.382+0000 7fd032000640 1 -- 172.21.15.137:0/3485734799 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0340b88d0 con 0x7fd038150530 2024-04-26T23:43:23.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.382+0000 7fd040800640 1 -- 172.21.15.137:0/3485734799 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0380b08b0 con 0x7fd038150530 2024-04-26T23:43:23.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.382+0000 7fd040800640 1 -- 172.21.15.137:0/3485734799 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0380b0e70 con 0x7fd038150530 2024-04-26T23:43:23.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.382+0000 7fd040800640 1 -- 172.21.15.137:0/3485734799 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd03806a410 con 0x7fd038150530 2024-04-26T23:43:23.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.382+0000 7fd032000640 1 -- 172.21.15.137:0/3485734799 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd0340b8a70 con 0x7fd038150530 2024-04-26T23:43:23.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.386+0000 7fd032000640 1 --2- 172.21.15.137:0/3485734799 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd01c0683b0 0x7fd01c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:23.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.386+0000 7fd032000640 1 -- 172.21.15.137:0/3485734799 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5609+0+0 (secure 0 0 0) 0x7fd0341223f0 con 0x7fd038150530 2024-04-26T23:43:23.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.386+0000 7fd03de00640 1 --2- 172.21.15.137:0/3485734799 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd01c0683b0 0x7fd01c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:23.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.386+0000 7fd03de00640 1 --2- 172.21.15.137:0/3485734799 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd01c0683b0 0x7fd01c06a870 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd02c007fd0 tx=0x7fd02c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:23.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.390+0000 7fd032000640 1 -- 172.21.15.137:0/3485734799 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd034016620 con 0x7fd038150530 2024-04-26T23:43:23.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:23.582+0000 7fd040800640 1 -- 172.21.15.137:0/3485734799 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd038160870 con 0x7fd038150530 2024-04-26T23:43:24.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.210+0000 7fd032000640 1 -- 172.21.15.137:0/3485734799 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v21) ==== 172+0+0 (secure 0 0 0) 0x7fd0340f2a80 con 0x7fd038150530 2024-04-26T23:43:24.223 INFO:teuthology.orchestra.run.smithi137.stderr:new fs with metadata pool 6 and data pool 7 2024-04-26T23:43:24.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.222+0000 7fd040800640 1 -- 172.21.15.137:0/3485734799 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd01c0683b0 msgr2=0x7fd01c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:24.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.222+0000 7fd040800640 1 --2- 172.21.15.137:0/3485734799 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd01c0683b0 0x7fd01c06a870 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd02c007fd0 tx=0x7fd02c009040 comp rx=0 tx=0).stop 2024-04-26T23:43:24.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.222+0000 7fd040800640 1 -- 172.21.15.137:0/3485734799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd038150530 msgr2=0x7fd038150c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:24.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.222+0000 7fd040800640 1 --2- 172.21.15.137:0/3485734799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd038150530 0x7fd038150c40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd034009e50 tx=0x7fd0340197d0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.230+0000 7fd040800640 1 -- 172.21.15.137:0/3485734799 shutdown_connections 2024-04-26T23:43:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.230+0000 7fd040800640 1 --2- 172.21.15.137:0/3485734799 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd01c0683b0 0x7fd01c06a870 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.230+0000 7fd040800640 1 --2- 172.21.15.137:0/3485734799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd038150530 0x7fd038150c40 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.230+0000 7fd040800640 1 --2- 172.21.15.137:0/3485734799 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0380affa0 0x7fd03814fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.230+0000 7fd040800640 1 --2- 172.21.15.137:0/3485734799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0380afbc0 0x7fd0381409b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.230+0000 7fd040800640 1 -- 172.21.15.137:0/3485734799 >> 172.21.15.137:0/3485734799 conn(0x7fd03806c800 msgr2=0x7fd03806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:24.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.234+0000 7fd040800640 1 -- 172.21.15.137:0/3485734799 shutdown_connections 2024-04-26T23:43:24.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.234+0000 7fd040800640 1 -- 172.21.15.137:0/3485734799 wait complete. 2024-04-26T23:43:24.273 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:43:24.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.402+0000 7ff094400640 1 Processor -- start 2024-04-26T23:43:24.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.402+0000 7ff094400640 1 -- start start 2024-04-26T23:43:24.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.402+0000 7ff094400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff08c15de80 0x7ff08c073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:24.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.402+0000 7ff094400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff08c073010 con 0x7ff08c0ce7c0 2024-04-26T23:43:24.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.402+0000 7ff094400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff08c0cef90 con 0x7ff08c0ce3e0 2024-04-26T23:43:24.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.402+0000 7ff094400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff08c073280 con 0x7ff08c15de80 2024-04-26T23:43:24.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.402+0000 7ff092400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7ff08c0ce7c0 0x7ff08c146210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52966/0 (socket says 172.21.15.137:52966) 2024-04-26T23:43:24.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.402+0000 7ff092400640 1 -- 172.21.15.137:0/3866963923 learned_addr learned my addr 172.21.15.137:0/3866963923 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:24.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.402+0000 7ff091000640 1 --2- 172.21.15.137:0/3866963923 >> v2:172.21.15.170:3300/0 conn(0x7ff08c15de80 0x7ff08c073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:24.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.406+0000 7ff08be00640 1 -- 172.21.15.137:0/3866963923 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3576823680 0 0) 0x7ff08c073010 con 0x7ff08c0ce7c0 2024-04-26T23:43:24.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.406+0000 7ff08be00640 1 -- 172.21.15.137:0/3866963923 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff074003530 con 0x7ff08c0ce7c0 2024-04-26T23:43:24.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.406+0000 7ff091000640 1 -- 172.21.15.137:0/3866963923 >> v1:172.21.15.170:6789/0 conn(0x7ff08c0ce3e0 legacy=0x7ff08c0d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:24.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.406+0000 7ff091000640 1 -- 172.21.15.137:0/3866963923 >> v1:172.21.15.137:6789/0 conn(0x7ff08c0ce7c0 legacy=0x7ff08c146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:24.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.406+0000 7ff091000640 1 -- 172.21.15.137:0/3866963923 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08c073560 con 0x7ff08c15de80 2024-04-26T23:43:24.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.406+0000 7ff091000640 1 --2- 172.21.15.137:0/3866963923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff08c15de80 0x7ff08c073d60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff0780097f0 tx=0x7ff07801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6b3ea1640d0b86 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:24.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.406+0000 7ff08be00640 1 -- 172.21.15.137:0/3866963923 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0780aa5f0 con 0x7ff08c15de80 2024-04-26T23:43:24.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.406+0000 7ff08be00640 1 -- 172.21.15.137:0/3866963923 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0780af070 con 0x7ff08c15de80 2024-04-26T23:43:24.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.406+0000 7ff08be00640 1 -- 172.21.15.137:0/3866963923 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0780aa990 con 0x7ff08c15de80 2024-04-26T23:43:24.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff094400640 1 -- 172.21.15.137:0/3866963923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff08c15de80 msgr2=0x7ff08c073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:24.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff094400640 1 --2- 172.21.15.137:0/3866963923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff08c15de80 0x7ff08c073d60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff0780097f0 tx=0x7ff07801c470 comp rx=0 tx=0).stop 2024-04-26T23:43:24.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff094400640 1 -- 172.21.15.137:0/3866963923 shutdown_connections 2024-04-26T23:43:24.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff094400640 1 --2- 172.21.15.137:0/3866963923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff08c15de80 0x7ff08c073d60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff094400640 1 -- 172.21.15.137:0/3866963923 >> 172.21.15.137:0/3866963923 conn(0x7ff08c06c5d0 msgr2=0x7ff08c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:24.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff094400640 1 -- 172.21.15.137:0/3866963923 shutdown_connections 2024-04-26T23:43:24.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff094400640 1 -- 172.21.15.137:0/3866963923 wait complete. 2024-04-26T23:43:24.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff094400640 1 Processor -- start 2024-04-26T23:43:24.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff094400640 1 -- start start 2024-04-26T23:43:24.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff094400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08c0ce3e0 0x7ff08c13f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:24.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff094400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08c0ce7c0 0x7ff08c0b5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:24.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff094400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff08c15de80 0x7ff08c0c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:24.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff094400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c06ed10 con 0x7ff08c0ce7c0 2024-04-26T23:43:24.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff094400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c06ee90 con 0x7ff08c15de80 2024-04-26T23:43:24.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff094400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff08c06f010 con 0x7ff08c0ce3e0 2024-04-26T23:43:24.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff091000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08c0ce7c0 0x7ff08c0b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:24.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff091000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08c0ce7c0 0x7ff08c0b5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54818/0 (socket says 172.21.15.137:54818) 2024-04-26T23:43:24.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff091000640 1 -- 172.21.15.137:0/2224851919 learned_addr learned my addr 172.21.15.137:0/2224851919 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:24.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff091a00640 1 --2- 172.21.15.137:0/2224851919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08c0ce3e0 0x7ff08c13f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:24.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff092400640 1 --2- 172.21.15.137:0/2224851919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff08c15de80 0x7ff08c0c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:24.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff091000640 1 -- 172.21.15.137:0/2224851919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08c0ce3e0 msgr2=0x7ff08c13f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:24.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff091000640 1 --2- 172.21.15.137:0/2224851919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08c0ce3e0 0x7ff08c13f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff091000640 1 -- 172.21.15.137:0/2224851919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff08c15de80 msgr2=0x7ff08c0c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:24.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff091000640 1 --2- 172.21.15.137:0/2224851919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff08c15de80 0x7ff08c0c5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff091000640 1 -- 172.21.15.137:0/2224851919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08c13fbc0 con 0x7ff08c0ce7c0 2024-04-26T23:43:24.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.410+0000 7ff091000640 1 --2- 172.21.15.137:0/2224851919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08c0ce7c0 0x7ff08c0b5440 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff078009740 tx=0x7ff07801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:24.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.414+0000 7ff089600640 1 -- 172.21.15.137:0/2224851919 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff078004030 con 0x7ff08c0ce7c0 2024-04-26T23:43:24.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.414+0000 7ff089600640 1 -- 172.21.15.137:0/2224851919 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0780041d0 con 0x7ff08c0ce7c0 2024-04-26T23:43:24.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.414+0000 7ff089600640 1 -- 172.21.15.137:0/2224851919 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff078003620 con 0x7ff08c0ce7c0 2024-04-26T23:43:24.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.414+0000 7ff094400640 1 -- 172.21.15.137:0/2224851919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff08c15f650 con 0x7ff08c0ce7c0 2024-04-26T23:43:24.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.414+0000 7ff094400640 1 -- 172.21.15.137:0/2224851919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff08c0b4960 con 0x7ff08c0ce7c0 2024-04-26T23:43:24.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.414+0000 7ff094400640 1 -- 172.21.15.137:0/2224851919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff08c06a4b0 con 0x7ff08c0ce7c0 2024-04-26T23:43:24.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.414+0000 7ff089600640 1 -- 172.21.15.137:0/2224851919 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff0780037c0 con 0x7ff08c0ce7c0 2024-04-26T23:43:24.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.414+0000 7ff089600640 1 --2- 172.21.15.137:0/2224851919 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff06c0683b0 0x7ff06c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:24.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.414+0000 7ff089600640 1 -- 172.21.15.137:0/2224851919 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7ff0781211a0 con 0x7ff08c0ce7c0 2024-04-26T23:43:24.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.414+0000 7ff091a00640 1 --2- 172.21.15.137:0/2224851919 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff06c0683b0 0x7ff06c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:24.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.418+0000 7ff091a00640 1 --2- 172.21.15.137:0/2224851919 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff06c0683b0 0x7ff06c06a870 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff080007fd0 tx=0x7ff080009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:24.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.422+0000 7ff089600640 1 -- 172.21.15.137:0/2224851919 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff078016090 con 0x7ff08c0ce7c0 2024-04-26T23:43:24.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.578+0000 7ff094400640 1 -- 172.21.15.137:0/2224851919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff08c0726d0 con 0x7ff08c0ce7c0 2024-04-26T23:43:24.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.578+0000 7ff089600640 1 -- 172.21.15.137:0/2224851919 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16674 (secure 0 0 0) 0x7ff0780f1100 con 0x7ff08c0ce7c0 2024-04-26T23:43:24.586 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:24.586 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":44,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:43:23.588851+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:43:21.281556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T23:43:22.549121+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:43:24.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.578+0000 7ff094400640 1 -- 172.21.15.137:0/2224851919 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff06c0683b0 msgr2=0x7ff06c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:24.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.578+0000 7ff094400640 1 --2- 172.21.15.137:0/2224851919 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff06c0683b0 0x7ff06c06a870 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff080007fd0 tx=0x7ff080009040 comp rx=0 tx=0).stop 2024-04-26T23:43:24.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.578+0000 7ff094400640 1 -- 172.21.15.137:0/2224851919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08c0ce7c0 msgr2=0x7ff08c0b5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:24.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.578+0000 7ff094400640 1 --2- 172.21.15.137:0/2224851919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08c0ce7c0 0x7ff08c0b5440 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff078009740 tx=0x7ff07801acb0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.578+0000 7ff094400640 1 -- 172.21.15.137:0/2224851919 shutdown_connections 2024-04-26T23:43:24.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.578+0000 7ff094400640 1 --2- 172.21.15.137:0/2224851919 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff06c0683b0 0x7ff06c06a870 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.578+0000 7ff094400640 1 --2- 172.21.15.137:0/2224851919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08c0ce7c0 0x7ff08c0b5440 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.578+0000 7ff094400640 1 --2- 172.21.15.137:0/2224851919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff08c15de80 0x7ff08c0c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.578+0000 7ff094400640 1 --2- 172.21.15.137:0/2224851919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08c0ce3e0 0x7ff08c13f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.578+0000 7ff094400640 1 -- 172.21.15.137:0/2224851919 >> 172.21.15.137:0/2224851919 conn(0x7ff08c06c5d0 msgr2=0x7ff08c143d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:24.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.578+0000 7ff094400640 1 -- 172.21.15.137:0/2224851919 shutdown_connections 2024-04-26T23:43:24.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.578+0000 7ff094400640 1 -- 172.21.15.137:0/2224851919 wait complete. 2024-04-26T23:43:24.608 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:43:24.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.738+0000 7f657ba00640 1 Processor -- start 2024-04-26T23:43:24.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.738+0000 7f657ba00640 1 -- start start 2024-04-26T23:43:24.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.738+0000 7f657ba00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f657415ced0 0x7f65740d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:24.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.738+0000 7f657ba00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65740b1b30 con 0x7f657415d2b0 2024-04-26T23:43:24.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.738+0000 7f657ba00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65740b1e10 con 0x7f65740b14a0 2024-04-26T23:43:24.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.738+0000 7f657ba00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f65740b18f0 con 0x7f657415ced0 2024-04-26T23:43:24.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.738+0000 7f6579000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f657415ced0 0x7f65740d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:24.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.738+0000 7f656be00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f657415d2b0 0x7f65740b0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52980/0 (socket says 172.21.15.137:52980) 2024-04-26T23:43:24.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.738+0000 7f656be00640 1 -- 172.21.15.137:0/209056029 learned_addr learned my addr 172.21.15.137:0/209056029 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:24.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.738+0000 7f6579000640 1 -- 172.21.15.137:0/209056029 >> v1:172.21.15.170:6789/0 conn(0x7f65740b14a0 legacy=0x7f65740b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:24.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.738+0000 7f6579000640 1 -- 172.21.15.137:0/209056029 >> v1:172.21.15.137:6789/0 conn(0x7f657415d2b0 legacy=0x7f65740b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:24.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.738+0000 7f6579000640 1 -- 172.21.15.137:0/209056029 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65740b23f0 con 0x7f657415ced0 2024-04-26T23:43:24.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.742+0000 7f6579000640 1 --2- 172.21.15.137:0/209056029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657415ced0 0x7f65740d13b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f65640097c0 tx=0x7f656401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570d0180d188d22e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:24.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.742+0000 7f6573e00640 1 -- 172.21.15.137:0/209056029 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65640b0070 con 0x7f657415ced0 2024-04-26T23:43:24.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.742+0000 7f6573e00640 1 -- 172.21.15.137:0/209056029 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65640ab600 con 0x7f657415ced0 2024-04-26T23:43:24.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.742+0000 7f6573e00640 1 -- 172.21.15.137:0/209056029 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65640ab9d0 con 0x7f657415ced0 2024-04-26T23:43:24.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.742+0000 7f657ba00640 1 -- 172.21.15.137:0/209056029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657415ced0 msgr2=0x7f65740d13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:24.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.742+0000 7f657ba00640 1 --2- 172.21.15.137:0/209056029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657415ced0 0x7f65740d13b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f65640097c0 tx=0x7f656401c460 comp rx=0 tx=0).stop 2024-04-26T23:43:24.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.742+0000 7f657ba00640 1 -- 172.21.15.137:0/209056029 shutdown_connections 2024-04-26T23:43:24.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.742+0000 7f657ba00640 1 --2- 172.21.15.137:0/209056029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657415ced0 0x7f65740d13b0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.742+0000 7f657ba00640 1 -- 172.21.15.137:0/209056029 >> 172.21.15.137:0/209056029 conn(0x7f657409ba60 msgr2=0x7f657409be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:24.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.742+0000 7f657ba00640 1 -- 172.21.15.137:0/209056029 shutdown_connections 2024-04-26T23:43:24.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.742+0000 7f657ba00640 1 -- 172.21.15.137:0/209056029 wait complete. 2024-04-26T23:43:24.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f657ba00640 1 Processor -- start 2024-04-26T23:43:24.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f657ba00640 1 -- start start 2024-04-26T23:43:24.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f657ba00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65740b14a0 0x7f6574151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:24.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f657ba00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657415ced0 0x7f6574070250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:24.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f657ba00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f657415d2b0 0x7f6574070790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:24.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f657ba00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f65740d1d00 con 0x7f657415ced0 2024-04-26T23:43:24.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f657ba00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f65740b3de0 con 0x7f657415d2b0 2024-04-26T23:43:24.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f657ba00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f657416ad30 con 0x7f65740b14a0 2024-04-26T23:43:24.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f656be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657415ced0 0x7f6574070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:24.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f656be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657415ced0 0x7f6574070250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54826/0 (socket says 172.21.15.137:54826) 2024-04-26T23:43:24.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f656be00640 1 -- 172.21.15.137:0/3344792221 learned_addr learned my addr 172.21.15.137:0/3344792221 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f6579a00640 1 --2- 172.21.15.137:0/3344792221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f657415d2b0 0x7f6574070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f6579000640 1 --2- 172.21.15.137:0/3344792221 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65740b14a0 0x7f6574151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f656be00640 1 -- 172.21.15.137:0/3344792221 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65740b14a0 msgr2=0x7f6574151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f656be00640 1 --2- 172.21.15.137:0/3344792221 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65740b14a0 0x7f6574151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f656be00640 1 -- 172.21.15.137:0/3344792221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f657415d2b0 msgr2=0x7f6574070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f656be00640 1 --2- 172.21.15.137:0/3344792221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f657415d2b0 0x7f6574070790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f656be00640 1 -- 172.21.15.137:0/3344792221 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65741517a0 con 0x7f657415ced0 2024-04-26T23:43:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f6579a00640 1 --2- 172.21.15.137:0/3344792221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f657415d2b0 0x7f6574070790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f656be00640 1 --2- 172.21.15.137:0/3344792221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657415ced0 0x7f6574070250 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f655c00c3a0 tx=0x7f655c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f6571600640 1 -- 172.21.15.137:0/3344792221 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655c017070 con 0x7f657415ced0 2024-04-26T23:43:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f6571600640 1 -- 172.21.15.137:0/3344792221 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f655c005cf0 con 0x7f657415ced0 2024-04-26T23:43:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f657ba00640 1 -- 172.21.15.137:0/3344792221 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6574151a80 con 0x7f657415ced0 2024-04-26T23:43:24.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f6571600640 1 -- 172.21.15.137:0/3344792221 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655c0072f0 con 0x7f657415ced0 2024-04-26T23:43:24.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f657ba00640 1 -- 172.21.15.137:0/3344792221 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65741531a0 con 0x7f657415ced0 2024-04-26T23:43:24.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.746+0000 7f657ba00640 1 -- 172.21.15.137:0/3344792221 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f657406a4b0 con 0x7f657415ced0 2024-04-26T23:43:24.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.750+0000 7f6571600640 1 -- 172.21.15.137:0/3344792221 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f655c01a070 con 0x7f657415ced0 2024-04-26T23:43:24.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.750+0000 7f6571600640 1 --2- 172.21.15.137:0/3344792221 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6550068380 0x7f655006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:24.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.750+0000 7f6571600640 1 -- 172.21.15.137:0/3344792221 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f655c085ce0 con 0x7f657415ced0 2024-04-26T23:43:24.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.750+0000 7f6579000640 1 --2- 172.21.15.137:0/3344792221 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6550068380 0x7f655006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:24.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.750+0000 7f6579000640 1 --2- 172.21.15.137:0/3344792221 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6550068380 0x7f655006a840 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f65640ad000 tx=0x7f65640a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:24.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.754+0000 7f6571600640 1 -- 172.21.15.137:0/3344792221 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f655c055bb0 con 0x7f657415ced0 2024-04-26T23:43:24.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.910+0000 7f657ba00640 1 -- 172.21.15.137:0/3344792221 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f657409c7a0 con 0x7f657415ced0 2024-04-26T23:43:24.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.914+0000 7f6571600640 1 -- 172.21.15.137:0/3344792221 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16674 (secure 0 0 0) 0x7f655c059eb0 con 0x7f657415ced0 2024-04-26T23:43:24.921 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:24.921 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":44,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:43:23.588851+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:43:21.281556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T23:43:22.549121+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:43:24.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.914+0000 7f657ba00640 1 -- 172.21.15.137:0/3344792221 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6550068380 msgr2=0x7f655006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:24.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.914+0000 7f657ba00640 1 --2- 172.21.15.137:0/3344792221 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6550068380 0x7f655006a840 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f65640ad000 tx=0x7f65640a6000 comp rx=0 tx=0).stop 2024-04-26T23:43:24.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.914+0000 7f657ba00640 1 -- 172.21.15.137:0/3344792221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657415ced0 msgr2=0x7f6574070250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:24.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.914+0000 7f657ba00640 1 --2- 172.21.15.137:0/3344792221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657415ced0 0x7f6574070250 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f655c00c3a0 tx=0x7f655c00c860 comp rx=0 tx=0).stop 2024-04-26T23:43:24.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.914+0000 7f657ba00640 1 -- 172.21.15.137:0/3344792221 shutdown_connections 2024-04-26T23:43:24.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.914+0000 7f657ba00640 1 --2- 172.21.15.137:0/3344792221 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6550068380 0x7f655006a840 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.914+0000 7f657ba00640 1 --2- 172.21.15.137:0/3344792221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657415ced0 0x7f6574070250 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.914+0000 7f657ba00640 1 --2- 172.21.15.137:0/3344792221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f657415d2b0 0x7f6574070790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.914+0000 7f657ba00640 1 --2- 172.21.15.137:0/3344792221 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65740b14a0 0x7f6574151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.914+0000 7f657ba00640 1 -- 172.21.15.137:0/3344792221 >> 172.21.15.137:0/3344792221 conn(0x7f657409ba60 msgr2=0x7f65740afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:24.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.914+0000 7f657ba00640 1 -- 172.21.15.137:0/3344792221 shutdown_connections 2024-04-26T23:43:24.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:24.914+0000 7f657ba00640 1 -- 172.21.15.137:0/3344792221 wait complete. 2024-04-26T23:43:24.943 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T23:43:25.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.074+0000 7f7fac800640 1 Processor -- start 2024-04-26T23:43:25.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.074+0000 7f7fac800640 1 -- start start 2024-04-26T23:43:25.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.074+0000 7f7fac800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7fa4160000 0x7f7fa4144d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:25.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.074+0000 7f7fac800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fa40cffa0 con 0x7f7fa40b5ee0 2024-04-26T23:43:25.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.074+0000 7f7fac800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fa40d0280 con 0x7f7fa40b54e0 2024-04-26T23:43:25.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.074+0000 7f7fac800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f7fa40b3d90 con 0x7f7fa4160000 2024-04-26T23:43:25.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.074+0000 7f7fa9400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f7fa40b5ee0 0x7f7fa415f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52996/0 (socket says 172.21.15.137:52996) 2024-04-26T23:43:25.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.074+0000 7f7fa9400640 1 -- 172.21.15.137:0/580779552 learned_addr learned my addr 172.21.15.137:0/580779552 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:25.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.074+0000 7f7fa8a00640 1 -- 172.21.15.137:0/580779552 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4103715679 0 0) 0x7f7fa40cffa0 con 0x7f7fa40b5ee0 2024-04-26T23:43:25.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.074+0000 7f7faa800640 1 --2- 172.21.15.137:0/580779552 >> v2:172.21.15.170:3300/0 conn(0x7f7fa4160000 0x7f7fa4144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:25.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.074+0000 7f7fa8a00640 1 -- 172.21.15.137:0/580779552 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f8c003530 con 0x7f7fa40b5ee0 2024-04-26T23:43:25.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7fa8a00640 1 -- 172.21.15.137:0/580779552 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4123611423 0 0) 0x7f7f8c003530 con 0x7f7fa40b5ee0 2024-04-26T23:43:25.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7fa8a00640 1 -- 172.21.15.137:0/580779552 >> v2:172.21.15.170:3300/0 conn(0x7f7fa4160000 msgr2=0x7f7fa4144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:25.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7fa8a00640 1 --2- 172.21.15.137:0/580779552 >> v2:172.21.15.170:3300/0 conn(0x7f7fa4160000 0x7f7fa4144d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:25.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7fa8a00640 1 -- 172.21.15.137:0/580779552 >> v1:172.21.15.170:6789/0 conn(0x7f7fa40b54e0 legacy=0x7f7fa40cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:25.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7fa8a00640 1 -- 172.21.15.137:0/580779552 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa40d0560 con 0x7f7fa40b5ee0 2024-04-26T23:43:25.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7fa8a00640 1 -- 172.21.15.137:0/580779552 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f7f94001680 con 0x7f7fa40b5ee0 2024-04-26T23:43:25.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7fa8a00640 1 -- 172.21.15.137:0/580779552 >> v1:172.21.15.137:6789/0 conn(0x7f7fa40b5ee0 legacy=0x7f7fa415f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:25.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7fa8a00640 1 --2- 172.21.15.137:0/580779552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f8c0039c0 0x7f7f8c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:25.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7fa8a00640 1 --2- 172.21.15.137:0/580779552 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f8c004810 0x7f7f8c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:25.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7fa8a00640 1 --2- 172.21.15.137:0/580779552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f8c0051d0 0x7f7f8c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:25.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7fa8a00640 1 -- 172.21.15.137:0/580779552 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c00c040 con 0x7f7f8c0051d0 2024-04-26T23:43:25.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7fa8a00640 1 -- 172.21.15.137:0/580779552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c00c1f0 con 0x7f7f8c0039c0 2024-04-26T23:43:25.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7fa8a00640 1 -- 172.21.15.137:0/580779552 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7f8c00c3f0 con 0x7f7f8c004810 2024-04-26T23:43:25.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7faa800640 1 --2- 172.21.15.137:0/580779552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f8c0051d0 0x7f7f8c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:25.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7fa9400640 1 --2- 172.21.15.137:0/580779552 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f8c004810 0x7f7f8c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:25.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7fa9e00640 1 --2- 172.21.15.137:0/580779552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f8c0039c0 0x7f7f8c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:25.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7faa800640 1 -- 172.21.15.137:0/580779552 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f8c004810 msgr2=0x7f7f8c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:25.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7faa800640 1 --2- 172.21.15.137:0/580779552 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f8c004810 0x7f7f8c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:25.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7faa800640 1 -- 172.21.15.137:0/580779552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f8c0039c0 msgr2=0x7f7f8c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:25.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7faa800640 1 --2- 172.21.15.137:0/580779552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f8c0039c0 0x7f7f8c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:25.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7faa800640 1 -- 172.21.15.137:0/580779552 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8c003530 con 0x7f7f8c0051d0 2024-04-26T23:43:25.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7faa800640 1 -- 172.21.15.137:0/580779552 reap_dead start 2024-04-26T23:43:25.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.078+0000 7f7faa800640 1 --2- 172.21.15.137:0/580779552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f8c0051d0 0x7f7f8c00b9d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009fc0 tx=0x7f7fa001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e287ec92095cd2b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:25.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.082+0000 7f7fa8a00640 1 -- 172.21.15.137:0/580779552 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0009c10 con 0x7f7f8c0051d0 2024-04-26T23:43:25.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.082+0000 7f7fa8a00640 1 -- 172.21.15.137:0/580779552 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa00a5cd0 con 0x7f7f8c0051d0 2024-04-26T23:43:25.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.082+0000 7f7fa8a00640 1 -- 172.21.15.137:0/580779552 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0003be0 con 0x7f7f8c0051d0 2024-04-26T23:43:25.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.082+0000 7f7fac800640 1 -- 172.21.15.137:0/580779552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f8c0051d0 msgr2=0x7f7f8c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:25.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.082+0000 7f7fac800640 1 --2- 172.21.15.137:0/580779552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f8c0051d0 0x7f7f8c00b9d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009fc0 tx=0x7f7fa001ccc0 comp rx=0 tx=0).stop 2024-04-26T23:43:25.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.082+0000 7f7fac800640 1 -- 172.21.15.137:0/580779552 shutdown_connections 2024-04-26T23:43:25.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.082+0000 7f7fac800640 1 --2- 172.21.15.137:0/580779552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f8c0051d0 0x7f7f8c00b9d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:25.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.082+0000 7f7fac800640 1 -- 172.21.15.137:0/580779552 >> 172.21.15.137:0/580779552 conn(0x7f7fa406c800 msgr2=0x7f7fa406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:25.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.082+0000 7f7fac800640 1 -- 172.21.15.137:0/580779552 shutdown_connections 2024-04-26T23:43:25.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.082+0000 7f7fac800640 1 -- 172.21.15.137:0/580779552 wait complete. 2024-04-26T23:43:25.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.082+0000 7f7fac800640 1 Processor -- start 2024-04-26T23:43:25.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.082+0000 7f7fac800640 1 -- start start 2024-04-26T23:43:25.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.082+0000 7f7fac800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f8c0051d0 0x7f7fa40b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:25.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.082+0000 7f7fac800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fa415ba10 0x7f7fa415ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:25.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.082+0000 7f7fac800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7fa41f1f50 0x7f7fa40b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:25.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.082+0000 7f7fac800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa40b62c0 con 0x7f7fa415ba10 2024-04-26T23:43:25.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.082+0000 7f7fac800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa40d0840 con 0x7f7f8c0051d0 2024-04-26T23:43:25.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.082+0000 7f7fac800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7fa415f8f0 con 0x7f7fa41f1f50 2024-04-26T23:43:25.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.082+0000 7f7fa9400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fa415ba10 0x7f7fa415ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:25.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.082+0000 7f7fa9400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fa415ba10 0x7f7fa415ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54852/0 (socket says 172.21.15.137:54852) 2024-04-26T23:43:25.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.082+0000 7f7fa9400640 1 -- 172.21.15.137:0/4251191103 learned_addr learned my addr 172.21.15.137:0/4251191103 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:25.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.082+0000 7f7fa9e00640 1 --2- 172.21.15.137:0/4251191103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f8c0051d0 0x7f7fa40b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:25.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.086+0000 7f7faa800640 1 --2- 172.21.15.137:0/4251191103 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7fa41f1f50 0x7f7fa40b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:25.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.086+0000 7f7fa9400640 1 -- 172.21.15.137:0/4251191103 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7fa41f1f50 msgr2=0x7f7fa40b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:25.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.086+0000 7f7fa9400640 1 --2- 172.21.15.137:0/4251191103 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7fa41f1f50 0x7f7fa40b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:25.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.086+0000 7f7fa9400640 1 -- 172.21.15.137:0/4251191103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f8c0051d0 msgr2=0x7f7fa40b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:25.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.086+0000 7f7fa9400640 1 --2- 172.21.15.137:0/4251191103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f8c0051d0 0x7f7fa40b3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:25.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.086+0000 7f7fa9400640 1 -- 172.21.15.137:0/4251191103 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa415dd80 con 0x7f7fa415ba10 2024-04-26T23:43:25.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.086+0000 7f7fa9400640 1 --2- 172.21.15.137:0/4251191103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fa415ba10 0x7f7fa415ee20 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7f94004f80 tx=0x7f7f940074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:25.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.086+0000 7f7f9e000640 1 -- 172.21.15.137:0/4251191103 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9400f750 con 0x7f7fa415ba10 2024-04-26T23:43:25.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.086+0000 7f7f9e000640 1 -- 172.21.15.137:0/4251191103 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f94018070 con 0x7f7fa415ba10 2024-04-26T23:43:25.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.086+0000 7f7fac800640 1 -- 172.21.15.137:0/4251191103 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa415e060 con 0x7f7fa415ba10 2024-04-26T23:43:25.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.086+0000 7f7f9e000640 1 -- 172.21.15.137:0/4251191103 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9400fb10 con 0x7f7fa415ba10 2024-04-26T23:43:25.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.086+0000 7f7fac800640 1 -- 172.21.15.137:0/4251191103 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa415e620 con 0x7f7fa415ba10 2024-04-26T23:43:25.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.086+0000 7f7fac800640 1 -- 172.21.15.137:0/4251191103 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fa406a410 con 0x7f7fa415ba10 2024-04-26T23:43:25.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.086+0000 7f7f9e000640 1 -- 172.21.15.137:0/4251191103 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7f9401d460 con 0x7f7fa415ba10 2024-04-26T23:43:25.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.086+0000 7f7f9e000640 1 --2- 172.21.15.137:0/4251191103 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7f88068380 0x7f7f8806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:25.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.086+0000 7f7f9e000640 1 -- 172.21.15.137:0/4251191103 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f7f94086bc0 con 0x7f7fa415ba10 2024-04-26T23:43:25.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.086+0000 7f7fa9e00640 1 --2- 172.21.15.137:0/4251191103 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7f88068380 0x7f7f8806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:25.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.090+0000 7f7fa9e00640 1 --2- 172.21.15.137:0/4251191103 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7f88068380 0x7f7f8806a840 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7f98000c10 tx=0x7f7f98009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:25.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.090+0000 7f7f9e000640 1 -- 172.21.15.137:0/4251191103 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7f940570e0 con 0x7f7fa415ba10 2024-04-26T23:43:25.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:25.286+0000 7f7fac800640 1 -- 172.21.15.137:0/4251191103 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7fa415d110 con 0x7f7fa415ba10 2024-04-26T23:43:26.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.218+0000 7f7f9e000640 1 -- 172.21.15.137:0/4251191103 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7f7f940569e0 con 0x7f7fa415ba10 2024-04-26T23:43:26.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.222+0000 7f7fac800640 1 -- 172.21.15.137:0/4251191103 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7f88068380 msgr2=0x7f7f8806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:26.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.222+0000 7f7fac800640 1 --2- 172.21.15.137:0/4251191103 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7f88068380 0x7f7f8806a840 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7f98000c10 tx=0x7f7f98009040 comp rx=0 tx=0).stop 2024-04-26T23:43:26.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.222+0000 7f7fac800640 1 -- 172.21.15.137:0/4251191103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fa415ba10 msgr2=0x7f7fa415ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:26.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.222+0000 7f7fac800640 1 --2- 172.21.15.137:0/4251191103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fa415ba10 0x7f7fa415ee20 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7f94004f80 tx=0x7f7f940074f0 comp rx=0 tx=0).stop 2024-04-26T23:43:26.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.222+0000 7f7fac800640 1 -- 172.21.15.137:0/4251191103 shutdown_connections 2024-04-26T23:43:26.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.222+0000 7f7fac800640 1 --2- 172.21.15.137:0/4251191103 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7f88068380 0x7f7f8806a840 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:26.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.222+0000 7f7fac800640 1 --2- 172.21.15.137:0/4251191103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fa415ba10 0x7f7fa415ee20 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:26.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.222+0000 7f7fac800640 1 --2- 172.21.15.137:0/4251191103 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7fa41f1f50 0x7f7fa40b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:26.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.222+0000 7f7fac800640 1 --2- 172.21.15.137:0/4251191103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f8c0051d0 0x7f7fa40b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:26.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.222+0000 7f7fac800640 1 -- 172.21.15.137:0/4251191103 >> 172.21.15.137:0/4251191103 conn(0x7f7fa406c800 msgr2=0x7f7fa415c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:26.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.222+0000 7f7fac800640 1 -- 172.21.15.137:0/4251191103 shutdown_connections 2024-04-26T23:43:26.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.222+0000 7f7fac800640 1 -- 172.21.15.137:0/4251191103 wait complete. 2024-04-26T23:43:26.253 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T23:43:26.253 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T23:43:26.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.390+0000 7fd4ad000640 1 Processor -- start 2024-04-26T23:43:26.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.390+0000 7fd4ad000640 1 -- start start 2024-04-26T23:43:26.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.390+0000 7fd4ad000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd4a80afbc0 0x7fd4a815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:26.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.390+0000 7fd4ad000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd4a80affa0 0x7fd4a80ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:26.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.390+0000 7fd4ad000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4a8072860 con 0x7fd4a8073f20 2024-04-26T23:43:26.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.390+0000 7fd4ad000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd4a80743b0 con 0x7fd4a80affa0 2024-04-26T23:43:26.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.390+0000 7fd4ad000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fd4a8072b00 con 0x7fd4a80afbc0 2024-04-26T23:43:26.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.390+0000 7fd4a6800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd4a80affa0 0x7fd4a80ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:26.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.390+0000 7fd4a6800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd4a80affa0 0x7fd4a80ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54858/0 (socket says 172.21.15.137:54858) 2024-04-26T23:43:26.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.390+0000 7fd4a6800640 1 -- 172.21.15.137:0/3699462029 learned_addr learned my addr 172.21.15.137:0/3699462029 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:26.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.390+0000 7fd4a5e00640 1 --2- 172.21.15.137:0/3699462029 >> v2:172.21.15.170:3300/0 conn(0x7fd4a80afbc0 0x7fd4a815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:26.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.390+0000 7fd4a6800640 1 -- 172.21.15.137:0/3699462029 >> v2:172.21.15.170:3300/0 conn(0x7fd4a80afbc0 msgr2=0x7fd4a815df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:26.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.390+0000 7fd4a6800640 1 --2- 172.21.15.137:0/3699462029 >> v2:172.21.15.170:3300/0 conn(0x7fd4a80afbc0 0x7fd4a815df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:26.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.390+0000 7fd4a6800640 1 -- 172.21.15.137:0/3699462029 >> v1:172.21.15.170:6789/0 conn(0x7fd4a8073f20 legacy=0x7fd4a80735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:26.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.390+0000 7fd4a6800640 1 -- 172.21.15.137:0/3699462029 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4a8072de0 con 0x7fd4a80affa0 2024-04-26T23:43:26.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.390+0000 7fd4a5e00640 1 --2- 172.21.15.137:0/3699462029 >> v2:172.21.15.170:3300/0 conn(0x7fd4a80afbc0 0x7fd4a815df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:43:26.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.394+0000 7fd4a6800640 1 --2- 172.21.15.137:0/3699462029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4a80affa0 0x7fd4a80ce3b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0009e50 tx=0x7fd4a001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977f433c6a33cbee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:26.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.394+0000 7fd4a4a00640 1 -- 172.21.15.137:0/3699462029 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a00a5670 con 0x7fd4a80affa0 2024-04-26T23:43:26.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.394+0000 7fd4a4a00640 1 -- 172.21.15.137:0/3699462029 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4a00a5810 con 0x7fd4a80affa0 2024-04-26T23:43:26.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.394+0000 7fd4a4a00640 1 -- 172.21.15.137:0/3699462029 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a00a5be0 con 0x7fd4a80affa0 2024-04-26T23:43:26.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.394+0000 7fd4ad000640 1 -- 172.21.15.137:0/3699462029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4a80affa0 msgr2=0x7fd4a80ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:26.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.394+0000 7fd4ad000640 1 --2- 172.21.15.137:0/3699462029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4a80affa0 0x7fd4a80ce3b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0009e50 tx=0x7fd4a001c9b0 comp rx=0 tx=0).stop 2024-04-26T23:43:26.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.394+0000 7fd4ad000640 1 -- 172.21.15.137:0/3699462029 shutdown_connections 2024-04-26T23:43:26.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.394+0000 7fd4ad000640 1 --2- 172.21.15.137:0/3699462029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4a80affa0 0x7fd4a80ce3b0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:26.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.394+0000 7fd4ad000640 1 --2- 172.21.15.137:0/3699462029 >> v2:172.21.15.170:3300/0 conn(0x7fd4a80afbc0 0x7fd4a815df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:26.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.394+0000 7fd4ad000640 1 -- 172.21.15.137:0/3699462029 >> 172.21.15.137:0/3699462029 conn(0x7fd4a806c800 msgr2=0x7fd4a806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:26.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.394+0000 7fd4ad000640 1 -- 172.21.15.137:0/3699462029 shutdown_connections 2024-04-26T23:43:26.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.394+0000 7fd4ad000640 1 -- 172.21.15.137:0/3699462029 wait complete. 2024-04-26T23:43:26.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.394+0000 7fd4ad000640 1 Processor -- start 2024-04-26T23:43:26.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.394+0000 7fd4ad000640 1 -- start start 2024-04-26T23:43:26.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd4ad000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4a80afbc0 0x7fd4a8147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:26.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd4ad000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4a80affa0 0x7fd4a81f9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:26.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd4ad000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4a80b2280 0x7fd4a806f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:26.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd4ad000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a806f360 con 0x7fd4a80b2280 2024-04-26T23:43:26.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd4ad000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a806f1e0 con 0x7fd4a80affa0 2024-04-26T23:43:26.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd4ad000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd4a806f4e0 con 0x7fd4a80afbc0 2024-04-26T23:43:26.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd4a6800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4a80b2280 0x7fd4a806f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:26.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd4a6800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4a80b2280 0x7fd4a806f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54870/0 (socket says 172.21.15.137:54870) 2024-04-26T23:43:26.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd4a6800640 1 -- 172.21.15.137:0/2322716385 learned_addr learned my addr 172.21.15.137:0/2322716385 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:26.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd4a5e00640 1 --2- 172.21.15.137:0/2322716385 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4a80afbc0 0x7fd4a8147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:26.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd4a5400640 1 --2- 172.21.15.137:0/2322716385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4a80affa0 0x7fd4a81f9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:26.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd4a6800640 1 -- 172.21.15.137:0/2322716385 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4a80afbc0 msgr2=0x7fd4a8147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:26.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd4a6800640 1 --2- 172.21.15.137:0/2322716385 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4a80afbc0 0x7fd4a8147c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:26.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd4a6800640 1 -- 172.21.15.137:0/2322716385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4a80affa0 msgr2=0x7fd4a81f9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:26.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd4a6800640 1 --2- 172.21.15.137:0/2322716385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4a80affa0 0x7fd4a81f9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:26.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd4a6800640 1 -- 172.21.15.137:0/2322716385 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4a81f8980 con 0x7fd4a80b2280 2024-04-26T23:43:26.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd4a5400640 1 --2- 172.21.15.137:0/2322716385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4a80affa0 0x7fd4a81f9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:26.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd4a5e00640 1 --2- 172.21.15.137:0/2322716385 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4a80afbc0 0x7fd4a8147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:26.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd4a6800640 1 --2- 172.21.15.137:0/2322716385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4a80b2280 0x7fd4a806f8a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd4a00af040 tx=0x7fd4a0019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:26.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd49e000640 1 -- 172.21.15.137:0/2322716385 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a00b8470 con 0x7fd4a80b2280 2024-04-26T23:43:26.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd49e000640 1 -- 172.21.15.137:0/2322716385 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4a00b8630 con 0x7fd4a80b2280 2024-04-26T23:43:26.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd49e000640 1 -- 172.21.15.137:0/2322716385 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a00b8a20 con 0x7fd4a80b2280 2024-04-26T23:43:26.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd4ad000640 1 -- 172.21.15.137:0/2322716385 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4a81f8c60 con 0x7fd4a80b2280 2024-04-26T23:43:26.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd4ad000640 1 -- 172.21.15.137:0/2322716385 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4a81f9220 con 0x7fd4a80b2280 2024-04-26T23:43:26.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.398+0000 7fd4ad000640 1 -- 172.21.15.137:0/2322716385 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4a806a410 con 0x7fd4a80b2280 2024-04-26T23:43:26.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.402+0000 7fd49e000640 1 -- 172.21.15.137:0/2322716385 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd4a00c0020 con 0x7fd4a80b2280 2024-04-26T23:43:26.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.402+0000 7fd49e000640 1 --2- 172.21.15.137:0/2322716385 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd488068380 0x7fd48806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:26.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.402+0000 7fd49e000640 1 -- 172.21.15.137:0/2322716385 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fd4a01215b0 con 0x7fd4a80b2280 2024-04-26T23:43:26.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.402+0000 7fd4a5e00640 1 --2- 172.21.15.137:0/2322716385 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd488068380 0x7fd48806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:26.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.402+0000 7fd4a5e00640 1 --2- 172.21.15.137:0/2322716385 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd488068380 0x7fd48806a840 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd498006fd0 tx=0x7fd498008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:26.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.406+0000 7fd49e000640 1 -- 172.21.15.137:0/2322716385 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd4a00165a0 con 0x7fd4a80b2280 2024-04-26T23:43:26.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:26.602+0000 7fd4ad000640 1 -- 172.21.15.137:0/2322716385 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd4a8160870 con 0x7fd4a80b2280 2024-04-26T23:43:27.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.222+0000 7fd49e000640 1 -- 172.21.15.137:0/2322716385 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) ==== 122+0+0 (secure 0 0 0) 0x7fd4a00f1bf0 con 0x7fd4a80b2280 2024-04-26T23:43:27.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.222+0000 7fd4ad000640 1 -- 172.21.15.137:0/2322716385 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd488068380 msgr2=0x7fd48806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:27.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.222+0000 7fd4ad000640 1 --2- 172.21.15.137:0/2322716385 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd488068380 0x7fd48806a840 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd498006fd0 tx=0x7fd498008040 comp rx=0 tx=0).stop 2024-04-26T23:43:27.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.222+0000 7fd4ad000640 1 -- 172.21.15.137:0/2322716385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4a80b2280 msgr2=0x7fd4a806f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:27.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.226+0000 7fd4ad000640 1 --2- 172.21.15.137:0/2322716385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4a80b2280 0x7fd4a806f8a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd4a00af040 tx=0x7fd4a0019750 comp rx=0 tx=0).stop 2024-04-26T23:43:27.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.226+0000 7fd4ad000640 1 -- 172.21.15.137:0/2322716385 shutdown_connections 2024-04-26T23:43:27.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.226+0000 7fd4ad000640 1 --2- 172.21.15.137:0/2322716385 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd488068380 0x7fd48806a840 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:27.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.226+0000 7fd4ad000640 1 --2- 172.21.15.137:0/2322716385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4a80b2280 0x7fd4a806f8a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:27.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.226+0000 7fd4ad000640 1 --2- 172.21.15.137:0/2322716385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4a80affa0 0x7fd4a81f9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:27.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.226+0000 7fd4ad000640 1 --2- 172.21.15.137:0/2322716385 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4a80afbc0 0x7fd4a8147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:27.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.226+0000 7fd4ad000640 1 -- 172.21.15.137:0/2322716385 >> 172.21.15.137:0/2322716385 conn(0x7fd4a806c800 msgr2=0x7fd4a815f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:27.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.226+0000 7fd4ad000640 1 -- 172.21.15.137:0/2322716385 shutdown_connections 2024-04-26T23:43:27.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.226+0000 7fd4ad000640 1 -- 172.21.15.137:0/2322716385 wait complete. 2024-04-26T23:43:27.253 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T23:43:27.254 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:43:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.382+0000 7f9b2ce00640 1 Processor -- start 2024-04-26T23:43:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.382+0000 7f9b2ce00640 1 -- start start 2024-04-26T23:43:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.382+0000 7f9b2ce00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b28146920 0x7f9b28073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.382+0000 7f9b2ce00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b28073010 con 0x7f9b280ce3e0 2024-04-26T23:43:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.382+0000 7f9b2ce00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b280cef90 con 0x7f9b2815de80 2024-04-26T23:43:27.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.382+0000 7f9b2ce00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9b28073280 con 0x7f9b28146920 2024-04-26T23:43:27.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.382+0000 7f9b25e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f9b280ce3e0 0x7f9b280d04e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:53010/0 (socket says 172.21.15.137:53010) 2024-04-26T23:43:27.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.382+0000 7f9b25e00640 1 -- 172.21.15.137:0/3966898970 learned_addr learned my addr 172.21.15.137:0/3966898970 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b26800640 1 --2- 172.21.15.137:0/3966898970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b28146920 0x7f9b28073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b24a00640 1 -- 172.21.15.137:0/3966898970 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2545927626 0 0) 0x7f9b28073010 con 0x7f9b280ce3e0 2024-04-26T23:43:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b24a00640 1 -- 172.21.15.137:0/3966898970 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b0c003530 con 0x7f9b280ce3e0 2024-04-26T23:43:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b24a00640 1 -- 172.21.15.137:0/3966898970 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 205503714 0 0) 0x7f9b280cef90 con 0x7f9b2815de80 2024-04-26T23:43:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b24a00640 1 -- 172.21.15.137:0/3966898970 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b28073010 con 0x7f9b2815de80 2024-04-26T23:43:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b24a00640 1 -- 172.21.15.137:0/3966898970 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3050809891 0 0) 0x7f9b0c003530 con 0x7f9b280ce3e0 2024-04-26T23:43:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b24a00640 1 -- 172.21.15.137:0/3966898970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b28146920 msgr2=0x7f9b28073d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b24a00640 1 --2- 172.21.15.137:0/3966898970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b28146920 0x7f9b28073d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b24a00640 1 -- 172.21.15.137:0/3966898970 >> v1:172.21.15.170:6789/0 conn(0x7f9b2815de80 legacy=0x7f9b28146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b24a00640 1 -- 172.21.15.137:0/3966898970 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b28073560 con 0x7f9b280ce3e0 2024-04-26T23:43:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b24a00640 1 -- 172.21.15.137:0/3966898970 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f9b18001680 con 0x7f9b280ce3e0 2024-04-26T23:43:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b24a00640 1 -- 172.21.15.137:0/3966898970 >> v1:172.21.15.137:6789/0 conn(0x7f9b280ce3e0 legacy=0x7f9b280d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b24a00640 1 --2- 172.21.15.137:0/3966898970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b28146920 0x7f9b0c003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b24a00640 1 --2- 172.21.15.137:0/3966898970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b0c004130 0x7f9b0c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b24a00640 1 --2- 172.21.15.137:0/3966898970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b0c004d50 0x7f9b0c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b24a00640 1 -- 172.21.15.137:0/3966898970 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9b28073280 con 0x7f9b0c004130 2024-04-26T23:43:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b24a00640 1 -- 172.21.15.137:0/3966898970 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c00bb10 con 0x7f9b0c004d50 2024-04-26T23:43:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b24a00640 1 -- 172.21.15.137:0/3966898970 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9b0c00bd10 con 0x7f9b28146920 2024-04-26T23:43:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b25400640 1 --2- 172.21.15.137:0/3966898970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b0c004130 0x7f9b0c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b25e00640 1 --2- 172.21.15.137:0/3966898970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b28146920 0x7f9b0c003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b26800640 1 --2- 172.21.15.137:0/3966898970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b0c004d50 0x7f9b0c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b25400640 1 -- 172.21.15.137:0/3966898970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b28146920 msgr2=0x7f9b0c003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b25400640 1 --2- 172.21.15.137:0/3966898970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b28146920 0x7f9b0c003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b25400640 1 -- 172.21.15.137:0/3966898970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b0c004d50 msgr2=0x7f9b0c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b25400640 1 --2- 172.21.15.137:0/3966898970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b0c004d50 0x7f9b0c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b25400640 1 -- 172.21.15.137:0/3966898970 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0c003530 con 0x7f9b0c004130 2024-04-26T23:43:27.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.386+0000 7f9b26800640 1 --2- 172.21.15.137:0/3966898970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b0c004d50 0x7f9b0c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:27.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b25400640 1 --2- 172.21.15.137:0/3966898970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b0c004130 0x7f9b0c004810 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9b28072d30 tx=0x7f9b1401ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc68d7981cd7322 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:27.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b24a00640 1 -- 172.21.15.137:0/3966898970 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b14001520 con 0x7f9b0c004130 2024-04-26T23:43:27.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b24a00640 1 -- 172.21.15.137:0/3966898970 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b140052f0 con 0x7f9b0c004130 2024-04-26T23:43:27.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b24a00640 1 -- 172.21.15.137:0/3966898970 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b140a8870 con 0x7f9b0c004130 2024-04-26T23:43:27.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b2ce00640 1 -- 172.21.15.137:0/3966898970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b0c004130 msgr2=0x7f9b0c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:27.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b2ce00640 1 --2- 172.21.15.137:0/3966898970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b0c004130 0x7f9b0c004810 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9b28072d30 tx=0x7f9b1401ec10 comp rx=0 tx=0).stop 2024-04-26T23:43:27.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b26800640 1 -- 172.21.15.137:0/3966898970 reap_dead start 2024-04-26T23:43:27.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b2ce00640 1 -- 172.21.15.137:0/3966898970 shutdown_connections 2024-04-26T23:43:27.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b2ce00640 1 -- 172.21.15.137:0/3966898970 >> 172.21.15.137:0/3966898970 conn(0x7f9b2806c5d0 msgr2=0x7f9b2806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:27.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b2ce00640 1 -- 172.21.15.137:0/3966898970 shutdown_connections 2024-04-26T23:43:27.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b2ce00640 1 -- 172.21.15.137:0/3966898970 wait complete. 2024-04-26T23:43:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b2ce00640 1 Processor -- start 2024-04-26T23:43:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b2ce00640 1 -- start start 2024-04-26T23:43:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b2ce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b0c004130 0x7f9b2815c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b2ce00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b280c5d00 0x7f9b281f5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b2ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b280c6180 0x7f9b281f6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b2ce00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9b280ce7c0 con 0x7f9b280c6180 2024-04-26T23:43:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b2ce00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2815e320 con 0x7f9b0c004130 2024-04-26T23:43:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b2ce00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9b280ce940 con 0x7f9b280c5d00 2024-04-26T23:43:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b26800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b280c6180 0x7f9b281f6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b26800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b280c6180 0x7f9b281f6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54894/0 (socket says 172.21.15.137:54894) 2024-04-26T23:43:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b26800640 1 -- 172.21.15.137:0/2785614587 learned_addr learned my addr 172.21.15.137:0/2785614587 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b25e00640 1 --2- 172.21.15.137:0/2785614587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b0c004130 0x7f9b2815c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.390+0000 7f9b25400640 1 --2- 172.21.15.137:0/2785614587 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b280c5d00 0x7f9b281f5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.394+0000 7f9b26800640 1 -- 172.21.15.137:0/2785614587 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b280c5d00 msgr2=0x7f9b281f5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.394+0000 7f9b26800640 1 --2- 172.21.15.137:0/2785614587 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b280c5d00 0x7f9b281f5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.394+0000 7f9b26800640 1 -- 172.21.15.137:0/2785614587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b0c004130 msgr2=0x7f9b2815c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.394+0000 7f9b26800640 1 --2- 172.21.15.137:0/2785614587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b0c004130 0x7f9b2815c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.394+0000 7f9b26800640 1 -- 172.21.15.137:0/2785614587 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2815cd70 con 0x7f9b280c6180 2024-04-26T23:43:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.394+0000 7f9b25400640 1 --2- 172.21.15.137:0/2785614587 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b280c5d00 0x7f9b281f5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.394+0000 7f9b26800640 1 --2- 172.21.15.137:0/2785614587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b280c6180 0x7f9b281f6410 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9b2815d430 tx=0x7f9b20010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.394+0000 7f9b1e000640 1 -- 172.21.15.137:0/2785614587 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b200039a0 con 0x7f9b280c6180 2024-04-26T23:43:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.394+0000 7f9b1e000640 1 -- 172.21.15.137:0/2785614587 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b20003b60 con 0x7f9b280c6180 2024-04-26T23:43:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.394+0000 7f9b2ce00640 1 -- 172.21.15.137:0/2785614587 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b280ac290 con 0x7f9b280c6180 2024-04-26T23:43:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.394+0000 7f9b1e000640 1 -- 172.21.15.137:0/2785614587 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20004020 con 0x7f9b280c6180 2024-04-26T23:43:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.394+0000 7f9b2ce00640 1 -- 172.21.15.137:0/2785614587 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b280ac850 con 0x7f9b280c6180 2024-04-26T23:43:27.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.394+0000 7f9b2ce00640 1 -- 172.21.15.137:0/2785614587 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b2806a4b0 con 0x7f9b280c6180 2024-04-26T23:43:27.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.394+0000 7f9b1e000640 1 -- 172.21.15.137:0/2785614587 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9b2001e020 con 0x7f9b280c6180 2024-04-26T23:43:27.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.394+0000 7f9b1e000640 1 --2- 172.21.15.137:0/2785614587 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b08068380 0x7f9b0806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:27.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.394+0000 7f9b1e000640 1 -- 172.21.15.137:0/2785614587 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f9b20086fe0 con 0x7f9b280c6180 2024-04-26T23:43:27.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.394+0000 7f9b25e00640 1 --2- 172.21.15.137:0/2785614587 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b08068380 0x7f9b0806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:27.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.398+0000 7f9b25e00640 1 --2- 172.21.15.137:0/2785614587 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b08068380 0x7f9b0806a840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9b18001ba0 tx=0x7f9b18007040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:27.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.398+0000 7f9b1e000640 1 -- 172.21.15.137:0/2785614587 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9b20057540 con 0x7f9b280c6180 2024-04-26T23:43:27.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.586+0000 7f9b2ce00640 1 -- 172.21.15.137:0/2785614587 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b28072940 con 0x7f9b280c6180 2024-04-26T23:43:27.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.590+0000 7f9b1e000640 1 -- 172.21.15.137:0/2785614587 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5187 (secure 0 0 0) 0x7f9b20056e40 con 0x7f9b280c6180 2024-04-26T23:43:27.596 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:27.596 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/145346644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":145346644},{"type":"v1","addr":"172.21.15.170:6835","nonce":145346644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5656,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3121910067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3121910067},{"type":"v1","addr":"172.21.15.170:6834","nonce":3121910067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5835,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/2120163779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2120163779},{"type":"v1","addr":"172.21.15.137:6836","nonce":2120163779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:43:23.588817+0000","modified":"2024-04-26T23:43:26.606923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5838},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5838":{"gid":5838,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/547646153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":547646153},{"type":"v1","addr":"172.21.15.137:6837","nonce":547646153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5838,"qdb_cluster":[5838]},"id":3}]} 2024-04-26T23:43:27.597 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 25 2024-04-26T23:43:27.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.590+0000 7f9b2ce00640 1 -- 172.21.15.137:0/2785614587 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b08068380 msgr2=0x7f9b0806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:27.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.590+0000 7f9b2ce00640 1 --2- 172.21.15.137:0/2785614587 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b08068380 0x7f9b0806a840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9b18001ba0 tx=0x7f9b18007040 comp rx=0 tx=0).stop 2024-04-26T23:43:27.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.590+0000 7f9b2ce00640 1 -- 172.21.15.137:0/2785614587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b280c6180 msgr2=0x7f9b281f6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:27.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.590+0000 7f9b2ce00640 1 --2- 172.21.15.137:0/2785614587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b280c6180 0x7f9b281f6410 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9b2815d430 tx=0x7f9b20010590 comp rx=0 tx=0).stop 2024-04-26T23:43:27.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.590+0000 7f9b2ce00640 1 -- 172.21.15.137:0/2785614587 shutdown_connections 2024-04-26T23:43:27.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.590+0000 7f9b2ce00640 1 --2- 172.21.15.137:0/2785614587 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b08068380 0x7f9b0806a840 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:27.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.590+0000 7f9b2ce00640 1 --2- 172.21.15.137:0/2785614587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b280c6180 0x7f9b281f6410 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:27.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.590+0000 7f9b2ce00640 1 --2- 172.21.15.137:0/2785614587 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b280c5d00 0x7f9b281f5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:27.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.590+0000 7f9b2ce00640 1 --2- 172.21.15.137:0/2785614587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b0c004130 0x7f9b2815c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:27.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.590+0000 7f9b2ce00640 1 -- 172.21.15.137:0/2785614587 >> 172.21.15.137:0/2785614587 conn(0x7f9b2806c5d0 msgr2=0x7f9b28145fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:27.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.590+0000 7f9b2ce00640 1 -- 172.21.15.137:0/2785614587 shutdown_connections 2024-04-26T23:43:27.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.590+0000 7f9b2ce00640 1 -- 172.21.15.137:0/2785614587 wait complete. 2024-04-26T23:43:27.618 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:43:27.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.746+0000 7f5ffc400640 1 Processor -- start 2024-04-26T23:43:27.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.746+0000 7f5ffc400640 1 -- start start 2024-04-26T23:43:27.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.746+0000 7f5ffc400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ff406d0d0 0x7f5ff40b4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:27.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.746+0000 7f5ffc400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff4163240 con 0x7f5ff4162d80 2024-04-26T23:43:27.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.746+0000 7f5ffc400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff4163520 con 0x7f5ff415f130 2024-04-26T23:43:27.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.746+0000 7f5ffc400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff4163800 con 0x7f5ff406d0d0 2024-04-26T23:43:27.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.746+0000 7f5ffa400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f5ff4162d80 0x7f5ff40d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:53022/0 (socket says 172.21.15.137:53022) 2024-04-26T23:43:27.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.746+0000 7f5ffa400640 1 -- 172.21.15.137:0/1704776631 learned_addr learned my addr 172.21.15.137:0/1704776631 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:27.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.746+0000 7f5ff9000640 1 --2- 172.21.15.137:0/1704776631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ff406d0d0 0x7f5ff40b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:27.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.746+0000 7f5ff3e00640 1 -- 172.21.15.137:0/1704776631 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2148614101 0 0) 0x7f5ff4163240 con 0x7f5ff4162d80 2024-04-26T23:43:27.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.746+0000 7f5ff3e00640 1 -- 172.21.15.137:0/1704776631 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fdc003530 con 0x7f5ff4162d80 2024-04-26T23:43:27.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.746+0000 7f5ff3e00640 1 -- 172.21.15.137:0/1704776631 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 906150140 0 0) 0x7f5ff4163520 con 0x7f5ff415f130 2024-04-26T23:43:27.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.746+0000 7f5ff3e00640 1 -- 172.21.15.137:0/1704776631 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ff4163240 con 0x7f5ff415f130 2024-04-26T23:43:27.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.746+0000 7f5ff9000640 1 -- 172.21.15.137:0/1704776631 >> v1:172.21.15.170:6789/0 conn(0x7f5ff415f130 legacy=0x7f5ff406c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:27.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.746+0000 7f5ff9000640 1 -- 172.21.15.137:0/1704776631 >> v1:172.21.15.137:6789/0 conn(0x7f5ff4162d80 legacy=0x7f5ff40d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:27.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.746+0000 7f5ff9000640 1 -- 172.21.15.137:0/1704776631 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff4163ae0 con 0x7f5ff406d0d0 2024-04-26T23:43:27.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.750+0000 7f5ff9000640 1 --2- 172.21.15.137:0/1704776631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ff406d0d0 0x7f5ff40b4370 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00097f0 tx=0x7f5fe001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e83d9e3629c91df7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:27.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.750+0000 7f5ff3e00640 1 -- 172.21.15.137:0/1704776631 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00ab610 con 0x7f5ff406d0d0 2024-04-26T23:43:27.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.750+0000 7f5ff3e00640 1 -- 172.21.15.137:0/1704776631 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe00b0070 con 0x7f5ff406d0d0 2024-04-26T23:43:27.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.750+0000 7f5ff3e00640 1 -- 172.21.15.137:0/1704776631 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00ab9d0 con 0x7f5ff406d0d0 2024-04-26T23:43:27.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.750+0000 7f5ffc400640 1 -- 172.21.15.137:0/1704776631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ff406d0d0 msgr2=0x7f5ff40b4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:27.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.750+0000 7f5ffc400640 1 --2- 172.21.15.137:0/1704776631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ff406d0d0 0x7f5ff40b4370 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00097f0 tx=0x7f5fe001c4a0 comp rx=0 tx=0).stop 2024-04-26T23:43:27.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.750+0000 7f5ffc400640 1 -- 172.21.15.137:0/1704776631 shutdown_connections 2024-04-26T23:43:27.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.750+0000 7f5ffc400640 1 --2- 172.21.15.137:0/1704776631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ff406d0d0 0x7f5ff40b4370 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:27.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.750+0000 7f5ffc400640 1 -- 172.21.15.137:0/1704776631 >> 172.21.15.137:0/1704776631 conn(0x7f5ff409ba60 msgr2=0x7f5ff409be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:27.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.750+0000 7f5ffc400640 1 -- 172.21.15.137:0/1704776631 shutdown_connections 2024-04-26T23:43:27.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.750+0000 7f5ffc400640 1 -- 172.21.15.137:0/1704776631 wait complete. 2024-04-26T23:43:27.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ffc400640 1 Processor -- start 2024-04-26T23:43:27.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ffc400640 1 -- start start 2024-04-26T23:43:27.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ffc400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ff406d0d0 0x7f5ff40b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:27.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ffc400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ff415f130 0x7f5ff4158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:27.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ffc400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ff4162d80 0x7f5ff414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:27.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ffc400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff40b2960 con 0x7f5ff4162d80 2024-04-26T23:43:27.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ffc400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff40b27e0 con 0x7f5ff406d0d0 2024-04-26T23:43:27.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ffc400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff416d0d0 con 0x7f5ff415f130 2024-04-26T23:43:27.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ffa400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ff4162d80 0x7f5ff414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:27.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ffa400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ff4162d80 0x7f5ff414ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54910/0 (socket says 172.21.15.137:54910) 2024-04-26T23:43:27.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ffa400640 1 -- 172.21.15.137:0/4206584947 learned_addr learned my addr 172.21.15.137:0/4206584947 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:27.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ff9a00640 1 --2- 172.21.15.137:0/4206584947 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ff406d0d0 0x7f5ff40b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:27.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ff9000640 1 --2- 172.21.15.137:0/4206584947 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ff415f130 0x7f5ff4158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:27.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ffa400640 1 -- 172.21.15.137:0/4206584947 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ff415f130 msgr2=0x7f5ff4158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:27.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ffa400640 1 --2- 172.21.15.137:0/4206584947 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ff415f130 0x7f5ff4158ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:27.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ffa400640 1 -- 172.21.15.137:0/4206584947 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ff406d0d0 msgr2=0x7f5ff40b1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:27.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ffa400640 1 --2- 172.21.15.137:0/4206584947 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ff406d0d0 0x7f5ff40b1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:27.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ffa400640 1 -- 172.21.15.137:0/4206584947 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff40b8160 con 0x7f5ff4162d80 2024-04-26T23:43:27.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ffa400640 1 --2- 172.21.15.137:0/4206584947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ff4162d80 0x7f5ff414ff50 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f5fec00c3c0 tx=0x7f5fec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:27.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ff1600640 1 -- 172.21.15.137:0/4206584947 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec017070 con 0x7f5ff4162d80 2024-04-26T23:43:27.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ff1600640 1 -- 172.21.15.137:0/4206584947 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fec005cf0 con 0x7f5ff4162d80 2024-04-26T23:43:27.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ff1600640 1 -- 172.21.15.137:0/4206584947 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0072d0 con 0x7f5ff4162d80 2024-04-26T23:43:27.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ffc400640 1 -- 172.21.15.137:0/4206584947 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff40b8440 con 0x7f5ff4162d80 2024-04-26T23:43:27.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.754+0000 7f5ffc400640 1 -- 172.21.15.137:0/4206584947 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff40b8a00 con 0x7f5ff4162d80 2024-04-26T23:43:27.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.758+0000 7f5ffc400640 1 -- 172.21.15.137:0/4206584947 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff406a4b0 con 0x7f5ff4162d80 2024-04-26T23:43:27.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.758+0000 7f5ff1600640 1 -- 172.21.15.137:0/4206584947 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5fec01a070 con 0x7f5ff4162d80 2024-04-26T23:43:27.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.758+0000 7f5ff1600640 1 --2- 172.21.15.137:0/4206584947 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5fd4068380 0x7f5fd406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:27.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.758+0000 7f5ff1600640 1 -- 172.21.15.137:0/4206584947 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f5fec085c80 con 0x7f5ff4162d80 2024-04-26T23:43:27.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.758+0000 7f5ff9a00640 1 --2- 172.21.15.137:0/4206584947 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5fd4068380 0x7f5fd406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:27.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.758+0000 7f5ff9a00640 1 --2- 172.21.15.137:0/4206584947 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5fd4068380 0x7f5fd406a840 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8001570 tx=0x7f5fe8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:27.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.762+0000 7f5ff1600640 1 -- 172.21.15.137:0/4206584947 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5fec055b50 con 0x7f5ff4162d80 2024-04-26T23:43:27.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.922+0000 7f5ffc400640 1 -- 172.21.15.137:0/4206584947 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ff4071d70 con 0x7f5ff4162d80 2024-04-26T23:43:27.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.922+0000 7f5ff1600640 1 -- 172.21.15.137:0/4206584947 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16661 (secure 0 0 0) 0x7f5fec059e50 con 0x7f5ff4162d80 2024-04-26T23:43:27.930 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:27.930 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":45,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:43:25.213503+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:43:21.281556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T23:43:22.549121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:43:27.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.926+0000 7f5ffc400640 1 -- 172.21.15.137:0/4206584947 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5fd4068380 msgr2=0x7f5fd406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:27.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.926+0000 7f5ffc400640 1 --2- 172.21.15.137:0/4206584947 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5fd4068380 0x7f5fd406a840 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8001570 tx=0x7f5fe8009040 comp rx=0 tx=0).stop 2024-04-26T23:43:27.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.926+0000 7f5ffc400640 1 -- 172.21.15.137:0/4206584947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ff4162d80 msgr2=0x7f5ff414ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:27.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.926+0000 7f5ffc400640 1 --2- 172.21.15.137:0/4206584947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ff4162d80 0x7f5ff414ff50 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f5fec00c3c0 tx=0x7f5fec00c880 comp rx=0 tx=0).stop 2024-04-26T23:43:27.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.926+0000 7f5ffc400640 1 -- 172.21.15.137:0/4206584947 shutdown_connections 2024-04-26T23:43:27.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.926+0000 7f5ffc400640 1 --2- 172.21.15.137:0/4206584947 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5fd4068380 0x7f5fd406a840 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:27.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.926+0000 7f5ffc400640 1 --2- 172.21.15.137:0/4206584947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ff4162d80 0x7f5ff414ff50 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:27.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.926+0000 7f5ffc400640 1 --2- 172.21.15.137:0/4206584947 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ff415f130 0x7f5ff4158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:27.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.926+0000 7f5ffc400640 1 --2- 172.21.15.137:0/4206584947 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ff406d0d0 0x7f5ff40b1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:27.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.926+0000 7f5ffc400640 1 -- 172.21.15.137:0/4206584947 >> 172.21.15.137:0/4206584947 conn(0x7f5ff409ba60 msgr2=0x7f5ff4156ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:27.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.926+0000 7f5ffc400640 1 -- 172.21.15.137:0/4206584947 shutdown_connections 2024-04-26T23:43:27.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:27.926+0000 7f5ffc400640 1 -- 172.21.15.137:0/4206584947 wait complete. 2024-04-26T23:43:27.951 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T23:43:27.951 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:43:28.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.078+0000 7f8e4a200640 1 Processor -- start 2024-04-26T23:43:28.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.078+0000 7f8e4a200640 1 -- start start 2024-04-26T23:43:28.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.078+0000 7f8e4a200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8e440ce3e0 0x7f8e44073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:28.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.082+0000 7f8e4a200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e44073010 con 0x7f8e4415de80 2024-04-26T23:43:28.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.082+0000 7f8e4a200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e440cef90 con 0x7f8e440ce7c0 2024-04-26T23:43:28.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.082+0000 7f8e4a200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8e44073280 con 0x7f8e440ce3e0 2024-04-26T23:43:28.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.082+0000 7f8e43400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8e440ce3e0 0x7f8e44073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:28.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.082+0000 7f8e3aa00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f8e4415de80 0x7f8e440d04e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:53032/0 (socket says 172.21.15.137:53032) 2024-04-26T23:43:28.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.082+0000 7f8e3aa00640 1 -- 172.21.15.137:0/3466998770 learned_addr learned my addr 172.21.15.137:0/3466998770 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:28.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.082+0000 7f8e43400640 1 -- 172.21.15.137:0/3466998770 >> v1:172.21.15.170:6789/0 conn(0x7f8e440ce7c0 legacy=0x7f8e44146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:28.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.082+0000 7f8e43400640 1 -- 172.21.15.137:0/3466998770 >> v1:172.21.15.137:6789/0 conn(0x7f8e4415de80 legacy=0x7f8e440d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:28.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.082+0000 7f8e43400640 1 -- 172.21.15.137:0/3466998770 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e44073560 con 0x7f8e440ce3e0 2024-04-26T23:43:28.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.082+0000 7f8e42a00640 1 -- 172.21.15.137:0/3466998770 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 868313787 0 0) 0x7f8e44073010 con 0x7f8e4415de80 2024-04-26T23:43:28.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.082+0000 7f8e43400640 1 --2- 172.21.15.137:0/3466998770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e440ce3e0 0x7f8e44073d60 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8e34009dc0 tx=0x7f8e3401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadc24506a3b21c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:28.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.082+0000 7f8e42a00640 1 -- 172.21.15.137:0/3466998770 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e340b2070 con 0x7f8e440ce3e0 2024-04-26T23:43:28.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.082+0000 7f8e42a00640 1 -- 172.21.15.137:0/3466998770 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e340a59c0 con 0x7f8e440ce3e0 2024-04-26T23:43:28.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.082+0000 7f8e42a00640 1 -- 172.21.15.137:0/3466998770 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e340a5d90 con 0x7f8e440ce3e0 2024-04-26T23:43:28.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e4a200640 1 -- 172.21.15.137:0/3466998770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e440ce3e0 msgr2=0x7f8e44073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:28.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e4a200640 1 --2- 172.21.15.137:0/3466998770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e440ce3e0 0x7f8e44073d60 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8e34009dc0 tx=0x7f8e3401c8e0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e4a200640 1 -- 172.21.15.137:0/3466998770 shutdown_connections 2024-04-26T23:43:28.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e4a200640 1 --2- 172.21.15.137:0/3466998770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e440ce3e0 0x7f8e44073d60 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e4a200640 1 -- 172.21.15.137:0/3466998770 >> 172.21.15.137:0/3466998770 conn(0x7f8e4406c5d0 msgr2=0x7f8e4406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:28.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e4a200640 1 -- 172.21.15.137:0/3466998770 shutdown_connections 2024-04-26T23:43:28.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e4a200640 1 -- 172.21.15.137:0/3466998770 wait complete. 2024-04-26T23:43:28.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e4a200640 1 Processor -- start 2024-04-26T23:43:28.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e4a200640 1 -- start start 2024-04-26T23:43:28.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e4a200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e440ce3e0 0x7f8e4413d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:28.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e4a200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e440ce7c0 0x7f8e4415a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:28.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e4a200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e4415de80 0x7f8e440ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:28.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e4a200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4406ed10 con 0x7f8e4415de80 2024-04-26T23:43:28.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e4a200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4406ee90 con 0x7f8e440ce3e0 2024-04-26T23:43:28.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e4a200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8e4406f010 con 0x7f8e440ce7c0 2024-04-26T23:43:28.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e43e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e4415de80 0x7f8e440ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:28.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e43e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e4415de80 0x7f8e440ade40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54932/0 (socket says 172.21.15.137:54932) 2024-04-26T23:43:28.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e43e00640 1 -- 172.21.15.137:0/601323070 learned_addr learned my addr 172.21.15.137:0/601323070 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:28.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e43400640 1 --2- 172.21.15.137:0/601323070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e440ce3e0 0x7f8e4413d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:28.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e3aa00640 1 --2- 172.21.15.137:0/601323070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e440ce7c0 0x7f8e4415a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:28.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e43e00640 1 -- 172.21.15.137:0/601323070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e440ce7c0 msgr2=0x7f8e4415a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:28.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e43e00640 1 --2- 172.21.15.137:0/601323070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e440ce7c0 0x7f8e4415a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e43e00640 1 -- 172.21.15.137:0/601323070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e440ce3e0 msgr2=0x7f8e4413d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:28.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e43e00640 1 --2- 172.21.15.137:0/601323070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e440ce3e0 0x7f8e4413d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e43e00640 1 -- 172.21.15.137:0/601323070 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4415ac90 con 0x7f8e4415de80 2024-04-26T23:43:28.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e43400640 1 --2- 172.21.15.137:0/601323070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e440ce3e0 0x7f8e4413d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:43:28.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.086+0000 7f8e3aa00640 1 --2- 172.21.15.137:0/601323070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e440ce7c0 0x7f8e4415a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:43:28.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.090+0000 7f8e43e00640 1 --2- 172.21.15.137:0/601323070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e4415de80 0x7f8e440ade40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00c3c0 tx=0x7f8e3c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:28.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.090+0000 7f8e3be00640 1 -- 172.21.15.137:0/601323070 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c011790 con 0x7f8e4415de80 2024-04-26T23:43:28.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.090+0000 7f8e3be00640 1 -- 172.21.15.137:0/601323070 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e3c017070 con 0x7f8e4415de80 2024-04-26T23:43:28.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.090+0000 7f8e3be00640 1 -- 172.21.15.137:0/601323070 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c011b70 con 0x7f8e4415de80 2024-04-26T23:43:28.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.090+0000 7f8e4a200640 1 -- 172.21.15.137:0/601323070 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e4415af70 con 0x7f8e4415de80 2024-04-26T23:43:28.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.090+0000 7f8e4a200640 1 -- 172.21.15.137:0/601323070 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e4415b530 con 0x7f8e4415de80 2024-04-26T23:43:28.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.090+0000 7f8e4a200640 1 -- 172.21.15.137:0/601323070 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e44068950 con 0x7f8e4415de80 2024-04-26T23:43:28.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.090+0000 7f8e3be00640 1 -- 172.21.15.137:0/601323070 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8e3c011d10 con 0x7f8e4415de80 2024-04-26T23:43:28.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.090+0000 7f8e3be00640 1 --2- 172.21.15.137:0/601323070 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8e200683b0 0x7f8e2006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:28.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.090+0000 7f8e3be00640 1 -- 172.21.15.137:0/601323070 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f8e3c086740 con 0x7f8e4415de80 2024-04-26T23:43:28.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.090+0000 7f8e43400640 1 --2- 172.21.15.137:0/601323070 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8e200683b0 0x7f8e2006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:28.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.094+0000 7f8e43400640 1 --2- 172.21.15.137:0/601323070 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8e200683b0 0x7f8e2006a870 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8e340af000 tx=0x7f8e340a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:28.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.094+0000 7f8e3be00640 1 -- 172.21.15.137:0/601323070 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8e3c056cf0 con 0x7f8e4415de80 2024-04-26T23:43:28.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.254+0000 7f8e4a200640 1 -- 172.21.15.137:0/601323070 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8e4406a4b0 con 0x7f8e200683b0 2024-04-26T23:43:28.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.258+0000 7f8e3be00640 1 -- 172.21.15.137:0/601323070 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251923 (secure 0 0 0) 0x7f8e4406a4b0 con 0x7f8e200683b0 2024-04-26T23:43:28.270 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:28.272 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T23:43:28.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.262+0000 7f8e4a200640 1 -- 172.21.15.137:0/601323070 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8e200683b0 msgr2=0x7f8e2006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:28.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.262+0000 7f8e4a200640 1 --2- 172.21.15.137:0/601323070 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8e200683b0 0x7f8e2006a870 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8e340af000 tx=0x7f8e340a7070 comp rx=0 tx=0).stop 2024-04-26T23:43:28.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.262+0000 7f8e4a200640 1 -- 172.21.15.137:0/601323070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e4415de80 msgr2=0x7f8e440ade40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:28.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.262+0000 7f8e4a200640 1 --2- 172.21.15.137:0/601323070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e4415de80 0x7f8e440ade40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00c3c0 tx=0x7f8e3c00c880 comp rx=0 tx=0).stop 2024-04-26T23:43:28.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.262+0000 7f8e4a200640 1 -- 172.21.15.137:0/601323070 shutdown_connections 2024-04-26T23:43:28.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.262+0000 7f8e4a200640 1 --2- 172.21.15.137:0/601323070 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8e200683b0 0x7f8e2006a870 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.262+0000 7f8e4a200640 1 --2- 172.21.15.137:0/601323070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e4415de80 0x7f8e440ade40 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.262+0000 7f8e4a200640 1 --2- 172.21.15.137:0/601323070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e440ce7c0 0x7f8e4415a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.262+0000 7f8e4a200640 1 --2- 172.21.15.137:0/601323070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e440ce3e0 0x7f8e4413d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.262+0000 7f8e4a200640 1 -- 172.21.15.137:0/601323070 >> 172.21.15.137:0/601323070 conn(0x7f8e4406c5d0 msgr2=0x7f8e44140ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:28.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.262+0000 7f8e4a200640 1 -- 172.21.15.137:0/601323070 shutdown_connections 2024-04-26T23:43:28.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.262+0000 7f8e4a200640 1 -- 172.21.15.137:0/601323070 wait complete. 2024-04-26T23:43:28.291 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2024-04-26T23:43:27.614607+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238068,"kb_used_data":5268,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736652,"statfs":{"total":773094113280,"available":772850331648,"internally_reserved":0,"allocated":5394432,"data_stored":2862504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.426813"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.233757+0000","last_change":"2024-04-26T23:43:24.230030+0000","last_active":"2024-04-26T23:43:24.233757+0000","last_peered":"2024-04-26T23:43:24.233757+0000","last_clean":"2024-04-26T23:43:24.233757+0000","last_became_active":"2024-04-26T23:43:24.229747+0000","last_became_peered":"2024-04-26T23:43:24.229747+0000","last_unstale":"2024-04-26T23:43:24.233757+0000","last_undegraded":"2024-04-26T23:43:24.233757+0000","last_fullsized":"2024-04-26T23:43:24.233757+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:37.389687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.224001+0000","last_change":"2024-04-26T23:43:24.230835+0000","last_active":"2024-04-26T23:43:25.224001+0000","last_peered":"2024-04-26T23:43:25.224001+0000","last_clean":"2024-04-26T23:43:25.224001+0000","last_became_active":"2024-04-26T23:43:24.230201+0000","last_became_peered":"2024-04-26T23:43:24.230201+0000","last_unstale":"2024-04-26T23:43:25.224001+0000","last_undegraded":"2024-04-26T23:43:25.224001+0000","last_fullsized":"2024-04-26T23:43:25.224001+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:47:47.195724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.222764+0000","last_change":"2024-04-26T23:43:24.229916+0000","last_active":"2024-04-26T23:43:25.222764+0000","last_peered":"2024-04-26T23:43:25.222764+0000","last_clean":"2024-04-26T23:43:25.222764+0000","last_became_active":"2024-04-26T23:43:24.229648+0000","last_became_peered":"2024-04-26T23:43:24.229648+0000","last_unstale":"2024-04-26T23:43:25.222764+0000","last_undegraded":"2024-04-26T23:43:25.222764+0000","last_fullsized":"2024-04-26T23:43:25.222764+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:54.898662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.228039+0000","last_change":"2024-04-26T23:43:24.225398+0000","last_active":"2024-04-26T23:43:24.228039+0000","last_peered":"2024-04-26T23:43:24.228039+0000","last_clean":"2024-04-26T23:43:24.228039+0000","last_became_active":"2024-04-26T23:43:24.225085+0000","last_became_peered":"2024-04-26T23:43:24.225085+0000","last_unstale":"2024-04-26T23:43:24.228039+0000","last_undegraded":"2024-04-26T23:43:24.228039+0000","last_fullsized":"2024-04-26T23:43:24.228039+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:24.760856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223733+0000","last_change":"2024-04-26T23:43:24.231314+0000","last_active":"2024-04-26T23:43:25.223733+0000","last_peered":"2024-04-26T23:43:25.223733+0000","last_clean":"2024-04-26T23:43:25.223733+0000","last_became_active":"2024-04-26T23:43:24.231012+0000","last_became_peered":"2024-04-26T23:43:24.231012+0000","last_unstale":"2024-04-26T23:43:25.223733+0000","last_undegraded":"2024-04-26T23:43:25.223733+0000","last_fullsized":"2024-04-26T23:43:25.223733+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:44:28.807293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240669+0000","last_change":"2024-04-26T23:43:24.235059+0000","last_active":"2024-04-26T23:43:25.240669+0000","last_peered":"2024-04-26T23:43:25.240669+0000","last_clean":"2024-04-26T23:43:25.240669+0000","last_became_active":"2024-04-26T23:43:24.231774+0000","last_became_peered":"2024-04-26T23:43:24.231774+0000","last_unstale":"2024-04-26T23:43:25.240669+0000","last_undegraded":"2024-04-26T23:43:25.240669+0000","last_fullsized":"2024-04-26T23:43:25.240669+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:29.184834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.235868+0000","last_change":"2024-04-26T23:43:24.234192+0000","last_active":"2024-04-26T23:43:24.235868+0000","last_peered":"2024-04-26T23:43:24.235868+0000","last_clean":"2024-04-26T23:43:24.235868+0000","last_became_active":"2024-04-26T23:43:24.233780+0000","last_became_peered":"2024-04-26T23:43:24.233780+0000","last_unstale":"2024-04-26T23:43:24.235868+0000","last_undegraded":"2024-04-26T23:43:24.235868+0000","last_fullsized":"2024-04-26T23:43:24.235868+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:44:28.807293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.231534+0000","last_change":"2024-04-26T23:43:24.226379+0000","last_active":"2024-04-26T23:43:24.231534+0000","last_peered":"2024-04-26T23:43:24.231534+0000","last_clean":"2024-04-26T23:43:24.231534+0000","last_became_active":"2024-04-26T23:43:24.225759+0000","last_became_peered":"2024-04-26T23:43:24.225759+0000","last_unstale":"2024-04-26T23:43:24.231534+0000","last_undegraded":"2024-04-26T23:43:24.231534+0000","last_fullsized":"2024-04-26T23:43:24.231534+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:14.970501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.246475+0000","last_change":"2024-04-26T23:43:24.241793+0000","last_active":"2024-04-26T23:43:24.246475+0000","last_peered":"2024-04-26T23:43:24.246475+0000","last_clean":"2024-04-26T23:43:24.246475+0000","last_became_active":"2024-04-26T23:43:24.240474+0000","last_became_peered":"2024-04-26T23:43:24.240474+0000","last_unstale":"2024-04-26T23:43:24.246475+0000","last_undegraded":"2024-04-26T23:43:24.246475+0000","last_fullsized":"2024-04-26T23:43:24.246475+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:12.146041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.240897+0000","last_change":"2024-04-26T23:43:24.227153+0000","last_active":"2024-04-26T23:43:24.240897+0000","last_peered":"2024-04-26T23:43:24.240897+0000","last_clean":"2024-04-26T23:43:24.240897+0000","last_became_active":"2024-04-26T23:43:24.226808+0000","last_became_peered":"2024-04-26T23:43:24.226808+0000","last_unstale":"2024-04-26T23:43:24.240897+0000","last_undegraded":"2024-04-26T23:43:24.240897+0000","last_fullsized":"2024-04-26T23:43:24.240897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:00.359183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.242298+0000","last_change":"2024-04-26T23:43:24.235012+0000","last_active":"2024-04-26T23:43:24.242298+0000","last_peered":"2024-04-26T23:43:24.242298+0000","last_clean":"2024-04-26T23:43:24.242298+0000","last_became_active":"2024-04-26T23:43:24.234727+0000","last_became_peered":"2024-04-26T23:43:24.234727+0000","last_unstale":"2024-04-26T23:43:24.242298+0000","last_undegraded":"2024-04-26T23:43:24.242298+0000","last_fullsized":"2024-04-26T23:43:24.242298+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:37:16.843601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223983+0000","last_change":"2024-04-26T23:43:24.231753+0000","last_active":"2024-04-26T23:43:25.223983+0000","last_peered":"2024-04-26T23:43:25.223983+0000","last_clean":"2024-04-26T23:43:25.223983+0000","last_became_active":"2024-04-26T23:43:24.231278+0000","last_became_peered":"2024-04-26T23:43:24.231278+0000","last_unstale":"2024-04-26T23:43:25.223983+0000","last_undegraded":"2024-04-26T23:43:25.223983+0000","last_fullsized":"2024-04-26T23:43:25.223983+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:19:39.351368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.220973+0000","last_change":"2024-04-26T23:43:24.236735+0000","last_active":"2024-04-26T23:43:25.220973+0000","last_peered":"2024-04-26T23:43:25.220973+0000","last_clean":"2024-04-26T23:43:25.220973+0000","last_became_active":"2024-04-26T23:43:24.236377+0000","last_became_peered":"2024-04-26T23:43:24.236377+0000","last_unstale":"2024-04-26T23:43:25.220973+0000","last_undegraded":"2024-04-26T23:43:25.220973+0000","last_fullsized":"2024-04-26T23:43:25.220973+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:17:36.342022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.240861+0000","last_change":"2024-04-26T23:43:24.233270+0000","last_active":"2024-04-26T23:43:24.240861+0000","last_peered":"2024-04-26T23:43:24.240861+0000","last_clean":"2024-04-26T23:43:24.240861+0000","last_became_active":"2024-04-26T23:43:24.232829+0000","last_became_peered":"2024-04-26T23:43:24.232829+0000","last_unstale":"2024-04-26T23:43:24.240861+0000","last_undegraded":"2024-04-26T23:43:24.240861+0000","last_fullsized":"2024-04-26T23:43:24.240861+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:26.840281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240465+0000","last_change":"2024-04-26T23:43:24.231213+0000","last_active":"2024-04-26T23:43:25.240465+0000","last_peered":"2024-04-26T23:43:25.240465+0000","last_clean":"2024-04-26T23:43:25.240465+0000","last_became_active":"2024-04-26T23:43:24.230927+0000","last_became_peered":"2024-04-26T23:43:24.230927+0000","last_unstale":"2024-04-26T23:43:25.240465+0000","last_undegraded":"2024-04-26T23:43:25.240465+0000","last_fullsized":"2024-04-26T23:43:25.240465+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:22.850762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.235337+0000","last_change":"2024-04-26T23:43:24.229593+0000","last_active":"2024-04-26T23:43:24.235337+0000","last_peered":"2024-04-26T23:43:24.235337+0000","last_clean":"2024-04-26T23:43:24.235337+0000","last_became_active":"2024-04-26T23:43:24.229225+0000","last_became_peered":"2024-04-26T23:43:24.229225+0000","last_unstale":"2024-04-26T23:43:24.235337+0000","last_undegraded":"2024-04-26T23:43:24.235337+0000","last_fullsized":"2024-04-26T23:43:24.235337+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:17:36.342022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223128+0000","last_change":"2024-04-26T23:43:24.225858+0000","last_active":"2024-04-26T23:43:25.223128+0000","last_peered":"2024-04-26T23:43:25.223128+0000","last_clean":"2024-04-26T23:43:25.223128+0000","last_became_active":"2024-04-26T23:43:24.225319+0000","last_became_peered":"2024-04-26T23:43:24.225319+0000","last_unstale":"2024-04-26T23:43:25.223128+0000","last_undegraded":"2024-04-26T23:43:25.223128+0000","last_fullsized":"2024-04-26T23:43:25.223128+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:23:28.974276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223110+0000","last_change":"2024-04-26T23:43:24.233249+0000","last_active":"2024-04-26T23:43:25.223110+0000","last_peered":"2024-04-26T23:43:25.223110+0000","last_clean":"2024-04-26T23:43:25.223110+0000","last_became_active":"2024-04-26T23:43:24.232962+0000","last_became_peered":"2024-04-26T23:43:24.232962+0000","last_unstale":"2024-04-26T23:43:25.223110+0000","last_undegraded":"2024-04-26T23:43:25.223110+0000","last_fullsized":"2024-04-26T23:43:25.223110+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:08.065863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.235400+0000","last_change":"2024-04-26T23:43:24.230256+0000","last_active":"2024-04-26T23:43:24.235400+0000","last_peered":"2024-04-26T23:43:24.235400+0000","last_clean":"2024-04-26T23:43:24.235400+0000","last_became_active":"2024-04-26T23:43:24.229970+0000","last_became_peered":"2024-04-26T23:43:24.229970+0000","last_unstale":"2024-04-26T23:43:24.235400+0000","last_undegraded":"2024-04-26T23:43:24.235400+0000","last_fullsized":"2024-04-26T23:43:24.235400+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:00:10.429420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.221216+0000","last_change":"2024-04-26T23:43:24.230632+0000","last_active":"2024-04-26T23:43:25.221216+0000","last_peered":"2024-04-26T23:43:25.221216+0000","last_clean":"2024-04-26T23:43:25.221216+0000","last_became_active":"2024-04-26T23:43:24.226284+0000","last_became_peered":"2024-04-26T23:43:24.226284+0000","last_unstale":"2024-04-26T23:43:25.221216+0000","last_undegraded":"2024-04-26T23:43:25.221216+0000","last_fullsized":"2024-04-26T23:43:25.221216+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:00:10.429420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240694+0000","last_change":"2024-04-26T23:43:24.231426+0000","last_active":"2024-04-26T23:43:25.240694+0000","last_peered":"2024-04-26T23:43:25.240694+0000","last_clean":"2024-04-26T23:43:25.240694+0000","last_became_active":"2024-04-26T23:43:24.231204+0000","last_became_peered":"2024-04-26T23:43:24.231204+0000","last_unstale":"2024-04-26T23:43:25.240694+0000","last_undegraded":"2024-04-26T23:43:25.240694+0000","last_fullsized":"2024-04-26T23:43:25.240694+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:18:30.564984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.240070+0000","last_change":"2024-04-26T23:43:24.226983+0000","last_active":"2024-04-26T23:43:24.240070+0000","last_peered":"2024-04-26T23:43:24.240070+0000","last_clean":"2024-04-26T23:43:24.240070+0000","last_became_active":"2024-04-26T23:43:24.226652+0000","last_became_peered":"2024-04-26T23:43:24.226652+0000","last_unstale":"2024-04-26T23:43:24.240070+0000","last_undegraded":"2024-04-26T23:43:24.240070+0000","last_fullsized":"2024-04-26T23:43:24.240070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:29.521126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.235984+0000","last_change":"2024-04-26T23:43:24.232811+0000","last_active":"2024-04-26T23:43:24.235984+0000","last_peered":"2024-04-26T23:43:24.235984+0000","last_clean":"2024-04-26T23:43:24.235984+0000","last_became_active":"2024-04-26T23:43:24.232538+0000","last_became_peered":"2024-04-26T23:43:24.232538+0000","last_unstale":"2024-04-26T23:43:24.235984+0000","last_undegraded":"2024-04-26T23:43:24.235984+0000","last_fullsized":"2024-04-26T23:43:24.235984+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:57.550494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.233116+0000","last_change":"2024-04-26T23:43:24.226223+0000","last_active":"2024-04-26T23:43:24.233116+0000","last_peered":"2024-04-26T23:43:24.233116+0000","last_clean":"2024-04-26T23:43:24.233116+0000","last_became_active":"2024-04-26T23:43:24.225937+0000","last_became_peered":"2024-04-26T23:43:24.225937+0000","last_unstale":"2024-04-26T23:43:24.233116+0000","last_undegraded":"2024-04-26T23:43:24.233116+0000","last_fullsized":"2024-04-26T23:43:24.233116+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:41.575445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.240002+0000","last_change":"2024-04-26T23:43:24.238447+0000","last_active":"2024-04-26T23:43:24.240002+0000","last_peered":"2024-04-26T23:43:24.240002+0000","last_clean":"2024-04-26T23:43:24.240002+0000","last_became_active":"2024-04-26T23:43:24.238161+0000","last_became_peered":"2024-04-26T23:43:24.238161+0000","last_unstale":"2024-04-26T23:43:24.240002+0000","last_undegraded":"2024-04-26T23:43:24.240002+0000","last_fullsized":"2024-04-26T23:43:24.240002+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:24.760856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.221161+0000","last_change":"2024-04-26T23:43:24.234451+0000","last_active":"2024-04-26T23:43:25.221161+0000","last_peered":"2024-04-26T23:43:25.221161+0000","last_clean":"2024-04-26T23:43:25.221161+0000","last_became_active":"2024-04-26T23:43:24.233305+0000","last_became_peered":"2024-04-26T23:43:24.233305+0000","last_unstale":"2024-04-26T23:43:25.221161+0000","last_undegraded":"2024-04-26T23:43:25.221161+0000","last_fullsized":"2024-04-26T23:43:25.221161+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:22.904809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.222819+0000","last_change":"2024-04-26T23:43:24.225839+0000","last_active":"2024-04-26T23:43:25.222819+0000","last_peered":"2024-04-26T23:43:25.222819+0000","last_clean":"2024-04-26T23:43:25.222819+0000","last_became_active":"2024-04-26T23:43:24.225515+0000","last_became_peered":"2024-04-26T23:43:24.225515+0000","last_unstale":"2024-04-26T23:43:25.222819+0000","last_undegraded":"2024-04-26T23:43:25.222819+0000","last_fullsized":"2024-04-26T23:43:25.222819+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:46.151679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223976+0000","last_change":"2024-04-26T23:43:24.231638+0000","last_active":"2024-04-26T23:43:25.223976+0000","last_peered":"2024-04-26T23:43:25.223976+0000","last_clean":"2024-04-26T23:43:25.223976+0000","last_became_active":"2024-04-26T23:43:24.230826+0000","last_became_peered":"2024-04-26T23:43:24.230826+0000","last_unstale":"2024-04-26T23:43:25.223976+0000","last_undegraded":"2024-04-26T23:43:25.223976+0000","last_fullsized":"2024-04-26T23:43:25.223976+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:23:28.974276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.238036+0000","last_change":"2024-04-26T23:43:24.236559+0000","last_active":"2024-04-26T23:43:24.238036+0000","last_peered":"2024-04-26T23:43:24.238036+0000","last_clean":"2024-04-26T23:43:24.238036+0000","last_became_active":"2024-04-26T23:43:24.236220+0000","last_became_peered":"2024-04-26T23:43:24.236220+0000","last_unstale":"2024-04-26T23:43:24.238036+0000","last_undegraded":"2024-04-26T23:43:24.238036+0000","last_fullsized":"2024-04-26T23:43:24.238036+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:24:46.924266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.222711+0000","last_change":"2024-04-26T23:43:24.235776+0000","last_active":"2024-04-26T23:43:25.222711+0000","last_peered":"2024-04-26T23:43:25.222711+0000","last_clean":"2024-04-26T23:43:25.222711+0000","last_became_active":"2024-04-26T23:43:24.235516+0000","last_became_peered":"2024-04-26T23:43:24.235516+0000","last_unstale":"2024-04-26T23:43:25.222711+0000","last_undegraded":"2024-04-26T23:43:25.222711+0000","last_fullsized":"2024-04-26T23:43:25.222711+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:39:31.580031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240512+0000","last_change":"2024-04-26T23:43:24.230430+0000","last_active":"2024-04-26T23:43:25.240512+0000","last_peered":"2024-04-26T23:43:25.240512+0000","last_clean":"2024-04-26T23:43:25.240512+0000","last_became_active":"2024-04-26T23:43:24.229848+0000","last_became_peered":"2024-04-26T23:43:24.229848+0000","last_unstale":"2024-04-26T23:43:25.240512+0000","last_undegraded":"2024-04-26T23:43:25.240512+0000","last_fullsized":"2024-04-26T23:43:25.240512+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:53.392835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.220912+0000","last_change":"2024-04-26T23:43:24.228989+0000","last_active":"2024-04-26T23:43:25.220912+0000","last_peered":"2024-04-26T23:43:25.220912+0000","last_clean":"2024-04-26T23:43:25.220912+0000","last_became_active":"2024-04-26T23:43:24.228730+0000","last_became_peered":"2024-04-26T23:43:24.228730+0000","last_unstale":"2024-04-26T23:43:25.220912+0000","last_undegraded":"2024-04-26T23:43:25.220912+0000","last_fullsized":"2024-04-26T23:43:25.220912+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:49:11.174508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.239478+0000","last_change":"2024-04-26T23:43:24.232444+0000","last_active":"2024-04-26T23:43:24.239478+0000","last_peered":"2024-04-26T23:43:24.239478+0000","last_clean":"2024-04-26T23:43:24.239478+0000","last_became_active":"2024-04-26T23:43:24.232164+0000","last_became_peered":"2024-04-26T23:43:24.232164+0000","last_unstale":"2024-04-26T23:43:24.239478+0000","last_undegraded":"2024-04-26T23:43:24.239478+0000","last_fullsized":"2024-04-26T23:43:24.239478+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:47:30.057297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.241074+0000","last_change":"2024-04-26T23:43:23.213558+0000","last_active":"2024-04-26T23:43:25.241074+0000","last_peered":"2024-04-26T23:43:25.241074+0000","last_clean":"2024-04-26T23:43:25.241074+0000","last_became_active":"2024-04-26T23:43:23.213317+0000","last_became_peered":"2024-04-26T23:43:23.213317+0000","last_unstale":"2024-04-26T23:43:25.241074+0000","last_undegraded":"2024-04-26T23:43:25.241074+0000","last_fullsized":"2024-04-26T23:43:25.241074+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:01:02.104398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.224949+0000","last_change":"2024-04-26T23:43:24.223928+0000","last_active":"2024-04-26T23:43:24.224949+0000","last_peered":"2024-04-26T23:43:24.224949+0000","last_clean":"2024-04-26T23:43:24.224949+0000","last_became_active":"2024-04-26T23:43:24.223595+0000","last_became_peered":"2024-04-26T23:43:24.223595+0000","last_unstale":"2024-04-26T23:43:24.224949+0000","last_undegraded":"2024-04-26T23:43:24.224949+0000","last_fullsized":"2024-04-26T23:43:24.224949+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:54.472519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223281+0000","last_change":"2024-04-26T23:43:23.215426+0000","last_active":"2024-04-26T23:43:25.223281+0000","last_peered":"2024-04-26T23:43:25.223281+0000","last_clean":"2024-04-26T23:43:25.223281+0000","last_became_active":"2024-04-26T23:43:23.214798+0000","last_became_peered":"2024-04-26T23:43:23.214798+0000","last_unstale":"2024-04-26T23:43:25.223281+0000","last_undegraded":"2024-04-26T23:43:25.223281+0000","last_fullsized":"2024-04-26T23:43:25.223281+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:23.754123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.224110+0000","last_change":"2024-04-26T23:43:24.231510+0000","last_active":"2024-04-26T23:43:25.224110+0000","last_peered":"2024-04-26T23:43:25.224110+0000","last_clean":"2024-04-26T23:43:25.224110+0000","last_became_active":"2024-04-26T23:43:24.228306+0000","last_became_peered":"2024-04-26T23:43:24.228306+0000","last_unstale":"2024-04-26T23:43:25.224110+0000","last_undegraded":"2024-04-26T23:43:25.224110+0000","last_fullsized":"2024-04-26T23:43:25.224110+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:29:16.961750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.248034+0000","last_change":"2024-04-26T23:43:23.217674+0000","last_active":"2024-04-26T23:43:24.248034+0000","last_peered":"2024-04-26T23:43:24.248034+0000","last_clean":"2024-04-26T23:43:24.248034+0000","last_became_active":"2024-04-26T23:43:23.217367+0000","last_became_peered":"2024-04-26T23:43:23.217367+0000","last_unstale":"2024-04-26T23:43:24.248034+0000","last_undegraded":"2024-04-26T23:43:24.248034+0000","last_fullsized":"2024-04-26T23:43:24.248034+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:59.352451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.239534+0000","last_change":"2024-04-26T23:43:24.232366+0000","last_active":"2024-04-26T23:43:24.239534+0000","last_peered":"2024-04-26T23:43:24.239534+0000","last_clean":"2024-04-26T23:43:24.239534+0000","last_became_active":"2024-04-26T23:43:24.232060+0000","last_became_peered":"2024-04-26T23:43:24.232060+0000","last_unstale":"2024-04-26T23:43:24.239534+0000","last_undegraded":"2024-04-26T23:43:24.239534+0000","last_fullsized":"2024-04-26T23:43:24.239534+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:40:04.393689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.244273+0000","last_change":"2024-04-26T23:43:23.215339+0000","last_active":"2024-04-26T23:43:24.244273+0000","last_peered":"2024-04-26T23:43:24.244273+0000","last_clean":"2024-04-26T23:43:24.244273+0000","last_became_active":"2024-04-26T23:43:23.215010+0000","last_became_peered":"2024-04-26T23:43:23.215010+0000","last_unstale":"2024-04-26T23:43:24.244273+0000","last_undegraded":"2024-04-26T23:43:24.244273+0000","last_fullsized":"2024-04-26T23:43:24.244273+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:11.139308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.222895+0000","last_change":"2024-04-26T23:43:24.226015+0000","last_active":"2024-04-26T23:43:25.222895+0000","last_peered":"2024-04-26T23:43:25.222895+0000","last_clean":"2024-04-26T23:43:25.222895+0000","last_became_active":"2024-04-26T23:43:24.225717+0000","last_became_peered":"2024-04-26T23:43:24.225717+0000","last_unstale":"2024-04-26T23:43:25.222895+0000","last_undegraded":"2024-04-26T23:43:25.222895+0000","last_fullsized":"2024-04-26T23:43:25.222895+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:01:03.111130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240769+0000","last_change":"2024-04-26T23:43:23.207365+0000","last_active":"2024-04-26T23:43:25.240769+0000","last_peered":"2024-04-26T23:43:25.240769+0000","last_clean":"2024-04-26T23:43:25.240769+0000","last_became_active":"2024-04-26T23:43:23.207061+0000","last_became_peered":"2024-04-26T23:43:23.207061+0000","last_unstale":"2024-04-26T23:43:25.240769+0000","last_undegraded":"2024-04-26T23:43:25.240769+0000","last_fullsized":"2024-04-26T23:43:25.240769+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:45.144947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.241169+0000","last_change":"2024-04-26T23:43:24.229533+0000","last_active":"2024-04-26T23:43:24.241169+0000","last_peered":"2024-04-26T23:43:24.241169+0000","last_clean":"2024-04-26T23:43:24.241169+0000","last_became_active":"2024-04-26T23:43:24.229196+0000","last_became_peered":"2024-04-26T23:43:24.229196+0000","last_unstale":"2024-04-26T23:43:24.241169+0000","last_undegraded":"2024-04-26T23:43:24.241169+0000","last_fullsized":"2024-04-26T23:43:24.241169+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:47:30.057297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.222939+0000","last_change":"2024-04-26T23:43:23.204392+0000","last_active":"2024-04-26T23:43:25.222939+0000","last_peered":"2024-04-26T23:43:25.222939+0000","last_clean":"2024-04-26T23:43:25.222939+0000","last_became_active":"2024-04-26T23:43:23.204069+0000","last_became_peered":"2024-04-26T23:43:23.204069+0000","last_unstale":"2024-04-26T23:43:25.222939+0000","last_undegraded":"2024-04-26T23:43:25.222939+0000","last_fullsized":"2024-04-26T23:43:25.222939+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:28.514394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.231522+0000","last_change":"2024-04-26T23:43:24.226013+0000","last_active":"2024-04-26T23:43:24.231522+0000","last_peered":"2024-04-26T23:43:24.231522+0000","last_clean":"2024-04-26T23:43:24.231522+0000","last_became_active":"2024-04-26T23:43:24.225434+0000","last_became_peered":"2024-04-26T23:43:24.225434+0000","last_unstale":"2024-04-26T23:43:24.231522+0000","last_undegraded":"2024-04-26T23:43:24.231522+0000","last_fullsized":"2024-04-26T23:43:24.231522+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:02.098089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223433+0000","last_change":"2024-04-26T23:43:23.216757+0000","last_active":"2024-04-26T23:43:25.223433+0000","last_peered":"2024-04-26T23:43:25.223433+0000","last_clean":"2024-04-26T23:43:25.223433+0000","last_became_active":"2024-04-26T23:43:23.216381+0000","last_became_peered":"2024-04-26T23:43:23.216381+0000","last_unstale":"2024-04-26T23:43:25.223433+0000","last_undegraded":"2024-04-26T23:43:25.223433+0000","last_fullsized":"2024-04-26T23:43:25.223433+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:47:29.050565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.235273+0000","last_change":"2024-04-26T23:43:24.229052+0000","last_active":"2024-04-26T23:43:24.235273+0000","last_peered":"2024-04-26T23:43:24.235273+0000","last_clean":"2024-04-26T23:43:24.235273+0000","last_became_active":"2024-04-26T23:43:24.228696+0000","last_became_peered":"2024-04-26T23:43:24.228696+0000","last_unstale":"2024-04-26T23:43:24.235273+0000","last_undegraded":"2024-04-26T23:43:24.235273+0000","last_fullsized":"2024-04-26T23:43:24.235273+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:49:11.174508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.219961+0000","last_change":"2024-04-26T23:43:23.216674+0000","last_active":"2024-04-26T23:43:24.219961+0000","last_peered":"2024-04-26T23:43:24.219961+0000","last_clean":"2024-04-26T23:43:24.219961+0000","last_became_active":"2024-04-26T23:43:23.216418+0000","last_became_peered":"2024-04-26T23:43:23.216418+0000","last_unstale":"2024-04-26T23:43:24.219961+0000","last_undegraded":"2024-04-26T23:43:24.219961+0000","last_fullsized":"2024-04-26T23:43:24.219961+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:21.898077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223120+0000","last_change":"2024-04-26T23:43:24.230423+0000","last_active":"2024-04-26T23:43:25.223120+0000","last_peered":"2024-04-26T23:43:25.223120+0000","last_clean":"2024-04-26T23:43:25.223120+0000","last_became_active":"2024-04-26T23:43:24.230164+0000","last_became_peered":"2024-04-26T23:43:24.230164+0000","last_unstale":"2024-04-26T23:43:25.223120+0000","last_undegraded":"2024-04-26T23:43:25.223120+0000","last_fullsized":"2024-04-26T23:43:25.223120+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:44:28.807293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223304+0000","last_change":"2024-04-26T23:43:23.218055+0000","last_active":"2024-04-26T23:43:25.223304+0000","last_peered":"2024-04-26T23:43:25.223304+0000","last_clean":"2024-04-26T23:43:25.223304+0000","last_became_active":"2024-04-26T23:43:23.216993+0000","last_became_peered":"2024-04-26T23:43:23.216993+0000","last_unstale":"2024-04-26T23:43:25.223304+0000","last_undegraded":"2024-04-26T23:43:25.223304+0000","last_fullsized":"2024-04-26T23:43:25.223304+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:13.963768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.224158+0000","last_change":"2024-04-26T23:43:24.218545+0000","last_active":"2024-04-26T23:43:24.224158+0000","last_peered":"2024-04-26T23:43:24.224158+0000","last_clean":"2024-04-26T23:43:24.224158+0000","last_became_active":"2024-04-26T23:43:24.218195+0000","last_became_peered":"2024-04-26T23:43:24.218195+0000","last_unstale":"2024-04-26T23:43:24.224158+0000","last_undegraded":"2024-04-26T23:43:24.224158+0000","last_fullsized":"2024-04-26T23:43:24.224158+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:46.151679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.222778+0000","last_change":"2024-04-26T23:43:23.212372+0000","last_active":"2024-04-26T23:43:24.222778+0000","last_peered":"2024-04-26T23:43:24.222778+0000","last_clean":"2024-04-26T23:43:24.222778+0000","last_became_active":"2024-04-26T23:43:23.212103+0000","last_became_peered":"2024-04-26T23:43:23.212103+0000","last_unstale":"2024-04-26T23:43:24.222778+0000","last_undegraded":"2024-04-26T23:43:24.222778+0000","last_fullsized":"2024-04-26T23:43:24.222778+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:16.132853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240897+0000","last_change":"2024-04-26T23:43:24.239163+0000","last_active":"2024-04-26T23:43:25.240897+0000","last_peered":"2024-04-26T23:43:25.240897+0000","last_clean":"2024-04-26T23:43:25.240897+0000","last_became_active":"2024-04-26T23:43:24.238893+0000","last_became_peered":"2024-04-26T23:43:24.238893+0000","last_unstale":"2024-04-26T23:43:25.240897+0000","last_undegraded":"2024-04-26T23:43:25.240897+0000","last_fullsized":"2024-04-26T23:43:25.240897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:15:11.771640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.244929+0000","last_change":"2024-04-26T23:43:23.214229+0000","last_active":"2024-04-26T23:43:24.244929+0000","last_peered":"2024-04-26T23:43:24.244929+0000","last_clean":"2024-04-26T23:43:24.244929+0000","last_became_active":"2024-04-26T23:43:23.213728+0000","last_became_peered":"2024-04-26T23:43:23.213728+0000","last_unstale":"2024-04-26T23:43:24.244929+0000","last_undegraded":"2024-04-26T23:43:24.244929+0000","last_fullsized":"2024-04-26T23:43:24.244929+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:39:30.573298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.239608+0000","last_change":"2024-04-26T23:43:24.238879+0000","last_active":"2024-04-26T23:43:24.239608+0000","last_peered":"2024-04-26T23:43:24.239608+0000","last_clean":"2024-04-26T23:43:24.239608+0000","last_became_active":"2024-04-26T23:43:24.238363+0000","last_became_peered":"2024-04-26T23:43:24.238363+0000","last_unstale":"2024-04-26T23:43:24.239608+0000","last_undegraded":"2024-04-26T23:43:24.239608+0000","last_fullsized":"2024-04-26T23:43:24.239608+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:23:28.974276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.221203+0000","last_change":"2024-04-26T23:43:23.205978+0000","last_active":"2024-04-26T23:43:25.221203+0000","last_peered":"2024-04-26T23:43:25.221203+0000","last_clean":"2024-04-26T23:43:25.221203+0000","last_became_active":"2024-04-26T23:43:23.205698+0000","last_became_peered":"2024-04-26T23:43:23.205698+0000","last_unstale":"2024-04-26T23:43:25.221203+0000","last_undegraded":"2024-04-26T23:43:25.221203+0000","last_fullsized":"2024-04-26T23:43:25.221203+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:01:00.235383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.236939+0000","last_change":"2024-04-26T23:43:24.235595+0000","last_active":"2024-04-26T23:43:24.236939+0000","last_peered":"2024-04-26T23:43:24.236939+0000","last_clean":"2024-04-26T23:43:24.236939+0000","last_became_active":"2024-04-26T23:43:24.234380+0000","last_became_peered":"2024-04-26T23:43:24.234380+0000","last_unstale":"2024-04-26T23:43:24.236939+0000","last_undegraded":"2024-04-26T23:43:24.236939+0000","last_fullsized":"2024-04-26T23:43:24.236939+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:33.464698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240794+0000","last_change":"2024-04-26T23:43:23.217399+0000","last_active":"2024-04-26T23:43:25.240794+0000","last_peered":"2024-04-26T23:43:25.240794+0000","last_clean":"2024-04-26T23:43:25.240794+0000","last_became_active":"2024-04-26T23:43:23.216472+0000","last_became_peered":"2024-04-26T23:43:23.216472+0000","last_unstale":"2024-04-26T23:43:25.240794+0000","last_undegraded":"2024-04-26T23:43:25.240794+0000","last_fullsized":"2024-04-26T23:43:25.240794+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:36.382955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.241147+0000","last_change":"2024-04-26T23:43:24.229496+0000","last_active":"2024-04-26T23:43:24.241147+0000","last_peered":"2024-04-26T23:43:24.241147+0000","last_clean":"2024-04-26T23:43:24.241147+0000","last_became_active":"2024-04-26T23:43:24.229215+0000","last_became_peered":"2024-04-26T23:43:24.229215+0000","last_unstale":"2024-04-26T23:43:24.241147+0000","last_undegraded":"2024-04-26T23:43:24.241147+0000","last_fullsized":"2024-04-26T23:43:24.241147+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:40:04.393689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.210366+0000","last_change":"2024-04-26T23:43:23.216097+0000","last_active":"2024-04-26T23:43:24.210366+0000","last_peered":"2024-04-26T23:43:24.210366+0000","last_clean":"2024-04-26T23:43:24.210366+0000","last_became_active":"2024-04-26T23:43:23.215773+0000","last_became_peered":"2024-04-26T23:43:23.215773+0000","last_unstale":"2024-04-26T23:43:24.210366+0000","last_undegraded":"2024-04-26T23:43:24.210366+0000","last_fullsized":"2024-04-26T23:43:24.210366+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:25.833549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240436+0000","last_change":"2024-04-26T23:43:24.228890+0000","last_active":"2024-04-26T23:43:25.240436+0000","last_peered":"2024-04-26T23:43:25.240436+0000","last_clean":"2024-04-26T23:43:25.240436+0000","last_became_active":"2024-04-26T23:43:24.228497+0000","last_became_peered":"2024-04-26T23:43:24.228497+0000","last_unstale":"2024-04-26T23:43:25.240436+0000","last_undegraded":"2024-04-26T23:43:25.240436+0000","last_fullsized":"2024-04-26T23:43:25.240436+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:10.196139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240555+0000","last_change":"2024-04-26T23:43:23.216890+0000","last_active":"2024-04-26T23:43:25.240555+0000","last_peered":"2024-04-26T23:43:25.240555+0000","last_clean":"2024-04-26T23:43:25.240555+0000","last_became_active":"2024-04-26T23:43:23.216522+0000","last_became_peered":"2024-04-26T23:43:23.216522+0000","last_unstale":"2024-04-26T23:43:25.240555+0000","last_undegraded":"2024-04-26T23:43:25.240555+0000","last_fullsized":"2024-04-26T23:43:25.240555+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:39:30.573298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.229432+0000","last_change":"2024-04-26T23:43:24.228213+0000","last_active":"2024-04-26T23:43:24.229432+0000","last_peered":"2024-04-26T23:43:24.229432+0000","last_clean":"2024-04-26T23:43:24.229432+0000","last_became_active":"2024-04-26T23:43:24.225062+0000","last_became_peered":"2024-04-26T23:43:24.225062+0000","last_unstale":"2024-04-26T23:43:24.229432+0000","last_undegraded":"2024-04-26T23:43:24.229432+0000","last_fullsized":"2024-04-26T23:43:24.229432+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:01:03.111130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.253975+0000","last_change":"2024-04-26T23:43:23.217879+0000","last_active":"2024-04-26T23:43:24.253975+0000","last_peered":"2024-04-26T23:43:24.253975+0000","last_clean":"2024-04-26T23:43:24.253975+0000","last_became_active":"2024-04-26T23:43:23.217522+0000","last_became_peered":"2024-04-26T23:43:23.217522+0000","last_unstale":"2024-04-26T23:43:24.253975+0000","last_undegraded":"2024-04-26T23:43:24.253975+0000","last_fullsized":"2024-04-26T23:43:24.253975+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:00:09.422688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.221282+0000","last_change":"2024-04-26T23:43:24.223318+0000","last_active":"2024-04-26T23:43:25.221282+0000","last_peered":"2024-04-26T23:43:25.221282+0000","last_clean":"2024-04-26T23:43:25.221282+0000","last_became_active":"2024-04-26T23:43:24.223084+0000","last_became_peered":"2024-04-26T23:43:24.223084+0000","last_unstale":"2024-04-26T23:43:25.221282+0000","last_undegraded":"2024-04-26T23:43:25.221282+0000","last_fullsized":"2024-04-26T23:43:25.221282+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:17.139585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.221279+0000","last_change":"2024-04-26T23:43:23.213620+0000","last_active":"2024-04-26T23:43:25.221279+0000","last_peered":"2024-04-26T23:43:25.221279+0000","last_clean":"2024-04-26T23:43:25.221279+0000","last_became_active":"2024-04-26T23:43:23.210916+0000","last_became_peered":"2024-04-26T23:43:23.210916+0000","last_unstale":"2024-04-26T23:43:25.221279+0000","last_undegraded":"2024-04-26T23:43:25.221279+0000","last_fullsized":"2024-04-26T23:43:25.221279+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:11:56.185920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.240345+0000","last_change":"2024-04-26T23:43:24.228261+0000","last_active":"2024-04-26T23:43:24.240345+0000","last_peered":"2024-04-26T23:43:24.240345+0000","last_clean":"2024-04-26T23:43:24.240345+0000","last_became_active":"2024-04-26T23:43:24.227938+0000","last_became_peered":"2024-04-26T23:43:24.227938+0000","last_unstale":"2024-04-26T23:43:24.240345+0000","last_undegraded":"2024-04-26T23:43:24.240345+0000","last_fullsized":"2024-04-26T23:43:24.240345+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:12:58.041847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223485+0000","last_change":"2024-04-26T23:43:23.216939+0000","last_active":"2024-04-26T23:43:25.223485+0000","last_peered":"2024-04-26T23:43:25.223485+0000","last_clean":"2024-04-26T23:43:25.223485+0000","last_became_active":"2024-04-26T23:43:23.216603+0000","last_became_peered":"2024-04-26T23:43:23.216603+0000","last_unstale":"2024-04-26T23:43:25.223485+0000","last_undegraded":"2024-04-26T23:43:25.223485+0000","last_fullsized":"2024-04-26T23:43:25.223485+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:01.091356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.235946+0000","last_change":"2024-04-26T23:43:24.232488+0000","last_active":"2024-04-26T23:43:24.235946+0000","last_peered":"2024-04-26T23:43:24.235946+0000","last_clean":"2024-04-26T23:43:24.235946+0000","last_became_active":"2024-04-26T23:43:24.231997+0000","last_became_peered":"2024-04-26T23:43:24.231997+0000","last_unstale":"2024-04-26T23:43:24.235946+0000","last_undegraded":"2024-04-26T23:43:24.235946+0000","last_fullsized":"2024-04-26T23:43:24.235946+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:17.139585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223858+0000","last_change":"2024-04-26T23:43:23.219353+0000","last_active":"2024-04-26T23:43:25.223858+0000","last_peered":"2024-04-26T23:43:25.223858+0000","last_clean":"2024-04-26T23:43:25.223858+0000","last_became_active":"2024-04-26T23:43:23.218946+0000","last_became_peered":"2024-04-26T23:43:23.218946+0000","last_unstale":"2024-04-26T23:43:25.223858+0000","last_undegraded":"2024-04-26T23:43:25.223858+0000","last_fullsized":"2024-04-26T23:43:25.223858+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:25.833549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.240021+0000","last_change":"2024-04-26T23:43:24.239205+0000","last_active":"2024-04-26T23:43:24.240021+0000","last_peered":"2024-04-26T23:43:24.240021+0000","last_clean":"2024-04-26T23:43:24.240021+0000","last_became_active":"2024-04-26T23:43:24.238746+0000","last_became_peered":"2024-04-26T23:43:24.238746+0000","last_unstale":"2024-04-26T23:43:24.240021+0000","last_undegraded":"2024-04-26T23:43:24.240021+0000","last_fullsized":"2024-04-26T23:43:24.240021+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:02.098089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240974+0000","last_change":"2024-04-26T23:43:23.212991+0000","last_active":"2024-04-26T23:43:25.240974+0000","last_peered":"2024-04-26T23:43:25.240974+0000","last_clean":"2024-04-26T23:43:25.240974+0000","last_became_active":"2024-04-26T23:43:23.211944+0000","last_became_peered":"2024-04-26T23:43:23.211944+0000","last_unstale":"2024-04-26T23:43:25.240974+0000","last_undegraded":"2024-04-26T23:43:25.240974+0000","last_fullsized":"2024-04-26T23:43:25.240974+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:53.891929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240665+0000","last_change":"2024-04-26T23:43:24.238856+0000","last_active":"2024-04-26T23:43:25.240665+0000","last_peered":"2024-04-26T23:43:25.240665+0000","last_clean":"2024-04-26T23:43:25.240665+0000","last_became_active":"2024-04-26T23:43:24.238593+0000","last_became_peered":"2024-04-26T23:43:24.238593+0000","last_unstale":"2024-04-26T23:43:25.240665+0000","last_undegraded":"2024-04-26T23:43:25.240665+0000","last_fullsized":"2024-04-26T23:43:25.240665+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:14:01.979606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240898+0000","last_change":"2024-04-26T23:43:23.204711+0000","last_active":"2024-04-26T23:43:25.240898+0000","last_peered":"2024-04-26T23:43:25.240898+0000","last_clean":"2024-04-26T23:43:25.240898+0000","last_became_active":"2024-04-26T23:43:23.204410+0000","last_became_peered":"2024-04-26T23:43:23.204410+0000","last_unstale":"2024-04-26T23:43:25.240898+0000","last_undegraded":"2024-04-26T23:43:25.240898+0000","last_fullsized":"2024-04-26T23:43:25.240898+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:44:27.800560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.237065+0000","last_change":"2024-04-26T23:43:24.230587+0000","last_active":"2024-04-26T23:43:24.237065+0000","last_peered":"2024-04-26T23:43:24.237065+0000","last_clean":"2024-04-26T23:43:24.237065+0000","last_became_active":"2024-04-26T23:43:24.230240+0000","last_became_peered":"2024-04-26T23:43:24.230240+0000","last_unstale":"2024-04-26T23:43:24.237065+0000","last_undegraded":"2024-04-26T23:43:24.237065+0000","last_fullsized":"2024-04-26T23:43:24.237065+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:28.622795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223477+0000","last_change":"2024-04-26T23:43:23.217463+0000","last_active":"2024-04-26T23:43:25.223477+0000","last_peered":"2024-04-26T23:43:25.223477+0000","last_clean":"2024-04-26T23:43:25.223477+0000","last_became_active":"2024-04-26T23:43:23.215473+0000","last_became_peered":"2024-04-26T23:43:23.215473+0000","last_unstale":"2024-04-26T23:43:25.223477+0000","last_undegraded":"2024-04-26T23:43:25.223477+0000","last_fullsized":"2024-04-26T23:43:25.223477+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:23.830371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.220903+0000","last_change":"2024-04-26T23:43:24.225447+0000","last_active":"2024-04-26T23:43:25.220903+0000","last_peered":"2024-04-26T23:43:25.220903+0000","last_clean":"2024-04-26T23:43:25.220903+0000","last_became_active":"2024-04-26T23:43:24.225188+0000","last_became_peered":"2024-04-26T23:43:24.225188+0000","last_unstale":"2024-04-26T23:43:25.220903+0000","last_undegraded":"2024-04-26T23:43:25.220903+0000","last_fullsized":"2024-04-26T23:43:25.220903+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:41.575445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.223744+0000","last_change":"2024-04-26T23:43:23.212791+0000","last_active":"2024-04-26T23:43:24.223744+0000","last_peered":"2024-04-26T23:43:24.223744+0000","last_clean":"2024-04-26T23:43:24.223744+0000","last_became_active":"2024-04-26T23:43:23.212484+0000","last_became_peered":"2024-04-26T23:43:23.212484+0000","last_unstale":"2024-04-26T23:43:24.223744+0000","last_undegraded":"2024-04-26T23:43:24.223744+0000","last_fullsized":"2024-04-26T23:43:24.223744+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:32.457966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.240694+0000","last_change":"2024-04-26T23:43:24.233071+0000","last_active":"2024-04-26T23:43:24.240694+0000","last_peered":"2024-04-26T23:43:24.240694+0000","last_clean":"2024-04-26T23:43:24.240694+0000","last_became_active":"2024-04-26T23:43:24.232791+0000","last_became_peered":"2024-04-26T23:43:24.232791+0000","last_unstale":"2024-04-26T23:43:24.240694+0000","last_undegraded":"2024-04-26T23:43:24.240694+0000","last_fullsized":"2024-04-26T23:43:24.240694+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:24.837103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.210227+0000","last_change":"2024-04-26T23:43:23.217511+0000","last_active":"2024-04-26T23:43:24.210227+0000","last_peered":"2024-04-26T23:43:24.210227+0000","last_clean":"2024-04-26T23:43:24.210227+0000","last_became_active":"2024-04-26T23:43:23.217237+0000","last_became_peered":"2024-04-26T23:43:23.217237+0000","last_unstale":"2024-04-26T23:43:24.210227+0000","last_undegraded":"2024-04-26T23:43:24.210227+0000","last_fullsized":"2024-04-26T23:43:24.210227+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:23.830371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.235351+0000","last_change":"2024-04-26T23:43:24.230196+0000","last_active":"2024-04-26T23:43:24.235351+0000","last_peered":"2024-04-26T23:43:24.235351+0000","last_clean":"2024-04-26T23:43:24.235351+0000","last_became_active":"2024-04-26T23:43:24.229798+0000","last_became_peered":"2024-04-26T23:43:24.229798+0000","last_unstale":"2024-04-26T23:43:24.235351+0000","last_undegraded":"2024-04-26T23:43:24.235351+0000","last_fullsized":"2024-04-26T23:43:24.235351+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:22.904809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.242515+0000","last_change":"2024-04-26T23:43:23.210525+0000","last_active":"2024-04-26T23:43:25.242515+0000","last_peered":"2024-04-26T23:43:25.242515+0000","last_clean":"2024-04-26T23:43:25.242515+0000","last_became_active":"2024-04-26T23:43:23.205988+0000","last_became_peered":"2024-04-26T23:43:23.205988+0000","last_unstale":"2024-04-26T23:43:25.242515+0000","last_undegraded":"2024-04-26T23:43:25.242515+0000","last_fullsized":"2024-04-26T23:43:25.242515+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:07.059130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.228020+0000","last_change":"2024-04-26T23:43:24.224432+0000","last_active":"2024-04-26T23:43:24.228020+0000","last_peered":"2024-04-26T23:43:24.228020+0000","last_clean":"2024-04-26T23:43:24.228020+0000","last_became_active":"2024-04-26T23:43:24.224033+0000","last_became_peered":"2024-04-26T23:43:24.224033+0000","last_unstale":"2024-04-26T23:43:24.228020+0000","last_undegraded":"2024-04-26T23:43:24.228020+0000","last_fullsized":"2024-04-26T23:43:24.228020+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:24:46.924266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.212603+0000","last_change":"2024-04-26T23:43:23.213980+0000","last_active":"2024-04-26T23:43:24.212603+0000","last_peered":"2024-04-26T23:43:24.212603+0000","last_clean":"2024-04-26T23:43:24.212603+0000","last_became_active":"2024-04-26T23:43:23.213375+0000","last_became_peered":"2024-04-26T23:43:23.213375+0000","last_unstale":"2024-04-26T23:43:24.212603+0000","last_undegraded":"2024-04-26T23:43:24.212603+0000","last_fullsized":"2024-04-26T23:43:24.212603+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:53.891929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.233658+0000","last_change":"2024-04-26T23:43:24.230836+0000","last_active":"2024-04-26T23:43:24.233658+0000","last_peered":"2024-04-26T23:43:24.233658+0000","last_clean":"2024-04-26T23:43:24.233658+0000","last_became_active":"2024-04-26T23:43:24.230518+0000","last_became_peered":"2024-04-26T23:43:24.230518+0000","last_unstale":"2024-04-26T23:43:24.233658+0000","last_undegraded":"2024-04-26T23:43:24.233658+0000","last_fullsized":"2024-04-26T23:43:24.233658+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:08.065863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.216320+0000","last_change":"2024-04-26T23:43:23.216247+0000","last_active":"2024-04-26T23:43:24.216320+0000","last_peered":"2024-04-26T23:43:24.216320+0000","last_clean":"2024-04-26T23:43:24.216320+0000","last_became_active":"2024-04-26T23:43:23.215960+0000","last_became_peered":"2024-04-26T23:43:23.215960+0000","last_unstale":"2024-04-26T23:43:24.216320+0000","last_undegraded":"2024-04-26T23:43:24.216320+0000","last_fullsized":"2024-04-26T23:43:24.216320+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:12:57.035114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240825+0000","last_change":"2024-04-26T23:43:24.235711+0000","last_active":"2024-04-26T23:43:25.240825+0000","last_peered":"2024-04-26T23:43:25.240825+0000","last_clean":"2024-04-26T23:43:25.240825+0000","last_became_active":"2024-04-26T23:43:24.235445+0000","last_became_peered":"2024-04-26T23:43:24.235445+0000","last_unstale":"2024-04-26T23:43:25.240825+0000","last_undegraded":"2024-04-26T23:43:25.240825+0000","last_fullsized":"2024-04-26T23:43:25.240825+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:46:34.620595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.210972+0000","last_change":"2024-04-26T23:43:23.213480+0000","last_active":"2024-04-26T23:43:24.210972+0000","last_peered":"2024-04-26T23:43:24.210972+0000","last_clean":"2024-04-26T23:43:24.210972+0000","last_became_active":"2024-04-26T23:43:23.213213+0000","last_became_peered":"2024-04-26T23:43:23.213213+0000","last_unstale":"2024-04-26T23:43:24.210972+0000","last_undegraded":"2024-04-26T23:43:24.210972+0000","last_fullsized":"2024-04-26T23:43:24.210972+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:37:15.836868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240695+0000","last_change":"2024-04-26T23:43:24.242272+0000","last_active":"2024-04-26T23:43:25.240695+0000","last_peered":"2024-04-26T23:43:25.240695+0000","last_clean":"2024-04-26T23:43:25.240695+0000","last_became_active":"2024-04-26T23:43:24.241622+0000","last_became_peered":"2024-04-26T23:43:24.241622+0000","last_unstale":"2024-04-26T23:43:25.240695+0000","last_undegraded":"2024-04-26T23:43:25.240695+0000","last_fullsized":"2024-04-26T23:43:25.240695+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:43:36.834419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223033+0000","last_change":"2024-04-26T23:43:23.211036+0000","last_active":"2024-04-26T23:43:25.223033+0000","last_peered":"2024-04-26T23:43:25.223033+0000","last_clean":"2024-04-26T23:43:25.223033+0000","last_became_active":"2024-04-26T23:43:23.210683+0000","last_became_peered":"2024-04-26T23:43:23.210683+0000","last_unstale":"2024-04-26T23:43:25.223033+0000","last_undegraded":"2024-04-26T23:43:25.223033+0000","last_fullsized":"2024-04-26T23:43:25.223033+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:59.352451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.222771+0000","last_change":"2024-04-26T23:43:24.233982+0000","last_active":"2024-04-26T23:43:25.222771+0000","last_peered":"2024-04-26T23:43:25.222771+0000","last_clean":"2024-04-26T23:43:25.222771+0000","last_became_active":"2024-04-26T23:43:24.233719+0000","last_became_peered":"2024-04-26T23:43:24.233719+0000","last_unstale":"2024-04-26T23:43:25.222771+0000","last_undegraded":"2024-04-26T23:43:25.222771+0000","last_fullsized":"2024-04-26T23:43:25.222771+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:08.065863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.215388+0000","last_change":"2024-04-26T23:43:23.214905+0000","last_active":"2024-04-26T23:43:24.215388+0000","last_peered":"2024-04-26T23:43:24.215388+0000","last_clean":"2024-04-26T23:43:24.215388+0000","last_became_active":"2024-04-26T23:43:23.214611+0000","last_became_peered":"2024-04-26T23:43:23.214611+0000","last_unstale":"2024-04-26T23:43:24.215388+0000","last_undegraded":"2024-04-26T23:43:24.215388+0000","last_fullsized":"2024-04-26T23:43:24.215388+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:28.514394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.222971+0000","last_change":"2024-04-26T23:43:24.237784+0000","last_active":"2024-04-26T23:43:25.222971+0000","last_peered":"2024-04-26T23:43:25.222971+0000","last_clean":"2024-04-26T23:43:25.222971+0000","last_became_active":"2024-04-26T23:43:24.237433+0000","last_became_peered":"2024-04-26T23:43:24.237433+0000","last_unstale":"2024-04-26T23:43:25.222971+0000","last_undegraded":"2024-04-26T23:43:25.222971+0000","last_fullsized":"2024-04-26T23:43:25.222971+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:37.389687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.223472+0000","last_change":"2024-04-26T23:43:23.217660+0000","last_active":"2024-04-26T23:43:24.223472+0000","last_peered":"2024-04-26T23:43:24.223472+0000","last_clean":"2024-04-26T23:43:24.223472+0000","last_became_active":"2024-04-26T23:43:23.217006+0000","last_became_peered":"2024-04-26T23:43:23.217006+0000","last_unstale":"2024-04-26T23:43:24.223472+0000","last_undegraded":"2024-04-26T23:43:24.223472+0000","last_fullsized":"2024-04-26T23:43:24.223472+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:56.543762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.240917+0000","last_change":"2024-04-26T23:43:24.228799+0000","last_active":"2024-04-26T23:43:24.240917+0000","last_peered":"2024-04-26T23:43:24.240917+0000","last_clean":"2024-04-26T23:43:24.240917+0000","last_became_active":"2024-04-26T23:43:24.227457+0000","last_became_peered":"2024-04-26T23:43:24.227457+0000","last_unstale":"2024-04-26T23:43:24.240917+0000","last_undegraded":"2024-04-26T23:43:24.240917+0000","last_fullsized":"2024-04-26T23:43:24.240917+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:28.622795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.224016+0000","last_change":"2024-04-26T23:43:23.207678+0000","last_active":"2024-04-26T23:43:25.224016+0000","last_peered":"2024-04-26T23:43:25.224016+0000","last_clean":"2024-04-26T23:43:25.224016+0000","last_became_active":"2024-04-26T23:43:23.207418+0000","last_became_peered":"2024-04-26T23:43:23.207418+0000","last_unstale":"2024-04-26T23:43:25.224016+0000","last_undegraded":"2024-04-26T23:43:25.224016+0000","last_fullsized":"2024-04-26T23:43:25.224016+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:37:15.836868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":216,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.210091+0000","last_change":"2024-04-26T23:41:12.783987+0000","last_active":"2024-04-26T23:43:24.210091+0000","last_peered":"2024-04-26T23:43:24.210091+0000","last_clean":"2024-04-26T23:43:24.210091+0000","last_became_active":"2024-04-26T23:41:12.782901+0000","last_became_peered":"2024-04-26T23:41:12.782901+0000","last_unstale":"2024-04-26T23:43:24.210091+0000","last_undegraded":"2024-04-26T23:43:24.210091+0000","last_fullsized":"2024-04-26T23:43:24.210091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_clean_scrub_stamp":"2024-04-26T23:41:11.626255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:16.305521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1114112,"data_stored":799289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31692,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340148,"statfs":{"total":96636764160,"available":96604311552,"internally_reserved":0,"allocated":524288,"data_stored":209503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":520192,"data_stored":208901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":528384,"data_stored":210443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":540672,"data_stored":215769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":210465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":520192,"data_stored":208901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1114112,"data_stored":799233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:43:28.295 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:43:28.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.458+0000 7f0017e00640 1 Processor -- start 2024-04-26T23:43:28.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.462+0000 7f0017e00640 1 -- start start 2024-04-26T23:43:28.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.462+0000 7f0017e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00180b01c0 0x7f0018070900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:28.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.462+0000 7f0017e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f001815fe10 0x7f00180b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:28.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.462+0000 7f0017e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0018075760 con 0x7f0018160270 2024-04-26T23:43:28.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.462+0000 7f0017e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f00180b05a0 con 0x7f001815fe10 2024-04-26T23:43:28.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.462+0000 7f0017e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f00180b6d00 con 0x7f00180b01c0 2024-04-26T23:43:28.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.462+0000 7f0016000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f001815fe10 0x7f00180b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:28.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.462+0000 7f0017400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f0018160270 0x7f001806f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:53046/0 (socket says 172.21.15.137:53046) 2024-04-26T23:43:28.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.462+0000 7f0017400640 1 -- 172.21.15.137:0/1471306672 learned_addr learned my addr 172.21.15.137:0/1471306672 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:28.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.462+0000 7f0016a00640 1 --2- 172.21.15.137:0/1471306672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00180b01c0 0x7f0018070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:28.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.462+0000 7f0016000640 1 -- 172.21.15.137:0/1471306672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00180b01c0 msgr2=0x7f0018070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:28.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.462+0000 7f0016000640 1 --2- 172.21.15.137:0/1471306672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00180b01c0 0x7f0018070900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.462+0000 7f0016000640 1 -- 172.21.15.137:0/1471306672 >> v1:172.21.15.137:6789/0 conn(0x7f0018160270 legacy=0x7f001806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:28.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.462+0000 7f0016000640 1 -- 172.21.15.137:0/1471306672 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0018075a40 con 0x7f001815fe10 2024-04-26T23:43:28.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.462+0000 7f0016a00640 1 --2- 172.21.15.137:0/1471306672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00180b01c0 0x7f0018070900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:43:28.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.462+0000 7f0015600640 1 -- 172.21.15.137:0/1471306672 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3022351109 0 0) 0x7f0018075760 con 0x7f0018160270 2024-04-26T23:43:28.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.466+0000 7f0016000640 1 --2- 172.21.15.137:0/1471306672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f001815fe10 0x7f00180b0930 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f00040097f0 tx=0x7f000401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc144446bce2e04 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:28.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.466+0000 7f0015600640 1 -- 172.21.15.137:0/1471306672 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00040b0070 con 0x7f001815fe10 2024-04-26T23:43:28.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.466+0000 7f0015600640 1 -- 172.21.15.137:0/1471306672 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00040ab600 con 0x7f001815fe10 2024-04-26T23:43:28.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.466+0000 7f0015600640 1 -- 172.21.15.137:0/1471306672 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00040ab9d0 con 0x7f001815fe10 2024-04-26T23:43:28.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.466+0000 7f0017e00640 1 -- 172.21.15.137:0/1471306672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f001815fe10 msgr2=0x7f00180b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:28.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.466+0000 7f0017e00640 1 --2- 172.21.15.137:0/1471306672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f001815fe10 0x7f00180b0930 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f00040097f0 tx=0x7f000401c410 comp rx=0 tx=0).stop 2024-04-26T23:43:28.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.466+0000 7f0017e00640 1 -- 172.21.15.137:0/1471306672 shutdown_connections 2024-04-26T23:43:28.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.466+0000 7f0017e00640 1 --2- 172.21.15.137:0/1471306672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f001815fe10 0x7f00180b0930 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.466+0000 7f0017e00640 1 --2- 172.21.15.137:0/1471306672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00180b01c0 0x7f0018070900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.466+0000 7f0017e00640 1 -- 172.21.15.137:0/1471306672 >> 172.21.15.137:0/1471306672 conn(0x7f00180d1b90 msgr2=0x7f00180d1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:28.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.466+0000 7f0017e00640 1 -- 172.21.15.137:0/1471306672 shutdown_connections 2024-04-26T23:43:28.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.466+0000 7f0017e00640 1 -- 172.21.15.137:0/1471306672 wait complete. 2024-04-26T23:43:28.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.466+0000 7f0017e00640 1 Processor -- start 2024-04-26T23:43:28.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.466+0000 7f0017e00640 1 -- start start 2024-04-26T23:43:28.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f0017e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00180b01c0 0x7f00181571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:28.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f0017e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f001815fe10 0x7f001813f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:28.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f0017e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0018160270 0x7f0018154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:28.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f0017e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f00180b1280 con 0x7f00180b01c0 2024-04-26T23:43:28.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f0017e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f001815f980 con 0x7f0018160270 2024-04-26T23:43:28.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f0017e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0018075380 con 0x7f001815fe10 2024-04-26T23:43:28.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f0016a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00180b01c0 0x7f00181571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:28.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f0016a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00180b01c0 0x7f00181571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54946/0 (socket says 172.21.15.137:54946) 2024-04-26T23:43:28.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f0016a00640 1 -- 172.21.15.137:0/3457840039 learned_addr learned my addr 172.21.15.137:0/3457840039 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:28.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f0016000640 1 --2- 172.21.15.137:0/3457840039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f001815fe10 0x7f001813f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:28.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f0017400640 1 --2- 172.21.15.137:0/3457840039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0018160270 0x7f0018154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:28.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f0016a00640 1 -- 172.21.15.137:0/3457840039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f001815fe10 msgr2=0x7f001813f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:28.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f0016a00640 1 --2- 172.21.15.137:0/3457840039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f001815fe10 0x7f001813f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f0016a00640 1 -- 172.21.15.137:0/3457840039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0018160270 msgr2=0x7f0018154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:28.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f0016a00640 1 --2- 172.21.15.137:0/3457840039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0018160270 0x7f0018154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f0016a00640 1 -- 172.21.15.137:0/3457840039 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0018159a00 con 0x7f00180b01c0 2024-04-26T23:43:28.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f0016a00640 1 --2- 172.21.15.137:0/3457840039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00180b01c0 0x7f00181571e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f000800c7f0 tx=0x7f000800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:28.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f000ea00640 1 -- 172.21.15.137:0/3457840039 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0008015070 con 0x7f00180b01c0 2024-04-26T23:43:28.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f000ea00640 1 -- 172.21.15.137:0/3457840039 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00080077c0 con 0x7f00180b01c0 2024-04-26T23:43:28.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f000ea00640 1 -- 172.21.15.137:0/3457840039 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0008007bb0 con 0x7f00180b01c0 2024-04-26T23:43:28.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f0017e00640 1 -- 172.21.15.137:0/3457840039 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0018159ca0 con 0x7f00180b01c0 2024-04-26T23:43:28.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f0017e00640 1 -- 172.21.15.137:0/3457840039 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f001815a260 con 0x7f00180b01c0 2024-04-26T23:43:28.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f0017e00640 1 -- 172.21.15.137:0/3457840039 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f001806a410 con 0x7f00180b01c0 2024-04-26T23:43:28.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.470+0000 7f000ea00640 1 -- 172.21.15.137:0/3457840039 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0008018070 con 0x7f00180b01c0 2024-04-26T23:43:28.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.474+0000 7f000ea00640 1 --2- 172.21.15.137:0/3457840039 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efff8068380 0x7efff806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:28.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.474+0000 7f000ea00640 1 -- 172.21.15.137:0/3457840039 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f0008086a60 con 0x7f00180b01c0 2024-04-26T23:43:28.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.474+0000 7f0016000640 1 --2- 172.21.15.137:0/3457840039 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efff8068380 0x7efff806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:28.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.474+0000 7f0016000640 1 --2- 172.21.15.137:0/3457840039 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efff8068380 0x7efff806a840 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f00040ad000 tx=0x7f00040a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:28.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.478+0000 7f000ea00640 1 -- 172.21.15.137:0/3457840039 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0008057010 con 0x7f00180b01c0 2024-04-26T23:43:28.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.630+0000 7f0017e00640 1 -- 172.21.15.137:0/3457840039 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f00180b3620 con 0x7efff8068380 2024-04-26T23:43:28.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.634+0000 7f000ea00640 1 -- 172.21.15.137:0/3457840039 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251923 (secure 0 0 0) 0x7f00180b3620 con 0x7efff8068380 2024-04-26T23:43:28.645 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:28.647 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T23:43:28.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.638+0000 7f0017e00640 1 -- 172.21.15.137:0/3457840039 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efff8068380 msgr2=0x7efff806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:28.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.638+0000 7f0017e00640 1 --2- 172.21.15.137:0/3457840039 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efff8068380 0x7efff806a840 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f00040ad000 tx=0x7f00040a6000 comp rx=0 tx=0).stop 2024-04-26T23:43:28.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.638+0000 7f0017e00640 1 -- 172.21.15.137:0/3457840039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00180b01c0 msgr2=0x7f00181571e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:28.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.638+0000 7f0017e00640 1 --2- 172.21.15.137:0/3457840039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00180b01c0 0x7f00181571e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f000800c7f0 tx=0x7f000800ccb0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.638+0000 7f0017e00640 1 -- 172.21.15.137:0/3457840039 shutdown_connections 2024-04-26T23:43:28.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.638+0000 7f0017e00640 1 --2- 172.21.15.137:0/3457840039 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efff8068380 0x7efff806a840 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.638+0000 7f0017e00640 1 --2- 172.21.15.137:0/3457840039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0018160270 0x7f0018154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.638+0000 7f0017e00640 1 --2- 172.21.15.137:0/3457840039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f001815fe10 0x7f001813f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.638+0000 7f0017e00640 1 --2- 172.21.15.137:0/3457840039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00180b01c0 0x7f00181571e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.638+0000 7f0017e00640 1 -- 172.21.15.137:0/3457840039 >> 172.21.15.137:0/3457840039 conn(0x7f00180d1b90 msgr2=0x7f00181560b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:28.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.638+0000 7f0017e00640 1 -- 172.21.15.137:0/3457840039 shutdown_connections 2024-04-26T23:43:28.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.638+0000 7f0017e00640 1 -- 172.21.15.137:0/3457840039 wait complete. 2024-04-26T23:43:28.666 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2024-04-26T23:43:27.614607+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238068,"kb_used_data":5268,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736652,"statfs":{"total":773094113280,"available":772850331648,"internally_reserved":0,"allocated":5394432,"data_stored":2862504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.426813"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.233757+0000","last_change":"2024-04-26T23:43:24.230030+0000","last_active":"2024-04-26T23:43:24.233757+0000","last_peered":"2024-04-26T23:43:24.233757+0000","last_clean":"2024-04-26T23:43:24.233757+0000","last_became_active":"2024-04-26T23:43:24.229747+0000","last_became_peered":"2024-04-26T23:43:24.229747+0000","last_unstale":"2024-04-26T23:43:24.233757+0000","last_undegraded":"2024-04-26T23:43:24.233757+0000","last_fullsized":"2024-04-26T23:43:24.233757+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:37.389687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.224001+0000","last_change":"2024-04-26T23:43:24.230835+0000","last_active":"2024-04-26T23:43:25.224001+0000","last_peered":"2024-04-26T23:43:25.224001+0000","last_clean":"2024-04-26T23:43:25.224001+0000","last_became_active":"2024-04-26T23:43:24.230201+0000","last_became_peered":"2024-04-26T23:43:24.230201+0000","last_unstale":"2024-04-26T23:43:25.224001+0000","last_undegraded":"2024-04-26T23:43:25.224001+0000","last_fullsized":"2024-04-26T23:43:25.224001+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:47:47.195724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.222764+0000","last_change":"2024-04-26T23:43:24.229916+0000","last_active":"2024-04-26T23:43:25.222764+0000","last_peered":"2024-04-26T23:43:25.222764+0000","last_clean":"2024-04-26T23:43:25.222764+0000","last_became_active":"2024-04-26T23:43:24.229648+0000","last_became_peered":"2024-04-26T23:43:24.229648+0000","last_unstale":"2024-04-26T23:43:25.222764+0000","last_undegraded":"2024-04-26T23:43:25.222764+0000","last_fullsized":"2024-04-26T23:43:25.222764+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:54.898662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.228039+0000","last_change":"2024-04-26T23:43:24.225398+0000","last_active":"2024-04-26T23:43:24.228039+0000","last_peered":"2024-04-26T23:43:24.228039+0000","last_clean":"2024-04-26T23:43:24.228039+0000","last_became_active":"2024-04-26T23:43:24.225085+0000","last_became_peered":"2024-04-26T23:43:24.225085+0000","last_unstale":"2024-04-26T23:43:24.228039+0000","last_undegraded":"2024-04-26T23:43:24.228039+0000","last_fullsized":"2024-04-26T23:43:24.228039+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:24.760856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223733+0000","last_change":"2024-04-26T23:43:24.231314+0000","last_active":"2024-04-26T23:43:25.223733+0000","last_peered":"2024-04-26T23:43:25.223733+0000","last_clean":"2024-04-26T23:43:25.223733+0000","last_became_active":"2024-04-26T23:43:24.231012+0000","last_became_peered":"2024-04-26T23:43:24.231012+0000","last_unstale":"2024-04-26T23:43:25.223733+0000","last_undegraded":"2024-04-26T23:43:25.223733+0000","last_fullsized":"2024-04-26T23:43:25.223733+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:44:28.807293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240669+0000","last_change":"2024-04-26T23:43:24.235059+0000","last_active":"2024-04-26T23:43:25.240669+0000","last_peered":"2024-04-26T23:43:25.240669+0000","last_clean":"2024-04-26T23:43:25.240669+0000","last_became_active":"2024-04-26T23:43:24.231774+0000","last_became_peered":"2024-04-26T23:43:24.231774+0000","last_unstale":"2024-04-26T23:43:25.240669+0000","last_undegraded":"2024-04-26T23:43:25.240669+0000","last_fullsized":"2024-04-26T23:43:25.240669+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:29.184834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.235868+0000","last_change":"2024-04-26T23:43:24.234192+0000","last_active":"2024-04-26T23:43:24.235868+0000","last_peered":"2024-04-26T23:43:24.235868+0000","last_clean":"2024-04-26T23:43:24.235868+0000","last_became_active":"2024-04-26T23:43:24.233780+0000","last_became_peered":"2024-04-26T23:43:24.233780+0000","last_unstale":"2024-04-26T23:43:24.235868+0000","last_undegraded":"2024-04-26T23:43:24.235868+0000","last_fullsized":"2024-04-26T23:43:24.235868+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:44:28.807293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.231534+0000","last_change":"2024-04-26T23:43:24.226379+0000","last_active":"2024-04-26T23:43:24.231534+0000","last_peered":"2024-04-26T23:43:24.231534+0000","last_clean":"2024-04-26T23:43:24.231534+0000","last_became_active":"2024-04-26T23:43:24.225759+0000","last_became_peered":"2024-04-26T23:43:24.225759+0000","last_unstale":"2024-04-26T23:43:24.231534+0000","last_undegraded":"2024-04-26T23:43:24.231534+0000","last_fullsized":"2024-04-26T23:43:24.231534+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:14.970501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.246475+0000","last_change":"2024-04-26T23:43:24.241793+0000","last_active":"2024-04-26T23:43:24.246475+0000","last_peered":"2024-04-26T23:43:24.246475+0000","last_clean":"2024-04-26T23:43:24.246475+0000","last_became_active":"2024-04-26T23:43:24.240474+0000","last_became_peered":"2024-04-26T23:43:24.240474+0000","last_unstale":"2024-04-26T23:43:24.246475+0000","last_undegraded":"2024-04-26T23:43:24.246475+0000","last_fullsized":"2024-04-26T23:43:24.246475+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:12.146041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.240897+0000","last_change":"2024-04-26T23:43:24.227153+0000","last_active":"2024-04-26T23:43:24.240897+0000","last_peered":"2024-04-26T23:43:24.240897+0000","last_clean":"2024-04-26T23:43:24.240897+0000","last_became_active":"2024-04-26T23:43:24.226808+0000","last_became_peered":"2024-04-26T23:43:24.226808+0000","last_unstale":"2024-04-26T23:43:24.240897+0000","last_undegraded":"2024-04-26T23:43:24.240897+0000","last_fullsized":"2024-04-26T23:43:24.240897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:00.359183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.242298+0000","last_change":"2024-04-26T23:43:24.235012+0000","last_active":"2024-04-26T23:43:24.242298+0000","last_peered":"2024-04-26T23:43:24.242298+0000","last_clean":"2024-04-26T23:43:24.242298+0000","last_became_active":"2024-04-26T23:43:24.234727+0000","last_became_peered":"2024-04-26T23:43:24.234727+0000","last_unstale":"2024-04-26T23:43:24.242298+0000","last_undegraded":"2024-04-26T23:43:24.242298+0000","last_fullsized":"2024-04-26T23:43:24.242298+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:37:16.843601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223983+0000","last_change":"2024-04-26T23:43:24.231753+0000","last_active":"2024-04-26T23:43:25.223983+0000","last_peered":"2024-04-26T23:43:25.223983+0000","last_clean":"2024-04-26T23:43:25.223983+0000","last_became_active":"2024-04-26T23:43:24.231278+0000","last_became_peered":"2024-04-26T23:43:24.231278+0000","last_unstale":"2024-04-26T23:43:25.223983+0000","last_undegraded":"2024-04-26T23:43:25.223983+0000","last_fullsized":"2024-04-26T23:43:25.223983+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:19:39.351368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.220973+0000","last_change":"2024-04-26T23:43:24.236735+0000","last_active":"2024-04-26T23:43:25.220973+0000","last_peered":"2024-04-26T23:43:25.220973+0000","last_clean":"2024-04-26T23:43:25.220973+0000","last_became_active":"2024-04-26T23:43:24.236377+0000","last_became_peered":"2024-04-26T23:43:24.236377+0000","last_unstale":"2024-04-26T23:43:25.220973+0000","last_undegraded":"2024-04-26T23:43:25.220973+0000","last_fullsized":"2024-04-26T23:43:25.220973+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:17:36.342022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.240861+0000","last_change":"2024-04-26T23:43:24.233270+0000","last_active":"2024-04-26T23:43:24.240861+0000","last_peered":"2024-04-26T23:43:24.240861+0000","last_clean":"2024-04-26T23:43:24.240861+0000","last_became_active":"2024-04-26T23:43:24.232829+0000","last_became_peered":"2024-04-26T23:43:24.232829+0000","last_unstale":"2024-04-26T23:43:24.240861+0000","last_undegraded":"2024-04-26T23:43:24.240861+0000","last_fullsized":"2024-04-26T23:43:24.240861+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:26.840281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240465+0000","last_change":"2024-04-26T23:43:24.231213+0000","last_active":"2024-04-26T23:43:25.240465+0000","last_peered":"2024-04-26T23:43:25.240465+0000","last_clean":"2024-04-26T23:43:25.240465+0000","last_became_active":"2024-04-26T23:43:24.230927+0000","last_became_peered":"2024-04-26T23:43:24.230927+0000","last_unstale":"2024-04-26T23:43:25.240465+0000","last_undegraded":"2024-04-26T23:43:25.240465+0000","last_fullsized":"2024-04-26T23:43:25.240465+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:22.850762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.235337+0000","last_change":"2024-04-26T23:43:24.229593+0000","last_active":"2024-04-26T23:43:24.235337+0000","last_peered":"2024-04-26T23:43:24.235337+0000","last_clean":"2024-04-26T23:43:24.235337+0000","last_became_active":"2024-04-26T23:43:24.229225+0000","last_became_peered":"2024-04-26T23:43:24.229225+0000","last_unstale":"2024-04-26T23:43:24.235337+0000","last_undegraded":"2024-04-26T23:43:24.235337+0000","last_fullsized":"2024-04-26T23:43:24.235337+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:17:36.342022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223128+0000","last_change":"2024-04-26T23:43:24.225858+0000","last_active":"2024-04-26T23:43:25.223128+0000","last_peered":"2024-04-26T23:43:25.223128+0000","last_clean":"2024-04-26T23:43:25.223128+0000","last_became_active":"2024-04-26T23:43:24.225319+0000","last_became_peered":"2024-04-26T23:43:24.225319+0000","last_unstale":"2024-04-26T23:43:25.223128+0000","last_undegraded":"2024-04-26T23:43:25.223128+0000","last_fullsized":"2024-04-26T23:43:25.223128+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:23:28.974276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223110+0000","last_change":"2024-04-26T23:43:24.233249+0000","last_active":"2024-04-26T23:43:25.223110+0000","last_peered":"2024-04-26T23:43:25.223110+0000","last_clean":"2024-04-26T23:43:25.223110+0000","last_became_active":"2024-04-26T23:43:24.232962+0000","last_became_peered":"2024-04-26T23:43:24.232962+0000","last_unstale":"2024-04-26T23:43:25.223110+0000","last_undegraded":"2024-04-26T23:43:25.223110+0000","last_fullsized":"2024-04-26T23:43:25.223110+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:08.065863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.235400+0000","last_change":"2024-04-26T23:43:24.230256+0000","last_active":"2024-04-26T23:43:24.235400+0000","last_peered":"2024-04-26T23:43:24.235400+0000","last_clean":"2024-04-26T23:43:24.235400+0000","last_became_active":"2024-04-26T23:43:24.229970+0000","last_became_peered":"2024-04-26T23:43:24.229970+0000","last_unstale":"2024-04-26T23:43:24.235400+0000","last_undegraded":"2024-04-26T23:43:24.235400+0000","last_fullsized":"2024-04-26T23:43:24.235400+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:00:10.429420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.221216+0000","last_change":"2024-04-26T23:43:24.230632+0000","last_active":"2024-04-26T23:43:25.221216+0000","last_peered":"2024-04-26T23:43:25.221216+0000","last_clean":"2024-04-26T23:43:25.221216+0000","last_became_active":"2024-04-26T23:43:24.226284+0000","last_became_peered":"2024-04-26T23:43:24.226284+0000","last_unstale":"2024-04-26T23:43:25.221216+0000","last_undegraded":"2024-04-26T23:43:25.221216+0000","last_fullsized":"2024-04-26T23:43:25.221216+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:00:10.429420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240694+0000","last_change":"2024-04-26T23:43:24.231426+0000","last_active":"2024-04-26T23:43:25.240694+0000","last_peered":"2024-04-26T23:43:25.240694+0000","last_clean":"2024-04-26T23:43:25.240694+0000","last_became_active":"2024-04-26T23:43:24.231204+0000","last_became_peered":"2024-04-26T23:43:24.231204+0000","last_unstale":"2024-04-26T23:43:25.240694+0000","last_undegraded":"2024-04-26T23:43:25.240694+0000","last_fullsized":"2024-04-26T23:43:25.240694+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:18:30.564984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.240070+0000","last_change":"2024-04-26T23:43:24.226983+0000","last_active":"2024-04-26T23:43:24.240070+0000","last_peered":"2024-04-26T23:43:24.240070+0000","last_clean":"2024-04-26T23:43:24.240070+0000","last_became_active":"2024-04-26T23:43:24.226652+0000","last_became_peered":"2024-04-26T23:43:24.226652+0000","last_unstale":"2024-04-26T23:43:24.240070+0000","last_undegraded":"2024-04-26T23:43:24.240070+0000","last_fullsized":"2024-04-26T23:43:24.240070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:29.521126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.235984+0000","last_change":"2024-04-26T23:43:24.232811+0000","last_active":"2024-04-26T23:43:24.235984+0000","last_peered":"2024-04-26T23:43:24.235984+0000","last_clean":"2024-04-26T23:43:24.235984+0000","last_became_active":"2024-04-26T23:43:24.232538+0000","last_became_peered":"2024-04-26T23:43:24.232538+0000","last_unstale":"2024-04-26T23:43:24.235984+0000","last_undegraded":"2024-04-26T23:43:24.235984+0000","last_fullsized":"2024-04-26T23:43:24.235984+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:57.550494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.233116+0000","last_change":"2024-04-26T23:43:24.226223+0000","last_active":"2024-04-26T23:43:24.233116+0000","last_peered":"2024-04-26T23:43:24.233116+0000","last_clean":"2024-04-26T23:43:24.233116+0000","last_became_active":"2024-04-26T23:43:24.225937+0000","last_became_peered":"2024-04-26T23:43:24.225937+0000","last_unstale":"2024-04-26T23:43:24.233116+0000","last_undegraded":"2024-04-26T23:43:24.233116+0000","last_fullsized":"2024-04-26T23:43:24.233116+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:41.575445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.240002+0000","last_change":"2024-04-26T23:43:24.238447+0000","last_active":"2024-04-26T23:43:24.240002+0000","last_peered":"2024-04-26T23:43:24.240002+0000","last_clean":"2024-04-26T23:43:24.240002+0000","last_became_active":"2024-04-26T23:43:24.238161+0000","last_became_peered":"2024-04-26T23:43:24.238161+0000","last_unstale":"2024-04-26T23:43:24.240002+0000","last_undegraded":"2024-04-26T23:43:24.240002+0000","last_fullsized":"2024-04-26T23:43:24.240002+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:24.760856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.221161+0000","last_change":"2024-04-26T23:43:24.234451+0000","last_active":"2024-04-26T23:43:25.221161+0000","last_peered":"2024-04-26T23:43:25.221161+0000","last_clean":"2024-04-26T23:43:25.221161+0000","last_became_active":"2024-04-26T23:43:24.233305+0000","last_became_peered":"2024-04-26T23:43:24.233305+0000","last_unstale":"2024-04-26T23:43:25.221161+0000","last_undegraded":"2024-04-26T23:43:25.221161+0000","last_fullsized":"2024-04-26T23:43:25.221161+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:22.904809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.222819+0000","last_change":"2024-04-26T23:43:24.225839+0000","last_active":"2024-04-26T23:43:25.222819+0000","last_peered":"2024-04-26T23:43:25.222819+0000","last_clean":"2024-04-26T23:43:25.222819+0000","last_became_active":"2024-04-26T23:43:24.225515+0000","last_became_peered":"2024-04-26T23:43:24.225515+0000","last_unstale":"2024-04-26T23:43:25.222819+0000","last_undegraded":"2024-04-26T23:43:25.222819+0000","last_fullsized":"2024-04-26T23:43:25.222819+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:46.151679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223976+0000","last_change":"2024-04-26T23:43:24.231638+0000","last_active":"2024-04-26T23:43:25.223976+0000","last_peered":"2024-04-26T23:43:25.223976+0000","last_clean":"2024-04-26T23:43:25.223976+0000","last_became_active":"2024-04-26T23:43:24.230826+0000","last_became_peered":"2024-04-26T23:43:24.230826+0000","last_unstale":"2024-04-26T23:43:25.223976+0000","last_undegraded":"2024-04-26T23:43:25.223976+0000","last_fullsized":"2024-04-26T23:43:25.223976+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:23:28.974276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.238036+0000","last_change":"2024-04-26T23:43:24.236559+0000","last_active":"2024-04-26T23:43:24.238036+0000","last_peered":"2024-04-26T23:43:24.238036+0000","last_clean":"2024-04-26T23:43:24.238036+0000","last_became_active":"2024-04-26T23:43:24.236220+0000","last_became_peered":"2024-04-26T23:43:24.236220+0000","last_unstale":"2024-04-26T23:43:24.238036+0000","last_undegraded":"2024-04-26T23:43:24.238036+0000","last_fullsized":"2024-04-26T23:43:24.238036+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:24:46.924266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.222711+0000","last_change":"2024-04-26T23:43:24.235776+0000","last_active":"2024-04-26T23:43:25.222711+0000","last_peered":"2024-04-26T23:43:25.222711+0000","last_clean":"2024-04-26T23:43:25.222711+0000","last_became_active":"2024-04-26T23:43:24.235516+0000","last_became_peered":"2024-04-26T23:43:24.235516+0000","last_unstale":"2024-04-26T23:43:25.222711+0000","last_undegraded":"2024-04-26T23:43:25.222711+0000","last_fullsized":"2024-04-26T23:43:25.222711+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:39:31.580031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240512+0000","last_change":"2024-04-26T23:43:24.230430+0000","last_active":"2024-04-26T23:43:25.240512+0000","last_peered":"2024-04-26T23:43:25.240512+0000","last_clean":"2024-04-26T23:43:25.240512+0000","last_became_active":"2024-04-26T23:43:24.229848+0000","last_became_peered":"2024-04-26T23:43:24.229848+0000","last_unstale":"2024-04-26T23:43:25.240512+0000","last_undegraded":"2024-04-26T23:43:25.240512+0000","last_fullsized":"2024-04-26T23:43:25.240512+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:53.392835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.220912+0000","last_change":"2024-04-26T23:43:24.228989+0000","last_active":"2024-04-26T23:43:25.220912+0000","last_peered":"2024-04-26T23:43:25.220912+0000","last_clean":"2024-04-26T23:43:25.220912+0000","last_became_active":"2024-04-26T23:43:24.228730+0000","last_became_peered":"2024-04-26T23:43:24.228730+0000","last_unstale":"2024-04-26T23:43:25.220912+0000","last_undegraded":"2024-04-26T23:43:25.220912+0000","last_fullsized":"2024-04-26T23:43:25.220912+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:49:11.174508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.239478+0000","last_change":"2024-04-26T23:43:24.232444+0000","last_active":"2024-04-26T23:43:24.239478+0000","last_peered":"2024-04-26T23:43:24.239478+0000","last_clean":"2024-04-26T23:43:24.239478+0000","last_became_active":"2024-04-26T23:43:24.232164+0000","last_became_peered":"2024-04-26T23:43:24.232164+0000","last_unstale":"2024-04-26T23:43:24.239478+0000","last_undegraded":"2024-04-26T23:43:24.239478+0000","last_fullsized":"2024-04-26T23:43:24.239478+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:47:30.057297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.241074+0000","last_change":"2024-04-26T23:43:23.213558+0000","last_active":"2024-04-26T23:43:25.241074+0000","last_peered":"2024-04-26T23:43:25.241074+0000","last_clean":"2024-04-26T23:43:25.241074+0000","last_became_active":"2024-04-26T23:43:23.213317+0000","last_became_peered":"2024-04-26T23:43:23.213317+0000","last_unstale":"2024-04-26T23:43:25.241074+0000","last_undegraded":"2024-04-26T23:43:25.241074+0000","last_fullsized":"2024-04-26T23:43:25.241074+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:01:02.104398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.224949+0000","last_change":"2024-04-26T23:43:24.223928+0000","last_active":"2024-04-26T23:43:24.224949+0000","last_peered":"2024-04-26T23:43:24.224949+0000","last_clean":"2024-04-26T23:43:24.224949+0000","last_became_active":"2024-04-26T23:43:24.223595+0000","last_became_peered":"2024-04-26T23:43:24.223595+0000","last_unstale":"2024-04-26T23:43:24.224949+0000","last_undegraded":"2024-04-26T23:43:24.224949+0000","last_fullsized":"2024-04-26T23:43:24.224949+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:54.472519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223281+0000","last_change":"2024-04-26T23:43:23.215426+0000","last_active":"2024-04-26T23:43:25.223281+0000","last_peered":"2024-04-26T23:43:25.223281+0000","last_clean":"2024-04-26T23:43:25.223281+0000","last_became_active":"2024-04-26T23:43:23.214798+0000","last_became_peered":"2024-04-26T23:43:23.214798+0000","last_unstale":"2024-04-26T23:43:25.223281+0000","last_undegraded":"2024-04-26T23:43:25.223281+0000","last_fullsized":"2024-04-26T23:43:25.223281+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:23.754123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.224110+0000","last_change":"2024-04-26T23:43:24.231510+0000","last_active":"2024-04-26T23:43:25.224110+0000","last_peered":"2024-04-26T23:43:25.224110+0000","last_clean":"2024-04-26T23:43:25.224110+0000","last_became_active":"2024-04-26T23:43:24.228306+0000","last_became_peered":"2024-04-26T23:43:24.228306+0000","last_unstale":"2024-04-26T23:43:25.224110+0000","last_undegraded":"2024-04-26T23:43:25.224110+0000","last_fullsized":"2024-04-26T23:43:25.224110+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:29:16.961750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.248034+0000","last_change":"2024-04-26T23:43:23.217674+0000","last_active":"2024-04-26T23:43:24.248034+0000","last_peered":"2024-04-26T23:43:24.248034+0000","last_clean":"2024-04-26T23:43:24.248034+0000","last_became_active":"2024-04-26T23:43:23.217367+0000","last_became_peered":"2024-04-26T23:43:23.217367+0000","last_unstale":"2024-04-26T23:43:24.248034+0000","last_undegraded":"2024-04-26T23:43:24.248034+0000","last_fullsized":"2024-04-26T23:43:24.248034+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:59.352451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.239534+0000","last_change":"2024-04-26T23:43:24.232366+0000","last_active":"2024-04-26T23:43:24.239534+0000","last_peered":"2024-04-26T23:43:24.239534+0000","last_clean":"2024-04-26T23:43:24.239534+0000","last_became_active":"2024-04-26T23:43:24.232060+0000","last_became_peered":"2024-04-26T23:43:24.232060+0000","last_unstale":"2024-04-26T23:43:24.239534+0000","last_undegraded":"2024-04-26T23:43:24.239534+0000","last_fullsized":"2024-04-26T23:43:24.239534+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:40:04.393689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.244273+0000","last_change":"2024-04-26T23:43:23.215339+0000","last_active":"2024-04-26T23:43:24.244273+0000","last_peered":"2024-04-26T23:43:24.244273+0000","last_clean":"2024-04-26T23:43:24.244273+0000","last_became_active":"2024-04-26T23:43:23.215010+0000","last_became_peered":"2024-04-26T23:43:23.215010+0000","last_unstale":"2024-04-26T23:43:24.244273+0000","last_undegraded":"2024-04-26T23:43:24.244273+0000","last_fullsized":"2024-04-26T23:43:24.244273+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:11.139308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.222895+0000","last_change":"2024-04-26T23:43:24.226015+0000","last_active":"2024-04-26T23:43:25.222895+0000","last_peered":"2024-04-26T23:43:25.222895+0000","last_clean":"2024-04-26T23:43:25.222895+0000","last_became_active":"2024-04-26T23:43:24.225717+0000","last_became_peered":"2024-04-26T23:43:24.225717+0000","last_unstale":"2024-04-26T23:43:25.222895+0000","last_undegraded":"2024-04-26T23:43:25.222895+0000","last_fullsized":"2024-04-26T23:43:25.222895+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:01:03.111130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240769+0000","last_change":"2024-04-26T23:43:23.207365+0000","last_active":"2024-04-26T23:43:25.240769+0000","last_peered":"2024-04-26T23:43:25.240769+0000","last_clean":"2024-04-26T23:43:25.240769+0000","last_became_active":"2024-04-26T23:43:23.207061+0000","last_became_peered":"2024-04-26T23:43:23.207061+0000","last_unstale":"2024-04-26T23:43:25.240769+0000","last_undegraded":"2024-04-26T23:43:25.240769+0000","last_fullsized":"2024-04-26T23:43:25.240769+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:45.144947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.241169+0000","last_change":"2024-04-26T23:43:24.229533+0000","last_active":"2024-04-26T23:43:24.241169+0000","last_peered":"2024-04-26T23:43:24.241169+0000","last_clean":"2024-04-26T23:43:24.241169+0000","last_became_active":"2024-04-26T23:43:24.229196+0000","last_became_peered":"2024-04-26T23:43:24.229196+0000","last_unstale":"2024-04-26T23:43:24.241169+0000","last_undegraded":"2024-04-26T23:43:24.241169+0000","last_fullsized":"2024-04-26T23:43:24.241169+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:47:30.057297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.222939+0000","last_change":"2024-04-26T23:43:23.204392+0000","last_active":"2024-04-26T23:43:25.222939+0000","last_peered":"2024-04-26T23:43:25.222939+0000","last_clean":"2024-04-26T23:43:25.222939+0000","last_became_active":"2024-04-26T23:43:23.204069+0000","last_became_peered":"2024-04-26T23:43:23.204069+0000","last_unstale":"2024-04-26T23:43:25.222939+0000","last_undegraded":"2024-04-26T23:43:25.222939+0000","last_fullsized":"2024-04-26T23:43:25.222939+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:28.514394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.231522+0000","last_change":"2024-04-26T23:43:24.226013+0000","last_active":"2024-04-26T23:43:24.231522+0000","last_peered":"2024-04-26T23:43:24.231522+0000","last_clean":"2024-04-26T23:43:24.231522+0000","last_became_active":"2024-04-26T23:43:24.225434+0000","last_became_peered":"2024-04-26T23:43:24.225434+0000","last_unstale":"2024-04-26T23:43:24.231522+0000","last_undegraded":"2024-04-26T23:43:24.231522+0000","last_fullsized":"2024-04-26T23:43:24.231522+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:02.098089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223433+0000","last_change":"2024-04-26T23:43:23.216757+0000","last_active":"2024-04-26T23:43:25.223433+0000","last_peered":"2024-04-26T23:43:25.223433+0000","last_clean":"2024-04-26T23:43:25.223433+0000","last_became_active":"2024-04-26T23:43:23.216381+0000","last_became_peered":"2024-04-26T23:43:23.216381+0000","last_unstale":"2024-04-26T23:43:25.223433+0000","last_undegraded":"2024-04-26T23:43:25.223433+0000","last_fullsized":"2024-04-26T23:43:25.223433+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:47:29.050565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.235273+0000","last_change":"2024-04-26T23:43:24.229052+0000","last_active":"2024-04-26T23:43:24.235273+0000","last_peered":"2024-04-26T23:43:24.235273+0000","last_clean":"2024-04-26T23:43:24.235273+0000","last_became_active":"2024-04-26T23:43:24.228696+0000","last_became_peered":"2024-04-26T23:43:24.228696+0000","last_unstale":"2024-04-26T23:43:24.235273+0000","last_undegraded":"2024-04-26T23:43:24.235273+0000","last_fullsized":"2024-04-26T23:43:24.235273+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:49:11.174508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.219961+0000","last_change":"2024-04-26T23:43:23.216674+0000","last_active":"2024-04-26T23:43:24.219961+0000","last_peered":"2024-04-26T23:43:24.219961+0000","last_clean":"2024-04-26T23:43:24.219961+0000","last_became_active":"2024-04-26T23:43:23.216418+0000","last_became_peered":"2024-04-26T23:43:23.216418+0000","last_unstale":"2024-04-26T23:43:24.219961+0000","last_undegraded":"2024-04-26T23:43:24.219961+0000","last_fullsized":"2024-04-26T23:43:24.219961+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:21.898077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223120+0000","last_change":"2024-04-26T23:43:24.230423+0000","last_active":"2024-04-26T23:43:25.223120+0000","last_peered":"2024-04-26T23:43:25.223120+0000","last_clean":"2024-04-26T23:43:25.223120+0000","last_became_active":"2024-04-26T23:43:24.230164+0000","last_became_peered":"2024-04-26T23:43:24.230164+0000","last_unstale":"2024-04-26T23:43:25.223120+0000","last_undegraded":"2024-04-26T23:43:25.223120+0000","last_fullsized":"2024-04-26T23:43:25.223120+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:44:28.807293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223304+0000","last_change":"2024-04-26T23:43:23.218055+0000","last_active":"2024-04-26T23:43:25.223304+0000","last_peered":"2024-04-26T23:43:25.223304+0000","last_clean":"2024-04-26T23:43:25.223304+0000","last_became_active":"2024-04-26T23:43:23.216993+0000","last_became_peered":"2024-04-26T23:43:23.216993+0000","last_unstale":"2024-04-26T23:43:25.223304+0000","last_undegraded":"2024-04-26T23:43:25.223304+0000","last_fullsized":"2024-04-26T23:43:25.223304+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:13.963768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.224158+0000","last_change":"2024-04-26T23:43:24.218545+0000","last_active":"2024-04-26T23:43:24.224158+0000","last_peered":"2024-04-26T23:43:24.224158+0000","last_clean":"2024-04-26T23:43:24.224158+0000","last_became_active":"2024-04-26T23:43:24.218195+0000","last_became_peered":"2024-04-26T23:43:24.218195+0000","last_unstale":"2024-04-26T23:43:24.224158+0000","last_undegraded":"2024-04-26T23:43:24.224158+0000","last_fullsized":"2024-04-26T23:43:24.224158+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:46.151679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.222778+0000","last_change":"2024-04-26T23:43:23.212372+0000","last_active":"2024-04-26T23:43:24.222778+0000","last_peered":"2024-04-26T23:43:24.222778+0000","last_clean":"2024-04-26T23:43:24.222778+0000","last_became_active":"2024-04-26T23:43:23.212103+0000","last_became_peered":"2024-04-26T23:43:23.212103+0000","last_unstale":"2024-04-26T23:43:24.222778+0000","last_undegraded":"2024-04-26T23:43:24.222778+0000","last_fullsized":"2024-04-26T23:43:24.222778+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:16.132853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240897+0000","last_change":"2024-04-26T23:43:24.239163+0000","last_active":"2024-04-26T23:43:25.240897+0000","last_peered":"2024-04-26T23:43:25.240897+0000","last_clean":"2024-04-26T23:43:25.240897+0000","last_became_active":"2024-04-26T23:43:24.238893+0000","last_became_peered":"2024-04-26T23:43:24.238893+0000","last_unstale":"2024-04-26T23:43:25.240897+0000","last_undegraded":"2024-04-26T23:43:25.240897+0000","last_fullsized":"2024-04-26T23:43:25.240897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:15:11.771640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.244929+0000","last_change":"2024-04-26T23:43:23.214229+0000","last_active":"2024-04-26T23:43:24.244929+0000","last_peered":"2024-04-26T23:43:24.244929+0000","last_clean":"2024-04-26T23:43:24.244929+0000","last_became_active":"2024-04-26T23:43:23.213728+0000","last_became_peered":"2024-04-26T23:43:23.213728+0000","last_unstale":"2024-04-26T23:43:24.244929+0000","last_undegraded":"2024-04-26T23:43:24.244929+0000","last_fullsized":"2024-04-26T23:43:24.244929+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:39:30.573298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.239608+0000","last_change":"2024-04-26T23:43:24.238879+0000","last_active":"2024-04-26T23:43:24.239608+0000","last_peered":"2024-04-26T23:43:24.239608+0000","last_clean":"2024-04-26T23:43:24.239608+0000","last_became_active":"2024-04-26T23:43:24.238363+0000","last_became_peered":"2024-04-26T23:43:24.238363+0000","last_unstale":"2024-04-26T23:43:24.239608+0000","last_undegraded":"2024-04-26T23:43:24.239608+0000","last_fullsized":"2024-04-26T23:43:24.239608+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:23:28.974276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.221203+0000","last_change":"2024-04-26T23:43:23.205978+0000","last_active":"2024-04-26T23:43:25.221203+0000","last_peered":"2024-04-26T23:43:25.221203+0000","last_clean":"2024-04-26T23:43:25.221203+0000","last_became_active":"2024-04-26T23:43:23.205698+0000","last_became_peered":"2024-04-26T23:43:23.205698+0000","last_unstale":"2024-04-26T23:43:25.221203+0000","last_undegraded":"2024-04-26T23:43:25.221203+0000","last_fullsized":"2024-04-26T23:43:25.221203+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:01:00.235383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.236939+0000","last_change":"2024-04-26T23:43:24.235595+0000","last_active":"2024-04-26T23:43:24.236939+0000","last_peered":"2024-04-26T23:43:24.236939+0000","last_clean":"2024-04-26T23:43:24.236939+0000","last_became_active":"2024-04-26T23:43:24.234380+0000","last_became_peered":"2024-04-26T23:43:24.234380+0000","last_unstale":"2024-04-26T23:43:24.236939+0000","last_undegraded":"2024-04-26T23:43:24.236939+0000","last_fullsized":"2024-04-26T23:43:24.236939+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:33.464698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240794+0000","last_change":"2024-04-26T23:43:23.217399+0000","last_active":"2024-04-26T23:43:25.240794+0000","last_peered":"2024-04-26T23:43:25.240794+0000","last_clean":"2024-04-26T23:43:25.240794+0000","last_became_active":"2024-04-26T23:43:23.216472+0000","last_became_peered":"2024-04-26T23:43:23.216472+0000","last_unstale":"2024-04-26T23:43:25.240794+0000","last_undegraded":"2024-04-26T23:43:25.240794+0000","last_fullsized":"2024-04-26T23:43:25.240794+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:36.382955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.241147+0000","last_change":"2024-04-26T23:43:24.229496+0000","last_active":"2024-04-26T23:43:24.241147+0000","last_peered":"2024-04-26T23:43:24.241147+0000","last_clean":"2024-04-26T23:43:24.241147+0000","last_became_active":"2024-04-26T23:43:24.229215+0000","last_became_peered":"2024-04-26T23:43:24.229215+0000","last_unstale":"2024-04-26T23:43:24.241147+0000","last_undegraded":"2024-04-26T23:43:24.241147+0000","last_fullsized":"2024-04-26T23:43:24.241147+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:40:04.393689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.210366+0000","last_change":"2024-04-26T23:43:23.216097+0000","last_active":"2024-04-26T23:43:24.210366+0000","last_peered":"2024-04-26T23:43:24.210366+0000","last_clean":"2024-04-26T23:43:24.210366+0000","last_became_active":"2024-04-26T23:43:23.215773+0000","last_became_peered":"2024-04-26T23:43:23.215773+0000","last_unstale":"2024-04-26T23:43:24.210366+0000","last_undegraded":"2024-04-26T23:43:24.210366+0000","last_fullsized":"2024-04-26T23:43:24.210366+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:25.833549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240436+0000","last_change":"2024-04-26T23:43:24.228890+0000","last_active":"2024-04-26T23:43:25.240436+0000","last_peered":"2024-04-26T23:43:25.240436+0000","last_clean":"2024-04-26T23:43:25.240436+0000","last_became_active":"2024-04-26T23:43:24.228497+0000","last_became_peered":"2024-04-26T23:43:24.228497+0000","last_unstale":"2024-04-26T23:43:25.240436+0000","last_undegraded":"2024-04-26T23:43:25.240436+0000","last_fullsized":"2024-04-26T23:43:25.240436+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:10.196139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240555+0000","last_change":"2024-04-26T23:43:23.216890+0000","last_active":"2024-04-26T23:43:25.240555+0000","last_peered":"2024-04-26T23:43:25.240555+0000","last_clean":"2024-04-26T23:43:25.240555+0000","last_became_active":"2024-04-26T23:43:23.216522+0000","last_became_peered":"2024-04-26T23:43:23.216522+0000","last_unstale":"2024-04-26T23:43:25.240555+0000","last_undegraded":"2024-04-26T23:43:25.240555+0000","last_fullsized":"2024-04-26T23:43:25.240555+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:39:30.573298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.229432+0000","last_change":"2024-04-26T23:43:24.228213+0000","last_active":"2024-04-26T23:43:24.229432+0000","last_peered":"2024-04-26T23:43:24.229432+0000","last_clean":"2024-04-26T23:43:24.229432+0000","last_became_active":"2024-04-26T23:43:24.225062+0000","last_became_peered":"2024-04-26T23:43:24.225062+0000","last_unstale":"2024-04-26T23:43:24.229432+0000","last_undegraded":"2024-04-26T23:43:24.229432+0000","last_fullsized":"2024-04-26T23:43:24.229432+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:01:03.111130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.253975+0000","last_change":"2024-04-26T23:43:23.217879+0000","last_active":"2024-04-26T23:43:24.253975+0000","last_peered":"2024-04-26T23:43:24.253975+0000","last_clean":"2024-04-26T23:43:24.253975+0000","last_became_active":"2024-04-26T23:43:23.217522+0000","last_became_peered":"2024-04-26T23:43:23.217522+0000","last_unstale":"2024-04-26T23:43:24.253975+0000","last_undegraded":"2024-04-26T23:43:24.253975+0000","last_fullsized":"2024-04-26T23:43:24.253975+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:00:09.422688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.221282+0000","last_change":"2024-04-26T23:43:24.223318+0000","last_active":"2024-04-26T23:43:25.221282+0000","last_peered":"2024-04-26T23:43:25.221282+0000","last_clean":"2024-04-26T23:43:25.221282+0000","last_became_active":"2024-04-26T23:43:24.223084+0000","last_became_peered":"2024-04-26T23:43:24.223084+0000","last_unstale":"2024-04-26T23:43:25.221282+0000","last_undegraded":"2024-04-26T23:43:25.221282+0000","last_fullsized":"2024-04-26T23:43:25.221282+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:17.139585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.221279+0000","last_change":"2024-04-26T23:43:23.213620+0000","last_active":"2024-04-26T23:43:25.221279+0000","last_peered":"2024-04-26T23:43:25.221279+0000","last_clean":"2024-04-26T23:43:25.221279+0000","last_became_active":"2024-04-26T23:43:23.210916+0000","last_became_peered":"2024-04-26T23:43:23.210916+0000","last_unstale":"2024-04-26T23:43:25.221279+0000","last_undegraded":"2024-04-26T23:43:25.221279+0000","last_fullsized":"2024-04-26T23:43:25.221279+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:11:56.185920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.240345+0000","last_change":"2024-04-26T23:43:24.228261+0000","last_active":"2024-04-26T23:43:24.240345+0000","last_peered":"2024-04-26T23:43:24.240345+0000","last_clean":"2024-04-26T23:43:24.240345+0000","last_became_active":"2024-04-26T23:43:24.227938+0000","last_became_peered":"2024-04-26T23:43:24.227938+0000","last_unstale":"2024-04-26T23:43:24.240345+0000","last_undegraded":"2024-04-26T23:43:24.240345+0000","last_fullsized":"2024-04-26T23:43:24.240345+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:12:58.041847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223485+0000","last_change":"2024-04-26T23:43:23.216939+0000","last_active":"2024-04-26T23:43:25.223485+0000","last_peered":"2024-04-26T23:43:25.223485+0000","last_clean":"2024-04-26T23:43:25.223485+0000","last_became_active":"2024-04-26T23:43:23.216603+0000","last_became_peered":"2024-04-26T23:43:23.216603+0000","last_unstale":"2024-04-26T23:43:25.223485+0000","last_undegraded":"2024-04-26T23:43:25.223485+0000","last_fullsized":"2024-04-26T23:43:25.223485+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:01.091356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.235946+0000","last_change":"2024-04-26T23:43:24.232488+0000","last_active":"2024-04-26T23:43:24.235946+0000","last_peered":"2024-04-26T23:43:24.235946+0000","last_clean":"2024-04-26T23:43:24.235946+0000","last_became_active":"2024-04-26T23:43:24.231997+0000","last_became_peered":"2024-04-26T23:43:24.231997+0000","last_unstale":"2024-04-26T23:43:24.235946+0000","last_undegraded":"2024-04-26T23:43:24.235946+0000","last_fullsized":"2024-04-26T23:43:24.235946+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:17.139585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223858+0000","last_change":"2024-04-26T23:43:23.219353+0000","last_active":"2024-04-26T23:43:25.223858+0000","last_peered":"2024-04-26T23:43:25.223858+0000","last_clean":"2024-04-26T23:43:25.223858+0000","last_became_active":"2024-04-26T23:43:23.218946+0000","last_became_peered":"2024-04-26T23:43:23.218946+0000","last_unstale":"2024-04-26T23:43:25.223858+0000","last_undegraded":"2024-04-26T23:43:25.223858+0000","last_fullsized":"2024-04-26T23:43:25.223858+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:25.833549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.240021+0000","last_change":"2024-04-26T23:43:24.239205+0000","last_active":"2024-04-26T23:43:24.240021+0000","last_peered":"2024-04-26T23:43:24.240021+0000","last_clean":"2024-04-26T23:43:24.240021+0000","last_became_active":"2024-04-26T23:43:24.238746+0000","last_became_peered":"2024-04-26T23:43:24.238746+0000","last_unstale":"2024-04-26T23:43:24.240021+0000","last_undegraded":"2024-04-26T23:43:24.240021+0000","last_fullsized":"2024-04-26T23:43:24.240021+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:02.098089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240974+0000","last_change":"2024-04-26T23:43:23.212991+0000","last_active":"2024-04-26T23:43:25.240974+0000","last_peered":"2024-04-26T23:43:25.240974+0000","last_clean":"2024-04-26T23:43:25.240974+0000","last_became_active":"2024-04-26T23:43:23.211944+0000","last_became_peered":"2024-04-26T23:43:23.211944+0000","last_unstale":"2024-04-26T23:43:25.240974+0000","last_undegraded":"2024-04-26T23:43:25.240974+0000","last_fullsized":"2024-04-26T23:43:25.240974+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:53.891929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240665+0000","last_change":"2024-04-26T23:43:24.238856+0000","last_active":"2024-04-26T23:43:25.240665+0000","last_peered":"2024-04-26T23:43:25.240665+0000","last_clean":"2024-04-26T23:43:25.240665+0000","last_became_active":"2024-04-26T23:43:24.238593+0000","last_became_peered":"2024-04-26T23:43:24.238593+0000","last_unstale":"2024-04-26T23:43:25.240665+0000","last_undegraded":"2024-04-26T23:43:25.240665+0000","last_fullsized":"2024-04-26T23:43:25.240665+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:14:01.979606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240898+0000","last_change":"2024-04-26T23:43:23.204711+0000","last_active":"2024-04-26T23:43:25.240898+0000","last_peered":"2024-04-26T23:43:25.240898+0000","last_clean":"2024-04-26T23:43:25.240898+0000","last_became_active":"2024-04-26T23:43:23.204410+0000","last_became_peered":"2024-04-26T23:43:23.204410+0000","last_unstale":"2024-04-26T23:43:25.240898+0000","last_undegraded":"2024-04-26T23:43:25.240898+0000","last_fullsized":"2024-04-26T23:43:25.240898+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:44:27.800560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.237065+0000","last_change":"2024-04-26T23:43:24.230587+0000","last_active":"2024-04-26T23:43:24.237065+0000","last_peered":"2024-04-26T23:43:24.237065+0000","last_clean":"2024-04-26T23:43:24.237065+0000","last_became_active":"2024-04-26T23:43:24.230240+0000","last_became_peered":"2024-04-26T23:43:24.230240+0000","last_unstale":"2024-04-26T23:43:24.237065+0000","last_undegraded":"2024-04-26T23:43:24.237065+0000","last_fullsized":"2024-04-26T23:43:24.237065+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:28.622795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223477+0000","last_change":"2024-04-26T23:43:23.217463+0000","last_active":"2024-04-26T23:43:25.223477+0000","last_peered":"2024-04-26T23:43:25.223477+0000","last_clean":"2024-04-26T23:43:25.223477+0000","last_became_active":"2024-04-26T23:43:23.215473+0000","last_became_peered":"2024-04-26T23:43:23.215473+0000","last_unstale":"2024-04-26T23:43:25.223477+0000","last_undegraded":"2024-04-26T23:43:25.223477+0000","last_fullsized":"2024-04-26T23:43:25.223477+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:23.830371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.220903+0000","last_change":"2024-04-26T23:43:24.225447+0000","last_active":"2024-04-26T23:43:25.220903+0000","last_peered":"2024-04-26T23:43:25.220903+0000","last_clean":"2024-04-26T23:43:25.220903+0000","last_became_active":"2024-04-26T23:43:24.225188+0000","last_became_peered":"2024-04-26T23:43:24.225188+0000","last_unstale":"2024-04-26T23:43:25.220903+0000","last_undegraded":"2024-04-26T23:43:25.220903+0000","last_fullsized":"2024-04-26T23:43:25.220903+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:41.575445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.223744+0000","last_change":"2024-04-26T23:43:23.212791+0000","last_active":"2024-04-26T23:43:24.223744+0000","last_peered":"2024-04-26T23:43:24.223744+0000","last_clean":"2024-04-26T23:43:24.223744+0000","last_became_active":"2024-04-26T23:43:23.212484+0000","last_became_peered":"2024-04-26T23:43:23.212484+0000","last_unstale":"2024-04-26T23:43:24.223744+0000","last_undegraded":"2024-04-26T23:43:24.223744+0000","last_fullsized":"2024-04-26T23:43:24.223744+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:32.457966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.240694+0000","last_change":"2024-04-26T23:43:24.233071+0000","last_active":"2024-04-26T23:43:24.240694+0000","last_peered":"2024-04-26T23:43:24.240694+0000","last_clean":"2024-04-26T23:43:24.240694+0000","last_became_active":"2024-04-26T23:43:24.232791+0000","last_became_peered":"2024-04-26T23:43:24.232791+0000","last_unstale":"2024-04-26T23:43:24.240694+0000","last_undegraded":"2024-04-26T23:43:24.240694+0000","last_fullsized":"2024-04-26T23:43:24.240694+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:24.837103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.210227+0000","last_change":"2024-04-26T23:43:23.217511+0000","last_active":"2024-04-26T23:43:24.210227+0000","last_peered":"2024-04-26T23:43:24.210227+0000","last_clean":"2024-04-26T23:43:24.210227+0000","last_became_active":"2024-04-26T23:43:23.217237+0000","last_became_peered":"2024-04-26T23:43:23.217237+0000","last_unstale":"2024-04-26T23:43:24.210227+0000","last_undegraded":"2024-04-26T23:43:24.210227+0000","last_fullsized":"2024-04-26T23:43:24.210227+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:23.830371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.235351+0000","last_change":"2024-04-26T23:43:24.230196+0000","last_active":"2024-04-26T23:43:24.235351+0000","last_peered":"2024-04-26T23:43:24.235351+0000","last_clean":"2024-04-26T23:43:24.235351+0000","last_became_active":"2024-04-26T23:43:24.229798+0000","last_became_peered":"2024-04-26T23:43:24.229798+0000","last_unstale":"2024-04-26T23:43:24.235351+0000","last_undegraded":"2024-04-26T23:43:24.235351+0000","last_fullsized":"2024-04-26T23:43:24.235351+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:22.904809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.242515+0000","last_change":"2024-04-26T23:43:23.210525+0000","last_active":"2024-04-26T23:43:25.242515+0000","last_peered":"2024-04-26T23:43:25.242515+0000","last_clean":"2024-04-26T23:43:25.242515+0000","last_became_active":"2024-04-26T23:43:23.205988+0000","last_became_peered":"2024-04-26T23:43:23.205988+0000","last_unstale":"2024-04-26T23:43:25.242515+0000","last_undegraded":"2024-04-26T23:43:25.242515+0000","last_fullsized":"2024-04-26T23:43:25.242515+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:07.059130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.228020+0000","last_change":"2024-04-26T23:43:24.224432+0000","last_active":"2024-04-26T23:43:24.228020+0000","last_peered":"2024-04-26T23:43:24.228020+0000","last_clean":"2024-04-26T23:43:24.228020+0000","last_became_active":"2024-04-26T23:43:24.224033+0000","last_became_peered":"2024-04-26T23:43:24.224033+0000","last_unstale":"2024-04-26T23:43:24.228020+0000","last_undegraded":"2024-04-26T23:43:24.228020+0000","last_fullsized":"2024-04-26T23:43:24.228020+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:24:46.924266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.212603+0000","last_change":"2024-04-26T23:43:23.213980+0000","last_active":"2024-04-26T23:43:24.212603+0000","last_peered":"2024-04-26T23:43:24.212603+0000","last_clean":"2024-04-26T23:43:24.212603+0000","last_became_active":"2024-04-26T23:43:23.213375+0000","last_became_peered":"2024-04-26T23:43:23.213375+0000","last_unstale":"2024-04-26T23:43:24.212603+0000","last_undegraded":"2024-04-26T23:43:24.212603+0000","last_fullsized":"2024-04-26T23:43:24.212603+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:53.891929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.233658+0000","last_change":"2024-04-26T23:43:24.230836+0000","last_active":"2024-04-26T23:43:24.233658+0000","last_peered":"2024-04-26T23:43:24.233658+0000","last_clean":"2024-04-26T23:43:24.233658+0000","last_became_active":"2024-04-26T23:43:24.230518+0000","last_became_peered":"2024-04-26T23:43:24.230518+0000","last_unstale":"2024-04-26T23:43:24.233658+0000","last_undegraded":"2024-04-26T23:43:24.233658+0000","last_fullsized":"2024-04-26T23:43:24.233658+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:08.065863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.216320+0000","last_change":"2024-04-26T23:43:23.216247+0000","last_active":"2024-04-26T23:43:24.216320+0000","last_peered":"2024-04-26T23:43:24.216320+0000","last_clean":"2024-04-26T23:43:24.216320+0000","last_became_active":"2024-04-26T23:43:23.215960+0000","last_became_peered":"2024-04-26T23:43:23.215960+0000","last_unstale":"2024-04-26T23:43:24.216320+0000","last_undegraded":"2024-04-26T23:43:24.216320+0000","last_fullsized":"2024-04-26T23:43:24.216320+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:12:57.035114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240825+0000","last_change":"2024-04-26T23:43:24.235711+0000","last_active":"2024-04-26T23:43:25.240825+0000","last_peered":"2024-04-26T23:43:25.240825+0000","last_clean":"2024-04-26T23:43:25.240825+0000","last_became_active":"2024-04-26T23:43:24.235445+0000","last_became_peered":"2024-04-26T23:43:24.235445+0000","last_unstale":"2024-04-26T23:43:25.240825+0000","last_undegraded":"2024-04-26T23:43:25.240825+0000","last_fullsized":"2024-04-26T23:43:25.240825+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:46:34.620595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.210972+0000","last_change":"2024-04-26T23:43:23.213480+0000","last_active":"2024-04-26T23:43:24.210972+0000","last_peered":"2024-04-26T23:43:24.210972+0000","last_clean":"2024-04-26T23:43:24.210972+0000","last_became_active":"2024-04-26T23:43:23.213213+0000","last_became_peered":"2024-04-26T23:43:23.213213+0000","last_unstale":"2024-04-26T23:43:24.210972+0000","last_undegraded":"2024-04-26T23:43:24.210972+0000","last_fullsized":"2024-04-26T23:43:24.210972+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:37:15.836868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.240695+0000","last_change":"2024-04-26T23:43:24.242272+0000","last_active":"2024-04-26T23:43:25.240695+0000","last_peered":"2024-04-26T23:43:25.240695+0000","last_clean":"2024-04-26T23:43:25.240695+0000","last_became_active":"2024-04-26T23:43:24.241622+0000","last_became_peered":"2024-04-26T23:43:24.241622+0000","last_unstale":"2024-04-26T23:43:25.240695+0000","last_undegraded":"2024-04-26T23:43:25.240695+0000","last_fullsized":"2024-04-26T23:43:25.240695+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:43:36.834419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.223033+0000","last_change":"2024-04-26T23:43:23.211036+0000","last_active":"2024-04-26T23:43:25.223033+0000","last_peered":"2024-04-26T23:43:25.223033+0000","last_clean":"2024-04-26T23:43:25.223033+0000","last_became_active":"2024-04-26T23:43:23.210683+0000","last_became_peered":"2024-04-26T23:43:23.210683+0000","last_unstale":"2024-04-26T23:43:25.223033+0000","last_undegraded":"2024-04-26T23:43:25.223033+0000","last_fullsized":"2024-04-26T23:43:25.223033+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:59.352451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.222771+0000","last_change":"2024-04-26T23:43:24.233982+0000","last_active":"2024-04-26T23:43:25.222771+0000","last_peered":"2024-04-26T23:43:25.222771+0000","last_clean":"2024-04-26T23:43:25.222771+0000","last_became_active":"2024-04-26T23:43:24.233719+0000","last_became_peered":"2024-04-26T23:43:24.233719+0000","last_unstale":"2024-04-26T23:43:25.222771+0000","last_undegraded":"2024-04-26T23:43:25.222771+0000","last_fullsized":"2024-04-26T23:43:25.222771+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:08.065863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.215388+0000","last_change":"2024-04-26T23:43:23.214905+0000","last_active":"2024-04-26T23:43:24.215388+0000","last_peered":"2024-04-26T23:43:24.215388+0000","last_clean":"2024-04-26T23:43:24.215388+0000","last_became_active":"2024-04-26T23:43:23.214611+0000","last_became_peered":"2024-04-26T23:43:23.214611+0000","last_unstale":"2024-04-26T23:43:24.215388+0000","last_undegraded":"2024-04-26T23:43:24.215388+0000","last_fullsized":"2024-04-26T23:43:24.215388+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:28.514394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.222971+0000","last_change":"2024-04-26T23:43:24.237784+0000","last_active":"2024-04-26T23:43:25.222971+0000","last_peered":"2024-04-26T23:43:25.222971+0000","last_clean":"2024-04-26T23:43:25.222971+0000","last_became_active":"2024-04-26T23:43:24.237433+0000","last_became_peered":"2024-04-26T23:43:24.237433+0000","last_unstale":"2024-04-26T23:43:25.222971+0000","last_undegraded":"2024-04-26T23:43:25.222971+0000","last_fullsized":"2024-04-26T23:43:25.222971+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:37.389687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.223472+0000","last_change":"2024-04-26T23:43:23.217660+0000","last_active":"2024-04-26T23:43:24.223472+0000","last_peered":"2024-04-26T23:43:24.223472+0000","last_clean":"2024-04-26T23:43:24.223472+0000","last_became_active":"2024-04-26T23:43:23.217006+0000","last_became_peered":"2024-04-26T23:43:23.217006+0000","last_unstale":"2024-04-26T23:43:24.223472+0000","last_undegraded":"2024-04-26T23:43:24.223472+0000","last_fullsized":"2024-04-26T23:43:24.223472+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:56.543762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.240917+0000","last_change":"2024-04-26T23:43:24.228799+0000","last_active":"2024-04-26T23:43:24.240917+0000","last_peered":"2024-04-26T23:43:24.240917+0000","last_clean":"2024-04-26T23:43:24.240917+0000","last_became_active":"2024-04-26T23:43:24.227457+0000","last_became_peered":"2024-04-26T23:43:24.227457+0000","last_unstale":"2024-04-26T23:43:24.240917+0000","last_undegraded":"2024-04-26T23:43:24.240917+0000","last_fullsized":"2024-04-26T23:43:24.240917+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:23.187034+0000","last_clean_scrub_stamp":"2024-04-26T23:43:23.187034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:28.622795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T23:43:25.224016+0000","last_change":"2024-04-26T23:43:23.207678+0000","last_active":"2024-04-26T23:43:25.224016+0000","last_peered":"2024-04-26T23:43:25.224016+0000","last_clean":"2024-04-26T23:43:25.224016+0000","last_became_active":"2024-04-26T23:43:23.207418+0000","last_became_peered":"2024-04-26T23:43:23.207418+0000","last_unstale":"2024-04-26T23:43:25.224016+0000","last_undegraded":"2024-04-26T23:43:25.224016+0000","last_fullsized":"2024-04-26T23:43:25.224016+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:43:22.180302+0000","last_clean_scrub_stamp":"2024-04-26T23:43:22.180302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:37:15.836868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":216,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T23:43:24.210091+0000","last_change":"2024-04-26T23:41:12.783987+0000","last_active":"2024-04-26T23:43:24.210091+0000","last_peered":"2024-04-26T23:43:24.210091+0000","last_clean":"2024-04-26T23:43:24.210091+0000","last_became_active":"2024-04-26T23:41:12.782901+0000","last_became_peered":"2024-04-26T23:41:12.782901+0000","last_unstale":"2024-04-26T23:43:24.210091+0000","last_undegraded":"2024-04-26T23:43:24.210091+0000","last_fullsized":"2024-04-26T23:43:24.210091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_clean_scrub_stamp":"2024-04-26T23:41:11.626255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:16.305521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1114112,"data_stored":799289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31692,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340148,"statfs":{"total":96636764160,"available":96604311552,"internally_reserved":0,"allocated":524288,"data_stored":209503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":520192,"data_stored":208901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":528384,"data_stored":210443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":540672,"data_stored":215769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":210465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":520192,"data_stored":208901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1114112,"data_stored":799233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:43:28.670 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T23:43:28.671 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-26T23:43:28.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.846+0000 7fdc22400640 1 Processor -- start 2024-04-26T23:43:28.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.846+0000 7fdc22400640 1 -- start start 2024-04-26T23:43:28.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.850+0000 7fdc22400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fdc1c15f3e0 0x7fdc1c0d0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:28.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.850+0000 7fdc22400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc1c0b7640 0x7fdc1c0d4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:28.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.850+0000 7fdc22400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc1c0d5d00 con 0x7fdc1c15f000 2024-04-26T23:43:28.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.850+0000 7fdc22400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fdc1c0d5870 con 0x7fdc1c15f3e0 2024-04-26T23:43:28.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.850+0000 7fdc22400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdc1c0d4c60 con 0x7fdc1c0b7640 2024-04-26T23:43:28.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.850+0000 7fdc13e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fdc1c15f3e0 0x7fdc1c0d0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:28.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.850+0000 7fdc21a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc1c0b7640 0x7fdc1c0d4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:28.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.850+0000 7fdc13e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fdc1c15f3e0 0x7fdc1c0d0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:54488/0 (socket says 172.21.15.137:54488) 2024-04-26T23:43:28.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.850+0000 7fdc13e00640 1 -- 172.21.15.137:0/2612875975 learned_addr learned my addr 172.21.15.137:0/2612875975 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:28.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.850+0000 7fdc21a00640 1 -- 172.21.15.137:0/2612875975 >> v2:172.21.15.170:3300/0 conn(0x7fdc1c15f3e0 msgr2=0x7fdc1c0d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:28.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.850+0000 7fdc21a00640 1 --2- 172.21.15.137:0/2612875975 >> v2:172.21.15.170:3300/0 conn(0x7fdc1c15f3e0 0x7fdc1c0d0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.850+0000 7fdc21a00640 1 -- 172.21.15.137:0/2612875975 >> v1:172.21.15.170:6789/0 conn(0x7fdc1c15f000 legacy=0x7fdc1c0b6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:28.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.850+0000 7fdc21a00640 1 -- 172.21.15.137:0/2612875975 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1c0d4f40 con 0x7fdc1c0b7640 2024-04-26T23:43:28.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.850+0000 7fdc13e00640 1 --2- 172.21.15.137:0/2612875975 >> v2:172.21.15.170:3300/0 conn(0x7fdc1c15f3e0 0x7fdc1c0d0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:43:28.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.854+0000 7fdc21a00640 1 --2- 172.21.15.137:0/2612875975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc1c0b7640 0x7fdc1c0d4580 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdc14009d90 tx=0x7fdc1401f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ed4ae245e97b763 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:28.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.854+0000 7fdc1be00640 1 -- 172.21.15.137:0/2612875975 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc140b4070 con 0x7fdc1c0b7640 2024-04-26T23:43:28.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.854+0000 7fdc1be00640 1 -- 172.21.15.137:0/2612875975 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc140af600 con 0x7fdc1c0b7640 2024-04-26T23:43:28.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.854+0000 7fdc1be00640 1 -- 172.21.15.137:0/2612875975 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc140af9d0 con 0x7fdc1c0b7640 2024-04-26T23:43:28.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.854+0000 7fdc22400640 1 -- 172.21.15.137:0/2612875975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc1c0b7640 msgr2=0x7fdc1c0d4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:28.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.854+0000 7fdc22400640 1 --2- 172.21.15.137:0/2612875975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc1c0b7640 0x7fdc1c0d4580 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdc14009d90 tx=0x7fdc1401f150 comp rx=0 tx=0).stop 2024-04-26T23:43:28.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.854+0000 7fdc22400640 1 -- 172.21.15.137:0/2612875975 shutdown_connections 2024-04-26T23:43:28.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.854+0000 7fdc22400640 1 --2- 172.21.15.137:0/2612875975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc1c0b7640 0x7fdc1c0d4580 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.854+0000 7fdc22400640 1 --2- 172.21.15.137:0/2612875975 >> v2:172.21.15.170:3300/0 conn(0x7fdc1c15f3e0 0x7fdc1c0d0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.854+0000 7fdc22400640 1 -- 172.21.15.137:0/2612875975 >> 172.21.15.137:0/2612875975 conn(0x7fdc1c06c800 msgr2=0x7fdc1c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:28.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.854+0000 7fdc22400640 1 -- 172.21.15.137:0/2612875975 shutdown_connections 2024-04-26T23:43:28.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.854+0000 7fdc22400640 1 -- 172.21.15.137:0/2612875975 wait complete. 2024-04-26T23:43:28.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.854+0000 7fdc22400640 1 Processor -- start 2024-04-26T23:43:28.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.854+0000 7fdc22400640 1 -- start start 2024-04-26T23:43:28.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc22400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc1c0b7640 0x7fdc1c152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:28.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc22400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc1c15f000 0x7fdc1c0c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:28.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc22400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc1c15f3e0 0x7fdc1c0ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:28.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc22400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1c0b7ff0 con 0x7fdc1c15f000 2024-04-26T23:43:28.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc22400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1c0d5500 con 0x7fdc1c15f3e0 2024-04-26T23:43:28.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc22400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdc1c0b8170 con 0x7fdc1c0b7640 2024-04-26T23:43:28.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc13e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc1c15f000 0x7fdc1c0c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:28.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc13e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc1c15f000 0x7fdc1c0c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54954/0 (socket says 172.21.15.137:54954) 2024-04-26T23:43:28.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc13e00640 1 -- 172.21.15.137:0/1409392081 learned_addr learned my addr 172.21.15.137:0/1409392081 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:28.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc21000640 1 --2- 172.21.15.137:0/1409392081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc1c0b7640 0x7fdc1c152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:28.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc21a00640 1 --2- 172.21.15.137:0/1409392081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc1c15f3e0 0x7fdc1c0ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:28.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc13e00640 1 -- 172.21.15.137:0/1409392081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc1c0b7640 msgr2=0x7fdc1c152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:28.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc13e00640 1 --2- 172.21.15.137:0/1409392081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc1c0b7640 0x7fdc1c152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc13e00640 1 -- 172.21.15.137:0/1409392081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc1c15f3e0 msgr2=0x7fdc1c0ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:28.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc13e00640 1 --2- 172.21.15.137:0/1409392081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc1c15f3e0 0x7fdc1c0ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:28.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc13e00640 1 -- 172.21.15.137:0/1409392081 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1c0cd720 con 0x7fdc1c15f000 2024-04-26T23:43:28.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc13e00640 1 --2- 172.21.15.137:0/1409392081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc1c15f000 0x7fdc1c0c8760 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400e930 tx=0x7fdc0400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:28.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc19600640 1 -- 172.21.15.137:0/1409392081 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc04017070 con 0x7fdc1c15f000 2024-04-26T23:43:28.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc19600640 1 -- 172.21.15.137:0/1409392081 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc0400ca00 con 0x7fdc1c15f000 2024-04-26T23:43:28.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc22400640 1 -- 172.21.15.137:0/1409392081 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc1c0cda00 con 0x7fdc1c15f000 2024-04-26T23:43:28.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc19600640 1 -- 172.21.15.137:0/1409392081 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0400cdd0 con 0x7fdc1c15f000 2024-04-26T23:43:28.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc22400640 1 -- 172.21.15.137:0/1409392081 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc1c0cdfc0 con 0x7fdc1c15f000 2024-04-26T23:43:28.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc22400640 1 -- 172.21.15.137:0/1409392081 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc1c0b6eb0 con 0x7fdc1c15f000 2024-04-26T23:43:28.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.858+0000 7fdc19600640 1 -- 172.21.15.137:0/1409392081 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdc0401a070 con 0x7fdc1c15f000 2024-04-26T23:43:28.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.862+0000 7fdc19600640 1 --2- 172.21.15.137:0/1409392081 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdbf8068380 0x7fdbf806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:28.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.862+0000 7fdc19600640 1 -- 172.21.15.137:0/1409392081 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fdc04086b80 con 0x7fdc1c15f000 2024-04-26T23:43:28.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.862+0000 7fdc21000640 1 --2- 172.21.15.137:0/1409392081 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdbf8068380 0x7fdbf806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:28.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.862+0000 7fdc21000640 1 --2- 172.21.15.137:0/1409392081 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdbf8068380 0x7fdbf806a840 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c001810 tx=0x7fdc0c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:28.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:28.866+0000 7fdc19600640 1 -- 172.21.15.137:0/1409392081 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdc04056ae0 con 0x7fdc1c15f000 2024-04-26T23:43:29.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.078+0000 7fdc22400640 1 -- 172.21.15.137:0/1409392081 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fdc1c06a370 con 0x7fdc1c15f000 2024-04-26T23:43:29.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.078+0000 7fdc19600640 1 -- 172.21.15.137:0/1409392081 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fdc0405ade0 con 0x7fdc1c15f000 2024-04-26T23:43:29.087 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-04-26T23:43:29.087 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBlOyxmNsaKARAAi0ecpgpB9GUVCXS04Xi03g== 2024-04-26T23:43:29.087 INFO:teuthology.orchestra.run.smithi137.stdout: caps mds = "allow" 2024-04-26T23:43:29.087 INFO:teuthology.orchestra.run.smithi137.stdout: caps mon = "allow r" 2024-04-26T23:43:29.087 INFO:teuthology.orchestra.run.smithi137.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-26T23:43:29.087 INFO:teuthology.orchestra.run.smithi137.stderr:updated caps for client.0 2024-04-26T23:43:29.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.082+0000 7fdc22400640 1 -- 172.21.15.137:0/1409392081 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdbf8068380 msgr2=0x7fdbf806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:29.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.082+0000 7fdc22400640 1 --2- 172.21.15.137:0/1409392081 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdbf8068380 0x7fdbf806a840 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c001810 tx=0x7fdc0c009040 comp rx=0 tx=0).stop 2024-04-26T23:43:29.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.082+0000 7fdc22400640 1 -- 172.21.15.137:0/1409392081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc1c15f000 msgr2=0x7fdc1c0c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:29.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.082+0000 7fdc22400640 1 --2- 172.21.15.137:0/1409392081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc1c15f000 0x7fdc1c0c8760 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400e930 tx=0x7fdc0400edf0 comp rx=0 tx=0).stop 2024-04-26T23:43:29.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.082+0000 7fdc22400640 1 -- 172.21.15.137:0/1409392081 shutdown_connections 2024-04-26T23:43:29.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.082+0000 7fdc22400640 1 --2- 172.21.15.137:0/1409392081 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdbf8068380 0x7fdbf806a840 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:29.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.082+0000 7fdc22400640 1 --2- 172.21.15.137:0/1409392081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc1c15f000 0x7fdc1c0c8760 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:29.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.082+0000 7fdc22400640 1 --2- 172.21.15.137:0/1409392081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc1c15f3e0 0x7fdc1c0ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:29.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.082+0000 7fdc22400640 1 --2- 172.21.15.137:0/1409392081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc1c0b7640 0x7fdc1c152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:29.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.082+0000 7fdc22400640 1 -- 172.21.15.137:0/1409392081 >> 172.21.15.137:0/1409392081 conn(0x7fdc1c06c800 msgr2=0x7fdc1c0b8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:29.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.082+0000 7fdc22400640 1 -- 172.21.15.137:0/1409392081 shutdown_connections 2024-04-26T23:43:29.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.082+0000 7fdc22400640 1 -- 172.21.15.137:0/1409392081 wait complete. 2024-04-26T23:43:29.108 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:43:29.187 INFO:tasks.ceph.mds.a.smithi137.stderr:2024-04-26T23:43:29.178+0000 7f871a200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:43:29.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.238+0000 7f4267200640 1 Processor -- start 2024-04-26T23:43:29.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.238+0000 7f4267200640 1 -- start start 2024-04-26T23:43:29.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.238+0000 7f4267200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4268159660 0x7f426815c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.238+0000 7f4267200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f426815f740 0x7f42680b5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.238+0000 7f4267200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f426815ff20 con 0x7f42680b5ea0 2024-04-26T23:43:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.238+0000 7f4267200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f426806c6a0 con 0x7f426815f740 2024-04-26T23:43:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.238+0000 7f4267200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4268160200 con 0x7f4268159660 2024-04-26T23:43:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.238+0000 7f4266800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f42680b5ea0 0x7f426806fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:53048/0 (socket says 172.21.15.137:53048) 2024-04-26T23:43:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.238+0000 7f4266800640 1 -- 172.21.15.137:0/3268858885 learned_addr learned my addr 172.21.15.137:0/3268858885 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.238+0000 7f4265e00640 1 --2- 172.21.15.137:0/3268858885 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4268159660 0x7f426815c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.238+0000 7f425fe00640 1 --2- 172.21.15.137:0/3268858885 >> v2:172.21.15.170:3300/0 conn(0x7f426815f740 0x7f42680b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.242+0000 7f4265400640 1 -- 172.21.15.137:0/3268858885 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 489711514 0 0) 0x7f426815ff20 con 0x7f42680b5ea0 2024-04-26T23:43:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.242+0000 7f4265400640 1 -- 172.21.15.137:0/3268858885 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f424c005740 con 0x7f42680b5ea0 2024-04-26T23:43:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.242+0000 7f4265e00640 1 -- 172.21.15.137:0/3268858885 >> v2:172.21.15.170:3300/0 conn(0x7f426815f740 msgr2=0x7f42680b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.242+0000 7f4265e00640 1 --2- 172.21.15.137:0/3268858885 >> v2:172.21.15.170:3300/0 conn(0x7f426815f740 0x7f42680b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.242+0000 7f4265e00640 1 -- 172.21.15.137:0/3268858885 >> v1:172.21.15.137:6789/0 conn(0x7f42680b5ea0 legacy=0x7f426806fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.242+0000 7f4265e00640 1 -- 172.21.15.137:0/3268858885 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42681604e0 con 0x7f4268159660 2024-04-26T23:43:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.242+0000 7f425fe00640 1 --2- 172.21.15.137:0/3268858885 >> v2:172.21.15.170:3300/0 conn(0x7f426815f740 0x7f42680b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:43:29.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.242+0000 7f4265e00640 1 --2- 172.21.15.137:0/3268858885 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4268159660 0x7f426815c150 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f42580097c0 tx=0x7f425801c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11f70e081d987a64 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:29.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.242+0000 7f4265400640 1 -- 172.21.15.137:0/3268858885 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42580b0070 con 0x7f4268159660 2024-04-26T23:43:29.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.242+0000 7f4265400640 1 -- 172.21.15.137:0/3268858885 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42580ab600 con 0x7f4268159660 2024-04-26T23:43:29.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.242+0000 7f4265400640 1 -- 172.21.15.137:0/3268858885 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42580ab9b0 con 0x7f4268159660 2024-04-26T23:43:29.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4267200640 1 -- 172.21.15.137:0/3268858885 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4268159660 msgr2=0x7f426815c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:29.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4267200640 1 --2- 172.21.15.137:0/3268858885 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4268159660 0x7f426815c150 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f42580097c0 tx=0x7f425801c380 comp rx=0 tx=0).stop 2024-04-26T23:43:29.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4267200640 1 -- 172.21.15.137:0/3268858885 shutdown_connections 2024-04-26T23:43:29.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4267200640 1 --2- 172.21.15.137:0/3268858885 >> v2:172.21.15.170:3300/0 conn(0x7f426815f740 0x7f42680b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:29.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4267200640 1 --2- 172.21.15.137:0/3268858885 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4268159660 0x7f426815c150 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:29.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4267200640 1 -- 172.21.15.137:0/3268858885 >> 172.21.15.137:0/3268858885 conn(0x7f42680d1b40 msgr2=0x7f42680d1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:29.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4267200640 1 -- 172.21.15.137:0/3268858885 shutdown_connections 2024-04-26T23:43:29.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4267200640 1 -- 172.21.15.137:0/3268858885 wait complete. 2024-04-26T23:43:29.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4267200640 1 Processor -- start 2024-04-26T23:43:29.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4267200640 1 -- start start 2024-04-26T23:43:29.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4267200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42680b5ea0 0x7f42680cf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:29.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4267200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4268159660 0x7f42680c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:29.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4267200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f426815f740 0x7f4268158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:29.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4267200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4268075380 con 0x7f426815f740 2024-04-26T23:43:29.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4267200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f426806dd50 con 0x7f4268159660 2024-04-26T23:43:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4267200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4268075500 con 0x7f42680b5ea0 2024-04-26T23:43:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4266800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f426815f740 0x7f4268158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4266800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f426815f740 0x7f4268158280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54962/0 (socket says 172.21.15.137:54962) 2024-04-26T23:43:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4266800640 1 -- 172.21.15.137:0/3648281643 learned_addr learned my addr 172.21.15.137:0/3648281643 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4265e00640 1 --2- 172.21.15.137:0/3648281643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42680b5ea0 0x7f42680cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f425fe00640 1 --2- 172.21.15.137:0/3648281643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4268159660 0x7f42680c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4266800640 1 -- 172.21.15.137:0/3648281643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42680b5ea0 msgr2=0x7f42680cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4266800640 1 --2- 172.21.15.137:0/3648281643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42680b5ea0 0x7f42680cf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4266800640 1 -- 172.21.15.137:0/3648281643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4268159660 msgr2=0x7f42680c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4266800640 1 --2- 172.21.15.137:0/3648281643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4268159660 0x7f42680c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.246+0000 7f4266800640 1 -- 172.21.15.137:0/3648281643 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42680cac20 con 0x7f426815f740 2024-04-26T23:43:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.250+0000 7f4266800640 1 --2- 172.21.15.137:0/3648281643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f426815f740 0x7f4268158280 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f426000cb70 tx=0x7f426000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.250+0000 7f425e000640 1 -- 172.21.15.137:0/3648281643 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4260017070 con 0x7f426815f740 2024-04-26T23:43:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.250+0000 7f425e000640 1 -- 172.21.15.137:0/3648281643 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f426000ad40 con 0x7f426815f740 2024-04-26T23:43:29.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.250+0000 7f425e000640 1 -- 172.21.15.137:0/3648281643 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4260012620 con 0x7f426815f740 2024-04-26T23:43:29.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.250+0000 7f4267200640 1 -- 172.21.15.137:0/3648281643 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42680cfe50 con 0x7f426815f740 2024-04-26T23:43:29.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.250+0000 7f4267200640 1 -- 172.21.15.137:0/3648281643 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42680d06f0 con 0x7f426815f740 2024-04-26T23:43:29.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.250+0000 7f4267200640 1 -- 172.21.15.137:0/3648281643 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f426806a410 con 0x7f426815f740 2024-04-26T23:43:29.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.250+0000 7f425e000640 1 -- 172.21.15.137:0/3648281643 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f426001a070 con 0x7f426815f740 2024-04-26T23:43:29.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.250+0000 7f425e000640 1 --2- 172.21.15.137:0/3648281643 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4244068380 0x7f424406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:29.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.250+0000 7f425e000640 1 -- 172.21.15.137:0/3648281643 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f42600867b0 con 0x7f426815f740 2024-04-26T23:43:29.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.250+0000 7f4265e00640 1 --2- 172.21.15.137:0/3648281643 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4244068380 0x7f424406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:29.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.254+0000 7f4265e00640 1 --2- 172.21.15.137:0/3648281643 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4244068380 0x7f424406a840 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f42580ad000 tx=0x7f42580a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:29.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.254+0000 7f425e000640 1 -- 172.21.15.137:0/3648281643 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4260056680 con 0x7f426815f740 2024-04-26T23:43:29.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.450+0000 7f4267200640 1 -- 172.21.15.137:0/3648281643 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f426806f660 con 0x7f426815f740 2024-04-26T23:43:29.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.450+0000 7f425e000640 1 -- 172.21.15.137:0/3648281643 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5187 (secure 0 0 0) 0x7f426005a980 con 0x7f426815f740 2024-04-26T23:43:29.458 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:29.458 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/145346644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":145346644},{"type":"v1","addr":"172.21.15.170:6835","nonce":145346644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5656,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3121910067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3121910067},{"type":"v1","addr":"172.21.15.170:6834","nonce":3121910067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5835,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/2120163779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2120163779},{"type":"v1","addr":"172.21.15.137:6836","nonce":2120163779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:43:23.588817+0000","modified":"2024-04-26T23:43:26.606923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5838},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5838":{"gid":5838,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/547646153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":547646153},{"type":"v1","addr":"172.21.15.137:6837","nonce":547646153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5838,"qdb_cluster":[5838]},"id":3}]} 2024-04-26T23:43:29.458 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 25 2024-04-26T23:43:29.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.450+0000 7f4267200640 1 -- 172.21.15.137:0/3648281643 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4244068380 msgr2=0x7f424406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:29.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.450+0000 7f4267200640 1 --2- 172.21.15.137:0/3648281643 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4244068380 0x7f424406a840 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f42580ad000 tx=0x7f42580a6000 comp rx=0 tx=0).stop 2024-04-26T23:43:29.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.450+0000 7f4267200640 1 -- 172.21.15.137:0/3648281643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f426815f740 msgr2=0x7f4268158280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:29.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.450+0000 7f4267200640 1 --2- 172.21.15.137:0/3648281643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f426815f740 0x7f4268158280 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f426000cb70 tx=0x7f426000a430 comp rx=0 tx=0).stop 2024-04-26T23:43:29.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.450+0000 7f4267200640 1 -- 172.21.15.137:0/3648281643 shutdown_connections 2024-04-26T23:43:29.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.450+0000 7f4267200640 1 --2- 172.21.15.137:0/3648281643 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4244068380 0x7f424406a840 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:29.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.450+0000 7f4267200640 1 --2- 172.21.15.137:0/3648281643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f426815f740 0x7f4268158280 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:29.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.450+0000 7f4267200640 1 --2- 172.21.15.137:0/3648281643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4268159660 0x7f42680c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:29.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.450+0000 7f4267200640 1 --2- 172.21.15.137:0/3648281643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42680b5ea0 0x7f42680cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:29.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.450+0000 7f4267200640 1 -- 172.21.15.137:0/3648281643 >> 172.21.15.137:0/3648281643 conn(0x7f42680d1b40 msgr2=0x7f4268165f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:29.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.450+0000 7f4267200640 1 -- 172.21.15.137:0/3648281643 shutdown_connections 2024-04-26T23:43:29.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:29.450+0000 7f4267200640 1 -- 172.21.15.137:0/3648281643 wait complete. 2024-04-26T23:43:29.882 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T23:43:23.588817+0000', 'modified': '2024-04-26T23:43:26.606923+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5838}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5838': {'gid': 5838, 'name': 'a', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.137:6837/547646153', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6835', 'nonce': 547646153}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 547646153}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5838, 'qdb_cluster': [5838]} 2024-04-26T23:43:29.883 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T23:43:29.883 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T23:43:30.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.014+0000 7f31c9000640 1 Processor -- start 2024-04-26T23:43:30.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.014+0000 7f31c9000640 1 -- start start 2024-04-26T23:43:30.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.014+0000 7f31c9000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f31c415ced0 0x7f31c40d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.014+0000 7f31c9000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31c415d2b0 0x7f31c40d18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.014+0000 7f31c9000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f31c40b0d90 0x7f31c40b1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.014+0000 7f31c9000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f31c40b1b30 con 0x7f31c40b0d90 2024-04-26T23:43:30.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.014+0000 7f31c9000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f31c40b1e10 con 0x7f31c415ced0 2024-04-26T23:43:30.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.014+0000 7f31c9000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f31c40b23f0 con 0x7f31c415d2b0 2024-04-26T23:43:30.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.014+0000 7f31c2800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f31c40b0d90 0x7f31c40b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.014+0000 7f31c2800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f31c40b0d90 0x7f31c40b1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54966/0 (socket says 172.21.15.137:54966) 2024-04-26T23:43:30.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.014+0000 7f31c2800640 1 -- 172.21.15.137:0/373275135 learned_addr learned my addr 172.21.15.137:0/373275135 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:30.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.014+0000 7f31c1e00640 1 --2- 172.21.15.137:0/373275135 >> v2:172.21.15.170:3300/0 conn(0x7f31c415ced0 0x7f31c40d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.014+0000 7f31b9400640 1 --2- 172.21.15.137:0/373275135 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31c415d2b0 0x7f31c40d18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.014+0000 7f31c2800640 1 -- 172.21.15.137:0/373275135 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31c415d2b0 msgr2=0x7f31c40d18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:30.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.014+0000 7f31c2800640 1 --2- 172.21.15.137:0/373275135 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31c415d2b0 0x7f31c40d18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.014+0000 7f31c2800640 1 -- 172.21.15.137:0/373275135 >> v2:172.21.15.170:3300/0 conn(0x7f31c415ced0 msgr2=0x7f31c40d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:30.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.014+0000 7f31c2800640 1 --2- 172.21.15.137:0/373275135 >> v2:172.21.15.170:3300/0 conn(0x7f31c415ced0 0x7f31c40d13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.014+0000 7f31c2800640 1 -- 172.21.15.137:0/373275135 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c40b26d0 con 0x7f31c40b0d90 2024-04-26T23:43:30.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.018+0000 7f31c2800640 1 --2- 172.21.15.137:0/373275135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31c40b0d90 0x7f31c40b1220 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f31c40d0880 tx=0x7f31bc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9ee9d563992b5b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:30.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.018+0000 7f31c1400640 1 -- 172.21.15.137:0/373275135 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0a5780 con 0x7f31c40b0d90 2024-04-26T23:43:30.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.018+0000 7f31c1400640 1 -- 172.21.15.137:0/373275135 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31bc0a5920 con 0x7f31c40b0d90 2024-04-26T23:43:30.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.018+0000 7f31c1400640 1 -- 172.21.15.137:0/373275135 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0a5cf0 con 0x7f31c40b0d90 2024-04-26T23:43:30.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.018+0000 7f31c9000640 1 -- 172.21.15.137:0/373275135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31c40b0d90 msgr2=0x7f31c40b1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:30.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.018+0000 7f31c9000640 1 --2- 172.21.15.137:0/373275135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31c40b0d90 0x7f31c40b1220 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f31c40d0880 tx=0x7f31bc01c9f0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.018+0000 7f31c9000640 1 -- 172.21.15.137:0/373275135 shutdown_connections 2024-04-26T23:43:30.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.018+0000 7f31c9000640 1 --2- 172.21.15.137:0/373275135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31c40b0d90 0x7f31c40b1220 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.018+0000 7f31c9000640 1 --2- 172.21.15.137:0/373275135 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31c415d2b0 0x7f31c40d18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.018+0000 7f31c9000640 1 --2- 172.21.15.137:0/373275135 >> v2:172.21.15.170:3300/0 conn(0x7f31c415ced0 0x7f31c40d13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.018+0000 7f31c9000640 1 -- 172.21.15.137:0/373275135 >> 172.21.15.137:0/373275135 conn(0x7f31c409ba60 msgr2=0x7f31c409be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:30.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.018+0000 7f31c9000640 1 -- 172.21.15.137:0/373275135 shutdown_connections 2024-04-26T23:43:30.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.018+0000 7f31c9000640 1 -- 172.21.15.137:0/373275135 wait complete. 2024-04-26T23:43:30.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31c9000640 1 Processor -- start 2024-04-26T23:43:30.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31c9000640 1 -- start start 2024-04-26T23:43:30.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31c9000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31c40b0d90 0x7f31c40b8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31c9000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31c415ced0 0x7f31c40ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31c9000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31c415d2b0 0x7f31c40ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31c9000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f31c40b0660 con 0x7f31c415d2b0 2024-04-26T23:43:30.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31c9000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f31c40b04e0 con 0x7f31c40b0d90 2024-04-26T23:43:30.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31c9000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f31c40b07e0 con 0x7f31c415ced0 2024-04-26T23:43:30.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31c2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31c415d2b0 0x7f31c40ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31c2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31c415d2b0 0x7f31c40ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54970/0 (socket says 172.21.15.137:54970) 2024-04-26T23:43:30.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31c2800640 1 -- 172.21.15.137:0/2823918874 learned_addr learned my addr 172.21.15.137:0/2823918874 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:30.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31c1e00640 1 --2- 172.21.15.137:0/2823918874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31c40b0d90 0x7f31c40b8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31b9400640 1 --2- 172.21.15.137:0/2823918874 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31c415ced0 0x7f31c40ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31c2800640 1 -- 172.21.15.137:0/2823918874 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31c415ced0 msgr2=0x7f31c40ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:30.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31c2800640 1 --2- 172.21.15.137:0/2823918874 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31c415ced0 0x7f31c40ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31c2800640 1 -- 172.21.15.137:0/2823918874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31c40b0d90 msgr2=0x7f31c40b8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:30.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31c2800640 1 --2- 172.21.15.137:0/2823918874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31c40b0d90 0x7f31c40b8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31c2800640 1 -- 172.21.15.137:0/2823918874 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c40b6650 con 0x7f31c415d2b0 2024-04-26T23:43:30.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31b9400640 1 --2- 172.21.15.137:0/2823918874 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31c415ced0 0x7f31c40ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:30.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31c2800640 1 --2- 172.21.15.137:0/2823918874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31c415d2b0 0x7f31c40ca770 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0af040 tx=0x7f31bc019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:30.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31baa00640 1 -- 172.21.15.137:0/2823918874 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0bc020 con 0x7f31c415d2b0 2024-04-26T23:43:30.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31baa00640 1 -- 172.21.15.137:0/2823918874 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31bc0b8880 con 0x7f31c415d2b0 2024-04-26T23:43:30.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31baa00640 1 -- 172.21.15.137:0/2823918874 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0a5780 con 0x7f31c415d2b0 2024-04-26T23:43:30.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31c9000640 1 -- 172.21.15.137:0/2823918874 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c40b6930 con 0x7f31c415d2b0 2024-04-26T23:43:30.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.022+0000 7f31c9000640 1 -- 172.21.15.137:0/2823918874 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c40b6ef0 con 0x7f31c415d2b0 2024-04-26T23:43:30.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31baa00640 1 -- 172.21.15.137:0/2823918874 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f31bc0bf020 con 0x7f31c415d2b0 2024-04-26T23:43:30.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31baa00640 1 --2- 172.21.15.137:0/2823918874 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f31a0068380 0x7f31a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31baa00640 1 -- 172.21.15.137:0/2823918874 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f31bc1219f0 con 0x7f31c415d2b0 2024-04-26T23:43:30.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31c1e00640 1 --2- 172.21.15.137:0/2823918874 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f31a0068380 0x7f31a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31cc4e1000 1 Processor -- start 2024-04-26T23:43:30.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31cc4e1000 1 -- start start 2024-04-26T23:43:30.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31c1e00640 1 --2- 172.21.15.137:0/2823918874 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f31a0068380 0x7f31a006a840 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009ac0 tx=0x7f31ac009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:30.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31cc4e1000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848dfa2af0 0x55848dfa2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31cc4e1000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa3410 0x55848df59610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31cc4e1000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55848df59b50 0x55848df59f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31cc4e1000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55848de0d140 con 0x55848dfa3410 2024-04-26T23:43:30.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31cc4e1000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55848dda2e00 con 0x55848dfa2af0 2024-04-26T23:43:30.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31cc4e1000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55848dd5ba00 con 0x55848df59b50 2024-04-26T23:43:30.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31b9400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa3410 0x55848df59610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31b9400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa3410 0x55848df59610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54980/0 (socket says 172.21.15.137:54980) 2024-04-26T23:43:30.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31b9400640 1 -- 172.21.15.137:0/1064642995 learned_addr learned my addr 172.21.15.137:0/1064642995 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:30.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31c1e00640 1 --2- 172.21.15.137:0/1064642995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848dfa2af0 0x55848dfa2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31c2800640 1 --2- 172.21.15.137:0/1064642995 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55848df59b50 0x55848df59f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31b9400640 1 -- 172.21.15.137:0/1064642995 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55848df59b50 msgr2=0x55848df59f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:30.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31b9400640 1 --2- 172.21.15.137:0/1064642995 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55848df59b50 0x55848df59f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31b9400640 1 -- 172.21.15.137:0/1064642995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848dfa2af0 msgr2=0x55848dfa2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:30.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31b9400640 1 --2- 172.21.15.137:0/1064642995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848dfa2af0 0x55848dfa2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31b9400640 1 -- 172.21.15.137:0/1064642995 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55848dd600e0 con 0x55848dfa3410 2024-04-26T23:43:30.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31c2800640 1 --2- 172.21.15.137:0/1064642995 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55848df59b50 0x55848df59f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:30.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31c1e00640 1 --2- 172.21.15.137:0/1064642995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848dfa2af0 0x55848dfa2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:30.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.026+0000 7f31b9400640 1 --2- 172.21.15.137:0/1064642995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa3410 0x55848df59610 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f31b4009ae0 tx=0x7f31b4009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28bbb1cdd23e3afb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:30.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31b2a00640 1 -- 172.21.15.137:0/1064642995 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b4019070 con 0x55848dfa3410 2024-04-26T23:43:30.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31b2a00640 1 -- 172.21.15.137:0/1064642995 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b4011bc0 con 0x55848dfa3410 2024-04-26T23:43:30.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31b2a00640 1 -- 172.21.15.137:0/1064642995 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b4015460 con 0x55848dfa3410 2024-04-26T23:43:30.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31cc4e1000 1 -- 172.21.15.137:0/1064642995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa3410 msgr2=0x55848df59610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:30.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31cc4e1000 1 --2- 172.21.15.137:0/1064642995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa3410 0x55848df59610 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f31b4009ae0 tx=0x7f31b4009190 comp rx=0 tx=0).stop 2024-04-26T23:43:30.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31cc4e1000 1 -- 172.21.15.137:0/1064642995 shutdown_connections 2024-04-26T23:43:30.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31cc4e1000 1 --2- 172.21.15.137:0/1064642995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa3410 0x55848df59610 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31cc4e1000 1 --2- 172.21.15.137:0/1064642995 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55848df59b50 0x55848df59f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31cc4e1000 1 --2- 172.21.15.137:0/1064642995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848dfa2af0 0x55848dfa2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31cc4e1000 1 -- 172.21.15.137:0/1064642995 >> 172.21.15.137:0/1064642995 conn(0x55848df516f0 msgr2=0x55848df53ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:30.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31cc4e1000 1 -- 172.21.15.137:0/1064642995 shutdown_connections 2024-04-26T23:43:30.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31cc4e1000 1 -- 172.21.15.137:0/1064642995 wait complete. 2024-04-26T23:43:30.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31cc4e1000 1 -- start start 2024-04-26T23:43:30.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31cc4e1000 1 Processor -- start 2024-04-26T23:43:30.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31cc4e1000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848df59b50 0x55848dfa9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31cc4e1000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa2af0 0x55848dfaa390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31cc4e1000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55848dfa3410 0x55848df63c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31cc4e1000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55848ddb0200 con 0x55848dfa2af0 2024-04-26T23:43:30.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31cc4e1000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55848dd46e80 con 0x55848df59b50 2024-04-26T23:43:30.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31cc4e1000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55848dd9dae0 con 0x55848dfa3410 2024-04-26T23:43:30.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31cc4e1000 10 client.0 _ll_register_callbacks cb 0x55848ddafda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:43:30.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31b9400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa2af0 0x55848dfaa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31b9400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa2af0 0x55848dfaa390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54988/0 (socket says 172.21.15.137:54988) 2024-04-26T23:43:30.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31b9400640 1 -- 172.21.15.137:0/4231450957 learned_addr learned my addr 172.21.15.137:0/4231450957 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:30.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31c1e00640 1 --2- 172.21.15.137:0/4231450957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848df59b50 0x55848dfa9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31c2800640 1 --2- 172.21.15.137:0/4231450957 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55848dfa3410 0x55848df63c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31b9400640 1 -- 172.21.15.137:0/4231450957 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55848dfa3410 msgr2=0x55848df63c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:30.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31b9400640 1 --2- 172.21.15.137:0/4231450957 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55848dfa3410 0x55848df63c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31b9400640 1 -- 172.21.15.137:0/4231450957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848df59b50 msgr2=0x55848dfa9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:30.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31b9400640 1 --2- 172.21.15.137:0/4231450957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848df59b50 0x55848dfa9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31b9400640 1 -- 172.21.15.137:0/4231450957 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55848dd424e0 con 0x55848dfa2af0 2024-04-26T23:43:30.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31b9400640 1 --2- 172.21.15.137:0/4231450957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa2af0 0x55848dfaa390 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x55848dbbcc70 tx=0x7f31b4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ceffa152a7462b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:30.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.030+0000 7f31a7400640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T23:43:30.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31a7400640 1 -- 172.21.15.137:0/4231450957 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b402c060 con 0x55848dfa2af0 2024-04-26T23:43:30.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31cc4e1000 1 -- 172.21.15.137:0/4231450957 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31b4011bc0 con 0x55848dfa2af0 2024-04-26T23:43:30.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31a7400640 1 -- 172.21.15.137:0/4231450957 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f31b40119c0 con 0x55848dfa2af0 2024-04-26T23:43:30.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31a7400640 1 -- 172.21.15.137:0/4231450957 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f31b4032050 con 0x55848dfa2af0 2024-04-26T23:43:30.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31cc4e1000 10 client.5973 fetch_fsmap learned FSMap version 25 2024-04-26T23:43:30.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31cc4e1000 1 -- 172.21.15.137:0/4231450957 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55848dd28e80 con 0x55848dfa2af0 2024-04-26T23:43:30.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31a7400640 1 -- 172.21.15.137:0/4231450957 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b4011bc0 con 0x55848dfa2af0 2024-04-26T23:43:30.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31a7400640 1 -- 172.21.15.137:0/4231450957 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7f31b4026070 con 0x55848dfa2af0 2024-04-26T23:43:30.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31cc4e1000 10 client.5973 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T23:43:30.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31cc4e1000 10 client.5973 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T23:43:30.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31cc4e1000 20 client.5973 populate_metadata read hostname 'smithi137' 2024-04-26T23:43:30.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31cc4e1000 1 --2- 172.21.15.137:0/4231450957 >> [v2:172.21.15.137:6835/547646153,v1:172.21.15.137:6837/547646153] conn(0x55848df649c0 0x55848df64da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31cc4e1000 4 client.5973 mds_command: new command op to 5838 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T23:43:30.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31cc4e1000 1 -- 172.21.15.137:0/4231450957 --> [v2:172.21.15.137:6835/547646153,v1:172.21.15.137:6837/547646153] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55848dd3bbc0 con 0x55848df649c0 2024-04-26T23:43:30.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31c1e00640 1 --2- 172.21.15.137:0/4231450957 >> [v2:172.21.15.137:6835/547646153,v1:172.21.15.137:6837/547646153] conn(0x55848df649c0 0x55848df64da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31c1e00640 1 --2- 172.21.15.137:0/4231450957 >> [v2:172.21.15.137:6835/547646153,v1:172.21.15.137:6837/547646153] conn(0x55848df649c0 0x55848df64da0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ae4c48c56b7208a server_cookie=2bf105180947714f in_seq=0 out_seq=0 2024-04-26T23:43:30.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31a7400640 10 client.5973 ms_handle_connect on v2:172.21.15.137:6835/547646153 2024-04-26T23:43:30.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31a7400640 1 -- 172.21.15.137:0/4231450957 <== mds.0 v2:172.21.15.137:6835/547646153 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55848dd3bbc0 con 0x55848df649c0 2024-04-26T23:43:30.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31a7400640 10 client.5973 handle_command_reply: tid=0 2024-04-26T23:43:30.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31cc4e1000 1 client.5973 shutdown 2024-04-26T23:43:30.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31cc4e1000 1 -- 172.21.15.137:0/4231450957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa2af0 msgr2=0x55848dfaa390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:30.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31cc4e1000 1 --2- 172.21.15.137:0/4231450957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa2af0 0x55848dfaa390 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x55848dbbcc70 tx=0x7f31b4004740 comp rx=0 tx=0).stop 2024-04-26T23:43:30.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31cc4e1000 1 -- 172.21.15.137:0/4231450957 shutdown_connections 2024-04-26T23:43:30.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31cc4e1000 1 --2- 172.21.15.137:0/4231450957 >> [v2:172.21.15.137:6835/547646153,v1:172.21.15.137:6837/547646153] conn(0x55848df649c0 0x55848df64da0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31cc4e1000 1 --2- 172.21.15.137:0/4231450957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa2af0 0x55848dfaa390 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31cc4e1000 1 --2- 172.21.15.137:0/4231450957 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55848dfa3410 0x55848df63c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31cc4e1000 1 --2- 172.21.15.137:0/4231450957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848df59b50 0x55848dfa9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31a7400640 0 client.5973 ms_handle_reset on v2:172.21.15.137:6835/547646153 2024-04-26T23:43:30.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31cc4e1000 1 -- 172.21.15.137:0/4231450957 >> 172.21.15.137:0/4231450957 conn(0x55848df516f0 msgr2=0x55848df53ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:30.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31cc4e1000 1 -- 172.21.15.137:0/4231450957 shutdown_connections 2024-04-26T23:43:30.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31cc4e1000 1 -- 172.21.15.137:0/4231450957 wait complete. 2024-04-26T23:43:30.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.034+0000 7f31cc4e1000 20 client.5973 trim_cache size 0 max 16384 2024-04-26T23:43:30.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31cc4e1000 1 Processor -- start 2024-04-26T23:43:30.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31cc4e1000 1 -- start start 2024-04-26T23:43:30.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31cc4e1000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848df516f0 0x55848dfa1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31cc4e1000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55848df59b50 0x55848dfa24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31cc4e1000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa2af0 0x55848df59f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31cc4e1000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f31c4154100 con 0x55848dfa2af0 2024-04-26T23:43:30.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31cc4e1000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f31c406da70 con 0x55848df516f0 2024-04-26T23:43:30.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31cc4e1000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f31c406e0c0 con 0x55848df59b50 2024-04-26T23:43:30.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31c2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa2af0 0x55848df59f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31c2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa2af0 0x55848df59f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54992/0 (socket says 172.21.15.137:54992) 2024-04-26T23:43:30.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31c2800640 1 -- 172.21.15.137:0/821169536 learned_addr learned my addr 172.21.15.137:0/821169536 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:30.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31c2800640 1 -- 172.21.15.137:0/821169536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55848df59b50 msgr2=0x55848dfa24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:30.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31c2800640 1 --2- 172.21.15.137:0/821169536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55848df59b50 0x55848dfa24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31c2800640 1 -- 172.21.15.137:0/821169536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848df516f0 msgr2=0x55848dfa1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:30.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31c2800640 1 --2- 172.21.15.137:0/821169536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848df516f0 0x55848dfa1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31c2800640 1 -- 172.21.15.137:0/821169536 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55848dd5bc50 con 0x55848dfa2af0 2024-04-26T23:43:30.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31c2800640 1 --2- 172.21.15.137:0/821169536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa2af0 0x55848df59f30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f31bc01ced0 tx=0x7f31bc110040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea24d98a8a07cc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:30.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31b2000640 1 -- 172.21.15.137:0/821169536 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc10e070 con 0x55848dfa2af0 2024-04-26T23:43:30.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31b2000640 1 -- 172.21.15.137:0/821169536 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31bc0f1820 con 0x55848dfa2af0 2024-04-26T23:43:30.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31b2000640 1 -- 172.21.15.137:0/821169536 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0f5bd0 con 0x55848dfa2af0 2024-04-26T23:43:30.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31cc4e1000 1 -- 172.21.15.137:0/821169536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa2af0 msgr2=0x55848df59f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:30.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31cc4e1000 1 --2- 172.21.15.137:0/821169536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa2af0 0x55848df59f30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f31bc01ced0 tx=0x7f31bc110040 comp rx=0 tx=0).stop 2024-04-26T23:43:30.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31cc4e1000 1 -- 172.21.15.137:0/821169536 shutdown_connections 2024-04-26T23:43:30.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31cc4e1000 1 --2- 172.21.15.137:0/821169536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa2af0 0x55848df59f30 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31cc4e1000 1 --2- 172.21.15.137:0/821169536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55848df59b50 0x55848dfa24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31cc4e1000 1 --2- 172.21.15.137:0/821169536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848df516f0 0x55848dfa1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31cc4e1000 1 -- 172.21.15.137:0/821169536 >> 172.21.15.137:0/821169536 conn(0x55848dfb07b0 msgr2=0x55848dfb8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:30.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31cc4e1000 1 -- 172.21.15.137:0/821169536 shutdown_connections 2024-04-26T23:43:30.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31cc4e1000 1 -- 172.21.15.137:0/821169536 wait complete. 2024-04-26T23:43:30.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31cc4e1000 1 -- start start 2024-04-26T23:43:30.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.054+0000 7f31cc4e1000 1 Processor -- start 2024-04-26T23:43:30.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848df516f0 0x55848dfa1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55848df59b50 0x55848dfa23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa2af0 0x55848df56b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55848dda2110 con 0x55848dfa2af0 2024-04-26T23:43:30.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55848dd387b0 con 0x55848df516f0 2024-04-26T23:43:30.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55848dda7430 con 0x55848df59b50 2024-04-26T23:43:30.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 10 client.0 _ll_register_callbacks cb 0x7f31b4009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:43:30.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31c2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa2af0 0x55848df56b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31c2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa2af0 0x55848df56b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55006/0 (socket says 172.21.15.137:55006) 2024-04-26T23:43:30.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31c2800640 1 -- 172.21.15.137:0/2679096297 learned_addr learned my addr 172.21.15.137:0/2679096297 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:30.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31c1e00640 1 --2- 172.21.15.137:0/2679096297 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848df516f0 0x55848dfa1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31b9400640 1 --2- 172.21.15.137:0/2679096297 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55848df59b50 0x55848dfa23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31c2800640 1 -- 172.21.15.137:0/2679096297 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55848df59b50 msgr2=0x55848dfa23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:30.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31c2800640 1 --2- 172.21.15.137:0/2679096297 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55848df59b50 0x55848dfa23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31c2800640 1 -- 172.21.15.137:0/2679096297 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848df516f0 msgr2=0x55848dfa1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:30.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31c2800640 1 --2- 172.21.15.137:0/2679096297 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848df516f0 0x55848dfa1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31c2800640 1 -- 172.21.15.137:0/2679096297 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55848de25160 con 0x55848dfa2af0 2024-04-26T23:43:30.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31c2800640 1 --2- 172.21.15.137:0/2679096297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa2af0 0x55848df56b40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0edc80 tx=0x7f31bc009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0a8830d4bd209d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:30.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31a7400640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T23:43:30.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31a7400640 1 -- 172.21.15.137:0/2679096297 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc10e040 con 0x55848dfa2af0 2024-04-26T23:43:30.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31a7400640 1 -- 172.21.15.137:0/2679096297 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f31bc111de0 con 0x55848dfa2af0 2024-04-26T23:43:30.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 1 -- 172.21.15.137:0/2679096297 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31bc0f1820 con 0x55848dfa2af0 2024-04-26T23:43:30.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31a7400640 1 -- 172.21.15.137:0/2679096297 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f31bc0f1a80 con 0x55848dfa2af0 2024-04-26T23:43:30.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 10 client.5979 fetch_fsmap learned FSMap version 25 2024-04-26T23:43:30.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 1 -- 172.21.15.137:0/2679096297 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55848da5c0c0 con 0x55848dfa2af0 2024-04-26T23:43:30.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31a7400640 1 -- 172.21.15.137:0/2679096297 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31bc0f1820 con 0x55848dfa2af0 2024-04-26T23:43:30.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31a7400640 1 -- 172.21.15.137:0/2679096297 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7f31bc1193d0 con 0x55848dfa2af0 2024-04-26T23:43:30.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 10 client.5979 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T23:43:30.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 10 client.5979 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T23:43:30.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 20 client.5979 populate_metadata read hostname 'smithi137' 2024-04-26T23:43:30.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 1 --2- 172.21.15.137:0/2679096297 >> [v2:172.21.15.137:6835/547646153,v1:172.21.15.137:6837/547646153] conn(0x55848dfa3410 0x55848df574d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 4 client.5979 mds_command: new command op to 5838 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T23:43:30.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 1 -- 172.21.15.137:0/2679096297 --> [v2:172.21.15.137:6835/547646153,v1:172.21.15.137:6837/547646153] -- command(tid 0: {"prefix": "status"}) -- 0x55848ddb0a10 con 0x55848dfa3410 2024-04-26T23:43:30.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31c1e00640 1 --2- 172.21.15.137:0/2679096297 >> [v2:172.21.15.137:6835/547646153,v1:172.21.15.137:6837/547646153] conn(0x55848dfa3410 0x55848df574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31a7400640 10 client.5979 ms_handle_connect on v2:172.21.15.137:6835/547646153 2024-04-26T23:43:30.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31c1e00640 1 --2- 172.21.15.137:0/2679096297 >> [v2:172.21.15.137:6835/547646153,v1:172.21.15.137:6837/547646153] conn(0x55848dfa3410 0x55848df574d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37f535b6275ea6f4 server_cookie=54ccefece204ff17 in_seq=0 out_seq=0 2024-04-26T23:43:30.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31a7400640 1 -- 172.21.15.137:0/2679096297 <== mds.0 v2:172.21.15.137:6835/547646153 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55848ddb0a10 con 0x55848dfa3410 2024-04-26T23:43:30.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31a7400640 10 client.5979 handle_command_reply: tid=0 2024-04-26T23:43:30.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 1 client.5979 shutdown 2024-04-26T23:43:30.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 1 -- 172.21.15.137:0/2679096297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa2af0 msgr2=0x55848df56b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:30.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 1 --2- 172.21.15.137:0/2679096297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa2af0 0x55848df56b40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0edc80 tx=0x7f31bc009810 comp rx=0 tx=0).stop 2024-04-26T23:43:30.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 1 -- 172.21.15.137:0/2679096297 shutdown_connections 2024-04-26T23:43:30.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 1 --2- 172.21.15.137:0/2679096297 >> [v2:172.21.15.137:6835/547646153,v1:172.21.15.137:6837/547646153] conn(0x55848dfa3410 0x55848df574d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 1 --2- 172.21.15.137:0/2679096297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55848dfa2af0 0x55848df56b40 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 1 --2- 172.21.15.137:0/2679096297 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55848df59b50 0x55848dfa23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 1 --2- 172.21.15.137:0/2679096297 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848df516f0 0x55848dfa1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31a7400640 0 client.5979 ms_handle_reset on v2:172.21.15.137:6835/547646153 2024-04-26T23:43:30.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 1 -- 172.21.15.137:0/2679096297 >> 172.21.15.137:0/2679096297 conn(0x55848dfb07b0 msgr2=0x55848df63950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:30.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 1 -- 172.21.15.137:0/2679096297 shutdown_connections 2024-04-26T23:43:30.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 1 -- 172.21.15.137:0/2679096297 wait complete. 2024-04-26T23:43:30.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.058+0000 7f31cc4e1000 20 client.5979 trim_cache size 0 max 16384 2024-04-26T23:43:30.075 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:43:30.075 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "efde6204-be0d-4c4f-9ea0-954d26627e78", 2024-04-26T23:43:30.075 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 0, 2024-04-26T23:43:30.075 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 5838, 2024-04-26T23:43:30.075 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-26T23:43:30.075 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-26T23:43:30.075 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-26T23:43:30.076 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 5.8464638950000003, 2024-04-26T23:43:30.076 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 25, 2024-04-26T23:43:30.076 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 45, 2024-04-26T23:43:30.076 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 45, 2024-04-26T23:43:30.076 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 11.757935625 2024-04-26T23:43:30.076 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:43:30.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.062+0000 7f31c9000640 1 -- 172.21.15.137:0/2823918874 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f31a0068380 msgr2=0x7f31a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:30.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.062+0000 7f31c9000640 1 --2- 172.21.15.137:0/2823918874 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f31a0068380 0x7f31a006a840 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009ac0 tx=0x7f31ac009190 comp rx=0 tx=0).stop 2024-04-26T23:43:30.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.062+0000 7f31c9000640 1 -- 172.21.15.137:0/2823918874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31c415d2b0 msgr2=0x7f31c40ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:30.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.062+0000 7f31c9000640 1 --2- 172.21.15.137:0/2823918874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31c415d2b0 0x7f31c40ca770 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0af040 tx=0x7f31bc019790 comp rx=0 tx=0).stop 2024-04-26T23:43:30.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.062+0000 7f31c9000640 1 -- 172.21.15.137:0/2823918874 shutdown_connections 2024-04-26T23:43:30.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.062+0000 7f31c9000640 1 --2- 172.21.15.137:0/2823918874 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f31a0068380 0x7f31a006a840 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.062+0000 7f31c9000640 1 --2- 172.21.15.137:0/2823918874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31c415d2b0 0x7f31c40ca770 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.062+0000 7f31c9000640 1 --2- 172.21.15.137:0/2823918874 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31c415ced0 0x7f31c40ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.062+0000 7f31c9000640 1 --2- 172.21.15.137:0/2823918874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31c40b0d90 0x7f31c40b8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.062+0000 7f31c9000640 1 -- 172.21.15.137:0/2823918874 >> 172.21.15.137:0/2823918874 conn(0x7f31c409ba60 msgr2=0x7f31c4071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:30.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.062+0000 7f31c9000640 1 -- 172.21.15.137:0/2823918874 shutdown_connections 2024-04-26T23:43:30.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.062+0000 7f31c9000640 1 -- 172.21.15.137:0/2823918874 wait complete. 2024-04-26T23:43:30.088 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:43:30.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.218+0000 7f950e000640 1 Processor -- start 2024-04-26T23:43:30.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.218+0000 7f950e000640 1 -- start start 2024-04-26T23:43:30.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.218+0000 7f950e000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f95080b5080 0x7f95080cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.218+0000 7f950e000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9508072980 0x7f9508072e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.218+0000 7f950e000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95080cfef0 con 0x7f95080725a0 2024-04-26T23:43:30.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.218+0000 7f950e000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f95080cddc0 con 0x7f95080b5080 2024-04-26T23:43:30.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.218+0000 7f950e000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f95080d01b0 con 0x7f9508072980 2024-04-26T23:43:30.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.218+0000 7f9507400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f95080725a0 0x7f9508073f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:53050/0 (socket says 172.21.15.137:53050) 2024-04-26T23:43:30.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.218+0000 7f9507400640 1 -- 172.21.15.137:0/1289749430 learned_addr learned my addr 172.21.15.137:0/1289749430 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:30.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.218+0000 7f9507e00640 1 --2- 172.21.15.137:0/1289749430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9508072980 0x7f9508072e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.218+0000 7f94fea00640 1 --2- 172.21.15.137:0/1289749430 >> v2:172.21.15.170:3300/0 conn(0x7f95080b5080 0x7f95080cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.222+0000 7f9506a00640 1 -- 172.21.15.137:0/1289749430 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 118709277 0 0) 0x7f95080cfef0 con 0x7f95080725a0 2024-04-26T23:43:30.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.222+0000 7f9506a00640 1 -- 172.21.15.137:0/1289749430 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94ec003530 con 0x7f95080725a0 2024-04-26T23:43:30.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.222+0000 7f9507e00640 1 -- 172.21.15.137:0/1289749430 >> v2:172.21.15.170:3300/0 conn(0x7f95080b5080 msgr2=0x7f95080cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:30.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.222+0000 7f9507e00640 1 --2- 172.21.15.137:0/1289749430 >> v2:172.21.15.170:3300/0 conn(0x7f95080b5080 0x7f95080cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.222+0000 7f9507e00640 1 -- 172.21.15.137:0/1289749430 >> v1:172.21.15.137:6789/0 conn(0x7f95080725a0 legacy=0x7f9508073f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:30.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.222+0000 7f9507e00640 1 -- 172.21.15.137:0/1289749430 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95080d0490 con 0x7f9508072980 2024-04-26T23:43:30.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.222+0000 7f9507e00640 1 --2- 172.21.15.137:0/1289749430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9508072980 0x7f9508072e30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f95000097f0 tx=0x7f950001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd2309853a03325a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:30.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.222+0000 7f9506a00640 1 -- 172.21.15.137:0/1289749430 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95000a7070 con 0x7f9508072980 2024-04-26T23:43:30.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.222+0000 7f9506a00640 1 -- 172.21.15.137:0/1289749430 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95000b0070 con 0x7f9508072980 2024-04-26T23:43:30.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.222+0000 7f9506a00640 1 -- 172.21.15.137:0/1289749430 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95000ab890 con 0x7f9508072980 2024-04-26T23:43:30.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f950e000640 1 -- 172.21.15.137:0/1289749430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9508072980 msgr2=0x7f9508072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:30.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f950e000640 1 --2- 172.21.15.137:0/1289749430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9508072980 0x7f9508072e30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f95000097f0 tx=0x7f950001c470 comp rx=0 tx=0).stop 2024-04-26T23:43:30.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f950e000640 1 -- 172.21.15.137:0/1289749430 shutdown_connections 2024-04-26T23:43:30.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f950e000640 1 --2- 172.21.15.137:0/1289749430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9508072980 0x7f9508072e30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f950e000640 1 --2- 172.21.15.137:0/1289749430 >> v2:172.21.15.170:3300/0 conn(0x7f95080b5080 0x7f95080cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f950e000640 1 -- 172.21.15.137:0/1289749430 >> 172.21.15.137:0/1289749430 conn(0x7f950806c5d0 msgr2=0x7f950806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:30.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f950e000640 1 -- 172.21.15.137:0/1289749430 shutdown_connections 2024-04-26T23:43:30.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f950e000640 1 -- 172.21.15.137:0/1289749430 wait complete. 2024-04-26T23:43:30.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f950e000640 1 Processor -- start 2024-04-26T23:43:30.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f950e000640 1 -- start start 2024-04-26T23:43:30.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f950e000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95080725a0 0x7f95080b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f950e000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9508072980 0x7f95080b3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f950e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95080b5080 0x7f9508143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f950e000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f95081684e0 con 0x7f95080b5080 2024-04-26T23:43:30.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f950e000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9508168360 con 0x7f95080725a0 2024-04-26T23:43:30.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f950e000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9508168660 con 0x7f9508072980 2024-04-26T23:43:30.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f9507e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95080b5080 0x7f9508143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f9507e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95080b5080 0x7f9508143f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55008/0 (socket says 172.21.15.137:55008) 2024-04-26T23:43:30.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f9507e00640 1 -- 172.21.15.137:0/2827748920 learned_addr learned my addr 172.21.15.137:0/2827748920 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:30.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f9507400640 1 --2- 172.21.15.137:0/2827748920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95080725a0 0x7f95080b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f94fea00640 1 --2- 172.21.15.137:0/2827748920 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9508072980 0x7f95080b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f9507e00640 1 -- 172.21.15.137:0/2827748920 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9508072980 msgr2=0x7f95080b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:30.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f9507e00640 1 --2- 172.21.15.137:0/2827748920 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9508072980 0x7f95080b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f9507e00640 1 -- 172.21.15.137:0/2827748920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95080725a0 msgr2=0x7f95080b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:30.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f9507e00640 1 --2- 172.21.15.137:0/2827748920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95080725a0 0x7f95080b0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f9507e00640 1 -- 172.21.15.137:0/2827748920 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95080b3ca0 con 0x7f95080b5080 2024-04-26T23:43:30.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.226+0000 7f94fea00640 1 --2- 172.21.15.137:0/2827748920 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9508072980 0x7f95080b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:30.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.230+0000 7f9507e00640 1 --2- 172.21.15.137:0/2827748920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95080b5080 0x7f9508143f40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f95000ad040 tx=0x7f950001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:30.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.230+0000 7f94ffe00640 1 -- 172.21.15.137:0/2827748920 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95000bf410 con 0x7f95080b5080 2024-04-26T23:43:30.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.230+0000 7f94ffe00640 1 -- 172.21.15.137:0/2827748920 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95000bf5b0 con 0x7f95080b5080 2024-04-26T23:43:30.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.230+0000 7f950e000640 1 -- 172.21.15.137:0/2827748920 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95080b0ec0 con 0x7f95080b5080 2024-04-26T23:43:30.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.230+0000 7f94ffe00640 1 -- 172.21.15.137:0/2827748920 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95000bf980 con 0x7f95080b5080 2024-04-26T23:43:30.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.230+0000 7f950e000640 1 -- 172.21.15.137:0/2827748920 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9508141690 con 0x7f95080b5080 2024-04-26T23:43:30.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.230+0000 7f950e000640 1 -- 172.21.15.137:0/2827748920 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95080b13e0 con 0x7f95080b5080 2024-04-26T23:43:30.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.230+0000 7f94ffe00640 1 -- 172.21.15.137:0/2827748920 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f95000bd020 con 0x7f95080b5080 2024-04-26T23:43:30.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.230+0000 7f94ffe00640 1 --2- 172.21.15.137:0/2827748920 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f94e40683b0 0x7f94e406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.230+0000 7f94ffe00640 1 -- 172.21.15.137:0/2827748920 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f9500121b00 con 0x7f95080b5080 2024-04-26T23:43:30.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.230+0000 7f9507400640 1 --2- 172.21.15.137:0/2827748920 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f94e40683b0 0x7f94e406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.234+0000 7f9507400640 1 --2- 172.21.15.137:0/2827748920 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f94e40683b0 0x7f94e406a870 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f94f8005c10 tx=0x7f94f8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:30.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.238+0000 7f94ffe00640 1 -- 172.21.15.137:0/2827748920 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9500016090 con 0x7f95080b5080 2024-04-26T23:43:30.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.430+0000 7f950e000640 1 -- 172.21.15.137:0/2827748920 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9508072380 con 0x7f95080b5080 2024-04-26T23:43:30.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.430+0000 7f94ffe00640 1 -- 172.21.15.137:0/2827748920 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7f95000f1160 con 0x7f95080b5080 2024-04-26T23:43:30.437 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:43:30.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.430+0000 7f950e000640 1 -- 172.21.15.137:0/2827748920 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f94e40683b0 msgr2=0x7f94e406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:30.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.430+0000 7f950e000640 1 --2- 172.21.15.137:0/2827748920 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f94e40683b0 0x7f94e406a870 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f94f8005c10 tx=0x7f94f8009040 comp rx=0 tx=0).stop 2024-04-26T23:43:30.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.430+0000 7f950e000640 1 -- 172.21.15.137:0/2827748920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95080b5080 msgr2=0x7f9508143f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:30.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.430+0000 7f950e000640 1 --2- 172.21.15.137:0/2827748920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95080b5080 0x7f9508143f40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f95000ad040 tx=0x7f950001acb0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.430+0000 7f950e000640 1 -- 172.21.15.137:0/2827748920 shutdown_connections 2024-04-26T23:43:30.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.430+0000 7f950e000640 1 --2- 172.21.15.137:0/2827748920 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f94e40683b0 0x7f94e406a870 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.430+0000 7f950e000640 1 --2- 172.21.15.137:0/2827748920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95080b5080 0x7f9508143f40 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.430+0000 7f950e000640 1 --2- 172.21.15.137:0/2827748920 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9508072980 0x7f95080b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.430+0000 7f950e000640 1 --2- 172.21.15.137:0/2827748920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95080725a0 0x7f95080b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.430+0000 7f950e000640 1 -- 172.21.15.137:0/2827748920 >> 172.21.15.137:0/2827748920 conn(0x7f950806c5d0 msgr2=0x7f950806c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:30.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.430+0000 7f950e000640 1 -- 172.21.15.137:0/2827748920 shutdown_connections 2024-04-26T23:43:30.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30.430+0000 7f950e000640 1 -- 172.21.15.137:0/2827748920 wait complete. 2024-04-26T23:43:30.458 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:43:30.458 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:43:30.459 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T23:43:30.459 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T23:43:30.459 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T23:43:30.459 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:43:30.459 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:43:30.459 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:43:30.459 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:43:30.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:30.459 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T23:43:30.468 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:43:30.468 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:43:30.468 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:43:30.468 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:30.468 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T23:43:30.468 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:30.469 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:43:30.469 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T23:43:30.469 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T23:43:30.469 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:43:30.469 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T23:43:30.469 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T23:43:30.469 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:43:30.469 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:43:30.469 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:43:30.469 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:43:30.469 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:43:30.469 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42352sec preferred_lft 42352sec 2024-04-26T23:43:30.469 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link 2024-04-26T23:43:30.469 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:30.469 INFO:teuthology.orchestra.run.smithi137.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:43:30.470 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 02:42:f4:6f:af:56 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:43:30.470 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:43:30.470 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:30.470 INFO:teuthology.orchestra.run.smithi137.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:43:30.470 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:43:30.470 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:43:30.470 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:30.470 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T23:43:30.470 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:30.470 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:43:30.470 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:43:30.470 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:43:30.470 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:30.470 INFO:teuthology.orchestra.run.smithi137.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:43:30.471 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:43:30.471 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-26T23:43:30.471 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:30.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:30.472 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:43:30.532 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T23:43:30.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:30.535 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T23:43:30.587 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T23:43:30.587 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:43:30.587 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:43:30.587 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:43:30.587 INFO:teuthology.orchestra.run.smithi137.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:43:30.587 INFO:teuthology.orchestra.run.smithi137.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:43:30.587 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:43:30.587 INFO:teuthology.orchestra.run.smithi137.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:43:30.587 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:43:30.588 INFO:teuthology.orchestra.run.smithi137.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:43:30.588 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:43:30.588 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:43:30.588 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T23:43:30.588 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:43:30.588 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:43:30.588 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:43:30.588 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T23:43:30.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:43:30.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:43:30.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:30.724 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T23:43:30.733 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T23:43:30.733 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T23:43:30.734 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:43:30.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:30.734 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-26T23:43:30.795 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-26T23:43:30.795 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:43:30.795 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T23:43:30.843 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:43:30.843 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:43:30.843 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:43:30.890 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-26T23:43:30.951 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:43:31.005 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-26T23:43:31.005 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-26T23:43:31.005 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-26T23:43:31.005 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-26T23:43:31.005 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-26T23:43:31.005 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-26T23:43:31.005 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-26T23:43:31.005 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-26T23:43:31.006 INFO:teuthology.orchestra.run.smithi137.stdout:/run/lock 2024-04-26T23:43:31.006 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-26T23:43:31.006 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-26T23:43:31.006 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-26T23:43:31.006 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:43:31.006 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-26T23:43:31.006 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-26T23:43:31.006 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-26T23:43:31.006 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-26T23:43:31.006 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/fs/nfsd 2024-04-26T23:43:31.006 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-26T23:43:31.006 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-26T23:43:31.006 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:43:31.007 INFO:teuthology.orchestra.run.smithi137.stdout:/run/rpc_pipefs 2024-04-26T23:43:31.007 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-26T23:43:31.007 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-26T23:43:31.007 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:43:31.007 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:43:31.007 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:43:31.007 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:43:31.007 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-26T23:43:31.007 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:43:31.007 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:43:31.007 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:43:31.007 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:43:31.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:31.008 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-26T23:43:31.063 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T23:43:31.063 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-26T23:43:31.106 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-26T23:43:31.128 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:43:31.182 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-26T23:43:31.182 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-26T23:43:31.182 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-26T23:43:31.182 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-26T23:43:31.182 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-26T23:43:31.182 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-26T23:43:31.182 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-26T23:43:31.182 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-26T23:43:31.182 INFO:teuthology.orchestra.run.smithi137.stdout:/run/lock 2024-04-26T23:43:31.183 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-26T23:43:31.183 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-26T23:43:31.183 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-26T23:43:31.183 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:43:31.183 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-26T23:43:31.183 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-26T23:43:31.183 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-26T23:43:31.183 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-26T23:43:31.183 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/fs/nfsd 2024-04-26T23:43:31.183 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-26T23:43:31.183 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-26T23:43:31.183 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:43:31.183 INFO:teuthology.orchestra.run.smithi137.stdout:/run/rpc_pipefs 2024-04-26T23:43:31.183 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-26T23:43:31.184 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-26T23:43:31.184 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:43:31.184 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:43:31.184 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:43:31.184 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:43:31.184 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-26T23:43:31.184 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:43:31.184 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:43:31.184 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:43:31.184 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:43:31.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:31.185 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-26T23:43:31.201 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:2024-04-26T23:43:31.194+0000 7f6fa0b93580 -1 init, newargv = 0x55bbe8311290 newargc=15 2024-04-26T23:43:31.201 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:ceph-fuse[40127]: starting ceph client 2024-04-26T23:43:31.208 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:ceph-fuse[40127]: starting fuse 2024-04-26T23:43:31.210 INFO:teuthology.orchestra.run.smithi137.stdout:44 2024-04-26T23:43:31.211 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T23:43:31.211 DEBUG:teuthology.orchestra.run.smithi137:> sudo stdin-killer -- python3 -c ' 2024-04-26T23:43:31.211 DEBUG:teuthology.orchestra.run.smithi137:> import glob 2024-04-26T23:43:31.211 DEBUG:teuthology.orchestra.run.smithi137:> import re 2024-04-26T23:43:31.211 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T23:43:31.211 DEBUG:teuthology.orchestra.run.smithi137:> import subprocess 2024-04-26T23:43:31.211 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:43:31.211 DEBUG:teuthology.orchestra.run.smithi137:> def _find_admin_socket(client_name): 2024-04-26T23:43:31.211 DEBUG:teuthology.orchestra.run.smithi137:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T23:43:31.211 DEBUG:teuthology.orchestra.run.smithi137:> files = glob.glob(asok_path) 2024-04-26T23:43:31.211 DEBUG:teuthology.orchestra.run.smithi137:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T23:43:31.211 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:43:31.212 DEBUG:teuthology.orchestra.run.smithi137:> # Given a non-glob path, it better be there 2024-04-26T23:43:31.212 DEBUG:teuthology.orchestra.run.smithi137:> if "*" not in asok_path: 2024-04-26T23:43:31.212 DEBUG:teuthology.orchestra.run.smithi137:> assert(len(files) == 1) 2024-04-26T23:43:31.212 DEBUG:teuthology.orchestra.run.smithi137:> return files[0] 2024-04-26T23:43:31.212 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:43:31.212 DEBUG:teuthology.orchestra.run.smithi137:> for f in files: 2024-04-26T23:43:31.212 DEBUG:teuthology.orchestra.run.smithi137:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T23:43:31.212 DEBUG:teuthology.orchestra.run.smithi137:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T23:43:31.212 DEBUG:teuthology.orchestra.run.smithi137:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T23:43:31.212 DEBUG:teuthology.orchestra.run.smithi137:> contents = proc_f.read() 2024-04-26T23:43:31.212 DEBUG:teuthology.orchestra.run.smithi137:> if mountpoint in contents: 2024-04-26T23:43:31.212 DEBUG:teuthology.orchestra.run.smithi137:> return f 2024-04-26T23:43:31.212 DEBUG:teuthology.orchestra.run.smithi137:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T23:43:31.212 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:43:31.212 DEBUG:teuthology.orchestra.run.smithi137:> print(_find_admin_socket("client.0")) 2024-04-26T23:43:31.212 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T23:43:31.332 INFO:teuthology.orchestra.run.smithi137.stdout:/var/run/ceph/ceph-client.0.40127.asok 2024-04-26T23:43:31.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:43:31.343 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.40127.asok 2024-04-26T23:43:31.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:31.343 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.40127.asok status 2024-04-26T23:43:31.510 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:43:31.510 INFO:teuthology.orchestra.run.smithi137.stdout: "metadata": { 2024-04-26T23:43:31.511 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T23:43:31.511 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T23:43:31.511 INFO:teuthology.orchestra.run.smithi137.stdout: "entity_id": "0", 2024-04-26T23:43:31.511 INFO:teuthology.orchestra.run.smithi137.stdout: "hostname": "smithi137", 2024-04-26T23:43:31.511 INFO:teuthology.orchestra.run.smithi137.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-26T23:43:31.511 INFO:teuthology.orchestra.run.smithi137.stdout: "pid": "40127", 2024-04-26T23:43:31.511 INFO:teuthology.orchestra.run.smithi137.stdout: "root": "/" 2024-04-26T23:43:31.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:31.511 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_count": 0, 2024-04-26T23:43:31.511 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_pinned_count": 0, 2024-04-26T23:43:31.511 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 5991, 2024-04-26T23:43:31.511 INFO:teuthology.orchestra.run.smithi137.stdout: "inst": { 2024-04-26T23:43:31.512 INFO:teuthology.orchestra.run.smithi137.stdout: "name": { 2024-04-26T23:43:31.512 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "client", 2024-04-26T23:43:31.512 INFO:teuthology.orchestra.run.smithi137.stdout: "num": 5991 2024-04-26T23:43:31.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:31.512 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2024-04-26T23:43:31.512 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-26T23:43:31.512 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:43:31.512 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 268105340 2024-04-26T23:43:31.512 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:31.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:31.512 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2024-04-26T23:43:31.512 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-26T23:43:31.512 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:43:31.512 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 268105340 2024-04-26T23:43:31.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:31.513 INFO:teuthology.orchestra.run.smithi137.stdout: "inst_str": "client.5991 192.168.0.1:0/268105340", 2024-04-26T23:43:31.513 INFO:teuthology.orchestra.run.smithi137.stdout: "addr_str": "192.168.0.1:0/268105340", 2024-04-26T23:43:31.513 INFO:teuthology.orchestra.run.smithi137.stdout: "inode_count": 1, 2024-04-26T23:43:31.513 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_epoch": 25, 2024-04-26T23:43:31.513 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch": 45, 2024-04-26T23:43:31.513 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch_barrier": 0, 2024-04-26T23:43:31.513 INFO:teuthology.orchestra.run.smithi137.stdout: "blocklisted": false, 2024-04-26T23:43:31.513 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs" 2024-04-26T23:43:31.514 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:43:31.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:31.525 DEBUG:teuthology.orchestra.run.smithi137:> stat --file-system '--printf=%T 2024-04-26T23:43:31.525 DEBUG:teuthology.orchestra.run.smithi137:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-26T23:43:31.534 INFO:teuthology.orchestra.run.smithi137.stdout:fuseblk 2024-04-26T23:43:31.534 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-26T23:43:31.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:31.534 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:43:31.599 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:43:31.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.770+0000 7f9ac4200640 1 Processor -- start 2024-04-26T23:43:31.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.770+0000 7f9ac4200640 1 -- start start 2024-04-26T23:43:31.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.770+0000 7f9ac4200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9abc15c0a0 0x7f9abc06d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:31.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.774+0000 7f9ac4200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9abc06d950 con 0x7f9abc070e80 2024-04-26T23:43:31.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.774+0000 7f9ac4200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9abc06dbd0 con 0x7f9abc0b6640 2024-04-26T23:43:31.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.774+0000 7f9ac4200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f9abc09ff60 con 0x7f9abc15c0a0 2024-04-26T23:43:31.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.774+0000 7f9ac1800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9abc15c0a0 0x7f9abc06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:31.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.774+0000 7f9ac0e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f9abc070e80 0x7f9abc0b5f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:36308/0 (socket says 172.21.15.137:36308) 2024-04-26T23:43:31.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.774+0000 7f9ac1800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9abc15c0a0 0x7f9abc06d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53536/0 (socket says 172.21.15.137:53536) 2024-04-26T23:43:31.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.774+0000 7f9ac0e00640 1 -- 172.21.15.137:0/2785975169 learned_addr learned my addr 172.21.15.137:0/2785975169 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:31.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.774+0000 7f9ac1800640 1 -- 172.21.15.137:0/2785975169 >> v1:172.21.15.170:6789/0 conn(0x7f9abc0b6640 legacy=0x7f9abc0b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:31.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.774+0000 7f9ac1800640 1 -- 172.21.15.137:0/2785975169 >> v1:172.21.15.137:6789/0 conn(0x7f9abc070e80 legacy=0x7f9abc0b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:31.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.774+0000 7f9ac1800640 1 -- 172.21.15.137:0/2785975169 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9abc15fb30 con 0x7f9abc15c0a0 2024-04-26T23:43:31.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.774+0000 7f9ac1800640 1 --2- 172.21.15.137:0/2785975169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9abc15c0a0 0x7f9abc06d410 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00097c0 tx=0x7f9ab001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650037324e503a4c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:31.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.774+0000 7f9abbe00640 1 -- 172.21.15.137:0/2785975169 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00b0070 con 0x7f9abc15c0a0 2024-04-26T23:43:31.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.774+0000 7f9abbe00640 1 -- 172.21.15.137:0/2785975169 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab00ab600 con 0x7f9abc15c0a0 2024-04-26T23:43:31.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.774+0000 7f9abbe00640 1 -- 172.21.15.137:0/2785975169 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00a4e60 con 0x7f9abc15c0a0 2024-04-26T23:43:31.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac4200640 1 -- 172.21.15.137:0/2785975169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9abc15c0a0 msgr2=0x7f9abc06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:31.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac4200640 1 --2- 172.21.15.137:0/2785975169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9abc15c0a0 0x7f9abc06d410 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00097c0 tx=0x7f9ab001c3d0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac4200640 1 -- 172.21.15.137:0/2785975169 shutdown_connections 2024-04-26T23:43:31.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac4200640 1 --2- 172.21.15.137:0/2785975169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9abc15c0a0 0x7f9abc06d410 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac4200640 1 -- 172.21.15.137:0/2785975169 >> 172.21.15.137:0/2785975169 conn(0x7f9abc073210 msgr2=0x7f9abc073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:31.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac4200640 1 -- 172.21.15.137:0/2785975169 shutdown_connections 2024-04-26T23:43:31.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac4200640 1 -- 172.21.15.137:0/2785975169 wait complete. 2024-04-26T23:43:31.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac4200640 1 Processor -- start 2024-04-26T23:43:31.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac4200640 1 -- start start 2024-04-26T23:43:31.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac4200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9abc070e80 0x7f9abc15f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:31.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac4200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9abc0b6640 0x7f9abc14aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:31.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac4200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9abc1fbd70 0x7f9abc06f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:31.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac4200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc075710 con 0x7f9abc070e80 2024-04-26T23:43:31.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac4200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc075590 con 0x7f9abc1fbd70 2024-04-26T23:43:31.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac4200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9abc075890 con 0x7f9abc0b6640 2024-04-26T23:43:31.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac1800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9abc070e80 0x7f9abc15f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:31.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac1800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9abc070e80 0x7f9abc15f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53546/0 (socket says 172.21.15.137:53546) 2024-04-26T23:43:31.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac1800640 1 -- 172.21.15.137:0/1478320245 learned_addr learned my addr 172.21.15.137:0/1478320245 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:31.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac1800640 1 -- 172.21.15.137:0/1478320245 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9abc0b6640 msgr2=0x7f9abc14aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:31.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac1800640 1 --2- 172.21.15.137:0/1478320245 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9abc0b6640 0x7f9abc14aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac1800640 1 -- 172.21.15.137:0/1478320245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9abc1fbd70 msgr2=0x7f9abc06f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:31.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac1800640 1 --2- 172.21.15.137:0/1478320245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9abc1fbd70 0x7f9abc06f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.778+0000 7f9ac1800640 1 -- 172.21.15.137:0/1478320245 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9abc1fc2d0 con 0x7f9abc070e80 2024-04-26T23:43:31.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.782+0000 7f9ac1800640 1 --2- 172.21.15.137:0/1478320245 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9abc070e80 0x7f9abc15f1e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00ae040 tx=0x7f9ab001ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:31.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.782+0000 7f9ab9600640 1 -- 172.21.15.137:0/1478320245 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00b0050 con 0x7f9abc070e80 2024-04-26T23:43:31.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.782+0000 7f9ab9600640 1 -- 172.21.15.137:0/1478320245 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab00bc070 con 0x7f9abc070e80 2024-04-26T23:43:31.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.782+0000 7f9ab9600640 1 -- 172.21.15.137:0/1478320245 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00aabc0 con 0x7f9abc070e80 2024-04-26T23:43:31.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.782+0000 7f9ac4200640 1 -- 172.21.15.137:0/1478320245 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9abc1fc5b0 con 0x7f9abc070e80 2024-04-26T23:43:31.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.782+0000 7f9ac4200640 1 -- 172.21.15.137:0/1478320245 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9abc1fcb70 con 0x7f9abc070e80 2024-04-26T23:43:31.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.782+0000 7f9ac4200640 1 -- 172.21.15.137:0/1478320245 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9abc15f780 con 0x7f9abc070e80 2024-04-26T23:43:31.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.782+0000 7f9ab9600640 1 -- 172.21.15.137:0/1478320245 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9ab00c1460 con 0x7f9abc070e80 2024-04-26T23:43:31.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.782+0000 7f9ab9600640 1 --2- 172.21.15.137:0/1478320245 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9a9c068380 0x7f9a9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:31.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.782+0000 7f9ab9600640 1 -- 172.21.15.137:0/1478320245 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f9ab01213b0 con 0x7f9abc070e80 2024-04-26T23:43:31.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.782+0000 7f9ac0e00640 1 --2- 172.21.15.137:0/1478320245 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9a9c068380 0x7f9a9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:31.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.786+0000 7f9ac0e00640 1 --2- 172.21.15.137:0/1478320245 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9a9c068380 0x7f9a9c06a840 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8000f70 tx=0x7f9aa8007a90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:31.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.786+0000 7f9ab9600640 1 -- 172.21.15.137:0/1478320245 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9ab0016050 con 0x7f9abc070e80 2024-04-26T23:43:31.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.978+0000 7f9ac4200640 1 -- 172.21.15.137:0/1478320245 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9abc06a4b0 con 0x7f9abc070e80 2024-04-26T23:43:31.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.978+0000 7f9ab9600640 1 -- 172.21.15.137:0/1478320245 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7f9ab00f1960 con 0x7f9abc070e80 2024-04-26T23:43:31.987 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:43:31.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.978+0000 7f9ac4200640 1 -- 172.21.15.137:0/1478320245 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9a9c068380 msgr2=0x7f9a9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:31.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.978+0000 7f9ac4200640 1 --2- 172.21.15.137:0/1478320245 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9a9c068380 0x7f9a9c06a840 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8000f70 tx=0x7f9aa8007a90 comp rx=0 tx=0).stop 2024-04-26T23:43:31.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.978+0000 7f9ac4200640 1 -- 172.21.15.137:0/1478320245 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9abc070e80 msgr2=0x7f9abc15f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:31.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.978+0000 7f9ac4200640 1 --2- 172.21.15.137:0/1478320245 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9abc070e80 0x7f9abc15f1e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00ae040 tx=0x7f9ab001ac10 comp rx=0 tx=0).stop 2024-04-26T23:43:31.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.978+0000 7f9ac4200640 1 -- 172.21.15.137:0/1478320245 shutdown_connections 2024-04-26T23:43:31.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.978+0000 7f9ac4200640 1 --2- 172.21.15.137:0/1478320245 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9a9c068380 0x7f9a9c06a840 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.978+0000 7f9ac4200640 1 --2- 172.21.15.137:0/1478320245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9abc1fbd70 0x7f9abc06f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.978+0000 7f9ac4200640 1 --2- 172.21.15.137:0/1478320245 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9abc0b6640 0x7f9abc14aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.978+0000 7f9ac4200640 1 --2- 172.21.15.137:0/1478320245 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9abc070e80 0x7f9abc15f1e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.978+0000 7f9ac4200640 1 -- 172.21.15.137:0/1478320245 >> 172.21.15.137:0/1478320245 conn(0x7f9abc073210 msgr2=0x7f9abc169da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:31.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.982+0000 7f9ac4200640 1 -- 172.21.15.137:0/1478320245 shutdown_connections 2024-04-26T23:43:31.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:31.982+0000 7f9ac4200640 1 -- 172.21.15.137:0/1478320245 wait complete. 2024-04-26T23:43:32.007 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:43:32.007 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:43:32.007 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi170.front.sepia.ceph.com 2024-04-26T23:43:32.007 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-26T23:43:32.007 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T23:43:32.007 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:43:32.008 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:43:32.008 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:43:32.008 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:43:32.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:32.008 DEBUG:teuthology.orchestra.run.smithi170:> ip addr 2024-04-26T23:43:32.018 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:43:32.018 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:43:32.018 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:43:32.018 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:32.018 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2024-04-26T23:43:32.018 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:32.019 INFO:teuthology.orchestra.run.smithi170.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:43:32.019 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:54 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:43:32.019 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f0 2024-04-26T23:43:32.019 INFO:teuthology.orchestra.run.smithi170.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:43:32.019 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:55 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:43:32.019 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f1 2024-04-26T23:43:32.019 INFO:teuthology.orchestra.run.smithi170.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:43:32.019 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:54 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:43:32.019 INFO:teuthology.orchestra.run.smithi170.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:43:32.019 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:55 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:43:32.019 INFO:teuthology.orchestra.run.smithi170.stdout: inet 172.21.15.170/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:43:32.019 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft 42354sec preferred_lft 42354sec 2024-04-26T23:43:32.019 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::ec4:7aff:fe88:7255/64 scope link 2024-04-26T23:43:32.019 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:32.020 INFO:teuthology.orchestra.run.smithi170.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:43:32.020 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 02:42:23:a7:19:38 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:43:32.020 INFO:teuthology.orchestra.run.smithi170.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:43:32.020 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:32.020 INFO:teuthology.orchestra.run.smithi170.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:43:32.020 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:43:32.020 INFO:teuthology.orchestra.run.smithi170.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:43:32.020 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:32.020 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T23:43:32.020 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:32.021 INFO:teuthology.orchestra.run.smithi170.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:43:32.021 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:43:32.021 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:43:32.021 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:32.021 INFO:teuthology.orchestra.run.smithi170.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:43:32.021 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:43:32.021 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-26T23:43:32.021 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:32.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:32.023 DEBUG:teuthology.orchestra.run.smithi170:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:43:32.085 INFO:teuthology.orchestra.run.smithi170.stdout:1 2024-04-26T23:43:32.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:32.088 DEBUG:teuthology.orchestra.run.smithi170:> route 2024-04-26T23:43:32.140 INFO:teuthology.orchestra.run.smithi170.stdout:Kernel IP routing table 2024-04-26T23:43:32.141 INFO:teuthology.orchestra.run.smithi170.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:43:32.141 INFO:teuthology.orchestra.run.smithi170.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:43:32.141 INFO:teuthology.orchestra.run.smithi170.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:43:32.141 INFO:teuthology.orchestra.run.smithi170.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:43:32.141 INFO:teuthology.orchestra.run.smithi170.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:43:32.141 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:43:32.141 INFO:teuthology.orchestra.run.smithi170.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:43:32.141 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:43:32.141 INFO:teuthology.orchestra.run.smithi170.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:43:32.141 INFO:teuthology.orchestra.run.smithi170.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:43:32.142 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:43:32.142 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-04-26T23:43:32.142 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:43:32.142 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:43:32.142 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:43:32.142 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-04-26T23:43:32.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:43:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:43:32.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:43:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:43:32.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:32.292 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-04-26T23:43:32.301 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T23:43:32.302 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-26T23:43:32.302 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:43:32.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:32.303 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set brx.0 up 2024-04-26T23:43:32.368 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-26T23:43:32.368 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:43:32.369 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-26T23:43:32.417 INFO:teuthology.orchestra.run.smithi170.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:43:32.417 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:43:32.417 DEBUG:teuthology.orchestra.run.smithi170:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:43:32.468 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2024-04-26T23:43:32.530 DEBUG:teuthology.orchestra.run.smithi170:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:43:32.582 INFO:teuthology.orchestra.run.smithi170.stdout:/sys 2024-04-26T23:43:32.582 INFO:teuthology.orchestra.run.smithi170.stdout:/proc 2024-04-26T23:43:32.582 INFO:teuthology.orchestra.run.smithi170.stdout:/dev 2024-04-26T23:43:32.582 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/pts 2024-04-26T23:43:32.582 INFO:teuthology.orchestra.run.smithi170.stdout:/run 2024-04-26T23:43:32.582 INFO:teuthology.orchestra.run.smithi170.stdout:/ 2024-04-26T23:43:32.583 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/security 2024-04-26T23:43:32.583 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/shm 2024-04-26T23:43:32.583 INFO:teuthology.orchestra.run.smithi170.stdout:/run/lock 2024-04-26T23:43:32.583 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/cgroup 2024-04-26T23:43:32.583 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/pstore 2024-04-26T23:43:32.583 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/bpf 2024-04-26T23:43:32.583 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:43:32.583 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/hugepages 2024-04-26T23:43:32.583 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/mqueue 2024-04-26T23:43:32.583 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/debug 2024-04-26T23:43:32.583 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/tracing 2024-04-26T23:43:32.583 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/fs/nfsd 2024-04-26T23:43:32.583 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/fuse/connections 2024-04-26T23:43:32.583 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/config 2024-04-26T23:43:32.584 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:43:32.584 INFO:teuthology.orchestra.run.smithi170.stdout:/run/rpc_pipefs 2024-04-26T23:43:32.584 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/1000 2024-04-26T23:43:32.584 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph 2024-04-26T23:43:32.584 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:43:32.584 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:43:32.584 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:43:32.584 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:43:32.584 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns 2024-04-26T23:43:32.584 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:43:32.584 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:43:32.584 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:43:32.584 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:43:32.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:32.585 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2024-04-26T23:43:32.640 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T23:43:32.640 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-26T23:43:32.687 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2024-04-26T23:43:32.708 DEBUG:teuthology.orchestra.run.smithi170:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:43:32.758 INFO:teuthology.orchestra.run.smithi170.stdout:/sys 2024-04-26T23:43:32.758 INFO:teuthology.orchestra.run.smithi170.stdout:/proc 2024-04-26T23:43:32.758 INFO:teuthology.orchestra.run.smithi170.stdout:/dev 2024-04-26T23:43:32.759 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/pts 2024-04-26T23:43:32.759 INFO:teuthology.orchestra.run.smithi170.stdout:/run 2024-04-26T23:43:32.759 INFO:teuthology.orchestra.run.smithi170.stdout:/ 2024-04-26T23:43:32.759 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/security 2024-04-26T23:43:32.759 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/shm 2024-04-26T23:43:32.759 INFO:teuthology.orchestra.run.smithi170.stdout:/run/lock 2024-04-26T23:43:32.759 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/cgroup 2024-04-26T23:43:32.759 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/pstore 2024-04-26T23:43:32.759 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/bpf 2024-04-26T23:43:32.759 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:43:32.759 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/hugepages 2024-04-26T23:43:32.759 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/mqueue 2024-04-26T23:43:32.760 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/debug 2024-04-26T23:43:32.760 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/tracing 2024-04-26T23:43:32.760 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/fs/nfsd 2024-04-26T23:43:32.760 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/fuse/connections 2024-04-26T23:43:32.760 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/config 2024-04-26T23:43:32.760 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:43:32.760 INFO:teuthology.orchestra.run.smithi170.stdout:/run/rpc_pipefs 2024-04-26T23:43:32.760 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/1000 2024-04-26T23:43:32.760 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph 2024-04-26T23:43:32.760 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:43:32.760 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:43:32.760 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:43:32.761 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:43:32.761 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns 2024-04-26T23:43:32.761 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:43:32.761 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:43:32.761 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:43:32.761 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:43:32.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:32.762 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2024-04-26T23:43:32.781 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:2024-04-26T23:43:32.772+0000 7fde0204b580 -1 init, newargv = 0x55a071693710 newargc=15 2024-04-26T23:43:32.781 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:ceph-fuse[32605]: starting ceph client 2024-04-26T23:43:32.788 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:ceph-fuse[32605]: starting fuse 2024-04-26T23:43:32.789 INFO:teuthology.orchestra.run.smithi170.stdout:44 2024-04-26T23:43:32.790 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T23:43:32.790 DEBUG:teuthology.orchestra.run.smithi170:> sudo stdin-killer -- python3 -c ' 2024-04-26T23:43:32.790 DEBUG:teuthology.orchestra.run.smithi170:> import glob 2024-04-26T23:43:32.790 DEBUG:teuthology.orchestra.run.smithi170:> import re 2024-04-26T23:43:32.790 DEBUG:teuthology.orchestra.run.smithi170:> import os 2024-04-26T23:43:32.790 DEBUG:teuthology.orchestra.run.smithi170:> import subprocess 2024-04-26T23:43:32.790 DEBUG:teuthology.orchestra.run.smithi170:> 2024-04-26T23:43:32.790 DEBUG:teuthology.orchestra.run.smithi170:> def _find_admin_socket(client_name): 2024-04-26T23:43:32.791 DEBUG:teuthology.orchestra.run.smithi170:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-26T23:43:32.791 DEBUG:teuthology.orchestra.run.smithi170:> files = glob.glob(asok_path) 2024-04-26T23:43:32.791 DEBUG:teuthology.orchestra.run.smithi170:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-26T23:43:32.791 DEBUG:teuthology.orchestra.run.smithi170:> 2024-04-26T23:43:32.791 DEBUG:teuthology.orchestra.run.smithi170:> # Given a non-glob path, it better be there 2024-04-26T23:43:32.791 DEBUG:teuthology.orchestra.run.smithi170:> if "*" not in asok_path: 2024-04-26T23:43:32.791 DEBUG:teuthology.orchestra.run.smithi170:> assert(len(files) == 1) 2024-04-26T23:43:32.791 DEBUG:teuthology.orchestra.run.smithi170:> return files[0] 2024-04-26T23:43:32.791 DEBUG:teuthology.orchestra.run.smithi170:> 2024-04-26T23:43:32.791 DEBUG:teuthology.orchestra.run.smithi170:> for f in files: 2024-04-26T23:43:32.791 DEBUG:teuthology.orchestra.run.smithi170:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T23:43:32.791 DEBUG:teuthology.orchestra.run.smithi170:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T23:43:32.791 DEBUG:teuthology.orchestra.run.smithi170:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T23:43:32.791 DEBUG:teuthology.orchestra.run.smithi170:> contents = proc_f.read() 2024-04-26T23:43:32.792 DEBUG:teuthology.orchestra.run.smithi170:> if mountpoint in contents: 2024-04-26T23:43:32.792 DEBUG:teuthology.orchestra.run.smithi170:> return f 2024-04-26T23:43:32.792 DEBUG:teuthology.orchestra.run.smithi170:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T23:43:32.792 DEBUG:teuthology.orchestra.run.smithi170:> 2024-04-26T23:43:32.792 DEBUG:teuthology.orchestra.run.smithi170:> print(_find_admin_socket("client.1")) 2024-04-26T23:43:32.792 DEBUG:teuthology.orchestra.run.smithi170:> ' 2024-04-26T23:43:32.916 INFO:teuthology.orchestra.run.smithi170.stdout:/var/run/ceph/ceph-client.1.32605.asok 2024-04-26T23:43:32.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:43:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:43:32.928 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.32605.asok 2024-04-26T23:43:32.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:32.928 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.32605.asok status 2024-04-26T23:43:33.095 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-26T23:43:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: "metadata": { 2024-04-26T23:43:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T23:43:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T23:43:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: "entity_id": "1", 2024-04-26T23:43:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: "hostname": "smithi170", 2024-04-26T23:43:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-26T23:43:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: "pid": "32605", 2024-04-26T23:43:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: "root": "/" 2024-04-26T23:43:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-26T23:43:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: "dentry_count": 0, 2024-04-26T23:43:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: "dentry_pinned_count": 0, 2024-04-26T23:43:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 35297, 2024-04-26T23:43:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: "inst": { 2024-04-26T23:43:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: "name": { 2024-04-26T23:43:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "client", 2024-04-26T23:43:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: "num": 35297 2024-04-26T23:43:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-26T23:43:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": { 2024-04-26T23:43:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2024-04-26T23:43:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:43:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 595466655 2024-04-26T23:43:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-26T23:43:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-26T23:43:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": { 2024-04-26T23:43:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2024-04-26T23:43:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:43:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 595466655 2024-04-26T23:43:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-26T23:43:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: "inst_str": "client.35297 192.168.0.1:0/595466655", 2024-04-26T23:43:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: "addr_str": "192.168.0.1:0/595466655", 2024-04-26T23:43:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: "inode_count": 1, 2024-04-26T23:43:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_epoch": 25, 2024-04-26T23:43:33.099 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_epoch": 45, 2024-04-26T23:43:33.099 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_epoch_barrier": 0, 2024-04-26T23:43:33.099 INFO:teuthology.orchestra.run.smithi170.stdout: "blocklisted": false, 2024-04-26T23:43:33.099 INFO:teuthology.orchestra.run.smithi170.stdout: "fs_name": "cephfs" 2024-04-26T23:43:33.099 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-26T23:43:33.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:33.112 DEBUG:teuthology.orchestra.run.smithi170:> stat --file-system '--printf=%T 2024-04-26T23:43:33.112 DEBUG:teuthology.orchestra.run.smithi170:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-26T23:43:33.120 INFO:teuthology.orchestra.run.smithi170.stdout:fuseblk 2024-04-26T23:43:33.121 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-26T23:43:33.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:33.121 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:43:33.184 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2024-04-26T23:43:33.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.326+0000 7f3dc2800640 1 Processor -- start 2024-04-26T23:43:33.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.326+0000 7f3dc2800640 1 -- start start 2024-04-26T23:43:33.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.326+0000 7f3dc2800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3dbc0afbc0 0x7f3dbc15df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:33.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.326+0000 7f3dc2800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dbc072860 con 0x7f3dbc0affa0 2024-04-26T23:43:33.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.326+0000 7f3dc2800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dbc0743b0 con 0x7f3dbc073f20 2024-04-26T23:43:33.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.326+0000 7f3dc2800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f3dbc072b00 con 0x7f3dbc0afbc0 2024-04-26T23:43:33.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.326+0000 7f3dbbe00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f3dbc0affa0 0x7f3dbc0ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:36310/0 (socket says 172.21.15.137:36310) 2024-04-26T23:43:33.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.326+0000 7f3dbbe00640 1 -- 172.21.15.137:0/691072399 learned_addr learned my addr 172.21.15.137:0/691072399 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:33.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.326+0000 7f3dbb400640 1 --2- 172.21.15.137:0/691072399 >> v2:172.21.15.170:3300/0 conn(0x7f3dbc0afbc0 0x7f3dbc15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:33.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.330+0000 7f3dbaa00640 1 -- 172.21.15.137:0/691072399 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 339172497 0 0) 0x7f3dbc072860 con 0x7f3dbc0affa0 2024-04-26T23:43:33.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.330+0000 7f3dbaa00640 1 -- 172.21.15.137:0/691072399 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3da0003530 con 0x7f3dbc0affa0 2024-04-26T23:43:33.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.330+0000 7f3dbb400640 1 -- 172.21.15.137:0/691072399 >> v1:172.21.15.170:6789/0 conn(0x7f3dbc073f20 legacy=0x7f3dbc0735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:33.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.330+0000 7f3dbaa00640 1 -- 172.21.15.137:0/691072399 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3784157408 0 0) 0x7f3dbc0743b0 con 0x7f3dbc073f20 2024-04-26T23:43:33.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.330+0000 7f3dbb400640 1 -- 172.21.15.137:0/691072399 >> v1:172.21.15.137:6789/0 conn(0x7f3dbc0affa0 legacy=0x7f3dbc0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:33.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.330+0000 7f3dbb400640 1 -- 172.21.15.137:0/691072399 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dbc072de0 con 0x7f3dbc0afbc0 2024-04-26T23:43:33.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.330+0000 7f3dbb400640 1 --2- 172.21.15.137:0/691072399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc0afbc0 0x7f3dbc15df90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009dc0 tx=0x7f3dac01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d39bf339f88e6650 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:33.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.330+0000 7f3dbaa00640 1 -- 172.21.15.137:0/691072399 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac0b2070 con 0x7f3dbc0afbc0 2024-04-26T23:43:33.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.330+0000 7f3dbaa00640 1 -- 172.21.15.137:0/691072399 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dac0a58c0 con 0x7f3dbc0afbc0 2024-04-26T23:43:33.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.330+0000 7f3dbaa00640 1 -- 172.21.15.137:0/691072399 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac0a5c90 con 0x7f3dbc0afbc0 2024-04-26T23:43:33.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dc2800640 1 -- 172.21.15.137:0/691072399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc0afbc0 msgr2=0x7f3dbc15df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:33.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dc2800640 1 --2- 172.21.15.137:0/691072399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc0afbc0 0x7f3dbc15df90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009dc0 tx=0x7f3dac01c950 comp rx=0 tx=0).stop 2024-04-26T23:43:33.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dc2800640 1 -- 172.21.15.137:0/691072399 shutdown_connections 2024-04-26T23:43:33.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dc2800640 1 --2- 172.21.15.137:0/691072399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc0afbc0 0x7f3dbc15df90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:33.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dc2800640 1 -- 172.21.15.137:0/691072399 >> 172.21.15.137:0/691072399 conn(0x7f3dbc06c800 msgr2=0x7f3dbc06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:33.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dc2800640 1 -- 172.21.15.137:0/691072399 shutdown_connections 2024-04-26T23:43:33.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dc2800640 1 -- 172.21.15.137:0/691072399 wait complete. 2024-04-26T23:43:33.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dc2800640 1 Processor -- start 2024-04-26T23:43:33.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dc2800640 1 -- start start 2024-04-26T23:43:33.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dc2800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dbc0afbc0 0x7f3dbc14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:33.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dc2800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc0affa0 0x7f3dbc0b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:33.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dc2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc143200 0x7f3dbc14f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:33.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dc2800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc06ffe0 con 0x7f3dbc143200 2024-04-26T23:43:33.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dc2800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc0cecd0 con 0x7f3dbc0affa0 2024-04-26T23:43:33.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dc2800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3dbc070160 con 0x7f3dbc0afbc0 2024-04-26T23:43:33.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dbbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc143200 0x7f3dbc14f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:33.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dbbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc143200 0x7f3dbc14f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53554/0 (socket says 172.21.15.137:53554) 2024-04-26T23:43:33.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dbbe00640 1 -- 172.21.15.137:0/799743800 learned_addr learned my addr 172.21.15.137:0/799743800 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:33.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3db2a00640 1 --2- 172.21.15.137:0/799743800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc0affa0 0x7f3dbc0b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:33.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dbb400640 1 --2- 172.21.15.137:0/799743800 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dbc0afbc0 0x7f3dbc14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:33.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dbbe00640 1 -- 172.21.15.137:0/799743800 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dbc0afbc0 msgr2=0x7f3dbc14ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:33.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dbbe00640 1 --2- 172.21.15.137:0/799743800 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dbc0afbc0 0x7f3dbc14ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:33.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dbbe00640 1 -- 172.21.15.137:0/799743800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc0affa0 msgr2=0x7f3dbc0b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:33.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dbbe00640 1 --2- 172.21.15.137:0/799743800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc0affa0 0x7f3dbc0b48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:33.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dbbe00640 1 -- 172.21.15.137:0/799743800 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dbc0b4de0 con 0x7f3dbc143200 2024-04-26T23:43:33.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3db2a00640 1 --2- 172.21.15.137:0/799743800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc0affa0 0x7f3dbc0b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:33.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dbb400640 1 --2- 172.21.15.137:0/799743800 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dbc0afbc0 0x7f3dbc14ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:33.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.334+0000 7f3dbbe00640 1 --2- 172.21.15.137:0/799743800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc143200 0x7f3dbc14f680 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3db400c420 tx=0x7f3db400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:33.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.338+0000 7f3db3e00640 1 -- 172.21.15.137:0/799743800 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db4017070 con 0x7f3dbc143200 2024-04-26T23:43:33.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.338+0000 7f3db3e00640 1 -- 172.21.15.137:0/799743800 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3db4005cf0 con 0x7f3dbc143200 2024-04-26T23:43:33.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.338+0000 7f3db3e00640 1 -- 172.21.15.137:0/799743800 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db40072d0 con 0x7f3dbc143200 2024-04-26T23:43:33.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.338+0000 7f3dc2800640 1 -- 172.21.15.137:0/799743800 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dbc0b5080 con 0x7f3dbc143200 2024-04-26T23:43:33.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.338+0000 7f3dc2800640 1 -- 172.21.15.137:0/799743800 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dbc0b5640 con 0x7f3dbc143200 2024-04-26T23:43:33.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.338+0000 7f3dc2800640 1 -- 172.21.15.137:0/799743800 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dbc06a410 con 0x7f3dbc143200 2024-04-26T23:43:33.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.338+0000 7f3db3e00640 1 -- 172.21.15.137:0/799743800 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3db4007470 con 0x7f3dbc143200 2024-04-26T23:43:33.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.338+0000 7f3db3e00640 1 --2- 172.21.15.137:0/799743800 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3d98068380 0x7f3d9806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:33.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.338+0000 7f3db3e00640 1 -- 172.21.15.137:0/799743800 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f3db4085d10 con 0x7f3dbc143200 2024-04-26T23:43:33.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.338+0000 7f3dbb400640 1 --2- 172.21.15.137:0/799743800 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3d98068380 0x7f3d9806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:33.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.342+0000 7f3dbb400640 1 --2- 172.21.15.137:0/799743800 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3d98068380 0x7f3d9806a840 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0af000 tx=0x7f3dac0a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:33.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.342+0000 7f3db3e00640 1 -- 172.21.15.137:0/799743800 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3db408b020 con 0x7f3dbc143200 2024-04-26T23:43:33.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.534+0000 7f3dc2800640 1 -- 172.21.15.137:0/799743800 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) -- 0x7f3dbc0737f0 con 0x7f3dbc143200 2024-04-26T23:43:33.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.590+0000 7f3db3e00640 1 -- 172.21.15.137:0/799743800 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v26) ==== 105+0+0 (secure 0 0 0) 0x7f3db4055ca0 con 0x7f3dbc143200 2024-04-26T23:43:33.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.590+0000 7f3dc2800640 1 -- 172.21.15.137:0/799743800 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3d98068380 msgr2=0x7f3d9806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:33.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.590+0000 7f3dc2800640 1 --2- 172.21.15.137:0/799743800 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3d98068380 0x7f3d9806a840 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0af000 tx=0x7f3dac0a7070 comp rx=0 tx=0).stop 2024-04-26T23:43:33.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.590+0000 7f3dc2800640 1 -- 172.21.15.137:0/799743800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc143200 msgr2=0x7f3dbc14f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:33.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.590+0000 7f3dc2800640 1 --2- 172.21.15.137:0/799743800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc143200 0x7f3dbc14f680 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3db400c420 tx=0x7f3db400c8e0 comp rx=0 tx=0).stop 2024-04-26T23:43:33.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.590+0000 7f3dc2800640 1 -- 172.21.15.137:0/799743800 shutdown_connections 2024-04-26T23:43:33.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.590+0000 7f3dc2800640 1 --2- 172.21.15.137:0/799743800 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3d98068380 0x7f3d9806a840 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:33.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.590+0000 7f3dc2800640 1 --2- 172.21.15.137:0/799743800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc143200 0x7f3dbc14f680 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:33.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.590+0000 7f3dc2800640 1 --2- 172.21.15.137:0/799743800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc0affa0 0x7f3dbc0b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:33.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.590+0000 7f3dc2800640 1 --2- 172.21.15.137:0/799743800 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dbc0afbc0 0x7f3dbc14ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:33.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.590+0000 7f3dc2800640 1 -- 172.21.15.137:0/799743800 >> 172.21.15.137:0/799743800 conn(0x7f3dbc06c800 msgr2=0x7f3dbc0b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:33.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.590+0000 7f3dc2800640 1 -- 172.21.15.137:0/799743800 shutdown_connections 2024-04-26T23:43:33.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.590+0000 7f3dc2800640 1 -- 172.21.15.137:0/799743800 wait complete. 2024-04-26T23:43:33.625 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:43:33.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.754+0000 7ffacce00640 1 Processor -- start 2024-04-26T23:43:33.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.754+0000 7ffacce00640 1 -- start start 2024-04-26T23:43:33.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.754+0000 7ffacce00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ffac80b4ad0 0x7ffac806f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:33.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.754+0000 7ffacce00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ffac806f6d0 0x7ffac80ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:33.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.754+0000 7ffacce00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac8148d30 con 0x7ffac8148950 2024-04-26T23:43:33.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.754+0000 7ffacce00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ffac81604d0 con 0x7ffac806f6d0 2024-04-26T23:43:33.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.754+0000 7ffacce00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ffac806fb30 con 0x7ffac80b4ad0 2024-04-26T23:43:33.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.754+0000 7ffac6800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ffac806f6d0 0x7ffac80ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:33.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.754+0000 7ffac6800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ffac806f6d0 0x7ffac80ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53568/0 (socket says 172.21.15.137:53568) 2024-04-26T23:43:33.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.754+0000 7ffac6800640 1 -- 172.21.15.137:0/1481117468 learned_addr learned my addr 172.21.15.137:0/1481117468 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:33.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.754+0000 7ffabd400640 1 --2- 172.21.15.137:0/1481117468 >> v2:172.21.15.170:3300/0 conn(0x7ffac80b4ad0 0x7ffac806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:33.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.754+0000 7ffac6800640 1 -- 172.21.15.137:0/1481117468 >> v2:172.21.15.170:3300/0 conn(0x7ffac80b4ad0 msgr2=0x7ffac806f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:33.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.754+0000 7ffac6800640 1 --2- 172.21.15.137:0/1481117468 >> v2:172.21.15.170:3300/0 conn(0x7ffac80b4ad0 0x7ffac806f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:33.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.754+0000 7ffac6800640 1 -- 172.21.15.137:0/1481117468 >> v1:172.21.15.170:6789/0 conn(0x7ffac8148950 legacy=0x7ffac815fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:33.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.754+0000 7ffac6800640 1 -- 172.21.15.137:0/1481117468 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac8073540 con 0x7ffac806f6d0 2024-04-26T23:43:33.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.758+0000 7ffac6800640 1 --2- 172.21.15.137:0/1481117468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffac806f6d0 0x7ffac80ae8d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ffac80b0650 tx=0x7ffac001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e234b7d55d52dcbc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:33.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.758+0000 7ffac5400640 1 -- 172.21.15.137:0/1481117468 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac00a5880 con 0x7ffac806f6d0 2024-04-26T23:43:33.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.758+0000 7ffac5400640 1 -- 172.21.15.137:0/1481117468 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffac00a5a20 con 0x7ffac806f6d0 2024-04-26T23:43:33.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.758+0000 7ffac5400640 1 -- 172.21.15.137:0/1481117468 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac00a5df0 con 0x7ffac806f6d0 2024-04-26T23:43:33.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.758+0000 7ffacce00640 1 -- 172.21.15.137:0/1481117468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffac806f6d0 msgr2=0x7ffac80ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:33.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.758+0000 7ffacce00640 1 --2- 172.21.15.137:0/1481117468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffac806f6d0 0x7ffac80ae8d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ffac80b0650 tx=0x7ffac001c9c0 comp rx=0 tx=0).stop 2024-04-26T23:43:33.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.758+0000 7ffacce00640 1 -- 172.21.15.137:0/1481117468 shutdown_connections 2024-04-26T23:43:33.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.758+0000 7ffacce00640 1 --2- 172.21.15.137:0/1481117468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffac806f6d0 0x7ffac80ae8d0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:33.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.758+0000 7ffacce00640 1 --2- 172.21.15.137:0/1481117468 >> v2:172.21.15.170:3300/0 conn(0x7ffac80b4ad0 0x7ffac806f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:33.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.758+0000 7ffacce00640 1 -- 172.21.15.137:0/1481117468 >> 172.21.15.137:0/1481117468 conn(0x7ffac806c5d0 msgr2=0x7ffac806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:33.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.758+0000 7ffacce00640 1 -- 172.21.15.137:0/1481117468 shutdown_connections 2024-04-26T23:43:33.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.758+0000 7ffacce00640 1 -- 172.21.15.137:0/1481117468 wait complete. 2024-04-26T23:43:33.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffacce00640 1 Processor -- start 2024-04-26T23:43:33.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffacce00640 1 -- start start 2024-04-26T23:43:33.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffacce00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffac806f6d0 0x7ffac80ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:33.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffacce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffac80b4ad0 0x7ffac813c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:33.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffacce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffac8148950 0x7ffac80ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:33.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffacce00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ffac8073320 con 0x7ffac8148950 2024-04-26T23:43:33.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffacce00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ffac80731a0 con 0x7ffac80b4ad0 2024-04-26T23:43:33.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffacce00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ffac8074300 con 0x7ffac806f6d0 2024-04-26T23:43:33.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffac6800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffac8148950 0x7ffac80ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:33.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffac6800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffac8148950 0x7ffac80ceb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53584/0 (socket says 172.21.15.137:53584) 2024-04-26T23:43:33.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffac6800640 1 -- 172.21.15.137:0/1382404970 learned_addr learned my addr 172.21.15.137:0/1382404970 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:33.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffabd400640 1 --2- 172.21.15.137:0/1382404970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffac80b4ad0 0x7ffac813c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:33.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffac5e00640 1 --2- 172.21.15.137:0/1382404970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffac806f6d0 0x7ffac80ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:33.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffac6800640 1 -- 172.21.15.137:0/1382404970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffac806f6d0 msgr2=0x7ffac80ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:33.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffac6800640 1 --2- 172.21.15.137:0/1382404970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffac806f6d0 0x7ffac80ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:33.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffac6800640 1 -- 172.21.15.137:0/1382404970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffac80b4ad0 msgr2=0x7ffac813c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:33.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffac6800640 1 --2- 172.21.15.137:0/1382404970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffac80b4ad0 0x7ffac813c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:33.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffac6800640 1 -- 172.21.15.137:0/1382404970 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac813ef20 con 0x7ffac8148950 2024-04-26T23:43:33.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffac6800640 1 --2- 172.21.15.137:0/1382404970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffac8148950 0x7ffac80ceb40 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ffac00af040 tx=0x7ffac0019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:33.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffabea00640 1 -- 172.21.15.137:0/1382404970 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac00a5dd0 con 0x7ffac8148950 2024-04-26T23:43:33.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffabea00640 1 -- 172.21.15.137:0/1382404970 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffac00be070 con 0x7ffac8148950 2024-04-26T23:43:33.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffacce00640 1 -- 172.21.15.137:0/1382404970 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffac80cd700 con 0x7ffac8148950 2024-04-26T23:43:33.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffabea00640 1 -- 172.21.15.137:0/1382404970 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac00b86b0 con 0x7ffac8148950 2024-04-26T23:43:33.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffacce00640 1 -- 172.21.15.137:0/1382404970 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffac80cf080 con 0x7ffac8148950 2024-04-26T23:43:33.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.762+0000 7ffacce00640 1 -- 172.21.15.137:0/1382404970 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffac806a4b0 con 0x7ffac8148950 2024-04-26T23:43:33.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.766+0000 7ffabea00640 1 -- 172.21.15.137:0/1382404970 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffac00b8850 con 0x7ffac8148950 2024-04-26T23:43:33.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.766+0000 7ffabea00640 1 --2- 172.21.15.137:0/1382404970 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ffaa4068380 0x7ffaa406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:33.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.766+0000 7ffabea00640 1 -- 172.21.15.137:0/1382404970 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7ffac01217d0 con 0x7ffac8148950 2024-04-26T23:43:33.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.766+0000 7ffac5e00640 1 --2- 172.21.15.137:0/1382404970 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ffaa4068380 0x7ffaa406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:33.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.766+0000 7ffac5e00640 1 --2- 172.21.15.137:0/1382404970 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ffaa4068380 0x7ffaa406a840 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffab8001810 tx=0x7ffab8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:33.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.770+0000 7ffabea00640 1 -- 172.21.15.137:0/1382404970 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ffac00165e0 con 0x7ffac8148950 2024-04-26T23:43:33.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.962+0000 7ffacce00640 1 -- 172.21.15.137:0/1382404970 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffac81472e0 con 0x7ffac8148950 2024-04-26T23:43:33.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.966+0000 7ffabea00640 1 -- 172.21.15.137:0/1382404970 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5203 (secure 0 0 0) 0x7ffac00f1870 con 0x7ffac8148950 2024-04-26T23:43:33.972 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:33.972 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/145346644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":145346644},{"type":"v1","addr":"172.21.15.170:6835","nonce":145346644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5656,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3121910067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3121910067},{"type":"v1","addr":"172.21.15.170:6834","nonce":3121910067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:43:23.588817+0000","modified":"2024-04-26T23:43:33.596749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5838,"mds_1":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"c","rank":1,"incarnation":27,"state":"up:creating","state_seq":1,"addr":"172.21.15.137:6836/2120163779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2120163779},{"type":"v1","addr":"172.21.15.137:6836","nonce":2120163779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5838":{"gid":5838,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/547646153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":547646153},{"type":"v1","addr":"172.21.15.137:6837","nonce":547646153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5838,"qdb_cluster":[5838]},"id":3}]} 2024-04-26T23:43:33.972 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 27 2024-04-26T23:43:33.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.966+0000 7ffacce00640 1 -- 172.21.15.137:0/1382404970 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ffaa4068380 msgr2=0x7ffaa406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:33.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.966+0000 7ffacce00640 1 --2- 172.21.15.137:0/1382404970 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ffaa4068380 0x7ffaa406a840 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffab8001810 tx=0x7ffab8009040 comp rx=0 tx=0).stop 2024-04-26T23:43:33.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.966+0000 7ffacce00640 1 -- 172.21.15.137:0/1382404970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffac8148950 msgr2=0x7ffac80ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:33.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.966+0000 7ffacce00640 1 --2- 172.21.15.137:0/1382404970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffac8148950 0x7ffac80ceb40 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ffac00af040 tx=0x7ffac0019760 comp rx=0 tx=0).stop 2024-04-26T23:43:33.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.966+0000 7ffacce00640 1 -- 172.21.15.137:0/1382404970 shutdown_connections 2024-04-26T23:43:33.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.966+0000 7ffacce00640 1 --2- 172.21.15.137:0/1382404970 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ffaa4068380 0x7ffaa406a840 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:33.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.966+0000 7ffacce00640 1 --2- 172.21.15.137:0/1382404970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffac8148950 0x7ffac80ceb40 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:33.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.966+0000 7ffacce00640 1 --2- 172.21.15.137:0/1382404970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffac80b4ad0 0x7ffac813c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:33.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.966+0000 7ffacce00640 1 --2- 172.21.15.137:0/1382404970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffac806f6d0 0x7ffac80ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:33.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.966+0000 7ffacce00640 1 -- 172.21.15.137:0/1382404970 >> 172.21.15.137:0/1382404970 conn(0x7ffac806c5d0 msgr2=0x7ffac80b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:33.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.966+0000 7ffacce00640 1 -- 172.21.15.137:0/1382404970 shutdown_connections 2024-04-26T23:43:33.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:33.966+0000 7ffacce00640 1 -- 172.21.15.137:0/1382404970 wait complete. 2024-04-26T23:43:34.395 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T23:43:23.588817+0000', 'modified': '2024-04-26T23:43:33.596749+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 5838, 'mds_1': 5835}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5835': {'gid': 5835, 'name': 'c', 'rank': 1, 'incarnation': 27, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.137:6836/2120163779', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6834', 'nonce': 2120163779}, {'type': 'v1', 'addr': '172.21.15.137:6836', 'nonce': 2120163779}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_5838': {'gid': 5838, 'name': 'a', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.137:6837/547646153', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6835', 'nonce': 547646153}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 547646153}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5838, 'qdb_cluster': [5838]} 2024-04-26T23:43:34.396 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5835:up:creating 2024-04-26T23:43:35.397 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:43:35.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.534+0000 7f10bda00640 1 Processor -- start 2024-04-26T23:43:35.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.534+0000 7f10bda00640 1 -- start start 2024-04-26T23:43:35.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.538+0000 7f10bda00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f10b80ce3e0 0x7f10b8073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:35.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.538+0000 7f10bda00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10b8073010 con 0x7f10b815de80 2024-04-26T23:43:35.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.538+0000 7f10bda00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10b80cef90 con 0x7f10b80ce7c0 2024-04-26T23:43:35.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.538+0000 7f10bda00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f10b8073280 con 0x7f10b80ce3e0 2024-04-26T23:43:35.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.538+0000 7f10ae000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f10b815de80 0x7f10b80d04e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:36320/0 (socket says 172.21.15.137:36320) 2024-04-26T23:43:35.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.538+0000 7f10ae000640 1 -- 172.21.15.137:0/4269142191 learned_addr learned my addr 172.21.15.137:0/4269142191 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:35.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.538+0000 7f10b6a00640 1 --2- 172.21.15.137:0/4269142191 >> v2:172.21.15.170:3300/0 conn(0x7f10b80ce3e0 0x7f10b8073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:35.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.538+0000 7f10b6000640 1 -- 172.21.15.137:0/4269142191 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4119603477 0 0) 0x7f10b8073010 con 0x7f10b815de80 2024-04-26T23:43:35.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.538+0000 7f10b6000640 1 -- 172.21.15.137:0/4269142191 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f109c003530 con 0x7f10b815de80 2024-04-26T23:43:35.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.538+0000 7f10b6a00640 1 -- 172.21.15.137:0/4269142191 >> v1:172.21.15.170:6789/0 conn(0x7f10b80ce7c0 legacy=0x7f10b8146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:35.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.538+0000 7f10b6000640 1 -- 172.21.15.137:0/4269142191 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3496588230 0 0) 0x7f109c003530 con 0x7f10b815de80 2024-04-26T23:43:35.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.538+0000 7f10b6a00640 1 -- 172.21.15.137:0/4269142191 >> v1:172.21.15.137:6789/0 conn(0x7f10b815de80 legacy=0x7f10b80d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:35.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.538+0000 7f10b6a00640 1 -- 172.21.15.137:0/4269142191 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b8073560 con 0x7f10b80ce3e0 2024-04-26T23:43:35.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.542+0000 7f10b6a00640 1 --2- 172.21.15.137:0/4269142191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10b80ce3e0 0x7f10b8073d60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f10a80097f0 tx=0x7f10a801c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5466d7ab06501d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:35.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.542+0000 7f10b6000640 1 -- 172.21.15.137:0/4269142191 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a80b0070 con 0x7f10b80ce3e0 2024-04-26T23:43:35.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.542+0000 7f10b6000640 1 -- 172.21.15.137:0/4269142191 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a80ab400 con 0x7f10b80ce3e0 2024-04-26T23:43:35.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.542+0000 7f10b6000640 1 -- 172.21.15.137:0/4269142191 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0001a00 con 0x7f10b80ce3e0 2024-04-26T23:43:35.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.542+0000 7f10bda00640 1 -- 172.21.15.137:0/4269142191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10b80ce3e0 msgr2=0x7f10b8073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:35.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.542+0000 7f10bda00640 1 --2- 172.21.15.137:0/4269142191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10b80ce3e0 0x7f10b8073d60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f10a80097f0 tx=0x7f10a801c390 comp rx=0 tx=0).stop 2024-04-26T23:43:35.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.542+0000 7f10bda00640 1 -- 172.21.15.137:0/4269142191 shutdown_connections 2024-04-26T23:43:35.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.542+0000 7f10bda00640 1 --2- 172.21.15.137:0/4269142191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10b80ce3e0 0x7f10b8073d60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:35.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.542+0000 7f10bda00640 1 -- 172.21.15.137:0/4269142191 >> 172.21.15.137:0/4269142191 conn(0x7f10b806c5d0 msgr2=0x7f10b806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:35.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.542+0000 7f10bda00640 1 -- 172.21.15.137:0/4269142191 shutdown_connections 2024-04-26T23:43:35.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.542+0000 7f10bda00640 1 -- 172.21.15.137:0/4269142191 wait complete. 2024-04-26T23:43:35.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.542+0000 7f10bda00640 1 Processor -- start 2024-04-26T23:43:35.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.542+0000 7f10bda00640 1 -- start start 2024-04-26T23:43:35.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10bda00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10b80ce3e0 0x7f10b815be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:35.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10bda00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b80ce7c0 0x7f10b815c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:35.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10bda00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10b815de80 0x7f10b8144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:35.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10bda00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f10b806ed10 con 0x7f10b80ce7c0 2024-04-26T23:43:35.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10bda00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f10b806ee90 con 0x7f10b80ce3e0 2024-04-26T23:43:35.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10bda00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f10b806f010 con 0x7f10b815de80 2024-04-26T23:43:35.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10ae000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b80ce7c0 0x7f10b815c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:35.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10ae000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b80ce7c0 0x7f10b815c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53588/0 (socket says 172.21.15.137:53588) 2024-04-26T23:43:35.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10ae000640 1 -- 172.21.15.137:0/3660479935 learned_addr learned my addr 172.21.15.137:0/3660479935 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:35.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10b6a00640 1 --2- 172.21.15.137:0/3660479935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10b80ce3e0 0x7f10b815be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:35.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10b7400640 1 --2- 172.21.15.137:0/3660479935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10b815de80 0x7f10b8144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:35.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10ae000640 1 -- 172.21.15.137:0/3660479935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10b815de80 msgr2=0x7f10b8144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:35.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10ae000640 1 --2- 172.21.15.137:0/3660479935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10b815de80 0x7f10b8144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:35.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10ae000640 1 -- 172.21.15.137:0/3660479935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10b80ce3e0 msgr2=0x7f10b815be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:35.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10ae000640 1 --2- 172.21.15.137:0/3660479935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10b80ce3e0 0x7f10b815be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:35.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10ae000640 1 -- 172.21.15.137:0/3660479935 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b81450c0 con 0x7f10b80ce7c0 2024-04-26T23:43:35.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10ae000640 1 --2- 172.21.15.137:0/3660479935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b80ce7c0 0x7f10b815c3d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f10a0001570 tx=0x7f10a000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:35.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10af400640 1 -- 172.21.15.137:0/3660479935 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0017070 con 0x7f10b80ce7c0 2024-04-26T23:43:35.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10af400640 1 -- 172.21.15.137:0/3660479935 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a000ad40 con 0x7f10b80ce7c0 2024-04-26T23:43:35.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10af400640 1 -- 172.21.15.137:0/3660479935 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0012640 con 0x7f10b80ce7c0 2024-04-26T23:43:35.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10bda00640 1 -- 172.21.15.137:0/3660479935 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b8145400 con 0x7f10b80ce7c0 2024-04-26T23:43:35.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10bda00640 1 -- 172.21.15.137:0/3660479935 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b8145c40 con 0x7f10b80ce7c0 2024-04-26T23:43:35.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10bda00640 1 -- 172.21.15.137:0/3660479935 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b806a4b0 con 0x7f10b80ce7c0 2024-04-26T23:43:35.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.546+0000 7f10af400640 1 -- 172.21.15.137:0/3660479935 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f10a001a070 con 0x7f10b80ce7c0 2024-04-26T23:43:35.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.550+0000 7f10af400640 1 --2- 172.21.15.137:0/3660479935 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1094068380 0x7f109406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:35.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.550+0000 7f10af400640 1 -- 172.21.15.137:0/3660479935 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f10a00867c0 con 0x7f10b80ce7c0 2024-04-26T23:43:35.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.550+0000 7f10b6a00640 1 --2- 172.21.15.137:0/3660479935 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1094068380 0x7f109406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:35.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.550+0000 7f10b6a00640 1 --2- 172.21.15.137:0/3660479935 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1094068380 0x7f109406a840 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f10a80ad000 tx=0x7f10a80a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:35.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.554+0000 7f10af400640 1 -- 172.21.15.137:0/3660479935 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f10b8145400 con 0x7f10b80ce7c0 2024-04-26T23:43:35.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.746+0000 7f10bda00640 1 -- 172.21.15.137:0/3660479935 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10b80b26a0 con 0x7f10b80ce7c0 2024-04-26T23:43:35.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.746+0000 7f10af400640 1 -- 172.21.15.137:0/3660479935 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5206 (secure 0 0 0) 0x7f10a0056730 con 0x7f10b80ce7c0 2024-04-26T23:43:35.754 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:35.754 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/145346644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":145346644},{"type":"v1","addr":"172.21.15.170:6835","nonce":145346644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5656,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3121910067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3121910067},{"type":"v1","addr":"172.21.15.170:6834","nonce":3121910067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:43:23.588817+0000","modified":"2024-04-26T23:43:34.600975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5838,"mds_1":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"c","rank":1,"incarnation":27,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6836/2120163779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2120163779},{"type":"v1","addr":"172.21.15.137:6836","nonce":2120163779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5838":{"gid":5838,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/547646153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":547646153},{"type":"v1","addr":"172.21.15.137:6837","nonce":547646153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5838,"qdb_cluster":[5835,5838]},"id":3}]} 2024-04-26T23:43:35.755 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 28 2024-04-26T23:43:35.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.750+0000 7f10bda00640 1 -- 172.21.15.137:0/3660479935 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1094068380 msgr2=0x7f109406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:35.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.750+0000 7f10bda00640 1 --2- 172.21.15.137:0/3660479935 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1094068380 0x7f109406a840 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f10a80ad000 tx=0x7f10a80a6000 comp rx=0 tx=0).stop 2024-04-26T23:43:35.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.750+0000 7f10bda00640 1 -- 172.21.15.137:0/3660479935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b80ce7c0 msgr2=0x7f10b815c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:35.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.750+0000 7f10bda00640 1 --2- 172.21.15.137:0/3660479935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b80ce7c0 0x7f10b815c3d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f10a0001570 tx=0x7f10a000a430 comp rx=0 tx=0).stop 2024-04-26T23:43:35.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.750+0000 7f10bda00640 1 -- 172.21.15.137:0/3660479935 shutdown_connections 2024-04-26T23:43:35.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.750+0000 7f10bda00640 1 --2- 172.21.15.137:0/3660479935 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1094068380 0x7f109406a840 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:35.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.750+0000 7f10bda00640 1 --2- 172.21.15.137:0/3660479935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b80ce7c0 0x7f10b815c3d0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:35.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.750+0000 7f10bda00640 1 --2- 172.21.15.137:0/3660479935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10b815de80 0x7f10b8144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:35.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.750+0000 7f10bda00640 1 --2- 172.21.15.137:0/3660479935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10b80ce3e0 0x7f10b815be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:35.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.750+0000 7f10bda00640 1 -- 172.21.15.137:0/3660479935 >> 172.21.15.137:0/3660479935 conn(0x7f10b806c5d0 msgr2=0x7f10b80b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:35.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.750+0000 7f10bda00640 1 -- 172.21.15.137:0/3660479935 shutdown_connections 2024-04-26T23:43:35.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:35.750+0000 7f10bda00640 1 -- 172.21.15.137:0/3660479935 wait complete. 2024-04-26T23:43:36.181 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T23:43:23.588817+0000', 'modified': '2024-04-26T23:43:34.600975+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 5838, 'mds_1': 5835}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5835': {'gid': 5835, 'name': 'c', 'rank': 1, 'incarnation': 27, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.137:6836/2120163779', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6834', 'nonce': 2120163779}, {'type': 'v1', 'addr': '172.21.15.137:6836', 'nonce': 2120163779}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_5838': {'gid': 5838, 'name': 'a', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.137:6837/547646153', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6835', 'nonce': 547646153}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 547646153}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5838, 'qdb_cluster': [5835, 5838]} 2024-04-26T23:43:36.181 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2024-04-26T23:43:36.181 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-26T23:43:36.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.310+0000 7f5733000640 1 Processor -- start 2024-04-26T23:43:36.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.310+0000 7f5733000640 1 -- start start 2024-04-26T23:43:36.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.310+0000 7f5733000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f572c15f560 0x7f572c15f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.310+0000 7f5733000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f572c0b30b0 0x7f572c0b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.310+0000 7f5733000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f572c160070 con 0x7f572c0b4b70 2024-04-26T23:43:36.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.310+0000 7f5733000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f572c0b3a60 con 0x7f572c0b30b0 2024-04-26T23:43:36.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.310+0000 7f5733000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f572c160350 con 0x7f572c15f560 2024-04-26T23:43:36.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.310+0000 7f5732600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f572c0b30b0 0x7f572c0b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.314+0000 7f5732600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f572c0b30b0 0x7f572c0b3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53602/0 (socket says 172.21.15.137:53602) 2024-04-26T23:43:36.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.314+0000 7f5732600640 1 -- 172.21.15.137:0/349210510 learned_addr learned my addr 172.21.15.137:0/349210510 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:36.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.314+0000 7f5731200640 1 --2- 172.21.15.137:0/349210510 >> v2:172.21.15.170:3300/0 conn(0x7f572c15f560 0x7f572c15f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.314+0000 7f5732600640 1 -- 172.21.15.137:0/349210510 >> v2:172.21.15.170:3300/0 conn(0x7f572c15f560 msgr2=0x7f572c15f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:36.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.314+0000 7f5732600640 1 --2- 172.21.15.137:0/349210510 >> v2:172.21.15.170:3300/0 conn(0x7f572c15f560 0x7f572c15f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.314+0000 7f5732600640 1 -- 172.21.15.137:0/349210510 >> v1:172.21.15.170:6789/0 conn(0x7f572c0b4b70 legacy=0x7f572c163560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:36.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.314+0000 7f5732600640 1 -- 172.21.15.137:0/349210510 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f572c162d60 con 0x7f572c0b30b0 2024-04-26T23:43:36.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.314+0000 7f5732600640 1 --2- 172.21.15.137:0/349210510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f572c0b30b0 0x7f572c0b3520 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f572c0d1340 tx=0x7f572401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22b979b4f322ffe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:36.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.314+0000 7f572be00640 1 -- 172.21.15.137:0/349210510 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57240a58e0 con 0x7f572c0b30b0 2024-04-26T23:43:36.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.314+0000 7f572be00640 1 -- 172.21.15.137:0/349210510 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57240a5a80 con 0x7f572c0b30b0 2024-04-26T23:43:36.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.314+0000 7f572be00640 1 -- 172.21.15.137:0/349210510 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57240a5e50 con 0x7f572c0b30b0 2024-04-26T23:43:36.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5733000640 1 -- 172.21.15.137:0/349210510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f572c0b30b0 msgr2=0x7f572c0b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:36.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5733000640 1 --2- 172.21.15.137:0/349210510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f572c0b30b0 0x7f572c0b3520 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f572c0d1340 tx=0x7f572401c9f0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5733000640 1 -- 172.21.15.137:0/349210510 shutdown_connections 2024-04-26T23:43:36.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5733000640 1 --2- 172.21.15.137:0/349210510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f572c0b30b0 0x7f572c0b3520 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5733000640 1 --2- 172.21.15.137:0/349210510 >> v2:172.21.15.170:3300/0 conn(0x7f572c15f560 0x7f572c15f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5733000640 1 -- 172.21.15.137:0/349210510 >> 172.21.15.137:0/349210510 conn(0x7f572c075750 msgr2=0x7f572c06c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:36.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5733000640 1 -- 172.21.15.137:0/349210510 shutdown_connections 2024-04-26T23:43:36.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5733000640 1 -- 172.21.15.137:0/349210510 wait complete. 2024-04-26T23:43:36.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5733000640 1 Processor -- start 2024-04-26T23:43:36.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5733000640 1 -- start start 2024-04-26T23:43:36.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5733000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f572c0b30b0 0x7f572c1ff000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5733000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f572c0b4b70 0x7f572c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5733000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f572c15f560 0x7f572c1fc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5733000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f572c06f100 con 0x7f572c15f560 2024-04-26T23:43:36.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5733000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f572c06ef80 con 0x7f572c0b30b0 2024-04-26T23:43:36.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5733000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f572c06f280 con 0x7f572c0b4b70 2024-04-26T23:43:36.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5732600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f572c15f560 0x7f572c1fc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5732600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f572c15f560 0x7f572c1fc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53616/0 (socket says 172.21.15.137:53616) 2024-04-26T23:43:36.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5732600640 1 -- 172.21.15.137:0/1311647213 learned_addr learned my addr 172.21.15.137:0/1311647213 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:36.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5731200640 1 --2- 172.21.15.137:0/1311647213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f572c0b4b70 0x7f572c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5731c00640 1 --2- 172.21.15.137:0/1311647213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f572c0b30b0 0x7f572c1ff000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5732600640 1 -- 172.21.15.137:0/1311647213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f572c0b4b70 msgr2=0x7f572c15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:36.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5732600640 1 --2- 172.21.15.137:0/1311647213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f572c0b4b70 0x7f572c15a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5732600640 1 -- 172.21.15.137:0/1311647213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f572c0b30b0 msgr2=0x7f572c1ff000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:36.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5732600640 1 --2- 172.21.15.137:0/1311647213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f572c0b30b0 0x7f572c1ff000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5732600640 1 -- 172.21.15.137:0/1311647213 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f572c15a8a0 con 0x7f572c15f560 2024-04-26T23:43:36.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5731c00640 1 --2- 172.21.15.137:0/1311647213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f572c0b30b0 0x7f572c1ff000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:36.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.318+0000 7f5732600640 1 --2- 172.21.15.137:0/1311647213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f572c15f560 0x7f572c1fc0b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f57240af040 tx=0x7f5724019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:36.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.322+0000 7f5729600640 1 -- 172.21.15.137:0/1311647213 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57240bc020 con 0x7f572c15f560 2024-04-26T23:43:36.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.322+0000 7f5729600640 1 -- 172.21.15.137:0/1311647213 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5724007dd0 con 0x7f572c15f560 2024-04-26T23:43:36.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.322+0000 7f5729600640 1 -- 172.21.15.137:0/1311647213 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57240a58e0 con 0x7f572c15f560 2024-04-26T23:43:36.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.322+0000 7f5733000640 1 -- 172.21.15.137:0/1311647213 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f572c15af40 con 0x7f572c15f560 2024-04-26T23:43:36.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.322+0000 7f5733000640 1 -- 172.21.15.137:0/1311647213 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f572c15b500 con 0x7f572c15f560 2024-04-26T23:43:36.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.322+0000 7f5729600640 1 -- 172.21.15.137:0/1311647213 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f57240bf020 con 0x7f572c15f560 2024-04-26T23:43:36.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.322+0000 7f5729600640 1 --2- 172.21.15.137:0/1311647213 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f570c068380 0x7f570c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.322+0000 7f5729600640 1 -- 172.21.15.137:0/1311647213 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f5724121bc0 con 0x7f572c15f560 2024-04-26T23:43:36.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.322+0000 7f5731c00640 1 --2- 172.21.15.137:0/1311647213 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f570c068380 0x7f570c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.322+0000 7f5737a66000 1 Processor -- start 2024-04-26T23:43:36.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.322+0000 7f5737a66000 1 -- start start 2024-04-26T23:43:36.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.322+0000 7f5731c00640 1 --2- 172.21.15.137:0/1311647213 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f570c068380 0x7f570c06a840 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5720001670 tx=0x7f5720009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:36.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5737a66000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564ff683a700 0x564ff683aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5737a66000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564ff683b020 0x564ff67f1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5737a66000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff67f1740 0x564ff67f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5737a66000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564ff66a9140 con 0x564ff67f1740 2024-04-26T23:43:36.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5737a66000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x564ff663ee00 con 0x564ff683a700 2024-04-26T23:43:36.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5737a66000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x564ff65f7a00 con 0x564ff683b020 2024-04-26T23:43:36.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5732600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff67f1740 0x564ff67f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5731c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564ff683a700 0x564ff683aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5731200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564ff683b020 0x564ff67f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5732600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff67f1740 0x564ff67f1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53622/0 (socket says 172.21.15.137:53622) 2024-04-26T23:43:36.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5732600640 1 -- 172.21.15.137:0/3711175219 learned_addr learned my addr 172.21.15.137:0/3711175219 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:36.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5732600640 1 -- 172.21.15.137:0/3711175219 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564ff683b020 msgr2=0x564ff67f1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:36.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5732600640 1 --2- 172.21.15.137:0/3711175219 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564ff683b020 0x564ff67f1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5732600640 1 -- 172.21.15.137:0/3711175219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564ff683a700 msgr2=0x564ff683aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:36.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5732600640 1 --2- 172.21.15.137:0/3711175219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564ff683a700 0x564ff683aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5732600640 1 -- 172.21.15.137:0/3711175219 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ff65fc0e0 con 0x564ff67f1740 2024-04-26T23:43:36.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5731c00640 1 --2- 172.21.15.137:0/3711175219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564ff683a700 0x564ff683aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:43:36.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5732600640 1 --2- 172.21.15.137:0/3711175219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff67f1740 0x564ff67f1b20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f57240fa300 tx=0x7f57240f1850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca93a02a99a56c11 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:36.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f571e000640 1 -- 172.21.15.137:0/3711175219 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57240a5a80 con 0x564ff67f1740 2024-04-26T23:43:36.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f571e000640 1 -- 172.21.15.137:0/3711175219 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57240f2350 con 0x564ff67f1740 2024-04-26T23:43:36.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f571e000640 1 -- 172.21.15.137:0/3711175219 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57240f1c50 con 0x564ff67f1740 2024-04-26T23:43:36.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5737a66000 1 -- 172.21.15.137:0/3711175219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff67f1740 msgr2=0x564ff67f1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:36.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5737a66000 1 --2- 172.21.15.137:0/3711175219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff67f1740 0x564ff67f1b20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f57240fa300 tx=0x7f57240f1850 comp rx=0 tx=0).stop 2024-04-26T23:43:36.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5737a66000 1 -- 172.21.15.137:0/3711175219 shutdown_connections 2024-04-26T23:43:36.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5737a66000 1 --2- 172.21.15.137:0/3711175219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff67f1740 0x564ff67f1b20 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5737a66000 1 --2- 172.21.15.137:0/3711175219 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564ff683b020 0x564ff67f1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5737a66000 1 --2- 172.21.15.137:0/3711175219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564ff683a700 0x564ff683aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5737a66000 1 -- 172.21.15.137:0/3711175219 >> 172.21.15.137:0/3711175219 conn(0x564ff67ed6f0 msgr2=0x564ff67efae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:36.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5737a66000 1 -- 172.21.15.137:0/3711175219 shutdown_connections 2024-04-26T23:43:36.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5737a66000 1 -- 172.21.15.137:0/3711175219 wait complete. 2024-04-26T23:43:36.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5737a66000 1 -- start start 2024-04-26T23:43:36.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.326+0000 7f5737a66000 1 Processor -- start 2024-04-26T23:43:36.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5737a66000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564ff67f1740 0x564ff67fc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5737a66000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564ff683a700 0x564ff67fc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5737a66000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff683b020 0x564ff67fcb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5737a66000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564ff664c200 con 0x564ff683b020 2024-04-26T23:43:36.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5737a66000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x564ff65e2e80 con 0x564ff683a700 2024-04-26T23:43:36.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5737a66000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x564ff6639ae0 con 0x564ff67f1740 2024-04-26T23:43:36.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5737a66000 10 client.0 _ll_register_callbacks cb 0x564ff664bda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:43:36.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5732600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff683b020 0x564ff67fcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5731c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564ff67f1740 0x564ff67fc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5731c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564ff67f1740 0x564ff67fc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:34724/0 (socket says 172.21.15.137:34724) 2024-04-26T23:43:36.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5731c00640 1 -- 172.21.15.137:0/3834290703 learned_addr learned my addr 172.21.15.137:0/3834290703 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:36.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5731200640 1 --2- 172.21.15.137:0/3834290703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564ff683a700 0x564ff67fc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5732600640 1 -- 172.21.15.137:0/3834290703 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564ff67f1740 msgr2=0x564ff67fc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:36.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5732600640 1 --2- 172.21.15.137:0/3834290703 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564ff67f1740 0x564ff67fc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5732600640 1 -- 172.21.15.137:0/3834290703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564ff683a700 msgr2=0x564ff67fc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:36.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5732600640 1 --2- 172.21.15.137:0/3834290703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564ff683a700 0x564ff67fc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5732600640 1 -- 172.21.15.137:0/3834290703 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ff65de4e0 con 0x564ff683b020 2024-04-26T23:43:36.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5731c00640 1 --2- 172.21.15.137:0/3834290703 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564ff67f1740 0x564ff67fc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:43:36.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5732600640 1 --2- 172.21.15.137:0/3834290703 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff683b020 0x564ff67fcb20 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f57241200e0 tx=0x7f5724009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5935bc4f48e67f96 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:36.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5712a00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T23:43:36.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5712a00640 1 -- 172.21.15.137:0/3834290703 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57240f20b0 con 0x564ff683b020 2024-04-26T23:43:36.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5712a00640 1 -- 172.21.15.137:0/3834290703 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f57240fa3a0 con 0x564ff683b020 2024-04-26T23:43:36.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5737a66000 1 -- 172.21.15.137:0/3834290703 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57240f2350 con 0x564ff683b020 2024-04-26T23:43:36.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5712a00640 1 -- 172.21.15.137:0/3834290703 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f57240a5a80 con 0x564ff683b020 2024-04-26T23:43:36.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5737a66000 10 client.6036 fetch_fsmap learned FSMap version 28 2024-04-26T23:43:36.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5737a66000 1 -- 172.21.15.137:0/3834290703 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x564ff65c4e80 con 0x564ff683b020 2024-04-26T23:43:36.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5712a00640 1 -- 172.21.15.137:0/3834290703 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57240f2350 con 0x564ff683b020 2024-04-26T23:43:36.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5712a00640 1 -- 172.21.15.137:0/3834290703 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 28) ==== 3514+0+0 (secure 0 0 0) 0x7f57240f10a0 con 0x564ff683b020 2024-04-26T23:43:36.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5737a66000 10 client.6036 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T23:43:36.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5737a66000 10 client.6036 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T23:43:36.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5737a66000 20 client.6036 populate_metadata read hostname 'smithi137' 2024-04-26T23:43:36.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5737a66000 1 --2- 172.21.15.137:0/3834290703 >> [v2:172.21.15.137:6834/2120163779,v1:172.21.15.137:6836/2120163779] conn(0x564ff67fd530 0x564ff684c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5737a66000 4 client.6036 mds_command: new command op to 5835 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T23:43:36.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5737a66000 1 -- 172.21.15.137:0/3834290703 --> [v2:172.21.15.137:6834/2120163779,v1:172.21.15.137:6836/2120163779] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ff65d7bc0 con 0x564ff67fd530 2024-04-26T23:43:36.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5731c00640 1 --2- 172.21.15.137:0/3834290703 >> [v2:172.21.15.137:6834/2120163779,v1:172.21.15.137:6836/2120163779] conn(0x564ff67fd530 0x564ff684c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5731c00640 1 --2- 172.21.15.137:0/3834290703 >> [v2:172.21.15.137:6834/2120163779,v1:172.21.15.137:6836/2120163779] conn(0x564ff67fd530 0x564ff684c7b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d6a0621a1c931628 server_cookie=840a733e04005ce8 in_seq=0 out_seq=0 2024-04-26T23:43:36.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5712a00640 10 client.6036 ms_handle_connect on v2:172.21.15.137:6834/2120163779 2024-04-26T23:43:36.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5712a00640 1 -- 172.21.15.137:0/3834290703 <== mds.1 v2:172.21.15.137:6834/2120163779 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564ff65d7bc0 con 0x564ff67fd530 2024-04-26T23:43:36.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5712a00640 10 client.6036 handle_command_reply: tid=0 2024-04-26T23:43:36.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5737a66000 1 client.6036 shutdown 2024-04-26T23:43:36.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5737a66000 1 -- 172.21.15.137:0/3834290703 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff683b020 msgr2=0x564ff67fcb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:36.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.330+0000 7f5737a66000 1 --2- 172.21.15.137:0/3834290703 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff683b020 0x564ff67fcb20 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f57241200e0 tx=0x7f5724009810 comp rx=0 tx=0).stop 2024-04-26T23:43:36.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.334+0000 7f5737a66000 1 -- 172.21.15.137:0/3834290703 shutdown_connections 2024-04-26T23:43:36.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.334+0000 7f5737a66000 1 --2- 172.21.15.137:0/3834290703 >> [v2:172.21.15.137:6834/2120163779,v1:172.21.15.137:6836/2120163779] conn(0x564ff67fd530 0x564ff684c7b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.334+0000 7f5737a66000 1 --2- 172.21.15.137:0/3834290703 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff683b020 0x564ff67fcb20 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.334+0000 7f5737a66000 1 --2- 172.21.15.137:0/3834290703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564ff683a700 0x564ff67fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.334+0000 7f5712a00640 0 client.6036 ms_handle_reset on v2:172.21.15.137:6834/2120163779 2024-04-26T23:43:36.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.334+0000 7f5737a66000 1 --2- 172.21.15.137:0/3834290703 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564ff67f1740 0x564ff67fc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.334+0000 7f5737a66000 1 -- 172.21.15.137:0/3834290703 >> 172.21.15.137:0/3834290703 conn(0x564ff67ed6f0 msgr2=0x564ff67f0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:36.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.334+0000 7f5737a66000 1 -- 172.21.15.137:0/3834290703 shutdown_connections 2024-04-26T23:43:36.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.334+0000 7f5737a66000 1 -- 172.21.15.137:0/3834290703 wait complete. 2024-04-26T23:43:36.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.334+0000 7f5737a66000 20 client.6036 trim_cache size 0 max 16384 2024-04-26T23:43:36.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.350+0000 7f5737a66000 1 Processor -- start 2024-04-26T23:43:36.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.350+0000 7f5737a66000 1 -- start start 2024-04-26T23:43:36.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.350+0000 7f5737a66000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564ff67f1740 0x564ff684f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.350+0000 7f5737a66000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff683a700 0x564ff67f0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.350+0000 7f5737a66000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564ff683b020 0x564ff67f1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.350+0000 7f5737a66000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f572c208890 con 0x564ff683a700 2024-04-26T23:43:36.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.350+0000 7f5737a66000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f572c15d4a0 con 0x564ff683b020 2024-04-26T23:43:36.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.350+0000 7f5737a66000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f572c13f4e0 con 0x564ff67f1740 2024-04-26T23:43:36.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.350+0000 7f5731200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff683a700 0x564ff67f0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.350+0000 7f5731200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff683a700 0x564ff67f0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53626/0 (socket says 172.21.15.137:53626) 2024-04-26T23:43:36.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.350+0000 7f5731200640 1 -- 172.21.15.137:0/3313789676 learned_addr learned my addr 172.21.15.137:0/3313789676 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:36.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.350+0000 7f5731c00640 1 --2- 172.21.15.137:0/3313789676 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564ff67f1740 0x564ff684f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.350+0000 7f5732600640 1 --2- 172.21.15.137:0/3313789676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564ff683b020 0x564ff67f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.350+0000 7f5731200640 1 -- 172.21.15.137:0/3313789676 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564ff67f1740 msgr2=0x564ff684f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:36.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.350+0000 7f5731200640 1 --2- 172.21.15.137:0/3313789676 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564ff67f1740 0x564ff684f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.350+0000 7f5731200640 1 -- 172.21.15.137:0/3313789676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564ff683b020 msgr2=0x564ff67f1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:36.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.350+0000 7f5731200640 1 --2- 172.21.15.137:0/3313789676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564ff683b020 0x564ff67f1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.350+0000 7f5731200640 1 -- 172.21.15.137:0/3313789676 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ff65f7c50 con 0x564ff683a700 2024-04-26T23:43:36.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.350+0000 7f5731200640 1 --2- 172.21.15.137:0/3313789676 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff683a700 0x564ff67f0af0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f5718009da0 tx=0x7f5718009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707ab0d74bf7206a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:36.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.350+0000 7f571d600640 1 -- 172.21.15.137:0/3313789676 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5718015c90 con 0x564ff683a700 2024-04-26T23:43:36.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.350+0000 7f571d600640 1 -- 172.21.15.137:0/3313789676 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5718015e30 con 0x564ff683a700 2024-04-26T23:43:36.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.350+0000 7f571d600640 1 -- 172.21.15.137:0/3313789676 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5718004030 con 0x564ff683a700 2024-04-26T23:43:36.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5737a66000 1 -- 172.21.15.137:0/3313789676 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff683a700 msgr2=0x564ff67f0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:36.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5737a66000 1 --2- 172.21.15.137:0/3313789676 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff683a700 0x564ff67f0af0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f5718009da0 tx=0x7f5718009e90 comp rx=0 tx=0).stop 2024-04-26T23:43:36.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5737a66000 1 -- 172.21.15.137:0/3313789676 shutdown_connections 2024-04-26T23:43:36.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5737a66000 1 --2- 172.21.15.137:0/3313789676 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff683a700 0x564ff67f0af0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5737a66000 1 --2- 172.21.15.137:0/3313789676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564ff683b020 0x564ff67f1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5737a66000 1 --2- 172.21.15.137:0/3313789676 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564ff67f1740 0x564ff684f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5737a66000 1 -- 172.21.15.137:0/3313789676 >> 172.21.15.137:0/3313789676 conn(0x564ff67ed6f0 msgr2=0x564ff6847460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:36.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5737a66000 1 -- 172.21.15.137:0/3313789676 shutdown_connections 2024-04-26T23:43:36.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5737a66000 1 -- 172.21.15.137:0/3313789676 wait complete. 2024-04-26T23:43:36.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5737a66000 1 -- start start 2024-04-26T23:43:36.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5737a66000 1 Processor -- start 2024-04-26T23:43:36.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5737a66000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564ff67f1740 0x564ff684f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5737a66000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff683a700 0x564ff6866340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5737a66000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564ff683b020 0x564ff6866880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5737a66000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564ff663e110 con 0x564ff683a700 2024-04-26T23:43:36.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5737a66000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x564ff65d47b0 con 0x564ff67f1740 2024-04-26T23:43:36.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5737a66000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x564ff6643430 con 0x564ff683b020 2024-04-26T23:43:36.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5737a66000 10 client.0 _ll_register_callbacks cb 0x7f57200012f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:43:36.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5731200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff683a700 0x564ff6866340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5731200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff683a700 0x564ff6866340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53630/0 (socket says 172.21.15.137:53630) 2024-04-26T23:43:36.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5731200640 1 -- 172.21.15.137:0/3717014197 learned_addr learned my addr 172.21.15.137:0/3717014197 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:36.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5732600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564ff683b020 0x564ff6866880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5731c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564ff67f1740 0x564ff684f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5731200640 1 -- 172.21.15.137:0/3717014197 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564ff683b020 msgr2=0x564ff6866880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:36.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5731200640 1 --2- 172.21.15.137:0/3717014197 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564ff683b020 0x564ff6866880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5731200640 1 -- 172.21.15.137:0/3717014197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564ff67f1740 msgr2=0x564ff684f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:36.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5731200640 1 --2- 172.21.15.137:0/3717014197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564ff67f1740 0x564ff684f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5731200640 1 -- 172.21.15.137:0/3717014197 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ff66c1160 con 0x564ff683a700 2024-04-26T23:43:36.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5731200640 1 --2- 172.21.15.137:0/3717014197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff683a700 0x564ff6866340 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f57180157f0 tx=0x7f5718004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2550d56626918b0f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:36.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5712a00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T23:43:36.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5712a00640 1 -- 172.21.15.137:0/3717014197 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5718003620 con 0x564ff683a700 2024-04-26T23:43:36.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5712a00640 1 -- 172.21.15.137:0/3717014197 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f571801b040 con 0x564ff683a700 2024-04-26T23:43:36.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5737a66000 1 -- 172.21.15.137:0/3717014197 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5718015e30 con 0x564ff683a700 2024-04-26T23:43:36.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5712a00640 1 -- 172.21.15.137:0/3717014197 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5718030050 con 0x564ff683a700 2024-04-26T23:43:36.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5737a66000 10 client.6042 fetch_fsmap learned FSMap version 28 2024-04-26T23:43:36.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.354+0000 7f5737a66000 1 -- 172.21.15.137:0/3717014197 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x564ff62f80c0 con 0x564ff683a700 2024-04-26T23:43:36.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5712a00640 1 -- 172.21.15.137:0/3717014197 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5718015e30 con 0x564ff683a700 2024-04-26T23:43:36.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5712a00640 1 -- 172.21.15.137:0/3717014197 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 28) ==== 3514+0+0 (secure 0 0 0) 0x7f5718033020 con 0x564ff683a700 2024-04-26T23:43:36.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5737a66000 10 client.6042 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T23:43:36.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5737a66000 10 client.6042 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T23:43:36.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5737a66000 20 client.6042 populate_metadata read hostname 'smithi137' 2024-04-26T23:43:36.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5737a66000 1 --2- 172.21.15.137:0/3717014197 >> [v2:172.21.15.137:6834/2120163779,v1:172.21.15.137:6836/2120163779] conn(0x564ff68a9980 0x564ff68a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5737a66000 4 client.6042 mds_command: new command op to 5835 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T23:43:36.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5737a66000 1 -- 172.21.15.137:0/3717014197 --> [v2:172.21.15.137:6834/2120163779,v1:172.21.15.137:6836/2120163779] -- command(tid 0: {"prefix": "status"}) -- 0x564ff664ca10 con 0x564ff68a9980 2024-04-26T23:43:36.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5731c00640 1 --2- 172.21.15.137:0/3717014197 >> [v2:172.21.15.137:6834/2120163779,v1:172.21.15.137:6836/2120163779] conn(0x564ff68a9980 0x564ff68a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5731c00640 1 --2- 172.21.15.137:0/3717014197 >> [v2:172.21.15.137:6834/2120163779,v1:172.21.15.137:6836/2120163779] conn(0x564ff68a9980 0x564ff68a9d60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4ebedb69ed740203 server_cookie=c9e3842fc86be3ce in_seq=0 out_seq=0 2024-04-26T23:43:36.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5712a00640 10 client.6042 ms_handle_connect on v2:172.21.15.137:6834/2120163779 2024-04-26T23:43:36.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5712a00640 1 -- 172.21.15.137:0/3717014197 <== mds.1 v2:172.21.15.137:6834/2120163779 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x564ff664ca10 con 0x564ff68a9980 2024-04-26T23:43:36.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5712a00640 10 client.6042 handle_command_reply: tid=0 2024-04-26T23:43:36.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5737a66000 1 client.6042 shutdown 2024-04-26T23:43:36.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5737a66000 1 -- 172.21.15.137:0/3717014197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff683a700 msgr2=0x564ff6866340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:36.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5737a66000 1 --2- 172.21.15.137:0/3717014197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff683a700 0x564ff6866340 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f57180157f0 tx=0x7f5718004740 comp rx=0 tx=0).stop 2024-04-26T23:43:36.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5737a66000 1 -- 172.21.15.137:0/3717014197 shutdown_connections 2024-04-26T23:43:36.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5737a66000 1 --2- 172.21.15.137:0/3717014197 >> [v2:172.21.15.137:6834/2120163779,v1:172.21.15.137:6836/2120163779] conn(0x564ff68a9980 0x564ff68a9d60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5737a66000 1 --2- 172.21.15.137:0/3717014197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564ff683a700 0x564ff6866340 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5737a66000 1 --2- 172.21.15.137:0/3717014197 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564ff683b020 0x564ff6866880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5712a00640 0 client.6042 ms_handle_reset on v2:172.21.15.137:6834/2120163779 2024-04-26T23:43:36.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5737a66000 1 --2- 172.21.15.137:0/3717014197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564ff67f1740 0x564ff684f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5737a66000 1 -- 172.21.15.137:0/3717014197 >> 172.21.15.137:0/3717014197 conn(0x564ff67ed6f0 msgr2=0x564ff6847cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:36.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5737a66000 1 -- 172.21.15.137:0/3717014197 shutdown_connections 2024-04-26T23:43:36.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5737a66000 1 -- 172.21.15.137:0/3717014197 wait complete. 2024-04-26T23:43:36.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5737a66000 20 client.6042 trim_cache size 0 max 16384 2024-04-26T23:43:36.370 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:43:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "efde6204-be0d-4c4f-9ea0-954d26627e78", 2024-04-26T23:43:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 1, 2024-04-26T23:43:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 5835, 2024-04-26T23:43:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-26T23:43:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-26T23:43:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-26T23:43:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 2.7617941579999998, 2024-04-26T23:43:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 28, 2024-04-26T23:43:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 45, 2024-04-26T23:43:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 45, 2024-04-26T23:43:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 18.057745793999999 2024-04-26T23:43:36.370 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:43:36.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5733000640 1 -- 172.21.15.137:0/1311647213 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f570c068380 msgr2=0x7f570c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:36.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5733000640 1 --2- 172.21.15.137:0/1311647213 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f570c068380 0x7f570c06a840 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5720001670 tx=0x7f5720009040 comp rx=0 tx=0).stop 2024-04-26T23:43:36.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5733000640 1 -- 172.21.15.137:0/1311647213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f572c15f560 msgr2=0x7f572c1fc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:36.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5733000640 1 --2- 172.21.15.137:0/1311647213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f572c15f560 0x7f572c1fc0b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f57240af040 tx=0x7f5724019790 comp rx=0 tx=0).stop 2024-04-26T23:43:36.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5733000640 1 -- 172.21.15.137:0/1311647213 shutdown_connections 2024-04-26T23:43:36.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5733000640 1 --2- 172.21.15.137:0/1311647213 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f570c068380 0x7f570c06a840 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5733000640 1 --2- 172.21.15.137:0/1311647213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f572c15f560 0x7f572c1fc0b0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5733000640 1 --2- 172.21.15.137:0/1311647213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f572c0b4b70 0x7f572c15a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5733000640 1 --2- 172.21.15.137:0/1311647213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f572c0b30b0 0x7f572c1ff000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5733000640 1 -- 172.21.15.137:0/1311647213 >> 172.21.15.137:0/1311647213 conn(0x7f572c075750 msgr2=0x7f572c0b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:36.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5733000640 1 -- 172.21.15.137:0/1311647213 shutdown_connections 2024-04-26T23:43:36.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.358+0000 7f5733000640 1 -- 172.21.15.137:0/1311647213 wait complete. 2024-04-26T23:43:36.385 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T23:43:36.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.514+0000 7f5296400640 1 Processor -- start 2024-04-26T23:43:36.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.514+0000 7f5296400640 1 -- start start 2024-04-26T23:43:36.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.514+0000 7f5296400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5290072c30 0x7f52900b3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.514+0000 7f5296400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5290073010 0x7f52900b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.514+0000 7f5296400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f529006e630 con 0x7f5290072560 2024-04-26T23:43:36.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.514+0000 7f5296400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f52900b4bc0 con 0x7f5290073010 2024-04-26T23:43:36.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.514+0000 7f5296400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f52900cd620 con 0x7f5290072c30 2024-04-26T23:43:36.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.514+0000 7f5295a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5290073010 0x7f52900b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.514+0000 7f5295a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5290073010 0x7f52900b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53640/0 (socket says 172.21.15.137:53640) 2024-04-26T23:43:36.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.514+0000 7f5295a00640 1 -- 172.21.15.137:0/3436314450 learned_addr learned my addr 172.21.15.137:0/3436314450 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:36.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.514+0000 7f5295000640 1 --2- 172.21.15.137:0/3436314450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5290072c30 0x7f52900b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.518+0000 7f5295a00640 1 -- 172.21.15.137:0/3436314450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5290072c30 msgr2=0x7f52900b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:36.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.518+0000 7f5295a00640 1 --2- 172.21.15.137:0/3436314450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5290072c30 0x7f52900b3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.518+0000 7f5295a00640 1 -- 172.21.15.137:0/3436314450 >> v1:172.21.15.170:6789/0 conn(0x7f5290072560 legacy=0x7f52900cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:36.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.518+0000 7f5295a00640 1 -- 172.21.15.137:0/3436314450 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529006e350 con 0x7f5290073010 2024-04-26T23:43:36.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.518+0000 7f5295a00640 1 --2- 172.21.15.137:0/3436314450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5290073010 0x7f52900b5050 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5288009870 tx=0x7f528801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b03230f0a12f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:36.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.518+0000 7f528f400640 1 -- 172.21.15.137:0/3436314450 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52880b0070 con 0x7f5290073010 2024-04-26T23:43:36.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.518+0000 7f528f400640 1 -- 172.21.15.137:0/3436314450 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52880ab600 con 0x7f5290073010 2024-04-26T23:43:36.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.518+0000 7f528f400640 1 -- 172.21.15.137:0/3436314450 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52880ab9d0 con 0x7f5290073010 2024-04-26T23:43:36.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.518+0000 7f5296400640 1 -- 172.21.15.137:0/3436314450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5290073010 msgr2=0x7f52900b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:36.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.518+0000 7f5296400640 1 --2- 172.21.15.137:0/3436314450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5290073010 0x7f52900b5050 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5288009870 tx=0x7f528801c4d0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.518+0000 7f5296400640 1 -- 172.21.15.137:0/3436314450 shutdown_connections 2024-04-26T23:43:36.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.518+0000 7f5296400640 1 --2- 172.21.15.137:0/3436314450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5290073010 0x7f52900b5050 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.518+0000 7f5296400640 1 --2- 172.21.15.137:0/3436314450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5290072c30 0x7f52900b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.518+0000 7f5296400640 1 -- 172.21.15.137:0/3436314450 >> 172.21.15.137:0/3436314450 conn(0x7f52900b2730 msgr2=0x7f52900b2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:36.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f5296400640 1 -- 172.21.15.137:0/3436314450 shutdown_connections 2024-04-26T23:43:36.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f5296400640 1 -- 172.21.15.137:0/3436314450 wait complete. 2024-04-26T23:43:36.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f5296400640 1 Processor -- start 2024-04-26T23:43:36.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f5296400640 1 -- start start 2024-04-26T23:43:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f5296400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5290072560 0x7f52901531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f5296400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5290072c30 0x7f5290141370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f5296400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5290073010 0x7f52901515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f5296400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f52901689c0 con 0x7f5290072c30 2024-04-26T23:43:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f5296400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5290168840 con 0x7f5290073010 2024-04-26T23:43:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f5296400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5290168b40 con 0x7f5290072560 2024-04-26T23:43:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f528fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5290072c30 0x7f5290141370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f528fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5290072c30 0x7f5290141370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53654/0 (socket says 172.21.15.137:53654) 2024-04-26T23:43:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f528fe00640 1 -- 172.21.15.137:0/2433694063 learned_addr learned my addr 172.21.15.137:0/2433694063 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f5295000640 1 --2- 172.21.15.137:0/2433694063 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5290072560 0x7f52901531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f5295a00640 1 --2- 172.21.15.137:0/2433694063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5290073010 0x7f52901515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f528fe00640 1 -- 172.21.15.137:0/2433694063 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5290072560 msgr2=0x7f52901531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:36.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f528fe00640 1 --2- 172.21.15.137:0/2433694063 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5290072560 0x7f52901531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f528fe00640 1 -- 172.21.15.137:0/2433694063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5290073010 msgr2=0x7f52901515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:36.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f528fe00640 1 --2- 172.21.15.137:0/2433694063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5290073010 0x7f52901515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f528fe00640 1 -- 172.21.15.137:0/2433694063 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5290151300 con 0x7f5290072c30 2024-04-26T23:43:36.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f528fe00640 1 --2- 172.21.15.137:0/2433694063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5290072c30 0x7f5290141370 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f527c00c460 tx=0x7f527c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:36.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f528cc00640 1 -- 172.21.15.137:0/2433694063 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c016020 con 0x7f5290072c30 2024-04-26T23:43:36.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f528cc00640 1 -- 172.21.15.137:0/2433694063 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f527c0052d0 con 0x7f5290072c30 2024-04-26T23:43:36.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f5296400640 1 -- 172.21.15.137:0/2433694063 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5290152110 con 0x7f5290072c30 2024-04-26T23:43:36.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f528cc00640 1 -- 172.21.15.137:0/2433694063 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c007260 con 0x7f5290072c30 2024-04-26T23:43:36.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.522+0000 7f5296400640 1 -- 172.21.15.137:0/2433694063 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52901526d0 con 0x7f5290072c30 2024-04-26T23:43:36.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.526+0000 7f528cc00640 1 -- 172.21.15.137:0/2433694063 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f527c007400 con 0x7f5290072c30 2024-04-26T23:43:36.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.526+0000 7f528cc00640 1 --2- 172.21.15.137:0/2433694063 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f52700683d0 0x7f527006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.526+0000 7f528cc00640 1 -- 172.21.15.137:0/2433694063 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f527c0862e0 con 0x7f5290072c30 2024-04-26T23:43:36.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.526+0000 7f5295000640 1 --2- 172.21.15.137:0/2433694063 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f52700683d0 0x7f527006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.526+0000 7f529aded000 1 Processor -- start 2024-04-26T23:43:36.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.526+0000 7f529aded000 1 -- start start 2024-04-26T23:43:36.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.526+0000 7f5295000640 1 --2- 172.21.15.137:0/2433694063 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f52700683d0 0x7f527006a890 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5280007330 tx=0x7f528000b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:36.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f529aded000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf5877a700 0x55bf5877aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f529aded000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55bf5877b020 0x55bf58731200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f529aded000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf58731740 0x55bf58731b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f529aded000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bf585e9140 con 0x55bf5877a700 2024-04-26T23:43:36.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f529aded000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55bf5857ee00 con 0x55bf58731740 2024-04-26T23:43:36.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f529aded000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55bf58537a00 con 0x55bf5877b020 2024-04-26T23:43:36.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f5295000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf5877a700 0x55bf5877aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f5295000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf5877a700 0x55bf5877aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53670/0 (socket says 172.21.15.137:53670) 2024-04-26T23:43:36.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f5295000640 1 -- 172.21.15.137:0/2569805772 learned_addr learned my addr 172.21.15.137:0/2569805772 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:36.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f528fe00640 1 --2- 172.21.15.137:0/2569805772 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55bf5877b020 0x55bf58731200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f5295a00640 1 --2- 172.21.15.137:0/2569805772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf58731740 0x55bf58731b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f5295000640 1 -- 172.21.15.137:0/2569805772 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55bf5877b020 msgr2=0x55bf58731200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:36.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f5295000640 1 --2- 172.21.15.137:0/2569805772 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55bf5877b020 0x55bf58731200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f5295000640 1 -- 172.21.15.137:0/2569805772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf58731740 msgr2=0x55bf58731b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:36.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f5295000640 1 --2- 172.21.15.137:0/2569805772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf58731740 0x55bf58731b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f5295000640 1 -- 172.21.15.137:0/2569805772 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf5853c0e0 con 0x55bf5877a700 2024-04-26T23:43:36.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f5295000640 1 --2- 172.21.15.137:0/2569805772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf5877a700 0x55bf5877aae0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5280016700 tx=0x7f5280012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966faf60a309793f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:36.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f5285600640 1 -- 172.21.15.137:0/2569805772 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5280026070 con 0x55bf5877a700 2024-04-26T23:43:36.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f5285600640 1 -- 172.21.15.137:0/2569805772 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5280014a20 con 0x55bf5877a700 2024-04-26T23:43:36.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f5285600640 1 -- 172.21.15.137:0/2569805772 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5280014dd0 con 0x55bf5877a700 2024-04-26T23:43:36.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f529aded000 1 -- 172.21.15.137:0/2569805772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf5877a700 msgr2=0x55bf5877aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:36.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f529aded000 1 --2- 172.21.15.137:0/2569805772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf5877a700 0x55bf5877aae0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5280016700 tx=0x7f5280012000 comp rx=0 tx=0).stop 2024-04-26T23:43:36.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f529aded000 1 -- 172.21.15.137:0/2569805772 shutdown_connections 2024-04-26T23:43:36.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f529aded000 1 --2- 172.21.15.137:0/2569805772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf58731740 0x55bf58731b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f529aded000 1 --2- 172.21.15.137:0/2569805772 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55bf5877b020 0x55bf58731200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f529aded000 1 --2- 172.21.15.137:0/2569805772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf5877a700 0x55bf5877aae0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f529aded000 1 -- 172.21.15.137:0/2569805772 >> 172.21.15.137:0/2569805772 conn(0x55bf5872d6f0 msgr2=0x55bf5872fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:36.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f529aded000 1 -- 172.21.15.137:0/2569805772 shutdown_connections 2024-04-26T23:43:36.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f529aded000 1 -- 172.21.15.137:0/2569805772 wait complete. 2024-04-26T23:43:36.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f529aded000 1 -- start start 2024-04-26T23:43:36.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.530+0000 7f529aded000 1 Processor -- start 2024-04-26T23:43:36.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf58731740 0x55bf5873c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf5877a700 0x55bf5873c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55bf5877b020 0x55bf5873cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bf5858c200 con 0x55bf5877a700 2024-04-26T23:43:36.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55bf58522e80 con 0x55bf58731740 2024-04-26T23:43:36.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55bf58579ae0 con 0x55bf5877b020 2024-04-26T23:43:36.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 10 client.0 _ll_register_callbacks cb 0x55bf5858bda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:43:36.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f528fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf5877a700 0x55bf5873c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f528fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf5877a700 0x55bf5873c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53682/0 (socket says 172.21.15.137:53682) 2024-04-26T23:43:36.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f528fe00640 1 -- 172.21.15.137:0/2140260081 learned_addr learned my addr 172.21.15.137:0/2140260081 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:36.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f5295000640 1 --2- 172.21.15.137:0/2140260081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf58731740 0x55bf5873c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f5295a00640 1 --2- 172.21.15.137:0/2140260081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55bf5877b020 0x55bf5873cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f528fe00640 1 -- 172.21.15.137:0/2140260081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55bf5877b020 msgr2=0x55bf5873cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:36.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f528fe00640 1 --2- 172.21.15.137:0/2140260081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55bf5877b020 0x55bf5873cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f528fe00640 1 -- 172.21.15.137:0/2140260081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf58731740 msgr2=0x55bf5873c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:36.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f528fe00640 1 --2- 172.21.15.137:0/2140260081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf58731740 0x55bf5873c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f528fe00640 1 -- 172.21.15.137:0/2140260081 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf5851e4e0 con 0x55bf5877a700 2024-04-26T23:43:36.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f528fe00640 1 --2- 172.21.15.137:0/2140260081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf5877a700 0x55bf5873c5e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f527c00c430 tx=0x7f527c056a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9299acdd040f4ab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:36.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f527a000640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T23:43:36.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f527a000640 1 -- 172.21.15.137:0/2140260081 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c05edf0 con 0x55bf5877a700 2024-04-26T23:43:36.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f527a000640 1 -- 172.21.15.137:0/2140260081 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f527c052880 con 0x55bf5877a700 2024-04-26T23:43:36.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 1 -- 172.21.15.137:0/2140260081 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5280014a20 con 0x55bf5877a700 2024-04-26T23:43:36.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f527a000640 1 -- 172.21.15.137:0/2140260081 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f527c05e960 con 0x55bf5877a700 2024-04-26T23:43:36.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 10 client.6054 fetch_fsmap learned FSMap version 28 2024-04-26T23:43:36.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 1 -- 172.21.15.137:0/2140260081 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x55bf58504e80 con 0x55bf5877a700 2024-04-26T23:43:36.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f527a000640 1 -- 172.21.15.137:0/2140260081 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5280014a20 con 0x55bf5877a700 2024-04-26T23:43:36.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f527a000640 1 -- 172.21.15.137:0/2140260081 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 28) ==== 3514+0+0 (secure 0 0 0) 0x7f527c05a0c0 con 0x55bf5877a700 2024-04-26T23:43:36.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 10 client.6054 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T23:43:36.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 10 client.6054 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T23:43:36.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 20 client.6054 populate_metadata read hostname 'smithi137' 2024-04-26T23:43:36.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 1 --2- 172.21.15.137:0/2140260081 >> [v2:172.21.15.137:6835/547646153,v1:172.21.15.137:6837/547646153] conn(0x55bf5878a7a0 0x55bf5878cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 4 client.6054 mds_command: new command op to 5838 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T23:43:36.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 1 -- 172.21.15.137:0/2140260081 --> [v2:172.21.15.137:6835/547646153,v1:172.21.15.137:6837/547646153] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf58517bc0 con 0x55bf5878a7a0 2024-04-26T23:43:36.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f5295000640 1 --2- 172.21.15.137:0/2140260081 >> [v2:172.21.15.137:6835/547646153,v1:172.21.15.137:6837/547646153] conn(0x55bf5878a7a0 0x55bf5878cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f5295000640 1 --2- 172.21.15.137:0/2140260081 >> [v2:172.21.15.137:6835/547646153,v1:172.21.15.137:6837/547646153] conn(0x55bf5878a7a0 0x55bf5878cb90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfe4aad51b87c64e server_cookie=f6b64f099b288472 in_seq=0 out_seq=0 2024-04-26T23:43:36.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f527a000640 10 client.6054 ms_handle_connect on v2:172.21.15.137:6835/547646153 2024-04-26T23:43:36.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f527a000640 1 -- 172.21.15.137:0/2140260081 <== mds.0 v2:172.21.15.137:6835/547646153 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bf58517bc0 con 0x55bf5878a7a0 2024-04-26T23:43:36.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f527a000640 10 client.6054 handle_command_reply: tid=0 2024-04-26T23:43:36.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 1 client.6054 shutdown 2024-04-26T23:43:36.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 1 -- 172.21.15.137:0/2140260081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf5877a700 msgr2=0x55bf5873c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:36.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 1 --2- 172.21.15.137:0/2140260081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf5877a700 0x55bf5873c5e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f527c00c430 tx=0x7f527c056a20 comp rx=0 tx=0).stop 2024-04-26T23:43:36.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 1 -- 172.21.15.137:0/2140260081 shutdown_connections 2024-04-26T23:43:36.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 1 --2- 172.21.15.137:0/2140260081 >> [v2:172.21.15.137:6835/547646153,v1:172.21.15.137:6837/547646153] conn(0x55bf5878a7a0 0x55bf5878cb90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 1 --2- 172.21.15.137:0/2140260081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf5877a700 0x55bf5873c5e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 1 --2- 172.21.15.137:0/2140260081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55bf5877b020 0x55bf5873cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 1 --2- 172.21.15.137:0/2140260081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf58731740 0x55bf5873c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 1 -- 172.21.15.137:0/2140260081 >> 172.21.15.137:0/2140260081 conn(0x55bf5872d6f0 msgr2=0x55bf58730370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:36.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f527a000640 0 client.6054 ms_handle_reset on v2:172.21.15.137:6835/547646153 2024-04-26T23:43:36.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 1 -- 172.21.15.137:0/2140260081 shutdown_connections 2024-04-26T23:43:36.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.534+0000 7f529aded000 1 -- 172.21.15.137:0/2140260081 wait complete. 2024-04-26T23:43:36.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.538+0000 7f529aded000 20 client.6054 trim_cache size 0 max 16384 2024-04-26T23:43:36.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.554+0000 7f529aded000 1 Processor -- start 2024-04-26T23:43:36.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.554+0000 7f529aded000 1 -- start start 2024-04-26T23:43:36.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.554+0000 7f529aded000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf58731740 0x55bf58730af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.554+0000 7f529aded000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf5877a700 0x55bf58731030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.554+0000 7f529aded000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55bf5877b020 0x55bf587e5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.554+0000 7f529aded000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f52902047d0 con 0x55bf58731740 2024-04-26T23:43:36.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.554+0000 7f529aded000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5290155550 con 0x55bf5877a700 2024-04-26T23:43:36.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.554+0000 7f529aded000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5290203330 con 0x55bf5877b020 2024-04-26T23:43:36.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.554+0000 7f5295000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf58731740 0x55bf58730af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.554+0000 7f5295000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf58731740 0x55bf58730af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53696/0 (socket says 172.21.15.137:53696) 2024-04-26T23:43:36.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.554+0000 7f5295000640 1 -- 172.21.15.137:0/3380058234 learned_addr learned my addr 172.21.15.137:0/3380058234 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:36.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.554+0000 7f5295000640 1 -- 172.21.15.137:0/3380058234 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55bf5877b020 msgr2=0x55bf587e5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:36.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.554+0000 7f5295000640 1 --2- 172.21.15.137:0/3380058234 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55bf5877b020 0x55bf587e5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.554+0000 7f5295000640 1 -- 172.21.15.137:0/3380058234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf5877a700 msgr2=0x55bf58731030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:36.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.554+0000 7f5295000640 1 --2- 172.21.15.137:0/3380058234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf5877a700 0x55bf58731030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.554+0000 7f5295000640 1 -- 172.21.15.137:0/3380058234 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf58537c50 con 0x55bf58731740 2024-04-26T23:43:36.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.554+0000 7f5295000640 1 --2- 172.21.15.137:0/3380058234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf58731740 0x55bf58730af0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f52800166a0 tx=0x7f5280014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac445bb4c6c8ed0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:36.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.554+0000 7f5284c00640 1 -- 172.21.15.137:0/3380058234 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5280026040 con 0x55bf58731740 2024-04-26T23:43:36.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.554+0000 7f5284c00640 1 -- 172.21.15.137:0/3380058234 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528003a070 con 0x55bf58731740 2024-04-26T23:43:36.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.554+0000 7f5284c00640 1 -- 172.21.15.137:0/3380058234 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5280034300 con 0x55bf58731740 2024-04-26T23:43:36.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 1 -- 172.21.15.137:0/3380058234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf58731740 msgr2=0x55bf58730af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:36.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 1 --2- 172.21.15.137:0/3380058234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf58731740 0x55bf58730af0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f52800166a0 tx=0x7f5280014000 comp rx=0 tx=0).stop 2024-04-26T23:43:36.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 1 -- 172.21.15.137:0/3380058234 shutdown_connections 2024-04-26T23:43:36.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 1 --2- 172.21.15.137:0/3380058234 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55bf5877b020 0x55bf587e5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 1 --2- 172.21.15.137:0/3380058234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf5877a700 0x55bf58731030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 1 --2- 172.21.15.137:0/3380058234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf58731740 0x55bf58730af0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 1 -- 172.21.15.137:0/3380058234 >> 172.21.15.137:0/3380058234 conn(0x55bf5872d6f0 msgr2=0x55bf5873c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:36.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 1 -- 172.21.15.137:0/3380058234 shutdown_connections 2024-04-26T23:43:36.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 1 -- 172.21.15.137:0/3380058234 wait complete. 2024-04-26T23:43:36.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 1 -- start start 2024-04-26T23:43:36.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 1 Processor -- start 2024-04-26T23:43:36.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55bf58731740 0x55bf5878eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf5877a700 0x55bf5878f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf5877b020 0x55bf587a6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bf5857e110 con 0x55bf5877b020 2024-04-26T23:43:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55bf585147b0 con 0x55bf5877a700 2024-04-26T23:43:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55bf58583430 con 0x55bf58731740 2024-04-26T23:43:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 10 client.0 _ll_register_callbacks cb 0x7f527c005590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:43:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f5295a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf5877b020 0x55bf587a6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f5295a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf5877b020 0x55bf587a6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53710/0 (socket says 172.21.15.137:53710) 2024-04-26T23:43:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f5295a00640 1 -- 172.21.15.137:0/1191640720 learned_addr learned my addr 172.21.15.137:0/1191640720 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f528fe00640 1 --2- 172.21.15.137:0/1191640720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf5877a700 0x55bf5878f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f5295000640 1 --2- 172.21.15.137:0/1191640720 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55bf58731740 0x55bf5878eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f5295a00640 1 -- 172.21.15.137:0/1191640720 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55bf58731740 msgr2=0x55bf5878eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f5295a00640 1 --2- 172.21.15.137:0/1191640720 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55bf58731740 0x55bf5878eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f5295a00640 1 -- 172.21.15.137:0/1191640720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf5877a700 msgr2=0x55bf5878f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f5295a00640 1 --2- 172.21.15.137:0/1191640720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf5877a700 0x55bf5878f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f5295a00640 1 -- 172.21.15.137:0/1191640720 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf58601160 con 0x55bf5877b020 2024-04-26T23:43:36.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f5295a00640 1 --2- 172.21.15.137:0/1191640720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf5877b020 0x55bf587a6720 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f52880ae040 tx=0x7f528801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c7744652296fe9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:36.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f527a000640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T23:43:36.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f527a000640 1 -- 172.21.15.137:0/1191640720 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52880b0040 con 0x55bf5877b020 2024-04-26T23:43:36.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f527a000640 1 -- 172.21.15.137:0/1191640720 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f52880abc80 con 0x55bf5877b020 2024-04-26T23:43:36.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 1 -- 172.21.15.137:0/1191640720 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f528003a070 con 0x55bf5877b020 2024-04-26T23:43:36.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f527a000640 1 -- 172.21.15.137:0/1191640720 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f52880b5410 con 0x55bf5877b020 2024-04-26T23:43:36.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 10 client.6060 fetch_fsmap learned FSMap version 28 2024-04-26T23:43:36.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 1 -- 172.21.15.137:0/1191640720 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x55bf582380c0 con 0x55bf5877b020 2024-04-26T23:43:36.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f527a000640 1 -- 172.21.15.137:0/1191640720 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528003a070 con 0x55bf5877b020 2024-04-26T23:43:36.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f527a000640 1 -- 172.21.15.137:0/1191640720 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 28) ==== 3514+0+0 (secure 0 0 0) 0x7f52880b55b0 con 0x55bf5877b020 2024-04-26T23:43:36.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 10 client.6060 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T23:43:36.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 10 client.6060 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T23:43:36.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 20 client.6060 populate_metadata read hostname 'smithi137' 2024-04-26T23:43:36.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 1 --2- 172.21.15.137:0/1191640720 >> [v2:172.21.15.137:6835/547646153,v1:172.21.15.137:6837/547646153] conn(0x55bf587efb80 0x55bf587f1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:36.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 4 client.6060 mds_command: new command op to 5838 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T23:43:36.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.558+0000 7f529aded000 1 -- 172.21.15.137:0/1191640720 --> [v2:172.21.15.137:6835/547646153,v1:172.21.15.137:6837/547646153] -- command(tid 0: {"prefix": "status"}) -- 0x55bf5858ca10 con 0x55bf587efb80 2024-04-26T23:43:36.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f5295000640 1 --2- 172.21.15.137:0/1191640720 >> [v2:172.21.15.137:6835/547646153,v1:172.21.15.137:6837/547646153] conn(0x55bf587efb80 0x55bf587f1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:36.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f527a000640 10 client.6060 ms_handle_connect on v2:172.21.15.137:6835/547646153 2024-04-26T23:43:36.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f5295000640 1 --2- 172.21.15.137:0/1191640720 >> [v2:172.21.15.137:6835/547646153,v1:172.21.15.137:6837/547646153] conn(0x55bf587efb80 0x55bf587f1f70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c08b81f78bd88e09 server_cookie=3c678c1af2a11210 in_seq=0 out_seq=0 2024-04-26T23:43:36.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f527a000640 1 -- 172.21.15.137:0/1191640720 <== mds.0 v2:172.21.15.137:6835/547646153 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x55bf5858ca10 con 0x55bf587efb80 2024-04-26T23:43:36.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f527a000640 10 client.6060 handle_command_reply: tid=0 2024-04-26T23:43:36.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f529aded000 1 client.6060 shutdown 2024-04-26T23:43:36.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f529aded000 1 -- 172.21.15.137:0/1191640720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf5877b020 msgr2=0x55bf587a6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:36.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f529aded000 1 --2- 172.21.15.137:0/1191640720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf5877b020 0x55bf587a6720 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f52880ae040 tx=0x7f528801ad10 comp rx=0 tx=0).stop 2024-04-26T23:43:36.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f529aded000 1 -- 172.21.15.137:0/1191640720 shutdown_connections 2024-04-26T23:43:36.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f529aded000 1 --2- 172.21.15.137:0/1191640720 >> [v2:172.21.15.137:6835/547646153,v1:172.21.15.137:6837/547646153] conn(0x55bf587efb80 0x55bf587f1f70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f529aded000 1 --2- 172.21.15.137:0/1191640720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf5877b020 0x55bf587a6720 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f529aded000 1 --2- 172.21.15.137:0/1191640720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf5877a700 0x55bf5878f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f529aded000 1 --2- 172.21.15.137:0/1191640720 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55bf58731740 0x55bf5878eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f527a000640 0 client.6060 ms_handle_reset on v2:172.21.15.137:6835/547646153 2024-04-26T23:43:36.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f529aded000 1 -- 172.21.15.137:0/1191640720 >> 172.21.15.137:0/1191640720 conn(0x55bf5872d6f0 msgr2=0x55bf5873c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:36.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f529aded000 1 -- 172.21.15.137:0/1191640720 shutdown_connections 2024-04-26T23:43:36.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f529aded000 1 -- 172.21.15.137:0/1191640720 wait complete. 2024-04-26T23:43:36.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f529aded000 20 client.6060 trim_cache size 0 max 16384 2024-04-26T23:43:36.573 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:43:36.573 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "efde6204-be0d-4c4f-9ea0-954d26627e78", 2024-04-26T23:43:36.573 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 0, 2024-04-26T23:43:36.574 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 5838, 2024-04-26T23:43:36.574 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-26T23:43:36.574 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-26T23:43:36.574 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-26T23:43:36.574 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 12.348158782, 2024-04-26T23:43:36.574 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 28, 2024-04-26T23:43:36.574 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 45, 2024-04-26T23:43:36.574 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 45, 2024-04-26T23:43:36.574 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 18.259631147 2024-04-26T23:43:36.574 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:43:36.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f5296400640 1 -- 172.21.15.137:0/2433694063 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f52700683d0 msgr2=0x7f527006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:36.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f5296400640 1 --2- 172.21.15.137:0/2433694063 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f52700683d0 0x7f527006a890 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5280007330 tx=0x7f528000b040 comp rx=0 tx=0).stop 2024-04-26T23:43:36.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f5296400640 1 -- 172.21.15.137:0/2433694063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5290072c30 msgr2=0x7f5290141370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:36.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f5296400640 1 --2- 172.21.15.137:0/2433694063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5290072c30 0x7f5290141370 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f527c00c460 tx=0x7f527c00c920 comp rx=0 tx=0).stop 2024-04-26T23:43:36.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f5296400640 1 -- 172.21.15.137:0/2433694063 shutdown_connections 2024-04-26T23:43:36.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f5296400640 1 --2- 172.21.15.137:0/2433694063 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f52700683d0 0x7f527006a890 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f5296400640 1 --2- 172.21.15.137:0/2433694063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5290072c30 0x7f5290141370 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f5296400640 1 --2- 172.21.15.137:0/2433694063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5290073010 0x7f52901515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f5296400640 1 --2- 172.21.15.137:0/2433694063 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5290072560 0x7f52901531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:36.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f5296400640 1 -- 172.21.15.137:0/2433694063 >> 172.21.15.137:0/2433694063 conn(0x7f52900b2730 msgr2=0x7f52900b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:36.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f5296400640 1 -- 172.21.15.137:0/2433694063 shutdown_connections 2024-04-26T23:43:36.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36.562+0000 7f5296400640 1 -- 172.21.15.137:0/2433694063 wait complete. 2024-04-26T23:43:36.589 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir {d0,d1} && touch {d0,d1}/file') 2024-04-26T23:43:36.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:43:36.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:43:36.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:36.668 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d0) 2024-04-26T23:43:36.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:36.692 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1) 2024-04-26T23:43:36.749 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-04-26T23:43:36.953 INFO:teuthology.orchestra.run.smithi137.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"9","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-04-26T23:43:36.953 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 2, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "9" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-04-26T23:43:36.954 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d0', 0), ('/d1', 1)] 2024-04-26T23:43:38.955 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-04-26T23:43:39.121 INFO:teuthology.orchestra.run.smithi137.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-04-26T23:43:39.121 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-04-26T23:43:39.122 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d0', 0), ('/d1', 1)] 2024-04-26T23:43:41.123 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-04-26T23:43:41.290 INFO:teuthology.orchestra.run.smithi137.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-04-26T23:43:41.291 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-04-26T23:43:41.291 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d0', 0), ('/d1', 1)] 2024-04-26T23:43:43.293 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-04-26T23:43:43.463 INFO:teuthology.orchestra.run.smithi137.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d0","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"5","version":"5","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"5","version":"5","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"18","version":"18","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-04-26T23:43:43.463 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/d0", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "5", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000001", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "5", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "18", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "18" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-04-26T23:43:43.464 INFO:tasks.cephfs.cephfs_test_case:[('/d0', 0), ('/d1', 1)] =?= [('/d0', 0), ('/d1', 1)] 2024-04-26T23:43:43.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:43.464 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch d0/f0) 2024-04-26T23:43:43.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:43.476 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch d1/f0) 2024-04-26T23:43:43.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:43.540 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest/mnt.1 && exec touch d0/f1) 2024-04-26T23:43:43.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:43.562 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest/mnt.1 && exec touch d1/f1) 2024-04-26T23:43:43.631 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-04-26T23:43:43.791 INFO:teuthology.orchestra.run.smithi137.stdout:[{"id":35297,"entity":{"name":{"type":"client","num":35297},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":595466655}},"state":"open","num_leases":1,"num_caps":4,"request_load_avg":6,"uptime":10.987840221000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":7.9399170062683782,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":9,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.35297 192.168.0.1:0/595466655","completed_requests":[],"prealloc_inos":[{"start":"0x100000005e1","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"bc612ffb9c1d5bc27536bc917a705262a36d4387","ceph_version":"ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)","entity_id":"1","hostname":"smithi170","mount_point":"/home/ubuntu/cephtest/mnt.1","pid":"32605","root":"/"}},{"id":5991,"entity":{"name":{"type":"client","num":5991},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":268105340}},"state":"open","num_leases":3,"num_caps":5,"request_load_avg":12,"uptime":12.567815048,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":2,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.732435187248317,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":12,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000003","length":500}],"inst":"client.5991 192.168.0.1:0/268105340","completed_requests":[{"tid":12,"created_ino":"0x100000001f8"}],"prealloc_inos":[{"start":"0x10000000003","length":500},{"start":"0x100000001f9","length":999}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"bc612ffb9c1d5bc27536bc917a705262a36d4387","ceph_version":"ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)","entity_id":"0","hostname":"smithi137","mount_point":"/home/ubuntu/cephtest/mnt.0","pid":"40127","root":"/"}}] 2024-04-26T23:43:43.791 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "1", "hostname": "smithi170", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "32605", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 595466655, "type": "any" }, "name": { "num": 35297, "type": "client" } }, "id": 35297, "inst": "client.35297 192.168.0.1:0/595466655", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 9, "num_caps": 4, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x100000005e1" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 6, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 7.939917006268378 }, "state": "open", "uptime": 10.987840221 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "0", "hostname": "smithi137", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "40127", "root": "/" }, "completed_requests": [ { "created_ino": "0x100000001f8", "tid": 12 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000003" } ], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 268105340, "type": "any" }, "name": { "num": 5991, "type": "client" } }, "id": 5991, "inst": "client.5991 192.168.0.1:0/268105340", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 12, "num_caps": 5, "num_completed_flushes": 2, "num_completed_requests": 1, "num_leases": 3, "prealloc_inos": [ { "length": 500, "start": "0x10000000003" }, { "length": 999, "start": "0x100000001f9" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 12, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.732435187248317 }, "state": "open", "uptime": 12.567815048 } ] 2024-04-26T23:43:43.792 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-04-26T23:43:43.949 INFO:teuthology.orchestra.run.smithi137.stdout:[{"id":35297,"entity":{"name":{"type":"client","num":35297},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":595466655}},"state":"open","num_leases":1,"num_caps":2,"request_load_avg":2,"uptime":0.31999586200000002,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":3.9971729955816575,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":9,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.35297 192.168.0.1:0/595466655","completed_requests":[{"tid":10,"created_ino":"0x200000003e9"}],"prealloc_inos":[{"start":"0x200000003ea","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"bc612ffb9c1d5bc27536bc917a705262a36d4387","ceph_version":"ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)","entity_id":"1","hostname":"smithi170","mount_point":"/home/ubuntu/cephtest/mnt.1","pid":"32605","root":"/"}},{"id":5991,"entity":{"name":{"type":"client","num":5991},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":268105340}},"state":"open","num_leases":1,"num_caps":3,"request_load_avg":2,"uptime":0.56399270599999995,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":4.995021186058147,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":12,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5991 192.168.0.1:0/268105340","completed_requests":[{"tid":16,"created_ino":"0x20000000000"}],"prealloc_inos":[{"start":"0x20000000001","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"bc612ffb9c1d5bc27536bc917a705262a36d4387","ceph_version":"ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)","entity_id":"0","hostname":"smithi137","mount_point":"/home/ubuntu/cephtest/mnt.0","pid":"40127","root":"/"}}] 2024-04-26T23:43:43.950 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "1", "hostname": "smithi170", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "32605", "root": "/" }, "completed_requests": [ { "created_ino": "0x200000003e9", "tid": 10 } ], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 595466655, "type": "any" }, "name": { "num": 35297, "type": "client" } }, "id": 35297, "inst": "client.35297 192.168.0.1:0/595466655", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 9, "num_caps": 2, "num_completed_flushes": 0, "num_completed_requests": 1, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x200000003ea" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 3.9971729955816575 }, "state": "open", "uptime": 0.319995862 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "0", "hostname": "smithi137", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "40127", "root": "/" }, "completed_requests": [ { "created_ino": "0x20000000000", "tid": 16 } ], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 268105340, "type": "any" }, "name": { "num": 5991, "type": "client" } }, "id": 5991, "inst": "client.5991 192.168.0.1:0/268105340", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 12, "num_caps": 3, "num_completed_flushes": 0, "num_completed_requests": 1, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x20000000001" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 4.995021186058147 }, "state": "open", "uptime": 0.563992706 } ] 2024-04-26T23:43:43.950 DEBUG:teuthology.orchestra.run.smithi137:> sudo stdin-killer -- python3 -c ' 2024-04-26T23:43:43.950 DEBUG:teuthology.orchestra.run.smithi137:> import glob 2024-04-26T23:43:43.951 DEBUG:teuthology.orchestra.run.smithi137:> import re 2024-04-26T23:43:43.951 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T23:43:43.951 DEBUG:teuthology.orchestra.run.smithi137:> import subprocess 2024-04-26T23:43:43.951 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:43:43.951 DEBUG:teuthology.orchestra.run.smithi137:> def _find_admin_socket(client_name): 2024-04-26T23:43:43.951 DEBUG:teuthology.orchestra.run.smithi137:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T23:43:43.951 DEBUG:teuthology.orchestra.run.smithi137:> files = glob.glob(asok_path) 2024-04-26T23:43:43.951 DEBUG:teuthology.orchestra.run.smithi137:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T23:43:43.951 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:43:43.951 DEBUG:teuthology.orchestra.run.smithi137:> # Given a non-glob path, it better be there 2024-04-26T23:43:43.951 DEBUG:teuthology.orchestra.run.smithi137:> if "*" not in asok_path: 2024-04-26T23:43:43.951 DEBUG:teuthology.orchestra.run.smithi137:> assert(len(files) == 1) 2024-04-26T23:43:43.951 DEBUG:teuthology.orchestra.run.smithi137:> return files[0] 2024-04-26T23:43:43.951 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:43:43.951 DEBUG:teuthology.orchestra.run.smithi137:> for f in files: 2024-04-26T23:43:43.951 DEBUG:teuthology.orchestra.run.smithi137:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T23:43:43.951 DEBUG:teuthology.orchestra.run.smithi137:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T23:43:43.952 DEBUG:teuthology.orchestra.run.smithi137:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T23:43:43.952 DEBUG:teuthology.orchestra.run.smithi137:> contents = proc_f.read() 2024-04-26T23:43:43.952 DEBUG:teuthology.orchestra.run.smithi137:> if mountpoint in contents: 2024-04-26T23:43:43.952 DEBUG:teuthology.orchestra.run.smithi137:> return f 2024-04-26T23:43:43.952 DEBUG:teuthology.orchestra.run.smithi137:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T23:43:43.952 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:43:43.952 DEBUG:teuthology.orchestra.run.smithi137:> print(_find_admin_socket("client.0")) 2024-04-26T23:43:43.952 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T23:43:44.031 INFO:teuthology.orchestra.run.smithi137.stdout:/var/run/ceph/ceph-client.0.40127.asok 2024-04-26T23:43:44.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:43:44.043 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.40127.asok 2024-04-26T23:43:44.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:44.043 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.40127.asok mds_sessions 2024-04-26T23:43:44.209 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:43:44.210 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 5991, 2024-04-26T23:43:44.210 INFO:teuthology.orchestra.run.smithi137.stdout: "inst": { 2024-04-26T23:43:44.210 INFO:teuthology.orchestra.run.smithi137.stdout: "name": { 2024-04-26T23:43:44.210 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "client", 2024-04-26T23:43:44.210 INFO:teuthology.orchestra.run.smithi137.stdout: "num": 5991 2024-04-26T23:43:44.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:44.210 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2024-04-26T23:43:44.210 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-26T23:43:44.210 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:43:44.210 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 268105340 2024-04-26T23:43:44.210 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:44.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:44.211 INFO:teuthology.orchestra.run.smithi137.stdout: "inst_str": "client.5991 v1:192.168.0.1:0/268105340", 2024-04-26T23:43:44.211 INFO:teuthology.orchestra.run.smithi137.stdout: "addr_str": "v1:192.168.0.1:0/268105340", 2024-04-26T23:43:44.211 INFO:teuthology.orchestra.run.smithi137.stdout: "sessions": [ 2024-04-26T23:43:44.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:44.211 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": 0, 2024-04-26T23:43:44.211 INFO:teuthology.orchestra.run.smithi137.stdout: "addrs": { 2024-04-26T23:43:44.211 INFO:teuthology.orchestra.run.smithi137.stdout: "addrvec": [ 2024-04-26T23:43:44.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:44.211 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v2", 2024-04-26T23:43:44.211 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "172.21.15.137:6835", 2024-04-26T23:43:44.211 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 547646153 2024-04-26T23:43:44.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:44.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:44.211 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-26T23:43:44.212 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "172.21.15.137:6837", 2024-04-26T23:43:44.212 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 547646153 2024-04-26T23:43:44.212 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:44.212 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-26T23:43:44.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:44.212 INFO:teuthology.orchestra.run.smithi137.stdout: "seq": 11, 2024-04-26T23:43:44.212 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_gen": 0, 2024-04-26T23:43:44.212 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_ttl": "2024-04-26T23:44:32.201862+0000", 2024-04-26T23:43:44.212 INFO:teuthology.orchestra.run.smithi137.stdout: "last_cap_renew_request": "2024-04-26T23:43:32.201862+0000", 2024-04-26T23:43:44.212 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_renew_seq": 2, 2024-04-26T23:43:44.212 INFO:teuthology.orchestra.run.smithi137.stdout: "num_caps": 5, 2024-04-26T23:43:44.212 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "open" 2024-04-26T23:43:44.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:44.212 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:44.213 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": 1, 2024-04-26T23:43:44.213 INFO:teuthology.orchestra.run.smithi137.stdout: "addrs": { 2024-04-26T23:43:44.213 INFO:teuthology.orchestra.run.smithi137.stdout: "addrvec": [ 2024-04-26T23:43:44.213 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:44.213 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v2", 2024-04-26T23:43:44.213 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "172.21.15.137:6834", 2024-04-26T23:43:44.213 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 2120163779 2024-04-26T23:43:44.213 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:44.213 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:43:44.213 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-26T23:43:44.213 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "172.21.15.137:6836", 2024-04-26T23:43:44.213 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 2120163779 2024-04-26T23:43:44.213 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:44.213 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-26T23:43:44.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:43:44.214 INFO:teuthology.orchestra.run.smithi137.stdout: "seq": 1, 2024-04-26T23:43:44.214 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_gen": 0, 2024-04-26T23:43:44.214 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_ttl": "2024-04-26T23:44:43.372616+0000", 2024-04-26T23:43:44.214 INFO:teuthology.orchestra.run.smithi137.stdout: "last_cap_renew_request": "2024-04-26T23:43:43.372616+0000", 2024-04-26T23:43:44.214 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_renew_seq": 1, 2024-04-26T23:43:44.214 INFO:teuthology.orchestra.run.smithi137.stdout: "num_caps": 3, 2024-04-26T23:43:44.214 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "open" 2024-04-26T23:43:44.214 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:43:44.214 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-26T23:43:44.214 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 29 2024-04-26T23:43:44.214 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:43:44.225 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session evict 5991 2024-04-26T23:43:45.408 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:2024-04-26T23:43:45.398+0000 7f6f83e00640 -1 client.5991 I was blocklisted at osd epoch 46 2024-04-26T23:43:45.408 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:2024-04-26T23:43:45.398+0000 7f6f83e00640 -1 client.5991 remove_session_caps still has dirty|flushing caps on 0x100000001f8.head(faked_ino=0 nref=5 ll_ref=1 cap_refs={} open={2=0} mode=100664 size=0/4194304 nlink=1 btime=2024-04-26T23:43:43.471591+0000 mtime=2024-04-26T23:43:43.466610+0000 ctime=2024-04-26T23:43:43.473209+0000 change_attr=1 caps=- dirty_caps=AxFx objectset[0x100000001f8 ts 0/0 objects 0 dirty_or_tx 0] parents=0x10000000000.head["f0"] 0x7f6f7c0106e0) 2024-04-26T23:43:45.408 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:2024-04-26T23:43:45.398+0000 7f6f83e00640 -1 client.5991 remove_session_caps still has dirty|flushing caps on 0x20000000000.head(faked_ino=0 nref=5 ll_ref=1 cap_refs={} open={2=0} mode=100664 size=0/4194304 nlink=1 btime=2024-04-26T23:43:43.532574+0000 mtime=2024-04-26T23:43:43.530610+0000 ctime=2024-04-26T23:43:43.536796+0000 change_attr=1 caps=- dirty_caps=AxFx objectset[0x20000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x10000000001.head["f0"] 0x7f6f7c010cc0) 2024-04-26T23:43:45.461 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2024-04-26T23:43:45.461 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:43:45.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.590+0000 7fc152400640 1 Processor -- start 2024-04-26T23:43:45.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.590+0000 7fc152400640 1 -- start start 2024-04-26T23:43:45.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.594+0000 7fc152400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc14c070520 0x7fc14c0709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:45.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.594+0000 7fc152400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc14c0d2990 0x7fc14c0d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:45.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.594+0000 7fc152400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc14c15d430 con 0x7fc14c15d050 2024-04-26T23:43:45.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.594+0000 7fc152400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc14c070ee0 con 0x7fc14c0d2990 2024-04-26T23:43:45.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.594+0000 7fc152400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc14c0ce050 con 0x7fc14c070520 2024-04-26T23:43:45.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.594+0000 7fc151000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc14c15d050 0x7fc14c0ce4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:43776/0 (socket says 172.21.15.137:43776) 2024-04-26T23:43:45.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.594+0000 7fc151000640 1 -- 172.21.15.137:0/2000135432 learned_addr learned my addr 172.21.15.137:0/2000135432 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:45.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.594+0000 7fc151a00640 1 --2- 172.21.15.137:0/2000135432 >> v2:172.21.15.170:3300/0 conn(0x7fc14c0d2990 0x7fc14c0d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:45.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.594+0000 7fc14be00640 1 --2- 172.21.15.137:0/2000135432 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc14c070520 0x7fc14c0709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:45.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.594+0000 7fc14b400640 1 -- 172.21.15.137:0/2000135432 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4142403589 0 0) 0x7fc14c15d430 con 0x7fc14c15d050 2024-04-26T23:43:45.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.594+0000 7fc14b400640 1 -- 172.21.15.137:0/2000135432 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc134003530 con 0x7fc14c15d050 2024-04-26T23:43:45.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.594+0000 7fc14b400640 1 -- 172.21.15.137:0/2000135432 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1816095564 0 0) 0x7fc134003530 con 0x7fc14c15d050 2024-04-26T23:43:45.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.594+0000 7fc151a00640 1 -- 172.21.15.137:0/2000135432 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc14c070520 msgr2=0x7fc14c0709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:45.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.594+0000 7fc151a00640 1 --2- 172.21.15.137:0/2000135432 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc14c070520 0x7fc14c0709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:45.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.594+0000 7fc151a00640 1 -- 172.21.15.137:0/2000135432 >> v1:172.21.15.137:6789/0 conn(0x7fc14c15d050 legacy=0x7fc14c0ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:45.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.594+0000 7fc151a00640 1 -- 172.21.15.137:0/2000135432 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14c0d3360 con 0x7fc14c0d2990 2024-04-26T23:43:45.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.598+0000 7fc151a00640 1 --2- 172.21.15.137:0/2000135432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc14c0d2990 0x7fc14c0d2e20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc144009d90 tx=0x7fc14401c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac8890854170939c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:45.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.598+0000 7fc14b400640 1 -- 172.21.15.137:0/2000135432 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc140001680 con 0x7fc14c0d2990 2024-04-26T23:43:45.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.598+0000 7fc14b400640 1 -- 172.21.15.137:0/2000135432 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1440a6500 con 0x7fc14c0d2990 2024-04-26T23:43:45.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.598+0000 7fc14b400640 1 -- 172.21.15.137:0/2000135432 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1440a68b0 con 0x7fc14c0d2990 2024-04-26T23:43:45.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.598+0000 7fc152400640 1 -- 172.21.15.137:0/2000135432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc14c0d2990 msgr2=0x7fc14c0d2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:45.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.598+0000 7fc152400640 1 --2- 172.21.15.137:0/2000135432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc14c0d2990 0x7fc14c0d2e20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc144009d90 tx=0x7fc14401c800 comp rx=0 tx=0).stop 2024-04-26T23:43:45.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.598+0000 7fc152400640 1 -- 172.21.15.137:0/2000135432 shutdown_connections 2024-04-26T23:43:45.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.598+0000 7fc152400640 1 --2- 172.21.15.137:0/2000135432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc14c0d2990 0x7fc14c0d2e20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:45.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.598+0000 7fc152400640 1 --2- 172.21.15.137:0/2000135432 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc14c070520 0x7fc14c0709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:45.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.598+0000 7fc152400640 1 -- 172.21.15.137:0/2000135432 >> 172.21.15.137:0/2000135432 conn(0x7fc14c09ba60 msgr2=0x7fc14c09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:45.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.598+0000 7fc152400640 1 -- 172.21.15.137:0/2000135432 shutdown_connections 2024-04-26T23:43:45.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.598+0000 7fc152400640 1 -- 172.21.15.137:0/2000135432 wait complete. 2024-04-26T23:43:45.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.598+0000 7fc152400640 1 Processor -- start 2024-04-26T23:43:45.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.598+0000 7fc152400640 1 -- start start 2024-04-26T23:43:45.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc152400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc14c070520 0x7fc14c0b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:45.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc152400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc14c0d2990 0x7fc14c154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:45.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc152400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc14c15d050 0x7fc14c0b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:45.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc152400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc14c0d1c40 con 0x7fc14c15d050 2024-04-26T23:43:45.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc152400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc14c0cebf0 con 0x7fc14c0d2990 2024-04-26T23:43:45.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc152400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc14c0d13f0 con 0x7fc14c070520 2024-04-26T23:43:45.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc151a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc14c15d050 0x7fc14c0b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:45.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc151a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc14c15d050 0x7fc14c0b3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45674/0 (socket says 172.21.15.137:45674) 2024-04-26T23:43:45.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc151a00640 1 -- 172.21.15.137:0/2616501445 learned_addr learned my addr 172.21.15.137:0/2616501445 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:45.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc151000640 1 --2- 172.21.15.137:0/2616501445 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc14c070520 0x7fc14c0b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:45.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc14be00640 1 --2- 172.21.15.137:0/2616501445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc14c0d2990 0x7fc14c154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:45.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc151a00640 1 -- 172.21.15.137:0/2616501445 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc14c070520 msgr2=0x7fc14c0b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:45.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc151a00640 1 --2- 172.21.15.137:0/2616501445 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc14c070520 0x7fc14c0b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:45.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc151a00640 1 -- 172.21.15.137:0/2616501445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc14c0d2990 msgr2=0x7fc14c154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:45.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc151a00640 1 --2- 172.21.15.137:0/2616501445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc14c0d2990 0x7fc14c154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:45.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc151a00640 1 -- 172.21.15.137:0/2616501445 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14c155520 con 0x7fc14c15d050 2024-04-26T23:43:45.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc151a00640 1 --2- 172.21.15.137:0/2616501445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc14c15d050 0x7fc14c0b3cc0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc14401d0a0 tx=0x7fc1440195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:45.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc148c00640 1 -- 172.21.15.137:0/2616501445 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1440a68c0 con 0x7fc14c15d050 2024-04-26T23:43:45.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc148c00640 1 -- 172.21.15.137:0/2616501445 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1440a6a60 con 0x7fc14c15d050 2024-04-26T23:43:45.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc152400640 1 -- 172.21.15.137:0/2616501445 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc14c15fe30 con 0x7fc14c15d050 2024-04-26T23:43:45.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc148c00640 1 -- 172.21.15.137:0/2616501445 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1440a6c10 con 0x7fc14c15d050 2024-04-26T23:43:45.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc152400640 1 -- 172.21.15.137:0/2616501445 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc14c1603f0 con 0x7fc14c15d050 2024-04-26T23:43:45.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc152400640 1 -- 172.21.15.137:0/2616501445 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc14c06a410 con 0x7fc14c15d050 2024-04-26T23:43:45.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.602+0000 7fc148c00640 1 -- 172.21.15.137:0/2616501445 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc1440c2020 con 0x7fc14c15d050 2024-04-26T23:43:45.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.606+0000 7fc148c00640 1 --2- 172.21.15.137:0/2616501445 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc12c068380 0x7fc12c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:45.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.606+0000 7fc148c00640 1 -- 172.21.15.137:0/2616501445 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5752+0+0 (secure 0 0 0) 0x7fc144121600 con 0x7fc14c15d050 2024-04-26T23:43:45.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.606+0000 7fc151000640 1 --2- 172.21.15.137:0/2616501445 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc12c068380 0x7fc12c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:45.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.606+0000 7fc151000640 1 --2- 172.21.15.137:0/2616501445 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc12c068380 0x7fc12c06a840 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc140007950 tx=0x7fc140009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:45.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.610+0000 7fc148c00640 1 -- 172.21.15.137:0/2616501445 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc144016480 con 0x7fc14c15d050 2024-04-26T23:43:45.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.766+0000 7fc152400640 1 -- 172.21.15.137:0/2616501445 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc14c0d3020 con 0x7fc14c15d050 2024-04-26T23:43:45.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.770+0000 7fc148c00640 1 -- 172.21.15.137:0/2616501445 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16720 (secure 0 0 0) 0x7fc1440f1b00 con 0x7fc14c15d050 2024-04-26T23:43:45.777 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:45.777 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":46,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:43:45.365477+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:43:21.281556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T23:43:22.549121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/268105340":"2024-04-27T00:43:44.368539+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:43:45.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.770+0000 7fc152400640 1 -- 172.21.15.137:0/2616501445 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc12c068380 msgr2=0x7fc12c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:45.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.770+0000 7fc152400640 1 --2- 172.21.15.137:0/2616501445 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc12c068380 0x7fc12c06a840 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc140007950 tx=0x7fc140009040 comp rx=0 tx=0).stop 2024-04-26T23:43:45.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.770+0000 7fc152400640 1 -- 172.21.15.137:0/2616501445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc14c15d050 msgr2=0x7fc14c0b3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:45.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.770+0000 7fc152400640 1 --2- 172.21.15.137:0/2616501445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc14c15d050 0x7fc14c0b3cc0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc14401d0a0 tx=0x7fc1440195a0 comp rx=0 tx=0).stop 2024-04-26T23:43:45.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.770+0000 7fc152400640 1 -- 172.21.15.137:0/2616501445 shutdown_connections 2024-04-26T23:43:45.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.770+0000 7fc152400640 1 --2- 172.21.15.137:0/2616501445 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc12c068380 0x7fc12c06a840 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:45.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.770+0000 7fc152400640 1 --2- 172.21.15.137:0/2616501445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc14c15d050 0x7fc14c0b3cc0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:45.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.770+0000 7fc152400640 1 --2- 172.21.15.137:0/2616501445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc14c0d2990 0x7fc14c154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:45.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.770+0000 7fc152400640 1 --2- 172.21.15.137:0/2616501445 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc14c070520 0x7fc14c0b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:45.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.770+0000 7fc152400640 1 -- 172.21.15.137:0/2616501445 >> 172.21.15.137:0/2616501445 conn(0x7fc14c09ba60 msgr2=0x7fc14c06cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:45.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.770+0000 7fc152400640 1 -- 172.21.15.137:0/2616501445 shutdown_connections 2024-04-26T23:43:45.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:45.770+0000 7fc152400640 1 -- 172.21.15.137:0/2616501445 wait complete. 2024-04-26T23:43:45.799 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-26T23:43:48.671 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:43:48.675 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:43:55.800 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-04-26T23:43:55.970 INFO:teuthology.orchestra.run.smithi137.stdout:[{"id":35297,"entity":{"name":{"type":"client","num":35297},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":595466655}},"state":"open","num_leases":1,"num_caps":4,"request_load_avg":5,"uptime":23.167683658000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":8.7031661930013815,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":9,"last_trim_completed_flushes_tid":2,"delegated_inos":[],"inst":"client.35297 192.168.0.1:0/595466655","completed_requests":[],"prealloc_inos":[{"start":"0x100000005e1","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"bc612ffb9c1d5bc27536bc917a705262a36d4387","ceph_version":"ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)","entity_id":"1","hostname":"smithi170","mount_point":"/home/ubuntu/cephtest/mnt.1","pid":"32605","root":"/"}}] 2024-04-26T23:43:55.970 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "1", "hostname": "smithi170", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "32605", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 595466655, "type": "any" }, "name": { "num": 35297, "type": "client" } }, "id": 35297, "inst": "client.35297 192.168.0.1:0/595466655", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 9, "num_caps": 4, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x100000005e1" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 5, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 8.703166193001382 }, "state": "open", "uptime": 23.167683658 } ] 2024-04-26T23:43:55.971 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-04-26T23:43:56.129 INFO:teuthology.orchestra.run.smithi137.stdout:[{"id":35297,"entity":{"name":{"type":"client","num":35297},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":595466655}},"state":"open","num_leases":1,"num_caps":2,"request_load_avg":2,"uptime":12.499839457,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":4.8694663722856895,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":9,"last_trim_completed_flushes_tid":3,"delegated_inos":[],"inst":"client.35297 192.168.0.1:0/595466655","completed_requests":[{"tid":10,"created_ino":"0x200000003e9"}],"prealloc_inos":[{"start":"0x200000003ea","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"bc612ffb9c1d5bc27536bc917a705262a36d4387","ceph_version":"ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)","entity_id":"1","hostname":"smithi170","mount_point":"/home/ubuntu/cephtest/mnt.1","pid":"32605","root":"/"}}] 2024-04-26T23:43:56.129 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "1", "hostname": "smithi170", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "32605", "root": "/" }, "completed_requests": [ { "created_ino": "0x200000003e9", "tid": 10 } ], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 595466655, "type": "any" }, "name": { "num": 35297, "type": "client" } }, "id": 35297, "inst": "client.35297 192.168.0.1:0/595466655", "last_trim_completed_flushes_tid": 3, "last_trim_completed_requests_tid": 9, "num_caps": 2, "num_completed_flushes": 1, "num_completed_requests": 1, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x200000003ea" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 4.8694663722856895 }, "state": "open", "uptime": 12.499839457 } ] 2024-04-26T23:43:56.129 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T23:43:56.129 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:43:56.130 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:43:56.139 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:43:56.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.314+0000 7f0e0de00640 1 Processor -- start 2024-04-26T23:43:56.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.314+0000 7f0e0de00640 1 -- start start 2024-04-26T23:43:56.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.314+0000 7f0e0de00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e0815f070 0x7f0e0806c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:56.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.314+0000 7f0e0de00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0e08075a90 0x7f0e080b5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:56.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.314+0000 7f0e0de00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e080b6a80 con 0x7f0e080b4cc0 2024-04-26T23:43:56.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.314+0000 7f0e0de00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0e0806f1b0 con 0x7f0e08075a90 2024-04-26T23:43:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.314+0000 7f0e0de00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0e080b6d60 con 0x7f0e0815f070 2024-04-26T23:43:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.314+0000 7f0e07400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0e08075a90 0x7f0e080b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.314+0000 7f0dfe000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f0e080b4cc0 0x7f0e08075380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:33764/0 (socket says 172.21.15.137:33764) 2024-04-26T23:43:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.314+0000 7f0dfe000640 1 -- 172.21.15.137:0/1721716360 learned_addr learned my addr 172.21.15.137:0/1721716360 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.314+0000 7f0e06a00640 1 --2- 172.21.15.137:0/1721716360 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e0815f070 0x7f0e0806c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.314+0000 7f0e07400640 1 -- 172.21.15.137:0/1721716360 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e0815f070 msgr2=0x7f0e0806c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.314+0000 7f0e07400640 1 --2- 172.21.15.137:0/1721716360 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e0815f070 0x7f0e0806c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.314+0000 7f0e07400640 1 -- 172.21.15.137:0/1721716360 >> v1:172.21.15.137:6789/0 conn(0x7f0e080b4cc0 legacy=0x7f0e08075380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.314+0000 7f0e07400640 1 -- 172.21.15.137:0/1721716360 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e080b7040 con 0x7f0e08075a90 2024-04-26T23:43:56.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.318+0000 7f0e07400640 1 --2- 172.21.15.137:0/1721716360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e08075a90 0x7f0e080b5100 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0e000097c0 tx=0x7f0e0001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf54762b871ce3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:56.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.318+0000 7f0e06000640 1 -- 172.21.15.137:0/1721716360 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e000b0070 con 0x7f0e08075a90 2024-04-26T23:43:56.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.318+0000 7f0e06000640 1 -- 172.21.15.137:0/1721716360 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e000ab600 con 0x7f0e08075a90 2024-04-26T23:43:56.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.318+0000 7f0e06000640 1 -- 172.21.15.137:0/1721716360 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e000ab9d0 con 0x7f0e08075a90 2024-04-26T23:43:56.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.318+0000 7f0e0de00640 1 -- 172.21.15.137:0/1721716360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e08075a90 msgr2=0x7f0e080b5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:56.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.318+0000 7f0e0de00640 1 --2- 172.21.15.137:0/1721716360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e08075a90 0x7f0e080b5100 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0e000097c0 tx=0x7f0e0001c3e0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.318+0000 7f0e0de00640 1 -- 172.21.15.137:0/1721716360 shutdown_connections 2024-04-26T23:43:56.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.318+0000 7f0e0de00640 1 --2- 172.21.15.137:0/1721716360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e08075a90 0x7f0e080b5100 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.318+0000 7f0e0de00640 1 --2- 172.21.15.137:0/1721716360 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e0815f070 0x7f0e0806c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.318+0000 7f0e0de00640 1 -- 172.21.15.137:0/1721716360 >> 172.21.15.137:0/1721716360 conn(0x7f0e080b43e0 msgr2=0x7f0e080d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:56.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.318+0000 7f0e0de00640 1 -- 172.21.15.137:0/1721716360 shutdown_connections 2024-04-26T23:43:56.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.318+0000 7f0e0de00640 1 -- 172.21.15.137:0/1721716360 wait complete. 2024-04-26T23:43:56.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0e0de00640 1 Processor -- start 2024-04-26T23:43:56.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0e0de00640 1 -- start start 2024-04-26T23:43:56.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0e0de00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e08075a90 0x7f0e0815a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:56.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0e0de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e080b4cc0 0x7f0e0814c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:56.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0e0de00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e0815f070 0x7f0e08161ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:56.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0e0de00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0e08070c40 con 0x7f0e0815f070 2024-04-26T23:43:56.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0e0de00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0e08070dc0 con 0x7f0e080b4cc0 2024-04-26T23:43:56.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0e0de00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0e0816bdb0 con 0x7f0e08075a90 2024-04-26T23:43:56.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0e07400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e0815f070 0x7f0e08161ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:56.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0e07400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e0815f070 0x7f0e08161ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:56398/0 (socket says 172.21.15.137:56398) 2024-04-26T23:43:56.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0e07400640 1 -- 172.21.15.137:0/3419180488 learned_addr learned my addr 172.21.15.137:0/3419180488 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:56.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0e06a00640 1 --2- 172.21.15.137:0/3419180488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e08075a90 0x7f0e0815a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:56.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0dfe000640 1 --2- 172.21.15.137:0/3419180488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e080b4cc0 0x7f0e0814c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:56.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0e07400640 1 -- 172.21.15.137:0/3419180488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e08075a90 msgr2=0x7f0e0815a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:56.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0e07400640 1 --2- 172.21.15.137:0/3419180488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e08075a90 0x7f0e0815a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0e07400640 1 -- 172.21.15.137:0/3419180488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e080b4cc0 msgr2=0x7f0e0814c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:56.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0e07400640 1 --2- 172.21.15.137:0/3419180488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e080b4cc0 0x7f0e0814c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0e07400640 1 -- 172.21.15.137:0/3419180488 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e0815ff30 con 0x7f0e0815f070 2024-04-26T23:43:56.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0dfe000640 1 --2- 172.21.15.137:0/3419180488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e080b4cc0 0x7f0e0814c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:56.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0e07400640 1 --2- 172.21.15.137:0/3419180488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e0815f070 0x7f0e08161ea0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0e0001a010 tx=0x7f0e0001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:56.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0dffe00640 1 -- 172.21.15.137:0/3419180488 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e000b9070 con 0x7f0e0815f070 2024-04-26T23:43:56.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0dffe00640 1 -- 172.21.15.137:0/3419180488 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e000b4420 con 0x7f0e0815f070 2024-04-26T23:43:56.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0e0de00640 1 -- 172.21.15.137:0/3419180488 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e0815fc50 con 0x7f0e0815f070 2024-04-26T23:43:56.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0dffe00640 1 -- 172.21.15.137:0/3419180488 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e000b0040 con 0x7f0e0815f070 2024-04-26T23:43:56.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0e0de00640 1 -- 172.21.15.137:0/3419180488 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e081599c0 con 0x7f0e0815f070 2024-04-26T23:43:56.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.322+0000 7f0e0de00640 1 -- 172.21.15.137:0/3419180488 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e0806cb50 con 0x7f0e0815f070 2024-04-26T23:43:56.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.326+0000 7f0dffe00640 1 -- 172.21.15.137:0/3419180488 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0e000bc070 con 0x7f0e0815f070 2024-04-26T23:43:56.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.326+0000 7f0dffe00640 1 --2- 172.21.15.137:0/3419180488 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0de4068380 0x7f0de406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:56.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.326+0000 7f0dffe00640 1 -- 172.21.15.137:0/3419180488 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5752+0+0 (secure 0 0 0) 0x7f0e0011fb10 con 0x7f0e0815f070 2024-04-26T23:43:56.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.326+0000 7f0e06a00640 1 --2- 172.21.15.137:0/3419180488 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0de4068380 0x7f0de406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:56.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.326+0000 7f0e06a00640 1 --2- 172.21.15.137:0/3419180488 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0de4068380 0x7f0de406a840 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0df8003b90 tx=0x7f0df80098d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:56.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.330+0000 7f0dffe00640 1 -- 172.21.15.137:0/3419180488 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0e0806cb50 con 0x7f0e0815f070 2024-04-26T23:43:56.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.486+0000 7f0e0de00640 1 -- 172.21.15.137:0/3419180488 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e0806a4b0 con 0x7f0e0815f070 2024-04-26T23:43:56.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.490+0000 7f0dffe00640 1 -- 172.21.15.137:0/3419180488 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16720 (secure 0 0 0) 0x7f0e0815ff30 con 0x7f0e0815f070 2024-04-26T23:43:56.497 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:43:56.497 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":46,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:43:45.365477+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:43:21.281556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T23:43:22.549121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/268105340":"2024-04-27T00:43:44.368539+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:43:56.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.490+0000 7f0e0de00640 1 -- 172.21.15.137:0/3419180488 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0de4068380 msgr2=0x7f0de406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:56.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.490+0000 7f0e0de00640 1 --2- 172.21.15.137:0/3419180488 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0de4068380 0x7f0de406a840 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0df8003b90 tx=0x7f0df80098d0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.490+0000 7f0e0de00640 1 -- 172.21.15.137:0/3419180488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e0815f070 msgr2=0x7f0e08161ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:56.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.490+0000 7f0e0de00640 1 --2- 172.21.15.137:0/3419180488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e0815f070 0x7f0e08161ea0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0e0001a010 tx=0x7f0e0001ac20 comp rx=0 tx=0).stop 2024-04-26T23:43:56.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.490+0000 7f0e0de00640 1 -- 172.21.15.137:0/3419180488 shutdown_connections 2024-04-26T23:43:56.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.490+0000 7f0e0de00640 1 --2- 172.21.15.137:0/3419180488 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0de4068380 0x7f0de406a840 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.490+0000 7f0e0de00640 1 --2- 172.21.15.137:0/3419180488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e0815f070 0x7f0e08161ea0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.490+0000 7f0e0de00640 1 --2- 172.21.15.137:0/3419180488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e080b4cc0 0x7f0e0814c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.490+0000 7f0e0de00640 1 --2- 172.21.15.137:0/3419180488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e08075a90 0x7f0e0815a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.490+0000 7f0e0de00640 1 -- 172.21.15.137:0/3419180488 >> 172.21.15.137:0/3419180488 conn(0x7f0e080b43e0 msgr2=0x7f0e08070510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:56.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.490+0000 7f0e0de00640 1 -- 172.21.15.137:0/3419180488 shutdown_connections 2024-04-26T23:43:56.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.490+0000 7f0e0de00640 1 -- 172.21.15.137:0/3419180488 wait complete. 2024-04-26T23:43:56.519 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:43:21.281556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:43:22.549121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:43:56.520 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:43:56.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.650+0000 7f8b97a00640 1 Processor -- start 2024-04-26T23:43:56.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.650+0000 7f8b97a00640 1 -- start start 2024-04-26T23:43:56.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.654+0000 7f8b97a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8b90073f20 0x7f8b9015df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:56.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.654+0000 7f8b97a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8b900affa0 0x7f8b900ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:56.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.654+0000 7f8b97a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b90072860 con 0x7f8b900afbc0 2024-04-26T23:43:56.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.654+0000 7f8b97a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8b900743b0 con 0x7f8b90073f20 2024-04-26T23:43:56.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.654+0000 7f8b97a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f8b90072b00 con 0x7f8b900affa0 2024-04-26T23:43:56.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.654+0000 7f8b95000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f8b900afbc0 0x7f8b900735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:33772/0 (socket says 172.21.15.137:33772) 2024-04-26T23:43:56.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.654+0000 7f8b95000640 1 -- 172.21.15.137:0/1803235763 learned_addr learned my addr 172.21.15.137:0/1803235763 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:56.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.654+0000 7f8b87e00640 1 --2- 172.21.15.137:0/1803235763 >> v2:172.21.15.137:3300/0 conn(0x7f8b90073f20 0x7f8b9015df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:56.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.654+0000 7f8b95a00640 1 --2- 172.21.15.137:0/1803235763 >> v2:172.21.15.170:3300/0 conn(0x7f8b900affa0 0x7f8b900ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:56.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.654+0000 7f8b8fe00640 1 -- 172.21.15.137:0/1803235763 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3091164463 0 0) 0x7f8b90072860 con 0x7f8b900afbc0 2024-04-26T23:43:56.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.654+0000 7f8b8fe00640 1 -- 172.21.15.137:0/1803235763 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b74003530 con 0x7f8b900afbc0 2024-04-26T23:43:56.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.654+0000 7f8b87e00640 1 -- 172.21.15.137:0/1803235763 >> v2:172.21.15.170:3300/0 conn(0x7f8b900affa0 msgr2=0x7f8b900ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:56.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.654+0000 7f8b87e00640 1 --2- 172.21.15.137:0/1803235763 >> v2:172.21.15.170:3300/0 conn(0x7f8b900affa0 0x7f8b900ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.654+0000 7f8b87e00640 1 -- 172.21.15.137:0/1803235763 >> v1:172.21.15.137:6789/0 conn(0x7f8b900afbc0 legacy=0x7f8b900735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:56.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.654+0000 7f8b87e00640 1 -- 172.21.15.137:0/1803235763 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b90072de0 con 0x7f8b90073f20 2024-04-26T23:43:56.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.658+0000 7f8b87e00640 1 --2- 172.21.15.137:0/1803235763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b90073f20 0x7f8b9015df90 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8b780097c0 tx=0x7f8b7801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1d63730a65fa1a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:56.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.658+0000 7f8b8fe00640 1 -- 172.21.15.137:0/1803235763 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b780b0070 con 0x7f8b90073f20 2024-04-26T23:43:56.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.658+0000 7f8b8fe00640 1 -- 172.21.15.137:0/1803235763 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b780ab600 con 0x7f8b90073f20 2024-04-26T23:43:56.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.658+0000 7f8b8fe00640 1 -- 172.21.15.137:0/1803235763 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b780ab9b0 con 0x7f8b90073f20 2024-04-26T23:43:56.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.658+0000 7f8b97a00640 1 -- 172.21.15.137:0/1803235763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b90073f20 msgr2=0x7f8b9015df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:56.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.658+0000 7f8b97a00640 1 --2- 172.21.15.137:0/1803235763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b90073f20 0x7f8b9015df90 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8b780097c0 tx=0x7f8b7801c460 comp rx=0 tx=0).stop 2024-04-26T23:43:56.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.658+0000 7f8b97a00640 1 -- 172.21.15.137:0/1803235763 shutdown_connections 2024-04-26T23:43:56.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.658+0000 7f8b97a00640 1 --2- 172.21.15.137:0/1803235763 >> v2:172.21.15.170:3300/0 conn(0x7f8b900affa0 0x7f8b900ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.658+0000 7f8b97a00640 1 --2- 172.21.15.137:0/1803235763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b90073f20 0x7f8b9015df90 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.658+0000 7f8b97a00640 1 -- 172.21.15.137:0/1803235763 >> 172.21.15.137:0/1803235763 conn(0x7f8b9006c800 msgr2=0x7f8b9006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:56.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.658+0000 7f8b97a00640 1 -- 172.21.15.137:0/1803235763 shutdown_connections 2024-04-26T23:43:56.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.658+0000 7f8b97a00640 1 -- 172.21.15.137:0/1803235763 wait complete. 2024-04-26T23:43:56.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.658+0000 7f8b97a00640 1 Processor -- start 2024-04-26T23:43:56.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.658+0000 7f8b97a00640 1 -- start start 2024-04-26T23:43:56.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.658+0000 7f8b97a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8b900afbc0 0x7f8b9013b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:56.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.658+0000 7f8b97a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b900affa0 0x7f8b901562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:56.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.658+0000 7f8b97a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b90156820 0x7f8b900b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:56.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.658+0000 7f8b97a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9006f360 con 0x7f8b90156820 2024-04-26T23:43:56.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.658+0000 7f8b97a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9006f1e0 con 0x7f8b900affa0 2024-04-26T23:43:56.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.658+0000 7f8b97a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9006f4e0 con 0x7f8b900afbc0 2024-04-26T23:43:56.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.662+0000 7f8b95a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b90156820 0x7f8b900b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:56.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.662+0000 7f8b95000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8b900afbc0 0x7f8b9013b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:56.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.662+0000 7f8b87e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b900affa0 0x7f8b901562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:56.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.662+0000 7f8b95a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b90156820 0x7f8b900b1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:56410/0 (socket says 172.21.15.137:56410) 2024-04-26T23:43:56.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.662+0000 7f8b95000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8b900afbc0 0x7f8b9013b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:43260/0 (socket says 172.21.15.137:43260) 2024-04-26T23:43:56.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.662+0000 7f8b95a00640 1 -- 172.21.15.137:0/2398196075 learned_addr learned my addr 172.21.15.137:0/2398196075 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:56.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.662+0000 7f8b95a00640 1 -- 172.21.15.137:0/2398196075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8b900afbc0 msgr2=0x7f8b9013b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:56.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.662+0000 7f8b95a00640 1 --2- 172.21.15.137:0/2398196075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8b900afbc0 0x7f8b9013b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.662+0000 7f8b95a00640 1 -- 172.21.15.137:0/2398196075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b900affa0 msgr2=0x7f8b901562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:56.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.662+0000 7f8b95a00640 1 --2- 172.21.15.137:0/2398196075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b900affa0 0x7f8b901562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.662+0000 7f8b95a00640 1 -- 172.21.15.137:0/2398196075 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b90156e10 con 0x7f8b90156820 2024-04-26T23:43:56.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.662+0000 7f8b87e00640 1 --2- 172.21.15.137:0/2398196075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b900affa0 0x7f8b901562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:43:56.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.662+0000 7f8b95a00640 1 --2- 172.21.15.137:0/2398196075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b90156820 0x7f8b900b1600 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8b88007db0 tx=0x7f8b8800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:56.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.662+0000 7f8b8d600640 1 -- 172.21.15.137:0/2398196075 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b88014420 con 0x7f8b90156820 2024-04-26T23:43:56.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.662+0000 7f8b8d600640 1 -- 172.21.15.137:0/2398196075 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b88019070 con 0x7f8b90156820 2024-04-26T23:43:56.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.662+0000 7f8b97a00640 1 -- 172.21.15.137:0/2398196075 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b9014d490 con 0x7f8b90156820 2024-04-26T23:43:56.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.662+0000 7f8b8d600640 1 -- 172.21.15.137:0/2398196075 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b88014800 con 0x7f8b90156820 2024-04-26T23:43:56.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.662+0000 7f8b97a00640 1 -- 172.21.15.137:0/2398196075 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b9014da50 con 0x7f8b90156820 2024-04-26T23:43:56.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.662+0000 7f8b97a00640 1 -- 172.21.15.137:0/2398196075 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b9006a410 con 0x7f8b90156820 2024-04-26T23:43:56.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.662+0000 7f8b8d600640 1 -- 172.21.15.137:0/2398196075 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8b880149a0 con 0x7f8b90156820 2024-04-26T23:43:56.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.666+0000 7f8b8d600640 1 --2- 172.21.15.137:0/2398196075 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8b6c0683b0 0x7f8b6c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:56.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.666+0000 7f8b8d600640 1 -- 172.21.15.137:0/2398196075 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5752+0+0 (secure 0 0 0) 0x7f8b88086fe0 con 0x7f8b90156820 2024-04-26T23:43:56.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.666+0000 7f8b95000640 1 --2- 172.21.15.137:0/2398196075 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8b6c0683b0 0x7f8b6c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:56.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.666+0000 7f8b95000640 1 --2- 172.21.15.137:0/2398196075 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8b6c0683b0 0x7f8b6c06a870 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8b80007fd0 tx=0x7f8b80009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:56.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.670+0000 7f8b8d600640 1 -- 172.21.15.137:0/2398196075 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8b88056f50 con 0x7f8b90156820 2024-04-26T23:43:56.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.826+0000 7f8b97a00640 1 -- 172.21.15.137:0/2398196075 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8b90160870 con 0x7f8b90156820 2024-04-26T23:43:56.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.826+0000 7f8b8d600640 1 -- 172.21.15.137:0/2398196075 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) ==== 93+0+10 (secure 0 0 0) 0x7f8b8805b250 con 0x7f8b90156820 2024-04-26T23:43:56.835 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:43:56.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.830+0000 7f8b97a00640 1 -- 172.21.15.137:0/2398196075 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8b6c0683b0 msgr2=0x7f8b6c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:56.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.830+0000 7f8b97a00640 1 --2- 172.21.15.137:0/2398196075 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8b6c0683b0 0x7f8b6c06a870 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8b80007fd0 tx=0x7f8b80009040 comp rx=0 tx=0).stop 2024-04-26T23:43:56.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.830+0000 7f8b97a00640 1 -- 172.21.15.137:0/2398196075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b90156820 msgr2=0x7f8b900b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:56.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.830+0000 7f8b97a00640 1 --2- 172.21.15.137:0/2398196075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b90156820 0x7f8b900b1600 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8b88007db0 tx=0x7f8b8800e4b0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.830+0000 7f8b97a00640 1 -- 172.21.15.137:0/2398196075 shutdown_connections 2024-04-26T23:43:56.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.830+0000 7f8b97a00640 1 --2- 172.21.15.137:0/2398196075 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8b6c0683b0 0x7f8b6c06a870 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.830+0000 7f8b97a00640 1 --2- 172.21.15.137:0/2398196075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b90156820 0x7f8b900b1600 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.830+0000 7f8b97a00640 1 --2- 172.21.15.137:0/2398196075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b900affa0 0x7f8b901562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.830+0000 7f8b97a00640 1 --2- 172.21.15.137:0/2398196075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8b900afbc0 0x7f8b9013b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.830+0000 7f8b97a00640 1 -- 172.21.15.137:0/2398196075 >> 172.21.15.137:0/2398196075 conn(0x7f8b9006c800 msgr2=0x7f8b90152910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:56.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.830+0000 7f8b97a00640 1 -- 172.21.15.137:0/2398196075 shutdown_connections 2024-04-26T23:43:56.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.830+0000 7f8b97a00640 1 -- 172.21.15.137:0/2398196075 wait complete. 2024-04-26T23:43:56.857 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:43:56.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.986+0000 7fad07200640 1 Processor -- start 2024-04-26T23:43:56.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.986+0000 7fad07200640 1 -- start start 2024-04-26T23:43:56.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.990+0000 7fad07200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad000afbc0 0x7fad0015df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:56.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.990+0000 7fad07200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fad00073f20 0x7fad000735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:56.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.990+0000 7fad07200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fad000affa0 0x7fad000ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:56.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.990+0000 7fad07200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fad00073b20 con 0x7fad000affa0 2024-04-26T23:43:56.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.990+0000 7fad07200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fad00072860 con 0x7fad00073f20 2024-04-26T23:43:56.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.990+0000 7fad07200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fad000743b0 con 0x7fad000afbc0 2024-04-26T23:43:56.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.990+0000 7fad05200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fad000affa0 0x7fad000ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:56.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.990+0000 7fad05200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fad000affa0 0x7fad000ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:56420/0 (socket says 172.21.15.137:56420) 2024-04-26T23:43:56.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.990+0000 7fad05200640 1 -- 172.21.15.137:0/3638641744 learned_addr learned my addr 172.21.15.137:0/3638641744 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:56.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.990+0000 7facf7400640 1 --2- 172.21.15.137:0/3638641744 >> v2:172.21.15.170:3300/0 conn(0x7fad00073f20 0x7fad000735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:56.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.990+0000 7fad05200640 1 -- 172.21.15.137:0/3638641744 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad000afbc0 msgr2=0x7fad0015df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:56.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.990+0000 7facffe00640 1 --2- 172.21.15.137:0/3638641744 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad000afbc0 0x7fad0015df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:56.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.990+0000 7fad05200640 1 --2- 172.21.15.137:0/3638641744 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad000afbc0 0x7fad0015df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.990+0000 7fad05200640 1 -- 172.21.15.137:0/3638641744 >> v2:172.21.15.170:3300/0 conn(0x7fad00073f20 msgr2=0x7fad000735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:56.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.990+0000 7fad05200640 1 --2- 172.21.15.137:0/3638641744 >> v2:172.21.15.170:3300/0 conn(0x7fad00073f20 0x7fad000735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.990+0000 7fad05200640 1 -- 172.21.15.137:0/3638641744 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad00072b00 con 0x7fad000affa0 2024-04-26T23:43:56.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.990+0000 7facf7400640 1 --2- 172.21.15.137:0/3638641744 >> v2:172.21.15.170:3300/0 conn(0x7fad00073f20 0x7fad000735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:43:56.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.990+0000 7facffe00640 1 --2- 172.21.15.137:0/3638641744 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad000afbc0 0x7fad0015df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:43:57.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.994+0000 7fad05200640 1 --2- 172.21.15.137:0/3638641744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad000affa0 0x7fad000ce3b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fad0006de70 tx=0x7facf801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98abc94409a8a38 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:57.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.994+0000 7facff400640 1 -- 172.21.15.137:0/3638641744 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf80b0070 con 0x7fad000affa0 2024-04-26T23:43:57.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.994+0000 7facff400640 1 -- 172.21.15.137:0/3638641744 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facf80ab600 con 0x7fad000affa0 2024-04-26T23:43:57.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.994+0000 7facff400640 1 -- 172.21.15.137:0/3638641744 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf80ab9d0 con 0x7fad000affa0 2024-04-26T23:43:57.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.994+0000 7fad07200640 1 -- 172.21.15.137:0/3638641744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad000affa0 msgr2=0x7fad000ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:57.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.994+0000 7fad07200640 1 --2- 172.21.15.137:0/3638641744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad000affa0 0x7fad000ce3b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fad0006de70 tx=0x7facf801c520 comp rx=0 tx=0).stop 2024-04-26T23:43:57.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.994+0000 7fad07200640 1 -- 172.21.15.137:0/3638641744 shutdown_connections 2024-04-26T23:43:57.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.994+0000 7fad07200640 1 --2- 172.21.15.137:0/3638641744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad000affa0 0x7fad000ce3b0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.994+0000 7fad07200640 1 --2- 172.21.15.137:0/3638641744 >> v2:172.21.15.170:3300/0 conn(0x7fad00073f20 0x7fad000735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.994+0000 7fad07200640 1 --2- 172.21.15.137:0/3638641744 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad000afbc0 0x7fad0015df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.994+0000 7fad07200640 1 -- 172.21.15.137:0/3638641744 >> 172.21.15.137:0/3638641744 conn(0x7fad0006c800 msgr2=0x7fad0006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:57.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.994+0000 7fad07200640 1 -- 172.21.15.137:0/3638641744 shutdown_connections 2024-04-26T23:43:57.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.994+0000 7fad07200640 1 -- 172.21.15.137:0/3638641744 wait complete. 2024-04-26T23:43:57.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.994+0000 7fad07200640 1 Processor -- start 2024-04-26T23:43:57.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.994+0000 7fad07200640 1 -- start start 2024-04-26T23:43:57.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7fad07200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad000afbc0 0x7fad001f7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:57.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7fad07200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad000affa0 0x7fad000b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:57.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7fad07200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad000b2be0 0x7fad000b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:57.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7fad07200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fad00161490 con 0x7fad000affa0 2024-04-26T23:43:57.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7fad07200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fad00161310 con 0x7fad000afbc0 2024-04-26T23:43:57.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7fad07200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fad00161610 con 0x7fad000b2be0 2024-04-26T23:43:57.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7facf7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad000affa0 0x7fad000b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:57.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7facf7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad000affa0 0x7fad000b0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:56422/0 (socket says 172.21.15.137:56422) 2024-04-26T23:43:57.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7facffe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad000afbc0 0x7fad001f7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:57.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7facf7400640 1 -- 172.21.15.137:0/2759893909 learned_addr learned my addr 172.21.15.137:0/2759893909 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:57.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7fad05200640 1 --2- 172.21.15.137:0/2759893909 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad000b2be0 0x7fad000b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:57.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7facf7400640 1 -- 172.21.15.137:0/2759893909 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad000b2be0 msgr2=0x7fad000b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:57.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7facf7400640 1 --2- 172.21.15.137:0/2759893909 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad000b2be0 0x7fad000b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7facf7400640 1 -- 172.21.15.137:0/2759893909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad000afbc0 msgr2=0x7fad001f7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:57.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7facf7400640 1 --2- 172.21.15.137:0/2759893909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad000afbc0 0x7fad001f7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7facf7400640 1 -- 172.21.15.137:0/2759893909 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0014b980 con 0x7fad000affa0 2024-04-26T23:43:57.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7facf7400640 1 --2- 172.21.15.137:0/2759893909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad000affa0 0x7fad000b0df0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7face800c7c0 tx=0x7face800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:57.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7facfcc00640 1 -- 172.21.15.137:0/2759893909 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8015070 con 0x7fad000affa0 2024-04-26T23:43:57.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7facfcc00640 1 -- 172.21.15.137:0/2759893909 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face8007a30 con 0x7fad000affa0 2024-04-26T23:43:57.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7facfcc00640 1 -- 172.21.15.137:0/2759893909 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8007e00 con 0x7fad000affa0 2024-04-26T23:43:57.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7fad07200640 1 -- 172.21.15.137:0/2759893909 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad0014f7d0 con 0x7fad000affa0 2024-04-26T23:43:57.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7fad07200640 1 -- 172.21.15.137:0/2759893909 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad00150030 con 0x7fad000affa0 2024-04-26T23:43:57.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7fad07200640 1 -- 172.21.15.137:0/2759893909 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad0006a410 con 0x7fad000affa0 2024-04-26T23:43:57.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:56.998+0000 7facfcc00640 1 -- 172.21.15.137:0/2759893909 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7face8018070 con 0x7fad000affa0 2024-04-26T23:43:57.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.002+0000 7facfcc00640 1 --2- 172.21.15.137:0/2759893909 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7facdc0683b0 0x7facdc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:57.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.002+0000 7facfcc00640 1 -- 172.21.15.137:0/2759893909 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5752+0+0 (secure 0 0 0) 0x7face8086910 con 0x7fad000affa0 2024-04-26T23:43:57.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.002+0000 7facffe00640 1 --2- 172.21.15.137:0/2759893909 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7facdc0683b0 0x7facdc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:57.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.002+0000 7facffe00640 1 --2- 172.21.15.137:0/2759893909 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7facdc0683b0 0x7facdc06a870 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7facf000d620 tx=0x7facf0007810 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:57.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.006+0000 7facfcc00640 1 -- 172.21.15.137:0/2759893909 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7face8056720 con 0x7fad000affa0 2024-04-26T23:43:57.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.162+0000 7fad07200640 1 -- 172.21.15.137:0/2759893909 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fad00160870 con 0x7fad000affa0 2024-04-26T23:43:57.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.162+0000 7facfcc00640 1 -- 172.21.15.137:0/2759893909 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) ==== 104+0+11 (secure 0 0 0) 0x7face805aa20 con 0x7fad000affa0 2024-04-26T23:43:57.170 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:43:57.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.162+0000 7fad07200640 1 -- 172.21.15.137:0/2759893909 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7facdc0683b0 msgr2=0x7facdc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:57.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.162+0000 7fad07200640 1 --2- 172.21.15.137:0/2759893909 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7facdc0683b0 0x7facdc06a870 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7facf000d620 tx=0x7facf0007810 comp rx=0 tx=0).stop 2024-04-26T23:43:57.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.162+0000 7fad07200640 1 -- 172.21.15.137:0/2759893909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad000affa0 msgr2=0x7fad000b0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:57.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.162+0000 7fad07200640 1 --2- 172.21.15.137:0/2759893909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad000affa0 0x7fad000b0df0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7face800c7c0 tx=0x7face800cc80 comp rx=0 tx=0).stop 2024-04-26T23:43:57.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.162+0000 7fad07200640 1 -- 172.21.15.137:0/2759893909 shutdown_connections 2024-04-26T23:43:57.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.162+0000 7fad07200640 1 --2- 172.21.15.137:0/2759893909 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7facdc0683b0 0x7facdc06a870 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.162+0000 7fad07200640 1 --2- 172.21.15.137:0/2759893909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad000affa0 0x7fad000b0df0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.162+0000 7fad07200640 1 --2- 172.21.15.137:0/2759893909 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad000b2be0 0x7fad000b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.162+0000 7fad07200640 1 --2- 172.21.15.137:0/2759893909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad000afbc0 0x7fad001f7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.162+0000 7fad07200640 1 -- 172.21.15.137:0/2759893909 >> 172.21.15.137:0/2759893909 conn(0x7fad0006c800 msgr2=0x7fad0006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:57.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.166+0000 7fad07200640 1 -- 172.21.15.137:0/2759893909 shutdown_connections 2024-04-26T23:43:57.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.166+0000 7fad07200640 1 -- 172.21.15.137:0/2759893909 wait complete. 2024-04-26T23:43:57.191 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:43:57.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.322+0000 7f58ec600640 1 Processor -- start 2024-04-26T23:43:57.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.322+0000 7f58ec600640 1 -- start start 2024-04-26T23:43:57.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.322+0000 7f58ec600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f58e40b54e0 0x7f58e40b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:57.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.322+0000 7f58ec600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58e40cd710 0x7f58e415f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:57.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.322+0000 7f58ec600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e40cffa0 con 0x7f58e415fe30 2024-04-26T23:43:57.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.322+0000 7f58ec600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f58e40b3d90 con 0x7f58e40b54e0 2024-04-26T23:43:57.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.322+0000 7f58ec600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f58e40d0840 con 0x7f58e40cd710 2024-04-26T23:43:57.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.322+0000 7f58e9c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f58e40b54e0 0x7f58e40b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:57.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.322+0000 7f58e9c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f58e40b54e0 0x7f58e40b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:56424/0 (socket says 172.21.15.137:56424) 2024-04-26T23:43:57.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.322+0000 7f58e9c00640 1 -- 172.21.15.137:0/2308029936 learned_addr learned my addr 172.21.15.137:0/2308029936 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:57.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.322+0000 7f58e9c00640 1 -- 172.21.15.137:0/2308029936 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58e40cd710 msgr2=0x7f58e415f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:57.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.322+0000 7f58e9c00640 1 --2- 172.21.15.137:0/2308029936 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58e40cd710 0x7f58e415f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.322+0000 7f58e9c00640 1 -- 172.21.15.137:0/2308029936 >> v1:172.21.15.170:6789/0 conn(0x7f58e415fe30 legacy=0x7f58e4144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:57.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.322+0000 7f58e9c00640 1 -- 172.21.15.137:0/2308029936 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e40d0280 con 0x7f58e40b54e0 2024-04-26T23:43:57.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.326+0000 7f58e9c00640 1 --2- 172.21.15.137:0/2308029936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58e40b54e0 0x7f58e40b5ee0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f58d8009870 tx=0x7f58d801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd899ce2b529a84 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:57.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.326+0000 7f58e3e00640 1 -- 172.21.15.137:0/2308029936 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d80ab5f0 con 0x7f58e40b54e0 2024-04-26T23:43:57.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.326+0000 7f58e3e00640 1 -- 172.21.15.137:0/2308029936 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58d80b0070 con 0x7f58e40b54e0 2024-04-26T23:43:57.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.326+0000 7f58e3e00640 1 -- 172.21.15.137:0/2308029936 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d80ab9b0 con 0x7f58e40b54e0 2024-04-26T23:43:57.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.326+0000 7f58ec600640 1 -- 172.21.15.137:0/2308029936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58e40b54e0 msgr2=0x7f58e40b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:57.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.326+0000 7f58ec600640 1 --2- 172.21.15.137:0/2308029936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58e40b54e0 0x7f58e40b5ee0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f58d8009870 tx=0x7f58d801c520 comp rx=0 tx=0).stop 2024-04-26T23:43:57.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.326+0000 7f58ec600640 1 -- 172.21.15.137:0/2308029936 shutdown_connections 2024-04-26T23:43:57.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.326+0000 7f58ec600640 1 --2- 172.21.15.137:0/2308029936 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58e40cd710 0x7f58e415f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.326+0000 7f58ec600640 1 --2- 172.21.15.137:0/2308029936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58e40b54e0 0x7f58e40b5ee0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.326+0000 7f58ec600640 1 -- 172.21.15.137:0/2308029936 >> 172.21.15.137:0/2308029936 conn(0x7f58e406c800 msgr2=0x7f58e406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:57.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.326+0000 7f58ec600640 1 -- 172.21.15.137:0/2308029936 shutdown_connections 2024-04-26T23:43:57.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.326+0000 7f58ec600640 1 -- 172.21.15.137:0/2308029936 wait complete. 2024-04-26T23:43:57.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58ec600640 1 Processor -- start 2024-04-26T23:43:57.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58ec600640 1 -- start start 2024-04-26T23:43:57.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58ec600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58e40b54e0 0x7f58e413a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:57.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58ec600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58e40cd710 0x7f58e415ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:57.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58ec600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58e415fe30 0x7f58e415ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:57.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58ec600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f58e4145840 con 0x7f58e415fe30 2024-04-26T23:43:57.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58ec600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f58e40cdb60 con 0x7f58e40cd710 2024-04-26T23:43:57.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58ec600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f58e41459c0 con 0x7f58e40b54e0 2024-04-26T23:43:57.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58ea600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58e415fe30 0x7f58e415ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:57.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58ea600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58e415fe30 0x7f58e415ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:56434/0 (socket says 172.21.15.137:56434) 2024-04-26T23:43:57.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58ea600640 1 -- 172.21.15.137:0/2347161159 learned_addr learned my addr 172.21.15.137:0/2347161159 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:57.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58e9c00640 1 --2- 172.21.15.137:0/2347161159 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58e40b54e0 0x7f58e413a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:57.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58e9200640 1 --2- 172.21.15.137:0/2347161159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58e40cd710 0x7f58e415ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:57.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58ea600640 1 -- 172.21.15.137:0/2347161159 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58e40b54e0 msgr2=0x7f58e413a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:57.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58ea600640 1 --2- 172.21.15.137:0/2347161159 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58e40b54e0 0x7f58e413a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58ea600640 1 -- 172.21.15.137:0/2347161159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58e40cd710 msgr2=0x7f58e415ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:57.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58ea600640 1 --2- 172.21.15.137:0/2347161159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58e40cd710 0x7f58e415ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58ea600640 1 -- 172.21.15.137:0/2347161159 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e415d7a0 con 0x7f58e415fe30 2024-04-26T23:43:57.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58e9200640 1 --2- 172.21.15.137:0/2347161159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58e40cd710 0x7f58e415ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:57.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58ea600640 1 --2- 172.21.15.137:0/2347161159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58e415fe30 0x7f58e415ad40 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f58dc00c780 tx=0x7f58dc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:57.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58e1600640 1 -- 172.21.15.137:0/2347161159 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc004b70 con 0x7f58e415fe30 2024-04-26T23:43:57.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58e1600640 1 -- 172.21.15.137:0/2347161159 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58dc004d10 con 0x7f58e415fe30 2024-04-26T23:43:57.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58ec600640 1 -- 172.21.15.137:0/2347161159 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e415da80 con 0x7f58e415fe30 2024-04-26T23:43:57.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58e1600640 1 -- 172.21.15.137:0/2347161159 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc00aa90 con 0x7f58e415fe30 2024-04-26T23:43:57.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58ec600640 1 -- 172.21.15.137:0/2347161159 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e415e040 con 0x7f58e415fe30 2024-04-26T23:43:57.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.330+0000 7f58ec600640 1 -- 172.21.15.137:0/2347161159 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e406a410 con 0x7f58e415fe30 2024-04-26T23:43:57.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.334+0000 7f58e1600640 1 -- 172.21.15.137:0/2347161159 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f58dc00ac30 con 0x7f58e415fe30 2024-04-26T23:43:57.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.334+0000 7f58e1600640 1 --2- 172.21.15.137:0/2347161159 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f58c40683b0 0x7f58c406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:57.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.334+0000 7f58e1600640 1 -- 172.21.15.137:0/2347161159 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5752+0+0 (secure 0 0 0) 0x7f58dc086c20 con 0x7f58e415fe30 2024-04-26T23:43:57.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.334+0000 7f58e9c00640 1 --2- 172.21.15.137:0/2347161159 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f58c40683b0 0x7f58c406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:57.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.334+0000 7f58e9c00640 1 --2- 172.21.15.137:0/2347161159 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f58c40683b0 0x7f58c406a870 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f58d80af000 tx=0x7f58d80a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:57.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.338+0000 7f58e1600640 1 -- 172.21.15.137:0/2347161159 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f58dc020070 con 0x7f58e415fe30 2024-04-26T23:43:57.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.494+0000 7f58ec600640 1 -- 172.21.15.137:0/2347161159 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f58e413aa00 con 0x7f58e415fe30 2024-04-26T23:43:57.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.494+0000 7f58e1600640 1 -- 172.21.15.137:0/2347161159 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) ==== 100+0+11 (secure 0 0 0) 0x7f58dc0571a0 con 0x7f58e415fe30 2024-04-26T23:43:57.502 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:43:57.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.498+0000 7f58ec600640 1 -- 172.21.15.137:0/2347161159 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f58c40683b0 msgr2=0x7f58c406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:57.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.498+0000 7f58ec600640 1 --2- 172.21.15.137:0/2347161159 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f58c40683b0 0x7f58c406a870 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f58d80af000 tx=0x7f58d80a7000 comp rx=0 tx=0).stop 2024-04-26T23:43:57.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.498+0000 7f58ec600640 1 -- 172.21.15.137:0/2347161159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58e415fe30 msgr2=0x7f58e415ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:57.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.498+0000 7f58ec600640 1 --2- 172.21.15.137:0/2347161159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58e415fe30 0x7f58e415ad40 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f58dc00c780 tx=0x7f58dc00cc40 comp rx=0 tx=0).stop 2024-04-26T23:43:57.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.498+0000 7f58ec600640 1 -- 172.21.15.137:0/2347161159 shutdown_connections 2024-04-26T23:43:57.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.498+0000 7f58ec600640 1 --2- 172.21.15.137:0/2347161159 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f58c40683b0 0x7f58c406a870 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.498+0000 7f58ec600640 1 --2- 172.21.15.137:0/2347161159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58e415fe30 0x7f58e415ad40 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.498+0000 7f58ec600640 1 --2- 172.21.15.137:0/2347161159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58e40cd710 0x7f58e415ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.498+0000 7f58ec600640 1 --2- 172.21.15.137:0/2347161159 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58e40b54e0 0x7f58e413a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.498+0000 7f58ec600640 1 -- 172.21.15.137:0/2347161159 >> 172.21.15.137:0/2347161159 conn(0x7f58e406c800 msgr2=0x7f58e40b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:57.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.498+0000 7f58ec600640 1 -- 172.21.15.137:0/2347161159 shutdown_connections 2024-04-26T23:43:57.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.498+0000 7f58ec600640 1 -- 172.21.15.137:0/2347161159 wait complete. 2024-04-26T23:43:57.524 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:43:57.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.654+0000 7f313ce00640 1 Processor -- start 2024-04-26T23:43:57.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.654+0000 7f313ce00640 1 -- start start 2024-04-26T23:43:57.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.654+0000 7f313ce00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3138073090 0x7f31380cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:57.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.654+0000 7f313ce00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31380cfef0 con 0x7f31380725a0 2024-04-26T23:43:57.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.654+0000 7f313ce00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31380cddc0 con 0x7f31380b5080 2024-04-26T23:43:57.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.654+0000 7f313ce00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f31380d01b0 con 0x7f3138073090 2024-04-26T23:43:57.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.654+0000 7f3136800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3138073090 0x7f31380cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:57.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.654+0000 7f3135e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f31380725a0 0x7f3138073f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:33784/0 (socket says 172.21.15.137:33784) 2024-04-26T23:43:57.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.654+0000 7f3135e00640 1 -- 172.21.15.137:0/2417951117 learned_addr learned my addr 172.21.15.137:0/2417951117 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:43:57.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.658+0000 7f3136800640 1 -- 172.21.15.137:0/2417951117 >> v1:172.21.15.170:6789/0 conn(0x7f31380b5080 legacy=0x7f3138072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:57.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.658+0000 7f3136800640 1 -- 172.21.15.137:0/2417951117 >> v1:172.21.15.137:6789/0 conn(0x7f31380725a0 legacy=0x7f3138073f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:57.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.658+0000 7f3136800640 1 -- 172.21.15.137:0/2417951117 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31380d0490 con 0x7f3138073090 2024-04-26T23:43:57.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.658+0000 7f3135400640 1 -- 172.21.15.137:0/2417951117 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3555039721 0 0) 0x7f31380cfef0 con 0x7f31380725a0 2024-04-26T23:43:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.658+0000 7f3136800640 1 --2- 172.21.15.137:0/2417951117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3138073090 0x7f31380cd770 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3130009dc0 tx=0x7f313001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa3335c6876f968 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.658+0000 7f3135400640 1 -- 172.21.15.137:0/2417951117 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31300b2070 con 0x7f3138073090 2024-04-26T23:43:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.658+0000 7f3135400640 1 -- 172.21.15.137:0/2417951117 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31300a5a00 con 0x7f3138073090 2024-04-26T23:43:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.658+0000 7f3135400640 1 -- 172.21.15.137:0/2417951117 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31300a5dd0 con 0x7f3138073090 2024-04-26T23:43:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.658+0000 7f313ce00640 1 -- 172.21.15.137:0/2417951117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3138073090 msgr2=0x7f31380cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.658+0000 7f313ce00640 1 --2- 172.21.15.137:0/2417951117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3138073090 0x7f31380cd770 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3130009dc0 tx=0x7f313001c920 comp rx=0 tx=0).stop 2024-04-26T23:43:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.658+0000 7f313ce00640 1 -- 172.21.15.137:0/2417951117 shutdown_connections 2024-04-26T23:43:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.658+0000 7f313ce00640 1 --2- 172.21.15.137:0/2417951117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3138073090 0x7f31380cd770 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.658+0000 7f313ce00640 1 -- 172.21.15.137:0/2417951117 >> 172.21.15.137:0/2417951117 conn(0x7f313806c5d0 msgr2=0x7f313806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.658+0000 7f313ce00640 1 -- 172.21.15.137:0/2417951117 shutdown_connections 2024-04-26T23:43:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.658+0000 7f313ce00640 1 -- 172.21.15.137:0/2417951117 wait complete. 2024-04-26T23:43:57.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f313ce00640 1 Processor -- start 2024-04-26T23:43:57.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f313ce00640 1 -- start start 2024-04-26T23:43:57.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f313ce00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31380725a0 0x7f3138142810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:57.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f313ce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3138073090 0x7f313813d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f313ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31380b5080 0x7f313813dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f313ce00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3138169900 con 0x7f31380b5080 2024-04-26T23:43:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f313ce00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3138169780 con 0x7f3138073090 2024-04-26T23:43:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f313ce00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3138169a80 con 0x7f31380725a0 2024-04-26T23:43:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f3136800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31380b5080 0x7f313813dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f3136800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31380b5080 0x7f313813dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:56456/0 (socket says 172.21.15.137:56456) 2024-04-26T23:43:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f3136800640 1 -- 172.21.15.137:0/2794767100 learned_addr learned my addr 172.21.15.137:0/2794767100 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f3135e00640 1 --2- 172.21.15.137:0/2794767100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31380725a0 0x7f3138142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f312d400640 1 --2- 172.21.15.137:0/2794767100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3138073090 0x7f313813d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f3136800640 1 -- 172.21.15.137:0/2794767100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31380725a0 msgr2=0x7f3138142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f3136800640 1 --2- 172.21.15.137:0/2794767100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31380725a0 0x7f3138142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f3136800640 1 -- 172.21.15.137:0/2794767100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3138073090 msgr2=0x7f313813d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f3136800640 1 --2- 172.21.15.137:0/2794767100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3138073090 0x7f313813d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f3136800640 1 -- 172.21.15.137:0/2794767100 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31380b08f0 con 0x7f31380b5080 2024-04-26T23:43:57.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f3136800640 1 --2- 172.21.15.137:0/2794767100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31380b5080 0x7f313813dce0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f313001ce00 tx=0x7f31300196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:57.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f312ea00640 1 -- 172.21.15.137:0/2794767100 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31300b2040 con 0x7f31380b5080 2024-04-26T23:43:57.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f312ea00640 1 -- 172.21.15.137:0/2794767100 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31300ad8b0 con 0x7f31380b5080 2024-04-26T23:43:57.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f312ea00640 1 -- 172.21.15.137:0/2794767100 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31300adc60 con 0x7f31380b5080 2024-04-26T23:43:57.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f313ce00640 1 -- 172.21.15.137:0/2794767100 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31380b0bd0 con 0x7f31380b5080 2024-04-26T23:43:57.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.662+0000 7f313ce00640 1 -- 172.21.15.137:0/2794767100 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f313813cfa0 con 0x7f31380b5080 2024-04-26T23:43:57.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.666+0000 7f313ce00640 1 -- 172.21.15.137:0/2794767100 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f313806a4b0 con 0x7f31380b5080 2024-04-26T23:43:57.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.666+0000 7f312ea00640 1 -- 172.21.15.137:0/2794767100 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f31300c1020 con 0x7f31380b5080 2024-04-26T23:43:57.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.666+0000 7f312ea00640 1 --2- 172.21.15.137:0/2794767100 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f31140683b0 0x7f311406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:57.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.666+0000 7f312ea00640 1 -- 172.21.15.137:0/2794767100 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5752+0+0 (secure 0 0 0) 0x7f3130121960 con 0x7f31380b5080 2024-04-26T23:43:57.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.666+0000 7f3135e00640 1 --2- 172.21.15.137:0/2794767100 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f31140683b0 0x7f311406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:57.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.666+0000 7f3135e00640 1 --2- 172.21.15.137:0/2794767100 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f31140683b0 0x7f311406a870 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3128000f70 tx=0x7f3128007d10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:57.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.670+0000 7f312ea00640 1 -- 172.21.15.137:0/2794767100 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3130016540 con 0x7f31380b5080 2024-04-26T23:43:57.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.842+0000 7f313ce00640 1 -- 172.21.15.137:0/2794767100 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3138072380 con 0x7f31380b5080 2024-04-26T23:43:57.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.842+0000 7f312ea00640 1 -- 172.21.15.137:0/2794767100 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v46) ==== 80+0+56 (secure 0 0 0) 0x7f31300b6e20 con 0x7f31380b5080 2024-04-26T23:43:57.849 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.1:0/268105340 2024-04-27T00:43:44.368539+0000 2024-04-26T23:43:57.849 INFO:teuthology.orchestra.run.smithi137.stderr:listed 1 entries 2024-04-26T23:43:57.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.842+0000 7f313ce00640 1 -- 172.21.15.137:0/2794767100 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f31140683b0 msgr2=0x7f311406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:57.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.842+0000 7f313ce00640 1 --2- 172.21.15.137:0/2794767100 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f31140683b0 0x7f311406a870 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3128000f70 tx=0x7f3128007d10 comp rx=0 tx=0).stop 2024-04-26T23:43:57.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.842+0000 7f313ce00640 1 -- 172.21.15.137:0/2794767100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31380b5080 msgr2=0x7f313813dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:57.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.842+0000 7f313ce00640 1 --2- 172.21.15.137:0/2794767100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31380b5080 0x7f313813dce0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f313001ce00 tx=0x7f31300196c0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.842+0000 7f313ce00640 1 -- 172.21.15.137:0/2794767100 shutdown_connections 2024-04-26T23:43:57.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.842+0000 7f313ce00640 1 --2- 172.21.15.137:0/2794767100 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f31140683b0 0x7f311406a870 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.842+0000 7f313ce00640 1 --2- 172.21.15.137:0/2794767100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31380b5080 0x7f313813dce0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.842+0000 7f313ce00640 1 --2- 172.21.15.137:0/2794767100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3138073090 0x7f313813d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.842+0000 7f313ce00640 1 --2- 172.21.15.137:0/2794767100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31380725a0 0x7f3138142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:57.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.842+0000 7f313ce00640 1 -- 172.21.15.137:0/2794767100 >> 172.21.15.137:0/2794767100 conn(0x7f313806c5d0 msgr2=0x7f313806c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:57.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.842+0000 7f313ce00640 1 -- 172.21.15.137:0/2794767100 shutdown_connections 2024-04-26T23:43:57.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:57.842+0000 7f313ce00640 1 -- 172.21.15.137:0/2794767100 wait complete. 2024-04-26T23:43:57.870 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2024-04-26T23:43:57.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:57.870 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2024-04-26T23:43:57.903 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T23:43:57.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:57.903 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T23:43:57.956 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:43:58.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.126+0000 7f194dc00640 1 Processor -- start 2024-04-26T23:43:58.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.126+0000 7f194dc00640 1 -- start start 2024-04-26T23:43:58.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.126+0000 7f194dc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1948148aa0 0x7f1948072630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:58.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.126+0000 7f194dc00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1948160550 0x7f19480b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:58.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.126+0000 7f194dc00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1948148e80 con 0x7f19480b6360 2024-04-26T23:43:58.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.126+0000 7f194dc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f19480b67e0 con 0x7f1948148aa0 2024-04-26T23:43:58.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.126+0000 7f194dc00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f1948071b50 con 0x7f1948160550 2024-04-26T23:43:58.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.126+0000 7f1946a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1948148aa0 0x7f1948072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:58.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.126+0000 7f1946a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1948148aa0 0x7f1948072630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:56470/0 (socket says 172.21.15.137:56470) 2024-04-26T23:43:58.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.126+0000 7f1946a00640 1 -- 172.21.15.137:0/3946879443 learned_addr learned my addr 172.21.15.137:0/3946879443 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:58.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.126+0000 7f193e000640 1 --2- 172.21.15.137:0/3946879443 >> v2:172.21.15.170:3300/0 conn(0x7f1948160550 0x7f19480b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:58.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.126+0000 7f1946a00640 1 -- 172.21.15.137:0/3946879443 >> v2:172.21.15.170:3300/0 conn(0x7f1948160550 msgr2=0x7f19480b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:58.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.126+0000 7f1946a00640 1 --2- 172.21.15.137:0/3946879443 >> v2:172.21.15.170:3300/0 conn(0x7f1948160550 0x7f19480b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:58.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.126+0000 7f1946a00640 1 -- 172.21.15.137:0/3946879443 >> v1:172.21.15.170:6789/0 conn(0x7f19480b6360 legacy=0x7f19480704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:58.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.126+0000 7f1946a00640 1 -- 172.21.15.137:0/3946879443 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1948071e30 con 0x7f1948148aa0 2024-04-26T23:43:58.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.130+0000 7f1946a00640 1 --2- 172.21.15.137:0/3946879443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1948148aa0 0x7f1948072630 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f19480d2d20 tx=0x7f193801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8f6951785af01f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:58.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.130+0000 7f1946000640 1 -- 172.21.15.137:0/3946879443 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19380b1070 con 0x7f1948148aa0 2024-04-26T23:43:58.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.130+0000 7f1946000640 1 -- 172.21.15.137:0/3946879443 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19380ac640 con 0x7f1948148aa0 2024-04-26T23:43:58.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.130+0000 7f1946000640 1 -- 172.21.15.137:0/3946879443 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19380aca10 con 0x7f1948148aa0 2024-04-26T23:43:58.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.130+0000 7f194dc00640 1 -- 172.21.15.137:0/3946879443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1948148aa0 msgr2=0x7f1948072630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:58.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.130+0000 7f194dc00640 1 --2- 172.21.15.137:0/3946879443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1948148aa0 0x7f1948072630 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f19480d2d20 tx=0x7f193801c400 comp rx=0 tx=0).stop 2024-04-26T23:43:58.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.130+0000 7f194dc00640 1 -- 172.21.15.137:0/3946879443 shutdown_connections 2024-04-26T23:43:58.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.130+0000 7f194dc00640 1 --2- 172.21.15.137:0/3946879443 >> v2:172.21.15.170:3300/0 conn(0x7f1948160550 0x7f19480b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:58.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.130+0000 7f194dc00640 1 --2- 172.21.15.137:0/3946879443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1948148aa0 0x7f1948072630 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:58.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.130+0000 7f194dc00640 1 -- 172.21.15.137:0/3946879443 >> 172.21.15.137:0/3946879443 conn(0x7f19480b4b20 msgr2=0x7f19480b4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:58.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.130+0000 7f194dc00640 1 -- 172.21.15.137:0/3946879443 shutdown_connections 2024-04-26T23:43:58.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.130+0000 7f194dc00640 1 -- 172.21.15.137:0/3946879443 wait complete. 2024-04-26T23:43:58.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f194dc00640 1 Processor -- start 2024-04-26T23:43:58.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f194dc00640 1 -- start start 2024-04-26T23:43:58.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f194dc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19480b6360 0x7f19481431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:58.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f194dc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1948148aa0 0x7f1948164520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:58.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f194dc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1948164a60 0x7f194815e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:58.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f194dc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f194806d330 con 0x7f19480b6360 2024-04-26T23:43:58.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f194dc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f194806d1b0 con 0x7f1948164a60 2024-04-26T23:43:58.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f194dc00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f194806d4b0 con 0x7f1948148aa0 2024-04-26T23:43:58.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f1946a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19480b6360 0x7f19481431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:58.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f1946a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19480b6360 0x7f19481431c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:56480/0 (socket says 172.21.15.137:56480) 2024-04-26T23:43:58.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f1946a00640 1 -- 172.21.15.137:0/366246879 learned_addr learned my addr 172.21.15.137:0/366246879 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:43:58.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f193e000640 1 --2- 172.21.15.137:0/366246879 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1948148aa0 0x7f1948164520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:58.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f1947400640 1 --2- 172.21.15.137:0/366246879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1948164a60 0x7f194815e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:58.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f1946a00640 1 -- 172.21.15.137:0/366246879 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1948148aa0 msgr2=0x7f1948164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:58.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f1946a00640 1 --2- 172.21.15.137:0/366246879 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1948148aa0 0x7f1948164520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:58.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f1946a00640 1 -- 172.21.15.137:0/366246879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1948164a60 msgr2=0x7f194815e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:58.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f1946a00640 1 --2- 172.21.15.137:0/366246879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1948164a60 0x7f194815e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:58.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f1946a00640 1 -- 172.21.15.137:0/366246879 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1948143a50 con 0x7f19480b6360 2024-04-26T23:43:58.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f1947400640 1 --2- 172.21.15.137:0/366246879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1948164a60 0x7f194815e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:58.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f1946a00640 1 --2- 172.21.15.137:0/366246879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19480b6360 0x7f19481431c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f19380af040 tx=0x7f193801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:58.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f193f400640 1 -- 172.21.15.137:0/366246879 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19380bb020 con 0x7f19480b6360 2024-04-26T23:43:58.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f193f400640 1 -- 172.21.15.137:0/366246879 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19380b7640 con 0x7f19480b6360 2024-04-26T23:43:58.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f193f400640 1 -- 172.21.15.137:0/366246879 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19380b1040 con 0x7f19480b6360 2024-04-26T23:43:58.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f194dc00640 1 -- 172.21.15.137:0/366246879 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1948143d30 con 0x7f19480b6360 2024-04-26T23:43:58.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.134+0000 7f194dc00640 1 -- 172.21.15.137:0/366246879 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1948146420 con 0x7f19480b6360 2024-04-26T23:43:58.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.138+0000 7f194dc00640 1 -- 172.21.15.137:0/366246879 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1948164e70 con 0x7f19480b6360 2024-04-26T23:43:58.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.138+0000 7f193f400640 1 -- 172.21.15.137:0/366246879 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f19380be020 con 0x7f19480b6360 2024-04-26T23:43:58.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.138+0000 7f193f400640 1 --2- 172.21.15.137:0/366246879 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f19240683b0 0x7f192406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:58.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.138+0000 7f193f400640 1 -- 172.21.15.137:0/366246879 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5752+0+0 (secure 0 0 0) 0x7f1938120bf0 con 0x7f19480b6360 2024-04-26T23:43:58.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.138+0000 7f193e000640 1 --2- 172.21.15.137:0/366246879 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f19240683b0 0x7f192406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:58.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.138+0000 7f193e000640 1 --2- 172.21.15.137:0/366246879 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f19240683b0 0x7f192406a870 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f19481448a0 tx=0x7f1930008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:58.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.142+0000 7f193f400640 1 -- 172.21.15.137:0/366246879 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1948164e70 con 0x7f19480b6360 2024-04-26T23:43:58.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.334+0000 7f194dc00640 1 -- 172.21.15.137:0/366246879 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f194806a4b0 con 0x7f19480b6360 2024-04-26T23:43:58.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.334+0000 7f193f400640 1 -- 172.21.15.137:0/366246879 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) ==== 53+0+73 (secure 0 0 0) 0x7f19380c5030 con 0x7f19480b6360 2024-04-26T23:43:58.342 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:43:58.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.334+0000 7f194dc00640 1 -- 172.21.15.137:0/366246879 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f19240683b0 msgr2=0x7f192406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:58.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.334+0000 7f194dc00640 1 --2- 172.21.15.137:0/366246879 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f19240683b0 0x7f192406a870 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f19481448a0 tx=0x7f1930008040 comp rx=0 tx=0).stop 2024-04-26T23:43:58.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.334+0000 7f194dc00640 1 -- 172.21.15.137:0/366246879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19480b6360 msgr2=0x7f19481431c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:58.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.334+0000 7f194dc00640 1 --2- 172.21.15.137:0/366246879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19480b6360 0x7f19481431c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f19380af040 tx=0x7f193801ac40 comp rx=0 tx=0).stop 2024-04-26T23:43:58.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.338+0000 7f194dc00640 1 -- 172.21.15.137:0/366246879 shutdown_connections 2024-04-26T23:43:58.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.338+0000 7f194dc00640 1 --2- 172.21.15.137:0/366246879 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f19240683b0 0x7f192406a870 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:58.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.338+0000 7f194dc00640 1 --2- 172.21.15.137:0/366246879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1948164a60 0x7f194815e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:58.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.338+0000 7f194dc00640 1 --2- 172.21.15.137:0/366246879 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1948148aa0 0x7f1948164520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:58.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.338+0000 7f194dc00640 1 --2- 172.21.15.137:0/366246879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19480b6360 0x7f19481431c0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:58.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.338+0000 7f194dc00640 1 -- 172.21.15.137:0/366246879 >> 172.21.15.137:0/366246879 conn(0x7f19480b4b20 msgr2=0x7f1948160940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:58.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.338+0000 7f194dc00640 1 -- 172.21.15.137:0/366246879 shutdown_connections 2024-04-26T23:43:58.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58.338+0000 7f194dc00640 1 -- 172.21.15.137:0/366246879 wait complete. 2024-04-26T23:43:58.363 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:43:58.363 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:43:58.363 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T23:43:58.363 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T23:43:58.364 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T23:43:58.364 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:43:58.364 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:43:58.364 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:43:58.364 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:43:58.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:58.364 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T23:43:58.373 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:43:58.373 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:43:58.373 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:43:58.373 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:58.373 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T23:43:58.373 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:58.373 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:43:58.373 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T23:43:58.373 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T23:43:58.374 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:43:58.374 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T23:43:58.374 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T23:43:58.374 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:43:58.374 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:43:58.374 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:43:58.374 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:43:58.374 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:43:58.374 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42324sec preferred_lft 42324sec 2024-04-26T23:43:58.374 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link 2024-04-26T23:43:58.374 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:58.374 INFO:teuthology.orchestra.run.smithi137.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:43:58.374 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 02:42:f4:6f:af:56 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:43:58.374 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:43:58.375 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:58.375 INFO:teuthology.orchestra.run.smithi137.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:43:58.375 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:43:58.375 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:43:58.375 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:58.375 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T23:43:58.375 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:58.375 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:43:58.375 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:43:58.375 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:43:58.375 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:58.375 INFO:teuthology.orchestra.run.smithi137.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:43:58.375 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:43:58.375 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-26T23:43:58.376 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:43:58.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:58.377 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:43:58.441 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T23:43:58.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:58.443 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T23:43:58.506 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T23:43:58.506 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:43:58.506 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:43:58.506 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:43:58.506 INFO:teuthology.orchestra.run.smithi137.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:43:58.506 INFO:teuthology.orchestra.run.smithi137.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:43:58.506 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:43:58.506 INFO:teuthology.orchestra.run.smithi137.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:43:58.506 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:43:58.507 INFO:teuthology.orchestra.run.smithi137.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:43:58.507 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:43:58.507 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:43:58.507 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T23:43:58.507 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:43:58.507 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:43:58.507 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:43:58.507 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T23:43:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:43:58.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:43:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:43:58.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:58.644 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T23:43:58.653 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T23:43:58.653 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T23:43:58.653 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:43:58.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:58.653 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-26T23:43:58.719 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-26T23:43:58.719 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:43:58.719 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T23:43:58.768 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:43:58.768 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:43:58.768 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:43:58.818 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-26T23:43:58.879 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:43:58.937 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-26T23:43:58.937 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-26T23:43:58.937 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-26T23:43:58.937 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-26T23:43:58.937 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-26T23:43:58.937 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-26T23:43:58.937 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-26T23:43:58.937 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-26T23:43:58.937 INFO:teuthology.orchestra.run.smithi137.stdout:/run/lock 2024-04-26T23:43:58.937 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-26T23:43:58.938 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-26T23:43:58.938 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-26T23:43:58.938 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:43:58.938 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-26T23:43:58.938 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-26T23:43:58.938 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-26T23:43:58.938 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-26T23:43:58.938 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/fs/nfsd 2024-04-26T23:43:58.938 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-26T23:43:58.938 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-26T23:43:58.938 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:43:58.938 INFO:teuthology.orchestra.run.smithi137.stdout:/run/rpc_pipefs 2024-04-26T23:43:58.938 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-26T23:43:58.938 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-26T23:43:58.939 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:43:58.939 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:43:58.939 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:43:58.939 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:43:58.939 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-26T23:43:58.939 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:43:58.939 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:43:58.939 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:43:58.939 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:43:58.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:58.940 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-26T23:43:58.991 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T23:43:58.991 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-26T23:43:59.034 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-26T23:43:59.054 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:43:59.106 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-26T23:43:59.106 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-26T23:43:59.106 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-26T23:43:59.106 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-26T23:43:59.106 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-26T23:43:59.106 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-26T23:43:59.106 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-26T23:43:59.106 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-26T23:43:59.106 INFO:teuthology.orchestra.run.smithi137.stdout:/run/lock 2024-04-26T23:43:59.106 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-26T23:43:59.106 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-26T23:43:59.107 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-26T23:43:59.107 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:43:59.107 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-26T23:43:59.107 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-26T23:43:59.107 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-26T23:43:59.107 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-26T23:43:59.107 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/fs/nfsd 2024-04-26T23:43:59.107 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-26T23:43:59.107 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-26T23:43:59.107 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:43:59.107 INFO:teuthology.orchestra.run.smithi137.stdout:/run/rpc_pipefs 2024-04-26T23:43:59.107 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-26T23:43:59.107 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-26T23:43:59.108 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:43:59.108 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:43:59.108 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:43:59.108 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:43:59.108 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-26T23:43:59.108 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:43:59.108 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:43:59.108 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:43:59.108 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:43:59.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:43:59.109 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-26T23:43:59.128 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:2024-04-26T23:43:59.118+0000 7f24f397e580 -1 init, newargv = 0x55aa3e4617d0 newargc=15 2024-04-26T23:43:59.128 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:ceph-fuse[40665]: starting ceph client 2024-04-26T23:43:59.138 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:ceph-fuse[40665]: starting fuse 2024-04-26T23:44:00.238 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-26T23:44:00.263 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:44:00.314 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-26T23:44:00.314 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-26T23:44:00.314 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-26T23:44:00.314 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-26T23:44:00.314 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-26T23:44:00.314 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-26T23:44:00.315 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-26T23:44:00.315 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-26T23:44:00.315 INFO:teuthology.orchestra.run.smithi137.stdout:/run/lock 2024-04-26T23:44:00.315 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-26T23:44:00.315 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-26T23:44:00.315 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-26T23:44:00.315 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:44:00.315 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-26T23:44:00.315 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-26T23:44:00.315 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-26T23:44:00.315 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-26T23:44:00.315 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/fs/nfsd 2024-04-26T23:44:00.315 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-26T23:44:00.316 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-26T23:44:00.316 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:44:00.316 INFO:teuthology.orchestra.run.smithi137.stdout:/run/rpc_pipefs 2024-04-26T23:44:00.316 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-26T23:44:00.316 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-26T23:44:00.316 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:44:00.316 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:44:00.316 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:44:00.316 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:44:00.316 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-26T23:44:00.316 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:44:00.316 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:44:00.316 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:44:00.316 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:44:00.316 INFO:teuthology.orchestra.run.smithi137.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-26T23:44:00.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:00.317 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-26T23:44:00.372 INFO:teuthology.orchestra.run.smithi137.stdout:44 2024-04-26T23:44:00.372 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T23:44:00.372 DEBUG:teuthology.orchestra.run.smithi137:> sudo stdin-killer -- python3 -c ' 2024-04-26T23:44:00.372 DEBUG:teuthology.orchestra.run.smithi137:> import glob 2024-04-26T23:44:00.372 DEBUG:teuthology.orchestra.run.smithi137:> import re 2024-04-26T23:44:00.372 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T23:44:00.372 DEBUG:teuthology.orchestra.run.smithi137:> import subprocess 2024-04-26T23:44:00.372 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:44:00.373 DEBUG:teuthology.orchestra.run.smithi137:> def _find_admin_socket(client_name): 2024-04-26T23:44:00.373 DEBUG:teuthology.orchestra.run.smithi137:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T23:44:00.373 DEBUG:teuthology.orchestra.run.smithi137:> files = glob.glob(asok_path) 2024-04-26T23:44:00.373 DEBUG:teuthology.orchestra.run.smithi137:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T23:44:00.373 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:44:00.373 DEBUG:teuthology.orchestra.run.smithi137:> # Given a non-glob path, it better be there 2024-04-26T23:44:00.373 DEBUG:teuthology.orchestra.run.smithi137:> if "*" not in asok_path: 2024-04-26T23:44:00.373 DEBUG:teuthology.orchestra.run.smithi137:> assert(len(files) == 1) 2024-04-26T23:44:00.373 DEBUG:teuthology.orchestra.run.smithi137:> return files[0] 2024-04-26T23:44:00.373 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:44:00.373 DEBUG:teuthology.orchestra.run.smithi137:> for f in files: 2024-04-26T23:44:00.373 DEBUG:teuthology.orchestra.run.smithi137:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T23:44:00.373 DEBUG:teuthology.orchestra.run.smithi137:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T23:44:00.373 DEBUG:teuthology.orchestra.run.smithi137:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T23:44:00.373 DEBUG:teuthology.orchestra.run.smithi137:> contents = proc_f.read() 2024-04-26T23:44:00.374 DEBUG:teuthology.orchestra.run.smithi137:> if mountpoint in contents: 2024-04-26T23:44:00.374 DEBUG:teuthology.orchestra.run.smithi137:> return f 2024-04-26T23:44:00.374 DEBUG:teuthology.orchestra.run.smithi137:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T23:44:00.374 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:44:00.374 DEBUG:teuthology.orchestra.run.smithi137:> print(_find_admin_socket("client.0")) 2024-04-26T23:44:00.374 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T23:44:00.505 INFO:teuthology.orchestra.run.smithi137.stdout:/var/run/ceph/ceph-client.0.40665.asok 2024-04-26T23:44:00.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:44:00.516 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.40665.asok 2024-04-26T23:44:00.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:00.517 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.40665.asok status 2024-04-26T23:44:00.690 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:44:00.690 INFO:teuthology.orchestra.run.smithi137.stdout: "metadata": { 2024-04-26T23:44:00.690 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T23:44:00.690 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T23:44:00.690 INFO:teuthology.orchestra.run.smithi137.stdout: "entity_id": "0", 2024-04-26T23:44:00.690 INFO:teuthology.orchestra.run.smithi137.stdout: "hostname": "smithi137", 2024-04-26T23:44:00.690 INFO:teuthology.orchestra.run.smithi137.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-26T23:44:00.691 INFO:teuthology.orchestra.run.smithi137.stdout: "pid": "40665", 2024-04-26T23:44:00.691 INFO:teuthology.orchestra.run.smithi137.stdout: "root": "/" 2024-04-26T23:44:00.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:00.691 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_count": 0, 2024-04-26T23:44:00.691 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_pinned_count": 0, 2024-04-26T23:44:00.691 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 6117, 2024-04-26T23:44:00.691 INFO:teuthology.orchestra.run.smithi137.stdout: "inst": { 2024-04-26T23:44:00.691 INFO:teuthology.orchestra.run.smithi137.stdout: "name": { 2024-04-26T23:44:00.691 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "client", 2024-04-26T23:44:00.691 INFO:teuthology.orchestra.run.smithi137.stdout: "num": 6117 2024-04-26T23:44:00.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:00.691 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2024-04-26T23:44:00.691 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-26T23:44:00.691 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:44:00.692 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 1959349634 2024-04-26T23:44:00.692 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:00.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:00.692 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2024-04-26T23:44:00.692 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-26T23:44:00.692 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:44:00.692 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 1959349634 2024-04-26T23:44:00.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:00.692 INFO:teuthology.orchestra.run.smithi137.stdout: "inst_str": "client.6117 192.168.0.1:0/1959349634", 2024-04-26T23:44:00.692 INFO:teuthology.orchestra.run.smithi137.stdout: "addr_str": "192.168.0.1:0/1959349634", 2024-04-26T23:44:00.692 INFO:teuthology.orchestra.run.smithi137.stdout: "inode_count": 1, 2024-04-26T23:44:00.692 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_epoch": 29, 2024-04-26T23:44:00.692 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch": 46, 2024-04-26T23:44:00.692 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch_barrier": 0, 2024-04-26T23:44:00.693 INFO:teuthology.orchestra.run.smithi137.stdout: "blocklisted": false, 2024-04-26T23:44:00.693 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs" 2024-04-26T23:44:00.693 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:44:00.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:00.707 DEBUG:teuthology.orchestra.run.smithi137:> stat --file-system '--printf=%T 2024-04-26T23:44:00.707 DEBUG:teuthology.orchestra.run.smithi137:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-26T23:44:00.715 INFO:teuthology.orchestra.run.smithi137.stdout:fuseblk 2024-04-26T23:44:00.715 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-26T23:44:00.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:00.716 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:44:00.782 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T23:44:00.782 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:44:00.938 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:44:01.027 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T23:44:01.028 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:44:01.028 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:44:01.028 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:44:01.036 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:44:01.036 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:44:01.089 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:44:01.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.270+0000 7f1d74200640 1 Processor -- start 2024-04-26T23:44:01.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.270+0000 7f1d74200640 1 -- start start 2024-04-26T23:44:01.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.274+0000 7f1d74200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1d6c15de80 0x7f1d6c073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.274+0000 7f1d74200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1d6c0ce7c0 0x7f1d6c146210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.274+0000 7f1d74200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d6c073010 con 0x7f1d6c0ce3e0 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.274+0000 7f1d74200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1d6c0cef90 con 0x7f1d6c15de80 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.274+0000 7f1d74200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f1d6c073280 con 0x7f1d6c0ce7c0 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.274+0000 7f1d70e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1d6c15de80 0x7f1d6c073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.274+0000 7f1d71800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f1d6c0ce3e0 0x7f1d6c0d04e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:37538/0 (socket says 172.21.15.137:37538) 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.274+0000 7f1d70e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1d6c15de80 0x7f1d6c073d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41732/0 (socket says 172.21.15.137:41732) 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.274+0000 7f1d71800640 1 -- 172.21.15.137:0/3713057490 learned_addr learned my addr 172.21.15.137:0/3713057490 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.274+0000 7f1d72200640 1 --2- 172.21.15.137:0/3713057490 >> v2:172.21.15.170:3300/0 conn(0x7f1d6c0ce7c0 0x7f1d6c146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.274+0000 7f1d70e00640 1 -- 172.21.15.137:0/3713057490 >> v2:172.21.15.170:3300/0 conn(0x7f1d6c0ce7c0 msgr2=0x7f1d6c146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.274+0000 7f1d70e00640 1 --2- 172.21.15.137:0/3713057490 >> v2:172.21.15.170:3300/0 conn(0x7f1d6c0ce7c0 0x7f1d6c146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.274+0000 7f1d70e00640 1 -- 172.21.15.137:0/3713057490 >> v1:172.21.15.137:6789/0 conn(0x7f1d6c0ce3e0 legacy=0x7f1d6c0d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.274+0000 7f1d70e00640 1 -- 172.21.15.137:0/3713057490 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d6c073560 con 0x7f1d6c15de80 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.274+0000 7f1d6be00640 1 -- 172.21.15.137:0/3713057490 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1428508481 0 0) 0x7f1d6c073010 con 0x7f1d6c0ce3e0 2024-04-26T23:44:01.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.278+0000 7f1d70e00640 1 --2- 172.21.15.137:0/3713057490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d6c15de80 0x7f1d6c073d60 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f1d580097c0 tx=0x7f1d5801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73245987e25437aa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:01.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.278+0000 7f1d6be00640 1 -- 172.21.15.137:0/3713057490 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d580b0070 con 0x7f1d6c15de80 2024-04-26T23:44:01.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.278+0000 7f1d6be00640 1 -- 172.21.15.137:0/3713057490 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d580ab600 con 0x7f1d6c15de80 2024-04-26T23:44:01.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.278+0000 7f1d6be00640 1 -- 172.21.15.137:0/3713057490 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d580ab9d0 con 0x7f1d6c15de80 2024-04-26T23:44:01.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.278+0000 7f1d74200640 1 -- 172.21.15.137:0/3713057490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d6c15de80 msgr2=0x7f1d6c073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.278+0000 7f1d74200640 1 --2- 172.21.15.137:0/3713057490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d6c15de80 0x7f1d6c073d60 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f1d580097c0 tx=0x7f1d5801c430 comp rx=0 tx=0).stop 2024-04-26T23:44:01.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.278+0000 7f1d74200640 1 -- 172.21.15.137:0/3713057490 shutdown_connections 2024-04-26T23:44:01.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.278+0000 7f1d74200640 1 --2- 172.21.15.137:0/3713057490 >> v2:172.21.15.170:3300/0 conn(0x7f1d6c0ce7c0 0x7f1d6c146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.278+0000 7f1d74200640 1 --2- 172.21.15.137:0/3713057490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d6c15de80 0x7f1d6c073d60 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.278+0000 7f1d74200640 1 -- 172.21.15.137:0/3713057490 >> 172.21.15.137:0/3713057490 conn(0x7f1d6c06c5d0 msgr2=0x7f1d6c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:01.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.278+0000 7f1d74200640 1 -- 172.21.15.137:0/3713057490 shutdown_connections 2024-04-26T23:44:01.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.278+0000 7f1d74200640 1 -- 172.21.15.137:0/3713057490 wait complete. 2024-04-26T23:44:01.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.278+0000 7f1d74200640 1 Processor -- start 2024-04-26T23:44:01.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.278+0000 7f1d74200640 1 -- start start 2024-04-26T23:44:01.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d74200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d6c0ce3e0 0x7f1d6c13bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d74200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d6c0ce7c0 0x7f1d6c1418f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d74200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d6c15de80 0x7f1d6c13eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d74200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6c06f0e0 con 0x7f1d6c15de80 2024-04-26T23:44:01.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d74200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6c06ef60 con 0x7f1d6c0ce3e0 2024-04-26T23:44:01.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d74200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1d6c06f260 con 0x7f1d6c0ce7c0 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d72200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d6c15de80 0x7f1d6c13eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d72200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d6c15de80 0x7f1d6c13eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41734/0 (socket says 172.21.15.137:41734) 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d72200640 1 -- 172.21.15.137:0/3278132574 learned_addr learned my addr 172.21.15.137:0/3278132574 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d71800640 1 --2- 172.21.15.137:0/3278132574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d6c0ce3e0 0x7f1d6c13bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d70e00640 1 --2- 172.21.15.137:0/3278132574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d6c0ce7c0 0x7f1d6c1418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d72200640 1 -- 172.21.15.137:0/3278132574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d6c0ce7c0 msgr2=0x7f1d6c1418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d72200640 1 --2- 172.21.15.137:0/3278132574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d6c0ce7c0 0x7f1d6c1418f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d72200640 1 -- 172.21.15.137:0/3278132574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d6c0ce3e0 msgr2=0x7f1d6c13bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d72200640 1 --2- 172.21.15.137:0/3278132574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d6c0ce3e0 0x7f1d6c13bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d72200640 1 -- 172.21.15.137:0/3278132574 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d6c144540 con 0x7f1d6c15de80 2024-04-26T23:44:01.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d72200640 1 --2- 172.21.15.137:0/3278132574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d6c15de80 0x7f1d6c13eff0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f1d64007e70 tx=0x7f1d6400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:01.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d69600640 1 -- 172.21.15.137:0/3278132574 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d64014620 con 0x7f1d6c15de80 2024-04-26T23:44:01.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d69600640 1 -- 172.21.15.137:0/3278132574 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d64019070 con 0x7f1d6c15de80 2024-04-26T23:44:01.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d69600640 1 -- 172.21.15.137:0/3278132574 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d64014a20 con 0x7f1d6c15de80 2024-04-26T23:44:01.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d74200640 1 -- 172.21.15.137:0/3278132574 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d6c0b4a40 con 0x7f1d6c15de80 2024-04-26T23:44:01.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d74200640 1 -- 172.21.15.137:0/3278132574 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d6c13c430 con 0x7f1d6c15de80 2024-04-26T23:44:01.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d74200640 1 -- 172.21.15.137:0/3278132574 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d6c06a4b0 con 0x7f1d6c15de80 2024-04-26T23:44:01.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.282+0000 7f1d69600640 1 -- 172.21.15.137:0/3278132574 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1d64014bc0 con 0x7f1d6c15de80 2024-04-26T23:44:01.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.286+0000 7f1d69600640 1 --2- 172.21.15.137:0/3278132574 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d4c068380 0x7f1d4c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.286+0000 7f1d69600640 1 -- 172.21.15.137:0/3278132574 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5752+0+0 (secure 0 0 0) 0x7f1d640872e0 con 0x7f1d6c15de80 2024-04-26T23:44:01.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.286+0000 7f1d71800640 1 --2- 172.21.15.137:0/3278132574 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d4c068380 0x7f1d4c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.286+0000 7f1d71800640 1 --2- 172.21.15.137:0/3278132574 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d4c068380 0x7f1d4c06a840 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1d60000f70 tx=0x7f1d60007df0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:01.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.290+0000 7f1d69600640 1 -- 172.21.15.137:0/3278132574 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1d640570f0 con 0x7f1d6c15de80 2024-04-26T23:44:01.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.446+0000 7f1d74200640 1 -- 172.21.15.137:0/3278132574 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d6c15e810 con 0x7f1d6c15de80 2024-04-26T23:44:01.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.446+0000 7f1d69600640 1 -- 172.21.15.137:0/3278132574 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16720 (secure 0 0 0) 0x7f1d6405b3f0 con 0x7f1d6c15de80 2024-04-26T23:44:01.455 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:01.455 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":46,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:43:45.365477+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:43:21.281556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T23:43:22.549121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/268105340":"2024-04-27T00:43:44.368539+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:44:01.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.450+0000 7f1d74200640 1 -- 172.21.15.137:0/3278132574 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d4c068380 msgr2=0x7f1d4c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.450+0000 7f1d74200640 1 --2- 172.21.15.137:0/3278132574 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d4c068380 0x7f1d4c06a840 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1d60000f70 tx=0x7f1d60007df0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.450+0000 7f1d74200640 1 -- 172.21.15.137:0/3278132574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d6c15de80 msgr2=0x7f1d6c13eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.450+0000 7f1d74200640 1 --2- 172.21.15.137:0/3278132574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d6c15de80 0x7f1d6c13eff0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f1d64007e70 tx=0x7f1d6400e4b0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.450+0000 7f1d74200640 1 -- 172.21.15.137:0/3278132574 shutdown_connections 2024-04-26T23:44:01.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.450+0000 7f1d74200640 1 --2- 172.21.15.137:0/3278132574 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d4c068380 0x7f1d4c06a840 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.450+0000 7f1d74200640 1 --2- 172.21.15.137:0/3278132574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d6c15de80 0x7f1d6c13eff0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.450+0000 7f1d74200640 1 --2- 172.21.15.137:0/3278132574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d6c0ce7c0 0x7f1d6c1418f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.450+0000 7f1d74200640 1 --2- 172.21.15.137:0/3278132574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d6c0ce3e0 0x7f1d6c13bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.450+0000 7f1d74200640 1 -- 172.21.15.137:0/3278132574 >> 172.21.15.137:0/3278132574 conn(0x7f1d6c06c5d0 msgr2=0x7f1d6c0b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:01.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.450+0000 7f1d74200640 1 -- 172.21.15.137:0/3278132574 shutdown_connections 2024-04-26T23:44:01.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.450+0000 7f1d74200640 1 -- 172.21.15.137:0/3278132574 wait complete. 2024-04-26T23:44:01.476 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:43:21.281556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:43:22.549121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:44:01.477 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:44:01.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.606+0000 7f8227800640 1 Processor -- start 2024-04-26T23:44:01.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.606+0000 7f8227800640 1 -- start start 2024-04-26T23:44:01.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.610+0000 7f8227800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8220152510 0x7f822006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.610+0000 7f8227800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f82200ceb00 0x7f822006f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.610+0000 7f8227800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82200738d0 0x7f8220073d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.610+0000 7f8227800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f822015baf0 con 0x7f8220152510 2024-04-26T23:44:01.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.610+0000 7f8227800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f822015bdb0 con 0x7f82200ceb00 2024-04-26T23:44:01.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.610+0000 7f8227800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f822015c090 con 0x7f82200738d0 2024-04-26T23:44:01.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.610+0000 7f8224e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8220152510 0x7f822006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.610+0000 7f8224e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8220152510 0x7f822006ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41744/0 (socket says 172.21.15.137:41744) 2024-04-26T23:44:01.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.610+0000 7f8224e00640 1 -- 172.21.15.137:0/1695216806 learned_addr learned my addr 172.21.15.137:0/1695216806 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:01.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.610+0000 7f8225800640 1 --2- 172.21.15.137:0/1695216806 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82200738d0 0x7f8220073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.610+0000 7f821fe00640 1 --2- 172.21.15.137:0/1695216806 >> v2:172.21.15.170:3300/0 conn(0x7f82200ceb00 0x7f822006f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.610+0000 7f8224e00640 1 -- 172.21.15.137:0/1695216806 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82200738d0 msgr2=0x7f8220073d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:01.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.610+0000 7f8224e00640 1 --2- 172.21.15.137:0/1695216806 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82200738d0 0x7f8220073d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.610+0000 7f8224e00640 1 -- 172.21.15.137:0/1695216806 >> v2:172.21.15.170:3300/0 conn(0x7f82200ceb00 msgr2=0x7f822006f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:01.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.610+0000 7f8224e00640 1 --2- 172.21.15.137:0/1695216806 >> v2:172.21.15.170:3300/0 conn(0x7f82200ceb00 0x7f822006f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.610+0000 7f8224e00640 1 -- 172.21.15.137:0/1695216806 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822015c370 con 0x7f8220152510 2024-04-26T23:44:01.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.614+0000 7f8224e00640 1 --2- 172.21.15.137:0/1695216806 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8220152510 0x7f822006ef60 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f822015bfc0 tx=0x7f821401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5b6fbf289e0b04 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:01.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.614+0000 7f821f400640 1 -- 172.21.15.137:0/1695216806 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82140b0070 con 0x7f8220152510 2024-04-26T23:44:01.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.614+0000 7f821f400640 1 -- 172.21.15.137:0/1695216806 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82140ab600 con 0x7f8220152510 2024-04-26T23:44:01.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.614+0000 7f821f400640 1 -- 172.21.15.137:0/1695216806 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82140ab9d0 con 0x7f8220152510 2024-04-26T23:44:01.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.614+0000 7f8227800640 1 -- 172.21.15.137:0/1695216806 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8220152510 msgr2=0x7f822006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.614+0000 7f8227800640 1 --2- 172.21.15.137:0/1695216806 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8220152510 0x7f822006ef60 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f822015bfc0 tx=0x7f821401c460 comp rx=0 tx=0).stop 2024-04-26T23:44:01.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.614+0000 7f8227800640 1 -- 172.21.15.137:0/1695216806 shutdown_connections 2024-04-26T23:44:01.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.614+0000 7f8227800640 1 --2- 172.21.15.137:0/1695216806 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82200738d0 0x7f8220073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.614+0000 7f8227800640 1 --2- 172.21.15.137:0/1695216806 >> v2:172.21.15.170:3300/0 conn(0x7f82200ceb00 0x7f822006f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.614+0000 7f8227800640 1 --2- 172.21.15.137:0/1695216806 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8220152510 0x7f822006ef60 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.614+0000 7f8227800640 1 -- 172.21.15.137:0/1695216806 >> 172.21.15.137:0/1695216806 conn(0x7f822006c800 msgr2=0x7f822006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:01.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.614+0000 7f8227800640 1 -- 172.21.15.137:0/1695216806 shutdown_connections 2024-04-26T23:44:01.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.614+0000 7f8227800640 1 -- 172.21.15.137:0/1695216806 wait complete. 2024-04-26T23:44:01.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.614+0000 7f8227800640 1 Processor -- start 2024-04-26T23:44:01.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.614+0000 7f8227800640 1 -- start start 2024-04-26T23:44:01.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f8227800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82200738d0 0x7f8220144900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f8227800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8220152510 0x7f82201fafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f8227800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82201fb520 0x7f82201fb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f8227800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f822015f260 con 0x7f8220152510 2024-04-26T23:44:01.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f8227800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f822015f0e0 con 0x7f82201fb520 2024-04-26T23:44:01.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f8227800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f822015f3e0 con 0x7f82200738d0 2024-04-26T23:44:01.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f821fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8220152510 0x7f82201fafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f821fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8220152510 0x7f82201fafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41756/0 (socket says 172.21.15.137:41756) 2024-04-26T23:44:01.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f821fe00640 1 -- 172.21.15.137:0/3337158042 learned_addr learned my addr 172.21.15.137:0/3337158042 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:01.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f8224e00640 1 --2- 172.21.15.137:0/3337158042 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82200738d0 0x7f8220144900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f8225800640 1 --2- 172.21.15.137:0/3337158042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82201fb520 0x7f82201fb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f821fe00640 1 -- 172.21.15.137:0/3337158042 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82200738d0 msgr2=0x7f8220144900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f821fe00640 1 --2- 172.21.15.137:0/3337158042 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82200738d0 0x7f8220144900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f821fe00640 1 -- 172.21.15.137:0/3337158042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82201fb520 msgr2=0x7f82201fb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f821fe00640 1 --2- 172.21.15.137:0/3337158042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82201fb520 0x7f82201fb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f821fe00640 1 -- 172.21.15.137:0/3337158042 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822015eb70 con 0x7f8220152510 2024-04-26T23:44:01.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f821fe00640 1 --2- 172.21.15.137:0/3337158042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8220152510 0x7f82201fafe0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f820c00e930 tx=0x7f820c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:01.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f821cc00640 1 -- 172.21.15.137:0/3337158042 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820c017070 con 0x7f8220152510 2024-04-26T23:44:01.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f821cc00640 1 -- 172.21.15.137:0/3337158042 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f820c00ca00 con 0x7f8220152510 2024-04-26T23:44:01.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f821cc00640 1 -- 172.21.15.137:0/3337158042 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820c00cdb0 con 0x7f8220152510 2024-04-26T23:44:01.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f8227800640 1 -- 172.21.15.137:0/3337158042 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8220156d80 con 0x7f8220152510 2024-04-26T23:44:01.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f8227800640 1 -- 172.21.15.137:0/3337158042 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8220157340 con 0x7f8220152510 2024-04-26T23:44:01.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f8227800640 1 -- 172.21.15.137:0/3337158042 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8220156b10 con 0x7f8220152510 2024-04-26T23:44:01.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.618+0000 7f821cc00640 1 -- 172.21.15.137:0/3337158042 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f820c01a070 con 0x7f8220152510 2024-04-26T23:44:01.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.622+0000 7f821cc00640 1 --2- 172.21.15.137:0/3337158042 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8200068380 0x7f820006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.622+0000 7f821cc00640 1 -- 172.21.15.137:0/3337158042 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5752+0+0 (secure 0 0 0) 0x7f820c0869b0 con 0x7f8220152510 2024-04-26T23:44:01.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.622+0000 7f8224e00640 1 --2- 172.21.15.137:0/3337158042 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8200068380 0x7f820006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.622+0000 7f8224e00640 1 --2- 172.21.15.137:0/3337158042 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8200068380 0x7f820006a840 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f82200b5270 tx=0x7f8214009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:01.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.626+0000 7f821cc00640 1 -- 172.21.15.137:0/3337158042 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f820c0569a0 con 0x7f8220152510 2024-04-26T23:44:01.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.786+0000 7f8227800640 1 -- 172.21.15.137:0/3337158042 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f822006a410 con 0x7f8220152510 2024-04-26T23:44:01.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.786+0000 7f821cc00640 1 -- 172.21.15.137:0/3337158042 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) ==== 93+0+10 (secure 0 0 0) 0x7f820c05aca0 con 0x7f8220152510 2024-04-26T23:44:01.795 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:44:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.790+0000 7f8227800640 1 -- 172.21.15.137:0/3337158042 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8200068380 msgr2=0x7f820006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.790+0000 7f8227800640 1 --2- 172.21.15.137:0/3337158042 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8200068380 0x7f820006a840 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f82200b5270 tx=0x7f8214009040 comp rx=0 tx=0).stop 2024-04-26T23:44:01.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.790+0000 7f8227800640 1 -- 172.21.15.137:0/3337158042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8220152510 msgr2=0x7f82201fafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.790+0000 7f8227800640 1 --2- 172.21.15.137:0/3337158042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8220152510 0x7f82201fafe0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f820c00e930 tx=0x7f820c00edf0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.790+0000 7f8227800640 1 -- 172.21.15.137:0/3337158042 shutdown_connections 2024-04-26T23:44:01.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.790+0000 7f8227800640 1 --2- 172.21.15.137:0/3337158042 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8200068380 0x7f820006a840 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.790+0000 7f8227800640 1 --2- 172.21.15.137:0/3337158042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8220152510 0x7f82201fafe0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.790+0000 7f8227800640 1 --2- 172.21.15.137:0/3337158042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82201fb520 0x7f82201fb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.790+0000 7f8227800640 1 --2- 172.21.15.137:0/3337158042 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82200738d0 0x7f8220144900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.790+0000 7f8227800640 1 -- 172.21.15.137:0/3337158042 >> 172.21.15.137:0/3337158042 conn(0x7f822006c800 msgr2=0x7f822006ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:01.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.790+0000 7f8227800640 1 -- 172.21.15.137:0/3337158042 shutdown_connections 2024-04-26T23:44:01.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.790+0000 7f8227800640 1 -- 172.21.15.137:0/3337158042 wait complete. 2024-04-26T23:44:01.817 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:44:01.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.946+0000 7f68a1800640 1 Processor -- start 2024-04-26T23:44:01.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.946+0000 7f68a1800640 1 -- start start 2024-04-26T23:44:01.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f68a1800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f689c0afbc0 0x7f689c15df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f68a1800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f689c0affa0 0x7f689c0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f68a1800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f689c072860 con 0x7f689c073f20 2024-04-26T23:44:01.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f68a1800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f689c0743b0 con 0x7f689c0affa0 2024-04-26T23:44:01.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f68a1800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f689c072b00 con 0x7f689c0afbc0 2024-04-26T23:44:01.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f689a000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f689c073f20 0x7f689c0735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:37540/0 (socket says 172.21.15.137:37540) 2024-04-26T23:44:01.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f689a000640 1 -- 172.21.15.137:0/2227570398 learned_addr learned my addr 172.21.15.137:0/2227570398 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:01.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f689b400640 1 --2- 172.21.15.137:0/2227570398 >> v2:172.21.15.170:3300/0 conn(0x7f689c0affa0 0x7f689c0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f689aa00640 1 --2- 172.21.15.137:0/2227570398 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f689c0afbc0 0x7f689c15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f6899600640 1 -- 172.21.15.137:0/2227570398 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1156326928 0 0) 0x7f689c072860 con 0x7f689c073f20 2024-04-26T23:44:01.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f6899600640 1 -- 172.21.15.137:0/2227570398 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6880003530 con 0x7f689c073f20 2024-04-26T23:44:01.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f6899600640 1 -- 172.21.15.137:0/2227570398 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3859622631 0 0) 0x7f6880003530 con 0x7f689c073f20 2024-04-26T23:44:01.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f6899600640 1 -- 172.21.15.137:0/2227570398 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f689c0afbc0 msgr2=0x7f689c15df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:01.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f6899600640 1 --2- 172.21.15.137:0/2227570398 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f689c0afbc0 0x7f689c15df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f6899600640 1 -- 172.21.15.137:0/2227570398 >> v2:172.21.15.170:3300/0 conn(0x7f689c0affa0 msgr2=0x7f689c0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:01.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f6899600640 1 --2- 172.21.15.137:0/2227570398 >> v2:172.21.15.170:3300/0 conn(0x7f689c0affa0 0x7f689c0ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f6899600640 1 -- 172.21.15.137:0/2227570398 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689c072de0 con 0x7f689c073f20 2024-04-26T23:44:01.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f689b400640 1 --2- 172.21.15.137:0/2227570398 >> v2:172.21.15.170:3300/0 conn(0x7f689c0affa0 0x7f689c0ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:44:01.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f6899600640 1 -- 172.21.15.137:0/2227570398 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f6888001680 con 0x7f689c073f20 2024-04-26T23:44:01.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f6899600640 1 -- 172.21.15.137:0/2227570398 >> v1:172.21.15.137:6789/0 conn(0x7f689c073f20 legacy=0x7f689c0735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f6899600640 1 --2- 172.21.15.137:0/2227570398 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f689c0afbc0 0x7f68800039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f6899600640 1 --2- 172.21.15.137:0/2227570398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6880003f40 0x7f6880004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f6899600640 1 --2- 172.21.15.137:0/2227570398 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6880004d50 0x7f68800051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f6899600640 1 -- 172.21.15.137:0/2227570398 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f689c0743b0 con 0x7f6880003f40 2024-04-26T23:44:01.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f6899600640 1 -- 172.21.15.137:0/2227570398 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f689c072b00 con 0x7f6880004d50 2024-04-26T23:44:01.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f6899600640 1 -- 172.21.15.137:0/2227570398 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f688000b9d0 con 0x7f689c0afbc0 2024-04-26T23:44:01.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f689a000640 1 --2- 172.21.15.137:0/2227570398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6880003f40 0x7f6880004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f689aa00640 1 --2- 172.21.15.137:0/2227570398 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f689c0afbc0 0x7f68800039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f689b400640 1 --2- 172.21.15.137:0/2227570398 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6880004d50 0x7f68800051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f689aa00640 1 -- 172.21.15.137:0/2227570398 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6880004d50 msgr2=0x7f68800051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:01.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f689aa00640 1 --2- 172.21.15.137:0/2227570398 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6880004d50 0x7f68800051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f689aa00640 1 -- 172.21.15.137:0/2227570398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6880003f40 msgr2=0x7f6880004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:01.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f689aa00640 1 --2- 172.21.15.137:0/2227570398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6880003f40 0x7f6880004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f689aa00640 1 -- 172.21.15.137:0/2227570398 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6880003530 con 0x7f689c0afbc0 2024-04-26T23:44:01.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.950+0000 7f689a000640 1 --2- 172.21.15.137:0/2227570398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6880003f40 0x7f6880004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:44:01.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.954+0000 7f689aa00640 1 --2- 172.21.15.137:0/2227570398 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f689c0afbc0 0x7f68800039c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f688c009ae0 tx=0x7f688c01cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da7391a6c8f3ffd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:01.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.954+0000 7f6899600640 1 -- 172.21.15.137:0/2227570398 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c0b2070 con 0x7f689c0afbc0 2024-04-26T23:44:01.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.954+0000 7f6899600640 1 -- 172.21.15.137:0/2227570398 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f688c0a56a0 con 0x7f689c0afbc0 2024-04-26T23:44:01.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.954+0000 7f6899600640 1 -- 172.21.15.137:0/2227570398 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c0096b0 con 0x7f689c0afbc0 2024-04-26T23:44:01.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.954+0000 7f68a1800640 1 -- 172.21.15.137:0/2227570398 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f689c0afbc0 msgr2=0x7f68800039c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.954+0000 7f68a1800640 1 --2- 172.21.15.137:0/2227570398 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f689c0afbc0 0x7f68800039c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f688c009ae0 tx=0x7f688c01cab0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.954+0000 7f689b400640 1 -- 172.21.15.137:0/2227570398 reap_dead start 2024-04-26T23:44:01.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.954+0000 7f68a1800640 1 -- 172.21.15.137:0/2227570398 shutdown_connections 2024-04-26T23:44:01.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.954+0000 7f68a1800640 1 -- 172.21.15.137:0/2227570398 >> 172.21.15.137:0/2227570398 conn(0x7f689c06c800 msgr2=0x7f689c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:01.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.954+0000 7f68a1800640 1 -- 172.21.15.137:0/2227570398 shutdown_connections 2024-04-26T23:44:01.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.954+0000 7f68a1800640 1 -- 172.21.15.137:0/2227570398 wait complete. 2024-04-26T23:44:01.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.954+0000 7f68a1800640 1 Processor -- start 2024-04-26T23:44:01.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.954+0000 7f68a1800640 1 -- start start 2024-04-26T23:44:01.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.958+0000 7f68a1800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f689c0afbc0 0x7f689c1570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.958+0000 7f68a1800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f689c153990 0x7f689c1493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.958+0000 7f68a1800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f689c152ca0 0x7f689c146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.958+0000 7f68a1800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f689c0ce8f0 con 0x7f689c0afbc0 2024-04-26T23:44:01.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.958+0000 7f68a1800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f689c0d0850 con 0x7f689c153990 2024-04-26T23:44:01.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.958+0000 7f68a1800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f689c0cea70 con 0x7f689c152ca0 2024-04-26T23:44:01.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.958+0000 7f689aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f689c0afbc0 0x7f689c1570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.958+0000 7f689aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f689c0afbc0 0x7f689c1570d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41770/0 (socket says 172.21.15.137:41770) 2024-04-26T23:44:01.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.958+0000 7f689aa00640 1 -- 172.21.15.137:0/2107218029 learned_addr learned my addr 172.21.15.137:0/2107218029 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:01.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.958+0000 7f689aa00640 1 -- 172.21.15.137:0/2107218029 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f689c152ca0 msgr2=0x7f689c146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.958+0000 7f689aa00640 1 --2- 172.21.15.137:0/2107218029 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f689c152ca0 0x7f689c146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.958+0000 7f689aa00640 1 -- 172.21.15.137:0/2107218029 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f689c153990 msgr2=0x7f689c1493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.958+0000 7f689aa00640 1 --2- 172.21.15.137:0/2107218029 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f689c153990 0x7f689c1493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.958+0000 7f689aa00640 1 -- 172.21.15.137:0/2107218029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689c153e10 con 0x7f689c0afbc0 2024-04-26T23:44:01.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.958+0000 7f689aa00640 1 --2- 172.21.15.137:0/2107218029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f689c0afbc0 0x7f689c1570d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f688c009ae0 tx=0x7f6880005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:01.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.958+0000 7f6892a00640 1 -- 172.21.15.137:0/2107218029 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c0bf070 con 0x7f689c0afbc0 2024-04-26T23:44:01.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.958+0000 7f6892a00640 1 -- 172.21.15.137:0/2107218029 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f688c004030 con 0x7f689c0afbc0 2024-04-26T23:44:01.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.958+0000 7f6892a00640 1 -- 172.21.15.137:0/2107218029 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c0b2040 con 0x7f689c0afbc0 2024-04-26T23:44:01.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.958+0000 7f68a1800640 1 -- 172.21.15.137:0/2107218029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f689c151c00 con 0x7f689c0afbc0 2024-04-26T23:44:01.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.958+0000 7f68a1800640 1 -- 172.21.15.137:0/2107218029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f689c1521c0 con 0x7f689c0afbc0 2024-04-26T23:44:01.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.958+0000 7f68a1800640 1 -- 172.21.15.137:0/2107218029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f689c06a410 con 0x7f689c0afbc0 2024-04-26T23:44:01.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.958+0000 7f6892a00640 1 -- 172.21.15.137:0/2107218029 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f688c0c2070 con 0x7f689c0afbc0 2024-04-26T23:44:01.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.962+0000 7f6892a00640 1 --2- 172.21.15.137:0/2107218029 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f687c068380 0x7f687c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.962+0000 7f6892a00640 1 -- 172.21.15.137:0/2107218029 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5752+0+0 (secure 0 0 0) 0x7f688c1206a0 con 0x7f689c0afbc0 2024-04-26T23:44:01.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.962+0000 7f689a000640 1 --2- 172.21.15.137:0/2107218029 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f687c068380 0x7f687c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.962+0000 7f689a000640 1 --2- 172.21.15.137:0/2107218029 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f687c068380 0x7f687c06a840 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6888000c10 tx=0x7f6888001c40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:01.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:01.966+0000 7f6892a00640 1 -- 172.21.15.137:0/2107218029 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f689c153e10 con 0x7f689c0afbc0 2024-04-26T23:44:02.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.122+0000 7f68a1800640 1 -- 172.21.15.137:0/2107218029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f689c160870 con 0x7f689c0afbc0 2024-04-26T23:44:02.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.122+0000 7f6892a00640 1 -- 172.21.15.137:0/2107218029 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) ==== 104+0+11 (secure 0 0 0) 0x7f688c0167c0 con 0x7f689c0afbc0 2024-04-26T23:44:02.129 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.122+0000 7f68a1800640 1 -- 172.21.15.137:0/2107218029 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f687c068380 msgr2=0x7f687c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.122+0000 7f68a1800640 1 --2- 172.21.15.137:0/2107218029 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f687c068380 0x7f687c06a840 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6888000c10 tx=0x7f6888001c40 comp rx=0 tx=0).stop 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.122+0000 7f68a1800640 1 -- 172.21.15.137:0/2107218029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f689c0afbc0 msgr2=0x7f689c1570d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.122+0000 7f68a1800640 1 --2- 172.21.15.137:0/2107218029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f689c0afbc0 0x7f689c1570d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f688c009ae0 tx=0x7f6880005840 comp rx=0 tx=0).stop 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.122+0000 7f68a1800640 1 -- 172.21.15.137:0/2107218029 shutdown_connections 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.122+0000 7f68a1800640 1 --2- 172.21.15.137:0/2107218029 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f687c068380 0x7f687c06a840 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.122+0000 7f68a1800640 1 --2- 172.21.15.137:0/2107218029 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f689c152ca0 0x7f689c146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.122+0000 7f68a1800640 1 --2- 172.21.15.137:0/2107218029 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f689c153990 0x7f689c1493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.122+0000 7f68a1800640 1 --2- 172.21.15.137:0/2107218029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f689c0afbc0 0x7f689c1570d0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.122+0000 7f68a1800640 1 -- 172.21.15.137:0/2107218029 >> 172.21.15.137:0/2107218029 conn(0x7f689c06c800 msgr2=0x7f689c06f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.122+0000 7f68a1800640 1 -- 172.21.15.137:0/2107218029 shutdown_connections 2024-04-26T23:44:02.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.122+0000 7f68a1800640 1 -- 172.21.15.137:0/2107218029 wait complete. 2024-04-26T23:44:02.149 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:44:02.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.282+0000 7f4f53000640 1 Processor -- start 2024-04-26T23:44:02.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.282+0000 7f4f53000640 1 -- start start 2024-04-26T23:44:02.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.282+0000 7f4f53000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4f4c159560 0x7f4f4c0b5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:02.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.282+0000 7f4f53000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f4c0b5c50 con 0x7f4f4c0b57d0 2024-04-26T23:44:02.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.282+0000 7f4f53000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f4c0b5f30 con 0x7f4f4c073040 2024-04-26T23:44:02.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.282+0000 7f4f53000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f4f4c0b6210 con 0x7f4f4c159560 2024-04-26T23:44:02.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.282+0000 7f4f4b400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4f4c0b57d0 0x7f4f4c072930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:37544/0 (socket says 172.21.15.137:37544) 2024-04-26T23:44:02.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.282+0000 7f4f4b400640 1 -- 172.21.15.137:0/2683467405 learned_addr learned my addr 172.21.15.137:0/2683467405 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:02.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.282+0000 7f4f4be00640 1 --2- 172.21.15.137:0/2683467405 >> v2:172.21.15.170:3300/0 conn(0x7f4f4c159560 0x7f4f4c0b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:02.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.282+0000 7f4f4aa00640 1 -- 172.21.15.137:0/2683467405 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2443674455 0 0) 0x7f4f4c0b5c50 con 0x7f4f4c0b57d0 2024-04-26T23:44:02.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.282+0000 7f4f4aa00640 1 -- 172.21.15.137:0/2683467405 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f30003530 con 0x7f4f4c0b57d0 2024-04-26T23:44:02.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.282+0000 7f4f4aa00640 1 -- 172.21.15.137:0/2683467405 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3835093349 0 0) 0x7f4f4c0b5f30 con 0x7f4f4c073040 2024-04-26T23:44:02.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.282+0000 7f4f4aa00640 1 -- 172.21.15.137:0/2683467405 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f4c0b5c50 con 0x7f4f4c073040 2024-04-26T23:44:02.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.282+0000 7f4f4be00640 1 -- 172.21.15.137:0/2683467405 >> v1:172.21.15.170:6789/0 conn(0x7f4f4c073040 legacy=0x7f4f4c0afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.282+0000 7f4f4be00640 1 -- 172.21.15.137:0/2683467405 >> v1:172.21.15.137:6789/0 conn(0x7f4f4c0b57d0 legacy=0x7f4f4c072930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.282+0000 7f4f4aa00640 1 -- 172.21.15.137:0/2683467405 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 684290046 0 0) 0x7f4f30003530 con 0x7f4f4c0b57d0 2024-04-26T23:44:02.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.282+0000 7f4f4be00640 1 -- 172.21.15.137:0/2683467405 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4c0af760 con 0x7f4f4c159560 2024-04-26T23:44:02.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.286+0000 7f4f4be00640 1 --2- 172.21.15.137:0/2683467405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f4c159560 0x7f4f4c0b5290 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0097c0 tx=0x7f4f3c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba5ff797fb73264d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:02.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.286+0000 7f4f4aa00640 1 -- 172.21.15.137:0/2683467405 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c0b0070 con 0x7f4f4c159560 2024-04-26T23:44:02.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.286+0000 7f4f4aa00640 1 -- 172.21.15.137:0/2683467405 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f3c0ab400 con 0x7f4f4c159560 2024-04-26T23:44:02.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.286+0000 7f4f4aa00640 1 -- 172.21.15.137:0/2683467405 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f38001680 con 0x7f4f4c159560 2024-04-26T23:44:02.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.286+0000 7f4f53000640 1 -- 172.21.15.137:0/2683467405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f4c159560 msgr2=0x7f4f4c0b5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.286+0000 7f4f53000640 1 --2- 172.21.15.137:0/2683467405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f4c159560 0x7f4f4c0b5290 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0097c0 tx=0x7f4f3c01c3c0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.286+0000 7f4f53000640 1 -- 172.21.15.137:0/2683467405 shutdown_connections 2024-04-26T23:44:02.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.286+0000 7f4f53000640 1 --2- 172.21.15.137:0/2683467405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f4c159560 0x7f4f4c0b5290 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.286+0000 7f4f53000640 1 -- 172.21.15.137:0/2683467405 >> 172.21.15.137:0/2683467405 conn(0x7f4f4c0b3370 msgr2=0x7f4f4c0b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:02.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.286+0000 7f4f53000640 1 -- 172.21.15.137:0/2683467405 shutdown_connections 2024-04-26T23:44:02.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.286+0000 7f4f53000640 1 -- 172.21.15.137:0/2683467405 wait complete. 2024-04-26T23:44:02.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f53000640 1 Processor -- start 2024-04-26T23:44:02.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f53000640 1 -- start start 2024-04-26T23:44:02.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f53000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f4c073040 0x7f4f4c13cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:02.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f53000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f4c0b57d0 0x7f4f4c15dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:02.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f53000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f4c159560 0x7f4f4c14f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:02.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f53000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4c0b0d20 con 0x7f4f4c0b57d0 2024-04-26T23:44:02.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f53000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4c0b0ba0 con 0x7f4f4c159560 2024-04-26T23:44:02.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f53000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4f4c0b0ea0 con 0x7f4f4c073040 2024-04-26T23:44:02.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f4b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f4c0b57d0 0x7f4f4c15dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:02.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f4b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f4c0b57d0 0x7f4f4c15dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41782/0 (socket says 172.21.15.137:41782) 2024-04-26T23:44:02.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f4b400640 1 -- 172.21.15.137:0/1762686550 learned_addr learned my addr 172.21.15.137:0/1762686550 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:02.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f4be00640 1 --2- 172.21.15.137:0/1762686550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f4c073040 0x7f4f4c13cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:02.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f51000640 1 --2- 172.21.15.137:0/1762686550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f4c159560 0x7f4f4c14f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:02.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f4b400640 1 -- 172.21.15.137:0/1762686550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f4c073040 msgr2=0x7f4f4c13cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f4b400640 1 --2- 172.21.15.137:0/1762686550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f4c073040 0x7f4f4c13cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f4b400640 1 -- 172.21.15.137:0/1762686550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f4c159560 msgr2=0x7f4f4c14f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f4b400640 1 --2- 172.21.15.137:0/1762686550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f4c159560 0x7f4f4c14f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f4b400640 1 -- 172.21.15.137:0/1762686550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4c15cf60 con 0x7f4f4c0b57d0 2024-04-26T23:44:02.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f4b400640 1 --2- 172.21.15.137:0/1762686550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f4c0b57d0 0x7f4f4c15dd20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4f3800c780 tx=0x7f4f3800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:02.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f43e00640 1 -- 172.21.15.137:0/1762686550 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f38017070 con 0x7f4f4c0b57d0 2024-04-26T23:44:02.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f43e00640 1 -- 172.21.15.137:0/1762686550 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f38005b00 con 0x7f4f4c0b57d0 2024-04-26T23:44:02.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f53000640 1 -- 172.21.15.137:0/1762686550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f4c15bec0 con 0x7f4f4c0b57d0 2024-04-26T23:44:02.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f43e00640 1 -- 172.21.15.137:0/1762686550 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f38007070 con 0x7f4f4c0b57d0 2024-04-26T23:44:02.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f53000640 1 -- 172.21.15.137:0/1762686550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f4c15c760 con 0x7f4f4c0b57d0 2024-04-26T23:44:02.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.290+0000 7f4f53000640 1 -- 172.21.15.137:0/1762686550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f4c15c2b0 con 0x7f4f4c0b57d0 2024-04-26T23:44:02.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.294+0000 7f4f43e00640 1 -- 172.21.15.137:0/1762686550 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4f3801a070 con 0x7f4f4c0b57d0 2024-04-26T23:44:02.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.294+0000 7f4f43e00640 1 --2- 172.21.15.137:0/1762686550 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4f2c0683b0 0x7f4f2c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:02.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.294+0000 7f4f43e00640 1 -- 172.21.15.137:0/1762686550 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5752+0+0 (secure 0 0 0) 0x7f4f38085ec0 con 0x7f4f4c0b57d0 2024-04-26T23:44:02.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.294+0000 7f4f4be00640 1 --2- 172.21.15.137:0/1762686550 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4f2c0683b0 0x7f4f2c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:02.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.294+0000 7f4f4be00640 1 --2- 172.21.15.137:0/1762686550 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4f2c0683b0 0x7f4f2c06a870 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0ad000 tx=0x7f4f3c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:02.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.298+0000 7f4f43e00640 1 -- 172.21.15.137:0/1762686550 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4f38055de0 con 0x7f4f4c0b57d0 2024-04-26T23:44:02.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.454+0000 7f4f53000640 1 -- 172.21.15.137:0/1762686550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4f4c06ed10 con 0x7f4f4c0b57d0 2024-04-26T23:44:02.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.454+0000 7f4f43e00640 1 -- 172.21.15.137:0/1762686550 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) ==== 100+0+11 (secure 0 0 0) 0x7f4f3805a0e0 con 0x7f4f4c0b57d0 2024-04-26T23:44:02.463 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:44:02.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.458+0000 7f4f53000640 1 -- 172.21.15.137:0/1762686550 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4f2c0683b0 msgr2=0x7f4f2c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.458+0000 7f4f53000640 1 --2- 172.21.15.137:0/1762686550 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4f2c0683b0 0x7f4f2c06a870 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0ad000 tx=0x7f4f3c008040 comp rx=0 tx=0).stop 2024-04-26T23:44:02.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.458+0000 7f4f53000640 1 -- 172.21.15.137:0/1762686550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f4c0b57d0 msgr2=0x7f4f4c15dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.458+0000 7f4f53000640 1 --2- 172.21.15.137:0/1762686550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f4c0b57d0 0x7f4f4c15dd20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4f3800c780 tx=0x7f4f3800cc40 comp rx=0 tx=0).stop 2024-04-26T23:44:02.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.458+0000 7f4f53000640 1 -- 172.21.15.137:0/1762686550 shutdown_connections 2024-04-26T23:44:02.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.458+0000 7f4f53000640 1 --2- 172.21.15.137:0/1762686550 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4f2c0683b0 0x7f4f2c06a870 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.458+0000 7f4f53000640 1 --2- 172.21.15.137:0/1762686550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f4c0b57d0 0x7f4f4c15dd20 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.458+0000 7f4f53000640 1 --2- 172.21.15.137:0/1762686550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f4c159560 0x7f4f4c14f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.458+0000 7f4f53000640 1 --2- 172.21.15.137:0/1762686550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f4c073040 0x7f4f4c13cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.458+0000 7f4f53000640 1 -- 172.21.15.137:0/1762686550 >> 172.21.15.137:0/1762686550 conn(0x7f4f4c0b3370 msgr2=0x7f4f4c151850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:02.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.458+0000 7f4f53000640 1 -- 172.21.15.137:0/1762686550 shutdown_connections 2024-04-26T23:44:02.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.458+0000 7f4f53000640 1 -- 172.21.15.137:0/1762686550 wait complete. 2024-04-26T23:44:02.484 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:44:02.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.614+0000 7f97a3800640 1 Processor -- start 2024-04-26T23:44:02.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.614+0000 7f97a3800640 1 -- start start 2024-04-26T23:44:02.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.614+0000 7f97a3800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f979c0b5080 0x7f979c0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:02.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.614+0000 7f97a3800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f979c072980 0x7f979c072e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:02.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.614+0000 7f97a3800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f979c0cfef0 con 0x7f979c0725a0 2024-04-26T23:44:02.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.614+0000 7f97a3800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f979c0cddc0 con 0x7f979c0b5080 2024-04-26T23:44:02.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.614+0000 7f97a3800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f979c0d01b0 con 0x7f979c072980 2024-04-26T23:44:02.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.614+0000 7f979be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f979c0b5080 0x7f979c0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:02.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.614+0000 7f979be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f979c0b5080 0x7f979c0cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41788/0 (socket says 172.21.15.137:41788) 2024-04-26T23:44:02.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.614+0000 7f979be00640 1 -- 172.21.15.137:0/2477591052 learned_addr learned my addr 172.21.15.137:0/2477591052 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:02.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.614+0000 7f97a0e00640 1 --1- 172.21.15.137:0/2477591052 >> v1:172.21.15.137:6789/0 conn(0x7f979c0725a0 0x7f979c073f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:37550/0 (socket says 172.21.15.137:37550) 2024-04-26T23:44:02.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.618+0000 7f979be00640 1 -- 172.21.15.137:0/2477591052 >> v2:172.21.15.170:3300/0 conn(0x7f979c072980 msgr2=0x7f979c072e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:02.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.618+0000 7f979be00640 1 --2- 172.21.15.137:0/2477591052 >> v2:172.21.15.170:3300/0 conn(0x7f979c072980 0x7f979c072e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.618+0000 7f979be00640 1 -- 172.21.15.137:0/2477591052 >> v1:172.21.15.137:6789/0 conn(0x7f979c0725a0 legacy=0x7f979c073f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.618+0000 7f979be00640 1 -- 172.21.15.137:0/2477591052 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979c0d0490 con 0x7f979c0b5080 2024-04-26T23:44:02.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.618+0000 7f979be00640 1 --2- 172.21.15.137:0/2477591052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f979c0b5080 0x7f979c0cd770 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f97880098a0 tx=0x7f978801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e01a5bec44c6fb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:02.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.618+0000 7f979b400640 1 -- 172.21.15.137:0/2477591052 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97880aa430 con 0x7f979c0b5080 2024-04-26T23:44:02.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.618+0000 7f979b400640 1 -- 172.21.15.137:0/2477591052 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97880af070 con 0x7f979c0b5080 2024-04-26T23:44:02.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.618+0000 7f979b400640 1 -- 172.21.15.137:0/2477591052 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97880aa7f0 con 0x7f979c0b5080 2024-04-26T23:44:02.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.618+0000 7f97a3800640 1 -- 172.21.15.137:0/2477591052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f979c0b5080 msgr2=0x7f979c0cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.618+0000 7f97a3800640 1 --2- 172.21.15.137:0/2477591052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f979c0b5080 0x7f979c0cd770 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f97880098a0 tx=0x7f978801c4d0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a3800640 1 -- 172.21.15.137:0/2477591052 shutdown_connections 2024-04-26T23:44:02.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a3800640 1 --2- 172.21.15.137:0/2477591052 >> v2:172.21.15.170:3300/0 conn(0x7f979c072980 0x7f979c072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a3800640 1 --2- 172.21.15.137:0/2477591052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f979c0b5080 0x7f979c0cd770 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a3800640 1 -- 172.21.15.137:0/2477591052 >> 172.21.15.137:0/2477591052 conn(0x7f979c06c5d0 msgr2=0x7f979c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:02.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a3800640 1 -- 172.21.15.137:0/2477591052 shutdown_connections 2024-04-26T23:44:02.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a3800640 1 -- 172.21.15.137:0/2477591052 wait complete. 2024-04-26T23:44:02.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a3800640 1 Processor -- start 2024-04-26T23:44:02.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a3800640 1 -- start start 2024-04-26T23:44:02.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a3800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f979c0725a0 0x7f979c15d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:02.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a3800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f979c072980 0x7f979c15b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:02.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a3800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f979c0b5080 0x7f979c15e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:02.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a3800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f979c1684e0 con 0x7f979c0b5080 2024-04-26T23:44:02.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a3800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f979c168360 con 0x7f979c0725a0 2024-04-26T23:44:02.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a3800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f979c168660 con 0x7f979c072980 2024-04-26T23:44:02.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a1800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f979c0b5080 0x7f979c15e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:02.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a1800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f979c0b5080 0x7f979c15e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41794/0 (socket says 172.21.15.137:41794) 2024-04-26T23:44:02.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a1800640 1 -- 172.21.15.137:0/3297497250 learned_addr learned my addr 172.21.15.137:0/3297497250 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:02.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f979be00640 1 --2- 172.21.15.137:0/3297497250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f979c072980 0x7f979c15b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:02.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a0e00640 1 --2- 172.21.15.137:0/3297497250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f979c0725a0 0x7f979c15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:02.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a1800640 1 -- 172.21.15.137:0/3297497250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f979c072980 msgr2=0x7f979c15b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a1800640 1 --2- 172.21.15.137:0/3297497250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f979c072980 0x7f979c15b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a1800640 1 -- 172.21.15.137:0/3297497250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f979c0725a0 msgr2=0x7f979c15d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a1800640 1 --2- 172.21.15.137:0/3297497250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f979c0725a0 0x7f979c15d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.622+0000 7f97a1800640 1 -- 172.21.15.137:0/3297497250 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979c15c5d0 con 0x7f979c0b5080 2024-04-26T23:44:02.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.626+0000 7f97a1800640 1 --2- 172.21.15.137:0/3297497250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f979c0b5080 0x7f979c15e170 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f979400b430 tx=0x7f979400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:02.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.626+0000 7f9798c00640 1 -- 172.21.15.137:0/3297497250 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794015020 con 0x7f979c0b5080 2024-04-26T23:44:02.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.626+0000 7f9798c00640 1 -- 172.21.15.137:0/3297497250 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9794011830 con 0x7f979c0b5080 2024-04-26T23:44:02.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.626+0000 7f97a3800640 1 -- 172.21.15.137:0/3297497250 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f979c15c8b0 con 0x7f979c0b5080 2024-04-26T23:44:02.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.626+0000 7f9798c00640 1 -- 172.21.15.137:0/3297497250 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794011c20 con 0x7f979c0b5080 2024-04-26T23:44:02.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.626+0000 7f97a3800640 1 -- 172.21.15.137:0/3297497250 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f979c15ce70 con 0x7f979c0b5080 2024-04-26T23:44:02.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.626+0000 7f97a3800640 1 -- 172.21.15.137:0/3297497250 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f979c06a4b0 con 0x7f979c0b5080 2024-04-26T23:44:02.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.626+0000 7f9798c00640 1 -- 172.21.15.137:0/3297497250 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9794018020 con 0x7f979c0b5080 2024-04-26T23:44:02.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.626+0000 7f9798c00640 1 --2- 172.21.15.137:0/3297497250 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f977c068380 0x7f977c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:02.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.626+0000 7f9798c00640 1 -- 172.21.15.137:0/3297497250 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5752+0+0 (secure 0 0 0) 0x7f9794086980 con 0x7f979c0b5080 2024-04-26T23:44:02.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.626+0000 7f97a0e00640 1 --2- 172.21.15.137:0/3297497250 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f977c068380 0x7f977c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:02.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.626+0000 7f97a0e00640 1 --2- 172.21.15.137:0/3297497250 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f977c068380 0x7f977c06a840 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f978c0012f0 tx=0x7f978c001640 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:02.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.630+0000 7f9798c00640 1 -- 172.21.15.137:0/3297497250 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f979401f020 con 0x7f979c0b5080 2024-04-26T23:44:02.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.802+0000 7f97a3800640 1 -- 172.21.15.137:0/3297497250 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f979c072380 con 0x7f979c0b5080 2024-04-26T23:44:02.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.806+0000 7f9798c00640 1 -- 172.21.15.137:0/3297497250 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v46) ==== 80+0+56 (secure 0 0 0) 0x7f9794056820 con 0x7f979c0b5080 2024-04-26T23:44:02.812 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.1:0/268105340 2024-04-27T00:43:44.368539+0000 2024-04-26T23:44:02.812 INFO:teuthology.orchestra.run.smithi137.stderr:listed 1 entries 2024-04-26T23:44:02.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.806+0000 7f97a3800640 1 -- 172.21.15.137:0/3297497250 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f977c068380 msgr2=0x7f977c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.806+0000 7f97a3800640 1 --2- 172.21.15.137:0/3297497250 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f977c068380 0x7f977c06a840 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f978c0012f0 tx=0x7f978c001640 comp rx=0 tx=0).stop 2024-04-26T23:44:02.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.806+0000 7f97a3800640 1 -- 172.21.15.137:0/3297497250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f979c0b5080 msgr2=0x7f979c15e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.806+0000 7f97a3800640 1 --2- 172.21.15.137:0/3297497250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f979c0b5080 0x7f979c15e170 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f979400b430 tx=0x7f979400b8f0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.806+0000 7f97a3800640 1 -- 172.21.15.137:0/3297497250 shutdown_connections 2024-04-26T23:44:02.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.806+0000 7f97a3800640 1 --2- 172.21.15.137:0/3297497250 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f977c068380 0x7f977c06a840 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.806+0000 7f97a3800640 1 --2- 172.21.15.137:0/3297497250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f979c0b5080 0x7f979c15e170 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.806+0000 7f97a3800640 1 --2- 172.21.15.137:0/3297497250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f979c072980 0x7f979c15b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.806+0000 7f97a3800640 1 --2- 172.21.15.137:0/3297497250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f979c0725a0 0x7f979c15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.806+0000 7f97a3800640 1 -- 172.21.15.137:0/3297497250 >> 172.21.15.137:0/3297497250 conn(0x7f979c06c5d0 msgr2=0x7f979c140660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:02.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.806+0000 7f97a3800640 1 -- 172.21.15.137:0/3297497250 shutdown_connections 2024-04-26T23:44:02.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:02.806+0000 7f97a3800640 1 -- 172.21.15.137:0/3297497250 wait complete. 2024-04-26T23:44:02.833 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi137.front.sepia.ceph.com... 2024-04-26T23:44:02.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:02.833 DEBUG:teuthology.orchestra.run.smithi137:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-26T23:44:02.851 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:ceph-fuse[40665]: fuse finished with error 0 and tester_r 0 2024-04-26T23:44:02.854 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T23:44:02.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:02.854 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T23:44:02.913 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:44:02.913 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:44:02.913 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:44:02.923 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:44:02.923 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:44:02.973 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:44:03.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.102+0000 7fdd56800640 1 Processor -- start 2024-04-26T23:44:03.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.102+0000 7fdd56800640 1 -- start start 2024-04-26T23:44:03.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.102+0000 7fdd56800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fdd500ce3e0 0x7fdd50073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:03.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.102+0000 7fdd56800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdd5015de80 0x7fdd500d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:03.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.102+0000 7fdd56800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd50073010 con 0x7fdd500ce7c0 2024-04-26T23:44:03.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.102+0000 7fdd56800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fdd500cef90 con 0x7fdd5015de80 2024-04-26T23:44:03.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.102+0000 7fdd56800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fdd50073280 con 0x7fdd500ce3e0 2024-04-26T23:44:03.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.102+0000 7fdd4ea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdd5015de80 0x7fdd500d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:03.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.102+0000 7fdd4ea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdd5015de80 0x7fdd500d04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41798/0 (socket says 172.21.15.137:41798) 2024-04-26T23:44:03.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.102+0000 7fdd4ea00640 1 -- 172.21.15.137:0/590890019 learned_addr learned my addr 172.21.15.137:0/590890019 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:03.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.102+0000 7fdd4f400640 1 --2- 172.21.15.137:0/590890019 >> v2:172.21.15.170:3300/0 conn(0x7fdd500ce3e0 0x7fdd50073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:03.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.102+0000 7fdd4ea00640 1 -- 172.21.15.137:0/590890019 >> v2:172.21.15.170:3300/0 conn(0x7fdd500ce3e0 msgr2=0x7fdd50073d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:03.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.102+0000 7fdd4ea00640 1 --2- 172.21.15.137:0/590890019 >> v2:172.21.15.170:3300/0 conn(0x7fdd500ce3e0 0x7fdd50073d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.102+0000 7fdd4ea00640 1 -- 172.21.15.137:0/590890019 >> v1:172.21.15.170:6789/0 conn(0x7fdd500ce7c0 legacy=0x7fdd50146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:03.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.102+0000 7fdd4ea00640 1 -- 172.21.15.137:0/590890019 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd50073560 con 0x7fdd5015de80 2024-04-26T23:44:03.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.102+0000 7fdd4f400640 1 --2- 172.21.15.137:0/590890019 >> v2:172.21.15.170:3300/0 conn(0x7fdd500ce3e0 0x7fdd50073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:03.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.106+0000 7fdd4ea00640 1 --2- 172.21.15.137:0/590890019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd5015de80 0x7fdd500d04e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009870 tx=0x7fdd3c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607b7ca5947c638d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:03.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.106+0000 7fdd4e000640 1 -- 172.21.15.137:0/590890019 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0aa430 con 0x7fdd5015de80 2024-04-26T23:44:03.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.106+0000 7fdd4e000640 1 -- 172.21.15.137:0/590890019 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd3c0af070 con 0x7fdd5015de80 2024-04-26T23:44:03.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.106+0000 7fdd4e000640 1 -- 172.21.15.137:0/590890019 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0aa7f0 con 0x7fdd5015de80 2024-04-26T23:44:03.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.106+0000 7fdd56800640 1 -- 172.21.15.137:0/590890019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd5015de80 msgr2=0x7fdd500d04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:03.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.106+0000 7fdd56800640 1 --2- 172.21.15.137:0/590890019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd5015de80 0x7fdd500d04e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009870 tx=0x7fdd3c01c4b0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.106+0000 7fdd56800640 1 -- 172.21.15.137:0/590890019 shutdown_connections 2024-04-26T23:44:03.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.106+0000 7fdd56800640 1 --2- 172.21.15.137:0/590890019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd5015de80 0x7fdd500d04e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.106+0000 7fdd56800640 1 --2- 172.21.15.137:0/590890019 >> v2:172.21.15.170:3300/0 conn(0x7fdd500ce3e0 0x7fdd50073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.106+0000 7fdd56800640 1 -- 172.21.15.137:0/590890019 >> 172.21.15.137:0/590890019 conn(0x7fdd5006c5d0 msgr2=0x7fdd5006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:03.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.106+0000 7fdd56800640 1 -- 172.21.15.137:0/590890019 shutdown_connections 2024-04-26T23:44:03.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.106+0000 7fdd56800640 1 -- 172.21.15.137:0/590890019 wait complete. 2024-04-26T23:44:03.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd56800640 1 Processor -- start 2024-04-26T23:44:03.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd56800640 1 -- start start 2024-04-26T23:44:03.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd56800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd500ce3e0 0x7fdd50145210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:03.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd56800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd500ce7c0 0x7fdd50139760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:03.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd56800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd5015de80 0x7fdd501417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:03.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd56800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdd50146aa0 con 0x7fdd500ce3e0 2024-04-26T23:44:03.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd56800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdd50146920 con 0x7fdd500ce7c0 2024-04-26T23:44:03.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd56800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdd5006ed10 con 0x7fdd5015de80 2024-04-26T23:44:03.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd4f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd500ce3e0 0x7fdd50145210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:03.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd4f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd500ce3e0 0x7fdd50145210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41800/0 (socket says 172.21.15.137:41800) 2024-04-26T23:44:03.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd4f400640 1 -- 172.21.15.137:0/3601574168 learned_addr learned my addr 172.21.15.137:0/3601574168 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:03.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd4f400640 1 -- 172.21.15.137:0/3601574168 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd5015de80 msgr2=0x7fdd501417e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:03.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd4ea00640 1 --2- 172.21.15.137:0/3601574168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd500ce7c0 0x7fdd50139760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:03.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd4f400640 1 --2- 172.21.15.137:0/3601574168 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd5015de80 0x7fdd501417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd4f400640 1 -- 172.21.15.137:0/3601574168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd500ce7c0 msgr2=0x7fdd50139760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:03.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd4f400640 1 --2- 172.21.15.137:0/3601574168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd500ce7c0 0x7fdd50139760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd4f400640 1 -- 172.21.15.137:0/3601574168 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd501400d0 con 0x7fdd500ce3e0 2024-04-26T23:44:03.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd4ea00640 1 --2- 172.21.15.137:0/3601574168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd500ce7c0 0x7fdd50139760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:03.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd4f400640 1 --2- 172.21.15.137:0/3601574168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd500ce3e0 0x7fdd50145210 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000cf60 tx=0x7fdd4000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:03.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd47400640 1 -- 172.21.15.137:0/3601574168 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4001a070 con 0x7fdd500ce3e0 2024-04-26T23:44:03.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd47400640 1 -- 172.21.15.137:0/3601574168 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd4000d840 con 0x7fdd500ce3e0 2024-04-26T23:44:03.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd47400640 1 -- 172.21.15.137:0/3601574168 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4000dc10 con 0x7fdd500ce3e0 2024-04-26T23:44:03.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd56800640 1 -- 172.21.15.137:0/3601574168 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd501425b0 con 0x7fdd500ce3e0 2024-04-26T23:44:03.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd56800640 1 -- 172.21.15.137:0/3601574168 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd50139ca0 con 0x7fdd500ce3e0 2024-04-26T23:44:03.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.110+0000 7fdd56800640 1 -- 172.21.15.137:0/3601574168 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd5006a4b0 con 0x7fdd500ce3e0 2024-04-26T23:44:03.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.114+0000 7fdd47400640 1 -- 172.21.15.137:0/3601574168 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdd4001d070 con 0x7fdd500ce3e0 2024-04-26T23:44:03.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.114+0000 7fdd47400640 1 --2- 172.21.15.137:0/3601574168 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdd30068380 0x7fdd3006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:03.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.114+0000 7fdd47400640 1 -- 172.21.15.137:0/3601574168 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5752+0+0 (secure 0 0 0) 0x7fdd40087230 con 0x7fdd500ce3e0 2024-04-26T23:44:03.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.114+0000 7fdd4ea00640 1 --2- 172.21.15.137:0/3601574168 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdd30068380 0x7fdd3006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:03.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.114+0000 7fdd4ea00640 1 --2- 172.21.15.137:0/3601574168 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdd30068380 0x7fdd3006a840 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0ae000 tx=0x7fdd3c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:03.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.118+0000 7fdd47400640 1 -- 172.21.15.137:0/3601574168 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdd400570d0 con 0x7fdd500ce3e0 2024-04-26T23:44:03.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.278+0000 7fdd56800640 1 -- 172.21.15.137:0/3601574168 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd50142e60 con 0x7fdd500ce3e0 2024-04-26T23:44:03.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.282+0000 7fdd47400640 1 -- 172.21.15.137:0/3601574168 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16720 (secure 0 0 0) 0x7fdd4005b3d0 con 0x7fdd500ce3e0 2024-04-26T23:44:03.288 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:03.288 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":46,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:43:45.365477+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:43:21.281556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T23:43:22.549121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/268105340":"2024-04-27T00:43:44.368539+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:44:03.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.282+0000 7fdd56800640 1 -- 172.21.15.137:0/3601574168 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdd30068380 msgr2=0x7fdd3006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:03.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.282+0000 7fdd56800640 1 --2- 172.21.15.137:0/3601574168 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdd30068380 0x7fdd3006a840 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0ae000 tx=0x7fdd3c008040 comp rx=0 tx=0).stop 2024-04-26T23:44:03.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.282+0000 7fdd56800640 1 -- 172.21.15.137:0/3601574168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd500ce3e0 msgr2=0x7fdd50145210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:03.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.282+0000 7fdd56800640 1 --2- 172.21.15.137:0/3601574168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd500ce3e0 0x7fdd50145210 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000cf60 tx=0x7fdd4000cf90 comp rx=0 tx=0).stop 2024-04-26T23:44:03.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.282+0000 7fdd56800640 1 -- 172.21.15.137:0/3601574168 shutdown_connections 2024-04-26T23:44:03.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.282+0000 7fdd56800640 1 --2- 172.21.15.137:0/3601574168 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdd30068380 0x7fdd3006a840 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.282+0000 7fdd56800640 1 --2- 172.21.15.137:0/3601574168 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd5015de80 0x7fdd501417e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.282+0000 7fdd56800640 1 --2- 172.21.15.137:0/3601574168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd500ce7c0 0x7fdd50139760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.282+0000 7fdd56800640 1 --2- 172.21.15.137:0/3601574168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd500ce3e0 0x7fdd50145210 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.282+0000 7fdd56800640 1 -- 172.21.15.137:0/3601574168 >> 172.21.15.137:0/3601574168 conn(0x7fdd5006c5d0 msgr2=0x7fdd5006f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:03.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.282+0000 7fdd56800640 1 -- 172.21.15.137:0/3601574168 shutdown_connections 2024-04-26T23:44:03.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.282+0000 7fdd56800640 1 -- 172.21.15.137:0/3601574168 wait complete. 2024-04-26T23:44:03.309 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:43:21.281556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:43:22.549121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:44:03.310 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:44:03.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.442+0000 7fb33ae00640 1 Processor -- start 2024-04-26T23:44:03.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.442+0000 7fb33ae00640 1 -- start start 2024-04-26T23:44:03.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.442+0000 7fb33ae00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb3340b54e0 0x7fb3340b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:03.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.442+0000 7fb33ae00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3340cffa0 con 0x7fb334160000 2024-04-26T23:44:03.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.442+0000 7fb33ae00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3340d0280 con 0x7fb3340cd710 2024-04-26T23:44:03.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.442+0000 7fb33ae00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb3340b3d90 con 0x7fb3340b54e0 2024-04-26T23:44:03.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.442+0000 7fb333e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb3340b54e0 0x7fb3340b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:03.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.442+0000 7fb338e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb334160000 0x7fb334144d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:37552/0 (socket says 172.21.15.137:37552) 2024-04-26T23:44:03.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.442+0000 7fb338e00640 1 -- 172.21.15.137:0/2238272506 learned_addr learned my addr 172.21.15.137:0/2238272506 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:03.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.442+0000 7fb333e00640 1 -- 172.21.15.137:0/2238272506 >> v1:172.21.15.170:6789/0 conn(0x7fb3340cd710 legacy=0x7fb33415f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:03.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.442+0000 7fb333e00640 1 -- 172.21.15.137:0/2238272506 >> v1:172.21.15.137:6789/0 conn(0x7fb334160000 legacy=0x7fb334144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:03.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.442+0000 7fb333e00640 1 -- 172.21.15.137:0/2238272506 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3340d0560 con 0x7fb3340b54e0 2024-04-26T23:44:03.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.442+0000 7fb332a00640 1 -- 172.21.15.137:0/2238272506 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1844759775 0 0) 0x7fb3340cffa0 con 0x7fb334160000 2024-04-26T23:44:03.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.446+0000 7fb333e00640 1 --2- 172.21.15.137:0/2238272506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3340b54e0 0x7fb3340b5ee0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb3240097f0 tx=0x7fb32401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5b250e1650e97f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:03.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.446+0000 7fb332a00640 1 -- 172.21.15.137:0/2238272506 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3240b0070 con 0x7fb3340b54e0 2024-04-26T23:44:03.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.446+0000 7fb332a00640 1 -- 172.21.15.137:0/2238272506 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3240ab600 con 0x7fb3340b54e0 2024-04-26T23:44:03.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.446+0000 7fb332a00640 1 -- 172.21.15.137:0/2238272506 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3240ab9d0 con 0x7fb3340b54e0 2024-04-26T23:44:03.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.446+0000 7fb33ae00640 1 -- 172.21.15.137:0/2238272506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3340b54e0 msgr2=0x7fb3340b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:03.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.446+0000 7fb33ae00640 1 --2- 172.21.15.137:0/2238272506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3340b54e0 0x7fb3340b5ee0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb3240097f0 tx=0x7fb32401c460 comp rx=0 tx=0).stop 2024-04-26T23:44:03.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.446+0000 7fb33ae00640 1 -- 172.21.15.137:0/2238272506 shutdown_connections 2024-04-26T23:44:03.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.446+0000 7fb33ae00640 1 --2- 172.21.15.137:0/2238272506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3340b54e0 0x7fb3340b5ee0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.446+0000 7fb33ae00640 1 -- 172.21.15.137:0/2238272506 >> 172.21.15.137:0/2238272506 conn(0x7fb33406c800 msgr2=0x7fb33406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:03.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.446+0000 7fb33ae00640 1 -- 172.21.15.137:0/2238272506 shutdown_connections 2024-04-26T23:44:03.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.446+0000 7fb33ae00640 1 -- 172.21.15.137:0/2238272506 wait complete. 2024-04-26T23:44:03.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb33ae00640 1 Processor -- start 2024-04-26T23:44:03.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb33ae00640 1 -- start start 2024-04-26T23:44:03.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb33ae00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3340b54e0 0x7fb33415d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:03.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb33ae00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3340cd710 0x7fb334144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:03.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb33ae00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb334160000 0x7fb33415ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:03.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb33ae00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb334073640 con 0x7fb3340cd710 2024-04-26T23:44:03.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb33ae00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb3340734c0 con 0x7fb334160000 2024-04-26T23:44:03.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb33ae00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb334145840 con 0x7fb3340b54e0 2024-04-26T23:44:03.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb333400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3340cd710 0x7fb334144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:03.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb333400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3340cd710 0x7fb334144550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41826/0 (socket says 172.21.15.137:41826) 2024-04-26T23:44:03.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb333400640 1 -- 172.21.15.137:0/3270150551 learned_addr learned my addr 172.21.15.137:0/3270150551 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:03.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb333e00640 1 --2- 172.21.15.137:0/3270150551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3340b54e0 0x7fb33415d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:03.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb338e00640 1 --2- 172.21.15.137:0/3270150551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb334160000 0x7fb33415ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:03.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb333400640 1 -- 172.21.15.137:0/3270150551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3340b54e0 msgr2=0x7fb33415d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:03.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb333400640 1 --2- 172.21.15.137:0/3270150551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3340b54e0 0x7fb33415d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb333400640 1 -- 172.21.15.137:0/3270150551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb334160000 msgr2=0x7fb33415ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:03.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb333400640 1 --2- 172.21.15.137:0/3270150551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb334160000 0x7fb33415ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb333400640 1 -- 172.21.15.137:0/3270150551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33415e520 con 0x7fb3340cd710 2024-04-26T23:44:03.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb338e00640 1 --2- 172.21.15.137:0/3270150551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb334160000 0x7fb33415ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:03.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb333400640 1 --2- 172.21.15.137:0/3270150551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3340cd710 0x7fb334144550 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb32000c450 tx=0x7fb32000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:03.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb32be00640 1 -- 172.21.15.137:0/3270150551 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb320012830 con 0x7fb3340cd710 2024-04-26T23:44:03.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb32be00640 1 -- 172.21.15.137:0/3270150551 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb320017070 con 0x7fb3340cd710 2024-04-26T23:44:03.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb33ae00640 1 -- 172.21.15.137:0/3270150551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb33415e800 con 0x7fb3340cd710 2024-04-26T23:44:03.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb32be00640 1 -- 172.21.15.137:0/3270150551 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb320012c30 con 0x7fb3340cd710 2024-04-26T23:44:03.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb33ae00640 1 -- 172.21.15.137:0/3270150551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb33415edc0 con 0x7fb3340cd710 2024-04-26T23:44:03.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.450+0000 7fb33ae00640 1 -- 172.21.15.137:0/3270150551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb33406a410 con 0x7fb3340cd710 2024-04-26T23:44:03.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.454+0000 7fb32be00640 1 -- 172.21.15.137:0/3270150551 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb32001c460 con 0x7fb3340cd710 2024-04-26T23:44:03.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.454+0000 7fb32be00640 1 --2- 172.21.15.137:0/3270150551 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb314068380 0x7fb31406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:03.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.454+0000 7fb32be00640 1 -- 172.21.15.137:0/3270150551 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5752+0+0 (secure 0 0 0) 0x7fb320086750 con 0x7fb3340cd710 2024-04-26T23:44:03.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.454+0000 7fb333e00640 1 --2- 172.21.15.137:0/3270150551 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb314068380 0x7fb31406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:03.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.454+0000 7fb333e00640 1 --2- 172.21.15.137:0/3270150551 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb314068380 0x7fb31406a840 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb3240ad000 tx=0x7fb3240a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:03.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.458+0000 7fb32be00640 1 -- 172.21.15.137:0/3270150551 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb320056cd0 con 0x7fb3340cd710 2024-04-26T23:44:03.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.614+0000 7fb33ae00640 1 -- 172.21.15.137:0/3270150551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb334160680 con 0x7fb3340cd710 2024-04-26T23:44:03.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.614+0000 7fb32be00640 1 -- 172.21.15.137:0/3270150551 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) ==== 93+0+10 (secure 0 0 0) 0x7fb3200565d0 con 0x7fb3340cd710 2024-04-26T23:44:03.623 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:44:03.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.618+0000 7fb33ae00640 1 -- 172.21.15.137:0/3270150551 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb314068380 msgr2=0x7fb31406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:03.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.618+0000 7fb33ae00640 1 --2- 172.21.15.137:0/3270150551 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb314068380 0x7fb31406a840 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb3240ad000 tx=0x7fb3240a6000 comp rx=0 tx=0).stop 2024-04-26T23:44:03.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.618+0000 7fb33ae00640 1 -- 172.21.15.137:0/3270150551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3340cd710 msgr2=0x7fb334144550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:03.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.618+0000 7fb33ae00640 1 --2- 172.21.15.137:0/3270150551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3340cd710 0x7fb334144550 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb32000c450 tx=0x7fb32000c910 comp rx=0 tx=0).stop 2024-04-26T23:44:03.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.618+0000 7fb33ae00640 1 -- 172.21.15.137:0/3270150551 shutdown_connections 2024-04-26T23:44:03.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.618+0000 7fb33ae00640 1 --2- 172.21.15.137:0/3270150551 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb314068380 0x7fb31406a840 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.618+0000 7fb33ae00640 1 --2- 172.21.15.137:0/3270150551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3340cd710 0x7fb334144550 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.618+0000 7fb33ae00640 1 --2- 172.21.15.137:0/3270150551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb334160000 0x7fb33415ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.618+0000 7fb33ae00640 1 --2- 172.21.15.137:0/3270150551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3340b54e0 0x7fb33415d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.618+0000 7fb33ae00640 1 -- 172.21.15.137:0/3270150551 >> 172.21.15.137:0/3270150551 conn(0x7fb33406c800 msgr2=0x7fb3340b48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:03.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.618+0000 7fb33ae00640 1 -- 172.21.15.137:0/3270150551 shutdown_connections 2024-04-26T23:44:03.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.618+0000 7fb33ae00640 1 -- 172.21.15.137:0/3270150551 wait complete. 2024-04-26T23:44:03.644 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:44:03.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.778+0000 7f5933200640 1 Processor -- start 2024-04-26T23:44:03.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.778+0000 7f5933200640 1 -- start start 2024-04-26T23:44:03.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.778+0000 7f5933200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f593415bb80 0x7f5934072bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:03.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.778+0000 7f5933200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f59340b3b10 0x7f59340b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:03.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.778+0000 7f5933200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59340b5310 con 0x7f59340d0d10 2024-04-26T23:44:03.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.778+0000 7f5933200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5934072110 con 0x7f593415bb80 2024-04-26T23:44:03.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.778+0000 7f5933200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f59340723f0 con 0x7f59340b3b10 2024-04-26T23:44:03.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.778+0000 7f5931e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f593415bb80 0x7f5934072bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:03.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.778+0000 7f5932800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f59340d0d10 0x7f59340cdf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:37568/0 (socket says 172.21.15.137:37568) 2024-04-26T23:44:03.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.778+0000 7f5932800640 1 -- 172.21.15.137:0/1349845105 learned_addr learned my addr 172.21.15.137:0/1349845105 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:03.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.778+0000 7f5929400640 1 --2- 172.21.15.137:0/1349845105 >> v2:172.21.15.170:3300/0 conn(0x7f59340b3b10 0x7f59340b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:03.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.778+0000 7f5931400640 1 -- 172.21.15.137:0/1349845105 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1130311811 0 0) 0x7f59340b5310 con 0x7f59340d0d10 2024-04-26T23:44:03.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.778+0000 7f5931400640 1 -- 172.21.15.137:0/1349845105 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5918003530 con 0x7f59340d0d10 2024-04-26T23:44:03.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.778+0000 7f5931e00640 1 -- 172.21.15.137:0/1349845105 >> v2:172.21.15.170:3300/0 conn(0x7f59340b3b10 msgr2=0x7f59340b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:03.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.778+0000 7f5931e00640 1 --2- 172.21.15.137:0/1349845105 >> v2:172.21.15.170:3300/0 conn(0x7f59340b3b10 0x7f59340b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.778+0000 7f5931e00640 1 -- 172.21.15.137:0/1349845105 >> v1:172.21.15.137:6789/0 conn(0x7f59340d0d10 legacy=0x7f59340cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:03.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.778+0000 7f5931e00640 1 -- 172.21.15.137:0/1349845105 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59340726d0 con 0x7f593415bb80 2024-04-26T23:44:03.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.782+0000 7f5931e00640 1 --2- 172.21.15.137:0/1349845105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f593415bb80 0x7f5934072bf0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f59340b3fc0 tx=0x7f592401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8789b18ea70625 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:03.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.782+0000 7f5931400640 1 -- 172.21.15.137:0/1349845105 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59240b0070 con 0x7f593415bb80 2024-04-26T23:44:03.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.782+0000 7f5931400640 1 -- 172.21.15.137:0/1349845105 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59240ab600 con 0x7f593415bb80 2024-04-26T23:44:03.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.782+0000 7f5931400640 1 -- 172.21.15.137:0/1349845105 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59240ab9d0 con 0x7f593415bb80 2024-04-26T23:44:03.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.782+0000 7f5933200640 1 -- 172.21.15.137:0/1349845105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f593415bb80 msgr2=0x7f5934072bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:03.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.782+0000 7f5933200640 1 --2- 172.21.15.137:0/1349845105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f593415bb80 0x7f5934072bf0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f59340b3fc0 tx=0x7f592401c360 comp rx=0 tx=0).stop 2024-04-26T23:44:03.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.782+0000 7f5933200640 1 -- 172.21.15.137:0/1349845105 shutdown_connections 2024-04-26T23:44:03.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.782+0000 7f5933200640 1 --2- 172.21.15.137:0/1349845105 >> v2:172.21.15.170:3300/0 conn(0x7f59340b3b10 0x7f59340b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.782+0000 7f5933200640 1 --2- 172.21.15.137:0/1349845105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f593415bb80 0x7f5934072bf0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.782+0000 7f5933200640 1 -- 172.21.15.137:0/1349845105 >> 172.21.15.137:0/1349845105 conn(0x7f593406c5d0 msgr2=0x7f593406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:03.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.782+0000 7f5933200640 1 -- 172.21.15.137:0/1349845105 shutdown_connections 2024-04-26T23:44:03.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.782+0000 7f5933200640 1 -- 172.21.15.137:0/1349845105 wait complete. 2024-04-26T23:44:03.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f5933200640 1 Processor -- start 2024-04-26T23:44:03.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f5933200640 1 -- start start 2024-04-26T23:44:03.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f5933200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59340b3b10 0x7f5934158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:03.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f5933200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59340d0d10 0x7f5934154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:03.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f5933200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f593415bb80 0x7f59341f6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:03.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f5933200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5934168bb0 con 0x7f59340d0d10 2024-04-26T23:44:03.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f5933200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f59340b50f0 con 0x7f59340b3b10 2024-04-26T23:44:03.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f5933200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5934168d30 con 0x7f593415bb80 2024-04-26T23:44:03.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f5929400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59340d0d10 0x7f5934154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:03.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f5929400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59340d0d10 0x7f5934154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41850/0 (socket says 172.21.15.137:41850) 2024-04-26T23:44:03.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f5929400640 1 -- 172.21.15.137:0/1457077633 learned_addr learned my addr 172.21.15.137:0/1457077633 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:03.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f5932800640 1 --2- 172.21.15.137:0/1457077633 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f593415bb80 0x7f59341f6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:03.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f5931e00640 1 --2- 172.21.15.137:0/1457077633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59340b3b10 0x7f5934158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:03.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f5929400640 1 -- 172.21.15.137:0/1457077633 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f593415bb80 msgr2=0x7f59341f6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:03.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f5929400640 1 --2- 172.21.15.137:0/1457077633 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f593415bb80 0x7f59341f6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f5929400640 1 -- 172.21.15.137:0/1457077633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59340b3b10 msgr2=0x7f5934158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:03.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f5929400640 1 --2- 172.21.15.137:0/1457077633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59340b3b10 0x7f5934158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f5929400640 1 -- 172.21.15.137:0/1457077633 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5934156f70 con 0x7f59340d0d10 2024-04-26T23:44:03.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f5929400640 1 --2- 172.21.15.137:0/1457077633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59340d0d10 0x7f5934154540 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f591c00e900 tx=0x7f591c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:03.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f592aa00640 1 -- 172.21.15.137:0/1457077633 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c017070 con 0x7f59340d0d10 2024-04-26T23:44:03.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f592aa00640 1 -- 172.21.15.137:0/1457077633 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f591c00ca00 con 0x7f59340d0d10 2024-04-26T23:44:03.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f592aa00640 1 -- 172.21.15.137:0/1457077633 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c00cdf0 con 0x7f59340d0d10 2024-04-26T23:44:03.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f5933200640 1 -- 172.21.15.137:0/1457077633 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5934157250 con 0x7f59340d0d10 2024-04-26T23:44:03.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f5933200640 1 -- 172.21.15.137:0/1457077633 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5934157810 con 0x7f59340d0d10 2024-04-26T23:44:03.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.786+0000 7f5933200640 1 -- 172.21.15.137:0/1457077633 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f593406a300 con 0x7f59340d0d10 2024-04-26T23:44:03.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.790+0000 7f592aa00640 1 -- 172.21.15.137:0/1457077633 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f591c01a070 con 0x7f59340d0d10 2024-04-26T23:44:03.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.790+0000 7f592aa00640 1 --2- 172.21.15.137:0/1457077633 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5910068380 0x7f591006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:03.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.790+0000 7f592aa00640 1 -- 172.21.15.137:0/1457077633 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5752+0+0 (secure 0 0 0) 0x7f591c086d60 con 0x7f59340d0d10 2024-04-26T23:44:03.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.790+0000 7f5931e00640 1 --2- 172.21.15.137:0/1457077633 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5910068380 0x7f591006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:03.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.790+0000 7f5931e00640 1 --2- 172.21.15.137:0/1457077633 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5910068380 0x7f591006a840 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f59240ad000 tx=0x7f5924008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:03.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.794+0000 7f592aa00640 1 -- 172.21.15.137:0/1457077633 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f591c0572d0 con 0x7f59340d0d10 2024-04-26T23:44:03.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.950+0000 7f5933200640 1 -- 172.21.15.137:0/1457077633 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f59340b03c0 con 0x7f59340d0d10 2024-04-26T23:44:03.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.950+0000 7f592aa00640 1 -- 172.21.15.137:0/1457077633 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) ==== 104+0+11 (secure 0 0 0) 0x7f59340b03c0 con 0x7f59340d0d10 2024-04-26T23:44:03.959 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:44:03.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.954+0000 7f5933200640 1 -- 172.21.15.137:0/1457077633 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5910068380 msgr2=0x7f591006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:03.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.954+0000 7f5933200640 1 --2- 172.21.15.137:0/1457077633 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5910068380 0x7f591006a840 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f59240ad000 tx=0x7f5924008040 comp rx=0 tx=0).stop 2024-04-26T23:44:03.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.954+0000 7f5933200640 1 -- 172.21.15.137:0/1457077633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59340d0d10 msgr2=0x7f5934154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:03.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.954+0000 7f5933200640 1 --2- 172.21.15.137:0/1457077633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59340d0d10 0x7f5934154540 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f591c00e900 tx=0x7f591c00edc0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.954+0000 7f5933200640 1 -- 172.21.15.137:0/1457077633 shutdown_connections 2024-04-26T23:44:03.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.954+0000 7f5933200640 1 --2- 172.21.15.137:0/1457077633 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5910068380 0x7f591006a840 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.954+0000 7f5933200640 1 --2- 172.21.15.137:0/1457077633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59340d0d10 0x7f5934154540 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.954+0000 7f5933200640 1 --2- 172.21.15.137:0/1457077633 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f593415bb80 0x7f59341f6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.954+0000 7f5933200640 1 --2- 172.21.15.137:0/1457077633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59340b3b10 0x7f5934158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:03.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.954+0000 7f5933200640 1 -- 172.21.15.137:0/1457077633 >> 172.21.15.137:0/1457077633 conn(0x7f593406c5d0 msgr2=0x7f59340cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:03.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.954+0000 7f5933200640 1 -- 172.21.15.137:0/1457077633 shutdown_connections 2024-04-26T23:44:03.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:03.954+0000 7f5933200640 1 -- 172.21.15.137:0/1457077633 wait complete. 2024-04-26T23:44:03.979 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:44:04.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f364da00640 1 Processor -- start 2024-04-26T23:44:04.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f364da00640 1 -- start start 2024-04-26T23:44:04.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f364da00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f36480b54e0 0x7f36480b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:04.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f364da00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3648160000 0x7f3648144d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:04.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f364da00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36480cffa0 con 0x7f36480cd710 2024-04-26T23:44:04.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f364da00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f36480b3d90 con 0x7f36480b54e0 2024-04-26T23:44:04.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f364da00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f36480d0840 con 0x7f3648160000 2024-04-26T23:44:04.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f363fe00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f36480cd710 0x7f364815f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:37572/0 (socket says 172.21.15.137:37572) 2024-04-26T23:44:04.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f363fe00640 1 -- 172.21.15.137:0/2766505646 learned_addr learned my addr 172.21.15.137:0/2766505646 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:04.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646000640 1 -- 172.21.15.137:0/2766505646 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4201166286 0 0) 0x7f36480cffa0 con 0x7f36480cd710 2024-04-26T23:44:04.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646000640 1 -- 172.21.15.137:0/2766505646 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f362c003530 con 0x7f36480cd710 2024-04-26T23:44:04.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646a00640 1 --2- 172.21.15.137:0/2766505646 >> v2:172.21.15.170:3300/0 conn(0x7f36480b54e0 0x7f36480b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:04.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3647400640 1 --2- 172.21.15.137:0/2766505646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3648160000 0x7f3648144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:04.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646000640 1 -- 172.21.15.137:0/2766505646 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1948388493 0 0) 0x7f362c003530 con 0x7f36480cd710 2024-04-26T23:44:04.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646000640 1 -- 172.21.15.137:0/2766505646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3648160000 msgr2=0x7f3648144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:04.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646000640 1 --2- 172.21.15.137:0/2766505646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3648160000 0x7f3648144d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646000640 1 -- 172.21.15.137:0/2766505646 >> v2:172.21.15.170:3300/0 conn(0x7f36480b54e0 msgr2=0x7f36480b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:04.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646000640 1 --2- 172.21.15.137:0/2766505646 >> v2:172.21.15.170:3300/0 conn(0x7f36480b54e0 0x7f36480b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646000640 1 -- 172.21.15.137:0/2766505646 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36480d0280 con 0x7f36480cd710 2024-04-26T23:44:04.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646000640 1 -- 172.21.15.137:0/2766505646 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f3630001680 con 0x7f36480cd710 2024-04-26T23:44:04.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3647400640 1 --2- 172.21.15.137:0/2766505646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3648160000 0x7f3648144d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:04.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646000640 1 -- 172.21.15.137:0/2766505646 >> v1:172.21.15.137:6789/0 conn(0x7f36480cd710 legacy=0x7f364815f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:04.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646000640 1 --2- 172.21.15.137:0/2766505646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f362c0039c0 0x7f362c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:04.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646000640 1 --2- 172.21.15.137:0/2766505646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f362c004810 0x7f362c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:04.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646000640 1 --2- 172.21.15.137:0/2766505646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3648160000 0x7f362c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:04.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646000640 1 -- 172.21.15.137:0/2766505646 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f36480d0840 con 0x7f362c0039c0 2024-04-26T23:44:04.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646000640 1 -- 172.21.15.137:0/2766505646 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f362c00b9d0 con 0x7f362c004810 2024-04-26T23:44:04.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646000640 1 -- 172.21.15.137:0/2766505646 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f362c00bb50 con 0x7f3648160000 2024-04-26T23:44:04.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646a00640 1 --2- 172.21.15.137:0/2766505646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f362c0039c0 0x7f362c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:04.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f363fe00640 1 --2- 172.21.15.137:0/2766505646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f362c004810 0x7f362c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:04.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3647400640 1 --2- 172.21.15.137:0/2766505646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3648160000 0x7f362c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:04.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646a00640 1 -- 172.21.15.137:0/2766505646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3648160000 msgr2=0x7f362c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:04.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646a00640 1 --2- 172.21.15.137:0/2766505646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3648160000 0x7f362c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646a00640 1 -- 172.21.15.137:0/2766505646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f362c004810 msgr2=0x7f362c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:04.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646a00640 1 --2- 172.21.15.137:0/2766505646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f362c004810 0x7f362c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f3646a00640 1 -- 172.21.15.137:0/2766505646 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f362c003530 con 0x7f362c0039c0 2024-04-26T23:44:04.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.110+0000 7f363fe00640 1 --2- 172.21.15.137:0/2766505646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f362c004810 0x7f362c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:04.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.114+0000 7f3646a00640 1 --2- 172.21.15.137:0/2766505646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f362c0039c0 0x7f362c003de0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3638009b10 tx=0x7f363801ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14faef63f909b614 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:04.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.114+0000 7f3646000640 1 -- 172.21.15.137:0/2766505646 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36380b2070 con 0x7f362c0039c0 2024-04-26T23:44:04.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.114+0000 7f3646000640 1 -- 172.21.15.137:0/2766505646 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36380a5590 con 0x7f362c0039c0 2024-04-26T23:44:04.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.114+0000 7f3646000640 1 -- 172.21.15.137:0/2766505646 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36380096b0 con 0x7f362c0039c0 2024-04-26T23:44:04.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.114+0000 7f364da00640 1 -- 172.21.15.137:0/2766505646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f362c0039c0 msgr2=0x7f362c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:04.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.114+0000 7f364da00640 1 --2- 172.21.15.137:0/2766505646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f362c0039c0 0x7f362c003de0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3638009b10 tx=0x7f363801ca80 comp rx=0 tx=0).stop 2024-04-26T23:44:04.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.114+0000 7f3647400640 1 -- 172.21.15.137:0/2766505646 reap_dead start 2024-04-26T23:44:04.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.114+0000 7f364da00640 1 -- 172.21.15.137:0/2766505646 shutdown_connections 2024-04-26T23:44:04.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.114+0000 7f364da00640 1 -- 172.21.15.137:0/2766505646 >> 172.21.15.137:0/2766505646 conn(0x7f364806c800 msgr2=0x7f364806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:04.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.114+0000 7f364da00640 1 -- 172.21.15.137:0/2766505646 shutdown_connections 2024-04-26T23:44:04.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.114+0000 7f364da00640 1 -- 172.21.15.137:0/2766505646 wait complete. 2024-04-26T23:44:04.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f364da00640 1 Processor -- start 2024-04-26T23:44:04.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f364da00640 1 -- start start 2024-04-26T23:44:04.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f364da00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f362c0039c0 0x7f36481f7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:04.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f364da00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3648130210 0x7f364812d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:04.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f364da00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f364815ee30 0x7f3648164dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:04.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f364da00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f36480cdb20 con 0x7f3648130210 2024-04-26T23:44:04.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f364da00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3648145530 con 0x7f364815ee30 2024-04-26T23:44:04.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f364da00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f36481553c0 con 0x7f362c0039c0 2024-04-26T23:44:04.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f363fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3648130210 0x7f364812d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:04.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f363fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3648130210 0x7f364812d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41856/0 (socket says 172.21.15.137:41856) 2024-04-26T23:44:04.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f363fe00640 1 -- 172.21.15.137:0/905666933 learned_addr learned my addr 172.21.15.137:0/905666933 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:04.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f3647400640 1 --2- 172.21.15.137:0/905666933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f364815ee30 0x7f3648164dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:04.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f3646a00640 1 --2- 172.21.15.137:0/905666933 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f362c0039c0 0x7f36481f7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:04.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f363fe00640 1 -- 172.21.15.137:0/905666933 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f362c0039c0 msgr2=0x7f36481f7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:04.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f363fe00640 1 --2- 172.21.15.137:0/905666933 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f362c0039c0 0x7f36481f7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f363fe00640 1 -- 172.21.15.137:0/905666933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f364815ee30 msgr2=0x7f3648164dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:04.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f363fe00640 1 --2- 172.21.15.137:0/905666933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f364815ee30 0x7f3648164dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f363fe00640 1 -- 172.21.15.137:0/905666933 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3648153c30 con 0x7f3648130210 2024-04-26T23:44:04.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f363fe00640 1 --2- 172.21.15.137:0/905666933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3648130210 0x7f364812d540 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f363000e8f0 tx=0x7f363000edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:04.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f363ea00640 1 -- 172.21.15.137:0/905666933 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363000c8d0 con 0x7f3648130210 2024-04-26T23:44:04.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f363ea00640 1 -- 172.21.15.137:0/905666933 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f363000ca70 con 0x7f3648130210 2024-04-26T23:44:04.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f363ea00640 1 -- 172.21.15.137:0/905666933 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363000cc60 con 0x7f3648130210 2024-04-26T23:44:04.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f364da00640 1 -- 172.21.15.137:0/905666933 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3648155090 con 0x7f3648130210 2024-04-26T23:44:04.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.118+0000 7f364da00640 1 -- 172.21.15.137:0/905666933 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3648153670 con 0x7f3648130210 2024-04-26T23:44:04.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.122+0000 7f364da00640 1 -- 172.21.15.137:0/905666933 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f364806a410 con 0x7f3648130210 2024-04-26T23:44:04.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.122+0000 7f363ea00640 1 -- 172.21.15.137:0/905666933 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f363001a030 con 0x7f3648130210 2024-04-26T23:44:04.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.122+0000 7f363ea00640 1 --2- 172.21.15.137:0/905666933 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f36240683b0 0x7f362406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:04.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.122+0000 7f363ea00640 1 -- 172.21.15.137:0/905666933 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5752+0+0 (secure 0 0 0) 0x7f3630086240 con 0x7f3648130210 2024-04-26T23:44:04.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.122+0000 7f3646a00640 1 --2- 172.21.15.137:0/905666933 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f36240683b0 0x7f362406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:04.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.122+0000 7f3646a00640 1 --2- 172.21.15.137:0/905666933 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f36240683b0 0x7f362406a870 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f36380af000 tx=0x7f36380046d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:04.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.126+0000 7f363ea00640 1 -- 172.21.15.137:0/905666933 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3630021020 con 0x7f3648130210 2024-04-26T23:44:04.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.290+0000 7f364da00640 1 -- 172.21.15.137:0/905666933 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f36480d09c0 con 0x7f3648130210 2024-04-26T23:44:04.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.290+0000 7f363ea00640 1 -- 172.21.15.137:0/905666933 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) ==== 100+0+11 (secure 0 0 0) 0x7f3648153c30 con 0x7f3648130210 2024-04-26T23:44:04.296 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:44:04.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.290+0000 7f364da00640 1 -- 172.21.15.137:0/905666933 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f36240683b0 msgr2=0x7f362406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:04.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.290+0000 7f364da00640 1 --2- 172.21.15.137:0/905666933 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f36240683b0 0x7f362406a870 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f36380af000 tx=0x7f36380046d0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.290+0000 7f364da00640 1 -- 172.21.15.137:0/905666933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3648130210 msgr2=0x7f364812d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:04.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.290+0000 7f364da00640 1 --2- 172.21.15.137:0/905666933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3648130210 0x7f364812d540 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f363000e8f0 tx=0x7f363000edb0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.290+0000 7f364da00640 1 -- 172.21.15.137:0/905666933 shutdown_connections 2024-04-26T23:44:04.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.290+0000 7f364da00640 1 --2- 172.21.15.137:0/905666933 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f36240683b0 0x7f362406a870 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.290+0000 7f364da00640 1 --2- 172.21.15.137:0/905666933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3648130210 0x7f364812d540 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.290+0000 7f364da00640 1 --2- 172.21.15.137:0/905666933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f364815ee30 0x7f3648164dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.290+0000 7f364da00640 1 --2- 172.21.15.137:0/905666933 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f362c0039c0 0x7f36481f7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.290+0000 7f364da00640 1 -- 172.21.15.137:0/905666933 >> 172.21.15.137:0/905666933 conn(0x7f364806c800 msgr2=0x7f36480b0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:04.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.290+0000 7f364da00640 1 -- 172.21.15.137:0/905666933 shutdown_connections 2024-04-26T23:44:04.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.290+0000 7f364da00640 1 -- 172.21.15.137:0/905666933 wait complete. 2024-04-26T23:44:04.317 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:44:04.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.446+0000 7f9b3f000640 1 Processor -- start 2024-04-26T23:44:04.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.446+0000 7f9b3f000640 1 -- start start 2024-04-26T23:44:04.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.446+0000 7f9b3f000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9b38159750 0x7f9b380b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:04.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.446+0000 7f9b3f000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b380d1f30 con 0x7f9b38162de0 2024-04-26T23:44:04.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.446+0000 7f9b3f000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b380d1c50 con 0x7f9b38163260 2024-04-26T23:44:04.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.446+0000 7f9b3f000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f9b380ae1d0 con 0x7f9b38159750 2024-04-26T23:44:04.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.446+0000 7f9b2f400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f9b38162de0 0x7f9b3815f7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:37580/0 (socket says 172.21.15.137:37580) 2024-04-26T23:44:04.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.446+0000 7f9b2f400640 1 -- 172.21.15.137:0/952703128 learned_addr learned my addr 172.21.15.137:0/952703128 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:04.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.446+0000 7f9b37e00640 1 --2- 172.21.15.137:0/952703128 >> v2:172.21.15.170:3300/0 conn(0x7f9b38159750 0x7f9b380b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:04.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.446+0000 7f9b37400640 1 -- 172.21.15.137:0/952703128 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4148430840 0 0) 0x7f9b380d1f30 con 0x7f9b38162de0 2024-04-26T23:44:04.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.446+0000 7f9b37400640 1 -- 172.21.15.137:0/952703128 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b1c003530 con 0x7f9b38162de0 2024-04-26T23:44:04.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b37400640 1 -- 172.21.15.137:0/952703128 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2815842778 0 0) 0x7f9b1c003530 con 0x7f9b38162de0 2024-04-26T23:44:04.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b37400640 1 -- 172.21.15.137:0/952703128 >> v2:172.21.15.170:3300/0 conn(0x7f9b38159750 msgr2=0x7f9b380b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:04.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b37400640 1 --2- 172.21.15.137:0/952703128 >> v2:172.21.15.170:3300/0 conn(0x7f9b38159750 0x7f9b380b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b37400640 1 -- 172.21.15.137:0/952703128 >> v1:172.21.15.170:6789/0 conn(0x7f9b38163260 legacy=0x7f9b3815ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:04.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b37400640 1 -- 172.21.15.137:0/952703128 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b380b4290 con 0x7f9b38162de0 2024-04-26T23:44:04.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b37400640 1 -- 172.21.15.137:0/952703128 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f9b20001680 con 0x7f9b38162de0 2024-04-26T23:44:04.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b37400640 1 -- 172.21.15.137:0/952703128 >> v1:172.21.15.137:6789/0 conn(0x7f9b38162de0 legacy=0x7f9b3815f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:04.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b37400640 1 --2- 172.21.15.137:0/952703128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b1c0039c0 0x7f9b1c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:04.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b37400640 1 --2- 172.21.15.137:0/952703128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c004810 0x7f9b1c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:04.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b37400640 1 --2- 172.21.15.137:0/952703128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b1c0051d0 0x7f9b1c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:04.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b37400640 1 -- 172.21.15.137:0/952703128 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1c00c040 con 0x7f9b1c004810 2024-04-26T23:44:04.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b37400640 1 -- 172.21.15.137:0/952703128 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1c00c1f0 con 0x7f9b1c0051d0 2024-04-26T23:44:04.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b37400640 1 -- 172.21.15.137:0/952703128 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9b1c00c3f0 con 0x7f9b1c0039c0 2024-04-26T23:44:04.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b37e00640 1 --2- 172.21.15.137:0/952703128 >> v2:172.21.15.170:3300/0 conn(0x7f9b38159750 0x7f9b380b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:44:04.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b2f400640 1 --2- 172.21.15.137:0/952703128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c004810 0x7f9b1c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:04.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b3d000640 1 --2- 172.21.15.137:0/952703128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b1c0051d0 0x7f9b1c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:04.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b37e00640 1 --2- 172.21.15.137:0/952703128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b1c0039c0 0x7f9b1c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:04.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b2f400640 1 -- 172.21.15.137:0/952703128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b1c0039c0 msgr2=0x7f9b1c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:04.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b2f400640 1 --2- 172.21.15.137:0/952703128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b1c0039c0 0x7f9b1c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b2f400640 1 -- 172.21.15.137:0/952703128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b1c0051d0 msgr2=0x7f9b1c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:04.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b2f400640 1 --2- 172.21.15.137:0/952703128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b1c0051d0 0x7f9b1c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b2f400640 1 -- 172.21.15.137:0/952703128 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1c003530 con 0x7f9b1c004810 2024-04-26T23:44:04.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b3d000640 1 --2- 172.21.15.137:0/952703128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b1c0051d0 0x7f9b1c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:04.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b3d000640 1 -- 172.21.15.137:0/952703128 reap_dead start 2024-04-26T23:44:04.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b37e00640 1 --2- 172.21.15.137:0/952703128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b1c0039c0 0x7f9b1c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:04.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b2f400640 1 --2- 172.21.15.137:0/952703128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c004810 0x7f9b1c004c90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000c240 tx=0x7f9b2001f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6c0f0ad6f1cab2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:04.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b37400640 1 -- 172.21.15.137:0/952703128 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20007d20 con 0x7f9b1c004810 2024-04-26T23:44:04.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.450+0000 7f9b37400640 1 -- 172.21.15.137:0/952703128 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b20005ae0 con 0x7f9b1c004810 2024-04-26T23:44:04.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b37400640 1 -- 172.21.15.137:0/952703128 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20007070 con 0x7f9b1c004810 2024-04-26T23:44:04.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b3f000640 1 -- 172.21.15.137:0/952703128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c004810 msgr2=0x7f9b1c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:04.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b3f000640 1 --2- 172.21.15.137:0/952703128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c004810 0x7f9b1c004c90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000c240 tx=0x7f9b2001f3f0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b3f000640 1 -- 172.21.15.137:0/952703128 shutdown_connections 2024-04-26T23:44:04.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b3f000640 1 --2- 172.21.15.137:0/952703128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c004810 0x7f9b1c004c90 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b3f000640 1 -- 172.21.15.137:0/952703128 >> 172.21.15.137:0/952703128 conn(0x7f9b380b6710 msgr2=0x7f9b380b6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:04.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b3f000640 1 -- 172.21.15.137:0/952703128 shutdown_connections 2024-04-26T23:44:04.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b3f000640 1 -- 172.21.15.137:0/952703128 wait complete. 2024-04-26T23:44:04.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b3f000640 1 Processor -- start 2024-04-26T23:44:04.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b3f000640 1 -- start start 2024-04-26T23:44:04.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b3f000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c004810 0x7f9b38161ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:04.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b3f000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b3815f660 0x7f9b3815fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:04.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b3f000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b381f8450 0x7f9b381f88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:04.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b3f000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9b381636d0 con 0x7f9b1c004810 2024-04-26T23:44:04.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b3f000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9b380b48e0 con 0x7f9b381f8450 2024-04-26T23:44:04.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b3f000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9b380d1890 con 0x7f9b3815f660 2024-04-26T23:44:04.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b37e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c004810 0x7f9b38161ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:04.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b37e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c004810 0x7f9b38161ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41880/0 (socket says 172.21.15.137:41880) 2024-04-26T23:44:04.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b37e00640 1 -- 172.21.15.137:0/929007353 learned_addr learned my addr 172.21.15.137:0/929007353 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:04.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b2f400640 1 --2- 172.21.15.137:0/929007353 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b3815f660 0x7f9b3815fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:04.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b3d000640 1 --2- 172.21.15.137:0/929007353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b381f8450 0x7f9b381f88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:04.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b37e00640 1 -- 172.21.15.137:0/929007353 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b3815f660 msgr2=0x7f9b3815fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:04.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b37e00640 1 --2- 172.21.15.137:0/929007353 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b3815f660 0x7f9b3815fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b37e00640 1 -- 172.21.15.137:0/929007353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b381f8450 msgr2=0x7f9b381f88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:04.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b37e00640 1 --2- 172.21.15.137:0/929007353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b381f8450 0x7f9b381f88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.454+0000 7f9b37e00640 1 -- 172.21.15.137:0/929007353 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b38162530 con 0x7f9b1c004810 2024-04-26T23:44:04.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.458+0000 7f9b37e00640 1 --2- 172.21.15.137:0/929007353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c004810 0x7f9b38161ff0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9b28010900 tx=0x7f9b28010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:04.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.458+0000 7f9b34c00640 1 -- 172.21.15.137:0/929007353 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2800f040 con 0x7f9b1c004810 2024-04-26T23:44:04.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.458+0000 7f9b34c00640 1 -- 172.21.15.137:0/929007353 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b2800eb40 con 0x7f9b1c004810 2024-04-26T23:44:04.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.458+0000 7f9b34c00640 1 -- 172.21.15.137:0/929007353 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2801c400 con 0x7f9b1c004810 2024-04-26T23:44:04.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.458+0000 7f9b3f000640 1 -- 172.21.15.137:0/929007353 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b380b15b0 con 0x7f9b1c004810 2024-04-26T23:44:04.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.458+0000 7f9b3f000640 1 -- 172.21.15.137:0/929007353 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b380b1b50 con 0x7f9b1c004810 2024-04-26T23:44:04.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.458+0000 7f9b3f000640 1 -- 172.21.15.137:0/929007353 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b3806a4b0 con 0x7f9b1c004810 2024-04-26T23:44:04.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.458+0000 7f9b34c00640 1 -- 172.21.15.137:0/929007353 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9b2801c5a0 con 0x7f9b1c004810 2024-04-26T23:44:04.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.458+0000 7f9b34c00640 1 --2- 172.21.15.137:0/929007353 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b14068380 0x7f9b1406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:04.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.458+0000 7f9b34c00640 1 -- 172.21.15.137:0/929007353 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5752+0+0 (secure 0 0 0) 0x7f9b280870d0 con 0x7f9b1c004810 2024-04-26T23:44:04.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.462+0000 7f9b2f400640 1 --2- 172.21.15.137:0/929007353 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b14068380 0x7f9b1406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:04.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.462+0000 7f9b2f400640 1 --2- 172.21.15.137:0/929007353 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b14068380 0x7f9b1406a840 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9b200af000 tx=0x7f9b200aa000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:04.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.466+0000 7f9b34c00640 1 -- 172.21.15.137:0/929007353 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9b28018030 con 0x7f9b1c004810 2024-04-26T23:44:04.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.634+0000 7f9b3f000640 1 -- 172.21.15.137:0/929007353 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9b380b3b20 con 0x7f9b1c004810 2024-04-26T23:44:04.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.634+0000 7f9b34c00640 1 -- 172.21.15.137:0/929007353 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v46) ==== 80+0+56 (secure 0 0 0) 0x7f9b280575c0 con 0x7f9b1c004810 2024-04-26T23:44:04.643 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.1:0/268105340 2024-04-27T00:43:44.368539+0000 2024-04-26T23:44:04.643 INFO:teuthology.orchestra.run.smithi137.stderr:listed 1 entries 2024-04-26T23:44:04.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.638+0000 7f9b3f000640 1 -- 172.21.15.137:0/929007353 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b14068380 msgr2=0x7f9b1406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:04.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.638+0000 7f9b3f000640 1 --2- 172.21.15.137:0/929007353 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b14068380 0x7f9b1406a840 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9b200af000 tx=0x7f9b200aa000 comp rx=0 tx=0).stop 2024-04-26T23:44:04.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.638+0000 7f9b3f000640 1 -- 172.21.15.137:0/929007353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c004810 msgr2=0x7f9b38161ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:04.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.638+0000 7f9b3f000640 1 --2- 172.21.15.137:0/929007353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c004810 0x7f9b38161ff0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9b28010900 tx=0x7f9b28010dc0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.638+0000 7f9b3f000640 1 -- 172.21.15.137:0/929007353 shutdown_connections 2024-04-26T23:44:04.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.638+0000 7f9b3f000640 1 --2- 172.21.15.137:0/929007353 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9b14068380 0x7f9b1406a840 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.638+0000 7f9b3f000640 1 --2- 172.21.15.137:0/929007353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b381f8450 0x7f9b381f88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.638+0000 7f9b3f000640 1 --2- 172.21.15.137:0/929007353 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b3815f660 0x7f9b3815fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.638+0000 7f9b3f000640 1 --2- 172.21.15.137:0/929007353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c004810 0x7f9b38161ff0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:04.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.638+0000 7f9b3f000640 1 -- 172.21.15.137:0/929007353 >> 172.21.15.137:0/929007353 conn(0x7f9b380b6710 msgr2=0x7f9b3815e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:04.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.638+0000 7f9b3f000640 1 -- 172.21.15.137:0/929007353 shutdown_connections 2024-04-26T23:44:04.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.638+0000 7f9b3f000640 1 -- 172.21.15.137:0/929007353 wait complete. 2024-04-26T23:44:04.664 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi170.front.sepia.ceph.com... 2024-04-26T23:44:04.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:04.665 DEBUG:teuthology.orchestra.run.smithi170:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-04-26T23:44:04.686 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:ceph-fuse[32605]: fuse finished with error 0 and tester_r 0 2024-04-26T23:44:04.689 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T23:44:04.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:04.689 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-26T23:44:04.811 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:44:04.811 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:44:04.811 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:44:04.820 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4511 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:44:04.820 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:44:04.820 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:44:04.820 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:44:04.831 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4843 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:44:04.832 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:44:04.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.990+0000 7fbc45000640 1 Processor -- start 2024-04-26T23:44:04.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.990+0000 7fbc45000640 1 -- start start 2024-04-26T23:44:05.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.990+0000 7fbc45000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbc400b4b70 0x7fbc40163560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:05.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.990+0000 7fbc45000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc4015f560 0x7fbc4015f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:05.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.990+0000 7fbc45000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc40160070 con 0x7fbc400b30b0 2024-04-26T23:44:05.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.990+0000 7fbc45000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fbc40160350 con 0x7fbc400b4b70 2024-04-26T23:44:05.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.990+0000 7fbc45000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbc40162d60 con 0x7fbc4015f560 2024-04-26T23:44:05.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.994+0000 7fbc3f400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbc400b4b70 0x7fbc40163560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:05.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.994+0000 7fbc3f400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbc400b4b70 0x7fbc40163560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41888/0 (socket says 172.21.15.137:41888) 2024-04-26T23:44:05.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.994+0000 7fbc3f400640 1 -- 172.21.15.137:0/3974912366 learned_addr learned my addr 172.21.15.137:0/3974912366 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:05.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.994+0000 7fbc36a00640 1 --2- 172.21.15.137:0/3974912366 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc4015f560 0x7fbc4015f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:05.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.994+0000 7fbc3f400640 1 -- 172.21.15.137:0/3974912366 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc4015f560 msgr2=0x7fbc4015f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:05.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.994+0000 7fbc3f400640 1 --2- 172.21.15.137:0/3974912366 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc4015f560 0x7fbc4015f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.994+0000 7fbc3f400640 1 -- 172.21.15.137:0/3974912366 >> v1:172.21.15.170:6789/0 conn(0x7fbc400b30b0 legacy=0x7fbc4006e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:05.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.994+0000 7fbc3f400640 1 -- 172.21.15.137:0/3974912366 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc40163040 con 0x7fbc400b4b70 2024-04-26T23:44:05.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.994+0000 7fbc3f400640 1 --2- 172.21.15.137:0/3974912366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc400b4b70 0x7fbc40163560 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fbc30009870 tx=0x7fbc3001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147640ba6d4e7c0d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:05.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.994+0000 7fbc3ea00640 1 -- 172.21.15.137:0/3974912366 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc300a9640 con 0x7fbc400b4b70 2024-04-26T23:44:05.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.994+0000 7fbc3ea00640 1 -- 172.21.15.137:0/3974912366 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc300a97e0 con 0x7fbc400b4b70 2024-04-26T23:44:05.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.994+0000 7fbc3ea00640 1 -- 172.21.15.137:0/3974912366 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc300a9bb0 con 0x7fbc400b4b70 2024-04-26T23:44:05.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc45000640 1 -- 172.21.15.137:0/3974912366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc400b4b70 msgr2=0x7fbc40163560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:05.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc45000640 1 --2- 172.21.15.137:0/3974912366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc400b4b70 0x7fbc40163560 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fbc30009870 tx=0x7fbc3001c560 comp rx=0 tx=0).stop 2024-04-26T23:44:05.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc45000640 1 -- 172.21.15.137:0/3974912366 shutdown_connections 2024-04-26T23:44:05.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc45000640 1 --2- 172.21.15.137:0/3974912366 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc4015f560 0x7fbc4015f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc45000640 1 --2- 172.21.15.137:0/3974912366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc400b4b70 0x7fbc40163560 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc45000640 1 -- 172.21.15.137:0/3974912366 >> 172.21.15.137:0/3974912366 conn(0x7fbc40075750 msgr2=0x7fbc4006c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:05.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc45000640 1 -- 172.21.15.137:0/3974912366 shutdown_connections 2024-04-26T23:44:05.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc45000640 1 -- 172.21.15.137:0/3974912366 wait complete. 2024-04-26T23:44:05.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc45000640 1 Processor -- start 2024-04-26T23:44:05.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc45000640 1 -- start start 2024-04-26T23:44:05.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc45000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc400b30b0 0x7fbc400af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:05.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc45000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc400b4b70 0x7fbc40158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:05.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc45000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc4015f560 0x7fbc4015eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:05.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc45000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbc400b38d0 con 0x7fbc400b30b0 2024-04-26T23:44:05.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc45000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbc400b66c0 con 0x7fbc4015f560 2024-04-26T23:44:05.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc45000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbc4013ccc0 con 0x7fbc400b4b70 2024-04-26T23:44:05.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc3f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc400b30b0 0x7fbc400af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:05.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc3f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc400b30b0 0x7fbc400af150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41892/0 (socket says 172.21.15.137:41892) 2024-04-26T23:44:05.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc3f400640 1 -- 172.21.15.137:0/4277725480 learned_addr learned my addr 172.21.15.137:0/4277725480 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:05.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc36a00640 1 --2- 172.21.15.137:0/4277725480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc400b4b70 0x7fbc40158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:05.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc3fe00640 1 --2- 172.21.15.137:0/4277725480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc4015f560 0x7fbc4015eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:05.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc3f400640 1 -- 172.21.15.137:0/4277725480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc400b4b70 msgr2=0x7fbc40158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:05.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc3f400640 1 --2- 172.21.15.137:0/4277725480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc400b4b70 0x7fbc40158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc3f400640 1 -- 172.21.15.137:0/4277725480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc4015f560 msgr2=0x7fbc4015eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:05.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc3f400640 1 --2- 172.21.15.137:0/4277725480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc4015f560 0x7fbc4015eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc3f400640 1 -- 172.21.15.137:0/4277725480 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc400af7e0 con 0x7fbc400b30b0 2024-04-26T23:44:05.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc3fe00640 1 --2- 172.21.15.137:0/4277725480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc4015f560 0x7fbc4015eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:05.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:04.998+0000 7fbc3f400640 1 --2- 172.21.15.137:0/4277725480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc400b30b0 0x7fbc400af150 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fbc300ab040 tx=0x7fbc3001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:05.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.002+0000 7fbc37e00640 1 -- 172.21.15.137:0/4277725480 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc300b1800 con 0x7fbc400b30b0 2024-04-26T23:44:05.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.002+0000 7fbc37e00640 1 -- 172.21.15.137:0/4277725480 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc300b19c0 con 0x7fbc400b30b0 2024-04-26T23:44:05.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.002+0000 7fbc37e00640 1 -- 172.21.15.137:0/4277725480 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc300b1db0 con 0x7fbc400b30b0 2024-04-26T23:44:05.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.002+0000 7fbc45000640 1 -- 172.21.15.137:0/4277725480 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc400afac0 con 0x7fbc400b30b0 2024-04-26T23:44:05.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.002+0000 7fbc45000640 1 -- 172.21.15.137:0/4277725480 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc400b0080 con 0x7fbc400b30b0 2024-04-26T23:44:05.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.002+0000 7fbc45000640 1 -- 172.21.15.137:0/4277725480 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc4006a410 con 0x7fbc400b30b0 2024-04-26T23:44:05.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.002+0000 7fbc37e00640 1 -- 172.21.15.137:0/4277725480 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbc300c53f0 con 0x7fbc400b30b0 2024-04-26T23:44:05.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.002+0000 7fbc37e00640 1 --2- 172.21.15.137:0/4277725480 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbc1c068380 0x7fbc1c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:05.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.002+0000 7fbc37e00640 1 -- 172.21.15.137:0/4277725480 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5810+0+0 (secure 0 0 0) 0x7fbc30121640 con 0x7fbc400b30b0 2024-04-26T23:44:05.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.002+0000 7fbc36a00640 1 --2- 172.21.15.137:0/4277725480 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbc1c068380 0x7fbc1c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:05.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.002+0000 7fbc36a00640 1 --2- 172.21.15.137:0/4277725480 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbc1c068380 0x7fbc1c06a840 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbc40140290 tx=0x7fbc28008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:05.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.006+0000 7fbc37e00640 1 -- 172.21.15.137:0/4277725480 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbc300ad020 con 0x7fbc400b30b0 2024-04-26T23:44:05.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.198+0000 7fbc45000640 1 -- 172.21.15.137:0/4277725480 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc4006d210 con 0x7fbc400b30b0 2024-04-26T23:44:05.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.198+0000 7fbc37e00640 1 -- 172.21.15.137:0/4277725480 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5207 (secure 0 0 0) 0x7fbc30016150 con 0x7fbc400b30b0 2024-04-26T23:44:05.205 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:05.206 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":29,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/145346644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":145346644},{"type":"v1","addr":"172.21.15.170:6835","nonce":145346644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5656,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3121910067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3121910067},{"type":"v1","addr":"172.21.15.170:6834","nonce":3121910067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:43:23.588817+0000","modified":"2024-04-26T23:43:43.311113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5838,"mds_1":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"c","rank":1,"incarnation":27,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6836/2120163779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2120163779},{"type":"v1","addr":"172.21.15.137:6836","nonce":2120163779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5838":{"gid":5838,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/547646153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":547646153},{"type":"v1","addr":"172.21.15.137:6837","nonce":547646153}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5838,"qdb_cluster":[5838,5835]},"id":3}]} 2024-04-26T23:44:05.206 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 29 2024-04-26T23:44:05.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.198+0000 7fbc45000640 1 -- 172.21.15.137:0/4277725480 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbc1c068380 msgr2=0x7fbc1c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:05.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.198+0000 7fbc45000640 1 --2- 172.21.15.137:0/4277725480 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbc1c068380 0x7fbc1c06a840 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbc40140290 tx=0x7fbc28008040 comp rx=0 tx=0).stop 2024-04-26T23:44:05.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.198+0000 7fbc45000640 1 -- 172.21.15.137:0/4277725480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc400b30b0 msgr2=0x7fbc400af150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:05.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.198+0000 7fbc45000640 1 --2- 172.21.15.137:0/4277725480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc400b30b0 0x7fbc400af150 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fbc300ab040 tx=0x7fbc3001ada0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.198+0000 7fbc45000640 1 -- 172.21.15.137:0/4277725480 shutdown_connections 2024-04-26T23:44:05.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.198+0000 7fbc45000640 1 --2- 172.21.15.137:0/4277725480 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbc1c068380 0x7fbc1c06a840 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.198+0000 7fbc45000640 1 --2- 172.21.15.137:0/4277725480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc4015f560 0x7fbc4015eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.198+0000 7fbc45000640 1 --2- 172.21.15.137:0/4277725480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc400b4b70 0x7fbc40158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.198+0000 7fbc45000640 1 --2- 172.21.15.137:0/4277725480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc400b30b0 0x7fbc400af150 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.198+0000 7fbc45000640 1 -- 172.21.15.137:0/4277725480 >> 172.21.15.137:0/4277725480 conn(0x7fbc40075750 msgr2=0x7fbc4013f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:05.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.198+0000 7fbc45000640 1 -- 172.21.15.137:0/4277725480 shutdown_connections 2024-04-26T23:44:05.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.198+0000 7fbc45000640 1 -- 172.21.15.137:0/4277725480 wait complete. 2024-04-26T23:44:05.227 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:44:05.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.354+0000 7fdb17600640 1 Processor -- start 2024-04-26T23:44:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.354+0000 7fdb17600640 1 -- start start 2024-04-26T23:44:05.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.358+0000 7fdb17600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdb100725a0 0x7fdb100cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:05.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.358+0000 7fdb17600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fdb100b5080 0x7fdb10165930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:05.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.358+0000 7fdb17600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb100cfef0 con 0x7fdb10073f30 2024-04-26T23:44:05.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.358+0000 7fdb17600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fdb100cddc0 con 0x7fdb100725a0 2024-04-26T23:44:05.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.358+0000 7fdb17600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fdb100d01b0 con 0x7fdb100b5080 2024-04-26T23:44:05.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.358+0000 7fdb14c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdb100725a0 0x7fdb100cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:05.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.358+0000 7fdb0fe00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fdb10073f30 0x7fdb10072980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:37586/0 (socket says 172.21.15.137:37586) 2024-04-26T23:44:05.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.358+0000 7fdb0fe00640 1 -- 172.21.15.137:0/1098383802 learned_addr learned my addr 172.21.15.137:0/1098383802 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:05.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.358+0000 7fdb15600640 1 --2- 172.21.15.137:0/1098383802 >> v2:172.21.15.170:3300/0 conn(0x7fdb100b5080 0x7fdb10165930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:05.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.358+0000 7fdb14c00640 1 -- 172.21.15.137:0/1098383802 >> v2:172.21.15.170:3300/0 conn(0x7fdb100b5080 msgr2=0x7fdb10165930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:05.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.358+0000 7fdb14c00640 1 --2- 172.21.15.137:0/1098383802 >> v2:172.21.15.170:3300/0 conn(0x7fdb100b5080 0x7fdb10165930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.358+0000 7fdb14c00640 1 -- 172.21.15.137:0/1098383802 >> v1:172.21.15.137:6789/0 conn(0x7fdb10073f30 legacy=0x7fdb10072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:05.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.358+0000 7fdb14c00640 1 -- 172.21.15.137:0/1098383802 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb100d0490 con 0x7fdb100725a0 2024-04-26T23:44:05.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.358+0000 7fdb0f400640 1 -- 172.21.15.137:0/1098383802 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1073366942 0 0) 0x7fdb100cfef0 con 0x7fdb10073f30 2024-04-26T23:44:05.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.358+0000 7fdb15600640 1 --2- 172.21.15.137:0/1098383802 >> v2:172.21.15.170:3300/0 conn(0x7fdb100b5080 0x7fdb10165930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:05.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.358+0000 7fdb14c00640 1 --2- 172.21.15.137:0/1098383802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb100725a0 0x7fdb100cd770 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fdb100cdcb0 tx=0x7fdb0001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b6e428c79f5837 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:05.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.362+0000 7fdb0f400640 1 -- 172.21.15.137:0/1098383802 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb000b2070 con 0x7fdb100725a0 2024-04-26T23:44:05.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.362+0000 7fdb0f400640 1 -- 172.21.15.137:0/1098383802 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb000a58d0 con 0x7fdb100725a0 2024-04-26T23:44:05.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.362+0000 7fdb0f400640 1 -- 172.21.15.137:0/1098383802 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb000a5ca0 con 0x7fdb100725a0 2024-04-26T23:44:05.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.362+0000 7fdb17600640 1 -- 172.21.15.137:0/1098383802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb100725a0 msgr2=0x7fdb100cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:05.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.362+0000 7fdb17600640 1 --2- 172.21.15.137:0/1098383802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb100725a0 0x7fdb100cd770 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fdb100cdcb0 tx=0x7fdb0001c900 comp rx=0 tx=0).stop 2024-04-26T23:44:05.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.362+0000 7fdb17600640 1 -- 172.21.15.137:0/1098383802 shutdown_connections 2024-04-26T23:44:05.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.362+0000 7fdb17600640 1 --2- 172.21.15.137:0/1098383802 >> v2:172.21.15.170:3300/0 conn(0x7fdb100b5080 0x7fdb10165930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.362+0000 7fdb17600640 1 --2- 172.21.15.137:0/1098383802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb100725a0 0x7fdb100cd770 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.362+0000 7fdb17600640 1 -- 172.21.15.137:0/1098383802 >> 172.21.15.137:0/1098383802 conn(0x7fdb1006c5d0 msgr2=0x7fdb1006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:05.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.362+0000 7fdb17600640 1 -- 172.21.15.137:0/1098383802 shutdown_connections 2024-04-26T23:44:05.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.362+0000 7fdb17600640 1 -- 172.21.15.137:0/1098383802 wait complete. 2024-04-26T23:44:05.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.362+0000 7fdb17600640 1 Processor -- start 2024-04-26T23:44:05.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.362+0000 7fdb17600640 1 -- start start 2024-04-26T23:44:05.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.362+0000 7fdb17600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb100725a0 0x7fdb100b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:05.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.362+0000 7fdb17600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb10073f30 0x7fdb10140ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:05.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.362+0000 7fdb17600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb100b5080 0x7fdb1015e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:05.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.362+0000 7fdb17600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdb10166a10 con 0x7fdb100725a0 2024-04-26T23:44:05.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.362+0000 7fdb17600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdb10166890 con 0x7fdb100b5080 2024-04-26T23:44:05.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.362+0000 7fdb17600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdb10166b90 con 0x7fdb10073f30 2024-04-26T23:44:05.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.362+0000 7fdb14c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb100725a0 0x7fdb100b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:05.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.362+0000 7fdb14c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb100725a0 0x7fdb100b1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41920/0 (socket says 172.21.15.137:41920) 2024-04-26T23:44:05.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.362+0000 7fdb14c00640 1 -- 172.21.15.137:0/3969430812 learned_addr learned my addr 172.21.15.137:0/3969430812 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:05.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.366+0000 7fdb14c00640 1 -- 172.21.15.137:0/3969430812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb10073f30 msgr2=0x7fdb10140ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:05.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.366+0000 7fdb14c00640 1 --2- 172.21.15.137:0/3969430812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb10073f30 0x7fdb10140ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.366+0000 7fdb14c00640 1 -- 172.21.15.137:0/3969430812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb100b5080 msgr2=0x7fdb1015e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:05.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.366+0000 7fdb14c00640 1 --2- 172.21.15.137:0/3969430812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb100b5080 0x7fdb1015e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.366+0000 7fdb14c00640 1 -- 172.21.15.137:0/3969430812 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1015d9c0 con 0x7fdb100725a0 2024-04-26T23:44:05.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.366+0000 7fdb14c00640 1 --2- 172.21.15.137:0/3969430812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb100725a0 0x7fdb100b1f90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdb0001a530 tx=0x7fdb000196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:05.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.366+0000 7fdb0cc00640 1 -- 172.21.15.137:0/3969430812 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb000bd020 con 0x7fdb100725a0 2024-04-26T23:44:05.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.366+0000 7fdb0cc00640 1 -- 172.21.15.137:0/3969430812 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb000b8750 con 0x7fdb100725a0 2024-04-26T23:44:05.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.366+0000 7fdb17600640 1 -- 172.21.15.137:0/3969430812 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb100b14b0 con 0x7fdb100725a0 2024-04-26T23:44:05.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.366+0000 7fdb0cc00640 1 -- 172.21.15.137:0/3969430812 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb000b2040 con 0x7fdb100725a0 2024-04-26T23:44:05.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.366+0000 7fdb17600640 1 -- 172.21.15.137:0/3969430812 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb100b1a70 con 0x7fdb100725a0 2024-04-26T23:44:05.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.366+0000 7fdb17600640 1 -- 172.21.15.137:0/3969430812 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb1006a4b0 con 0x7fdb100725a0 2024-04-26T23:44:05.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.366+0000 7fdb0cc00640 1 -- 172.21.15.137:0/3969430812 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdb000c0020 con 0x7fdb100725a0 2024-04-26T23:44:05.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.366+0000 7fdb0cc00640 1 --2- 172.21.15.137:0/3969430812 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdaf0068380 0x7fdaf006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:05.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.366+0000 7fdb0cc00640 1 -- 172.21.15.137:0/3969430812 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5810+0+0 (secure 0 0 0) 0x7fdb00121b80 con 0x7fdb100725a0 2024-04-26T23:44:05.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.370+0000 7fdb0fe00640 1 --2- 172.21.15.137:0/3969430812 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdaf0068380 0x7fdaf006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:05.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.370+0000 7fdb0fe00640 1 --2- 172.21.15.137:0/3969430812 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdaf0068380 0x7fdaf006a840 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdb100b38c0 tx=0x7fdafc007990 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:05.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.374+0000 7fdb0cc00640 1 -- 172.21.15.137:0/3969430812 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdb000c7030 con 0x7fdb100725a0 2024-04-26T23:44:05.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.530+0000 7fdb17600640 1 -- 172.21.15.137:0/3969430812 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb10072380 con 0x7fdb100725a0 2024-04-26T23:44:05.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.530+0000 7fdb0cc00640 1 -- 172.21.15.137:0/3969430812 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16871 (secure 0 0 0) 0x7fdb00016520 con 0x7fdb100725a0 2024-04-26T23:44:05.540 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:05.540 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":47,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:44:04.711884+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:43:21.281556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T23:43:22.549121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":5}]},{"pgid":"7.2c","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/268105340":"2024-04-27T00:43:44.368539+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:44:05.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.534+0000 7fdb17600640 1 -- 172.21.15.137:0/3969430812 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdaf0068380 msgr2=0x7fdaf006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:05.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.534+0000 7fdb17600640 1 --2- 172.21.15.137:0/3969430812 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdaf0068380 0x7fdaf006a840 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdb100b38c0 tx=0x7fdafc007990 comp rx=0 tx=0).stop 2024-04-26T23:44:05.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.534+0000 7fdb17600640 1 -- 172.21.15.137:0/3969430812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb100725a0 msgr2=0x7fdb100b1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:05.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.534+0000 7fdb17600640 1 --2- 172.21.15.137:0/3969430812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb100725a0 0x7fdb100b1f90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdb0001a530 tx=0x7fdb000196a0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.534+0000 7fdb17600640 1 -- 172.21.15.137:0/3969430812 shutdown_connections 2024-04-26T23:44:05.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.534+0000 7fdb17600640 1 --2- 172.21.15.137:0/3969430812 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fdaf0068380 0x7fdaf006a840 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.534+0000 7fdb17600640 1 --2- 172.21.15.137:0/3969430812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb100b5080 0x7fdb1015e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.534+0000 7fdb17600640 1 --2- 172.21.15.137:0/3969430812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb10073f30 0x7fdb10140ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.534+0000 7fdb17600640 1 --2- 172.21.15.137:0/3969430812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb100725a0 0x7fdb100b1f90 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.534+0000 7fdb17600640 1 -- 172.21.15.137:0/3969430812 >> 172.21.15.137:0/3969430812 conn(0x7fdb1006c5d0 msgr2=0x7fdb10168450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:05.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.534+0000 7fdb17600640 1 -- 172.21.15.137:0/3969430812 shutdown_connections 2024-04-26T23:44:05.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.534+0000 7fdb17600640 1 -- 172.21.15.137:0/3969430812 wait complete. 2024-04-26T23:44:05.561 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:43:21.281556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:43:22.549121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:44:05.561 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:44:05.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb787e00640 1 Processor -- start 2024-04-26T23:44:05.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb787e00640 1 -- start start 2024-04-26T23:44:05.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb787e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7800b5ee0 0x7fb78015f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:05.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb787e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb78015fe30 0x7fb780144d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:05.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb787e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7800cffa0 con 0x7fb7800b54e0 2024-04-26T23:44:05.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb787e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb7800b3d90 con 0x7fb78015fe30 2024-04-26T23:44:05.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb787e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb7800d0840 con 0x7fb7800b5ee0 2024-04-26T23:44:05.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb785400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb7800b54e0 0x7fb7800cd710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:37594/0 (socket says 172.21.15.137:37594) 2024-04-26T23:44:05.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb785400640 1 -- 172.21.15.137:0/3159058038 learned_addr learned my addr 172.21.15.137:0/3159058038 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:05.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb785e00640 1 --2- 172.21.15.137:0/3159058038 >> v2:172.21.15.170:3300/0 conn(0x7fb78015fe30 0x7fb780144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:05.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb77fe00640 1 -- 172.21.15.137:0/3159058038 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1703962328 0 0) 0x7fb7800cffa0 con 0x7fb7800b54e0 2024-04-26T23:44:05.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb784a00640 1 --2- 172.21.15.137:0/3159058038 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7800b5ee0 0x7fb78015f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:05.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb77fe00640 1 -- 172.21.15.137:0/3159058038 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb768003530 con 0x7fb7800b54e0 2024-04-26T23:44:05.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb77fe00640 1 -- 172.21.15.137:0/3159058038 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1887992106 0 0) 0x7fb768003530 con 0x7fb7800b54e0 2024-04-26T23:44:05.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb77fe00640 1 -- 172.21.15.137:0/3159058038 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7800b5ee0 msgr2=0x7fb78015f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:05.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb77fe00640 1 --2- 172.21.15.137:0/3159058038 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7800b5ee0 0x7fb78015f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb77fe00640 1 -- 172.21.15.137:0/3159058038 >> v2:172.21.15.170:3300/0 conn(0x7fb78015fe30 msgr2=0x7fb780144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:05.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb77fe00640 1 --2- 172.21.15.137:0/3159058038 >> v2:172.21.15.170:3300/0 conn(0x7fb78015fe30 0x7fb780144d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb77fe00640 1 -- 172.21.15.137:0/3159058038 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7800d0280 con 0x7fb7800b54e0 2024-04-26T23:44:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb77fe00640 1 -- 172.21.15.137:0/3159058038 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fb774001680 con 0x7fb7800b54e0 2024-04-26T23:44:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb77fe00640 1 -- 172.21.15.137:0/3159058038 >> v1:172.21.15.137:6789/0 conn(0x7fb7800b54e0 legacy=0x7fb7800cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb77fe00640 1 --2- 172.21.15.137:0/3159058038 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7800b5ee0 0x7fb7680039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb77fe00640 1 --2- 172.21.15.137:0/3159058038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb768003f40 0x7fb768004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb77fe00640 1 --2- 172.21.15.137:0/3159058038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb768004d50 0x7fb7680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb77fe00640 1 -- 172.21.15.137:0/3159058038 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb7800d0840 con 0x7fb768003f40 2024-04-26T23:44:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb77fe00640 1 -- 172.21.15.137:0/3159058038 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb76800b9d0 con 0x7fb768004d50 2024-04-26T23:44:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb77fe00640 1 -- 172.21.15.137:0/3159058038 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb76800bb50 con 0x7fb7800b5ee0 2024-04-26T23:44:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb784a00640 1 --2- 172.21.15.137:0/3159058038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb768003f40 0x7fb768004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb785e00640 1 --2- 172.21.15.137:0/3159058038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb768004d50 0x7fb7680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb785400640 1 --2- 172.21.15.137:0/3159058038 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7800b5ee0 0x7fb7680039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb784a00640 1 -- 172.21.15.137:0/3159058038 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7800b5ee0 msgr2=0x7fb7680039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb784a00640 1 --2- 172.21.15.137:0/3159058038 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7800b5ee0 0x7fb7680039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb784a00640 1 -- 172.21.15.137:0/3159058038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb768004d50 msgr2=0x7fb7680051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:05.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb784a00640 1 --2- 172.21.15.137:0/3159058038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb768004d50 0x7fb7680051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb784a00640 1 -- 172.21.15.137:0/3159058038 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb768003530 con 0x7fb768003f40 2024-04-26T23:44:05.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb785400640 1 --2- 172.21.15.137:0/3159058038 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7800b5ee0 0x7fb7680039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:05.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.694+0000 7fb785e00640 1 --2- 172.21.15.137:0/3159058038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb768004d50 0x7fb7680051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:05.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.698+0000 7fb784a00640 1 --2- 172.21.15.137:0/3159058038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb768003f40 0x7fb768004810 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb76c009ae0 tx=0x7fb76c01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609854f5df83daca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:05.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.698+0000 7fb77fe00640 1 -- 172.21.15.137:0/3159058038 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c0b2070 con 0x7fb768003f40 2024-04-26T23:44:05.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.698+0000 7fb77fe00640 1 -- 172.21.15.137:0/3159058038 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb76c0a5660 con 0x7fb768003f40 2024-04-26T23:44:05.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.698+0000 7fb77fe00640 1 -- 172.21.15.137:0/3159058038 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c0096b0 con 0x7fb768003f40 2024-04-26T23:44:05.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.698+0000 7fb787e00640 1 -- 172.21.15.137:0/3159058038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb768003f40 msgr2=0x7fb768004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:05.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.698+0000 7fb787e00640 1 --2- 172.21.15.137:0/3159058038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb768003f40 0x7fb768004810 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb76c009ae0 tx=0x7fb76c01ca10 comp rx=0 tx=0).stop 2024-04-26T23:44:05.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.698+0000 7fb785e00640 1 -- 172.21.15.137:0/3159058038 reap_dead start 2024-04-26T23:44:05.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.698+0000 7fb787e00640 1 -- 172.21.15.137:0/3159058038 shutdown_connections 2024-04-26T23:44:05.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.698+0000 7fb787e00640 1 -- 172.21.15.137:0/3159058038 >> 172.21.15.137:0/3159058038 conn(0x7fb78006c800 msgr2=0x7fb78006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:05.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.698+0000 7fb787e00640 1 -- 172.21.15.137:0/3159058038 shutdown_connections 2024-04-26T23:44:05.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.698+0000 7fb787e00640 1 -- 172.21.15.137:0/3159058038 wait complete. 2024-04-26T23:44:05.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.702+0000 7fb787e00640 1 Processor -- start 2024-04-26T23:44:05.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.702+0000 7fb787e00640 1 -- start start 2024-04-26T23:44:05.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.702+0000 7fb787e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb768003f40 0x7fb7800cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:05.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.702+0000 7fb787e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb78013d5a0 0x7fb78013da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:05.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.702+0000 7fb787e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7800ca110 0x7fb7800ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:05.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.702+0000 7fb787e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb7800b58c0 con 0x7fb7800ca110 2024-04-26T23:44:05.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.702+0000 7fb787e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb780160280 con 0x7fb78013d5a0 2024-04-26T23:44:05.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.702+0000 7fb787e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb7800cded0 con 0x7fb768003f40 2024-04-26T23:44:05.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.702+0000 7fb785e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7800ca110 0x7fb7800ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:05.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.702+0000 7fb785e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7800ca110 0x7fb7800ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41944/0 (socket says 172.21.15.137:41944) 2024-04-26T23:44:05.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.702+0000 7fb785e00640 1 -- 172.21.15.137:0/696087447 learned_addr learned my addr 172.21.15.137:0/696087447 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:05.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.702+0000 7fb785e00640 1 -- 172.21.15.137:0/696087447 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb768003f40 msgr2=0x7fb7800cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:05.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.702+0000 7fb785e00640 1 --2- 172.21.15.137:0/696087447 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb768003f40 0x7fb7800cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.702+0000 7fb785e00640 1 -- 172.21.15.137:0/696087447 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb78013d5a0 msgr2=0x7fb78013da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:05.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.702+0000 7fb785e00640 1 --2- 172.21.15.137:0/696087447 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb78013d5a0 0x7fb78013da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.702+0000 7fb785e00640 1 -- 172.21.15.137:0/696087447 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78013df40 con 0x7fb7800ca110 2024-04-26T23:44:05.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.702+0000 7fb785e00640 1 --2- 172.21.15.137:0/696087447 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7800ca110 0x7fb7800ca590 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb780070130 tx=0x7fb778010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:05.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.702+0000 7fb77d600640 1 -- 172.21.15.137:0/696087447 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb778010d80 con 0x7fb7800ca110 2024-04-26T23:44:05.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.702+0000 7fb77d600640 1 -- 172.21.15.137:0/696087447 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7780039a0 con 0x7fb7800ca110 2024-04-26T23:44:05.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.702+0000 7fb787e00640 1 -- 172.21.15.137:0/696087447 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb78015d420 con 0x7fb7800ca110 2024-04-26T23:44:05.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.702+0000 7fb77d600640 1 -- 172.21.15.137:0/696087447 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb778003d90 con 0x7fb7800ca110 2024-04-26T23:44:05.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.702+0000 7fb787e00640 1 -- 172.21.15.137:0/696087447 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb78015d9a0 con 0x7fb7800ca110 2024-04-26T23:44:05.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.706+0000 7fb787e00640 1 -- 172.21.15.137:0/696087447 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb78006a410 con 0x7fb7800ca110 2024-04-26T23:44:05.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.706+0000 7fb77d600640 1 -- 172.21.15.137:0/696087447 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb77801e030 con 0x7fb7800ca110 2024-04-26T23:44:05.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.706+0000 7fb77d600640 1 --2- 172.21.15.137:0/696087447 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb760068380 0x7fb76006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:05.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.706+0000 7fb77d600640 1 -- 172.21.15.137:0/696087447 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5810+0+0 (secure 0 0 0) 0x7fb778087300 con 0x7fb7800ca110 2024-04-26T23:44:05.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.706+0000 7fb785400640 1 --2- 172.21.15.137:0/696087447 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb760068380 0x7fb76006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:05.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.706+0000 7fb785400640 1 --2- 172.21.15.137:0/696087447 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb760068380 0x7fb76006a840 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb774001ec0 tx=0x7fb774004810 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:05.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.710+0000 7fb77d600640 1 -- 172.21.15.137:0/696087447 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb778025020 con 0x7fb7800ca110 2024-04-26T23:44:05.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.870+0000 7fb787e00640 1 -- 172.21.15.137:0/696087447 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb7800734c0 con 0x7fb7800ca110 2024-04-26T23:44:05.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.870+0000 7fb77d600640 1 -- 172.21.15.137:0/696087447 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) ==== 93+0+10 (secure 0 0 0) 0x7fb78013df40 con 0x7fb7800ca110 2024-04-26T23:44:05.880 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:44:05.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.874+0000 7fb787e00640 1 -- 172.21.15.137:0/696087447 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb760068380 msgr2=0x7fb76006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:05.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.874+0000 7fb787e00640 1 --2- 172.21.15.137:0/696087447 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb760068380 0x7fb76006a840 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb774001ec0 tx=0x7fb774004810 comp rx=0 tx=0).stop 2024-04-26T23:44:05.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.874+0000 7fb787e00640 1 -- 172.21.15.137:0/696087447 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7800ca110 msgr2=0x7fb7800ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:05.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.874+0000 7fb787e00640 1 --2- 172.21.15.137:0/696087447 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7800ca110 0x7fb7800ca590 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb780070130 tx=0x7fb778010590 comp rx=0 tx=0).stop 2024-04-26T23:44:05.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.874+0000 7fb787e00640 1 -- 172.21.15.137:0/696087447 shutdown_connections 2024-04-26T23:44:05.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.874+0000 7fb787e00640 1 --2- 172.21.15.137:0/696087447 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb760068380 0x7fb76006a840 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.874+0000 7fb787e00640 1 --2- 172.21.15.137:0/696087447 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7800ca110 0x7fb7800ca590 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.874+0000 7fb787e00640 1 --2- 172.21.15.137:0/696087447 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb78013d5a0 0x7fb78013da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.874+0000 7fb787e00640 1 --2- 172.21.15.137:0/696087447 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb768003f40 0x7fb7800cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:05.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.874+0000 7fb787e00640 1 -- 172.21.15.137:0/696087447 >> 172.21.15.137:0/696087447 conn(0x7fb78006c800 msgr2=0x7fb7800cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:05.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.874+0000 7fb787e00640 1 -- 172.21.15.137:0/696087447 shutdown_connections 2024-04-26T23:44:05.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:05.874+0000 7fb787e00640 1 -- 172.21.15.137:0/696087447 wait complete. 2024-04-26T23:44:05.901 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:44:06.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.030+0000 7efdb5800640 1 Processor -- start 2024-04-26T23:44:06.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.030+0000 7efdb5800640 1 -- start start 2024-04-26T23:44:06.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdb5800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7efdb00b54e0 0x7efdb00b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:06.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdb5800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb00cffa0 con 0x7efdb0160000 2024-04-26T23:44:06.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdb5800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb00d0280 con 0x7efdb00cd710 2024-04-26T23:44:06.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdb5800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7efdb00b3d90 con 0x7efdb00b54e0 2024-04-26T23:44:06.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdaf400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7efdb0160000 0x7efdb0144d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:37596/0 (socket says 172.21.15.137:37596) 2024-04-26T23:44:06.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdaf400640 1 -- 172.21.15.137:0/2215918159 learned_addr learned my addr 172.21.15.137:0/2215918159 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:06.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdaea00640 1 --2- 172.21.15.137:0/2215918159 >> v2:172.21.15.170:3300/0 conn(0x7efdb00b54e0 0x7efdb00b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:06.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdae000640 1 -- 172.21.15.137:0/2215918159 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3489843544 0 0) 0x7efdb00cffa0 con 0x7efdb0160000 2024-04-26T23:44:06.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdae000640 1 -- 172.21.15.137:0/2215918159 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd94003530 con 0x7efdb0160000 2024-04-26T23:44:06.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdae000640 1 -- 172.21.15.137:0/2215918159 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2952230071 0 0) 0x7efd94003530 con 0x7efdb0160000 2024-04-26T23:44:06.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdae000640 1 -- 172.21.15.137:0/2215918159 >> v2:172.21.15.170:3300/0 conn(0x7efdb00b54e0 msgr2=0x7efdb00b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:06.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdae000640 1 --2- 172.21.15.137:0/2215918159 >> v2:172.21.15.170:3300/0 conn(0x7efdb00b54e0 0x7efdb00b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdae000640 1 -- 172.21.15.137:0/2215918159 >> v1:172.21.15.170:6789/0 conn(0x7efdb00cd710 legacy=0x7efdb015f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:06.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdae000640 1 -- 172.21.15.137:0/2215918159 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb00d0560 con 0x7efdb0160000 2024-04-26T23:44:06.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdae000640 1 -- 172.21.15.137:0/2215918159 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7efda8001680 con 0x7efdb0160000 2024-04-26T23:44:06.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdae000640 1 -- 172.21.15.137:0/2215918159 >> v1:172.21.15.137:6789/0 conn(0x7efdb0160000 legacy=0x7efdb0144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:06.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdae000640 1 --2- 172.21.15.137:0/2215918159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd940039c0 0x7efd94003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:06.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdae000640 1 --2- 172.21.15.137:0/2215918159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd94004810 0x7efd94004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:06.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdae000640 1 --2- 172.21.15.137:0/2215918159 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd940051d0 0x7efd9400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:06.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdae000640 1 -- 172.21.15.137:0/2215918159 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efd9400c040 con 0x7efd94004810 2024-04-26T23:44:06.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdae000640 1 -- 172.21.15.137:0/2215918159 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efd9400c1f0 con 0x7efd940039c0 2024-04-26T23:44:06.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdae000640 1 -- 172.21.15.137:0/2215918159 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7efd9400c3f0 con 0x7efd940051d0 2024-04-26T23:44:06.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efda6000640 1 --2- 172.21.15.137:0/2215918159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd94004810 0x7efd94004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:06.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdaea00640 1 --2- 172.21.15.137:0/2215918159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd940039c0 0x7efd94003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:06.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdaf400640 1 --2- 172.21.15.137:0/2215918159 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd940051d0 0x7efd9400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:06.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efda6000640 1 -- 172.21.15.137:0/2215918159 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd940051d0 msgr2=0x7efd9400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:06.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efda6000640 1 --2- 172.21.15.137:0/2215918159 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd940051d0 0x7efd9400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efda6000640 1 -- 172.21.15.137:0/2215918159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd940039c0 msgr2=0x7efd94003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:06.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efda6000640 1 --2- 172.21.15.137:0/2215918159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd940039c0 0x7efd94003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efda6000640 1 -- 172.21.15.137:0/2215918159 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd94003530 con 0x7efd94004810 2024-04-26T23:44:06.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdaea00640 1 --2- 172.21.15.137:0/2215918159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd940039c0 0x7efd94003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:06.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.034+0000 7efdaf400640 1 -- 172.21.15.137:0/2215918159 reap_dead start 2024-04-26T23:44:06.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.038+0000 7efda6000640 1 --2- 172.21.15.137:0/2215918159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd94004810 0x7efd94004c90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7efd98001780 tx=0x7efd9801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d4e0b85e89d47a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:06.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.038+0000 7efdae000640 1 -- 172.21.15.137:0/2215918159 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd980013a0 con 0x7efd94004810 2024-04-26T23:44:06.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.038+0000 7efdae000640 1 -- 172.21.15.137:0/2215918159 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd980052f0 con 0x7efd94004810 2024-04-26T23:44:06.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.038+0000 7efdae000640 1 -- 172.21.15.137:0/2215918159 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98003840 con 0x7efd94004810 2024-04-26T23:44:06.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.038+0000 7efdb5800640 1 -- 172.21.15.137:0/2215918159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd94004810 msgr2=0x7efd94004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:06.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.038+0000 7efdb5800640 1 --2- 172.21.15.137:0/2215918159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd94004810 0x7efd94004c90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7efd98001780 tx=0x7efd9801c400 comp rx=0 tx=0).stop 2024-04-26T23:44:06.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.038+0000 7efdb5800640 1 -- 172.21.15.137:0/2215918159 shutdown_connections 2024-04-26T23:44:06.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.038+0000 7efdb5800640 1 --2- 172.21.15.137:0/2215918159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd94004810 0x7efd94004c90 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.038+0000 7efdb5800640 1 -- 172.21.15.137:0/2215918159 >> 172.21.15.137:0/2215918159 conn(0x7efdb006c800 msgr2=0x7efdb006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:06.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.038+0000 7efdb5800640 1 -- 172.21.15.137:0/2215918159 shutdown_connections 2024-04-26T23:44:06.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.038+0000 7efdb5800640 1 -- 172.21.15.137:0/2215918159 wait complete. 2024-04-26T23:44:06.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.038+0000 7efdb5800640 1 Processor -- start 2024-04-26T23:44:06.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.038+0000 7efdb5800640 1 -- start start 2024-04-26T23:44:06.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efdb5800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd94004810 0x7efdb00b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:06.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efdb5800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdb00af650 0x7efdb013b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:06.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efdb5800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdb01f5dc0 0x7efdb01445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:06.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efdb5800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efdb00cdb80 con 0x7efdb01f5dc0 2024-04-26T23:44:06.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efdb5800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efdb00d0840 con 0x7efdb00af650 2024-04-26T23:44:06.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efdb5800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7efdb00cded0 con 0x7efd94004810 2024-04-26T23:44:06.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efdaf400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdb01f5dc0 0x7efdb01445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:06.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efdaf400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdb01f5dc0 0x7efdb01445d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41952/0 (socket says 172.21.15.137:41952) 2024-04-26T23:44:06.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efdaf400640 1 -- 172.21.15.137:0/50580405 learned_addr learned my addr 172.21.15.137:0/50580405 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:06.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efda6000640 1 --2- 172.21.15.137:0/50580405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdb00af650 0x7efdb013b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:06.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efdaea00640 1 --2- 172.21.15.137:0/50580405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd94004810 0x7efdb00b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:06.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efdaf400640 1 -- 172.21.15.137:0/50580405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd94004810 msgr2=0x7efdb00b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:06.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efdaf400640 1 --2- 172.21.15.137:0/50580405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd94004810 0x7efdb00b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efdaf400640 1 -- 172.21.15.137:0/50580405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdb00af650 msgr2=0x7efdb013b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:06.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efdaf400640 1 --2- 172.21.15.137:0/50580405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdb00af650 0x7efdb013b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efdaf400640 1 -- 172.21.15.137:0/50580405 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb00afb50 con 0x7efdb01f5dc0 2024-04-26T23:44:06.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efdaf400640 1 --2- 172.21.15.137:0/50580405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdb01f5dc0 0x7efdb01445d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7efdb00ceca0 tx=0x7efda8011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:06.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efda7400640 1 -- 172.21.15.137:0/50580405 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda8010040 con 0x7efdb01f5dc0 2024-04-26T23:44:06.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efda7400640 1 -- 172.21.15.137:0/50580405 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efda801a070 con 0x7efdb01f5dc0 2024-04-26T23:44:06.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efdb5800640 1 -- 172.21.15.137:0/50580405 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb00afe30 con 0x7efdb01f5dc0 2024-04-26T23:44:06.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efda7400640 1 -- 172.21.15.137:0/50580405 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda8013a20 con 0x7efdb01f5dc0 2024-04-26T23:44:06.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efdb5800640 1 -- 172.21.15.137:0/50580405 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb00b03f0 con 0x7efdb01f5dc0 2024-04-26T23:44:06.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.042+0000 7efdb5800640 1 -- 172.21.15.137:0/50580405 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdb006a410 con 0x7efdb01f5dc0 2024-04-26T23:44:06.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.046+0000 7efda7400640 1 -- 172.21.15.137:0/50580405 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efda8013bc0 con 0x7efdb01f5dc0 2024-04-26T23:44:06.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.046+0000 7efda7400640 1 --2- 172.21.15.137:0/50580405 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efd8c068380 0x7efd8c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:06.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.046+0000 7efda7400640 1 -- 172.21.15.137:0/50580405 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5810+0+0 (secure 0 0 0) 0x7efda80897f0 con 0x7efdb01f5dc0 2024-04-26T23:44:06.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.046+0000 7efdaea00640 1 --2- 172.21.15.137:0/50580405 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efd8c068380 0x7efd8c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:06.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.046+0000 7efdaea00640 1 --2- 172.21.15.137:0/50580405 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efd8c068380 0x7efd8c06a840 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efdb00b3b00 tx=0x7efda000b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:06.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.050+0000 7efda7400640 1 -- 172.21.15.137:0/50580405 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efda8059650 con 0x7efdb01f5dc0 2024-04-26T23:44:06.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.206+0000 7efdb5800640 1 -- 172.21.15.137:0/50580405 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efdb015bd40 con 0x7efdb01f5dc0 2024-04-26T23:44:06.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.206+0000 7efda7400640 1 -- 172.21.15.137:0/50580405 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) ==== 104+0+11 (secure 0 0 0) 0x7efda805d950 con 0x7efdb01f5dc0 2024-04-26T23:44:06.214 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:44:06.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.210+0000 7efdb5800640 1 -- 172.21.15.137:0/50580405 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efd8c068380 msgr2=0x7efd8c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:06.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.210+0000 7efdb5800640 1 --2- 172.21.15.137:0/50580405 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efd8c068380 0x7efd8c06a840 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efdb00b3b00 tx=0x7efda000b040 comp rx=0 tx=0).stop 2024-04-26T23:44:06.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.210+0000 7efdb5800640 1 -- 172.21.15.137:0/50580405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdb01f5dc0 msgr2=0x7efdb01445d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:06.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.210+0000 7efdb5800640 1 --2- 172.21.15.137:0/50580405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdb01f5dc0 0x7efdb01445d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7efdb00ceca0 tx=0x7efda8011a00 comp rx=0 tx=0).stop 2024-04-26T23:44:06.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.210+0000 7efdb5800640 1 -- 172.21.15.137:0/50580405 shutdown_connections 2024-04-26T23:44:06.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.210+0000 7efdb5800640 1 --2- 172.21.15.137:0/50580405 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efd8c068380 0x7efd8c06a840 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.210+0000 7efdb5800640 1 --2- 172.21.15.137:0/50580405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdb01f5dc0 0x7efdb01445d0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.210+0000 7efdb5800640 1 --2- 172.21.15.137:0/50580405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdb00af650 0x7efdb013b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.210+0000 7efdb5800640 1 --2- 172.21.15.137:0/50580405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd94004810 0x7efdb00b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.210+0000 7efdb5800640 1 -- 172.21.15.137:0/50580405 >> 172.21.15.137:0/50580405 conn(0x7efdb006c800 msgr2=0x7efdb015d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:06.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.210+0000 7efdb5800640 1 -- 172.21.15.137:0/50580405 shutdown_connections 2024-04-26T23:44:06.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.210+0000 7efdb5800640 1 -- 172.21.15.137:0/50580405 wait complete. 2024-04-26T23:44:06.236 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:44:06.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.370+0000 7f2a40600640 1 Processor -- start 2024-04-26T23:44:06.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.370+0000 7f2a40600640 1 -- start start 2024-04-26T23:44:06.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.374+0000 7f2a40600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a380b54e0 0x7f2a380b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:06.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.374+0000 7f2a40600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2a38160000 0x7f2a38144d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:06.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.374+0000 7f2a40600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a380cffa0 con 0x7f2a380cd710 2024-04-26T23:44:06.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.374+0000 7f2a40600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2a380b3d90 con 0x7f2a38160000 2024-04-26T23:44:06.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.374+0000 7f2a40600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2a380d0840 con 0x7f2a380b54e0 2024-04-26T23:44:06.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.374+0000 7f2a3e600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2a38160000 0x7f2a38144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:06.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.374+0000 7f2a3dc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a380b54e0 0x7f2a380b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:06.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.374+0000 7f2a3d200640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f2a380cd710 0x7f2a3815f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:57144/0 (socket says 172.21.15.137:57144) 2024-04-26T23:44:06.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.374+0000 7f2a3d200640 1 -- 172.21.15.137:0/2491032164 learned_addr learned my addr 172.21.15.137:0/2491032164 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:06.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.374+0000 7f2a3e600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2a38160000 0x7f2a38144d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41956/0 (socket says 172.21.15.137:41956) 2024-04-26T23:44:06.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.374+0000 7f2a3e600640 1 -- 172.21.15.137:0/2491032164 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a380b54e0 msgr2=0x7f2a380b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:06.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.374+0000 7f2a3e600640 1 --2- 172.21.15.137:0/2491032164 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a380b54e0 0x7f2a380b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.374+0000 7f2a3e600640 1 -- 172.21.15.137:0/2491032164 >> v1:172.21.15.170:6789/0 conn(0x7f2a380cd710 legacy=0x7f2a3815f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:06.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.374+0000 7f2a3e600640 1 -- 172.21.15.137:0/2491032164 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a380d0280 con 0x7f2a38160000 2024-04-26T23:44:06.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.378+0000 7f2a3e600640 1 --2- 172.21.15.137:0/2491032164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a38160000 0x7f2a38144d20 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009d90 tx=0x7f2a3001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575b4e6af986cc22 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:06.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.378+0000 7f2a37e00640 1 -- 172.21.15.137:0/2491032164 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a300b2070 con 0x7f2a38160000 2024-04-26T23:44:06.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.378+0000 7f2a37e00640 1 -- 172.21.15.137:0/2491032164 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a38145a70 con 0x7f2a38160000 2024-04-26T23:44:06.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.378+0000 7f2a37e00640 1 -- 172.21.15.137:0/2491032164 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a300a5c40 con 0x7f2a38160000 2024-04-26T23:44:06.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.378+0000 7f2a40600640 1 -- 172.21.15.137:0/2491032164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a38160000 msgr2=0x7f2a38144d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:06.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.378+0000 7f2a40600640 1 --2- 172.21.15.137:0/2491032164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a38160000 0x7f2a38144d20 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009d90 tx=0x7f2a3001c940 comp rx=0 tx=0).stop 2024-04-26T23:44:06.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.378+0000 7f2a40600640 1 -- 172.21.15.137:0/2491032164 shutdown_connections 2024-04-26T23:44:06.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.378+0000 7f2a40600640 1 --2- 172.21.15.137:0/2491032164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a38160000 0x7f2a38144d20 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.378+0000 7f2a40600640 1 --2- 172.21.15.137:0/2491032164 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a380b54e0 0x7f2a380b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.378+0000 7f2a40600640 1 -- 172.21.15.137:0/2491032164 >> 172.21.15.137:0/2491032164 conn(0x7f2a3806c800 msgr2=0x7f2a3806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:06.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.378+0000 7f2a40600640 1 -- 172.21.15.137:0/2491032164 shutdown_connections 2024-04-26T23:44:06.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.378+0000 7f2a40600640 1 -- 172.21.15.137:0/2491032164 wait complete. 2024-04-26T23:44:06.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.378+0000 7f2a40600640 1 Processor -- start 2024-04-26T23:44:06.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.378+0000 7f2a40600640 1 -- start start 2024-04-26T23:44:06.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a40600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a380b54e0 0x7f2a3813e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:06.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a40600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a380cd710 0x7f2a381420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:06.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a40600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a38160000 0x7f2a381425f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a40600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2a380cdc70 con 0x7f2a380b54e0 2024-04-26T23:44:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a40600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2a380cdaf0 con 0x7f2a380cd710 2024-04-26T23:44:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a40600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2a380724b0 con 0x7f2a38160000 2024-04-26T23:44:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a3dc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a380b54e0 0x7f2a3813e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a3dc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a380b54e0 0x7f2a3813e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41966/0 (socket says 172.21.15.137:41966) 2024-04-26T23:44:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a3dc00640 1 -- 172.21.15.137:0/985046550 learned_addr learned my addr 172.21.15.137:0/985046550 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a3dc00640 1 -- 172.21.15.137:0/985046550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a38160000 msgr2=0x7f2a381425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a3dc00640 1 --2- 172.21.15.137:0/985046550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a38160000 0x7f2a381425f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a3d200640 1 --2- 172.21.15.137:0/985046550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a380cd710 0x7f2a381420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a3dc00640 1 -- 172.21.15.137:0/985046550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a380cd710 msgr2=0x7f2a381420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a3dc00640 1 --2- 172.21.15.137:0/985046550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a380cd710 0x7f2a381420b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a3dc00640 1 -- 172.21.15.137:0/985046550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a380ac080 con 0x7f2a380b54e0 2024-04-26T23:44:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a3dc00640 1 --2- 172.21.15.137:0/985046550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a380b54e0 0x7f2a3813e9b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c00e960 tx=0x7f2a2c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a35600640 1 -- 172.21.15.137:0/985046550 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c017070 con 0x7f2a380b54e0 2024-04-26T23:44:06.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a35600640 1 -- 172.21.15.137:0/985046550 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a2c00ca00 con 0x7f2a380b54e0 2024-04-26T23:44:06.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a35600640 1 -- 172.21.15.137:0/985046550 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c00cdb0 con 0x7f2a380b54e0 2024-04-26T23:44:06.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a40600640 1 -- 172.21.15.137:0/985046550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a380ac360 con 0x7f2a380b54e0 2024-04-26T23:44:06.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a40600640 1 -- 172.21.15.137:0/985046550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a380ac920 con 0x7f2a380b54e0 2024-04-26T23:44:06.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a40600640 1 -- 172.21.15.137:0/985046550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a3806a410 con 0x7f2a380b54e0 2024-04-26T23:44:06.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.382+0000 7f2a35600640 1 -- 172.21.15.137:0/985046550 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2a2c01a070 con 0x7f2a380b54e0 2024-04-26T23:44:06.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.386+0000 7f2a35600640 1 --2- 172.21.15.137:0/985046550 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2a180683b0 0x7f2a1806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:06.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.386+0000 7f2a35600640 1 -- 172.21.15.137:0/985046550 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5810+0+0 (secure 0 0 0) 0x7f2a2c086e60 con 0x7f2a380b54e0 2024-04-26T23:44:06.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.386+0000 7f2a3d200640 1 --2- 172.21.15.137:0/985046550 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2a180683b0 0x7f2a1806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:06.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.386+0000 7f2a3d200640 1 --2- 172.21.15.137:0/985046550 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2a180683b0 0x7f2a1806a870 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2a38069630 tx=0x7f2a24009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:06.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.390+0000 7f2a35600640 1 -- 172.21.15.137:0/985046550 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2a2c057310 con 0x7f2a380b54e0 2024-04-26T23:44:06.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.546+0000 7f2a40600640 1 -- 172.21.15.137:0/985046550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2a380cf850 con 0x7f2a380b54e0 2024-04-26T23:44:06.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.546+0000 7f2a35600640 1 -- 172.21.15.137:0/985046550 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v48) ==== 100+0+11 (secure 0 0 0) 0x7f2a2c056c10 con 0x7f2a380b54e0 2024-04-26T23:44:06.554 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:44:06.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.550+0000 7f2a40600640 1 -- 172.21.15.137:0/985046550 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2a180683b0 msgr2=0x7f2a1806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:06.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.550+0000 7f2a40600640 1 --2- 172.21.15.137:0/985046550 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2a180683b0 0x7f2a1806a870 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2a38069630 tx=0x7f2a24009040 comp rx=0 tx=0).stop 2024-04-26T23:44:06.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.550+0000 7f2a40600640 1 -- 172.21.15.137:0/985046550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a380b54e0 msgr2=0x7f2a3813e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:06.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.550+0000 7f2a40600640 1 --2- 172.21.15.137:0/985046550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a380b54e0 0x7f2a3813e9b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c00e960 tx=0x7f2a2c00ee20 comp rx=0 tx=0).stop 2024-04-26T23:44:06.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.550+0000 7f2a40600640 1 -- 172.21.15.137:0/985046550 shutdown_connections 2024-04-26T23:44:06.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.550+0000 7f2a40600640 1 --2- 172.21.15.137:0/985046550 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2a180683b0 0x7f2a1806a870 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.550+0000 7f2a40600640 1 --2- 172.21.15.137:0/985046550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a38160000 0x7f2a381425f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.550+0000 7f2a40600640 1 --2- 172.21.15.137:0/985046550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a380cd710 0x7f2a381420b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.550+0000 7f2a40600640 1 --2- 172.21.15.137:0/985046550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a380b54e0 0x7f2a3813e9b0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.550+0000 7f2a40600640 1 -- 172.21.15.137:0/985046550 >> 172.21.15.137:0/985046550 conn(0x7f2a3806c800 msgr2=0x7f2a3806f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:06.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.550+0000 7f2a40600640 1 -- 172.21.15.137:0/985046550 shutdown_connections 2024-04-26T23:44:06.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.550+0000 7f2a40600640 1 -- 172.21.15.137:0/985046550 wait complete. 2024-04-26T23:44:06.575 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:44:06.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.702+0000 7f2eb1800640 1 Processor -- start 2024-04-26T23:44:06.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.702+0000 7f2eb1800640 1 -- start start 2024-04-26T23:44:06.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.706+0000 7f2eb1800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2eac0725a0 0x7f2eac0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:06.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.706+0000 7f2eb1800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2eac073f30 0x7f2eac072980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:06.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.706+0000 7f2eb1800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eac0cfef0 con 0x7f2eac072ec0 2024-04-26T23:44:06.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.706+0000 7f2eb1800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2eac0cddc0 con 0x7f2eac0725a0 2024-04-26T23:44:06.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.706+0000 7f2eb1800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f2eac0d01b0 con 0x7f2eac073f30 2024-04-26T23:44:06.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.706+0000 7f2eaaa00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2eac0725a0 0x7f2eac0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:06.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.706+0000 7f2eab400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f2eac072ec0 0x7f2eac0b4070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:37604/0 (socket says 172.21.15.137:37604) 2024-04-26T23:44:06.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.706+0000 7f2eab400640 1 -- 172.21.15.137:0/4053600973 learned_addr learned my addr 172.21.15.137:0/4053600973 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:06.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.706+0000 7f2ea2000640 1 --2- 172.21.15.137:0/4053600973 >> v2:172.21.15.170:3300/0 conn(0x7f2eac073f30 0x7f2eac072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:06.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.706+0000 7f2eaaa00640 1 -- 172.21.15.137:0/4053600973 >> v2:172.21.15.170:3300/0 conn(0x7f2eac073f30 msgr2=0x7f2eac072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:06.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.706+0000 7f2eaaa00640 1 --2- 172.21.15.137:0/4053600973 >> v2:172.21.15.170:3300/0 conn(0x7f2eac073f30 0x7f2eac072980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.706+0000 7f2eaaa00640 1 -- 172.21.15.137:0/4053600973 >> v1:172.21.15.137:6789/0 conn(0x7f2eac072ec0 legacy=0x7f2eac0b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:06.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.706+0000 7f2eaaa00640 1 -- 172.21.15.137:0/4053600973 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eac0d0490 con 0x7f2eac0725a0 2024-04-26T23:44:06.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.706+0000 7f2eaa000640 1 -- 172.21.15.137:0/4053600973 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1926822737 0 0) 0x7f2eac0cfef0 con 0x7f2eac072ec0 2024-04-26T23:44:06.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.710+0000 7f2eaaa00640 1 --2- 172.21.15.137:0/4053600973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2eac0725a0 0x7f2eac0cd770 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2eac15c310 tx=0x7f2e9c01ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb0ea0da8eb4db4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:06.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.710+0000 7f2eaa000640 1 -- 172.21.15.137:0/4053600973 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c0a7070 con 0x7f2eac0725a0 2024-04-26T23:44:06.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.710+0000 7f2eaa000640 1 -- 172.21.15.137:0/4053600973 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e9c0b0070 con 0x7f2eac0725a0 2024-04-26T23:44:06.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.710+0000 7f2eaa000640 1 -- 172.21.15.137:0/4053600973 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c0ab890 con 0x7f2eac0725a0 2024-04-26T23:44:06.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.710+0000 7f2eb1800640 1 -- 172.21.15.137:0/4053600973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2eac0725a0 msgr2=0x7f2eac0cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:06.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.710+0000 7f2eb1800640 1 --2- 172.21.15.137:0/4053600973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2eac0725a0 0x7f2eac0cd770 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2eac15c310 tx=0x7f2e9c01ceb0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.710+0000 7f2eb1800640 1 -- 172.21.15.137:0/4053600973 shutdown_connections 2024-04-26T23:44:06.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.710+0000 7f2eb1800640 1 --2- 172.21.15.137:0/4053600973 >> v2:172.21.15.170:3300/0 conn(0x7f2eac073f30 0x7f2eac072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.710+0000 7f2eb1800640 1 --2- 172.21.15.137:0/4053600973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2eac0725a0 0x7f2eac0cd770 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.710+0000 7f2eb1800640 1 -- 172.21.15.137:0/4053600973 >> 172.21.15.137:0/4053600973 conn(0x7f2eac06c5d0 msgr2=0x7f2eac06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:06.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.710+0000 7f2eb1800640 1 -- 172.21.15.137:0/4053600973 shutdown_connections 2024-04-26T23:44:06.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.710+0000 7f2eb1800640 1 -- 172.21.15.137:0/4053600973 wait complete. 2024-04-26T23:44:06.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.710+0000 7f2eb1800640 1 Processor -- start 2024-04-26T23:44:06.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.710+0000 7f2eb1800640 1 -- start start 2024-04-26T23:44:06.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2eb1800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2eac0725a0 0x7f2eac0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:06.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2eb1800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2eac072ec0 0x7f2eac0b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:06.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2eb1800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac073f30 0x7f2eac13d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:06.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2eb1800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac0b5110 con 0x7f2eac0725a0 2024-04-26T23:44:06.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2eb1800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac0b4f90 con 0x7f2eac073f30 2024-04-26T23:44:06.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2eb1800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2eac0b5290 con 0x7f2eac072ec0 2024-04-26T23:44:06.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2eaaa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2eac0725a0 0x7f2eac0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:06.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2eaaa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2eac0725a0 0x7f2eac0b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41990/0 (socket says 172.21.15.137:41990) 2024-04-26T23:44:06.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2eaaa00640 1 -- 172.21.15.137:0/2071307971 learned_addr learned my addr 172.21.15.137:0/2071307971 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:06.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2eaaa00640 1 -- 172.21.15.137:0/2071307971 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2eac072ec0 msgr2=0x7f2eac0b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:06.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2ea2000640 1 --2- 172.21.15.137:0/2071307971 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2eac072ec0 0x7f2eac0b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:06.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2eab400640 1 --2- 172.21.15.137:0/2071307971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac073f30 0x7f2eac13d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:06.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2eaaa00640 1 --2- 172.21.15.137:0/2071307971 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2eac072ec0 0x7f2eac0b3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2eaaa00640 1 -- 172.21.15.137:0/2071307971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac073f30 msgr2=0x7f2eac13d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:06.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2eaaa00640 1 --2- 172.21.15.137:0/2071307971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac073f30 0x7f2eac13d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2eaaa00640 1 -- 172.21.15.137:0/2071307971 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eac15b2e0 con 0x7f2eac0725a0 2024-04-26T23:44:06.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2ea2000640 1 --2- 172.21.15.137:0/2071307971 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2eac072ec0 0x7f2eac0b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:06.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2eab400640 1 --2- 172.21.15.137:0/2071307971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac073f30 0x7f2eac13d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:06.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2eaaa00640 1 --2- 172.21.15.137:0/2071307971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2eac0725a0 0x7f2eac0b2c50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c019060 tx=0x7f2e9c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:06.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2ea3400640 1 -- 172.21.15.137:0/2071307971 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c006e20 con 0x7f2eac0725a0 2024-04-26T23:44:06.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2ea3400640 1 -- 172.21.15.137:0/2071307971 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e9c004220 con 0x7f2eac0725a0 2024-04-26T23:44:06.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2ea3400640 1 -- 172.21.15.137:0/2071307971 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c003620 con 0x7f2eac0725a0 2024-04-26T23:44:06.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2eb1800640 1 -- 172.21.15.137:0/2071307971 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eac0b1540 con 0x7f2eac0725a0 2024-04-26T23:44:06.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2eb1800640 1 -- 172.21.15.137:0/2071307971 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eac0b1b00 con 0x7f2eac0725a0 2024-04-26T23:44:06.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2eb1800640 1 -- 172.21.15.137:0/2071307971 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eac06a4b0 con 0x7f2eac0725a0 2024-04-26T23:44:06.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.714+0000 7f2ea3400640 1 -- 172.21.15.137:0/2071307971 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2e9c0037c0 con 0x7f2eac0725a0 2024-04-26T23:44:06.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.718+0000 7f2ea3400640 1 --2- 172.21.15.137:0/2071307971 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2e88068380 0x7f2e8806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:06.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.718+0000 7f2ea3400640 1 -- 172.21.15.137:0/2071307971 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5810+0+0 (secure 0 0 0) 0x7f2e9c121220 con 0x7f2eac0725a0 2024-04-26T23:44:06.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.718+0000 7f2ea2000640 1 --2- 172.21.15.137:0/2071307971 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2e88068380 0x7f2e8806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:06.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.718+0000 7f2ea2000640 1 --2- 172.21.15.137:0/2071307971 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2e88068380 0x7f2e8806a840 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2eac13f9c0 tx=0x7f2e94008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:06.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.722+0000 7f2ea3400640 1 -- 172.21.15.137:0/2071307971 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2eac15b2e0 con 0x7f2eac0725a0 2024-04-26T23:44:06.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.910+0000 7f2eb1800640 1 -- 172.21.15.137:0/2071307971 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2eac15ee20 con 0x7f2eac0725a0 2024-04-26T23:44:06.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.914+0000 7f2ea3400640 1 -- 172.21.15.137:0/2071307971 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5207 (secure 0 0 0) 0x7f2e9c016070 con 0x7f2eac0725a0 2024-04-26T23:44:06.920 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:06.920 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":29,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/145346644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":145346644},{"type":"v1","addr":"172.21.15.170:6835","nonce":145346644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5656,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3121910067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3121910067},{"type":"v1","addr":"172.21.15.170:6834","nonce":3121910067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:43:23.588817+0000","modified":"2024-04-26T23:43:43.311113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5838,"mds_1":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"c","rank":1,"incarnation":27,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6836/2120163779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2120163779},{"type":"v1","addr":"172.21.15.137:6836","nonce":2120163779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5838":{"gid":5838,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/547646153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":547646153},{"type":"v1","addr":"172.21.15.137:6837","nonce":547646153}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5838,"qdb_cluster":[5838,5835]},"id":3}]} 2024-04-26T23:44:06.920 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 29 2024-04-26T23:44:06.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.914+0000 7f2eb1800640 1 -- 172.21.15.137:0/2071307971 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2e88068380 msgr2=0x7f2e8806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:06.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.914+0000 7f2eb1800640 1 --2- 172.21.15.137:0/2071307971 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2e88068380 0x7f2e8806a840 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2eac13f9c0 tx=0x7f2e94008040 comp rx=0 tx=0).stop 2024-04-26T23:44:06.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.914+0000 7f2eb1800640 1 -- 172.21.15.137:0/2071307971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2eac0725a0 msgr2=0x7f2eac0b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:06.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.914+0000 7f2eb1800640 1 --2- 172.21.15.137:0/2071307971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2eac0725a0 0x7f2eac0b2c50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c019060 tx=0x7f2e9c01ac90 comp rx=0 tx=0).stop 2024-04-26T23:44:06.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.914+0000 7f2eb1800640 1 -- 172.21.15.137:0/2071307971 shutdown_connections 2024-04-26T23:44:06.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.914+0000 7f2eb1800640 1 --2- 172.21.15.137:0/2071307971 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2e88068380 0x7f2e8806a840 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.914+0000 7f2eb1800640 1 --2- 172.21.15.137:0/2071307971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac073f30 0x7f2eac13d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.914+0000 7f2eb1800640 1 --2- 172.21.15.137:0/2071307971 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2eac072ec0 0x7f2eac0b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.914+0000 7f2eb1800640 1 --2- 172.21.15.137:0/2071307971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2eac0725a0 0x7f2eac0b2c50 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:06.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.914+0000 7f2eb1800640 1 -- 172.21.15.137:0/2071307971 >> 172.21.15.137:0/2071307971 conn(0x7f2eac06c5d0 msgr2=0x7f2eac0ccde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:06.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.914+0000 7f2eb1800640 1 -- 172.21.15.137:0/2071307971 shutdown_connections 2024-04-26T23:44:06.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:06.914+0000 7f2eb1800640 1 -- 172.21.15.137:0/2071307971 wait complete. 2024-04-26T23:44:06.941 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:44:07.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.070+0000 7fc42f800640 1 Processor -- start 2024-04-26T23:44:07.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.070+0000 7fc42f800640 1 -- start start 2024-04-26T23:44:07.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.070+0000 7fc42f800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc42815ced0 0x7fc4280d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:07.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.070+0000 7fc42f800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4280b14a0 0x7fc4280d18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:07.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.070+0000 7fc42f800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4280b1b30 con 0x7fc42815d2b0 2024-04-26T23:44:07.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.070+0000 7fc42f800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc4280b1e10 con 0x7fc42815ced0 2024-04-26T23:44:07.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.070+0000 7fc42f800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc4280b23f0 con 0x7fc4280b14a0 2024-04-26T23:44:07.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.070+0000 7fc42ce00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc42815ced0 0x7fc4280d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:07.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.070+0000 7fc42d800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4280b14a0 0x7fc4280d18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:07.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.070+0000 7fc42ce00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc42815ced0 0x7fc4280d13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:32924/0 (socket says 172.21.15.137:32924) 2024-04-26T23:44:07.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.070+0000 7fc42ce00640 1 -- 172.21.15.137:0/2009012557 learned_addr learned my addr 172.21.15.137:0/2009012557 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:07.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.070+0000 7fc42ce00640 1 -- 172.21.15.137:0/2009012557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4280b14a0 msgr2=0x7fc4280d18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:07.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.070+0000 7fc42ce00640 1 --2- 172.21.15.137:0/2009012557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4280b14a0 0x7fc4280d18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.070+0000 7fc42ce00640 1 -- 172.21.15.137:0/2009012557 >> v1:172.21.15.170:6789/0 conn(0x7fc42815d2b0 legacy=0x7fc4280b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:07.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.070+0000 7fc42ce00640 1 -- 172.21.15.137:0/2009012557 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4280b26d0 con 0x7fc42815ced0 2024-04-26T23:44:07.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.070+0000 7fc42d800640 1 --2- 172.21.15.137:0/2009012557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4280b14a0 0x7fc4280d18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:44:07.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.074+0000 7fc42ce00640 1 --2- 172.21.15.137:0/2009012557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc42815ced0 0x7fc4280d13b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc41c009870 tx=0x7fc41c01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ad361d68c2bfc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:07.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.074+0000 7fc427400640 1 -- 172.21.15.137:0/2009012557 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c0b2070 con 0x7fc42815ced0 2024-04-26T23:44:07.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.074+0000 7fc427400640 1 -- 172.21.15.137:0/2009012557 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc41c0a9070 con 0x7fc42815ced0 2024-04-26T23:44:07.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.074+0000 7fc427400640 1 -- 172.21.15.137:0/2009012557 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c0ad880 con 0x7fc42815ced0 2024-04-26T23:44:07.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.074+0000 7fc42f800640 1 -- 172.21.15.137:0/2009012557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc42815ced0 msgr2=0x7fc4280d13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:07.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.074+0000 7fc42f800640 1 --2- 172.21.15.137:0/2009012557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc42815ced0 0x7fc4280d13b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc41c009870 tx=0x7fc41c01c560 comp rx=0 tx=0).stop 2024-04-26T23:44:07.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.074+0000 7fc42f800640 1 -- 172.21.15.137:0/2009012557 shutdown_connections 2024-04-26T23:44:07.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.074+0000 7fc42f800640 1 --2- 172.21.15.137:0/2009012557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4280b14a0 0x7fc4280d18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.074+0000 7fc42f800640 1 --2- 172.21.15.137:0/2009012557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc42815ced0 0x7fc4280d13b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.074+0000 7fc42f800640 1 -- 172.21.15.137:0/2009012557 >> 172.21.15.137:0/2009012557 conn(0x7fc42809ba60 msgr2=0x7fc42809be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:07.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.074+0000 7fc42f800640 1 -- 172.21.15.137:0/2009012557 shutdown_connections 2024-04-26T23:44:07.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.074+0000 7fc42f800640 1 -- 172.21.15.137:0/2009012557 wait complete. 2024-04-26T23:44:07.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc42f800640 1 Processor -- start 2024-04-26T23:44:07.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc42f800640 1 -- start start 2024-04-26T23:44:07.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc42f800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4280b14a0 0x7fc4281538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:07.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc42f800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc42815ced0 0x7fc4281671c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:07.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc42f800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc42815d2b0 0x7fc428167700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:07.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc42f800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc4280b37d0 con 0x7fc42815ced0 2024-04-26T23:44:07.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc42f800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc4280b3650 con 0x7fc42815d2b0 2024-04-26T23:44:07.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc42f800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc4280b3950 con 0x7fc4280b14a0 2024-04-26T23:44:07.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc427e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc42815ced0 0x7fc4281671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:07.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc42ce00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4280b14a0 0x7fc4281538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:07.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc427e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc42815ced0 0x7fc4281671c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42000/0 (socket says 172.21.15.137:42000) 2024-04-26T23:44:07.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc427e00640 1 -- 172.21.15.137:0/4111662199 learned_addr learned my addr 172.21.15.137:0/4111662199 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:07.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc42d800640 1 --2- 172.21.15.137:0/4111662199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc42815d2b0 0x7fc428167700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:07.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc427e00640 1 -- 172.21.15.137:0/4111662199 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4280b14a0 msgr2=0x7fc4281538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:07.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc427e00640 1 --2- 172.21.15.137:0/4111662199 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4280b14a0 0x7fc4281538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc427e00640 1 -- 172.21.15.137:0/4111662199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc42815d2b0 msgr2=0x7fc428167700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:07.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc427e00640 1 --2- 172.21.15.137:0/4111662199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc42815d2b0 0x7fc428167700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc427e00640 1 -- 172.21.15.137:0/4111662199 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4280b7d30 con 0x7fc42815ced0 2024-04-26T23:44:07.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc427e00640 1 --2- 172.21.15.137:0/4111662199 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc42815ced0 0x7fc4281671c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc41400c3a0 tx=0x7fc41400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:07.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc424c00640 1 -- 172.21.15.137:0/4111662199 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4140052d0 con 0x7fc42815ced0 2024-04-26T23:44:07.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc424c00640 1 -- 172.21.15.137:0/4111662199 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc414005470 con 0x7fc42815ced0 2024-04-26T23:44:07.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc424c00640 1 -- 172.21.15.137:0/4111662199 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc414007260 con 0x7fc42815ced0 2024-04-26T23:44:07.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc42f800640 1 -- 172.21.15.137:0/4111662199 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4281564e0 con 0x7fc42815ced0 2024-04-26T23:44:07.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc42f800640 1 -- 172.21.15.137:0/4111662199 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4280b7ff0 con 0x7fc42815ced0 2024-04-26T23:44:07.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.078+0000 7fc42f800640 1 -- 172.21.15.137:0/4111662199 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc42806a4b0 con 0x7fc42815ced0 2024-04-26T23:44:07.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.082+0000 7fc424c00640 1 -- 172.21.15.137:0/4111662199 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc414007400 con 0x7fc42815ced0 2024-04-26T23:44:07.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.082+0000 7fc424c00640 1 --2- 172.21.15.137:0/4111662199 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc4080683b0 0x7fc40806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:07.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.082+0000 7fc424c00640 1 -- 172.21.15.137:0/4111662199 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5810+0+0 (secure 0 0 0) 0x7fc414085ea0 con 0x7fc42815ced0 2024-04-26T23:44:07.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.082+0000 7fc42ce00640 1 --2- 172.21.15.137:0/4111662199 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc4080683b0 0x7fc40806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:07.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.082+0000 7fc42ce00640 1 --2- 172.21.15.137:0/4111662199 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc4080683b0 0x7fc40806a870 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0af000 tx=0x7fc41c0a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:07.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.086+0000 7fc424c00640 1 -- 172.21.15.137:0/4111662199 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc414055c70 con 0x7fc42815ced0 2024-04-26T23:44:07.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.242+0000 7fc42f800640 1 -- 172.21.15.137:0/4111662199 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4280c66d0 con 0x7fc42815ced0 2024-04-26T23:44:07.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.246+0000 7fc424c00640 1 -- 172.21.15.137:0/4111662199 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16871 (secure 0 0 0) 0x7fc414059f70 con 0x7fc42815ced0 2024-04-26T23:44:07.252 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:07.253 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":48,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:44:05.720430+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:43:21.281556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T23:43:22.549121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":5}]},{"pgid":"7.2c","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/268105340":"2024-04-27T00:43:44.368539+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:44:07.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.246+0000 7fc42f800640 1 -- 172.21.15.137:0/4111662199 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc4080683b0 msgr2=0x7fc40806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.246+0000 7fc42f800640 1 --2- 172.21.15.137:0/4111662199 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc4080683b0 0x7fc40806a870 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0af000 tx=0x7fc41c0a7000 comp rx=0 tx=0).stop 2024-04-26T23:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.246+0000 7fc42f800640 1 -- 172.21.15.137:0/4111662199 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc42815ced0 msgr2=0x7fc4281671c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.246+0000 7fc42f800640 1 --2- 172.21.15.137:0/4111662199 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc42815ced0 0x7fc4281671c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc41400c3a0 tx=0x7fc41400c7a0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.246+0000 7fc42f800640 1 -- 172.21.15.137:0/4111662199 shutdown_connections 2024-04-26T23:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.246+0000 7fc42f800640 1 --2- 172.21.15.137:0/4111662199 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc4080683b0 0x7fc40806a870 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.246+0000 7fc42f800640 1 --2- 172.21.15.137:0/4111662199 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc42815ced0 0x7fc4281671c0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.246+0000 7fc42f800640 1 --2- 172.21.15.137:0/4111662199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc42815d2b0 0x7fc428167700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.246+0000 7fc42f800640 1 --2- 172.21.15.137:0/4111662199 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4280b14a0 0x7fc4281538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.246+0000 7fc42f800640 1 -- 172.21.15.137:0/4111662199 >> 172.21.15.137:0/4111662199 conn(0x7fc42809ba60 msgr2=0x7fc4280ce070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.246+0000 7fc42f800640 1 -- 172.21.15.137:0/4111662199 shutdown_connections 2024-04-26T23:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.246+0000 7fc42f800640 1 -- 172.21.15.137:0/4111662199 wait complete. 2024-04-26T23:44:07.274 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T23:44:07.274 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:44:07.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.402+0000 7f88c5c00640 1 Processor -- start 2024-04-26T23:44:07.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.402+0000 7f88c5c00640 1 -- start start 2024-04-26T23:44:07.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.402+0000 7f88c5c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f88c01596f0 0x7f88c015f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:07.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.402+0000 7f88c5c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88c0073040 0x7f88c00afb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:07.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.402+0000 7f88c5c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88c0159ad0 con 0x7f88c00b5290 2024-04-26T23:44:07.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.402+0000 7f88c5c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f88c00b5a70 con 0x7f88c01596f0 2024-04-26T23:44:07.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.402+0000 7f88c5c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f88c00b5d50 con 0x7f88c0073040 2024-04-26T23:44:07.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.402+0000 7f88bea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f88c01596f0 0x7f88c015f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:07.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.402+0000 7f88b7e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f88c00b5290 0x7f88c0072930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:37610/0 (socket says 172.21.15.137:37610) 2024-04-26T23:44:07.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.402+0000 7f88b7e00640 1 -- 172.21.15.137:0/1271822376 learned_addr learned my addr 172.21.15.137:0/1271822376 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:07.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.402+0000 7f88bf400640 1 --2- 172.21.15.137:0/1271822376 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88c0073040 0x7f88c00afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:07.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.402+0000 7f88bea00640 1 -- 172.21.15.137:0/1271822376 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88c0073040 msgr2=0x7f88c00afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:07.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.402+0000 7f88bea00640 1 --2- 172.21.15.137:0/1271822376 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88c0073040 0x7f88c00afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.402+0000 7f88bea00640 1 -- 172.21.15.137:0/1271822376 >> v1:172.21.15.137:6789/0 conn(0x7f88c00b5290 legacy=0x7f88c0072930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:07.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.402+0000 7f88bea00640 1 -- 172.21.15.137:0/1271822376 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c00b6030 con 0x7f88c01596f0 2024-04-26T23:44:07.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.406+0000 7f88bea00640 1 --2- 172.21.15.137:0/1271822376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88c01596f0 0x7f88c015f630 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f88b00097c0 tx=0x7f88b001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa513a8becab028 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:07.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.406+0000 7f88be000640 1 -- 172.21.15.137:0/1271822376 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b00b2070 con 0x7f88c01596f0 2024-04-26T23:44:07.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.406+0000 7f88be000640 1 -- 172.21.15.137:0/1271822376 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b00ad640 con 0x7f88c01596f0 2024-04-26T23:44:07.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.406+0000 7f88be000640 1 -- 172.21.15.137:0/1271822376 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b00ada10 con 0x7f88c01596f0 2024-04-26T23:44:07.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.406+0000 7f88c5c00640 1 -- 172.21.15.137:0/1271822376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88c01596f0 msgr2=0x7f88c015f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:07.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.406+0000 7f88c5c00640 1 --2- 172.21.15.137:0/1271822376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88c01596f0 0x7f88c015f630 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f88b00097c0 tx=0x7f88b001c4a0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.406+0000 7f88c5c00640 1 -- 172.21.15.137:0/1271822376 shutdown_connections 2024-04-26T23:44:07.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.406+0000 7f88c5c00640 1 --2- 172.21.15.137:0/1271822376 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88c0073040 0x7f88c00afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.406+0000 7f88c5c00640 1 --2- 172.21.15.137:0/1271822376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88c01596f0 0x7f88c015f630 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.406+0000 7f88c5c00640 1 -- 172.21.15.137:0/1271822376 >> 172.21.15.137:0/1271822376 conn(0x7f88c00b3370 msgr2=0x7f88c00b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:07.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.406+0000 7f88c5c00640 1 -- 172.21.15.137:0/1271822376 shutdown_connections 2024-04-26T23:44:07.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.406+0000 7f88c5c00640 1 -- 172.21.15.137:0/1271822376 wait complete. 2024-04-26T23:44:07.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88c5c00640 1 Processor -- start 2024-04-26T23:44:07.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88c5c00640 1 -- start start 2024-04-26T23:44:07.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88c5c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88c0073040 0x7f88c015aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:07.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88c5c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88c00b5290 0x7f88c0156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:07.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88c5c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88c01596f0 0x7f88c01573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:07.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88c5c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f88c00b09e0 con 0x7f88c00b5290 2024-04-26T23:44:07.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88c5c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f88c00b0860 con 0x7f88c01596f0 2024-04-26T23:44:07.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88c5c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f88c00b0b60 con 0x7f88c0073040 2024-04-26T23:44:07.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88b7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88c00b5290 0x7f88c0156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:07.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88b7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88c00b5290 0x7f88c0156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42010/0 (socket says 172.21.15.137:42010) 2024-04-26T23:44:07.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88b7e00640 1 -- 172.21.15.137:0/4086866345 learned_addr learned my addr 172.21.15.137:0/4086866345 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:07.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88bea00640 1 --2- 172.21.15.137:0/4086866345 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88c0073040 0x7f88c015aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:07.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88bf400640 1 --2- 172.21.15.137:0/4086866345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88c01596f0 0x7f88c01573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:07.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88b7e00640 1 -- 172.21.15.137:0/4086866345 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88c0073040 msgr2=0x7f88c015aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:07.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88b7e00640 1 --2- 172.21.15.137:0/4086866345 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88c0073040 0x7f88c015aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88b7e00640 1 -- 172.21.15.137:0/4086866345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88c01596f0 msgr2=0x7f88c01573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:07.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88b7e00640 1 --2- 172.21.15.137:0/4086866345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88c01596f0 0x7f88c01573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88b7e00640 1 -- 172.21.15.137:0/4086866345 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c0159d60 con 0x7f88c00b5290 2024-04-26T23:44:07.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88b7e00640 1 --2- 172.21.15.137:0/4086866345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88c00b5290 0x7f88c0156580 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f88a800c420 tx=0x7f88a800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:07.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88b6a00640 1 -- 172.21.15.137:0/4086866345 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a8017070 con 0x7f88c00b5290 2024-04-26T23:44:07.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88b6a00640 1 -- 172.21.15.137:0/4086866345 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88a8005cf0 con 0x7f88c00b5290 2024-04-26T23:44:07.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88c5c00640 1 -- 172.21.15.137:0/4086866345 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c015a2e0 con 0x7f88c00b5290 2024-04-26T23:44:07.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88b6a00640 1 -- 172.21.15.137:0/4086866345 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a80072f0 con 0x7f88c00b5290 2024-04-26T23:44:07.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.410+0000 7f88c5c00640 1 -- 172.21.15.137:0/4086866345 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c0155a00 con 0x7f88c00b5290 2024-04-26T23:44:07.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.414+0000 7f88c5c00640 1 -- 172.21.15.137:0/4086866345 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88c006a4b0 con 0x7f88c00b5290 2024-04-26T23:44:07.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.414+0000 7f88b6a00640 1 -- 172.21.15.137:0/4086866345 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f88a801a070 con 0x7f88c00b5290 2024-04-26T23:44:07.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.414+0000 7f88b6a00640 1 --2- 172.21.15.137:0/4086866345 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f889c068380 0x7f889c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:07.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.414+0000 7f88b6a00640 1 -- 172.21.15.137:0/4086866345 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5810+0+0 (secure 0 0 0) 0x7f88a8085de0 con 0x7f88c00b5290 2024-04-26T23:44:07.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.414+0000 7f88bea00640 1 --2- 172.21.15.137:0/4086866345 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f889c068380 0x7f889c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:07.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.414+0000 7f88bea00640 1 --2- 172.21.15.137:0/4086866345 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f889c068380 0x7f889c06a840 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f88b00af000 tx=0x7f88b0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:07.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.418+0000 7f88b6a00640 1 -- 172.21.15.137:0/4086866345 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f88a8055c40 con 0x7f88c00b5290 2024-04-26T23:44:07.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.606+0000 7f88c5c00640 1 -- 172.21.15.137:0/4086866345 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88c015f040 con 0x7f88c00b5290 2024-04-26T23:44:07.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.606+0000 7f88b6a00640 1 -- 172.21.15.137:0/4086866345 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5207 (secure 0 0 0) 0x7f88a8059f40 con 0x7f88c00b5290 2024-04-26T23:44:07.615 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:07.615 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":29,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/145346644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":145346644},{"type":"v1","addr":"172.21.15.170:6835","nonce":145346644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5656,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3121910067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3121910067},{"type":"v1","addr":"172.21.15.170:6834","nonce":3121910067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:43:23.588817+0000","modified":"2024-04-26T23:43:43.311113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5838,"mds_1":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"c","rank":1,"incarnation":27,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6836/2120163779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2120163779},{"type":"v1","addr":"172.21.15.137:6836","nonce":2120163779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5838":{"gid":5838,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/547646153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":547646153},{"type":"v1","addr":"172.21.15.137:6837","nonce":547646153}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5838,"qdb_cluster":[5838,5835]},"id":3}]} 2024-04-26T23:44:07.615 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 29 2024-04-26T23:44:07.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.610+0000 7f88c5c00640 1 -- 172.21.15.137:0/4086866345 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f889c068380 msgr2=0x7f889c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:07.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.610+0000 7f88c5c00640 1 --2- 172.21.15.137:0/4086866345 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f889c068380 0x7f889c06a840 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f88b00af000 tx=0x7f88b0008040 comp rx=0 tx=0).stop 2024-04-26T23:44:07.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.610+0000 7f88c5c00640 1 -- 172.21.15.137:0/4086866345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88c00b5290 msgr2=0x7f88c0156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:07.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.610+0000 7f88c5c00640 1 --2- 172.21.15.137:0/4086866345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88c00b5290 0x7f88c0156580 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f88a800c420 tx=0x7f88a800c8e0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.610+0000 7f88c5c00640 1 -- 172.21.15.137:0/4086866345 shutdown_connections 2024-04-26T23:44:07.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.610+0000 7f88c5c00640 1 --2- 172.21.15.137:0/4086866345 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f889c068380 0x7f889c06a840 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.610+0000 7f88c5c00640 1 --2- 172.21.15.137:0/4086866345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88c00b5290 0x7f88c0156580 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.610+0000 7f88c5c00640 1 --2- 172.21.15.137:0/4086866345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88c01596f0 0x7f88c01573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.610+0000 7f88c5c00640 1 --2- 172.21.15.137:0/4086866345 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88c0073040 0x7f88c015aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.610+0000 7f88c5c00640 1 -- 172.21.15.137:0/4086866345 >> 172.21.15.137:0/4086866345 conn(0x7f88c00b3370 msgr2=0x7f88c0161570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:07.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.610+0000 7f88c5c00640 1 -- 172.21.15.137:0/4086866345 shutdown_connections 2024-04-26T23:44:07.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.610+0000 7f88c5c00640 1 -- 172.21.15.137:0/4086866345 wait complete. 2024-04-26T23:44:07.637 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:44:07.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.766+0000 7f6119c00640 1 Processor -- start 2024-04-26T23:44:07.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.766+0000 7f6119c00640 1 -- start start 2024-04-26T23:44:07.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.766+0000 7f6119c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f61140d1ac0 0x7f61140b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:07.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.766+0000 7f6119c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f611415d2b0 0x7f61140b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:07.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.766+0000 7f6119c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61140b1b30 con 0x7f611415ced0 2024-04-26T23:44:07.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.766+0000 7f6119c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f61140b1e10 con 0x7f61140d1ac0 2024-04-26T23:44:07.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.766+0000 7f6119c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f61140b23f0 con 0x7f611415d2b0 2024-04-26T23:44:07.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.766+0000 7f6112000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f61140d1ac0 0x7f61140b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:07.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.766+0000 7f6112000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f61140d1ac0 0x7f61140b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42018/0 (socket says 172.21.15.137:42018) 2024-04-26T23:44:07.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.766+0000 7f6112000640 1 -- 172.21.15.137:0/2147183235 learned_addr learned my addr 172.21.15.137:0/2147183235 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:07.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.770+0000 7f6113400640 1 --2- 172.21.15.137:0/2147183235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f611415d2b0 0x7f61140b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:07.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.770+0000 7f6112000640 1 -- 172.21.15.137:0/2147183235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f611415d2b0 msgr2=0x7f61140b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:07.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.770+0000 7f6112000640 1 --2- 172.21.15.137:0/2147183235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f611415d2b0 0x7f61140b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.770+0000 7f6112000640 1 -- 172.21.15.137:0/2147183235 >> v1:172.21.15.170:6789/0 conn(0x7f611415ced0 legacy=0x7f61140d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:07.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.770+0000 7f6112000640 1 -- 172.21.15.137:0/2147183235 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61140b26d0 con 0x7f61140d1ac0 2024-04-26T23:44:07.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.770+0000 7f6112000640 1 --2- 172.21.15.137:0/2147183235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61140d1ac0 0x7f61140b0d90 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6100009870 tx=0x7f610001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b7bdef9b4f2b00 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:07.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.770+0000 7f6111600640 1 -- 172.21.15.137:0/2147183235 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61000b2070 con 0x7f61140d1ac0 2024-04-26T23:44:07.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.770+0000 7f6111600640 1 -- 172.21.15.137:0/2147183235 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61000a9070 con 0x7f61140d1ac0 2024-04-26T23:44:07.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.770+0000 7f6111600640 1 -- 172.21.15.137:0/2147183235 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61000ad880 con 0x7f61140d1ac0 2024-04-26T23:44:07.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.770+0000 7f6119c00640 1 -- 172.21.15.137:0/2147183235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61140d1ac0 msgr2=0x7f61140b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:07.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.770+0000 7f6119c00640 1 --2- 172.21.15.137:0/2147183235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61140d1ac0 0x7f61140b0d90 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6100009870 tx=0x7f610001c560 comp rx=0 tx=0).stop 2024-04-26T23:44:07.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6119c00640 1 -- 172.21.15.137:0/2147183235 shutdown_connections 2024-04-26T23:44:07.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6119c00640 1 --2- 172.21.15.137:0/2147183235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f611415d2b0 0x7f61140b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6119c00640 1 --2- 172.21.15.137:0/2147183235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61140d1ac0 0x7f61140b0d90 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6119c00640 1 -- 172.21.15.137:0/2147183235 >> 172.21.15.137:0/2147183235 conn(0x7f611409ba60 msgr2=0x7f611409be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:07.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6119c00640 1 -- 172.21.15.137:0/2147183235 shutdown_connections 2024-04-26T23:44:07.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6119c00640 1 -- 172.21.15.137:0/2147183235 wait complete. 2024-04-26T23:44:07.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6119c00640 1 Processor -- start 2024-04-26T23:44:07.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6119c00640 1 -- start start 2024-04-26T23:44:07.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6119c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61140d1ac0 0x7f611414f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:07.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6119c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f611415ced0 0x7f61140caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:07.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6119c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f611415d2b0 0x7f61140cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:07.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6119c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f61140b3810 con 0x7f611415d2b0 2024-04-26T23:44:07.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6119c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f61140b3690 con 0x7f611415ced0 2024-04-26T23:44:07.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6119c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f61140b3990 con 0x7f61140d1ac0 2024-04-26T23:44:07.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6113400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f611415d2b0 0x7f61140cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:07.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6112a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61140d1ac0 0x7f611414f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:07.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6113400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f611415d2b0 0x7f61140cdf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42020/0 (socket says 172.21.15.137:42020) 2024-04-26T23:44:07.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6113400640 1 -- 172.21.15.137:0/1728104781 learned_addr learned my addr 172.21.15.137:0/1728104781 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:07.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6112000640 1 --2- 172.21.15.137:0/1728104781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f611415ced0 0x7f61140caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:07.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6113400640 1 -- 172.21.15.137:0/1728104781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61140d1ac0 msgr2=0x7f611414f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:07.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6113400640 1 --2- 172.21.15.137:0/1728104781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61140d1ac0 0x7f611414f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6113400640 1 -- 172.21.15.137:0/1728104781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f611415ced0 msgr2=0x7f61140caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:07.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6113400640 1 --2- 172.21.15.137:0/1728104781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f611415ced0 0x7f61140caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6113400640 1 -- 172.21.15.137:0/1728104781 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611415b180 con 0x7f611415d2b0 2024-04-26T23:44:07.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6113400640 1 --2- 172.21.15.137:0/1728104781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f611415d2b0 0x7f61140cdf50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f610c00d590 tx=0x7f610c00da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:07.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f610aa00640 1 -- 172.21.15.137:0/1728104781 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c0125f0 con 0x7f611415d2b0 2024-04-26T23:44:07.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f610aa00640 1 -- 172.21.15.137:0/1728104781 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f610c019070 con 0x7f611415d2b0 2024-04-26T23:44:07.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f610aa00640 1 -- 172.21.15.137:0/1728104781 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c0129f0 con 0x7f611415d2b0 2024-04-26T23:44:07.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.774+0000 7f6119c00640 1 -- 172.21.15.137:0/1728104781 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f611415b420 con 0x7f611415d2b0 2024-04-26T23:44:07.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.778+0000 7f6119c00640 1 -- 172.21.15.137:0/1728104781 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f611415b9e0 con 0x7f611415d2b0 2024-04-26T23:44:07.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.778+0000 7f6119c00640 1 -- 172.21.15.137:0/1728104781 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f611406a4b0 con 0x7f611415d2b0 2024-04-26T23:44:07.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.778+0000 7f610aa00640 1 -- 172.21.15.137:0/1728104781 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f610c012b90 con 0x7f611415d2b0 2024-04-26T23:44:07.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.778+0000 7f610aa00640 1 --2- 172.21.15.137:0/1728104781 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f60f4068380 0x7f60f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:07.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.778+0000 7f610aa00640 1 -- 172.21.15.137:0/1728104781 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5810+0+0 (secure 0 0 0) 0x7f610c086cc0 con 0x7f611415d2b0 2024-04-26T23:44:07.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.778+0000 7f6112a00640 1 --2- 172.21.15.137:0/1728104781 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f60f4068380 0x7f60f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:07.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.778+0000 7f6112a00640 1 --2- 172.21.15.137:0/1728104781 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f60f4068380 0x7f60f406a840 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f61140ccec0 tx=0x7f6104009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:07.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.782+0000 7f610aa00640 1 -- 172.21.15.137:0/1728104781 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f610c08d080 con 0x7f611415d2b0 2024-04-26T23:44:07.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.970+0000 7f6119c00640 1 -- 172.21.15.137:0/1728104781 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6114160800 con 0x7f611415d2b0 2024-04-26T23:44:07.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.970+0000 7f610aa00640 1 -- 172.21.15.137:0/1728104781 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5207 (secure 0 0 0) 0x7f610c056bb0 con 0x7f611415d2b0 2024-04-26T23:44:07.979 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:07.979 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":29,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/145346644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":145346644},{"type":"v1","addr":"172.21.15.170:6835","nonce":145346644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5656,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3121910067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3121910067},{"type":"v1","addr":"172.21.15.170:6834","nonce":3121910067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:43:23.588817+0000","modified":"2024-04-26T23:43:43.311113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5838,"mds_1":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"c","rank":1,"incarnation":27,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6836/2120163779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2120163779},{"type":"v1","addr":"172.21.15.137:6836","nonce":2120163779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5838":{"gid":5838,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/547646153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":547646153},{"type":"v1","addr":"172.21.15.137:6837","nonce":547646153}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5838,"qdb_cluster":[5838,5835]},"id":3}]} 2024-04-26T23:44:07.979 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 29 2024-04-26T23:44:07.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.974+0000 7f6119c00640 1 -- 172.21.15.137:0/1728104781 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f60f4068380 msgr2=0x7f60f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:07.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.974+0000 7f6119c00640 1 --2- 172.21.15.137:0/1728104781 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f60f4068380 0x7f60f406a840 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f61140ccec0 tx=0x7f6104009040 comp rx=0 tx=0).stop 2024-04-26T23:44:07.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.974+0000 7f6119c00640 1 -- 172.21.15.137:0/1728104781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f611415d2b0 msgr2=0x7f61140cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:07.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.974+0000 7f6119c00640 1 --2- 172.21.15.137:0/1728104781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f611415d2b0 0x7f61140cdf50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f610c00d590 tx=0x7f610c00da50 comp rx=0 tx=0).stop 2024-04-26T23:44:07.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.974+0000 7f6119c00640 1 -- 172.21.15.137:0/1728104781 shutdown_connections 2024-04-26T23:44:07.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.974+0000 7f6119c00640 1 --2- 172.21.15.137:0/1728104781 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f60f4068380 0x7f60f406a840 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.974+0000 7f6119c00640 1 --2- 172.21.15.137:0/1728104781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f611415d2b0 0x7f61140cdf50 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.974+0000 7f6119c00640 1 --2- 172.21.15.137:0/1728104781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f611415ced0 0x7f61140caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.974+0000 7f6119c00640 1 --2- 172.21.15.137:0/1728104781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61140d1ac0 0x7f611414f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:07.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.974+0000 7f6119c00640 1 -- 172.21.15.137:0/1728104781 >> 172.21.15.137:0/1728104781 conn(0x7f611409ba60 msgr2=0x7f61140d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:07.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.974+0000 7f6119c00640 1 -- 172.21.15.137:0/1728104781 shutdown_connections 2024-04-26T23:44:07.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:07.974+0000 7f6119c00640 1 -- 172.21.15.137:0/1728104781 wait complete. 2024-04-26T23:44:08.001 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:44:08.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.130+0000 7f1732200640 1 Processor -- start 2024-04-26T23:44:08.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.130+0000 7f1732200640 1 -- start start 2024-04-26T23:44:08.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.130+0000 7f1732200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f172c15ced0 0x7f172c0d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:08.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.130+0000 7f1732200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f172c15d2b0 0x7f172c0d18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:08.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.130+0000 7f1732200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f172c0b1b30 con 0x7f172c0b0d90 2024-04-26T23:44:08.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.130+0000 7f1732200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f172c0b18f0 con 0x7f172c15ced0 2024-04-26T23:44:08.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.130+0000 7f1732200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f172c0b1e10 con 0x7f172c15d2b0 2024-04-26T23:44:08.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.130+0000 7f172b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f172c15ced0 0x7f172c0d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:08.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.130+0000 7f172b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f172c15ced0 0x7f172c0d13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42032/0 (socket says 172.21.15.137:42032) 2024-04-26T23:44:08.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.130+0000 7f172b400640 1 -- 172.21.15.137:0/4204107202 learned_addr learned my addr 172.21.15.137:0/4204107202 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:08.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.130+0000 7f172aa00640 1 --2- 172.21.15.137:0/4204107202 >> v2:172.21.15.170:3300/0 conn(0x7f172c15d2b0 0x7f172c0d18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:08.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.130+0000 7f172b400640 1 -- 172.21.15.137:0/4204107202 >> v2:172.21.15.170:3300/0 conn(0x7f172c15d2b0 msgr2=0x7f172c0d18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:08.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.130+0000 7f172b400640 1 --2- 172.21.15.137:0/4204107202 >> v2:172.21.15.170:3300/0 conn(0x7f172c15d2b0 0x7f172c0d18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.130+0000 7f172b400640 1 -- 172.21.15.137:0/4204107202 >> v1:172.21.15.170:6789/0 conn(0x7f172c0b0d90 legacy=0x7f172c0b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:08.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.130+0000 7f172b400640 1 -- 172.21.15.137:0/4204107202 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f172c0b23f0 con 0x7f172c15ced0 2024-04-26T23:44:08.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.134+0000 7f172b400640 1 --2- 172.21.15.137:0/4204107202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f172c15ced0 0x7f172c0d13b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f172c074450 tx=0x7f171c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d016715fa4a370 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:08.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.134+0000 7f172a000640 1 -- 172.21.15.137:0/4204107202 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c0b0070 con 0x7f172c15ced0 2024-04-26T23:44:08.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.134+0000 7f172a000640 1 -- 172.21.15.137:0/4204107202 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f171c0ab600 con 0x7f172c15ced0 2024-04-26T23:44:08.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.134+0000 7f172a000640 1 -- 172.21.15.137:0/4204107202 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c0ab9d0 con 0x7f172c15ced0 2024-04-26T23:44:08.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.134+0000 7f1732200640 1 -- 172.21.15.137:0/4204107202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f172c15ced0 msgr2=0x7f172c0d13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:08.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.134+0000 7f1732200640 1 --2- 172.21.15.137:0/4204107202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f172c15ced0 0x7f172c0d13b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f172c074450 tx=0x7f171c01c520 comp rx=0 tx=0).stop 2024-04-26T23:44:08.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.134+0000 7f1732200640 1 -- 172.21.15.137:0/4204107202 shutdown_connections 2024-04-26T23:44:08.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.134+0000 7f1732200640 1 --2- 172.21.15.137:0/4204107202 >> v2:172.21.15.170:3300/0 conn(0x7f172c15d2b0 0x7f172c0d18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.134+0000 7f1732200640 1 --2- 172.21.15.137:0/4204107202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f172c15ced0 0x7f172c0d13b0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.134+0000 7f1732200640 1 -- 172.21.15.137:0/4204107202 >> 172.21.15.137:0/4204107202 conn(0x7f172c09ba60 msgr2=0x7f172c09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:08.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.134+0000 7f1732200640 1 -- 172.21.15.137:0/4204107202 shutdown_connections 2024-04-26T23:44:08.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.134+0000 7f1732200640 1 -- 172.21.15.137:0/4204107202 wait complete. 2024-04-26T23:44:08.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.134+0000 7f1732200640 1 Processor -- start 2024-04-26T23:44:08.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f1732200640 1 -- start start 2024-04-26T23:44:08.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f1732200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f172c0b0d90 0x7f172c0c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:08.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f1732200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f172c15ced0 0x7f172c166ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:08.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f1732200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f172c15d2b0 0x7f172c14a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:08.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f1732200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f172c0b37d0 con 0x7f172c15ced0 2024-04-26T23:44:08.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f1732200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f172c0b3650 con 0x7f172c0b0d90 2024-04-26T23:44:08.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f1732200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f172c0b3950 con 0x7f172c15d2b0 2024-04-26T23:44:08.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f172aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f172c15ced0 0x7f172c166ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:08.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f172aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f172c15ced0 0x7f172c166ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42048/0 (socket says 172.21.15.137:42048) 2024-04-26T23:44:08.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f172aa00640 1 -- 172.21.15.137:0/4152599558 learned_addr learned my addr 172.21.15.137:0/4152599558 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:08.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f172be00640 1 --2- 172.21.15.137:0/4152599558 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f172c15d2b0 0x7f172c14a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:08.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f172b400640 1 --2- 172.21.15.137:0/4152599558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f172c0b0d90 0x7f172c0c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:08.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f172aa00640 1 -- 172.21.15.137:0/4152599558 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f172c15d2b0 msgr2=0x7f172c14a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:08.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f172aa00640 1 --2- 172.21.15.137:0/4152599558 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f172c15d2b0 0x7f172c14a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f172aa00640 1 -- 172.21.15.137:0/4152599558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f172c0b0d90 msgr2=0x7f172c0c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:08.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f172aa00640 1 --2- 172.21.15.137:0/4152599558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f172c0b0d90 0x7f172c0c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f172aa00640 1 -- 172.21.15.137:0/4152599558 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f172c165280 con 0x7f172c15ced0 2024-04-26T23:44:08.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f172aa00640 1 --2- 172.21.15.137:0/4152599558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f172c15ced0 0x7f172c166ee0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f171800e8a0 tx=0x7f171800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:08.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f1723400640 1 -- 172.21.15.137:0/4152599558 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1718017070 con 0x7f172c15ced0 2024-04-26T23:44:08.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f1723400640 1 -- 172.21.15.137:0/4152599558 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f171800c940 con 0x7f172c15ced0 2024-04-26T23:44:08.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f1723400640 1 -- 172.21.15.137:0/4152599558 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171800ccf0 con 0x7f172c15ced0 2024-04-26T23:44:08.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f1732200640 1 -- 172.21.15.137:0/4152599558 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f172c165560 con 0x7f172c15ced0 2024-04-26T23:44:08.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f1732200640 1 -- 172.21.15.137:0/4152599558 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f172c165b20 con 0x7f172c15ced0 2024-04-26T23:44:08.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.138+0000 7f1732200640 1 -- 172.21.15.137:0/4152599558 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f172c06a4b0 con 0x7f172c15ced0 2024-04-26T23:44:08.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.142+0000 7f1723400640 1 -- 172.21.15.137:0/4152599558 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f171801a070 con 0x7f172c15ced0 2024-04-26T23:44:08.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.142+0000 7f1723400640 1 --2- 172.21.15.137:0/4152599558 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f170c068380 0x7f170c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:08.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.142+0000 7f1723400640 1 -- 172.21.15.137:0/4152599558 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5810+0+0 (secure 0 0 0) 0x7f1718086b60 con 0x7f172c15ced0 2024-04-26T23:44:08.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.142+0000 7f172b400640 1 --2- 172.21.15.137:0/4152599558 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f170c068380 0x7f170c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:08.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.142+0000 7f172b400640 1 --2- 172.21.15.137:0/4152599558 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f170c068380 0x7f170c06a840 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f171c0ad000 tx=0x7f171c0a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:08.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.146+0000 7f1723400640 1 -- 172.21.15.137:0/4152599558 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1718056af0 con 0x7f172c15ced0 2024-04-26T23:44:08.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.302+0000 7f1732200640 1 -- 172.21.15.137:0/4152599558 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f172c15b2a0 con 0x7f172c15ced0 2024-04-26T23:44:08.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.302+0000 7f1723400640 1 -- 172.21.15.137:0/4152599558 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16871 (secure 0 0 0) 0x7f171805adf0 con 0x7f172c15ced0 2024-04-26T23:44:08.312 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:08.312 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":48,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:44:05.720430+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:43:21.281556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T23:43:22.549121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":5}]},{"pgid":"7.2c","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/268105340":"2024-04-27T00:43:44.368539+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:44:08.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.306+0000 7f1732200640 1 -- 172.21.15.137:0/4152599558 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f170c068380 msgr2=0x7f170c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:08.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.306+0000 7f1732200640 1 --2- 172.21.15.137:0/4152599558 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f170c068380 0x7f170c06a840 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f171c0ad000 tx=0x7f171c0a6000 comp rx=0 tx=0).stop 2024-04-26T23:44:08.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.306+0000 7f1732200640 1 -- 172.21.15.137:0/4152599558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f172c15ced0 msgr2=0x7f172c166ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:08.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.306+0000 7f1732200640 1 --2- 172.21.15.137:0/4152599558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f172c15ced0 0x7f172c166ee0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f171800e8a0 tx=0x7f171800eca0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.306+0000 7f1732200640 1 -- 172.21.15.137:0/4152599558 shutdown_connections 2024-04-26T23:44:08.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.306+0000 7f1732200640 1 --2- 172.21.15.137:0/4152599558 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f170c068380 0x7f170c06a840 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.306+0000 7f1732200640 1 --2- 172.21.15.137:0/4152599558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f172c15ced0 0x7f172c166ee0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.306+0000 7f1732200640 1 --2- 172.21.15.137:0/4152599558 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f172c15d2b0 0x7f172c14a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.306+0000 7f1732200640 1 --2- 172.21.15.137:0/4152599558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f172c0b0d90 0x7f172c0c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.306+0000 7f1732200640 1 -- 172.21.15.137:0/4152599558 >> 172.21.15.137:0/4152599558 conn(0x7f172c09ba60 msgr2=0x7f172c15baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:08.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.306+0000 7f1732200640 1 -- 172.21.15.137:0/4152599558 shutdown_connections 2024-04-26T23:44:08.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.306+0000 7f1732200640 1 -- 172.21.15.137:0/4152599558 wait complete. 2024-04-26T23:44:08.334 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T23:44:08.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.466+0000 7f2f15c00640 1 Processor -- start 2024-04-26T23:44:08.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.466+0000 7f2f15c00640 1 -- start start 2024-04-26T23:44:08.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.466+0000 7f2f15c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2f100725a0 0x7f2f100cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:08.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.466+0000 7f2f15c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f100b5080 0x7f2f10165930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:08.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.466+0000 7f2f15c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f100cfef0 con 0x7f2f10073f30 2024-04-26T23:44:08.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.466+0000 7f2f15c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2f100cddc0 con 0x7f2f100725a0 2024-04-26T23:44:08.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.466+0000 7f2f15c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2f100d01b0 con 0x7f2f100b5080 2024-04-26T23:44:08.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.466+0000 7f2f0e000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f2f10073f30 0x7f2f10072980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:37620/0 (socket says 172.21.15.137:37620) 2024-04-26T23:44:08.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.466+0000 7f2f0e000640 1 -- 172.21.15.137:0/620636505 learned_addr learned my addr 172.21.15.137:0/620636505 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:08.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.466+0000 7f2f0ea00640 1 --2- 172.21.15.137:0/620636505 >> v2:172.21.15.137:3300/0 conn(0x7f2f100725a0 0x7f2f100cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:08.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.466+0000 7f2f0f400640 1 --2- 172.21.15.137:0/620636505 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f100b5080 0x7f2f10165930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:08.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.466+0000 7f2f0ea00640 1 -- 172.21.15.137:0/620636505 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f100b5080 msgr2=0x7f2f10165930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:08.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.466+0000 7f2f0ea00640 1 --2- 172.21.15.137:0/620636505 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f100b5080 0x7f2f10165930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.466+0000 7f2f0ea00640 1 -- 172.21.15.137:0/620636505 >> v1:172.21.15.137:6789/0 conn(0x7f2f10073f30 legacy=0x7f2f10072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:08.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.466+0000 7f2f0ea00640 1 -- 172.21.15.137:0/620636505 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f100d0490 con 0x7f2f100725a0 2024-04-26T23:44:08.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.470+0000 7f2f0ea00640 1 --2- 172.21.15.137:0/620636505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f100725a0 0x7f2f100cd770 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2f000097c0 tx=0x7f2f0001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72dfa7e7a793bd7e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:08.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.470+0000 7f2f0d600640 1 -- 172.21.15.137:0/620636505 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f000b2070 con 0x7f2f100725a0 2024-04-26T23:44:08.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.470+0000 7f2f0d600640 1 -- 172.21.15.137:0/620636505 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f000ad680 con 0x7f2f100725a0 2024-04-26T23:44:08.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.470+0000 7f2f0d600640 1 -- 172.21.15.137:0/620636505 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f000ada50 con 0x7f2f100725a0 2024-04-26T23:44:08.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.470+0000 7f2f15c00640 1 -- 172.21.15.137:0/620636505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f100725a0 msgr2=0x7f2f100cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:08.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.470+0000 7f2f15c00640 1 --2- 172.21.15.137:0/620636505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f100725a0 0x7f2f100cd770 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2f000097c0 tx=0x7f2f0001c470 comp rx=0 tx=0).stop 2024-04-26T23:44:08.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.470+0000 7f2f15c00640 1 -- 172.21.15.137:0/620636505 shutdown_connections 2024-04-26T23:44:08.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.470+0000 7f2f15c00640 1 --2- 172.21.15.137:0/620636505 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f100b5080 0x7f2f10165930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.470+0000 7f2f15c00640 1 --2- 172.21.15.137:0/620636505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f100725a0 0x7f2f100cd770 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.470+0000 7f2f15c00640 1 -- 172.21.15.137:0/620636505 >> 172.21.15.137:0/620636505 conn(0x7f2f1006c5d0 msgr2=0x7f2f1006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:08.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.470+0000 7f2f15c00640 1 -- 172.21.15.137:0/620636505 shutdown_connections 2024-04-26T23:44:08.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.470+0000 7f2f15c00640 1 -- 172.21.15.137:0/620636505 wait complete. 2024-04-26T23:44:08.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f15c00640 1 Processor -- start 2024-04-26T23:44:08.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f15c00640 1 -- start start 2024-04-26T23:44:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f15c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f100725a0 0x7f2f100b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f15c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f10073f30 0x7f2f101fae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f15c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f100b5080 0x7f2f1015e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f15c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2f10168a20 con 0x7f2f100725a0 2024-04-26T23:44:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f15c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2f101688a0 con 0x7f2f10073f30 2024-04-26T23:44:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f15c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2f10168ba0 con 0x7f2f100b5080 2024-04-26T23:44:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f0ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f100725a0 0x7f2f100b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f0ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f100725a0 0x7f2f100b0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42060/0 (socket says 172.21.15.137:42060) 2024-04-26T23:44:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f0ea00640 1 -- 172.21.15.137:0/2275706439 learned_addr learned my addr 172.21.15.137:0/2275706439 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f0e000640 1 --2- 172.21.15.137:0/2275706439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f10073f30 0x7f2f101fae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f0f400640 1 --2- 172.21.15.137:0/2275706439 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f100b5080 0x7f2f1015e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f0ea00640 1 -- 172.21.15.137:0/2275706439 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f100b5080 msgr2=0x7f2f1015e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f0ea00640 1 --2- 172.21.15.137:0/2275706439 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f100b5080 0x7f2f1015e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f0ea00640 1 -- 172.21.15.137:0/2275706439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f10073f30 msgr2=0x7f2f101fae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f0ea00640 1 --2- 172.21.15.137:0/2275706439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f10073f30 0x7f2f101fae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f0ea00640 1 -- 172.21.15.137:0/2275706439 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f100b0f30 con 0x7f2f100725a0 2024-04-26T23:44:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f0f400640 1 --2- 172.21.15.137:0/2275706439 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f100b5080 0x7f2f1015e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f0ea00640 1 --2- 172.21.15.137:0/2275706439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f100725a0 0x7f2f100b0850 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2f0001ab20 tx=0x7f2f0001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f06a00640 1 -- 172.21.15.137:0/2275706439 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f000b2040 con 0x7f2f100725a0 2024-04-26T23:44:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f06a00640 1 -- 172.21.15.137:0/2275706439 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f000be070 con 0x7f2f100725a0 2024-04-26T23:44:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f06a00640 1 -- 172.21.15.137:0/2275706439 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f000ade50 con 0x7f2f100725a0 2024-04-26T23:44:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f15c00640 1 -- 172.21.15.137:0/2275706439 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f100b1210 con 0x7f2f100725a0 2024-04-26T23:44:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f15c00640 1 -- 172.21.15.137:0/2275706439 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f100b17d0 con 0x7f2f100725a0 2024-04-26T23:44:08.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.474+0000 7f2f15c00640 1 -- 172.21.15.137:0/2275706439 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f1006a4b0 con 0x7f2f100725a0 2024-04-26T23:44:08.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.478+0000 7f2f06a00640 1 -- 172.21.15.137:0/2275706439 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2f000c3460 con 0x7f2f100725a0 2024-04-26T23:44:08.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.478+0000 7f2f06a00640 1 --2- 172.21.15.137:0/2275706439 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2ef0068520 0x7f2ef006a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:08.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.478+0000 7f2f06a00640 1 -- 172.21.15.137:0/2275706439 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5810+0+0 (secure 0 0 0) 0x7f2f00120e00 con 0x7f2f100725a0 2024-04-26T23:44:08.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.478+0000 7f2f0e000640 1 --2- 172.21.15.137:0/2275706439 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2ef0068520 0x7f2ef006a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:08.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.478+0000 7f2f0e000640 1 --2- 172.21.15.137:0/2275706439 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2ef0068520 0x7f2ef006a9e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2f1015f390 tx=0x7f2efc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:08.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.482+0000 7f2f06a00640 1 -- 172.21.15.137:0/2275706439 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2f00016090 con 0x7f2f100725a0 2024-04-26T23:44:08.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.678+0000 7f2f15c00640 1 -- 172.21.15.137:0/2275706439 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2f10072380 con 0x7f2f100725a0 2024-04-26T23:44:08.684 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-04-26T23:44:08.678+0000 7f1be8800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T23:44:08.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.678+0000 7f2f06a00640 1 -- 172.21.15.137:0/2275706439 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) ==== 161+0+0 (secure 0 0 0) 0x7f2f000f12c0 con 0x7f2f100725a0 2024-04-26T23:44:08.687 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T23:44:08.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.682+0000 7f2f15c00640 1 -- 172.21.15.137:0/2275706439 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2ef0068520 msgr2=0x7f2ef006a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:08.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.682+0000 7f2f15c00640 1 --2- 172.21.15.137:0/2275706439 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2ef0068520 0x7f2ef006a9e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2f1015f390 tx=0x7f2efc009040 comp rx=0 tx=0).stop 2024-04-26T23:44:08.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.682+0000 7f2f15c00640 1 -- 172.21.15.137:0/2275706439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f100725a0 msgr2=0x7f2f100b0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:08.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.682+0000 7f2f15c00640 1 --2- 172.21.15.137:0/2275706439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f100725a0 0x7f2f100b0850 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2f0001ab20 tx=0x7f2f0001acb0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.682+0000 7f2f15c00640 1 -- 172.21.15.137:0/2275706439 shutdown_connections 2024-04-26T23:44:08.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.682+0000 7f2f15c00640 1 --2- 172.21.15.137:0/2275706439 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2ef0068520 0x7f2ef006a9e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.682+0000 7f2f15c00640 1 --2- 172.21.15.137:0/2275706439 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f100b5080 0x7f2f1015e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.682+0000 7f2f15c00640 1 --2- 172.21.15.137:0/2275706439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f10073f30 0x7f2f101fae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.682+0000 7f2f15c00640 1 --2- 172.21.15.137:0/2275706439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f100725a0 0x7f2f100b0850 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.682+0000 7f2f15c00640 1 -- 172.21.15.137:0/2275706439 >> 172.21.15.137:0/2275706439 conn(0x7f2f1006c5d0 msgr2=0x7f2f1015de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:08.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.682+0000 7f2f15c00640 1 -- 172.21.15.137:0/2275706439 shutdown_connections 2024-04-26T23:44:08.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.682+0000 7f2f15c00640 1 -- 172.21.15.137:0/2275706439 wait complete. 2024-04-26T23:44:08.703 INFO:tasks.ceph.mds.a.smithi137.stderr: -8502> 2024-04-26T23:43:29.178+0000 7f871a200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:44:08.713 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T23:44:08.747 INFO:tasks.ceph.mds.c.smithi137.stdout:starting mds.c at 2024-04-26T23:44:08.762 INFO:tasks.ceph.mds.a.smithi137.stdout:starting mds.a at 2024-04-26T23:44:08.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.850+0000 7f2cd1800640 1 Processor -- start 2024-04-26T23:44:08.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.850+0000 7f2cd1800640 1 -- start start 2024-04-26T23:44:08.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.850+0000 7f2cd1800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2ccc0d0890 0x7f2ccc1630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:08.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.850+0000 7f2cd1800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2ccc0b8530 0x7f2ccc0cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:08.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.850+0000 7f2cd1800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ccc15f9a0 con 0x7f2ccc15f5c0 2024-04-26T23:44:08.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.850+0000 7f2cd1800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2ccc164080 con 0x7f2ccc0b8530 2024-04-26T23:44:08.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.850+0000 7f2cd1800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f2ccc1637e0 con 0x7f2ccc0d0890 2024-04-26T23:44:08.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.850+0000 7f2ccb400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2ccc0b8530 0x7f2ccc0cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:08.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.850+0000 7f2ccb400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2ccc0b8530 0x7f2ccc0cfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42106/0 (socket says 172.21.15.137:42106) 2024-04-26T23:44:08.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.850+0000 7f2ccb400640 1 -- 172.21.15.137:0/88606300 learned_addr learned my addr 172.21.15.137:0/88606300 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:08.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.850+0000 7f2cc2000640 1 --2- 172.21.15.137:0/88606300 >> v2:172.21.15.170:3300/0 conn(0x7f2ccc0d0890 0x7f2ccc1630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:08.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.850+0000 7f2ccb400640 1 -- 172.21.15.137:0/88606300 >> v2:172.21.15.170:3300/0 conn(0x7f2ccc0d0890 msgr2=0x7f2ccc1630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:08.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.850+0000 7f2ccb400640 1 --2- 172.21.15.137:0/88606300 >> v2:172.21.15.170:3300/0 conn(0x7f2ccc0d0890 0x7f2ccc1630e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.850+0000 7f2ccb400640 1 -- 172.21.15.137:0/88606300 >> v1:172.21.15.170:6789/0 conn(0x7f2ccc15f5c0 legacy=0x7f2ccc0d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:08.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.850+0000 7f2ccb400640 1 -- 172.21.15.137:0/88606300 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ccc163ac0 con 0x7f2ccc0b8530 2024-04-26T23:44:08.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.850+0000 7f2cc2000640 1 --2- 172.21.15.137:0/88606300 >> v2:172.21.15.170:3300/0 conn(0x7f2ccc0d0890 0x7f2ccc1630e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:08.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.854+0000 7f2ccb400640 1 --2- 172.21.15.137:0/88606300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ccc0b8530 0x7f2ccc0cfae0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0d2fd0 tx=0x7f2cc401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a48942bdce55d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:08.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.854+0000 7f2cca000640 1 -- 172.21.15.137:0/88606300 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc40b0070 con 0x7f2ccc0b8530 2024-04-26T23:44:08.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.854+0000 7f2cca000640 1 -- 172.21.15.137:0/88606300 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc40ab600 con 0x7f2ccc0b8530 2024-04-26T23:44:08.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.854+0000 7f2cca000640 1 -- 172.21.15.137:0/88606300 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc40ab9d0 con 0x7f2ccc0b8530 2024-04-26T23:44:08.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.854+0000 7f2cd1800640 1 -- 172.21.15.137:0/88606300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ccc0b8530 msgr2=0x7f2ccc0cfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:08.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.854+0000 7f2cd1800640 1 --2- 172.21.15.137:0/88606300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ccc0b8530 0x7f2ccc0cfae0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0d2fd0 tx=0x7f2cc401c450 comp rx=0 tx=0).stop 2024-04-26T23:44:08.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.854+0000 7f2cd1800640 1 -- 172.21.15.137:0/88606300 shutdown_connections 2024-04-26T23:44:08.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.854+0000 7f2cd1800640 1 --2- 172.21.15.137:0/88606300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ccc0b8530 0x7f2ccc0cfae0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.854+0000 7f2cd1800640 1 --2- 172.21.15.137:0/88606300 >> v2:172.21.15.170:3300/0 conn(0x7f2ccc0d0890 0x7f2ccc1630e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.854+0000 7f2cd1800640 1 -- 172.21.15.137:0/88606300 >> 172.21.15.137:0/88606300 conn(0x7f2ccc0b6de0 msgr2=0x7f2ccc0b71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:08.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.854+0000 7f2cd1800640 1 -- 172.21.15.137:0/88606300 shutdown_connections 2024-04-26T23:44:08.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.854+0000 7f2cd1800640 1 -- 172.21.15.137:0/88606300 wait complete. 2024-04-26T23:44:08.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2cd1800640 1 Processor -- start 2024-04-26T23:44:08.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2cd1800640 1 -- start start 2024-04-26T23:44:08.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2cd1800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ccc0b8530 0x7f2ccc1575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:08.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2cd1800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ccc0d0890 0x7f2ccc0c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:08.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2cd1800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ccc15f5c0 0x7f2ccc0b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:08.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2cd1800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc0d4480 con 0x7f2ccc15f5c0 2024-04-26T23:44:08.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2cd1800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc0d4300 con 0x7f2ccc0b8530 2024-04-26T23:44:08.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2cd1800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2ccc0d4600 con 0x7f2ccc0d0890 2024-04-26T23:44:08.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2ccb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ccc15f5c0 0x7f2ccc0b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:08.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2ccb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ccc15f5c0 0x7f2ccc0b6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42120/0 (socket says 172.21.15.137:42120) 2024-04-26T23:44:08.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2ccb400640 1 -- 172.21.15.137:0/2752076032 learned_addr learned my addr 172.21.15.137:0/2752076032 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:08.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2ccaa00640 1 --2- 172.21.15.137:0/2752076032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ccc0b8530 0x7f2ccc1575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:08.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2cc2000640 1 --2- 172.21.15.137:0/2752076032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ccc0d0890 0x7f2ccc0c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:08.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2ccb400640 1 -- 172.21.15.137:0/2752076032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ccc0d0890 msgr2=0x7f2ccc0c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:08.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2ccb400640 1 --2- 172.21.15.137:0/2752076032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ccc0d0890 0x7f2ccc0c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2ccb400640 1 -- 172.21.15.137:0/2752076032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ccc0b8530 msgr2=0x7f2ccc1575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:08.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2ccb400640 1 --2- 172.21.15.137:0/2752076032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ccc0b8530 0x7f2ccc1575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:08.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2ccb400640 1 -- 172.21.15.137:0/2752076032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ccc158ec0 con 0x7f2ccc15f5c0 2024-04-26T23:44:08.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2ccb400640 1 --2- 172.21.15.137:0/2752076032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ccc15f5c0 0x7f2ccc0b6010 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40ae040 tx=0x7f2cc401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:08.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2cc3400640 1 -- 172.21.15.137:0/2752076032 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc40ba020 con 0x7f2ccc15f5c0 2024-04-26T23:44:08.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2cc3400640 1 -- 172.21.15.137:0/2752076032 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc40b6640 con 0x7f2ccc15f5c0 2024-04-26T23:44:08.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2cd1800640 1 -- 172.21.15.137:0/2752076032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ccc158900 con 0x7f2ccc15f5c0 2024-04-26T23:44:08.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2cc3400640 1 -- 172.21.15.137:0/2752076032 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc40b0040 con 0x7f2ccc15f5c0 2024-04-26T23:44:08.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.858+0000 7f2cd1800640 1 -- 172.21.15.137:0/2752076032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ccc0cdda0 con 0x7f2ccc15f5c0 2024-04-26T23:44:08.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.862+0000 7f2cd1800640 1 -- 172.21.15.137:0/2752076032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ccc06a410 con 0x7f2ccc15f5c0 2024-04-26T23:44:08.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.862+0000 7f2cc3400640 1 -- 172.21.15.137:0/2752076032 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2cc40bd020 con 0x7f2ccc15f5c0 2024-04-26T23:44:08.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.862+0000 7f2cc3400640 1 --2- 172.21.15.137:0/2752076032 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2ca8068380 0x7f2ca806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:08.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.862+0000 7f2cc3400640 1 -- 172.21.15.137:0/2752076032 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5982+0+0 (secure 0 0 0) 0x7f2cc4120b50 con 0x7f2ccc15f5c0 2024-04-26T23:44:08.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.862+0000 7f2ccaa00640 1 --2- 172.21.15.137:0/2752076032 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2ca8068380 0x7f2ca806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:08.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.862+0000 7f2ccaa00640 1 --2- 172.21.15.137:0/2752076032 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2ca8068380 0x7f2ca806a840 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00b450 tx=0x7f2cbc00d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:08.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:08.866+0000 7f2cc3400640 1 -- 172.21.15.137:0/2752076032 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2cc40c4030 con 0x7f2ccc15f5c0 2024-04-26T23:44:09.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.054+0000 7f2cd1800640 1 -- 172.21.15.137:0/2752076032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2ccc0d3000 con 0x7f2ccc15f5c0 2024-04-26T23:44:09.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.738+0000 7f2cc3400640 1 -- 172.21.15.137:0/2752076032 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7f2cc40160d0 con 0x7f2ccc15f5c0 2024-04-26T23:44:09.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.738+0000 7f2cd1800640 1 -- 172.21.15.137:0/2752076032 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2ca8068380 msgr2=0x7f2ca806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:09.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.738+0000 7f2cd1800640 1 --2- 172.21.15.137:0/2752076032 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2ca8068380 0x7f2ca806a840 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00b450 tx=0x7f2cbc00d040 comp rx=0 tx=0).stop 2024-04-26T23:44:09.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.738+0000 7f2cd1800640 1 -- 172.21.15.137:0/2752076032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ccc15f5c0 msgr2=0x7f2ccc0b6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:09.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.738+0000 7f2cd1800640 1 --2- 172.21.15.137:0/2752076032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ccc15f5c0 0x7f2ccc0b6010 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40ae040 tx=0x7f2cc401ac90 comp rx=0 tx=0).stop 2024-04-26T23:44:09.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.738+0000 7f2cd1800640 1 -- 172.21.15.137:0/2752076032 shutdown_connections 2024-04-26T23:44:09.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.738+0000 7f2cd1800640 1 --2- 172.21.15.137:0/2752076032 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2ca8068380 0x7f2ca806a840 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:09.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.738+0000 7f2cd1800640 1 --2- 172.21.15.137:0/2752076032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ccc15f5c0 0x7f2ccc0b6010 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:09.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.738+0000 7f2cd1800640 1 --2- 172.21.15.137:0/2752076032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ccc0d0890 0x7f2ccc0c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:09.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.738+0000 7f2cd1800640 1 --2- 172.21.15.137:0/2752076032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ccc0b8530 0x7f2ccc1575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:09.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.738+0000 7f2cd1800640 1 -- 172.21.15.137:0/2752076032 >> 172.21.15.137:0/2752076032 conn(0x7f2ccc0b6de0 msgr2=0x7f2ccc06cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:09.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.738+0000 7f2cd1800640 1 -- 172.21.15.137:0/2752076032 shutdown_connections 2024-04-26T23:44:09.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.738+0000 7f2cd1800640 1 -- 172.21.15.137:0/2752076032 wait complete. 2024-04-26T23:44:09.771 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T23:44:09.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.942+0000 7f29f1600640 1 Processor -- start 2024-04-26T23:44:09.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.942+0000 7f29f1600640 1 -- start start 2024-04-26T23:44:09.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.946+0000 7f29f1600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29ec13f110 0x7f29ec073a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:09.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.946+0000 7f29f1600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f29ec073f40 0x7f29ec0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:09.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.946+0000 7f29f1600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29ec06d240 con 0x7f29ec0cfc00 2024-04-26T23:44:09.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.946+0000 7f29f1600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f29ec13f660 con 0x7f29ec073f40 2024-04-26T23:44:09.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.946+0000 7f29f1600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f29ec0d0410 con 0x7f29ec13f110 2024-04-26T23:44:09.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.946+0000 7f29e2000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f29ec073f40 0x7f29ec0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:09.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.946+0000 7f29eb400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f29ec0cfc00 0x7f29ec1416b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:37654/0 (socket says 172.21.15.137:37654) 2024-04-26T23:44:09.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.946+0000 7f29eb400640 1 -- 172.21.15.137:0/755013543 learned_addr learned my addr 172.21.15.137:0/755013543 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:09.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.946+0000 7f29eaa00640 1 --2- 172.21.15.137:0/755013543 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29ec13f110 0x7f29ec073a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:09.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.946+0000 7f29e2000640 1 -- 172.21.15.137:0/755013543 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29ec13f110 msgr2=0x7f29ec073a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:09.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.946+0000 7f29e2000640 1 --2- 172.21.15.137:0/755013543 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29ec13f110 0x7f29ec073a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:09.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.946+0000 7f29e2000640 1 -- 172.21.15.137:0/755013543 >> v1:172.21.15.137:6789/0 conn(0x7f29ec0cfc00 legacy=0x7f29ec1416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:09.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.946+0000 7f29e2000640 1 -- 172.21.15.137:0/755013543 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29ec0d06f0 con 0x7f29ec073f40 2024-04-26T23:44:09.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.946+0000 7f29ea000640 1 -- 172.21.15.137:0/755013543 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1741600847 0 0) 0x7f29ec06d240 con 0x7f29ec0cfc00 2024-04-26T23:44:09.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.950+0000 7f29e2000640 1 --2- 172.21.15.137:0/755013543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29ec073f40 0x7f29ec0cf6c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f29d40097c0 tx=0x7f29d401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc72a4a743686f79 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:09.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.950+0000 7f29ea000640 1 -- 172.21.15.137:0/755013543 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d40b1070 con 0x7f29ec073f40 2024-04-26T23:44:09.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.950+0000 7f29ea000640 1 -- 172.21.15.137:0/755013543 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d40ac410 con 0x7f29ec073f40 2024-04-26T23:44:09.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.950+0000 7f29ea000640 1 -- 172.21.15.137:0/755013543 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d40ac7e0 con 0x7f29ec073f40 2024-04-26T23:44:09.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.950+0000 7f29f1600640 1 -- 172.21.15.137:0/755013543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29ec073f40 msgr2=0x7f29ec0cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:09.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.950+0000 7f29f1600640 1 --2- 172.21.15.137:0/755013543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29ec073f40 0x7f29ec0cf6c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f29d40097c0 tx=0x7f29d401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:44:09.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.950+0000 7f29f1600640 1 -- 172.21.15.137:0/755013543 shutdown_connections 2024-04-26T23:44:09.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.950+0000 7f29f1600640 1 --2- 172.21.15.137:0/755013543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29ec073f40 0x7f29ec0cf6c0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:09.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.950+0000 7f29f1600640 1 --2- 172.21.15.137:0/755013543 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29ec13f110 0x7f29ec073a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:09.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.950+0000 7f29f1600640 1 -- 172.21.15.137:0/755013543 >> 172.21.15.137:0/755013543 conn(0x7f29ec06e2d0 msgr2=0x7f29ec06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:09.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.950+0000 7f29f1600640 1 -- 172.21.15.137:0/755013543 shutdown_connections 2024-04-26T23:44:09.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.950+0000 7f29f1600640 1 -- 172.21.15.137:0/755013543 wait complete. 2024-04-26T23:44:09.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.950+0000 7f29f1600640 1 Processor -- start 2024-04-26T23:44:09.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.950+0000 7f29f1600640 1 -- start start 2024-04-26T23:44:09.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29f1600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29ec073f40 0x7f29ec155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:09.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29f1600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29ec0cfc00 0x7f29ec155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:09.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29f1600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29ec13f110 0x7f29ec15c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:09.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29f1600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f29ec168d90 con 0x7f29ec0cfc00 2024-04-26T23:44:09.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29f1600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f29ec168c10 con 0x7f29ec13f110 2024-04-26T23:44:09.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29f1600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f29ec168f10 con 0x7f29ec073f40 2024-04-26T23:44:09.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29e2000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29ec0cfc00 0x7f29ec155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:09.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29e2000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29ec0cfc00 0x7f29ec155ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42130/0 (socket says 172.21.15.137:42130) 2024-04-26T23:44:09.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29e2000640 1 -- 172.21.15.137:0/3954921991 learned_addr learned my addr 172.21.15.137:0/3954921991 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:09.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29eb400640 1 --2- 172.21.15.137:0/3954921991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29ec13f110 0x7f29ec15c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:09.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29eaa00640 1 --2- 172.21.15.137:0/3954921991 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29ec073f40 0x7f29ec155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:09.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29e2000640 1 -- 172.21.15.137:0/3954921991 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29ec073f40 msgr2=0x7f29ec155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:09.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29e2000640 1 --2- 172.21.15.137:0/3954921991 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29ec073f40 0x7f29ec155660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:09.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29e2000640 1 -- 172.21.15.137:0/3954921991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29ec13f110 msgr2=0x7f29ec15c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:09.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29e2000640 1 --2- 172.21.15.137:0/3954921991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29ec13f110 0x7f29ec15c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:09.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29e2000640 1 -- 172.21.15.137:0/3954921991 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29ec143360 con 0x7f29ec0cfc00 2024-04-26T23:44:09.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29eb400640 1 --2- 172.21.15.137:0/3954921991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29ec13f110 0x7f29ec15c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:09.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29eaa00640 1 --2- 172.21.15.137:0/3954921991 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29ec073f40 0x7f29ec155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:09.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29e2000640 1 --2- 172.21.15.137:0/3954921991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29ec0cfc00 0x7f29ec155ba0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f29d40af040 tx=0x7f29d4019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:09.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29e3400640 1 -- 172.21.15.137:0/3954921991 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d40b1040 con 0x7f29ec0cfc00 2024-04-26T23:44:09.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29e3400640 1 -- 172.21.15.137:0/3954921991 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d40bb070 con 0x7f29ec0cfc00 2024-04-26T23:44:09.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29f1600640 1 -- 172.21.15.137:0/3954921991 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29ec143640 con 0x7f29ec0cfc00 2024-04-26T23:44:09.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29e3400640 1 -- 172.21.15.137:0/3954921991 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d40b5670 con 0x7f29ec0cfc00 2024-04-26T23:44:09.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29f1600640 1 -- 172.21.15.137:0/3954921991 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29ec143c00 con 0x7f29ec0cfc00 2024-04-26T23:44:09.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29f1600640 1 -- 172.21.15.137:0/3954921991 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29ec0765d0 con 0x7f29ec0cfc00 2024-04-26T23:44:09.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.954+0000 7f29e3400640 1 -- 172.21.15.137:0/3954921991 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f29d40b5810 con 0x7f29ec0cfc00 2024-04-26T23:44:09.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.958+0000 7f29e3400640 1 --2- 172.21.15.137:0/3954921991 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f29c8068380 0x7f29c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:09.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.958+0000 7f29e3400640 1 -- 172.21.15.137:0/3954921991 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5982+0+0 (secure 0 0 0) 0x7f29d4120690 con 0x7f29ec0cfc00 2024-04-26T23:44:09.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.958+0000 7f29eaa00640 1 --2- 172.21.15.137:0/3954921991 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f29c8068380 0x7f29c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:09.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.958+0000 7f29eaa00640 1 --2- 172.21.15.137:0/3954921991 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f29c8068380 0x7f29c806a840 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f29ec144610 tx=0x7f29dc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:09.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:09.962+0000 7f29e3400640 1 -- 172.21.15.137:0/3954921991 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f29d4016090 con 0x7f29ec0cfc00 2024-04-26T23:44:10.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.118+0000 7f29f1600640 1 -- 172.21.15.137:0/3954921991 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f29ec143dd0 con 0x7f29ec0cfc00 2024-04-26T23:44:10.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.746+0000 7f29e3400640 1 -- 172.21.15.137:0/3954921991 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v50) ==== 181+0+0 (secure 0 0 0) 0x7f29d40f0aa0 con 0x7f29ec0cfc00 2024-04-26T23:44:10.753 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' removed 2024-04-26T23:44:10.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.750+0000 7f29f1600640 1 -- 172.21.15.137:0/3954921991 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f29c8068380 msgr2=0x7f29c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:10.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.750+0000 7f29f1600640 1 --2- 172.21.15.137:0/3954921991 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f29c8068380 0x7f29c806a840 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f29ec144610 tx=0x7f29dc008040 comp rx=0 tx=0).stop 2024-04-26T23:44:10.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.750+0000 7f29f1600640 1 -- 172.21.15.137:0/3954921991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29ec0cfc00 msgr2=0x7f29ec155ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:10.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.750+0000 7f29f1600640 1 --2- 172.21.15.137:0/3954921991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29ec0cfc00 0x7f29ec155ba0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f29d40af040 tx=0x7f29d4019240 comp rx=0 tx=0).stop 2024-04-26T23:44:10.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.750+0000 7f29f1600640 1 -- 172.21.15.137:0/3954921991 shutdown_connections 2024-04-26T23:44:10.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.750+0000 7f29f1600640 1 --2- 172.21.15.137:0/3954921991 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f29c8068380 0x7f29c806a840 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:10.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.750+0000 7f29f1600640 1 --2- 172.21.15.137:0/3954921991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29ec0cfc00 0x7f29ec155ba0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:10.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.750+0000 7f29f1600640 1 --2- 172.21.15.137:0/3954921991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29ec13f110 0x7f29ec15c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:10.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.750+0000 7f29f1600640 1 --2- 172.21.15.137:0/3954921991 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29ec073f40 0x7f29ec155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:10.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.750+0000 7f29f1600640 1 -- 172.21.15.137:0/3954921991 >> 172.21.15.137:0/3954921991 conn(0x7f29ec06e2d0 msgr2=0x7f29ec15b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:10.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.750+0000 7f29f1600640 1 -- 172.21.15.137:0/3954921991 shutdown_connections 2024-04-26T23:44:10.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.750+0000 7f29f1600640 1 -- 172.21.15.137:0/3954921991 wait complete. 2024-04-26T23:44:10.779 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T23:44:10.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.914+0000 7fc9e2e00640 1 Processor -- start 2024-04-26T23:44:10.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.914+0000 7fc9e2e00640 1 -- start start 2024-04-26T23:44:10.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.914+0000 7fc9e2e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc9dc06f860 0x7fc9dc0cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:10.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.914+0000 7fc9e2e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9dc15db00 con 0x7fc9dc0727d0 2024-04-26T23:44:10.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.914+0000 7fc9e2e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9dc0cf0a0 con 0x7fc9dc145670 2024-04-26T23:44:10.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.914+0000 7fc9e2e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc9dc0cee50 con 0x7fc9dc06f860 2024-04-26T23:44:10.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.914+0000 7fc9e1000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc9dc0727d0 0x7fc9dc06f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:33260/0 (socket says 172.21.15.137:33260) 2024-04-26T23:44:10.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.914+0000 7fc9e1000640 1 -- 172.21.15.137:0/3594594804 learned_addr learned my addr 172.21.15.137:0/3594594804 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:10.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.914+0000 7fc9e2400640 1 --2- 172.21.15.137:0/3594594804 >> v2:172.21.15.137:3300/0 conn(0x7fc9dc06f860 0x7fc9dc0cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:10.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.918+0000 7fc9e2400640 1 -- 172.21.15.137:0/3594594804 >> v1:172.21.15.170:6789/0 conn(0x7fc9dc145670 legacy=0x7fc9dc15d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:10.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.918+0000 7fc9e2400640 1 -- 172.21.15.137:0/3594594804 >> v1:172.21.15.137:6789/0 conn(0x7fc9dc0727d0 legacy=0x7fc9dc06f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:10.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.918+0000 7fc9e2400640 1 -- 172.21.15.137:0/3594594804 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9dc0cf380 con 0x7fc9dc06f860 2024-04-26T23:44:10.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.918+0000 7fc9dbe00640 1 -- 172.21.15.137:0/3594594804 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2282664874 0 0) 0x7fc9dc15db00 con 0x7fc9dc0727d0 2024-04-26T23:44:10.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.918+0000 7fc9e2400640 1 --2- 172.21.15.137:0/3594594804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9dc06f860 0x7fc9dc0cfe60 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40097c0 tx=0x7fc9d401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7531aafdcadd27e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:10.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.918+0000 7fc9dbe00640 1 -- 172.21.15.137:0/3594594804 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d40b0070 con 0x7fc9dc06f860 2024-04-26T23:44:10.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.918+0000 7fc9dbe00640 1 -- 172.21.15.137:0/3594594804 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9d40ab600 con 0x7fc9dc06f860 2024-04-26T23:44:10.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.918+0000 7fc9dbe00640 1 -- 172.21.15.137:0/3594594804 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d40ab9d0 con 0x7fc9dc06f860 2024-04-26T23:44:10.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e2e00640 1 -- 172.21.15.137:0/3594594804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9dc06f860 msgr2=0x7fc9dc0cfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:10.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e2e00640 1 --2- 172.21.15.137:0/3594594804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9dc06f860 0x7fc9dc0cfe60 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40097c0 tx=0x7fc9d401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:44:10.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e2e00640 1 -- 172.21.15.137:0/3594594804 shutdown_connections 2024-04-26T23:44:10.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e2e00640 1 --2- 172.21.15.137:0/3594594804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9dc06f860 0x7fc9dc0cfe60 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:10.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e2e00640 1 -- 172.21.15.137:0/3594594804 >> 172.21.15.137:0/3594594804 conn(0x7fc9dc0b2830 msgr2=0x7fc9dc0b2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:10.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e2e00640 1 -- 172.21.15.137:0/3594594804 shutdown_connections 2024-04-26T23:44:10.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e2e00640 1 -- 172.21.15.137:0/3594594804 wait complete. 2024-04-26T23:44:10.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e2e00640 1 Processor -- start 2024-04-26T23:44:10.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e2e00640 1 -- start start 2024-04-26T23:44:10.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e2e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc9dc06f860 0x7fc9dc15b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:10.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e2e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9dc0727d0 0x7fc9dc1fb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:10.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e2e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9dc145670 0x7fc9dc141110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:10.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e2e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc145a50 con 0x7fc9dc0727d0 2024-04-26T23:44:10.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e2e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc0cf9d0 con 0x7fc9dc145670 2024-04-26T23:44:10.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e2e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc9dc16a260 con 0x7fc9dc06f860 2024-04-26T23:44:10.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e1000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9dc0727d0 0x7fc9dc1fb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:10.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e1000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9dc0727d0 0x7fc9dc1fb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40606/0 (socket says 172.21.15.137:40606) 2024-04-26T23:44:10.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e1000640 1 -- 172.21.15.137:0/2130668293 learned_addr learned my addr 172.21.15.137:0/2130668293 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:10.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e2400640 1 --2- 172.21.15.137:0/2130668293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9dc145670 0x7fc9dc141110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:10.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e1a00640 1 --2- 172.21.15.137:0/2130668293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc9dc06f860 0x7fc9dc15b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:10.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e1000640 1 -- 172.21.15.137:0/2130668293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc9dc06f860 msgr2=0x7fc9dc15b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:10.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e1000640 1 --2- 172.21.15.137:0/2130668293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc9dc06f860 0x7fc9dc15b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:10.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e1000640 1 -- 172.21.15.137:0/2130668293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9dc145670 msgr2=0x7fc9dc141110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:10.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e1000640 1 --2- 172.21.15.137:0/2130668293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9dc145670 0x7fc9dc141110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:10.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.922+0000 7fc9e1000640 1 -- 172.21.15.137:0/2130668293 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9dc1fc000 con 0x7fc9dc0727d0 2024-04-26T23:44:10.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.926+0000 7fc9e1000640 1 --2- 172.21.15.137:0/2130668293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9dc0727d0 0x7fc9dc1fb970 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800c4a0 tx=0x7fc9c800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:10.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.926+0000 7fc9d9600640 1 -- 172.21.15.137:0/2130668293 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8018070 con 0x7fc9dc0727d0 2024-04-26T23:44:10.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.926+0000 7fc9d9600640 1 -- 172.21.15.137:0/2130668293 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9c80074e0 con 0x7fc9dc0727d0 2024-04-26T23:44:10.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.926+0000 7fc9d9600640 1 -- 172.21.15.137:0/2130668293 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8004a30 con 0x7fc9dc0727d0 2024-04-26T23:44:10.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.926+0000 7fc9e2e00640 1 -- 172.21.15.137:0/2130668293 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9dc1fc2e0 con 0x7fc9dc0727d0 2024-04-26T23:44:10.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.926+0000 7fc9e2e00640 1 -- 172.21.15.137:0/2130668293 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9dc13e590 con 0x7fc9dc0727d0 2024-04-26T23:44:10.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.926+0000 7fc9e2e00640 1 -- 172.21.15.137:0/2130668293 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9dc06a480 con 0x7fc9dc0727d0 2024-04-26T23:44:10.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.926+0000 7fc9d9600640 1 -- 172.21.15.137:0/2130668293 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc9c8004bd0 con 0x7fc9dc0727d0 2024-04-26T23:44:10.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.926+0000 7fc9d9600640 1 --2- 172.21.15.137:0/2130668293 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc9bc068380 0x7fc9bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:10.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.926+0000 7fc9d9600640 1 -- 172.21.15.137:0/2130668293 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5544+0+0 (secure 0 0 0) 0x7fc9c8085c90 con 0x7fc9dc0727d0 2024-04-26T23:44:10.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.926+0000 7fc9e1a00640 1 --2- 172.21.15.137:0/2130668293 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc9bc068380 0x7fc9bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:10.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.926+0000 7fc9e1a00640 1 --2- 172.21.15.137:0/2130668293 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc9bc068380 0x7fc9bc06a840 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0cdf20 tx=0x7fc9d0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:10.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:10.930+0000 7fc9d9600640 1 -- 172.21.15.137:0/2130668293 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc9c8055c00 con 0x7fc9dc0727d0 2024-04-26T23:44:11.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.090+0000 7fc9e2e00640 1 -- 172.21.15.137:0/2130668293 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc9dc0b2610 con 0x7fc9dc0727d0 2024-04-26T23:44:11.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.750+0000 7fc9d9600640 1 -- 172.21.15.137:0/2130668293 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v51) ==== 169+0+0 (secure 0 0 0) 0x7fc9c8059f00 con 0x7fc9dc0727d0 2024-04-26T23:44:11.804 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' removed 2024-04-26T23:44:11.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.754+0000 7fc9e2e00640 1 -- 172.21.15.137:0/2130668293 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc9bc068380 msgr2=0x7fc9bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:11.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.754+0000 7fc9e2e00640 1 --2- 172.21.15.137:0/2130668293 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc9bc068380 0x7fc9bc06a840 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0cdf20 tx=0x7fc9d0009040 comp rx=0 tx=0).stop 2024-04-26T23:44:11.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.754+0000 7fc9e2e00640 1 -- 172.21.15.137:0/2130668293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9dc0727d0 msgr2=0x7fc9dc1fb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:11.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.754+0000 7fc9e2e00640 1 --2- 172.21.15.137:0/2130668293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9dc0727d0 0x7fc9dc1fb970 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800c4a0 tx=0x7fc9c800c960 comp rx=0 tx=0).stop 2024-04-26T23:44:11.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.754+0000 7fc9e2e00640 1 -- 172.21.15.137:0/2130668293 shutdown_connections 2024-04-26T23:44:11.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.754+0000 7fc9e2e00640 1 --2- 172.21.15.137:0/2130668293 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc9bc068380 0x7fc9bc06a840 secure :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0cdf20 tx=0x7fc9d0009040 comp rx=0 tx=0).stop 2024-04-26T23:44:11.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.754+0000 7fc9e2e00640 1 --2- 172.21.15.137:0/2130668293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9dc0727d0 0x7fc9dc1fb970 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:11.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.754+0000 7fc9e2e00640 1 --2- 172.21.15.137:0/2130668293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9dc145670 0x7fc9dc141110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:11.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.754+0000 7fc9e2e00640 1 --2- 172.21.15.137:0/2130668293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc9dc06f860 0x7fc9dc15b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:11.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.754+0000 7fc9e2e00640 1 -- 172.21.15.137:0/2130668293 >> 172.21.15.137:0/2130668293 conn(0x7fc9dc0b2830 msgr2=0x7fc9dc1434c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:11.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.754+0000 7fc9e2e00640 1 -- 172.21.15.137:0/2130668293 shutdown_connections 2024-04-26T23:44:11.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.754+0000 7fc9e2e00640 1 -- 172.21.15.137:0/2130668293 wait complete. 2024-04-26T23:44:11.807 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-26T23:44:11.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.934+0000 7f12d1c00640 1 Processor -- start 2024-04-26T23:44:11.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.934+0000 7f12d1c00640 1 -- start start 2024-04-26T23:44:11.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.938+0000 7f12d1c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f12cc0afbc0 0x7f12cc15df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:11.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.938+0000 7f12d1c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f12cc073f20 0x7f12cc0735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:11.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.938+0000 7f12d1c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12cc073b20 con 0x7f12cc0affa0 2024-04-26T23:44:11.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.938+0000 7f12d1c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f12cc072860 con 0x7f12cc0afbc0 2024-04-26T23:44:11.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.938+0000 7f12d1c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f12cc0743b0 con 0x7f12cc073f20 2024-04-26T23:44:11.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.938+0000 7f12cb400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f12cc0affa0 0x7f12cc0ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:33270/0 (socket says 172.21.15.137:33270) 2024-04-26T23:44:11.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.938+0000 7f12cb400640 1 -- 172.21.15.137:0/1349700165 learned_addr learned my addr 172.21.15.137:0/1349700165 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:11.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.938+0000 7f12caa00640 1 --2- 172.21.15.137:0/1349700165 >> v2:172.21.15.137:3300/0 conn(0x7f12cc0afbc0 0x7f12cc15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:11.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.938+0000 7f12ca000640 1 --2- 172.21.15.137:0/1349700165 >> v2:172.21.15.170:3300/0 conn(0x7f12cc073f20 0x7f12cc0735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:11.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.938+0000 7f12caa00640 1 -- 172.21.15.137:0/1349700165 >> v2:172.21.15.170:3300/0 conn(0x7f12cc073f20 msgr2=0x7f12cc0735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:11.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.938+0000 7f12caa00640 1 --2- 172.21.15.137:0/1349700165 >> v2:172.21.15.170:3300/0 conn(0x7f12cc073f20 0x7f12cc0735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:11.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.938+0000 7f12caa00640 1 -- 172.21.15.137:0/1349700165 >> v1:172.21.15.137:6789/0 conn(0x7f12cc0affa0 legacy=0x7f12cc0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:11.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.938+0000 7f12caa00640 1 -- 172.21.15.137:0/1349700165 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12cc072b00 con 0x7f12cc0afbc0 2024-04-26T23:44:11.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.938+0000 7f12ca000640 1 --2- 172.21.15.137:0/1349700165 >> v2:172.21.15.170:3300/0 conn(0x7f12cc073f20 0x7f12cc0735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:11.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.942+0000 7f12caa00640 1 --2- 172.21.15.137:0/1349700165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12cc0afbc0 0x7f12cc15df90 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f12bc009d90 tx=0x7f12bc01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ba8f141327616e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:11.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.942+0000 7f12c9600640 1 -- 172.21.15.137:0/1349700165 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc0b2070 con 0x7f12cc0afbc0 2024-04-26T23:44:11.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.942+0000 7f12c9600640 1 -- 172.21.15.137:0/1349700165 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12bc0a58e0 con 0x7f12cc0afbc0 2024-04-26T23:44:11.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.942+0000 7f12c9600640 1 -- 172.21.15.137:0/1349700165 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc0a5cb0 con 0x7f12cc0afbc0 2024-04-26T23:44:11.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.942+0000 7f12d1c00640 1 -- 172.21.15.137:0/1349700165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12cc0afbc0 msgr2=0x7f12cc15df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:11.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.942+0000 7f12d1c00640 1 --2- 172.21.15.137:0/1349700165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12cc0afbc0 0x7f12cc15df90 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f12bc009d90 tx=0x7f12bc01c930 comp rx=0 tx=0).stop 2024-04-26T23:44:11.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.942+0000 7f12d1c00640 1 -- 172.21.15.137:0/1349700165 shutdown_connections 2024-04-26T23:44:11.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.942+0000 7f12d1c00640 1 --2- 172.21.15.137:0/1349700165 >> v2:172.21.15.170:3300/0 conn(0x7f12cc073f20 0x7f12cc0735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:11.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.942+0000 7f12d1c00640 1 --2- 172.21.15.137:0/1349700165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12cc0afbc0 0x7f12cc15df90 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:11.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.942+0000 7f12d1c00640 1 -- 172.21.15.137:0/1349700165 >> 172.21.15.137:0/1349700165 conn(0x7f12cc06c800 msgr2=0x7f12cc06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:11.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.942+0000 7f12d1c00640 1 -- 172.21.15.137:0/1349700165 shutdown_connections 2024-04-26T23:44:11.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.942+0000 7f12d1c00640 1 -- 172.21.15.137:0/1349700165 wait complete. 2024-04-26T23:44:11.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.942+0000 7f12d1c00640 1 Processor -- start 2024-04-26T23:44:11.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.942+0000 7f12d1c00640 1 -- start start 2024-04-26T23:44:11.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12d1c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f12cc0afbc0 0x7f12cc147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:11.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12d1c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12cc0affa0 0x7f12cc148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:11.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12d1c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12cc14b700 0x7f12cc1f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:11.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12d1c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc0cec40 con 0x7f12cc14b700 2024-04-26T23:44:11.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12d1c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc0ceac0 con 0x7f12cc0affa0 2024-04-26T23:44:11.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12d1c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f12cc06efd0 con 0x7f12cc0afbc0 2024-04-26T23:44:11.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12cb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12cc14b700 0x7f12cc1f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:11.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12cb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12cc14b700 0x7f12cc1f5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40630/0 (socket says 172.21.15.137:40630) 2024-04-26T23:44:11.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12cb400640 1 -- 172.21.15.137:0/1138818878 learned_addr learned my addr 172.21.15.137:0/1138818878 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:11.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12ca000640 1 --2- 172.21.15.137:0/1138818878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12cc0affa0 0x7f12cc148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:11.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12caa00640 1 --2- 172.21.15.137:0/1138818878 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f12cc0afbc0 0x7f12cc147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:11.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12cb400640 1 -- 172.21.15.137:0/1138818878 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f12cc0afbc0 msgr2=0x7f12cc147230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:11.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12cb400640 1 --2- 172.21.15.137:0/1138818878 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f12cc0afbc0 0x7f12cc147230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:11.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12cb400640 1 -- 172.21.15.137:0/1138818878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12cc0affa0 msgr2=0x7f12cc148c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:11.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12cb400640 1 --2- 172.21.15.137:0/1138818878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12cc0affa0 0x7f12cc148c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:11.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12cb400640 1 -- 172.21.15.137:0/1138818878 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12cc147770 con 0x7f12cc14b700 2024-04-26T23:44:11.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12cb400640 1 --2- 172.21.15.137:0/1138818878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12cc14b700 0x7f12cc1f5cc0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f12c400c3c0 tx=0x7f12c400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:11.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12c2a00640 1 -- 172.21.15.137:0/1138818878 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c4017070 con 0x7f12cc14b700 2024-04-26T23:44:11.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12c2a00640 1 -- 172.21.15.137:0/1138818878 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12c4005cf0 con 0x7f12cc14b700 2024-04-26T23:44:11.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12d1c00640 1 -- 172.21.15.137:0/1138818878 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12cc14bc50 con 0x7f12cc14b700 2024-04-26T23:44:11.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12c2a00640 1 -- 172.21.15.137:0/1138818878 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c40072f0 con 0x7f12cc14b700 2024-04-26T23:44:11.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12d1c00640 1 -- 172.21.15.137:0/1138818878 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12cc14c210 con 0x7f12cc14b700 2024-04-26T23:44:11.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12d1c00640 1 -- 172.21.15.137:0/1138818878 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12cc06a410 con 0x7f12cc14b700 2024-04-26T23:44:11.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.946+0000 7f12c2a00640 1 -- 172.21.15.137:0/1138818878 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f12c401a070 con 0x7f12cc14b700 2024-04-26T23:44:11.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.950+0000 7f12c2a00640 1 --2- 172.21.15.137:0/1138818878 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f12ac0683b0 0x7f12ac06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:11.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.950+0000 7f12c2a00640 1 -- 172.21.15.137:0/1138818878 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5072+0+0 (secure 0 0 0) 0x7f12c4085940 con 0x7f12cc14b700 2024-04-26T23:44:11.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.950+0000 7f12caa00640 1 --2- 172.21.15.137:0/1138818878 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f12ac0683b0 0x7f12ac06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:11.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.950+0000 7f12caa00640 1 --2- 172.21.15.137:0/1138818878 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f12ac0683b0 0x7f12ac06a870 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0af000 tx=0x7f12bc0a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:11.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:11.954+0000 7f12c2a00640 1 -- 172.21.15.137:0/1138818878 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f12c4055b40 con 0x7f12cc14b700 2024-04-26T23:44:12.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.110+0000 7f12d1c00640 1 -- 172.21.15.137:0/1138818878 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f12cc160870 con 0x7f12cc14b700 2024-04-26T23:44:12.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.114+0000 7f12c2a00640 1 -- 172.21.15.137:0/1138818878 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7f12c4059e40 con 0x7f12cc14b700 2024-04-26T23:44:12.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.118+0000 7f12d1c00640 1 -- 172.21.15.137:0/1138818878 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f12ac0683b0 msgr2=0x7f12ac06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:12.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.118+0000 7f12d1c00640 1 --2- 172.21.15.137:0/1138818878 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f12ac0683b0 0x7f12ac06a870 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0af000 tx=0x7f12bc0a7070 comp rx=0 tx=0).stop 2024-04-26T23:44:12.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.118+0000 7f12d1c00640 1 -- 172.21.15.137:0/1138818878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12cc14b700 msgr2=0x7f12cc1f5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:12.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.118+0000 7f12d1c00640 1 --2- 172.21.15.137:0/1138818878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12cc14b700 0x7f12cc1f5cc0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f12c400c3c0 tx=0x7f12c400c880 comp rx=0 tx=0).stop 2024-04-26T23:44:12.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.118+0000 7f12d1c00640 1 -- 172.21.15.137:0/1138818878 shutdown_connections 2024-04-26T23:44:12.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.118+0000 7f12d1c00640 1 --2- 172.21.15.137:0/1138818878 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f12ac0683b0 0x7f12ac06a870 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:12.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.118+0000 7f12d1c00640 1 --2- 172.21.15.137:0/1138818878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12cc14b700 0x7f12cc1f5cc0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:12.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.118+0000 7f12d1c00640 1 --2- 172.21.15.137:0/1138818878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12cc0affa0 0x7f12cc148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:12.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.118+0000 7f12d1c00640 1 --2- 172.21.15.137:0/1138818878 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f12cc0afbc0 0x7f12cc147230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:12.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.118+0000 7f12d1c00640 1 -- 172.21.15.137:0/1138818878 >> 172.21.15.137:0/1138818878 conn(0x7f12cc06c800 msgr2=0x7f12cc0b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:12.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.118+0000 7f12d1c00640 1 -- 172.21.15.137:0/1138818878 shutdown_connections 2024-04-26T23:44:12.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.118+0000 7f12d1c00640 1 -- 172.21.15.137:0/1138818878 wait complete. 2024-04-26T23:44:12.145 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted' 2024-04-26T23:44:12.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.282+0000 7f9355a00640 1 Processor -- start 2024-04-26T23:44:12.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.282+0000 7f9355a00640 1 -- start start 2024-04-26T23:44:12.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.282+0000 7f9355a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f93500b5080 0x7f93500cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:12.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.282+0000 7f9355a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9350072980 0x7f9350072e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:12.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.282+0000 7f9355a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93500cfef0 con 0x7f93500725a0 2024-04-26T23:44:12.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.282+0000 7f9355a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f93500cddc0 con 0x7f93500b5080 2024-04-26T23:44:12.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.282+0000 7f9355a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f93500d01b0 con 0x7f9350072980 2024-04-26T23:44:12.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.286+0000 7f934e000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f93500b5080 0x7f93500cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:12.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.286+0000 7f934ea00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f93500725a0 0x7f9350073f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:33280/0 (socket says 172.21.15.137:33280) 2024-04-26T23:44:12.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.286+0000 7f934ea00640 1 -- 172.21.15.137:0/1224824347 learned_addr learned my addr 172.21.15.137:0/1224824347 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:12.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.286+0000 7f934e000640 1 -- 172.21.15.137:0/1224824347 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9350072980 msgr2=0x7f9350072e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:12.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.286+0000 7f934e000640 1 --2- 172.21.15.137:0/1224824347 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9350072980 0x7f9350072e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:12.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.286+0000 7f934e000640 1 -- 172.21.15.137:0/1224824347 >> v1:172.21.15.137:6789/0 conn(0x7f93500725a0 legacy=0x7f9350073f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:12.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.286+0000 7f934e000640 1 -- 172.21.15.137:0/1224824347 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93500d0490 con 0x7f93500b5080 2024-04-26T23:44:12.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.286+0000 7f934e000640 1 --2- 172.21.15.137:0/1224824347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93500b5080 0x7f93500cd770 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f933c0097f0 tx=0x7f933c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c0092ba6366b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:12.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.286+0000 7f934d600640 1 -- 172.21.15.137:0/1224824347 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c0a7070 con 0x7f93500b5080 2024-04-26T23:44:12.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.286+0000 7f934d600640 1 -- 172.21.15.137:0/1224824347 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f933c0b0070 con 0x7f93500b5080 2024-04-26T23:44:12.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.286+0000 7f934d600640 1 -- 172.21.15.137:0/1224824347 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c0ab890 con 0x7f93500b5080 2024-04-26T23:44:12.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.286+0000 7f9355a00640 1 -- 172.21.15.137:0/1224824347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93500b5080 msgr2=0x7f93500cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:12.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f9355a00640 1 --2- 172.21.15.137:0/1224824347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93500b5080 0x7f93500cd770 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f933c0097f0 tx=0x7f933c01c470 comp rx=0 tx=0).stop 2024-04-26T23:44:12.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f9355a00640 1 -- 172.21.15.137:0/1224824347 shutdown_connections 2024-04-26T23:44:12.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f9355a00640 1 --2- 172.21.15.137:0/1224824347 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9350072980 0x7f9350072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:12.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f9355a00640 1 --2- 172.21.15.137:0/1224824347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93500b5080 0x7f93500cd770 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:12.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f9355a00640 1 -- 172.21.15.137:0/1224824347 >> 172.21.15.137:0/1224824347 conn(0x7f935006c5d0 msgr2=0x7f935006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:12.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f9355a00640 1 -- 172.21.15.137:0/1224824347 shutdown_connections 2024-04-26T23:44:12.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f9355a00640 1 -- 172.21.15.137:0/1224824347 wait complete. 2024-04-26T23:44:12.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f9355a00640 1 Processor -- start 2024-04-26T23:44:12.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f9355a00640 1 -- start start 2024-04-26T23:44:12.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f9355a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93500725a0 0x7f9350158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:12.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f9355a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9350072980 0x7f935013d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:12.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f9355a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93500b5080 0x7f935013b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:12.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f9355a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f93501684e0 con 0x7f93500b5080 2024-04-26T23:44:12.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f9355a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9350168360 con 0x7f93500725a0 2024-04-26T23:44:12.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f9355a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9350168660 con 0x7f9350072980 2024-04-26T23:44:12.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f934f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93500b5080 0x7f935013b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:12.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f934f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93500b5080 0x7f935013b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40662/0 (socket says 172.21.15.137:40662) 2024-04-26T23:44:12.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f934f400640 1 -- 172.21.15.137:0/1795394129 learned_addr learned my addr 172.21.15.137:0/1795394129 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:12.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f934e000640 1 --2- 172.21.15.137:0/1795394129 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9350072980 0x7f935013d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:12.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f934ea00640 1 --2- 172.21.15.137:0/1795394129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93500725a0 0x7f9350158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:12.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f934f400640 1 -- 172.21.15.137:0/1795394129 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9350072980 msgr2=0x7f935013d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:12.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f934f400640 1 --2- 172.21.15.137:0/1795394129 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9350072980 0x7f935013d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:12.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f934f400640 1 -- 172.21.15.137:0/1795394129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93500725a0 msgr2=0x7f9350158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:12.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f934f400640 1 --2- 172.21.15.137:0/1795394129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93500725a0 0x7f9350158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:12.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f934f400640 1 -- 172.21.15.137:0/1795394129 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935013bd90 con 0x7f93500b5080 2024-04-26T23:44:12.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f934e000640 1 --2- 172.21.15.137:0/1795394129 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9350072980 0x7f935013d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:12.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f934f400640 1 --2- 172.21.15.137:0/1795394129 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93500b5080 0x7f935013b850 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f934800b970 tx=0x7f934800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:12.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f9346a00640 1 -- 172.21.15.137:0/1795394129 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9348019070 con 0x7f93500b5080 2024-04-26T23:44:12.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f9346a00640 1 -- 172.21.15.137:0/1795394129 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f934800cb60 con 0x7f93500b5080 2024-04-26T23:44:12.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f9355a00640 1 -- 172.21.15.137:0/1795394129 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f935013c030 con 0x7f93500b5080 2024-04-26T23:44:12.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.290+0000 7f9346a00640 1 -- 172.21.15.137:0/1795394129 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9348014440 con 0x7f93500b5080 2024-04-26T23:44:12.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.294+0000 7f9355a00640 1 -- 172.21.15.137:0/1795394129 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f935013c5f0 con 0x7f93500b5080 2024-04-26T23:44:12.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.294+0000 7f9355a00640 1 -- 172.21.15.137:0/1795394129 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f935006a4b0 con 0x7f93500b5080 2024-04-26T23:44:12.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.294+0000 7f9346a00640 1 -- 172.21.15.137:0/1795394129 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f934801c070 con 0x7f93500b5080 2024-04-26T23:44:12.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.294+0000 7f9346a00640 1 --2- 172.21.15.137:0/1795394129 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9330068380 0x7f933006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:12.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.294+0000 7f9346a00640 1 -- 172.21.15.137:0/1795394129 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5072+0+0 (secure 0 0 0) 0x7f9348086550 con 0x7f93500b5080 2024-04-26T23:44:12.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.294+0000 7f934ea00640 1 --2- 172.21.15.137:0/1795394129 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9330068380 0x7f933006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:12.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.294+0000 7f934ea00640 1 --2- 172.21.15.137:0/1795394129 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9330068380 0x7f933006a840 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9340000f70 tx=0x7f9340009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:12.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.298+0000 7f9346a00640 1 -- 172.21.15.137:0/1795394129 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9348056d10 con 0x7f93500b5080 2024-04-26T23:44:12.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.510+0000 7f9355a00640 1 -- 172.21.15.137:0/1795394129 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]} v 0) -- 0x7f93500cf780 con 0x7f93500b5080 2024-04-26T23:44:12.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.754+0000 7f9346a00640 1 -- 172.21.15.137:0/1795394129 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]}]=0 v175) ==== 153+0+0 (secure 0 0 0) 0x7f9348056610 con 0x7f93500b5080 2024-04-26T23:44:12.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.754+0000 7f9355a00640 1 -- 172.21.15.137:0/1795394129 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9330068380 msgr2=0x7f933006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:12.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.754+0000 7f9355a00640 1 --2- 172.21.15.137:0/1795394129 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9330068380 0x7f933006a840 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9340000f70 tx=0x7f9340009040 comp rx=0 tx=0).stop 2024-04-26T23:44:12.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.754+0000 7f9355a00640 1 -- 172.21.15.137:0/1795394129 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93500b5080 msgr2=0x7f935013b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:12.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.754+0000 7f9355a00640 1 --2- 172.21.15.137:0/1795394129 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93500b5080 0x7f935013b850 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f934800b970 tx=0x7f934800be30 comp rx=0 tx=0).stop 2024-04-26T23:44:12.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.754+0000 7f9355a00640 1 -- 172.21.15.137:0/1795394129 shutdown_connections 2024-04-26T23:44:12.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.754+0000 7f9355a00640 1 --2- 172.21.15.137:0/1795394129 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9330068380 0x7f933006a840 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:12.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.754+0000 7f9355a00640 1 --2- 172.21.15.137:0/1795394129 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93500b5080 0x7f935013b850 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:12.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.754+0000 7f9355a00640 1 --2- 172.21.15.137:0/1795394129 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9350072980 0x7f935013d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:12.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.754+0000 7f9355a00640 1 --2- 172.21.15.137:0/1795394129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93500725a0 0x7f9350158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:12.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.754+0000 7f9355a00640 1 -- 172.21.15.137:0/1795394129 >> 172.21.15.137:0/1795394129 conn(0x7f935006c5d0 msgr2=0x7f935006c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:12.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.754+0000 7f9355a00640 1 -- 172.21.15.137:0/1795394129 shutdown_connections 2024-04-26T23:44:12.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.754+0000 7f9355a00640 1 -- 172.21.15.137:0/1795394129 wait complete. 2024-04-26T23:44:12.784 INFO:tasks.cephfs_test_runner:Check that mds evicts blocklisted client ... ok 2024-04-26T23:44:12.784 INFO:tasks.cephfs_test_runner:Starting test: test_session_reject (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-04-26T23:44:12.785 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:44:12.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.910+0000 7f3adca00640 1 Processor -- start 2024-04-26T23:44:12.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.914+0000 7f3adca00640 1 -- start start 2024-04-26T23:44:12.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.914+0000 7f3adca00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ad815f080 0x7f3ad80b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:12.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.914+0000 7f3adca00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3ad8073fe0 0x7f3ad80b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:12.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.914+0000 7f3adca00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ad8072e60 con 0x7f3ad80b44b0 2024-04-26T23:44:12.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.914+0000 7f3adca00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f3ad8072c10 con 0x7f3ad8073fe0 2024-04-26T23:44:12.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.914+0000 7f3adca00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3ad80ae990 con 0x7f3ad815f080 2024-04-26T23:44:12.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.914+0000 7f3acea00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3ad8073fe0 0x7f3ad80b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:12.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.914+0000 7f3ad7400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ad815f080 0x7f3ad80b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:12.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.914+0000 7f3acea00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3ad8073fe0 0x7f3ad80b3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:58432/0 (socket says 172.21.15.137:58432) 2024-04-26T23:44:12.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.914+0000 7f3acea00640 1 -- 172.21.15.137:0/979606359 learned_addr learned my addr 172.21.15.137:0/979606359 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:12.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.914+0000 7f3ad7400640 1 -- 172.21.15.137:0/979606359 >> v2:172.21.15.170:3300/0 conn(0x7f3ad8073fe0 msgr2=0x7f3ad80b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:12.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.914+0000 7f3ad7400640 1 --2- 172.21.15.137:0/979606359 >> v2:172.21.15.170:3300/0 conn(0x7f3ad8073fe0 0x7f3ad80b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:12.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.914+0000 7f3ad7400640 1 -- 172.21.15.137:0/979606359 >> v1:172.21.15.170:6789/0 conn(0x7f3ad80b44b0 legacy=0x7f3ad8162b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:12.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.914+0000 7f3ad7400640 1 -- 172.21.15.137:0/979606359 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad8073140 con 0x7f3ad815f080 2024-04-26T23:44:12.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.914+0000 7f3acea00640 1 --2- 172.21.15.137:0/979606359 >> v2:172.21.15.170:3300/0 conn(0x7f3ad8073fe0 0x7f3ad80b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:44:12.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.918+0000 7f3ad7400640 1 --2- 172.21.15.137:0/979606359 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ad815f080 0x7f3ad80b3a30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80097c0 tx=0x7f3ac801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f53d59434877eaf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:12.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.918+0000 7f3ad6a00640 1 -- 172.21.15.137:0/979606359 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80b0070 con 0x7f3ad815f080 2024-04-26T23:44:12.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.918+0000 7f3ad6a00640 1 -- 172.21.15.137:0/979606359 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ac80ab600 con 0x7f3ad815f080 2024-04-26T23:44:12.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.918+0000 7f3ad6a00640 1 -- 172.21.15.137:0/979606359 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80ab9d0 con 0x7f3ad815f080 2024-04-26T23:44:12.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.918+0000 7f3adca00640 1 -- 172.21.15.137:0/979606359 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ad815f080 msgr2=0x7f3ad80b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:12.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.918+0000 7f3adca00640 1 --2- 172.21.15.137:0/979606359 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ad815f080 0x7f3ad80b3a30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80097c0 tx=0x7f3ac801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:44:12.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.918+0000 7f3adca00640 1 -- 172.21.15.137:0/979606359 shutdown_connections 2024-04-26T23:44:12.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.918+0000 7f3adca00640 1 --2- 172.21.15.137:0/979606359 >> v2:172.21.15.170:3300/0 conn(0x7f3ad8073fe0 0x7f3ad80b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:12.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.918+0000 7f3adca00640 1 --2- 172.21.15.137:0/979606359 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ad815f080 0x7f3ad80b3a30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:12.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.918+0000 7f3adca00640 1 -- 172.21.15.137:0/979606359 >> 172.21.15.137:0/979606359 conn(0x7f3ad80b2730 msgr2=0x7f3ad80b2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:12.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.918+0000 7f3adca00640 1 -- 172.21.15.137:0/979606359 shutdown_connections 2024-04-26T23:44:12.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.918+0000 7f3adca00640 1 -- 172.21.15.137:0/979606359 wait complete. 2024-04-26T23:44:12.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.918+0000 7f3adca00640 1 Processor -- start 2024-04-26T23:44:12.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3adca00640 1 -- start start 2024-04-26T23:44:12.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3adca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ad8073fe0 0x7f3ad8162010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:12.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3adca00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ad80b44b0 0x7f3ad8149490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:12.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3adca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ad815f080 0x7f3ad81545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:12.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3adca00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad816c280 con 0x7f3ad815f080 2024-04-26T23:44:12.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3adca00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad816c100 con 0x7f3ad8073fe0 2024-04-26T23:44:12.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3adca00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3ad816c400 con 0x7f3ad80b44b0 2024-04-26T23:44:12.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3ad7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ad815f080 0x7f3ad81545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:12.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3ad7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ad8073fe0 0x7f3ad8162010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:12.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3ad7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ad815f080 0x7f3ad81545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40678/0 (socket says 172.21.15.137:40678) 2024-04-26T23:44:12.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3ad7e00640 1 -- 172.21.15.137:0/391740876 learned_addr learned my addr 172.21.15.137:0/391740876 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:12.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3acea00640 1 --2- 172.21.15.137:0/391740876 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ad80b44b0 0x7f3ad8149490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:12.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3ad7e00640 1 -- 172.21.15.137:0/391740876 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ad80b44b0 msgr2=0x7f3ad8149490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:12.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3ad7e00640 1 --2- 172.21.15.137:0/391740876 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ad80b44b0 0x7f3ad8149490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:12.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3ad7e00640 1 -- 172.21.15.137:0/391740876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ad8073fe0 msgr2=0x7f3ad8162010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:12.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3ad7e00640 1 --2- 172.21.15.137:0/391740876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ad8073fe0 0x7f3ad8162010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:12.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3ad7e00640 1 -- 172.21.15.137:0/391740876 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad80cf840 con 0x7f3ad815f080 2024-04-26T23:44:12.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3ad7e00640 1 --2- 172.21.15.137:0/391740876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ad815f080 0x7f3ad81545c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000c730 tx=0x7f3ad000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:12.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3acfe00640 1 -- 172.21.15.137:0/391740876 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0003b80 con 0x7f3ad815f080 2024-04-26T23:44:12.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3acfe00640 1 -- 172.21.15.137:0/391740876 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ad0003d20 con 0x7f3ad815f080 2024-04-26T23:44:12.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3adca00640 1 -- 172.21.15.137:0/391740876 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad80cfae0 con 0x7f3ad815f080 2024-04-26T23:44:12.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3acfe00640 1 -- 172.21.15.137:0/391740876 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0005310 con 0x7f3ad815f080 2024-04-26T23:44:12.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3adca00640 1 -- 172.21.15.137:0/391740876 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad8161810 con 0x7f3ad815f080 2024-04-26T23:44:12.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.922+0000 7f3adca00640 1 -- 172.21.15.137:0/391740876 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ad806a410 con 0x7f3ad815f080 2024-04-26T23:44:12.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.926+0000 7f3acfe00640 1 -- 172.21.15.137:0/391740876 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3ad00056c0 con 0x7f3ad815f080 2024-04-26T23:44:12.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.926+0000 7f3acfe00640 1 --2- 172.21.15.137:0/391740876 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3ab4068380 0x7f3ab406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:12.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.926+0000 7f3acfe00640 1 -- 172.21.15.137:0/391740876 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5072+0+0 (secure 0 0 0) 0x7f3ad00866e0 con 0x7f3ad815f080 2024-04-26T23:44:12.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.926+0000 7f3ad7400640 1 --2- 172.21.15.137:0/391740876 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3ab4068380 0x7f3ab406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:12.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.926+0000 7f3ad7400640 1 --2- 172.21.15.137:0/391740876 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3ab4068380 0x7f3ab406a840 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80ad000 tx=0x7f3ac8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:12.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:12.930+0000 7f3acfe00640 1 -- 172.21.15.137:0/391740876 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3ad0056850 con 0x7f3ad815f080 2024-04-26T23:44:13.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.086+0000 7f3adca00640 1 -- 172.21.15.137:0/391740876 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3ad8075ec0 con 0x7f3ad815f080 2024-04-26T23:44:13.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.086+0000 7f3acfe00640 1 -- 172.21.15.137:0/391740876 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+13260 (secure 0 0 0) 0x7f3ad005ab50 con 0x7f3ad815f080 2024-04-26T23:44:13.095 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:13.095 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":51,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:44:11.751777+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6835/547646153":"2024-04-27T23:44:08.682679+0000","172.21.15.137:6836/2120163779":"2024-04-27T23:44:08.682668+0000","172.21.15.137:6837/547646153":"2024-04-27T23:44:08.682679+0000","172.21.15.137:6834/2120163779":"2024-04-27T23:44:08.682668+0000","192.168.0.1:0/268105340":"2024-04-27T00:43:44.368539+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:44:13.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.090+0000 7f3adca00640 1 -- 172.21.15.137:0/391740876 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3ab4068380 msgr2=0x7f3ab406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.090+0000 7f3adca00640 1 --2- 172.21.15.137:0/391740876 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3ab4068380 0x7f3ab406a840 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80ad000 tx=0x7f3ac8008040 comp rx=0 tx=0).stop 2024-04-26T23:44:13.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.090+0000 7f3adca00640 1 -- 172.21.15.137:0/391740876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ad815f080 msgr2=0x7f3ad81545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.090+0000 7f3adca00640 1 --2- 172.21.15.137:0/391740876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ad815f080 0x7f3ad81545c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000c730 tx=0x7f3ad000cbf0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.090+0000 7f3adca00640 1 -- 172.21.15.137:0/391740876 shutdown_connections 2024-04-26T23:44:13.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.090+0000 7f3adca00640 1 --2- 172.21.15.137:0/391740876 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3ab4068380 0x7f3ab406a840 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.090+0000 7f3adca00640 1 --2- 172.21.15.137:0/391740876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ad815f080 0x7f3ad81545c0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.090+0000 7f3adca00640 1 --2- 172.21.15.137:0/391740876 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ad80b44b0 0x7f3ad8149490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.090+0000 7f3adca00640 1 --2- 172.21.15.137:0/391740876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ad8073fe0 0x7f3ad8162010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.090+0000 7f3adca00640 1 -- 172.21.15.137:0/391740876 >> 172.21.15.137:0/391740876 conn(0x7f3ad80b2730 msgr2=0x7f3ad8158340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:13.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.090+0000 7f3adca00640 1 -- 172.21.15.137:0/391740876 shutdown_connections 2024-04-26T23:44:13.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.090+0000 7f3adca00640 1 -- 172.21.15.137:0/391740876 wait complete. 2024-04-26T23:44:13.116 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:44:13.116 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:44:13.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.246+0000 7f1d69400640 1 Processor -- start 2024-04-26T23:44:13.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.246+0000 7f1d69400640 1 -- start start 2024-04-26T23:44:13.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.246+0000 7f1d69400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1d640b54e0 0x7f1d640b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.246+0000 7f1d69400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1d640cd710 0x7f1d6415f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.246+0000 7f1d69400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d640cffa0 con 0x7f1d6415fe30 2024-04-26T23:44:13.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.246+0000 7f1d69400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1d640b3d90 con 0x7f1d640cd710 2024-04-26T23:44:13.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.246+0000 7f1d69400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f1d640d0840 con 0x7f1d640b54e0 2024-04-26T23:44:13.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.246+0000 7f1d59e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1d640cd710 0x7f1d6415f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.246+0000 7f1d59e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1d640cd710 0x7f1d6415f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40690/0 (socket says 172.21.15.137:40690) 2024-04-26T23:44:13.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.246+0000 7f1d59e00640 1 -- 172.21.15.137:0/2760227489 learned_addr learned my addr 172.21.15.137:0/2760227489 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:13.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.250+0000 7f1d59e00640 1 -- 172.21.15.137:0/2760227489 >> v2:172.21.15.170:3300/0 conn(0x7f1d640b54e0 msgr2=0x7f1d640b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:13.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.250+0000 7f1d62800640 1 --2- 172.21.15.137:0/2760227489 >> v2:172.21.15.170:3300/0 conn(0x7f1d640b54e0 0x7f1d640b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.250+0000 7f1d59e00640 1 --2- 172.21.15.137:0/2760227489 >> v2:172.21.15.170:3300/0 conn(0x7f1d640b54e0 0x7f1d640b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.250+0000 7f1d59e00640 1 -- 172.21.15.137:0/2760227489 >> v1:172.21.15.170:6789/0 conn(0x7f1d6415fe30 legacy=0x7f1d64144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:13.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.250+0000 7f1d59e00640 1 -- 172.21.15.137:0/2760227489 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d640d0280 con 0x7f1d640cd710 2024-04-26T23:44:13.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.250+0000 7f1d62800640 1 --2- 172.21.15.137:0/2760227489 >> v2:172.21.15.170:3300/0 conn(0x7f1d640b54e0 0x7f1d640b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:13.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.250+0000 7f1d59e00640 1 --2- 172.21.15.137:0/2760227489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d640cd710 0x7f1d6415f8f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1d6406de40 tx=0x7f1d4c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ffa4bf35338f7ef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:13.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.250+0000 7f1d61e00640 1 -- 172.21.15.137:0/2760227489 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c0b0070 con 0x7f1d640cd710 2024-04-26T23:44:13.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.250+0000 7f1d61e00640 1 -- 172.21.15.137:0/2760227489 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4c0ab600 con 0x7f1d640cd710 2024-04-26T23:44:13.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.250+0000 7f1d61e00640 1 -- 172.21.15.137:0/2760227489 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c0ab9d0 con 0x7f1d640cd710 2024-04-26T23:44:13.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.250+0000 7f1d69400640 1 -- 172.21.15.137:0/2760227489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d640cd710 msgr2=0x7f1d6415f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.250+0000 7f1d69400640 1 --2- 172.21.15.137:0/2760227489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d640cd710 0x7f1d6415f8f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1d6406de40 tx=0x7f1d4c01c4e0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.250+0000 7f1d69400640 1 -- 172.21.15.137:0/2760227489 shutdown_connections 2024-04-26T23:44:13.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.250+0000 7f1d69400640 1 --2- 172.21.15.137:0/2760227489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d640cd710 0x7f1d6415f8f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.250+0000 7f1d69400640 1 --2- 172.21.15.137:0/2760227489 >> v2:172.21.15.170:3300/0 conn(0x7f1d640b54e0 0x7f1d640b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.250+0000 7f1d69400640 1 -- 172.21.15.137:0/2760227489 >> 172.21.15.137:0/2760227489 conn(0x7f1d6406c800 msgr2=0x7f1d6406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:13.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.250+0000 7f1d69400640 1 -- 172.21.15.137:0/2760227489 shutdown_connections 2024-04-26T23:44:13.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.250+0000 7f1d69400640 1 -- 172.21.15.137:0/2760227489 wait complete. 2024-04-26T23:44:13.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d69400640 1 Processor -- start 2024-04-26T23:44:13.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d69400640 1 -- start start 2024-04-26T23:44:13.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d69400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d640b54e0 0x7f1d6413d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d69400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d640cd710 0x7f1d640ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d69400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d6415fe30 0x7f1d6415e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d69400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1d64145840 con 0x7f1d640b54e0 2024-04-26T23:44:13.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d69400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1d640cded0 con 0x7f1d640cd710 2024-04-26T23:44:13.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d69400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1d641459c0 con 0x7f1d6415fe30 2024-04-26T23:44:13.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d62800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d640b54e0 0x7f1d6413d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d62800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d640b54e0 0x7f1d6413d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40704/0 (socket says 172.21.15.137:40704) 2024-04-26T23:44:13.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d62800640 1 -- 172.21.15.137:0/1291452238 learned_addr learned my addr 172.21.15.137:0/1291452238 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:13.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d59e00640 1 --2- 172.21.15.137:0/1291452238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d640cd710 0x7f1d640ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d63200640 1 --2- 172.21.15.137:0/1291452238 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d6415fe30 0x7f1d6415e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d62800640 1 -- 172.21.15.137:0/1291452238 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d6415fe30 msgr2=0x7f1d6415e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d62800640 1 --2- 172.21.15.137:0/1291452238 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d6415fe30 0x7f1d6415e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d62800640 1 -- 172.21.15.137:0/1291452238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d640cd710 msgr2=0x7f1d640ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d62800640 1 --2- 172.21.15.137:0/1291452238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d640cd710 0x7f1d640ae0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d62800640 1 -- 172.21.15.137:0/1291452238 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d64141130 con 0x7f1d640b54e0 2024-04-26T23:44:13.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d62800640 1 --2- 172.21.15.137:0/1291452238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d640b54e0 0x7f1d6413d130 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1d5400c7f0 tx=0x7f1d5400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:13.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d5b400640 1 -- 172.21.15.137:0/1291452238 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d54015070 con 0x7f1d640b54e0 2024-04-26T23:44:13.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d5b400640 1 -- 172.21.15.137:0/1291452238 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d54007820 con 0x7f1d640b54e0 2024-04-26T23:44:13.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d69400640 1 -- 172.21.15.137:0/1291452238 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d64141410 con 0x7f1d640b54e0 2024-04-26T23:44:13.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d5b400640 1 -- 172.21.15.137:0/1291452238 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d54007c10 con 0x7f1d640b54e0 2024-04-26T23:44:13.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.254+0000 7f1d69400640 1 -- 172.21.15.137:0/1291452238 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d641419d0 con 0x7f1d640b54e0 2024-04-26T23:44:13.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.258+0000 7f1d69400640 1 -- 172.21.15.137:0/1291452238 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d6406a410 con 0x7f1d640b54e0 2024-04-26T23:44:13.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.258+0000 7f1d5b400640 1 -- 172.21.15.137:0/1291452238 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1d54018070 con 0x7f1d640b54e0 2024-04-26T23:44:13.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.258+0000 7f1d5b400640 1 --2- 172.21.15.137:0/1291452238 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d40068380 0x7f1d4006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.258+0000 7f1d5b400640 1 -- 172.21.15.137:0/1291452238 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5072+0+0 (secure 0 0 0) 0x7f1d54086600 con 0x7f1d640b54e0 2024-04-26T23:44:13.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.258+0000 7f1d59e00640 1 --2- 172.21.15.137:0/1291452238 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d40068380 0x7f1d4006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.262+0000 7f1d59e00640 1 --2- 172.21.15.137:0/1291452238 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d40068380 0x7f1d4006a840 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0ad000 tx=0x7f1d4c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:13.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.262+0000 7f1d5b400640 1 -- 172.21.15.137:0/1291452238 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1d540567f0 con 0x7f1d640b54e0 2024-04-26T23:44:13.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.418+0000 7f1d69400640 1 -- 172.21.15.137:0/1291452238 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1d641424f0 con 0x7f1d640b54e0 2024-04-26T23:44:13.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.422+0000 7f1d5b400640 1 -- 172.21.15.137:0/1291452238 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) ==== 93+0+10 (secure 0 0 0) 0x7f1d5405aaf0 con 0x7f1d640b54e0 2024-04-26T23:44:13.428 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:44:13.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.422+0000 7f1d69400640 1 -- 172.21.15.137:0/1291452238 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d40068380 msgr2=0x7f1d4006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.422+0000 7f1d69400640 1 --2- 172.21.15.137:0/1291452238 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d40068380 0x7f1d4006a840 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0ad000 tx=0x7f1d4c008040 comp rx=0 tx=0).stop 2024-04-26T23:44:13.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.422+0000 7f1d69400640 1 -- 172.21.15.137:0/1291452238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d640b54e0 msgr2=0x7f1d6413d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.422+0000 7f1d69400640 1 --2- 172.21.15.137:0/1291452238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d640b54e0 0x7f1d6413d130 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1d5400c7f0 tx=0x7f1d5400ccb0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.422+0000 7f1d69400640 1 -- 172.21.15.137:0/1291452238 shutdown_connections 2024-04-26T23:44:13.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.422+0000 7f1d69400640 1 --2- 172.21.15.137:0/1291452238 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d40068380 0x7f1d4006a840 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.422+0000 7f1d69400640 1 --2- 172.21.15.137:0/1291452238 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d6415fe30 0x7f1d6415e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.422+0000 7f1d69400640 1 --2- 172.21.15.137:0/1291452238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d640cd710 0x7f1d640ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.422+0000 7f1d69400640 1 --2- 172.21.15.137:0/1291452238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d640b54e0 0x7f1d6413d130 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.422+0000 7f1d69400640 1 -- 172.21.15.137:0/1291452238 >> 172.21.15.137:0/1291452238 conn(0x7f1d6406c800 msgr2=0x7f1d64142a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:13.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.422+0000 7f1d69400640 1 -- 172.21.15.137:0/1291452238 shutdown_connections 2024-04-26T23:44:13.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.422+0000 7f1d69400640 1 -- 172.21.15.137:0/1291452238 wait complete. 2024-04-26T23:44:13.449 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject' 2024-04-26T23:44:13.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.578+0000 7f12c6c00640 1 Processor -- start 2024-04-26T23:44:13.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.578+0000 7f12c6c00640 1 -- start start 2024-04-26T23:44:13.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.578+0000 7f12c6c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f12c00725a0 0x7f12c00cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.578+0000 7f12c6c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12c00cfef0 con 0x7f12c0073f30 2024-04-26T23:44:13.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.578+0000 7f12c6c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12c00cddc0 con 0x7f12c00b5080 2024-04-26T23:44:13.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.578+0000 7f12c6c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f12c00d01b0 con 0x7f12c00725a0 2024-04-26T23:44:13.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.578+0000 7f12b7400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f12c0073f30 0x7f12c0072980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:33282/0 (socket says 172.21.15.137:33282) 2024-04-26T23:44:13.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.578+0000 7f12bfe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f12c00725a0 0x7f12c00cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.578+0000 7f12b7400640 1 -- 172.21.15.137:0/3300079633 learned_addr learned my addr 172.21.15.137:0/3300079633 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:13.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.578+0000 7f12bf400640 1 -- 172.21.15.137:0/3300079633 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 290972134 0 0) 0x7f12c00cfef0 con 0x7f12c0073f30 2024-04-26T23:44:13.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.578+0000 7f12bf400640 1 -- 172.21.15.137:0/3300079633 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12a4003530 con 0x7f12c0073f30 2024-04-26T23:44:13.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.578+0000 7f12bfe00640 1 -- 172.21.15.137:0/3300079633 >> v1:172.21.15.170:6789/0 conn(0x7f12c00b5080 legacy=0x7f12c0165930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.578+0000 7f12bfe00640 1 -- 172.21.15.137:0/3300079633 >> v1:172.21.15.137:6789/0 conn(0x7f12c0073f30 legacy=0x7f12c0072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.578+0000 7f12bfe00640 1 -- 172.21.15.137:0/3300079633 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c00d0490 con 0x7f12c00725a0 2024-04-26T23:44:13.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.582+0000 7f12bfe00640 1 --2- 172.21.15.137:0/3300079633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12c00725a0 0x7f12c00cd770 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f12b00097c0 tx=0x7f12b001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88de1a82b7c6c928 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:13.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.582+0000 7f12bf400640 1 -- 172.21.15.137:0/3300079633 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b00b0070 con 0x7f12c00725a0 2024-04-26T23:44:13.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.582+0000 7f12bf400640 1 -- 172.21.15.137:0/3300079633 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12b00ab600 con 0x7f12c00725a0 2024-04-26T23:44:13.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.582+0000 7f12bf400640 1 -- 172.21.15.137:0/3300079633 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b00ab9d0 con 0x7f12c00725a0 2024-04-26T23:44:13.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.582+0000 7f12c6c00640 1 -- 172.21.15.137:0/3300079633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12c00725a0 msgr2=0x7f12c00cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.582+0000 7f12c6c00640 1 --2- 172.21.15.137:0/3300079633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12c00725a0 0x7f12c00cd770 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f12b00097c0 tx=0x7f12b001c470 comp rx=0 tx=0).stop 2024-04-26T23:44:13.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.582+0000 7f12c6c00640 1 -- 172.21.15.137:0/3300079633 shutdown_connections 2024-04-26T23:44:13.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.582+0000 7f12c6c00640 1 --2- 172.21.15.137:0/3300079633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12c00725a0 0x7f12c00cd770 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.582+0000 7f12c6c00640 1 -- 172.21.15.137:0/3300079633 >> 172.21.15.137:0/3300079633 conn(0x7f12c006c5d0 msgr2=0x7f12c006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:13.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.582+0000 7f12c6c00640 1 -- 172.21.15.137:0/3300079633 shutdown_connections 2024-04-26T23:44:13.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.582+0000 7f12c6c00640 1 -- 172.21.15.137:0/3300079633 wait complete. 2024-04-26T23:44:13.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12c6c00640 1 Processor -- start 2024-04-26T23:44:13.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12c6c00640 1 -- start start 2024-04-26T23:44:13.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12c6c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12c00725a0 0x7f12c013a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12c6c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12c0073f30 0x7f12c015b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12c6c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f12c00b5080 0x7f12c00b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12c6c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12c006f930 con 0x7f12c00725a0 2024-04-26T23:44:13.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12c6c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f12c006f7b0 con 0x7f12c0073f30 2024-04-26T23:44:13.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12c6c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f12c006fab0 con 0x7f12c00b5080 2024-04-26T23:44:13.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12bfe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12c00725a0 0x7f12c013a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12bfe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12c00725a0 0x7f12c013a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40716/0 (socket says 172.21.15.137:40716) 2024-04-26T23:44:13.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12bfe00640 1 -- 172.21.15.137:0/2352388040 learned_addr learned my addr 172.21.15.137:0/2352388040 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:13.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12b7400640 1 --2- 172.21.15.137:0/2352388040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12c0073f30 0x7f12c015b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12c4c00640 1 --2- 172.21.15.137:0/2352388040 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f12c00b5080 0x7f12c00b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12bfe00640 1 -- 172.21.15.137:0/2352388040 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f12c00b5080 msgr2=0x7f12c00b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12bfe00640 1 --2- 172.21.15.137:0/2352388040 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f12c00b5080 0x7f12c00b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12bfe00640 1 -- 172.21.15.137:0/2352388040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12c0073f30 msgr2=0x7f12c015b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12bfe00640 1 --2- 172.21.15.137:0/2352388040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12c0073f30 0x7f12c015b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12bfe00640 1 -- 172.21.15.137:0/2352388040 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c015bf90 con 0x7f12c00725a0 2024-04-26T23:44:13.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12bfe00640 1 --2- 172.21.15.137:0/2352388040 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12c00725a0 0x7f12c013a450 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f12b0019080 tx=0x7f12b001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:13.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12bcc00640 1 -- 172.21.15.137:0/2352388040 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b00b0050 con 0x7f12c00725a0 2024-04-26T23:44:13.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12bcc00640 1 -- 172.21.15.137:0/2352388040 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12b00bc070 con 0x7f12c00725a0 2024-04-26T23:44:13.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12bcc00640 1 -- 172.21.15.137:0/2352388040 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b00b5830 con 0x7f12c00725a0 2024-04-26T23:44:13.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12c6c00640 1 -- 172.21.15.137:0/2352388040 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12c013ab60 con 0x7f12c00725a0 2024-04-26T23:44:13.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.586+0000 7f12c6c00640 1 -- 172.21.15.137:0/2352388040 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12c0140bd0 con 0x7f12c00725a0 2024-04-26T23:44:13.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.590+0000 7f12c6c00640 1 -- 172.21.15.137:0/2352388040 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12c01409e0 con 0x7f12c00725a0 2024-04-26T23:44:13.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.590+0000 7f12bcc00640 1 -- 172.21.15.137:0/2352388040 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f12b00b59d0 con 0x7f12c00725a0 2024-04-26T23:44:13.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.590+0000 7f12bcc00640 1 --2- 172.21.15.137:0/2352388040 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f129c068380 0x7f129c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.590+0000 7f12bcc00640 1 -- 172.21.15.137:0/2352388040 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5072+0+0 (secure 0 0 0) 0x7f12b0120db0 con 0x7f12c00725a0 2024-04-26T23:44:13.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.590+0000 7f12b7400640 1 --2- 172.21.15.137:0/2352388040 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f129c068380 0x7f129c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.590+0000 7f12b7400640 1 --2- 172.21.15.137:0/2352388040 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f129c068380 0x7f129c06a840 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f12c0072e60 tx=0x7f12a8007d40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:13.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.594+0000 7f12bcc00640 1 -- 172.21.15.137:0/2352388040 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f12b0125070 con 0x7f12c00725a0 2024-04-26T23:44:13.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:13.810+0000 7f12c6c00640 1 -- 172.21.15.137:0/2352388040 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]} v 0) -- 0x7f12c006a4b0 con 0x7f12c00725a0 2024-04-26T23:44:14.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.762+0000 7f12bcc00640 1 -- 172.21.15.137:0/2352388040 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]}]=0 v177) ==== 145+0+0 (secure 0 0 0) 0x7f12c015bf90 con 0x7f12c00725a0 2024-04-26T23:44:14.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.762+0000 7f12c6c00640 1 -- 172.21.15.137:0/2352388040 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f129c068380 msgr2=0x7f129c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:14.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.762+0000 7f12c6c00640 1 --2- 172.21.15.137:0/2352388040 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f129c068380 0x7f129c06a840 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f12c0072e60 tx=0x7f12a8007d40 comp rx=0 tx=0).stop 2024-04-26T23:44:14.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.762+0000 7f12c6c00640 1 -- 172.21.15.137:0/2352388040 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12c00725a0 msgr2=0x7f12c013a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:14.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.762+0000 7f12c6c00640 1 --2- 172.21.15.137:0/2352388040 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12c00725a0 0x7f12c013a450 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f12b0019080 tx=0x7f12b001acb0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.762+0000 7f12c6c00640 1 -- 172.21.15.137:0/2352388040 shutdown_connections 2024-04-26T23:44:14.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.762+0000 7f12c6c00640 1 --2- 172.21.15.137:0/2352388040 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f129c068380 0x7f129c06a840 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.762+0000 7f12c6c00640 1 --2- 172.21.15.137:0/2352388040 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f12c00b5080 0x7f12c00b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.762+0000 7f12c6c00640 1 --2- 172.21.15.137:0/2352388040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12c0073f30 0x7f12c015b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.762+0000 7f12c6c00640 1 --2- 172.21.15.137:0/2352388040 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12c00725a0 0x7f12c013a450 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.762+0000 7f12c6c00640 1 -- 172.21.15.137:0/2352388040 >> 172.21.15.137:0/2352388040 conn(0x7f12c006c5d0 msgr2=0x7f12c0143460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:14.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.762+0000 7f12c6c00640 1 -- 172.21.15.137:0/2352388040 shutdown_connections 2024-04-26T23:44:14.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.762+0000 7f12c6c00640 1 -- 172.21.15.137:0/2352388040 wait complete. 2024-04-26T23:44:14.793 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T23:44:14.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.926+0000 7ff1f2e00640 1 Processor -- start 2024-04-26T23:44:14.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.926+0000 7ff1f2e00640 1 -- start start 2024-04-26T23:44:14.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.930+0000 7ff1f2e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff1ec0ceb00 0x7ff1ec152510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.930+0000 7ff1f2e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff1ec0738d0 0x7ff1ec073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.930+0000 7ff1f2e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1ec15f0e0 0x7ff1ec15f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.930+0000 7ff1f2e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff1ec15baf0 con 0x7ff1ec0738d0 2024-04-26T23:44:14.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.930+0000 7ff1f2e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff1ec15bdb0 con 0x7ff1ec0ceb00 2024-04-26T23:44:14.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.930+0000 7ff1f2e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff1ec15c090 con 0x7ff1ec15f0e0 2024-04-26T23:44:14.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.930+0000 7ff1e3400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff1ec0738d0 0x7ff1ec073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.930+0000 7ff1e3400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff1ec0738d0 0x7ff1ec073d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40728/0 (socket says 172.21.15.137:40728) 2024-04-26T23:44:14.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.930+0000 7ff1e3400640 1 -- 172.21.15.137:0/2438431059 learned_addr learned my addr 172.21.15.137:0/2438431059 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:14.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.930+0000 7ff1f0e00640 1 --2- 172.21.15.137:0/2438431059 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1ec15f0e0 0x7ff1ec15f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.930+0000 7ff1ebe00640 1 --2- 172.21.15.137:0/2438431059 >> v2:172.21.15.170:3300/0 conn(0x7ff1ec0ceb00 0x7ff1ec152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.930+0000 7ff1e3400640 1 -- 172.21.15.137:0/2438431059 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1ec15f0e0 msgr2=0x7ff1ec15f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:14.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.930+0000 7ff1e3400640 1 --2- 172.21.15.137:0/2438431059 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1ec15f0e0 0x7ff1ec15f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.930+0000 7ff1e3400640 1 -- 172.21.15.137:0/2438431059 >> v2:172.21.15.170:3300/0 conn(0x7ff1ec0ceb00 msgr2=0x7ff1ec152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:14.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.930+0000 7ff1e3400640 1 --2- 172.21.15.137:0/2438431059 >> v2:172.21.15.170:3300/0 conn(0x7ff1ec0ceb00 0x7ff1ec152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.930+0000 7ff1e3400640 1 -- 172.21.15.137:0/2438431059 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1ec15c370 con 0x7ff1ec0738d0 2024-04-26T23:44:14.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.934+0000 7ff1e3400640 1 --2- 172.21.15.137:0/2438431059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1ec0738d0 0x7ff1ec073d60 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec0b5270 tx=0x7ff1d401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3533f46ef7464a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:14.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.934+0000 7ff1eb400640 1 -- 172.21.15.137:0/2438431059 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d40b0070 con 0x7ff1ec0738d0 2024-04-26T23:44:14.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.934+0000 7ff1eb400640 1 -- 172.21.15.137:0/2438431059 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d40ab600 con 0x7ff1ec0738d0 2024-04-26T23:44:14.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.934+0000 7ff1eb400640 1 -- 172.21.15.137:0/2438431059 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d40ab9d0 con 0x7ff1ec0738d0 2024-04-26T23:44:14.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.934+0000 7ff1f2e00640 1 -- 172.21.15.137:0/2438431059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1ec0738d0 msgr2=0x7ff1ec073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:14.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.934+0000 7ff1f2e00640 1 --2- 172.21.15.137:0/2438431059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1ec0738d0 0x7ff1ec073d60 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec0b5270 tx=0x7ff1d401c490 comp rx=0 tx=0).stop 2024-04-26T23:44:14.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.934+0000 7ff1f2e00640 1 -- 172.21.15.137:0/2438431059 shutdown_connections 2024-04-26T23:44:14.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.934+0000 7ff1f2e00640 1 --2- 172.21.15.137:0/2438431059 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1ec15f0e0 0x7ff1ec15f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.934+0000 7ff1f2e00640 1 --2- 172.21.15.137:0/2438431059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1ec0738d0 0x7ff1ec073d60 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.934+0000 7ff1f2e00640 1 --2- 172.21.15.137:0/2438431059 >> v2:172.21.15.170:3300/0 conn(0x7ff1ec0ceb00 0x7ff1ec152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.934+0000 7ff1f2e00640 1 -- 172.21.15.137:0/2438431059 >> 172.21.15.137:0/2438431059 conn(0x7ff1ec06c800 msgr2=0x7ff1ec06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:14.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.934+0000 7ff1f2e00640 1 -- 172.21.15.137:0/2438431059 shutdown_connections 2024-04-26T23:44:14.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.934+0000 7ff1f2e00640 1 -- 172.21.15.137:0/2438431059 wait complete. 2024-04-26T23:44:14.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.934+0000 7ff1f2e00640 1 Processor -- start 2024-04-26T23:44:14.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.934+0000 7ff1f2e00640 1 -- start start 2024-04-26T23:44:14.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1f2e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1ec0738d0 0x7ff1ec14e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1f2e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1ec15f0e0 0x7ff1ec0b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1f2e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1ec158070 0x7ff1ec150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1f2e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ec0b4720 con 0x7ff1ec0738d0 2024-04-26T23:44:14.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1f2e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ec0b45a0 con 0x7ff1ec158070 2024-04-26T23:44:14.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1f2e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff1ec0b48a0 con 0x7ff1ec15f0e0 2024-04-26T23:44:14.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1ebe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1ec0738d0 0x7ff1ec14e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1ebe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1ec0738d0 0x7ff1ec14e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40734/0 (socket says 172.21.15.137:40734) 2024-04-26T23:44:14.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1ebe00640 1 -- 172.21.15.137:0/3070939974 learned_addr learned my addr 172.21.15.137:0/3070939974 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:14.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1e3400640 1 --2- 172.21.15.137:0/3070939974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1ec15f0e0 0x7ff1ec0b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1f0e00640 1 --2- 172.21.15.137:0/3070939974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1ec158070 0x7ff1ec150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1ebe00640 1 -- 172.21.15.137:0/3070939974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1ec15f0e0 msgr2=0x7ff1ec0b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:14.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1ebe00640 1 --2- 172.21.15.137:0/3070939974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1ec15f0e0 0x7ff1ec0b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1ebe00640 1 -- 172.21.15.137:0/3070939974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1ec158070 msgr2=0x7ff1ec150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:14.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1ebe00640 1 --2- 172.21.15.137:0/3070939974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1ec158070 0x7ff1ec150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1ebe00640 1 -- 172.21.15.137:0/3070939974 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1ec1585d0 con 0x7ff1ec0738d0 2024-04-26T23:44:14.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1f0e00640 1 --2- 172.21.15.137:0/3070939974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1ec158070 0x7ff1ec150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:14.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1ebe00640 1 --2- 172.21.15.137:0/3070939974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1ec0738d0 0x7ff1ec14e700 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc007e60 tx=0x7ff1dc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:14.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1e8c00640 1 -- 172.21.15.137:0/3070939974 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc014620 con 0x7ff1ec0738d0 2024-04-26T23:44:14.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1e8c00640 1 -- 172.21.15.137:0/3070939974 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1dc019070 con 0x7ff1ec0738d0 2024-04-26T23:44:14.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1f2e00640 1 -- 172.21.15.137:0/3070939974 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1ec1588b0 con 0x7ff1ec0738d0 2024-04-26T23:44:14.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1e8c00640 1 -- 172.21.15.137:0/3070939974 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc014a00 con 0x7ff1ec0738d0 2024-04-26T23:44:14.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1f2e00640 1 -- 172.21.15.137:0/3070939974 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1ec158e70 con 0x7ff1ec0738d0 2024-04-26T23:44:14.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1f2e00640 1 -- 172.21.15.137:0/3070939974 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1ec06a410 con 0x7ff1ec0738d0 2024-04-26T23:44:14.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.938+0000 7ff1e8c00640 1 -- 172.21.15.137:0/3070939974 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff1dc014ba0 con 0x7ff1ec0738d0 2024-04-26T23:44:14.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.942+0000 7ff1e8c00640 1 --2- 172.21.15.137:0/3070939974 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff1c8068380 0x7ff1c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.942+0000 7ff1e8c00640 1 -- 172.21.15.137:0/3070939974 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5072+0+0 (secure 0 0 0) 0x7ff1dc086fe0 con 0x7ff1ec0738d0 2024-04-26T23:44:14.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.942+0000 7ff1e3400640 1 --2- 172.21.15.137:0/3070939974 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff1c8068380 0x7ff1c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.942+0000 7ff1e3400640 1 --2- 172.21.15.137:0/3070939974 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff1c8068380 0x7ff1c806a840 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff1d40ad000 tx=0x7ff1d4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:14.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:14.946+0000 7ff1e8c00640 1 -- 172.21.15.137:0/3070939974 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff1dc0577a0 con 0x7ff1ec0738d0 2024-04-26T23:44:15.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.102+0000 7ff1f2e00640 1 -- 172.21.15.137:0/3070939974 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff1ec0d08b0 con 0x7ff1ec0738d0 2024-04-26T23:44:15.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.106+0000 7ff1e8c00640 1 -- 172.21.15.137:0/3070939974 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7ff1dc0570a0 con 0x7ff1ec0738d0 2024-04-26T23:44:15.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.110+0000 7ff1f2e00640 1 -- 172.21.15.137:0/3070939974 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff1c8068380 msgr2=0x7ff1c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:15.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.110+0000 7ff1f2e00640 1 --2- 172.21.15.137:0/3070939974 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff1c8068380 0x7ff1c806a840 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff1d40ad000 tx=0x7ff1d4008040 comp rx=0 tx=0).stop 2024-04-26T23:44:15.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.110+0000 7ff1f2e00640 1 -- 172.21.15.137:0/3070939974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1ec0738d0 msgr2=0x7ff1ec14e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:15.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.110+0000 7ff1f2e00640 1 --2- 172.21.15.137:0/3070939974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1ec0738d0 0x7ff1ec14e700 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc007e60 tx=0x7ff1dc00e4b0 comp rx=0 tx=0).stop 2024-04-26T23:44:15.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.110+0000 7ff1f2e00640 1 -- 172.21.15.137:0/3070939974 shutdown_connections 2024-04-26T23:44:15.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.110+0000 7ff1f2e00640 1 --2- 172.21.15.137:0/3070939974 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff1c8068380 0x7ff1c806a840 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:15.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.110+0000 7ff1f2e00640 1 --2- 172.21.15.137:0/3070939974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1ec158070 0x7ff1ec150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:15.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.110+0000 7ff1f2e00640 1 --2- 172.21.15.137:0/3070939974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1ec15f0e0 0x7ff1ec0b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:15.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.110+0000 7ff1f2e00640 1 --2- 172.21.15.137:0/3070939974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1ec0738d0 0x7ff1ec14e700 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:15.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.110+0000 7ff1f2e00640 1 -- 172.21.15.137:0/3070939974 >> 172.21.15.137:0/3070939974 conn(0x7ff1ec06c800 msgr2=0x7ff1ec159f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:15.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.110+0000 7ff1f2e00640 1 -- 172.21.15.137:0/3070939974 shutdown_connections 2024-04-26T23:44:15.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.110+0000 7ff1f2e00640 1 -- 172.21.15.137:0/3070939974 wait complete. 2024-04-26T23:44:15.137 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T23:44:15.137 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:44:15.226 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:44:15.315 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T23:44:15.316 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:44:15.316 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:44:15.324 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4511 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:44:15.324 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:44:15.324 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:44:15.334 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4843 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:44:15.334 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:44:15.334 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:44:15.375 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4511 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:44:15.375 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:44:15.376 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:44:15.388 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4843 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:44:15.389 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-26T23:44:15.389 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:44:15.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.546+0000 7f48d8400640 1 Processor -- start 2024-04-26T23:44:15.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.550+0000 7f48d8400640 1 -- start start 2024-04-26T23:44:15.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.550+0000 7f48d8400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f48d015ced0 0x7f48d00d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:15.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.550+0000 7f48d8400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f48d00b14a0 0x7f48d00d18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:15.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.550+0000 7f48d8400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d00b1b30 con 0x7f48d015d2b0 2024-04-26T23:44:15.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.550+0000 7f48d8400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f48d00b18f0 con 0x7f48d00b14a0 2024-04-26T23:44:15.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.550+0000 7f48d8400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f48d00b1e10 con 0x7f48d015ced0 2024-04-26T23:44:15.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.550+0000 7f48d6400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f48d00b14a0 0x7f48d00d18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:15.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.550+0000 7f48d6400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f48d00b14a0 0x7f48d00d18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40748/0 (socket says 172.21.15.137:40748) 2024-04-26T23:44:15.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.550+0000 7f48d6400640 1 -- 172.21.15.137:0/1023217553 learned_addr learned my addr 172.21.15.137:0/1023217553 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:15.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.550+0000 7f48d5a00640 1 --2- 172.21.15.137:0/1023217553 >> v2:172.21.15.170:3300/0 conn(0x7f48d015ced0 0x7f48d00d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:15.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.550+0000 7f48d6400640 1 -- 172.21.15.137:0/1023217553 >> v2:172.21.15.170:3300/0 conn(0x7f48d015ced0 msgr2=0x7f48d00d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:15.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.550+0000 7f48d6400640 1 --2- 172.21.15.137:0/1023217553 >> v2:172.21.15.170:3300/0 conn(0x7f48d015ced0 0x7f48d00d13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:15.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.550+0000 7f48d6400640 1 -- 172.21.15.137:0/1023217553 >> v1:172.21.15.170:6789/0 conn(0x7f48d015d2b0 legacy=0x7f48d00b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:15.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.550+0000 7f48d6400640 1 -- 172.21.15.137:0/1023217553 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d00b23f0 con 0x7f48d00b14a0 2024-04-26T23:44:15.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.554+0000 7f48d6400640 1 --2- 172.21.15.137:0/1023217553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48d00b14a0 0x7f48d00d18f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f48d00d0880 tx=0x7f48c801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d1066698b309ae server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:15.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.554+0000 7f48cfe00640 1 -- 172.21.15.137:0/1023217553 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c80a5780 con 0x7f48d00b14a0 2024-04-26T23:44:15.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.554+0000 7f48cfe00640 1 -- 172.21.15.137:0/1023217553 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c80a5920 con 0x7f48d00b14a0 2024-04-26T23:44:15.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.554+0000 7f48cfe00640 1 -- 172.21.15.137:0/1023217553 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c80a5cf0 con 0x7f48d00b14a0 2024-04-26T23:44:15.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.554+0000 7f48d8400640 1 -- 172.21.15.137:0/1023217553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48d00b14a0 msgr2=0x7f48d00d18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:15.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.554+0000 7f48d8400640 1 --2- 172.21.15.137:0/1023217553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48d00b14a0 0x7f48d00d18f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f48d00d0880 tx=0x7f48c801c9b0 comp rx=0 tx=0).stop 2024-04-26T23:44:15.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.554+0000 7f48d8400640 1 -- 172.21.15.137:0/1023217553 shutdown_connections 2024-04-26T23:44:15.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.554+0000 7f48d8400640 1 --2- 172.21.15.137:0/1023217553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48d00b14a0 0x7f48d00d18f0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:15.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.554+0000 7f48d8400640 1 --2- 172.21.15.137:0/1023217553 >> v2:172.21.15.170:3300/0 conn(0x7f48d015ced0 0x7f48d00d13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:15.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.554+0000 7f48d8400640 1 -- 172.21.15.137:0/1023217553 >> 172.21.15.137:0/1023217553 conn(0x7f48d009ba60 msgr2=0x7f48d009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:15.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.554+0000 7f48d8400640 1 -- 172.21.15.137:0/1023217553 shutdown_connections 2024-04-26T23:44:15.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.554+0000 7f48d8400640 1 -- 172.21.15.137:0/1023217553 wait complete. 2024-04-26T23:44:15.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.554+0000 7f48d8400640 1 Processor -- start 2024-04-26T23:44:15.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.554+0000 7f48d8400640 1 -- start start 2024-04-26T23:44:15.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48d8400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48d00b14a0 0x7f48d0157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:15.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48d8400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48d015ced0 0x7f48d00afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:15.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48d8400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48d015d2b0 0x7f48d00b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:15.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48d8400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f48d00b3810 con 0x7f48d015d2b0 2024-04-26T23:44:15.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48d8400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f48d00b3690 con 0x7f48d015ced0 2024-04-26T23:44:15.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48d8400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f48d00b3990 con 0x7f48d00b14a0 2024-04-26T23:44:15.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48d6400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48d015d2b0 0x7f48d00b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:15.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48d6400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48d015d2b0 0x7f48d00b0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40752/0 (socket says 172.21.15.137:40752) 2024-04-26T23:44:15.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48d6400640 1 -- 172.21.15.137:0/2168379936 learned_addr learned my addr 172.21.15.137:0/2168379936 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:15.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48d5a00640 1 --2- 172.21.15.137:0/2168379936 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48d00b14a0 0x7f48d0157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:15.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48d5000640 1 --2- 172.21.15.137:0/2168379936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48d015ced0 0x7f48d00afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:15.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48d6400640 1 -- 172.21.15.137:0/2168379936 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48d00b14a0 msgr2=0x7f48d0157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:15.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48d6400640 1 --2- 172.21.15.137:0/2168379936 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48d00b14a0 0x7f48d0157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:15.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48d6400640 1 -- 172.21.15.137:0/2168379936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48d015ced0 msgr2=0x7f48d00afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:15.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48d6400640 1 --2- 172.21.15.137:0/2168379936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48d015ced0 0x7f48d00afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:15.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48d6400640 1 -- 172.21.15.137:0/2168379936 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d0157ce0 con 0x7f48d015d2b0 2024-04-26T23:44:15.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48d6400640 1 --2- 172.21.15.137:0/2168379936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48d015d2b0 0x7f48d00b0000 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f48c80af040 tx=0x7f48c8019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:15.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48cd600640 1 -- 172.21.15.137:0/2168379936 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c80b8880 con 0x7f48d015d2b0 2024-04-26T23:44:15.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48cd600640 1 -- 172.21.15.137:0/2168379936 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c80be070 con 0x7f48d015d2b0 2024-04-26T23:44:15.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48d8400640 1 -- 172.21.15.137:0/2168379936 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d0157fc0 con 0x7f48d015d2b0 2024-04-26T23:44:15.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48cd600640 1 -- 172.21.15.137:0/2168379936 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c80b8c80 con 0x7f48d015d2b0 2024-04-26T23:44:15.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48d8400640 1 -- 172.21.15.137:0/2168379936 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d0158580 con 0x7f48d015d2b0 2024-04-26T23:44:15.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48d8400640 1 -- 172.21.15.137:0/2168379936 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d006a4b0 con 0x7f48d015d2b0 2024-04-26T23:44:15.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.558+0000 7f48cd600640 1 -- 172.21.15.137:0/2168379936 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f48c80c3460 con 0x7f48d015d2b0 2024-04-26T23:44:15.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.562+0000 7f48cd600640 1 --2- 172.21.15.137:0/2168379936 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f48b0068380 0x7f48b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:15.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.562+0000 7f48cd600640 1 -- 172.21.15.137:0/2168379936 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5072+0+0 (secure 0 0 0) 0x7f48c8121c00 con 0x7f48d015d2b0 2024-04-26T23:44:15.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.562+0000 7f48d5a00640 1 --2- 172.21.15.137:0/2168379936 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f48b0068380 0x7f48b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:15.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.562+0000 7f48d5a00640 1 --2- 172.21.15.137:0/2168379936 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f48b0068380 0x7f48b006a840 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f48d015c320 tx=0x7f48c4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:15.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.566+0000 7f48cd600640 1 -- 172.21.15.137:0/2168379936 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f48c80165a0 con 0x7f48d015d2b0 2024-04-26T23:44:15.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.758+0000 7f48d8400640 1 -- 172.21.15.137:0/2168379936 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48d0070d90 con 0x7f48d015d2b0 2024-04-26T23:44:15.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.758+0000 7f48cd600640 1 -- 172.21.15.137:0/2168379936 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+3878 (secure 0 0 0) 0x7f48c80b8e20 con 0x7f48d015d2b0 2024-04-26T23:44:15.766 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:15.766 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":31,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/145346644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":145346644},{"type":"v1","addr":"172.21.15.170:6835","nonce":145346644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5656,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3121910067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3121910067},{"type":"v1","addr":"172.21.15.170:6834","nonce":3121910067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":6270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2484993048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2484993048},{"type":"v1","addr":"172.21.15.137:6835","nonce":2484993048}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1837447372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1837447372},{"type":"v1","addr":"172.21.15.137:6837","nonce":1837447372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[]} 2024-04-26T23:44:15.767 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 31 2024-04-26T23:44:15.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.762+0000 7f48d8400640 1 -- 172.21.15.137:0/2168379936 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f48b0068380 msgr2=0x7f48b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:15.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.762+0000 7f48d8400640 1 --2- 172.21.15.137:0/2168379936 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f48b0068380 0x7f48b006a840 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f48d015c320 tx=0x7f48c4008040 comp rx=0 tx=0).stop 2024-04-26T23:44:15.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.762+0000 7f48d8400640 1 -- 172.21.15.137:0/2168379936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48d015d2b0 msgr2=0x7f48d00b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:15.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.762+0000 7f48d8400640 1 --2- 172.21.15.137:0/2168379936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48d015d2b0 0x7f48d00b0000 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f48c80af040 tx=0x7f48c8019750 comp rx=0 tx=0).stop 2024-04-26T23:44:15.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.762+0000 7f48d8400640 1 -- 172.21.15.137:0/2168379936 shutdown_connections 2024-04-26T23:44:15.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.762+0000 7f48d8400640 1 --2- 172.21.15.137:0/2168379936 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f48b0068380 0x7f48b006a840 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:15.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.762+0000 7f48d8400640 1 --2- 172.21.15.137:0/2168379936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48d015d2b0 0x7f48d00b0000 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:15.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.762+0000 7f48d8400640 1 --2- 172.21.15.137:0/2168379936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48d015ced0 0x7f48d00afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:15.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.762+0000 7f48d8400640 1 --2- 172.21.15.137:0/2168379936 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48d00b14a0 0x7f48d0157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:15.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.762+0000 7f48d8400640 1 -- 172.21.15.137:0/2168379936 >> 172.21.15.137:0/2168379936 conn(0x7f48d009ba60 msgr2=0x7f48d00d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:15.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.762+0000 7f48d8400640 1 -- 172.21.15.137:0/2168379936 shutdown_connections 2024-04-26T23:44:15.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.762+0000 7f48d8400640 1 -- 172.21.15.137:0/2168379936 wait complete. 2024-04-26T23:44:15.789 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T23:44:15.789 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-26T23:44:15.789 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T23:44:15.789 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:44:15.790 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T23:44:15.790 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-26T23:44:15.790 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T23:44:15.790 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:44:15.790 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T23:44:15.791 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-26T23:44:15.791 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T23:44:15.791 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:44:15.791 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T23:44:15.791 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-26T23:44:15.791 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T23:44:15.792 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:44:15.807 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T23:44:15.807 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T23:44:15.808 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T23:44:15.808 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T23:44:15.811 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T23:44:15.811 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T23:44:15.812 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T23:44:15.812 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T23:44:15.854 INFO:tasks.ceph.mds.a:Started 2024-04-26T23:44:15.855 DEBUG:teuthology.parallel:result is None 2024-04-26T23:44:15.855 INFO:tasks.ceph.mds.b:Started 2024-04-26T23:44:15.855 DEBUG:teuthology.parallel:result is None 2024-04-26T23:44:15.856 INFO:tasks.ceph.mds.c:Started 2024-04-26T23:44:15.856 DEBUG:teuthology.parallel:result is None 2024-04-26T23:44:15.857 INFO:tasks.ceph.mds.d:Started 2024-04-26T23:44:15.857 DEBUG:teuthology.parallel:result is None 2024-04-26T23:44:15.857 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-26T23:44:15.942 INFO:tasks.ceph.mds.a.smithi137.stdout:starting mds.a at 2024-04-26T23:44:15.942 INFO:tasks.ceph.mds.c.smithi137.stdout:starting mds.c at 2024-04-26T23:44:15.949 INFO:tasks.ceph.mds.d.smithi170.stdout:starting mds.d at 2024-04-26T23:44:15.949 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2024-04-26T23:44:16.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.994+0000 7f6fd2c00640 1 Processor -- start 2024-04-26T23:44:16.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.994+0000 7f6fd2c00640 1 -- start start 2024-04-26T23:44:16.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.998+0000 7f6fd2c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6fcc0b5080 0x7f6fcc0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:16.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.998+0000 7f6fd2c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6fcc072980 0x7f6fcc072e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:16.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.998+0000 7f6fd2c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fcc0cfef0 con 0x7f6fcc0725a0 2024-04-26T23:44:16.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.998+0000 7f6fd2c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f6fcc0cddc0 con 0x7f6fcc0b5080 2024-04-26T23:44:16.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.998+0000 7f6fd2c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6fcc0d01b0 con 0x7f6fcc072980 2024-04-26T23:44:16.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.998+0000 7f6fd0c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6fcc072980 0x7f6fcc072e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:16.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.998+0000 7f6fd0c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6fcc072980 0x7f6fcc072e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:43532/0 (socket says 172.21.15.137:43532) 2024-04-26T23:44:16.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.998+0000 7f6fd0c00640 1 -- 172.21.15.137:0/4062640448 learned_addr learned my addr 172.21.15.137:0/4062640448 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:16.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.998+0000 7f6fc3400640 1 --2- 172.21.15.137:0/4062640448 >> v2:172.21.15.170:3300/0 conn(0x7f6fcc0b5080 0x7f6fcc0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:16.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.998+0000 7f6fd0c00640 1 -- 172.21.15.137:0/4062640448 >> v2:172.21.15.170:3300/0 conn(0x7f6fcc0b5080 msgr2=0x7f6fcc0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:16.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.998+0000 7f6fd0c00640 1 --2- 172.21.15.137:0/4062640448 >> v2:172.21.15.170:3300/0 conn(0x7f6fcc0b5080 0x7f6fcc0cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:16.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.998+0000 7f6fd0c00640 1 -- 172.21.15.137:0/4062640448 >> v1:172.21.15.170:6789/0 conn(0x7f6fcc0725a0 legacy=0x7f6fcc073f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:16.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.998+0000 7f6fcb400640 1 -- 172.21.15.137:0/4062640448 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2217506166 0 0) 0x7f6fcc0cfef0 con 0x7f6fcc0725a0 2024-04-26T23:44:16.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:15.998+0000 7f6fd0c00640 1 -- 172.21.15.137:0/4062640448 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fcc0d0490 con 0x7f6fcc072980 2024-04-26T23:44:16.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.002+0000 7f6fd0c00640 1 --2- 172.21.15.137:0/4062640448 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6fcc072980 0x7f6fcc072e30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4009e80 tx=0x7f6fc401c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6db98055a44c9202 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:16.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.002+0000 7f6fcb400640 1 -- 172.21.15.137:0/4062640448 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc40a58a0 con 0x7f6fcc072980 2024-04-26T23:44:16.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.002+0000 7f6fcb400640 1 -- 172.21.15.137:0/4062640448 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fc40a5a40 con 0x7f6fcc072980 2024-04-26T23:44:16.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.002+0000 7f6fcb400640 1 -- 172.21.15.137:0/4062640448 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc40a5e10 con 0x7f6fcc072980 2024-04-26T23:44:16.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.002+0000 7f6fd2c00640 1 -- 172.21.15.137:0/4062640448 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6fcc072980 msgr2=0x7f6fcc072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:16.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.002+0000 7f6fd2c00640 1 --2- 172.21.15.137:0/4062640448 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6fcc072980 0x7f6fcc072e30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4009e80 tx=0x7f6fc401c9e0 comp rx=0 tx=0).stop 2024-04-26T23:44:16.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.002+0000 7f6fd2c00640 1 -- 172.21.15.137:0/4062640448 shutdown_connections 2024-04-26T23:44:16.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.002+0000 7f6fd2c00640 1 --2- 172.21.15.137:0/4062640448 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6fcc072980 0x7f6fcc072e30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:16.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.002+0000 7f6fd2c00640 1 --2- 172.21.15.137:0/4062640448 >> v2:172.21.15.170:3300/0 conn(0x7f6fcc0b5080 0x7f6fcc0cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:16.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.002+0000 7f6fd2c00640 1 -- 172.21.15.137:0/4062640448 >> 172.21.15.137:0/4062640448 conn(0x7f6fcc06c5d0 msgr2=0x7f6fcc06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:16.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.002+0000 7f6fd2c00640 1 -- 172.21.15.137:0/4062640448 shutdown_connections 2024-04-26T23:44:16.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.002+0000 7f6fd2c00640 1 -- 172.21.15.137:0/4062640448 wait complete. 2024-04-26T23:44:16.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.002+0000 7f6fd2c00640 1 Processor -- start 2024-04-26T23:44:16.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.002+0000 7f6fd2c00640 1 -- start start 2024-04-26T23:44:16.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fd2c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6fcc0725a0 0x7f6fcc14f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fd2c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6fcc072980 0x7f6fcc165050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fd2c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fcc0b5080 0x7f6fcc143350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fd2c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6fcc1684e0 con 0x7f6fcc0b5080 2024-04-26T23:44:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fd2c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6fcc168360 con 0x7f6fcc0725a0 2024-04-26T23:44:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fd2c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6fcc168660 con 0x7f6fcc072980 2024-04-26T23:44:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fd0c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fcc0b5080 0x7f6fcc143350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fcbe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6fcc0725a0 0x7f6fcc14f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fd0c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fcc0b5080 0x7f6fcc143350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40800/0 (socket says 172.21.15.137:40800) 2024-04-26T23:44:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fd0c00640 1 -- 172.21.15.137:0/2972926718 learned_addr learned my addr 172.21.15.137:0/2972926718 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fc3400640 1 --2- 172.21.15.137:0/2972926718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6fcc072980 0x7f6fcc165050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fd0c00640 1 -- 172.21.15.137:0/2972926718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6fcc072980 msgr2=0x7f6fcc165050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fd0c00640 1 --2- 172.21.15.137:0/2972926718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6fcc072980 0x7f6fcc165050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fd0c00640 1 -- 172.21.15.137:0/2972926718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6fcc0725a0 msgr2=0x7f6fcc14f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:16.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fd0c00640 1 --2- 172.21.15.137:0/2972926718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6fcc0725a0 0x7f6fcc14f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:16.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fd0c00640 1 -- 172.21.15.137:0/2972926718 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fcc14fb80 con 0x7f6fcc0b5080 2024-04-26T23:44:16.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fd0c00640 1 --2- 172.21.15.137:0/2972926718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fcc0b5080 0x7f6fcc143350 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6fc40af040 tx=0x7f6fc4019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:16.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fc8c00640 1 -- 172.21.15.137:0/2972926718 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc40a58a0 con 0x7f6fcc0b5080 2024-04-26T23:44:16.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fc8c00640 1 -- 172.21.15.137:0/2972926718 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fc40be070 con 0x7f6fcc0b5080 2024-04-26T23:44:16.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fc8c00640 1 -- 172.21.15.137:0/2972926718 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4009510 con 0x7f6fcc0b5080 2024-04-26T23:44:16.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fd2c00640 1 -- 172.21.15.137:0/2972926718 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fcc0b3360 con 0x7f6fcc0b5080 2024-04-26T23:44:16.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fd2c00640 1 -- 172.21.15.137:0/2972926718 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fcc164850 con 0x7f6fcc0b5080 2024-04-26T23:44:16.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fd2c00640 1 -- 172.21.15.137:0/2972926718 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fcc0b3880 con 0x7f6fcc0b5080 2024-04-26T23:44:16.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.006+0000 7f6fc8c00640 1 -- 172.21.15.137:0/2972926718 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6fc40b8470 con 0x7f6fcc0b5080 2024-04-26T23:44:16.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.010+0000 7f6fc8c00640 1 --2- 172.21.15.137:0/2972926718 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6fa8068380 0x7f6fa806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:16.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.010+0000 7f6fc8c00640 1 -- 172.21.15.137:0/2972926718 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5072+0+0 (secure 0 0 0) 0x7f6fc4121c10 con 0x7f6fcc0b5080 2024-04-26T23:44:16.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.010+0000 7f6fcbe00640 1 --2- 172.21.15.137:0/2972926718 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6fa8068380 0x7f6fa806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:16.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.010+0000 7f6fcbe00640 1 --2- 172.21.15.137:0/2972926718 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6fa8068380 0x7f6fa806a840 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc007fd0 tx=0x7f6fbc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:16.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.014+0000 7f6fc8c00640 1 -- 172.21.15.137:0/2972926718 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6fcc0b3880 con 0x7f6fcc0b5080 2024-04-26T23:44:16.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:16.186+0000 7f6fd2c00640 1 -- 172.21.15.137:0/2972926718 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f6fcc06a4b0 con 0x7f6fcc0b5080 2024-04-26T23:44:17.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.122+0000 7f6fc8c00640 1 -- 172.21.15.137:0/2972926718 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v56) ==== 97+0+0 (secure 0 0 0) 0x7f6fc4016600 con 0x7f6fcc0b5080 2024-04-26T23:44:17.128 INFO:teuthology.orchestra.run.smithi137.stderr: removed all blocklist entries 2024-04-26T23:44:17.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.122+0000 7f6fd2c00640 1 -- 172.21.15.137:0/2972926718 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6fa8068380 msgr2=0x7f6fa806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:17.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.122+0000 7f6fd2c00640 1 --2- 172.21.15.137:0/2972926718 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6fa8068380 0x7f6fa806a840 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc007fd0 tx=0x7f6fbc009040 comp rx=0 tx=0).stop 2024-04-26T23:44:17.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.122+0000 7f6fd2c00640 1 -- 172.21.15.137:0/2972926718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fcc0b5080 msgr2=0x7f6fcc143350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:17.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.122+0000 7f6fd2c00640 1 --2- 172.21.15.137:0/2972926718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fcc0b5080 0x7f6fcc143350 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6fc40af040 tx=0x7f6fc4019780 comp rx=0 tx=0).stop 2024-04-26T23:44:17.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.122+0000 7f6fd2c00640 1 -- 172.21.15.137:0/2972926718 shutdown_connections 2024-04-26T23:44:17.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.122+0000 7f6fd2c00640 1 --2- 172.21.15.137:0/2972926718 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6fa8068380 0x7f6fa806a840 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.122+0000 7f6fd2c00640 1 --2- 172.21.15.137:0/2972926718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fcc0b5080 0x7f6fcc143350 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.122+0000 7f6fd2c00640 1 --2- 172.21.15.137:0/2972926718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6fcc072980 0x7f6fcc165050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.122+0000 7f6fd2c00640 1 --2- 172.21.15.137:0/2972926718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6fcc0725a0 0x7f6fcc14f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.122+0000 7f6fd2c00640 1 -- 172.21.15.137:0/2972926718 >> 172.21.15.137:0/2972926718 conn(0x7f6fcc06c5d0 msgr2=0x7f6fcc06ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:17.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.122+0000 7f6fd2c00640 1 -- 172.21.15.137:0/2972926718 shutdown_connections 2024-04-26T23:44:17.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.122+0000 7f6fd2c00640 1 -- 172.21.15.137:0/2972926718 wait complete. 2024-04-26T23:44:17.154 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-26T23:44:17.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.286+0000 7efe28200640 1 Processor -- start 2024-04-26T23:44:17.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.286+0000 7efe28200640 1 -- start start 2024-04-26T23:44:17.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.286+0000 7efe28200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efe2015f3d0 0x7efe200d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:17.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.286+0000 7efe28200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe200b4100 0x7efe2015f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:17.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.286+0000 7efe28200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe20160240 con 0x7efe2015fcf0 2024-04-26T23:44:17.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.286+0000 7efe28200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7efe200b2960 con 0x7efe2015f3d0 2024-04-26T23:44:17.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.286+0000 7efe28200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7efe20160520 con 0x7efe200b4100 2024-04-26T23:44:17.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.286+0000 7efe25800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efe2015f3d0 0x7efe200d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:17.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.286+0000 7efe25800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efe2015f3d0 0x7efe200d1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40810/0 (socket says 172.21.15.137:40810) 2024-04-26T23:44:17.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.286+0000 7efe25800640 1 -- 172.21.15.137:0/1349659272 learned_addr learned my addr 172.21.15.137:0/1349659272 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:17.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.286+0000 7efe26200640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7efe2015fcf0 0x7efe200d2d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:33306/0 (socket says 172.21.15.137:33306) 2024-04-26T23:44:17.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.286+0000 7efe24e00640 1 --2- 172.21.15.137:0/1349659272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe200b4100 0x7efe2015f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:17.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.286+0000 7efe25800640 1 -- 172.21.15.137:0/1349659272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe200b4100 msgr2=0x7efe2015f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:17.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.286+0000 7efe25800640 1 --2- 172.21.15.137:0/1349659272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe200b4100 0x7efe2015f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.286+0000 7efe25800640 1 -- 172.21.15.137:0/1349659272 >> v1:172.21.15.137:6789/0 conn(0x7efe2015fcf0 legacy=0x7efe200d2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:17.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.286+0000 7efe25800640 1 -- 172.21.15.137:0/1349659272 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe20160800 con 0x7efe2015f3d0 2024-04-26T23:44:17.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.286+0000 7efe1fe00640 1 -- 172.21.15.137:0/1349659272 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2083724260 0 0) 0x7efe20160240 con 0x7efe2015fcf0 2024-04-26T23:44:17.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.286+0000 7efe24e00640 1 --2- 172.21.15.137:0/1349659272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe200b4100 0x7efe2015f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:17.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.290+0000 7efe25800640 1 --2- 172.21.15.137:0/1349659272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe2015f3d0 0x7efe200d1030 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7efe14009870 tx=0x7efe1401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be36bbb9fde54211 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:17.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.290+0000 7efe1fe00640 1 -- 172.21.15.137:0/1349659272 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe140ab430 con 0x7efe2015f3d0 2024-04-26T23:44:17.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.290+0000 7efe1fe00640 1 -- 172.21.15.137:0/1349659272 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe140b0070 con 0x7efe2015f3d0 2024-04-26T23:44:17.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.290+0000 7efe1fe00640 1 -- 172.21.15.137:0/1349659272 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe140ab7f0 con 0x7efe2015f3d0 2024-04-26T23:44:17.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.290+0000 7efe28200640 1 -- 172.21.15.137:0/1349659272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe2015f3d0 msgr2=0x7efe200d1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:17.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.290+0000 7efe28200640 1 --2- 172.21.15.137:0/1349659272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe2015f3d0 0x7efe200d1030 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7efe14009870 tx=0x7efe1401c560 comp rx=0 tx=0).stop 2024-04-26T23:44:17.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.290+0000 7efe28200640 1 -- 172.21.15.137:0/1349659272 shutdown_connections 2024-04-26T23:44:17.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.290+0000 7efe28200640 1 --2- 172.21.15.137:0/1349659272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe200b4100 0x7efe2015f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.290+0000 7efe28200640 1 --2- 172.21.15.137:0/1349659272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe2015f3d0 0x7efe200d1030 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.290+0000 7efe28200640 1 -- 172.21.15.137:0/1349659272 >> 172.21.15.137:0/1349659272 conn(0x7efe2009ba60 msgr2=0x7efe2009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:17.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.290+0000 7efe28200640 1 -- 172.21.15.137:0/1349659272 shutdown_connections 2024-04-26T23:44:17.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.290+0000 7efe28200640 1 -- 172.21.15.137:0/1349659272 wait complete. 2024-04-26T23:44:17.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe28200640 1 Processor -- start 2024-04-26T23:44:17.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe28200640 1 -- start start 2024-04-26T23:44:17.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe28200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe200b4100 0x7efe2014c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:17.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe28200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe2015f3d0 0x7efe200b7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:17.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe28200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe2015fcf0 0x7efe20071320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:17.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe28200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efe200b3990 con 0x7efe2015fcf0 2024-04-26T23:44:17.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe28200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efe200b3810 con 0x7efe200b4100 2024-04-26T23:44:17.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe28200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7efe200b3b10 con 0x7efe2015f3d0 2024-04-26T23:44:17.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe26200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe2015fcf0 0x7efe20071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:17.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe26200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe2015fcf0 0x7efe20071320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40818/0 (socket says 172.21.15.137:40818) 2024-04-26T23:44:17.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe26200640 1 -- 172.21.15.137:0/3734461520 learned_addr learned my addr 172.21.15.137:0/3734461520 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:17.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe24e00640 1 --2- 172.21.15.137:0/3734461520 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe2015f3d0 0x7efe200b7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:17.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe25800640 1 --2- 172.21.15.137:0/3734461520 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe200b4100 0x7efe2014c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:17.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe26200640 1 -- 172.21.15.137:0/3734461520 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe2015f3d0 msgr2=0x7efe200b7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:17.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe26200640 1 --2- 172.21.15.137:0/3734461520 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe2015f3d0 0x7efe200b7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe26200640 1 -- 172.21.15.137:0/3734461520 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe200b4100 msgr2=0x7efe2014c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:17.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe26200640 1 --2- 172.21.15.137:0/3734461520 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe200b4100 0x7efe2014c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe26200640 1 -- 172.21.15.137:0/3734461520 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe2014cc30 con 0x7efe2015fcf0 2024-04-26T23:44:17.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe25800640 1 --2- 172.21.15.137:0/3734461520 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe200b4100 0x7efe2014c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:17.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe26200640 1 --2- 172.21.15.137:0/3734461520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe2015fcf0 0x7efe20071320 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7efe1800c7b0 tx=0x7efe1800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:17.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe1d600640 1 -- 172.21.15.137:0/3734461520 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe18018070 con 0x7efe2015fcf0 2024-04-26T23:44:17.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe1d600640 1 -- 172.21.15.137:0/3734461520 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe1800a640 con 0x7efe2015fcf0 2024-04-26T23:44:17.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe28200640 1 -- 172.21.15.137:0/3734461520 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe200b8050 con 0x7efe2015fcf0 2024-04-26T23:44:17.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe1d600640 1 -- 172.21.15.137:0/3734461520 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1800aa30 con 0x7efe2015fcf0 2024-04-26T23:44:17.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe28200640 1 -- 172.21.15.137:0/3734461520 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe2015c6e0 con 0x7efe2015fcf0 2024-04-26T23:44:17.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.294+0000 7efe28200640 1 -- 172.21.15.137:0/3734461520 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe200b8570 con 0x7efe2015fcf0 2024-04-26T23:44:17.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.298+0000 7efe1d600640 1 -- 172.21.15.137:0/3734461520 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efe1801b070 con 0x7efe2015fcf0 2024-04-26T23:44:17.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.298+0000 7efe1d600640 1 --2- 172.21.15.137:0/3734461520 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efe000683b0 0x7efe0006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:17.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.298+0000 7efe1d600640 1 -- 172.21.15.137:0/3734461520 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4857+0+0 (secure 0 0 0) 0x7efe18085ad0 con 0x7efe2015fcf0 2024-04-26T23:44:17.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.298+0000 7efe25800640 1 --2- 172.21.15.137:0/3734461520 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efe000683b0 0x7efe0006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:17.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.298+0000 7efe25800640 1 --2- 172.21.15.137:0/3734461520 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efe000683b0 0x7efe0006a870 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efe140af000 tx=0x7efe14008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:17.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.302+0000 7efe1d600640 1 -- 172.21.15.137:0/3734461520 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efe200b8570 con 0x7efe2015fcf0 2024-04-26T23:44:17.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.510+0000 7efe28200640 1 -- 172.21.15.137:0/3734461520 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7efe2006a4b0 con 0x7efe2015fcf0 2024-04-26T23:44:17.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.510+0000 7efe1d600640 1 -- 172.21.15.137:0/3734461520 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7efe18055d90 con 0x7efe2015fcf0 2024-04-26T23:44:17.517 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:17.517 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:44:17.517 INFO:teuthology.orchestra.run.smithi137.stdout: "auth_dump": [ 2024-04-26T23:44:17.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:44:17.517 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.a", 2024-04-26T23:44:17.517 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBkOyxm8fEFJhAApnO8C5VzrzRze2CXBFDX+w==", 2024-04-26T23:44:17.518 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:44:17.518 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:44:17.518 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T23:44:17.518 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T23:44:17.518 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:44:17.518 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:17.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:17.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:44:17.518 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.b", 2024-04-26T23:44:17.518 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBkOyxmcIXMMRAAbatu788GHajE0CeUmSfG6g==", 2024-04-26T23:44:17.518 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:44:17.518 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:44:17.518 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T23:44:17.519 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T23:44:17.519 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:44:17.519 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:17.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:17.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:44:17.519 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.c", 2024-04-26T23:44:17.519 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBkOyxmxOM0LRAAqjFB1cWhxjLMmH2Hw08y4Q==", 2024-04-26T23:44:17.519 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:44:17.519 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:44:17.519 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T23:44:17.519 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T23:44:17.519 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:44:17.519 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:17.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:17.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:44:17.520 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.d", 2024-04-26T23:44:17.520 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBkOyxmtB0QORAA4pb1qkARdVDYWtrlHHLM8A==", 2024-04-26T23:44:17.520 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:44:17.520 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:44:17.520 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T23:44:17.520 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T23:44:17.520 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:44:17.520 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:17.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:17.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:44:17.520 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.0", 2024-04-26T23:44:17.520 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBoOyxmBpUlARAAFTI893hK3CG+M43N95QY0Q==", 2024-04-26T23:44:17.520 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:44:17.521 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:44:17.521 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:44:17.521 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:44:17.521 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:17.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:17.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:44:17.521 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.1", 2024-04-26T23:44:17.521 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBrOyxmOKoBDRAAEKl+f5dgrhKsrw9GLl/aZg==", 2024-04-26T23:44:17.521 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:44:17.521 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:44:17.521 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:44:17.521 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:44:17.521 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:17.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:17.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:44:17.522 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.2", 2024-04-26T23:44:17.522 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBuOyxmRCxpFxAAiugbUkmCpSi3PpcfSIqzag==", 2024-04-26T23:44:17.522 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:44:17.522 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:44:17.522 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:44:17.522 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:44:17.522 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:17.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:17.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:44:17.522 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.3", 2024-04-26T23:44:17.522 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBxOyxmAVDRHxAAn16e0bzh8lMn7IfompY4tg==", 2024-04-26T23:44:17.522 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:44:17.522 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:44:17.523 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:44:17.523 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:44:17.523 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:17.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:17.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:44:17.523 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.4", 2024-04-26T23:44:17.523 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQB1OyxmBaU+MRAADSzfJp0HfnkgWh57F6vmGw==", 2024-04-26T23:44:17.523 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:44:17.523 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:44:17.523 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:44:17.523 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:44:17.523 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:17.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:17.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:44:17.524 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.5", 2024-04-26T23:44:17.524 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQB4OyxmFhNFOhAAIqlQNOvaL8EMnodLeQMhDw==", 2024-04-26T23:44:17.524 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:44:17.524 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:44:17.524 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:44:17.524 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:44:17.524 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:17.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:17.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:44:17.524 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.6", 2024-04-26T23:44:17.524 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQB8Oyxm1y03BxAAZaVKAAMQ8CgZxR9QOSmmxg==", 2024-04-26T23:44:17.524 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:44:17.524 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:44:17.525 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:44:17.525 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:44:17.525 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:17.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:17.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:44:17.525 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.7", 2024-04-26T23:44:17.525 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQB/Oyxmnl5HERAAzW6LvTGUe02XbfzKUdE9Ww==", 2024-04-26T23:44:17.525 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:44:17.525 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T23:44:17.525 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T23:44:17.525 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:44:17.525 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:17.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:17.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:44:17.526 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.0", 2024-04-26T23:44:17.526 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBlOyxmNsaKARAAi0ecpgpB9GUVCXS04Xi03g==", 2024-04-26T23:44:17.526 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:44:17.526 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:44:17.526 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow r", 2024-04-26T23:44:17.526 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-26T23:44:17.526 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:17.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:17.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:44:17.526 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.1", 2024-04-26T23:44:17.526 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBlOyxmZdztChAA5CqZN408iUQConPiWOpzNA==", 2024-04-26T23:44:17.526 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:44:17.526 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:44:17.526 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T23:44:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T23:44:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T23:44:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:44:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.2", 2024-04-26T23:44:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBlOyxmtliOBxAADAAo7qWwq7kTIiAzKhdSEw==", 2024-04-26T23:44:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:44:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:44:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T23:44:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T23:44:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T23:44:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:17.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:44:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.3", 2024-04-26T23:44:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBlOyxmY+nwEBAAwfSl/XoOGWEecTT5NKOaUQ==", 2024-04-26T23:44:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:44:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T23:44:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T23:44:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T23:44:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T23:44:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:44:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.admin", 2024-04-26T23:44:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBkOyxmhPUIChAA9/bw/6JVN8b4Qg3isTXsuw==", 2024-04-26T23:44:17.528 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:44:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T23:44:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T23:44:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T23:44:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:44:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:44:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mgr.x", 2024-04-26T23:44:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBkOyxmXYSgIRAAYsHzI8tb+DSiNPdNJxRDag==", 2024-04-26T23:44:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:44:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T23:44:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile mgr", 2024-04-26T23:44:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:44:17.529 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:17.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:17.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:44:17.530 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mgr.y", 2024-04-26T23:44:17.530 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBkOyxmdEIZHhAAPO3gVpDHmMunKrxtjSmYxw==", 2024-04-26T23:44:17.530 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T23:44:17.530 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T23:44:17.530 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile mgr", 2024-04-26T23:44:17.530 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T23:44:17.530 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:17.530 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:17.530 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-26T23:44:17.530 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:44:17.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.510+0000 7efe28200640 1 -- 172.21.15.137:0/3734461520 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efe000683b0 msgr2=0x7efe0006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:17.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.510+0000 7efe28200640 1 --2- 172.21.15.137:0/3734461520 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efe000683b0 0x7efe0006a870 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efe140af000 tx=0x7efe14008040 comp rx=0 tx=0).stop 2024-04-26T23:44:17.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.510+0000 7efe28200640 1 -- 172.21.15.137:0/3734461520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe2015fcf0 msgr2=0x7efe20071320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:17.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.510+0000 7efe28200640 1 --2- 172.21.15.137:0/3734461520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe2015fcf0 0x7efe20071320 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7efe1800c7b0 tx=0x7efe1800cc70 comp rx=0 tx=0).stop 2024-04-26T23:44:17.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.510+0000 7efe28200640 1 -- 172.21.15.137:0/3734461520 shutdown_connections 2024-04-26T23:44:17.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.510+0000 7efe28200640 1 --2- 172.21.15.137:0/3734461520 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7efe000683b0 0x7efe0006a870 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.510+0000 7efe28200640 1 --2- 172.21.15.137:0/3734461520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe2015fcf0 0x7efe20071320 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.510+0000 7efe28200640 1 --2- 172.21.15.137:0/3734461520 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe2015f3d0 0x7efe200b7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.510+0000 7efe28200640 1 --2- 172.21.15.137:0/3734461520 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe200b4100 0x7efe2014c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.510+0000 7efe28200640 1 -- 172.21.15.137:0/3734461520 >> 172.21.15.137:0/3734461520 conn(0x7efe2009ba60 msgr2=0x7efe200d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:17.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.510+0000 7efe28200640 1 -- 172.21.15.137:0/3734461520 shutdown_connections 2024-04-26T23:44:17.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.510+0000 7efe28200640 1 -- 172.21.15.137:0/3734461520 wait complete. 2024-04-26T23:44:17.539 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:44:17.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.670+0000 7f536b800640 1 Processor -- start 2024-04-26T23:44:17.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.670+0000 7f536b800640 1 -- start start 2024-04-26T23:44:17.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.670+0000 7f536b800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f536406d410 0x7f536406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:17.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.670+0000 7f536b800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f53640742b0 0x7f5364075380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.670+0000 7f536b800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f53641603c0 0x7f53640758c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.670+0000 7f536b800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f53640b7350 con 0x7f53641603c0 2024-04-26T23:44:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.670+0000 7f536b800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f536415f640 con 0x7f53640742b0 2024-04-26T23:44:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.670+0000 7f536b800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f536406dd30 con 0x7f536406d410 2024-04-26T23:44:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.670+0000 7f5369800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f53641603c0 0x7f53640758c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.670+0000 7f5369800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f53641603c0 0x7f53640758c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40824/0 (socket says 172.21.15.137:40824) 2024-04-26T23:44:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.670+0000 7f5369800640 1 -- 172.21.15.137:0/1639351299 learned_addr learned my addr 172.21.15.137:0/1639351299 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.670+0000 7f5363e00640 1 --2- 172.21.15.137:0/1639351299 >> v2:172.21.15.170:3300/0 conn(0x7f53640742b0 0x7f5364075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.670+0000 7f5368e00640 1 --2- 172.21.15.137:0/1639351299 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f536406d410 0x7f536406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:17.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.670+0000 7f5369800640 1 -- 172.21.15.137:0/1639351299 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f536406d410 msgr2=0x7f536406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:17.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.670+0000 7f5369800640 1 --2- 172.21.15.137:0/1639351299 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f536406d410 0x7f536406d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.670+0000 7f5369800640 1 -- 172.21.15.137:0/1639351299 >> v2:172.21.15.170:3300/0 conn(0x7f53640742b0 msgr2=0x7f5364075380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:17.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.670+0000 7f5369800640 1 --2- 172.21.15.137:0/1639351299 >> v2:172.21.15.170:3300/0 conn(0x7f53640742b0 0x7f5364075380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.670+0000 7f5369800640 1 -- 172.21.15.137:0/1639351299 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53640b7070 con 0x7f53641603c0 2024-04-26T23:44:17.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.670+0000 7f5363e00640 1 --2- 172.21.15.137:0/1639351299 >> v2:172.21.15.170:3300/0 conn(0x7f53640742b0 0x7f5364075380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:17.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.674+0000 7f5369800640 1 --2- 172.21.15.137:0/1639351299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53641603c0 0x7f53640758c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f536406e060 tx=0x7f535c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d853cccf6a2435 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:17.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.674+0000 7f5363400640 1 -- 172.21.15.137:0/1639351299 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535c0a57b0 con 0x7f53641603c0 2024-04-26T23:44:17.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.674+0000 7f5363400640 1 -- 172.21.15.137:0/1639351299 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f535c0a5950 con 0x7f53641603c0 2024-04-26T23:44:17.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.674+0000 7f5363400640 1 -- 172.21.15.137:0/1639351299 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535c0a5d20 con 0x7f53641603c0 2024-04-26T23:44:17.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.674+0000 7f536b800640 1 -- 172.21.15.137:0/1639351299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53641603c0 msgr2=0x7f53640758c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:17.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.674+0000 7f536b800640 1 --2- 172.21.15.137:0/1639351299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53641603c0 0x7f53640758c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f536406e060 tx=0x7f535c01c930 comp rx=0 tx=0).stop 2024-04-26T23:44:17.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.674+0000 7f536b800640 1 -- 172.21.15.137:0/1639351299 shutdown_connections 2024-04-26T23:44:17.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.674+0000 7f536b800640 1 --2- 172.21.15.137:0/1639351299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53641603c0 0x7f53640758c0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.674+0000 7f536b800640 1 --2- 172.21.15.137:0/1639351299 >> v2:172.21.15.170:3300/0 conn(0x7f53640742b0 0x7f5364075380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.674+0000 7f536b800640 1 --2- 172.21.15.137:0/1639351299 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f536406d410 0x7f536406d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.674+0000 7f536b800640 1 -- 172.21.15.137:0/1639351299 >> 172.21.15.137:0/1639351299 conn(0x7f5364073210 msgr2=0x7f5364073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:17.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.674+0000 7f536b800640 1 -- 172.21.15.137:0/1639351299 shutdown_connections 2024-04-26T23:44:17.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.674+0000 7f536b800640 1 -- 172.21.15.137:0/1639351299 wait complete. 2024-04-26T23:44:17.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.674+0000 7f536b800640 1 Processor -- start 2024-04-26T23:44:17.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f536b800640 1 -- start start 2024-04-26T23:44:17.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f536b800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f536406d410 0x7f5364155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:17.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f536b800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53640742b0 0x7f536415a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:17.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f536b800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53641603c0 0x7f53641447a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:17.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f536b800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5364075f80 con 0x7f536406d410 2024-04-26T23:44:17.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f536b800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5364075e00 con 0x7f53640742b0 2024-04-26T23:44:17.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f536b800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5364076100 con 0x7f53641603c0 2024-04-26T23:44:17.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f5368e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f536406d410 0x7f5364155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:17.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f5368e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f536406d410 0x7f5364155f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40840/0 (socket says 172.21.15.137:40840) 2024-04-26T23:44:17.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f5368e00640 1 -- 172.21.15.137:0/2700545919 learned_addr learned my addr 172.21.15.137:0/2700545919 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:17.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f5363e00640 1 --2- 172.21.15.137:0/2700545919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53640742b0 0x7f536415a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:17.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f5369800640 1 --2- 172.21.15.137:0/2700545919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53641603c0 0x7f53641447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:17.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f5368e00640 1 -- 172.21.15.137:0/2700545919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53641603c0 msgr2=0x7f53641447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:17.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f5368e00640 1 --2- 172.21.15.137:0/2700545919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53641603c0 0x7f53641447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f5368e00640 1 -- 172.21.15.137:0/2700545919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53640742b0 msgr2=0x7f536415a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:17.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f5368e00640 1 --2- 172.21.15.137:0/2700545919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53640742b0 0x7f536415a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f5368e00640 1 -- 172.21.15.137:0/2700545919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f536415b260 con 0x7f536406d410 2024-04-26T23:44:17.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f5363e00640 1 --2- 172.21.15.137:0/2700545919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53640742b0 0x7f536415a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:17.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f5368e00640 1 --2- 172.21.15.137:0/2700545919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f536406d410 0x7f5364155f60 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f535800e870 tx=0x7f535800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:17.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f5360c00640 1 -- 172.21.15.137:0/2700545919 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5358017070 con 0x7f536406d410 2024-04-26T23:44:17.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f5360c00640 1 -- 172.21.15.137:0/2700545919 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f535800c8e0 con 0x7f536406d410 2024-04-26T23:44:17.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f5360c00640 1 -- 172.21.15.137:0/2700545919 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535800cc90 con 0x7f536406d410 2024-04-26T23:44:17.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f536b800640 1 -- 172.21.15.137:0/2700545919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f536415b540 con 0x7f536406d410 2024-04-26T23:44:17.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f536b800640 1 -- 172.21.15.137:0/2700545919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5364144ce0 con 0x7f536406d410 2024-04-26T23:44:17.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.678+0000 7f536b800640 1 -- 172.21.15.137:0/2700545919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f536406a4b0 con 0x7f536406d410 2024-04-26T23:44:17.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.682+0000 7f5360c00640 1 -- 172.21.15.137:0/2700545919 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f535801a070 con 0x7f536406d410 2024-04-26T23:44:17.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.682+0000 7f5360c00640 1 --2- 172.21.15.137:0/2700545919 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5344068380 0x7f534406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:17.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.682+0000 7f5360c00640 1 -- 172.21.15.137:0/2700545919 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4857+0+0 (secure 0 0 0) 0x7f53580867e0 con 0x7f536406d410 2024-04-26T23:44:17.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.682+0000 7f5363e00640 1 --2- 172.21.15.137:0/2700545919 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5344068380 0x7f534406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:17.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.682+0000 7f5363e00640 1 --2- 172.21.15.137:0/2700545919 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5344068380 0x7f534406a840 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5364165a10 tx=0x7f5350008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:17.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.686+0000 7f5360c00640 1 -- 172.21.15.137:0/2700545919 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5358056a90 con 0x7f536406d410 2024-04-26T23:44:17.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.846+0000 7f536b800640 1 -- 172.21.15.137:0/2700545919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5364073fb0 con 0x7f536406d410 2024-04-26T23:44:17.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.846+0000 7f5360c00640 1 -- 172.21.15.137:0/2700545919 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+12939 (secure 0 0 0) 0x7f535805ad90 con 0x7f536406d410 2024-04-26T23:44:17.855 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:17.855 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":56,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:44:17.124106+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:44:17.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.850+0000 7f536b800640 1 -- 172.21.15.137:0/2700545919 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5344068380 msgr2=0x7f534406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:17.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.850+0000 7f536b800640 1 --2- 172.21.15.137:0/2700545919 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5344068380 0x7f534406a840 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5364165a10 tx=0x7f5350008040 comp rx=0 tx=0).stop 2024-04-26T23:44:17.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.850+0000 7f536b800640 1 -- 172.21.15.137:0/2700545919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f536406d410 msgr2=0x7f5364155f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:17.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.850+0000 7f536b800640 1 --2- 172.21.15.137:0/2700545919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f536406d410 0x7f5364155f60 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f535800e870 tx=0x7f535800ec70 comp rx=0 tx=0).stop 2024-04-26T23:44:17.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.850+0000 7f536b800640 1 -- 172.21.15.137:0/2700545919 shutdown_connections 2024-04-26T23:44:17.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.850+0000 7f536b800640 1 --2- 172.21.15.137:0/2700545919 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5344068380 0x7f534406a840 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.850+0000 7f536b800640 1 --2- 172.21.15.137:0/2700545919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53641603c0 0x7f53641447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.850+0000 7f536b800640 1 --2- 172.21.15.137:0/2700545919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53640742b0 0x7f536415a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.850+0000 7f536b800640 1 --2- 172.21.15.137:0/2700545919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f536406d410 0x7f5364155f60 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:17.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.850+0000 7f536b800640 1 -- 172.21.15.137:0/2700545919 >> 172.21.15.137:0/2700545919 conn(0x7f5364073210 msgr2=0x7f53641582d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:17.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.850+0000 7f536b800640 1 -- 172.21.15.137:0/2700545919 shutdown_connections 2024-04-26T23:44:17.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:17.850+0000 7f536b800640 1 -- 172.21.15.137:0/2700545919 wait complete. 2024-04-26T23:44:17.877 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:44:17.878 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:44:18.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.010+0000 7f527da00640 1 Processor -- start 2024-04-26T23:44:18.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.010+0000 7f527da00640 1 -- start start 2024-04-26T23:44:18.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.010+0000 7f527da00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f52780afbc0 0x7f527815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.010+0000 7f527da00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f52780affa0 0x7f52780ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.010+0000 7f527da00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5278072860 con 0x7f5278073f20 2024-04-26T23:44:18.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.010+0000 7f527da00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f52780743b0 con 0x7f52780afbc0 2024-04-26T23:44:18.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.010+0000 7f527da00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f5278072b00 con 0x7f52780affa0 2024-04-26T23:44:18.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.010+0000 7f5276a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f52780afbc0 0x7f527815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:18.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.010+0000 7f5276a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f52780afbc0 0x7f527815df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40856/0 (socket says 172.21.15.137:40856) 2024-04-26T23:44:18.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.010+0000 7f5276a00640 1 -- 172.21.15.137:0/1915650726 learned_addr learned my addr 172.21.15.137:0/1915650726 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:18.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.010+0000 7f5276a00640 1 -- 172.21.15.137:0/1915650726 >> v2:172.21.15.170:3300/0 conn(0x7f52780affa0 msgr2=0x7f52780ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:18.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.010+0000 7f5276a00640 1 --2- 172.21.15.137:0/1915650726 >> v2:172.21.15.170:3300/0 conn(0x7f52780affa0 0x7f52780ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.010+0000 7f5276a00640 1 -- 172.21.15.137:0/1915650726 >> v1:172.21.15.170:6789/0 conn(0x7f5278073f20 legacy=0x7f52780735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:18.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.010+0000 7f5276a00640 1 -- 172.21.15.137:0/1915650726 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5278072de0 con 0x7f52780afbc0 2024-04-26T23:44:18.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.014+0000 7f5276a00640 1 --2- 172.21.15.137:0/1915650726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52780afbc0 0x7f527815df90 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f5268009870 tx=0x7f526801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7cacbc2e6e67915 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:18.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.014+0000 7f5275600640 1 -- 172.21.15.137:0/1915650726 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52680b0070 con 0x7f52780afbc0 2024-04-26T23:44:18.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.014+0000 7f5275600640 1 -- 172.21.15.137:0/1915650726 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52680ab600 con 0x7f52780afbc0 2024-04-26T23:44:18.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.014+0000 7f5275600640 1 -- 172.21.15.137:0/1915650726 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52680ab9d0 con 0x7f52780afbc0 2024-04-26T23:44:18.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.014+0000 7f527da00640 1 -- 172.21.15.137:0/1915650726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52780afbc0 msgr2=0x7f527815df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:18.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.014+0000 7f527da00640 1 --2- 172.21.15.137:0/1915650726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52780afbc0 0x7f527815df90 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f5268009870 tx=0x7f526801c4e0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.014+0000 7f527da00640 1 -- 172.21.15.137:0/1915650726 shutdown_connections 2024-04-26T23:44:18.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.014+0000 7f527da00640 1 --2- 172.21.15.137:0/1915650726 >> v2:172.21.15.170:3300/0 conn(0x7f52780affa0 0x7f52780ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.014+0000 7f527da00640 1 --2- 172.21.15.137:0/1915650726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52780afbc0 0x7f527815df90 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.014+0000 7f527da00640 1 -- 172.21.15.137:0/1915650726 >> 172.21.15.137:0/1915650726 conn(0x7f527806c800 msgr2=0x7f527806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:18.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.014+0000 7f527da00640 1 -- 172.21.15.137:0/1915650726 shutdown_connections 2024-04-26T23:44:18.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.014+0000 7f527da00640 1 -- 172.21.15.137:0/1915650726 wait complete. 2024-04-26T23:44:18.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.014+0000 7f527da00640 1 Processor -- start 2024-04-26T23:44:18.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f527da00640 1 -- start start 2024-04-26T23:44:18.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f527da00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52780afbc0 0x7f52781f98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f527da00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52780affa0 0x7f527814b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f527da00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f527814d1c0 0x7f527814d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f527da00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f527806f360 con 0x7f52780afbc0 2024-04-26T23:44:18.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f527da00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f527806f1e0 con 0x7f52780affa0 2024-04-26T23:44:18.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f527da00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f527806f4e0 con 0x7f527814d1c0 2024-04-26T23:44:18.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f5276a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52780afbc0 0x7f52781f98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:18.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f5276a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52780afbc0 0x7f52781f98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40860/0 (socket says 172.21.15.137:40860) 2024-04-26T23:44:18.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f5276a00640 1 -- 172.21.15.137:0/3266684852 learned_addr learned my addr 172.21.15.137:0/3266684852 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:18.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f5276000640 1 --2- 172.21.15.137:0/3266684852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52780affa0 0x7f527814b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:18.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f5277400640 1 --2- 172.21.15.137:0/3266684852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f527814d1c0 0x7f527814d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:18.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f5276a00640 1 -- 172.21.15.137:0/3266684852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f527814d1c0 msgr2=0x7f527814d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:18.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f5276a00640 1 --2- 172.21.15.137:0/3266684852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f527814d1c0 0x7f527814d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f5276a00640 1 -- 172.21.15.137:0/3266684852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52780affa0 msgr2=0x7f527814b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:18.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f5276a00640 1 --2- 172.21.15.137:0/3266684852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52780affa0 0x7f527814b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f5276a00640 1 -- 172.21.15.137:0/3266684852 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52780ce720 con 0x7f52780afbc0 2024-04-26T23:44:18.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f5276000640 1 --2- 172.21.15.137:0/3266684852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52780affa0 0x7f527814b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:18.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f5277400640 1 --2- 172.21.15.137:0/3266684852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f527814d1c0 0x7f527814d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:18.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f5276a00640 1 --2- 172.21.15.137:0/3266684852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52780afbc0 0x7f52781f98d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f52680ae040 tx=0x7f526801ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:18.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f526ea00640 1 -- 172.21.15.137:0/3266684852 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52680b0040 con 0x7f52780afbc0 2024-04-26T23:44:18.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f526ea00640 1 -- 172.21.15.137:0/3266684852 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52680bc070 con 0x7f52780afbc0 2024-04-26T23:44:18.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f527da00640 1 -- 172.21.15.137:0/3266684852 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52781f9e10 con 0x7f52780afbc0 2024-04-26T23:44:18.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f526ea00640 1 -- 172.21.15.137:0/3266684852 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52680b6880 con 0x7f52780afbc0 2024-04-26T23:44:18.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f527da00640 1 -- 172.21.15.137:0/3266684852 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52780b1a90 con 0x7f52780afbc0 2024-04-26T23:44:18.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.018+0000 7f527da00640 1 -- 172.21.15.137:0/3266684852 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f527806a410 con 0x7f52780afbc0 2024-04-26T23:44:18.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.022+0000 7f526ea00640 1 -- 172.21.15.137:0/3266684852 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f52680b6a20 con 0x7f52780afbc0 2024-04-26T23:44:18.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.022+0000 7f526ea00640 1 --2- 172.21.15.137:0/3266684852 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5258068380 0x7f525806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.022+0000 7f526ea00640 1 -- 172.21.15.137:0/3266684852 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4857+0+0 (secure 0 0 0) 0x7f5268120a50 con 0x7f52780afbc0 2024-04-26T23:44:18.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.022+0000 7f5276000640 1 --2- 172.21.15.137:0/3266684852 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5258068380 0x7f525806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:18.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.022+0000 7f5276000640 1 --2- 172.21.15.137:0/3266684852 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5258068380 0x7f525806a840 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5278155af0 tx=0x7f5264009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:18.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.026+0000 7f526ea00640 1 -- 172.21.15.137:0/3266684852 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f52680160d0 con 0x7f52780afbc0 2024-04-26T23:44:18.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.182+0000 7f527da00640 1 -- 172.21.15.137:0/3266684852 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5278160870 con 0x7f52780afbc0 2024-04-26T23:44:18.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.182+0000 7f526ea00640 1 -- 172.21.15.137:0/3266684852 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) ==== 93+0+10 (secure 0 0 0) 0x7f52680f1360 con 0x7f52780afbc0 2024-04-26T23:44:18.190 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:44:18.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.182+0000 7f527da00640 1 -- 172.21.15.137:0/3266684852 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5258068380 msgr2=0x7f525806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:18.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.182+0000 7f527da00640 1 --2- 172.21.15.137:0/3266684852 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5258068380 0x7f525806a840 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5278155af0 tx=0x7f5264009040 comp rx=0 tx=0).stop 2024-04-26T23:44:18.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.182+0000 7f527da00640 1 -- 172.21.15.137:0/3266684852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52780afbc0 msgr2=0x7f52781f98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:18.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.182+0000 7f527da00640 1 --2- 172.21.15.137:0/3266684852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52780afbc0 0x7f52781f98d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f52680ae040 tx=0x7f526801ad20 comp rx=0 tx=0).stop 2024-04-26T23:44:18.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.186+0000 7f527da00640 1 -- 172.21.15.137:0/3266684852 shutdown_connections 2024-04-26T23:44:18.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.186+0000 7f527da00640 1 --2- 172.21.15.137:0/3266684852 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5258068380 0x7f525806a840 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.186+0000 7f527da00640 1 --2- 172.21.15.137:0/3266684852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f527814d1c0 0x7f527814d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.186+0000 7f527da00640 1 --2- 172.21.15.137:0/3266684852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52780affa0 0x7f527814b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.186+0000 7f527da00640 1 --2- 172.21.15.137:0/3266684852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52780afbc0 0x7f52781f98d0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.186+0000 7f527da00640 1 -- 172.21.15.137:0/3266684852 >> 172.21.15.137:0/3266684852 conn(0x7f527806c800 msgr2=0x7f5278156040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:18.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.186+0000 7f527da00640 1 -- 172.21.15.137:0/3266684852 shutdown_connections 2024-04-26T23:44:18.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.186+0000 7f527da00640 1 -- 172.21.15.137:0/3266684852 wait complete. 2024-04-26T23:44:18.212 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T23:44:18.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f93a6c00640 1 Processor -- start 2024-04-26T23:44:18.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f93a6c00640 1 -- start start 2024-04-26T23:44:18.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f93a6c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f93a015bb70 0x7f93a00723a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f93a6c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93a006f200 con 0x7f93a00cf6f0 2024-04-26T23:44:18.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f93a6c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93a00cfdb0 con 0x7f93a0074450 2024-04-26T23:44:18.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f93a6c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f93a00cfb50 con 0x7f93a015bb70 2024-04-26T23:44:18.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f93a4e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f93a00cf6f0 0x7f93a0073d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:33308/0 (socket says 172.21.15.137:33308) 2024-04-26T23:44:18.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f93a4e00640 1 -- 172.21.15.137:0/3702831091 learned_addr learned my addr 172.21.15.137:0/3702831091 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:18.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f93a5800640 1 --2- 172.21.15.137:0/3702831091 >> v2:172.21.15.170:3300/0 conn(0x7f93a015bb70 0x7f93a00723a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:18.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f939fe00640 1 -- 172.21.15.137:0/3702831091 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1263034809 0 0) 0x7f93a006f200 con 0x7f93a00cf6f0 2024-04-26T23:44:18.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f939fe00640 1 -- 172.21.15.137:0/3702831091 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9388005740 con 0x7f93a00cf6f0 2024-04-26T23:44:18.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f939fe00640 1 -- 172.21.15.137:0/3702831091 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1480568380 0 0) 0x7f93a00cfdb0 con 0x7f93a0074450 2024-04-26T23:44:18.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f939fe00640 1 -- 172.21.15.137:0/3702831091 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93a006f200 con 0x7f93a0074450 2024-04-26T23:44:18.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f939fe00640 1 -- 172.21.15.137:0/3702831091 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2979997606 0 0) 0x7f9388005740 con 0x7f93a00cf6f0 2024-04-26T23:44:18.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f939fe00640 1 -- 172.21.15.137:0/3702831091 >> v2:172.21.15.170:3300/0 conn(0x7f93a015bb70 msgr2=0x7f93a00723a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:18.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f939fe00640 1 --2- 172.21.15.137:0/3702831091 >> v2:172.21.15.170:3300/0 conn(0x7f93a015bb70 0x7f93a00723a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f939fe00640 1 -- 172.21.15.137:0/3702831091 >> v1:172.21.15.170:6789/0 conn(0x7f93a0074450 legacy=0x7f93a00b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:18.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f939fe00640 1 -- 172.21.15.137:0/3702831091 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a00d0090 con 0x7f93a00cf6f0 2024-04-26T23:44:18.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f939fe00640 1 -- 172.21.15.137:0/3702831091 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f938c0016a0 con 0x7f93a00cf6f0 2024-04-26T23:44:18.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f939fe00640 1 -- 172.21.15.137:0/3702831091 >> v1:172.21.15.137:6789/0 conn(0x7f93a00cf6f0 legacy=0x7f93a0073d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:18.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f939fe00640 1 --2- 172.21.15.137:0/3702831091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9388005d60 0x7f9388006160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f939fe00640 1 --2- 172.21.15.137:0/3702831091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9388006a20 0x7f9388006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f939fe00640 1 --2- 172.21.15.137:0/3702831091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93880073e0 0x7f938800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f939fe00640 1 -- 172.21.15.137:0/3702831091 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f93a00cfb50 con 0x7f9388005d60 2024-04-26T23:44:18.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f939fe00640 1 -- 172.21.15.137:0/3702831091 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f938800e260 con 0x7f9388006a20 2024-04-26T23:44:18.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f939fe00640 1 -- 172.21.15.137:0/3702831091 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f938800e460 con 0x7f93880073e0 2024-04-26T23:44:18.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f93a5800640 1 --2- 172.21.15.137:0/3702831091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9388005d60 0x7f9388006160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:18.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f93a4e00640 1 --2- 172.21.15.137:0/3702831091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9388006a20 0x7f9388006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:18.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f93a6200640 1 --2- 172.21.15.137:0/3702831091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93880073e0 0x7f938800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:18.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f93a5800640 1 -- 172.21.15.137:0/3702831091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93880073e0 msgr2=0x7f938800dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:18.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f93a5800640 1 --2- 172.21.15.137:0/3702831091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93880073e0 0x7f938800dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f93a5800640 1 -- 172.21.15.137:0/3702831091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9388006a20 msgr2=0x7f9388006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:18.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f93a5800640 1 --2- 172.21.15.137:0/3702831091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9388006a20 0x7f9388006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f93a5800640 1 -- 172.21.15.137:0/3702831091 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9388005740 con 0x7f9388005d60 2024-04-26T23:44:18.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f93a4e00640 1 --2- 172.21.15.137:0/3702831091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9388006a20 0x7f9388006ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:18.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.342+0000 7f93a6200640 1 -- 172.21.15.137:0/3702831091 reap_dead start 2024-04-26T23:44:18.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.346+0000 7f93a5800640 1 --2- 172.21.15.137:0/3702831091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9388005d60 0x7f9388006160 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f9394009ae0 tx=0x7f939401ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6187589af3785871 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:18.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.346+0000 7f939fe00640 1 -- 172.21.15.137:0/3702831091 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93940b2070 con 0x7f9388005d60 2024-04-26T23:44:18.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.346+0000 7f939fe00640 1 -- 172.21.15.137:0/3702831091 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93940a5540 con 0x7f9388005d60 2024-04-26T23:44:18.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.346+0000 7f939fe00640 1 -- 172.21.15.137:0/3702831091 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93940096b0 con 0x7f9388005d60 2024-04-26T23:44:18.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.346+0000 7f93a6c00640 1 -- 172.21.15.137:0/3702831091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9388005d60 msgr2=0x7f9388006160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:18.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.346+0000 7f93a6c00640 1 --2- 172.21.15.137:0/3702831091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9388005d60 0x7f9388006160 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f9394009ae0 tx=0x7f939401ca60 comp rx=0 tx=0).stop 2024-04-26T23:44:18.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.346+0000 7f93a6c00640 1 -- 172.21.15.137:0/3702831091 shutdown_connections 2024-04-26T23:44:18.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.346+0000 7f93a6c00640 1 --2- 172.21.15.137:0/3702831091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9388005d60 0x7f9388006160 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.346+0000 7f93a6c00640 1 -- 172.21.15.137:0/3702831091 >> 172.21.15.137:0/3702831091 conn(0x7f93a006e2b0 msgr2=0x7f93a006e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:18.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.346+0000 7f93a6c00640 1 -- 172.21.15.137:0/3702831091 shutdown_connections 2024-04-26T23:44:18.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.346+0000 7f93a6c00640 1 -- 172.21.15.137:0/3702831091 wait complete. 2024-04-26T23:44:18.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f93a6c00640 1 Processor -- start 2024-04-26T23:44:18.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f93a6c00640 1 -- start start 2024-04-26T23:44:18.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f93a6c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9388005d60 0x7f93a01468b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f93a6c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93a00b5e30 0x7f93a015cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f93a6c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93a00af920 0x7f93a00afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f93a6c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f93a015c0d0 con 0x7f93a00b5e30 2024-04-26T23:44:18.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f93a6c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f93a015bf50 con 0x7f93a00af920 2024-04-26T23:44:18.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f93a6c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f93a0160020 con 0x7f9388005d60 2024-04-26T23:44:18.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f93a4e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93a00b5e30 0x7f93a015cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:18.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f93a4e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93a00b5e30 0x7f93a015cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40888/0 (socket says 172.21.15.137:40888) 2024-04-26T23:44:18.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f93a4e00640 1 -- 172.21.15.137:0/3133514177 learned_addr learned my addr 172.21.15.137:0/3133514177 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:18.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f93a5800640 1 --2- 172.21.15.137:0/3133514177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9388005d60 0x7f93a01468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:18.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f93a6200640 1 --2- 172.21.15.137:0/3133514177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93a00af920 0x7f93a00afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:18.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f93a4e00640 1 -- 172.21.15.137:0/3133514177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9388005d60 msgr2=0x7f93a01468b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:18.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f93a4e00640 1 --2- 172.21.15.137:0/3133514177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9388005d60 0x7f93a01468b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f93a4e00640 1 -- 172.21.15.137:0/3133514177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93a00af920 msgr2=0x7f93a00afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:18.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f93a4e00640 1 --2- 172.21.15.137:0/3133514177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93a00af920 0x7f93a00afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f93a4e00640 1 -- 172.21.15.137:0/3133514177 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a015d5b0 con 0x7f93a00b5e30 2024-04-26T23:44:18.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f93a4e00640 1 --2- 172.21.15.137:0/3133514177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93a00b5e30 0x7f93a015cc60 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f938c00e700 tx=0x7f938c00ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:18.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f939d600640 1 -- 172.21.15.137:0/3133514177 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c00c660 con 0x7f93a00b5e30 2024-04-26T23:44:18.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f939d600640 1 -- 172.21.15.137:0/3133514177 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938c018070 con 0x7f93a00b5e30 2024-04-26T23:44:18.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f939d600640 1 -- 172.21.15.137:0/3133514177 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c00ca40 con 0x7f93a00b5e30 2024-04-26T23:44:18.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f93a6c00640 1 -- 172.21.15.137:0/3133514177 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93a015d890 con 0x7f93a00b5e30 2024-04-26T23:44:18.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.350+0000 7f93a6c00640 1 -- 172.21.15.137:0/3133514177 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93a015de50 con 0x7f93a00b5e30 2024-04-26T23:44:18.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.354+0000 7f93a6c00640 1 -- 172.21.15.137:0/3133514177 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93a006a410 con 0x7f93a00b5e30 2024-04-26T23:44:18.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.354+0000 7f939d600640 1 -- 172.21.15.137:0/3133514177 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f938c00cbe0 con 0x7f93a00b5e30 2024-04-26T23:44:18.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.354+0000 7f939d600640 1 --2- 172.21.15.137:0/3133514177 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f93800683b0 0x7f938006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.354+0000 7f939d600640 1 -- 172.21.15.137:0/3133514177 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4857+0+0 (secure 0 0 0) 0x7f938c085ec0 con 0x7f93a00b5e30 2024-04-26T23:44:18.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.354+0000 7f93a5800640 1 --2- 172.21.15.137:0/3133514177 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f93800683b0 0x7f938006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:18.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.354+0000 7f93a5800640 1 --2- 172.21.15.137:0/3133514177 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f93800683b0 0x7f938006a870 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f93940af000 tx=0x7f93940046d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:18.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.358+0000 7f939d600640 1 -- 172.21.15.137:0/3133514177 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f938c0560e0 con 0x7f93a00b5e30 2024-04-26T23:44:18.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.518+0000 7f93a6c00640 1 -- 172.21.15.137:0/3133514177 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f93a00b3c90 con 0x7f93a00b5e30 2024-04-26T23:44:18.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.518+0000 7f939d600640 1 -- 172.21.15.137:0/3133514177 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v56) ==== 84+0+65 (secure 0 0 0) 0x7f938c05a3e0 con 0x7f93a00b5e30 2024-04-26T23:44:18.525 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:18.525 INFO:teuthology.orchestra.run.smithi137.stdout:[ 2024-04-26T23:44:18.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T23:44:18.525 INFO:teuthology.orchestra.run.smithi137.stdout: "poolnum": 1, 2024-04-26T23:44:18.525 INFO:teuthology.orchestra.run.smithi137.stdout: "poolname": ".mgr" 2024-04-26T23:44:18.525 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:18.525 INFO:teuthology.orchestra.run.smithi137.stdout:] 2024-04-26T23:44:18.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.518+0000 7f93a6c00640 1 -- 172.21.15.137:0/3133514177 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f93800683b0 msgr2=0x7f938006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:18.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.518+0000 7f93a6c00640 1 --2- 172.21.15.137:0/3133514177 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f93800683b0 0x7f938006a870 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f93940af000 tx=0x7f93940046d0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.518+0000 7f93a6c00640 1 -- 172.21.15.137:0/3133514177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93a00b5e30 msgr2=0x7f93a015cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:18.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.518+0000 7f93a6c00640 1 --2- 172.21.15.137:0/3133514177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93a00b5e30 0x7f93a015cc60 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f938c00e700 tx=0x7f938c00ebc0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.518+0000 7f93a6c00640 1 -- 172.21.15.137:0/3133514177 shutdown_connections 2024-04-26T23:44:18.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.518+0000 7f93a6c00640 1 --2- 172.21.15.137:0/3133514177 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f93800683b0 0x7f938006a870 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.518+0000 7f93a6c00640 1 --2- 172.21.15.137:0/3133514177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93a00b5e30 0x7f93a015cc60 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.518+0000 7f93a6c00640 1 --2- 172.21.15.137:0/3133514177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93a00af920 0x7f93a00afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.518+0000 7f93a6c00640 1 --2- 172.21.15.137:0/3133514177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9388005d60 0x7f93a01468b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.518+0000 7f93a6c00640 1 -- 172.21.15.137:0/3133514177 >> 172.21.15.137:0/3133514177 conn(0x7f93a006e2b0 msgr2=0x7f93a0155bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:18.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.518+0000 7f93a6c00640 1 -- 172.21.15.137:0/3133514177 shutdown_connections 2024-04-26T23:44:18.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.518+0000 7f93a6c00640 1 -- 172.21.15.137:0/3133514177 wait complete. 2024-04-26T23:44:18.546 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T23:44:18.546 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T23:44:18.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.678+0000 7f7c57400640 1 Processor -- start 2024-04-26T23:44:18.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.678+0000 7f7c57400640 1 -- start start 2024-04-26T23:44:18.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.682+0000 7f7c57400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7c5013f110 0x7f7c50073a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.682+0000 7f7c57400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c5006d240 con 0x7f7c500cfdd0 2024-04-26T23:44:18.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.682+0000 7f7c57400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c500d0410 con 0x7f7c50073f40 2024-04-26T23:44:18.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.682+0000 7f7c57400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7c500d01e0 con 0x7f7c5013f110 2024-04-26T23:44:18.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.682+0000 7f7c54a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7c5013f110 0x7f7c50073a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:18.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.682+0000 7f7c55400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f7c500cfdd0 0x7f7c5013fdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:33320/0 (socket says 172.21.15.137:33320) 2024-04-26T23:44:18.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.682+0000 7f7c55400640 1 -- 172.21.15.137:0/1553842778 learned_addr learned my addr 172.21.15.137:0/1553842778 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:18.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.682+0000 7f7c54a00640 1 -- 172.21.15.137:0/1553842778 >> v1:172.21.15.170:6789/0 conn(0x7f7c50073f40 legacy=0x7f7c500cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:18.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.682+0000 7f7c54a00640 1 -- 172.21.15.137:0/1553842778 >> v1:172.21.15.137:6789/0 conn(0x7f7c500cfdd0 legacy=0x7f7c5013fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:18.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.682+0000 7f7c54a00640 1 -- 172.21.15.137:0/1553842778 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c500d06f0 con 0x7f7c5013f110 2024-04-26T23:44:18.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.682+0000 7f7c4f400640 1 -- 172.21.15.137:0/1553842778 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2520872935 0 0) 0x7f7c5006d240 con 0x7f7c500cfdd0 2024-04-26T23:44:18.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.682+0000 7f7c54a00640 1 --2- 172.21.15.137:0/1553842778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c5013f110 0x7f7c50073a00 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7c40009d90 tx=0x7f7c4001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974504d70b6fd1db server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:18.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.682+0000 7f7c4f400640 1 -- 172.21.15.137:0/1553842778 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c400b2070 con 0x7f7c5013f110 2024-04-26T23:44:18.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.682+0000 7f7c4f400640 1 -- 172.21.15.137:0/1553842778 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c400a5940 con 0x7f7c5013f110 2024-04-26T23:44:18.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.682+0000 7f7c4f400640 1 -- 172.21.15.137:0/1553842778 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c400a5d10 con 0x7f7c5013f110 2024-04-26T23:44:18.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c57400640 1 -- 172.21.15.137:0/1553842778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c5013f110 msgr2=0x7f7c50073a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:18.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c57400640 1 --2- 172.21.15.137:0/1553842778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c5013f110 0x7f7c50073a00 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7c40009d90 tx=0x7f7c4001c970 comp rx=0 tx=0).stop 2024-04-26T23:44:18.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c57400640 1 -- 172.21.15.137:0/1553842778 shutdown_connections 2024-04-26T23:44:18.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c57400640 1 --2- 172.21.15.137:0/1553842778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c5013f110 0x7f7c50073a00 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c57400640 1 -- 172.21.15.137:0/1553842778 >> 172.21.15.137:0/1553842778 conn(0x7f7c5006e2d0 msgr2=0x7f7c5006e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:18.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c57400640 1 -- 172.21.15.137:0/1553842778 shutdown_connections 2024-04-26T23:44:18.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c57400640 1 -- 172.21.15.137:0/1553842778 wait complete. 2024-04-26T23:44:18.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c57400640 1 Processor -- start 2024-04-26T23:44:18.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c57400640 1 -- start start 2024-04-26T23:44:18.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c57400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c50073f40 0x7f7c50157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c57400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c500cfdd0 0x7f7c50139520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c57400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c5013f110 0x7f7c500aab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c57400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7c50141100 con 0x7f7c50073f40 2024-04-26T23:44:18.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c57400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7c50140f80 con 0x7f7c5013f110 2024-04-26T23:44:18.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c57400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7c50074370 con 0x7f7c500cfdd0 2024-04-26T23:44:18.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c54a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c50073f40 0x7f7c50157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:18.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c54a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c50073f40 0x7f7c50157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40906/0 (socket says 172.21.15.137:40906) 2024-04-26T23:44:18.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c54a00640 1 -- 172.21.15.137:0/464719740 learned_addr learned my addr 172.21.15.137:0/464719740 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:18.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c4fe00640 1 --2- 172.21.15.137:0/464719740 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c500cfdd0 0x7f7c50139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:18.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c55400640 1 --2- 172.21.15.137:0/464719740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c5013f110 0x7f7c500aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:18.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c54a00640 1 -- 172.21.15.137:0/464719740 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c500cfdd0 msgr2=0x7f7c50139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:18.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c54a00640 1 --2- 172.21.15.137:0/464719740 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c500cfdd0 0x7f7c50139520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c54a00640 1 -- 172.21.15.137:0/464719740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c5013f110 msgr2=0x7f7c500aab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:18.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c54a00640 1 --2- 172.21.15.137:0/464719740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c5013f110 0x7f7c500aab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c54a00640 1 -- 172.21.15.137:0/464719740 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c501581f0 con 0x7f7c50073f40 2024-04-26T23:44:18.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.686+0000 7f7c4fe00640 1 --2- 172.21.15.137:0/464719740 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c500cfdd0 0x7f7c50139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:18.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.690+0000 7f7c54a00640 1 --2- 172.21.15.137:0/464719740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c50073f40 0x7f7c50157bf0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f7c400b0040 tx=0x7f7c40019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:18.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.690+0000 7f7c4cc00640 1 -- 172.21.15.137:0/464719740 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c400bd020 con 0x7f7c50073f40 2024-04-26T23:44:18.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.690+0000 7f7c4cc00640 1 -- 172.21.15.137:0/464719740 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c400ad6c0 con 0x7f7c50073f40 2024-04-26T23:44:18.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.690+0000 7f7c4cc00640 1 -- 172.21.15.137:0/464719740 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c400b2040 con 0x7f7c50073f40 2024-04-26T23:44:18.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.690+0000 7f7c57400640 1 -- 172.21.15.137:0/464719740 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c501584d0 con 0x7f7c50073f40 2024-04-26T23:44:18.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.690+0000 7f7c57400640 1 -- 172.21.15.137:0/464719740 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c50158a90 con 0x7f7c50073f40 2024-04-26T23:44:18.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.690+0000 7f7c57400640 1 -- 172.21.15.137:0/464719740 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c500765d0 con 0x7f7c50073f40 2024-04-26T23:44:18.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.690+0000 7f7c4cc00640 1 -- 172.21.15.137:0/464719740 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7c400c0020 con 0x7f7c50073f40 2024-04-26T23:44:18.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.690+0000 7f7c4cc00640 1 --2- 172.21.15.137:0/464719740 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c30068380 0x7f7c3006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.690+0000 7f7c4cc00640 1 -- 172.21.15.137:0/464719740 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4857+0+0 (secure 0 0 0) 0x7f7c401216a0 con 0x7f7c50073f40 2024-04-26T23:44:18.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.690+0000 7f7c4fe00640 1 --2- 172.21.15.137:0/464719740 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c30068380 0x7f7c3006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:18.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.694+0000 7f7c4fe00640 1 --2- 172.21.15.137:0/464719740 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c30068380 0x7f7c3006a840 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7c501fb110 tx=0x7f7c3c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:18.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.694+0000 7f7c4cc00640 1 -- 172.21.15.137:0/464719740 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7c400c7030 con 0x7f7c50073f40 2024-04-26T23:44:18.784 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:44:18.788 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:44:18.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:18.862+0000 7f7c57400640 1 -- 172.21.15.137:0/464719740 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f7c50073110 con 0x7f7c50073f40 2024-04-26T23:44:19.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:19.778+0000 7f7c4cc00640 1 -- 172.21.15.137:0/464719740 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v57) ==== 138+0+0 (secure 0 0 0) 0x7f7c40016560 con 0x7f7c50073f40 2024-04-26T23:44:19.786 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' created 2024-04-26T23:44:19.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:19.782+0000 7f7c57400640 1 -- 172.21.15.137:0/464719740 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c30068380 msgr2=0x7f7c3006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:19.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:19.782+0000 7f7c57400640 1 --2- 172.21.15.137:0/464719740 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c30068380 0x7f7c3006a840 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7c501fb110 tx=0x7f7c3c009040 comp rx=0 tx=0).stop 2024-04-26T23:44:19.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:19.782+0000 7f7c57400640 1 -- 172.21.15.137:0/464719740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c50073f40 msgr2=0x7f7c50157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:19.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:19.782+0000 7f7c57400640 1 --2- 172.21.15.137:0/464719740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c50073f40 0x7f7c50157bf0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f7c400b0040 tx=0x7f7c40019710 comp rx=0 tx=0).stop 2024-04-26T23:44:19.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:19.782+0000 7f7c57400640 1 -- 172.21.15.137:0/464719740 shutdown_connections 2024-04-26T23:44:19.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:19.782+0000 7f7c57400640 1 --2- 172.21.15.137:0/464719740 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7c30068380 0x7f7c3006a840 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:19.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:19.782+0000 7f7c57400640 1 --2- 172.21.15.137:0/464719740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c5013f110 0x7f7c500aab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:19.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:19.782+0000 7f7c57400640 1 --2- 172.21.15.137:0/464719740 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c500cfdd0 0x7f7c50139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:19.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:19.782+0000 7f7c57400640 1 --2- 172.21.15.137:0/464719740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c50073f40 0x7f7c50157bf0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:19.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:19.782+0000 7f7c57400640 1 -- 172.21.15.137:0/464719740 >> 172.21.15.137:0/464719740 conn(0x7f7c5006e2d0 msgr2=0x7f7c5013b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:19.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:19.782+0000 7f7c57400640 1 -- 172.21.15.137:0/464719740 shutdown_connections 2024-04-26T23:44:19.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:19.782+0000 7f7c57400640 1 -- 172.21.15.137:0/464719740 wait complete. 2024-04-26T23:44:19.816 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T23:44:20.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:19.998+0000 7fb8c1a00640 1 Processor -- start 2024-04-26T23:44:20.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:19.998+0000 7fb8c1a00640 1 -- start start 2024-04-26T23:44:20.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.002+0000 7fb8c1a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8bc160450 0x7fb8bc0d3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:20.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.002+0000 7fb8c1a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb8bc0b0470 0x7fb8bc0d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:20.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.002+0000 7fb8c1a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8bc0b0cb0 con 0x7fb8bc0d17f0 2024-04-26T23:44:20.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.002+0000 7fb8c1a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb8bc0d1c40 con 0x7fb8bc0b0470 2024-04-26T23:44:20.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.002+0000 7fb8c1a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb8bc0b0f90 con 0x7fb8bc160450 2024-04-26T23:44:20.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.002+0000 7fb8bb400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb8bc0d17f0 0x7fb8bc160c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:33336/0 (socket says 172.21.15.137:33336) 2024-04-26T23:44:20.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.002+0000 7fb8bb400640 1 -- 172.21.15.137:0/3375113062 learned_addr learned my addr 172.21.15.137:0/3375113062 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:20.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.002+0000 7fb8baa00640 1 --2- 172.21.15.137:0/3375113062 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8bc160450 0x7fb8bc0d3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:20.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.002+0000 7fb8ba000640 1 --2- 172.21.15.137:0/3375113062 >> v2:172.21.15.170:3300/0 conn(0x7fb8bc0b0470 0x7fb8bc0d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:20.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.002+0000 7fb8b9600640 1 -- 172.21.15.137:0/3375113062 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2996770257 0 0) 0x7fb8bc0b0cb0 con 0x7fb8bc0d17f0 2024-04-26T23:44:20.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.002+0000 7fb8b9600640 1 -- 172.21.15.137:0/3375113062 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8a0003530 con 0x7fb8bc0d17f0 2024-04-26T23:44:20.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.002+0000 7fb8baa00640 1 -- 172.21.15.137:0/3375113062 >> v2:172.21.15.170:3300/0 conn(0x7fb8bc0b0470 msgr2=0x7fb8bc0d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:20.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.002+0000 7fb8baa00640 1 --2- 172.21.15.137:0/3375113062 >> v2:172.21.15.170:3300/0 conn(0x7fb8bc0b0470 0x7fb8bc0d12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:20.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.002+0000 7fb8baa00640 1 -- 172.21.15.137:0/3375113062 >> v1:172.21.15.137:6789/0 conn(0x7fb8bc0d17f0 legacy=0x7fb8bc160c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:20.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.002+0000 7fb8b9600640 1 -- 172.21.15.137:0/3375113062 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2415484069 0 0) 0x7fb8a0003530 con 0x7fb8bc0d17f0 2024-04-26T23:44:20.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.002+0000 7fb8baa00640 1 -- 172.21.15.137:0/3375113062 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8bc0b1270 con 0x7fb8bc160450 2024-04-26T23:44:20.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.006+0000 7fb8baa00640 1 --2- 172.21.15.137:0/3375113062 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8bc160450 0x7fb8bc0d3360 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009d90 tx=0x7fb8ac01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa4cc5e123776a91 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:20.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.006+0000 7fb8b9600640 1 -- 172.21.15.137:0/3375113062 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac0b2070 con 0x7fb8bc160450 2024-04-26T23:44:20.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.006+0000 7fb8b9600640 1 -- 172.21.15.137:0/3375113062 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8ac0a5840 con 0x7fb8bc160450 2024-04-26T23:44:20.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.006+0000 7fb8b9600640 1 -- 172.21.15.137:0/3375113062 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac0a5bf0 con 0x7fb8bc160450 2024-04-26T23:44:20.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.006+0000 7fb8c1a00640 1 -- 172.21.15.137:0/3375113062 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8bc160450 msgr2=0x7fb8bc0d3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:20.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.006+0000 7fb8c1a00640 1 --2- 172.21.15.137:0/3375113062 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8bc160450 0x7fb8bc0d3360 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009d90 tx=0x7fb8ac01c970 comp rx=0 tx=0).stop 2024-04-26T23:44:20.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.006+0000 7fb8c1a00640 1 -- 172.21.15.137:0/3375113062 shutdown_connections 2024-04-26T23:44:20.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.006+0000 7fb8c1a00640 1 --2- 172.21.15.137:0/3375113062 >> v2:172.21.15.170:3300/0 conn(0x7fb8bc0b0470 0x7fb8bc0d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:20.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.006+0000 7fb8c1a00640 1 --2- 172.21.15.137:0/3375113062 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8bc160450 0x7fb8bc0d3360 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:20.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.006+0000 7fb8c1a00640 1 -- 172.21.15.137:0/3375113062 >> 172.21.15.137:0/3375113062 conn(0x7fb8bc09ba60 msgr2=0x7fb8bc09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:20.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.006+0000 7fb8c1a00640 1 -- 172.21.15.137:0/3375113062 shutdown_connections 2024-04-26T23:44:20.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.006+0000 7fb8c1a00640 1 -- 172.21.15.137:0/3375113062 wait complete. 2024-04-26T23:44:20.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.006+0000 7fb8c1a00640 1 Processor -- start 2024-04-26T23:44:20.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.006+0000 7fb8c1a00640 1 -- start start 2024-04-26T23:44:20.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8c1a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8bc0b0470 0x7fb8bc14c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:20.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8c1a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8bc0d17f0 0x7fb8bc0cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:20.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8c1a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8bc160450 0x7fb8bc0ce540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:20.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8c1a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc1609b0 con 0x7fb8bc0b0470 2024-04-26T23:44:20.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8c1a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc160830 con 0x7fb8bc0d17f0 2024-04-26T23:44:20.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8c1a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb8bc0b0850 con 0x7fb8bc160450 2024-04-26T23:44:20.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8baa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8bc0b0470 0x7fb8bc14c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:20.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8baa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8bc0b0470 0x7fb8bc14c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40914/0 (socket says 172.21.15.137:40914) 2024-04-26T23:44:20.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8baa00640 1 -- 172.21.15.137:0/2364641354 learned_addr learned my addr 172.21.15.137:0/2364641354 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:20.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8bb400640 1 --2- 172.21.15.137:0/2364641354 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8bc160450 0x7fb8bc0ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:20.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8ba000640 1 --2- 172.21.15.137:0/2364641354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8bc0d17f0 0x7fb8bc0cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:20.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8baa00640 1 -- 172.21.15.137:0/2364641354 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8bc160450 msgr2=0x7fb8bc0ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:20.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8baa00640 1 --2- 172.21.15.137:0/2364641354 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8bc160450 0x7fb8bc0ce540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:20.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8baa00640 1 -- 172.21.15.137:0/2364641354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8bc0d17f0 msgr2=0x7fb8bc0cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:20.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8baa00640 1 --2- 172.21.15.137:0/2364641354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8bc0d17f0 0x7fb8bc0cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:20.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8baa00640 1 -- 172.21.15.137:0/2364641354 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8bc15b010 con 0x7fb8bc0b0470 2024-04-26T23:44:20.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8baa00640 1 --2- 172.21.15.137:0/2364641354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8bc0b0470 0x7fb8bc14c280 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac01a5a0 tx=0x7fb8ac019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:20.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8b2a00640 1 -- 172.21.15.137:0/2364641354 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac0be020 con 0x7fb8bc0b0470 2024-04-26T23:44:20.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8b2a00640 1 -- 172.21.15.137:0/2364641354 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8ac0039a0 con 0x7fb8bc0b0470 2024-04-26T23:44:20.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8c1a00640 1 -- 172.21.15.137:0/2364641354 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8bc0cdd20 con 0x7fb8bc0b0470 2024-04-26T23:44:20.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8b2a00640 1 -- 172.21.15.137:0/2364641354 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac0b2040 con 0x7fb8bc0b0470 2024-04-26T23:44:20.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8c1a00640 1 -- 172.21.15.137:0/2364641354 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8bc15b590 con 0x7fb8bc0b0470 2024-04-26T23:44:20.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8c1a00640 1 -- 172.21.15.137:0/2364641354 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8bc06a410 con 0x7fb8bc0b0470 2024-04-26T23:44:20.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.010+0000 7fb8b2a00640 1 -- 172.21.15.137:0/2364641354 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb8ac0c1070 con 0x7fb8bc0b0470 2024-04-26T23:44:20.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.014+0000 7fb8b2a00640 1 --2- 172.21.15.137:0/2364641354 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb898068380 0x7fb89806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:20.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.014+0000 7fb8b2a00640 1 -- 172.21.15.137:0/2364641354 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5227+0+0 (secure 0 0 0) 0x7fb8ac120b20 con 0x7fb8bc0b0470 2024-04-26T23:44:20.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.014+0000 7fb8ba000640 1 --2- 172.21.15.137:0/2364641354 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb898068380 0x7fb89806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:20.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.014+0000 7fb8ba000640 1 --2- 172.21.15.137:0/2364641354 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb898068380 0x7fb89806a840 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc15a170 tx=0x7fb8a4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:20.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.018+0000 7fb8b2a00640 1 -- 172.21.15.137:0/2364641354 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb8ac016560 con 0x7fb8bc0b0470 2024-04-26T23:44:20.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.174+0000 7fb8c1a00640 1 -- 172.21.15.137:0/2364641354 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb8bc15bec0 con 0x7fb8bc0b0470 2024-04-26T23:44:20.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.782+0000 7fb8b2a00640 1 -- 172.21.15.137:0/2364641354 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v58) ==== 170+0+0 (secure 0 0 0) 0x7fb8ac0f0cf0 con 0x7fb8bc0b0470 2024-04-26T23:44:20.790 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' created 2024-04-26T23:44:20.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.786+0000 7fb8c1a00640 1 -- 172.21.15.137:0/2364641354 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb898068380 msgr2=0x7fb89806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:20.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.786+0000 7fb8c1a00640 1 --2- 172.21.15.137:0/2364641354 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb898068380 0x7fb89806a840 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc15a170 tx=0x7fb8a4009190 comp rx=0 tx=0).stop 2024-04-26T23:44:20.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.786+0000 7fb8c1a00640 1 -- 172.21.15.137:0/2364641354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8bc0b0470 msgr2=0x7fb8bc14c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:20.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.786+0000 7fb8c1a00640 1 --2- 172.21.15.137:0/2364641354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8bc0b0470 0x7fb8bc14c280 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac01a5a0 tx=0x7fb8ac019710 comp rx=0 tx=0).stop 2024-04-26T23:44:20.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.786+0000 7fb8c1a00640 1 -- 172.21.15.137:0/2364641354 shutdown_connections 2024-04-26T23:44:20.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.786+0000 7fb8c1a00640 1 --2- 172.21.15.137:0/2364641354 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb898068380 0x7fb89806a840 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:20.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.786+0000 7fb8c1a00640 1 --2- 172.21.15.137:0/2364641354 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8bc160450 0x7fb8bc0ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:20.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.786+0000 7fb8c1a00640 1 --2- 172.21.15.137:0/2364641354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8bc0d17f0 0x7fb8bc0cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:20.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.786+0000 7fb8c1a00640 1 --2- 172.21.15.137:0/2364641354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8bc0b0470 0x7fb8bc14c280 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:20.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.786+0000 7fb8c1a00640 1 -- 172.21.15.137:0/2364641354 >> 172.21.15.137:0/2364641354 conn(0x7fb8bc09ba60 msgr2=0x7fb8bc06cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:20.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.786+0000 7fb8c1a00640 1 -- 172.21.15.137:0/2364641354 shutdown_connections 2024-04-26T23:44:20.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.786+0000 7fb8c1a00640 1 -- 172.21.15.137:0/2364641354 wait complete. 2024-04-26T23:44:20.833 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T23:44:20.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.966+0000 7f97d3600640 1 Processor -- start 2024-04-26T23:44:20.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.966+0000 7f97d3600640 1 -- start start 2024-04-26T23:44:20.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.966+0000 7f97d3600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f97cc0b5ee0 0x7f97cc15f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:20.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.970+0000 7f97d3600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97cc0cffa0 con 0x7f97cc0b54e0 2024-04-26T23:44:20.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.970+0000 7f97d3600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97cc0d0280 con 0x7f97cc15fe30 2024-04-26T23:44:20.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.970+0000 7f97d3600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f97cc0b3d90 con 0x7f97cc0b5ee0 2024-04-26T23:44:20.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.970+0000 7f97d0c00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f97cc0b54e0 0x7f97cc0cd710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32828/0 (socket says 172.21.15.137:32828) 2024-04-26T23:44:20.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.970+0000 7f97d0c00640 1 -- 172.21.15.137:0/2867287789 learned_addr learned my addr 172.21.15.137:0/2867287789 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:20.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.970+0000 7f97c3e00640 1 --2- 172.21.15.137:0/2867287789 >> v2:172.21.15.170:3300/0 conn(0x7f97cc0b5ee0 0x7f97cc15f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:20.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.970+0000 7f97cbe00640 1 -- 172.21.15.137:0/2867287789 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3146612646 0 0) 0x7f97cc0cffa0 con 0x7f97cc0b54e0 2024-04-26T23:44:20.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.970+0000 7f97cbe00640 1 -- 172.21.15.137:0/2867287789 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97b0003530 con 0x7f97cc0b54e0 2024-04-26T23:44:20.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.970+0000 7f97c3e00640 1 -- 172.21.15.137:0/2867287789 >> v1:172.21.15.170:6789/0 conn(0x7f97cc15fe30 legacy=0x7f97cc144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:20.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.970+0000 7f97c3e00640 1 -- 172.21.15.137:0/2867287789 >> v1:172.21.15.137:6789/0 conn(0x7f97cc0b54e0 legacy=0x7f97cc0cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:20.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.970+0000 7f97c3e00640 1 -- 172.21.15.137:0/2867287789 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97cc0d0560 con 0x7f97cc0b5ee0 2024-04-26T23:44:20.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.970+0000 7f97c3e00640 1 --2- 172.21.15.137:0/2867287789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97cc0b5ee0 0x7f97cc15f8f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f97b40097c0 tx=0x7f97b401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55a1cd0f8cb5936a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:20.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.974+0000 7f97cbe00640 1 -- 172.21.15.137:0/2867287789 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b40b0070 con 0x7f97cc0b5ee0 2024-04-26T23:44:20.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.974+0000 7f97cbe00640 1 -- 172.21.15.137:0/2867287789 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b40ab600 con 0x7f97cc0b5ee0 2024-04-26T23:44:20.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.974+0000 7f97cbe00640 1 -- 172.21.15.137:0/2867287789 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b40ab9d0 con 0x7f97cc0b5ee0 2024-04-26T23:44:20.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.974+0000 7f97d3600640 1 -- 172.21.15.137:0/2867287789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97cc0b5ee0 msgr2=0x7f97cc15f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:20.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.974+0000 7f97d3600640 1 --2- 172.21.15.137:0/2867287789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97cc0b5ee0 0x7f97cc15f8f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f97b40097c0 tx=0x7f97b401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:44:20.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.974+0000 7f97d3600640 1 -- 172.21.15.137:0/2867287789 shutdown_connections 2024-04-26T23:44:20.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.974+0000 7f97d3600640 1 --2- 172.21.15.137:0/2867287789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97cc0b5ee0 0x7f97cc15f8f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:20.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.974+0000 7f97d3600640 1 -- 172.21.15.137:0/2867287789 >> 172.21.15.137:0/2867287789 conn(0x7f97cc06c800 msgr2=0x7f97cc06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:20.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.974+0000 7f97d3600640 1 -- 172.21.15.137:0/2867287789 shutdown_connections 2024-04-26T23:44:20.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.974+0000 7f97d3600640 1 -- 172.21.15.137:0/2867287789 wait complete. 2024-04-26T23:44:20.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.974+0000 7f97d3600640 1 Processor -- start 2024-04-26T23:44:20.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.974+0000 7f97d3600640 1 -- start start 2024-04-26T23:44:20.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.974+0000 7f97d3600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97cc0b54e0 0x7f97cc0ad050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:20.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.974+0000 7f97d3600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97cc0b5ee0 0x7f97cc0afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:20.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.974+0000 7f97d3600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97cc15fe30 0x7f97cc0ab060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:20.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.974+0000 7f97d3600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc145840 con 0x7f97cc15fe30 2024-04-26T23:44:20.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.974+0000 7f97d3600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc160240 con 0x7f97cc0b5ee0 2024-04-26T23:44:20.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.974+0000 7f97d3600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f97cc1459c0 con 0x7f97cc0b54e0 2024-04-26T23:44:20.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.978+0000 7f97d1600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97cc15fe30 0x7f97cc0ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:20.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.978+0000 7f97d1600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97cc15fe30 0x7f97cc0ab060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45572/0 (socket says 172.21.15.137:45572) 2024-04-26T23:44:20.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.978+0000 7f97d1600640 1 -- 172.21.15.137:0/117585335 learned_addr learned my addr 172.21.15.137:0/117585335 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:20.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.978+0000 7f97c3e00640 1 --2- 172.21.15.137:0/117585335 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97cc0b5ee0 0x7f97cc0afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:20.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.978+0000 7f97d0c00640 1 --2- 172.21.15.137:0/117585335 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97cc0b54e0 0x7f97cc0ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:20.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.978+0000 7f97c3e00640 1 -- 172.21.15.137:0/117585335 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97cc0b54e0 msgr2=0x7f97cc0ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:20.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.978+0000 7f97c3e00640 1 --2- 172.21.15.137:0/117585335 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97cc0b54e0 0x7f97cc0ad050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:20.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.978+0000 7f97c3e00640 1 -- 172.21.15.137:0/117585335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97cc15fe30 msgr2=0x7f97cc0ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:20.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.978+0000 7f97c3e00640 1 --2- 172.21.15.137:0/117585335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97cc15fe30 0x7f97cc0ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:20.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.978+0000 7f97c3e00640 1 -- 172.21.15.137:0/117585335 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97cc0abd10 con 0x7f97cc0b5ee0 2024-04-26T23:44:20.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.978+0000 7f97d1600640 1 --2- 172.21.15.137:0/117585335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97cc15fe30 0x7f97cc0ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:44:20.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.978+0000 7f97c3e00640 1 --2- 172.21.15.137:0/117585335 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97cc0b5ee0 0x7f97cc0afee0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f97b40ab000 tx=0x7f97b4019240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:20.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.978+0000 7f97c9600640 1 -- 172.21.15.137:0/117585335 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b40b0040 con 0x7f97cc0b5ee0 2024-04-26T23:44:20.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.978+0000 7f97c9600640 1 -- 172.21.15.137:0/117585335 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b40ba070 con 0x7f97cc0b5ee0 2024-04-26T23:44:20.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.978+0000 7f97c9600640 1 -- 172.21.15.137:0/117585335 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b40b4650 con 0x7f97cc0b5ee0 2024-04-26T23:44:20.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.978+0000 7f97d3600640 1 -- 172.21.15.137:0/117585335 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97cc0abfb0 con 0x7f97cc0b5ee0 2024-04-26T23:44:20.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.978+0000 7f97d3600640 1 -- 172.21.15.137:0/117585335 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97cc0ac570 con 0x7f97cc0b5ee0 2024-04-26T23:44:20.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.978+0000 7f97d3600640 1 -- 172.21.15.137:0/117585335 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97cc06a410 con 0x7f97cc0b5ee0 2024-04-26T23:44:20.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.978+0000 7f97c9600640 1 -- 172.21.15.137:0/117585335 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f97b40b47f0 con 0x7f97cc0b5ee0 2024-04-26T23:44:20.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.982+0000 7f97c9600640 1 --2- 172.21.15.137:0/117585335 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f97a8068380 0x7f97a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:20.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.982+0000 7f97c9600640 1 -- 172.21.15.137:0/117585335 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5609+0+0 (secure 0 0 0) 0x7f97b4120f70 con 0x7f97cc0b5ee0 2024-04-26T23:44:20.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.982+0000 7f97d0c00640 1 --2- 172.21.15.137:0/117585335 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f97a8068380 0x7f97a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:20.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.982+0000 7f97d0c00640 1 --2- 172.21.15.137:0/117585335 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f97a8068380 0x7f97a806a840 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f97bc0011f0 tx=0x7f97bc007d40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:20.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:20.986+0000 7f97c9600640 1 -- 172.21.15.137:0/117585335 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f97b4016090 con 0x7f97cc0b5ee0 2024-04-26T23:44:21.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.174+0000 7f97d3600640 1 -- 172.21.15.137:0/117585335 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f97cc069460 con 0x7f97cc0b5ee0 2024-04-26T23:44:21.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.822+0000 7f97c9600640 1 -- 172.21.15.137:0/117585335 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v33) ==== 172+0+0 (secure 0 0 0) 0x7f97b40f0f20 con 0x7f97cc0b5ee0 2024-04-26T23:44:21.833 INFO:teuthology.orchestra.run.smithi137.stderr:new fs with metadata pool 8 and data pool 9 2024-04-26T23:44:21.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.830+0000 7f97d3600640 1 -- 172.21.15.137:0/117585335 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f97a8068380 msgr2=0x7f97a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:21.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.830+0000 7f97d3600640 1 --2- 172.21.15.137:0/117585335 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f97a8068380 0x7f97a806a840 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f97bc0011f0 tx=0x7f97bc007d40 comp rx=0 tx=0).stop 2024-04-26T23:44:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.830+0000 7f97d3600640 1 -- 172.21.15.137:0/117585335 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97cc0b5ee0 msgr2=0x7f97cc0afee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.830+0000 7f97d3600640 1 --2- 172.21.15.137:0/117585335 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97cc0b5ee0 0x7f97cc0afee0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f97b40ab000 tx=0x7f97b4019240 comp rx=0 tx=0).stop 2024-04-26T23:44:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.830+0000 7f97d3600640 1 -- 172.21.15.137:0/117585335 shutdown_connections 2024-04-26T23:44:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.830+0000 7f97d3600640 1 --2- 172.21.15.137:0/117585335 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f97a8068380 0x7f97a806a840 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.830+0000 7f97d3600640 1 --2- 172.21.15.137:0/117585335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97cc15fe30 0x7f97cc0ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.830+0000 7f97d3600640 1 --2- 172.21.15.137:0/117585335 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97cc0b5ee0 0x7f97cc0afee0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:21.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.830+0000 7f97d3600640 1 --2- 172.21.15.137:0/117585335 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97cc0b54e0 0x7f97cc0ad050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:21.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.830+0000 7f97d3600640 1 -- 172.21.15.137:0/117585335 >> 172.21.15.137:0/117585335 conn(0x7f97cc06c800 msgr2=0x7f97cc0cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:21.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.830+0000 7f97d3600640 1 -- 172.21.15.137:0/117585335 shutdown_connections 2024-04-26T23:44:21.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.830+0000 7f97d3600640 1 -- 172.21.15.137:0/117585335 wait complete. 2024-04-26T23:44:21.863 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:44:22.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03f5600640 1 Processor -- start 2024-04-26T23:44:22.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03f5600640 1 -- start start 2024-04-26T23:44:22.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03f5600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03f00ce3e0 0x7f03f0073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:22.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03f5600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03f0073010 con 0x7f03f015de80 2024-04-26T23:44:22.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03f5600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03f00cef90 con 0x7f03f00ce7c0 2024-04-26T23:44:22.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03f5600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f03f0073280 con 0x7f03f00ce3e0 2024-04-26T23:44:22.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03ee000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f03f015de80 0x7f03f00d04e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32838/0 (socket says 172.21.15.137:32838) 2024-04-26T23:44:22.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03ee000640 1 -- 172.21.15.137:0/3660465338 learned_addr learned my addr 172.21.15.137:0/3660465338 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:22.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03eea00640 1 --2- 172.21.15.137:0/3660465338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03f00ce3e0 0x7f03f0073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:22.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03ed600640 1 -- 172.21.15.137:0/3660465338 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4122647894 0 0) 0x7f03f0073010 con 0x7f03f015de80 2024-04-26T23:44:22.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03ed600640 1 -- 172.21.15.137:0/3660465338 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03d4003530 con 0x7f03f015de80 2024-04-26T23:44:22.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03ed600640 1 -- 172.21.15.137:0/3660465338 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3055289741 0 0) 0x7f03d4003530 con 0x7f03f015de80 2024-04-26T23:44:22.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03ed600640 1 -- 172.21.15.137:0/3660465338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03f00ce3e0 msgr2=0x7f03f0073d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:22.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03ed600640 1 --2- 172.21.15.137:0/3660465338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03f00ce3e0 0x7f03f0073d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03ed600640 1 -- 172.21.15.137:0/3660465338 >> v1:172.21.15.170:6789/0 conn(0x7f03f00ce7c0 legacy=0x7f03f0146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:22.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03ed600640 1 -- 172.21.15.137:0/3660465338 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f0073560 con 0x7f03f015de80 2024-04-26T23:44:22.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03ed600640 1 -- 172.21.15.137:0/3660465338 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f03dc001680 con 0x7f03f015de80 2024-04-26T23:44:22.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03ed600640 1 -- 172.21.15.137:0/3660465338 >> v1:172.21.15.137:6789/0 conn(0x7f03f015de80 legacy=0x7f03f00d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:22.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03ed600640 1 --2- 172.21.15.137:0/3660465338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03d40039f0 0x7f03d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:22.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03ed600640 1 --2- 172.21.15.137:0/3660465338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03d40043a0 0x7f03d4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:22.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03ed600640 1 --2- 172.21.15.137:0/3660465338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03f00ce3e0 0x7f03d40050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:22.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03ed600640 1 -- 172.21.15.137:0/3660465338 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f03f0073280 con 0x7f03d40039f0 2024-04-26T23:44:22.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03ed600640 1 -- 172.21.15.137:0/3660465338 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f03d400b9d0 con 0x7f03d40043a0 2024-04-26T23:44:22.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03ed600640 1 -- 172.21.15.137:0/3660465338 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f03d400bbd0 con 0x7f03f00ce3e0 2024-04-26T23:44:22.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03eea00640 1 --2- 172.21.15.137:0/3660465338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03d40039f0 0x7f03d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:22.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03ee000640 1 --2- 172.21.15.137:0/3660465338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03d40043a0 0x7f03d4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:22.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03ef400640 1 --2- 172.21.15.137:0/3660465338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03f00ce3e0 0x7f03d40050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:22.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03eea00640 1 -- 172.21.15.137:0/3660465338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03f00ce3e0 msgr2=0x7f03d40050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:22.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03eea00640 1 --2- 172.21.15.137:0/3660465338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03f00ce3e0 0x7f03d40050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03eea00640 1 -- 172.21.15.137:0/3660465338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03d40043a0 msgr2=0x7f03d4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:22.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03eea00640 1 --2- 172.21.15.137:0/3660465338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03d40043a0 0x7f03d4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.994+0000 7f03eea00640 1 -- 172.21.15.137:0/3660465338 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d4003530 con 0x7f03d40039f0 2024-04-26T23:44:22.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.998+0000 7f03eea00640 1 --2- 172.21.15.137:0/3660465338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03d40039f0 0x7f03d4003dd0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009fc0 tx=0x7f03e001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4c55ae07ec41c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:22.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.998+0000 7f03ed600640 1 -- 172.21.15.137:0/3660465338 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e00b2070 con 0x7f03d40039f0 2024-04-26T23:44:22.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.998+0000 7f03ed600640 1 -- 172.21.15.137:0/3660465338 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03e00a5c90 con 0x7f03d40039f0 2024-04-26T23:44:22.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.998+0000 7f03ed600640 1 -- 172.21.15.137:0/3660465338 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e0009c10 con 0x7f03d40039f0 2024-04-26T23:44:22.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.998+0000 7f03f5600640 1 -- 172.21.15.137:0/3660465338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03d40039f0 msgr2=0x7f03d4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:22.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.998+0000 7f03f5600640 1 --2- 172.21.15.137:0/3660465338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03d40039f0 0x7f03d4003dd0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009fc0 tx=0x7f03e001cc80 comp rx=0 tx=0).stop 2024-04-26T23:44:22.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.998+0000 7f03ef400640 1 -- 172.21.15.137:0/3660465338 reap_dead start 2024-04-26T23:44:22.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.998+0000 7f03f5600640 1 -- 172.21.15.137:0/3660465338 shutdown_connections 2024-04-26T23:44:22.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.998+0000 7f03f5600640 1 -- 172.21.15.137:0/3660465338 >> 172.21.15.137:0/3660465338 conn(0x7f03f006c5d0 msgr2=0x7f03f006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:22.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.998+0000 7f03f5600640 1 -- 172.21.15.137:0/3660465338 shutdown_connections 2024-04-26T23:44:22.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:21.998+0000 7f03f5600640 1 -- 172.21.15.137:0/3660465338 wait complete. 2024-04-26T23:44:22.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03f5600640 1 Processor -- start 2024-04-26T23:44:22.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03f5600640 1 -- start start 2024-04-26T23:44:22.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03f5600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03d40039f0 0x7f03f0143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:22.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03f5600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03f00b0900 0x7f03f013f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:22.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03f5600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f00b1e30 0x7f03f00b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03f5600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f03f0146920 con 0x7f03f00b0900 2024-04-26T23:44:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03f5600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f03f015e320 con 0x7f03f00b1e30 2024-04-26T23:44:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03f5600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f03f0146aa0 con 0x7f03d40039f0 2024-04-26T23:44:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03ee000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03f00b0900 0x7f03f013f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03ee000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03f00b0900 0x7f03f013f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45592/0 (socket says 172.21.15.137:45592) 2024-04-26T23:44:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03ee000640 1 -- 172.21.15.137:0/3571967377 learned_addr learned my addr 172.21.15.137:0/3571967377 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03eea00640 1 --2- 172.21.15.137:0/3571967377 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03d40039f0 0x7f03f0143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03ef400640 1 --2- 172.21.15.137:0/3571967377 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f00b1e30 0x7f03f00b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03ee000640 1 -- 172.21.15.137:0/3571967377 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03d40039f0 msgr2=0x7f03f0143600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03ee000640 1 --2- 172.21.15.137:0/3571967377 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03d40039f0 0x7f03f0143600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03ee000640 1 -- 172.21.15.137:0/3571967377 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f00b1e30 msgr2=0x7f03f00b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03ee000640 1 --2- 172.21.15.137:0/3571967377 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f00b1e30 0x7f03f00b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03ee000640 1 -- 172.21.15.137:0/3571967377 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f00b22e0 con 0x7f03f00b0900 2024-04-26T23:44:22.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03ef400640 1 --2- 172.21.15.137:0/3571967377 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f00b1e30 0x7f03f00b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:22.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03ee000640 1 --2- 172.21.15.137:0/3571967377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03f00b0900 0x7f03f013f320 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f03dc001bb0 tx=0x7f03dc007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:22.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03e6a00640 1 -- 172.21.15.137:0/3571967377 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03dc00f9c0 con 0x7f03f00b0900 2024-04-26T23:44:22.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03e6a00640 1 -- 172.21.15.137:0/3571967377 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03dc018070 con 0x7f03f00b0900 2024-04-26T23:44:22.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03e6a00640 1 -- 172.21.15.137:0/3571967377 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03dc00fde0 con 0x7f03f00b0900 2024-04-26T23:44:22.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03f5600640 1 -- 172.21.15.137:0/3571967377 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03f00b0d90 con 0x7f03f00b0900 2024-04-26T23:44:22.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.002+0000 7f03f5600640 1 -- 172.21.15.137:0/3571967377 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03f00b1350 con 0x7f03f00b0900 2024-04-26T23:44:22.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.006+0000 7f03f5600640 1 -- 172.21.15.137:0/3571967377 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03f0068950 con 0x7f03f00b0900 2024-04-26T23:44:22.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.006+0000 7f03e6a00640 1 -- 172.21.15.137:0/3571967377 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f03dc01d460 con 0x7f03f00b0900 2024-04-26T23:44:22.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.006+0000 7f03e6a00640 1 --2- 172.21.15.137:0/3571967377 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f03d0068380 0x7f03d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:22.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.006+0000 7f03e6a00640 1 -- 172.21.15.137:0/3571967377 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f03dc086a80 con 0x7f03f00b0900 2024-04-26T23:44:22.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.006+0000 7f03eea00640 1 --2- 172.21.15.137:0/3571967377 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f03d0068380 0x7f03d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:22.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.006+0000 7f03eea00640 1 --2- 172.21.15.137:0/3571967377 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f03d0068380 0x7f03d006a840 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f03e00b0040 tx=0x7f03e0004ac0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:22.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.010+0000 7f03e6a00640 1 -- 172.21.15.137:0/3571967377 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f03dc088e20 con 0x7f03f00b0900 2024-04-26T23:44:22.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.166+0000 7f03f5600640 1 -- 172.21.15.137:0/3571967377 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03f0146600 con 0x7f03f00b0900 2024-04-26T23:44:22.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.170+0000 7f03e6a00640 1 -- 172.21.15.137:0/3571967377 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16726 (secure 0 0 0) 0x7f03dc057030 con 0x7f03f00b0900 2024-04-26T23:44:22.177 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:22.177 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":59,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:44:21.180398+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:44:18.876990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T23:44:20.189315+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:44:22.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.170+0000 7f03f5600640 1 -- 172.21.15.137:0/3571967377 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f03d0068380 msgr2=0x7f03d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:22.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.170+0000 7f03f5600640 1 --2- 172.21.15.137:0/3571967377 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f03d0068380 0x7f03d006a840 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f03e00b0040 tx=0x7f03e0004ac0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.170+0000 7f03f5600640 1 -- 172.21.15.137:0/3571967377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03f00b0900 msgr2=0x7f03f013f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:22.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.170+0000 7f03f5600640 1 --2- 172.21.15.137:0/3571967377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03f00b0900 0x7f03f013f320 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f03dc001bb0 tx=0x7f03dc007720 comp rx=0 tx=0).stop 2024-04-26T23:44:22.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.170+0000 7f03f5600640 1 -- 172.21.15.137:0/3571967377 shutdown_connections 2024-04-26T23:44:22.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.170+0000 7f03f5600640 1 --2- 172.21.15.137:0/3571967377 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f03d0068380 0x7f03d006a840 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.170+0000 7f03f5600640 1 --2- 172.21.15.137:0/3571967377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03f00b0900 0x7f03f013f320 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.170+0000 7f03f5600640 1 --2- 172.21.15.137:0/3571967377 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f00b1e30 0x7f03f00b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.170+0000 7f03f5600640 1 --2- 172.21.15.137:0/3571967377 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03d40039f0 0x7f03f0143600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.170+0000 7f03f5600640 1 -- 172.21.15.137:0/3571967377 >> 172.21.15.137:0/3571967377 conn(0x7f03f006c5d0 msgr2=0x7f03f015f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:22.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.170+0000 7f03f5600640 1 -- 172.21.15.137:0/3571967377 shutdown_connections 2024-04-26T23:44:22.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.170+0000 7f03f5600640 1 -- 172.21.15.137:0/3571967377 wait complete. 2024-04-26T23:44:22.198 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:44:22.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.326+0000 7f28c2e00640 1 Processor -- start 2024-04-26T23:44:22.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.326+0000 7f28c2e00640 1 -- start start 2024-04-26T23:44:22.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.326+0000 7f28c2e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28bc15de80 0x7f28bc073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:22.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.326+0000 7f28c2e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f28bc0ce7c0 0x7f28bc146210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:22.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.326+0000 7f28c2e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28bc073010 con 0x7f28bc0ce3e0 2024-04-26T23:44:22.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.326+0000 7f28c2e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f28bc0cef90 con 0x7f28bc0ce7c0 2024-04-26T23:44:22.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.326+0000 7f28c2e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f28bc073280 con 0x7f28bc15de80 2024-04-26T23:44:22.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.326+0000 7f28bbe00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f28bc0ce3e0 0x7f28bc0d04e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32854/0 (socket says 172.21.15.137:32854) 2024-04-26T23:44:22.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.326+0000 7f28bbe00640 1 -- 172.21.15.137:0/57492709 learned_addr learned my addr 172.21.15.137:0/57492709 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:22.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.326+0000 7f28b3400640 1 --2- 172.21.15.137:0/57492709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28bc15de80 0x7f28bc073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:22.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.326+0000 7f28c0e00640 1 --2- 172.21.15.137:0/57492709 >> v2:172.21.15.170:3300/0 conn(0x7f28bc0ce7c0 0x7f28bc146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:22.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.326+0000 7f28bb400640 1 -- 172.21.15.137:0/57492709 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317478844 0 0) 0x7f28bc073010 con 0x7f28bc0ce3e0 2024-04-26T23:44:22.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.326+0000 7f28bb400640 1 -- 172.21.15.137:0/57492709 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28a0003530 con 0x7f28bc0ce3e0 2024-04-26T23:44:22.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.330+0000 7f28b3400640 1 -- 172.21.15.137:0/57492709 >> v2:172.21.15.170:3300/0 conn(0x7f28bc0ce7c0 msgr2=0x7f28bc146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:22.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.330+0000 7f28b3400640 1 --2- 172.21.15.137:0/57492709 >> v2:172.21.15.170:3300/0 conn(0x7f28bc0ce7c0 0x7f28bc146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.330+0000 7f28b3400640 1 -- 172.21.15.137:0/57492709 >> v1:172.21.15.137:6789/0 conn(0x7f28bc0ce3e0 legacy=0x7f28bc0d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:22.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.330+0000 7f28b3400640 1 -- 172.21.15.137:0/57492709 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28bc073560 con 0x7f28bc15de80 2024-04-26T23:44:22.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.330+0000 7f28b3400640 1 --2- 172.21.15.137:0/57492709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28bc15de80 0x7f28bc073d60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f28a40097c0 tx=0x7f28a401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6873c6cd706bb76 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:22.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.330+0000 7f28bb400640 1 -- 172.21.15.137:0/57492709 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a40b2070 con 0x7f28bc15de80 2024-04-26T23:44:22.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.330+0000 7f28bb400640 1 -- 172.21.15.137:0/57492709 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28a40ad680 con 0x7f28bc15de80 2024-04-26T23:44:22.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.330+0000 7f28bb400640 1 -- 172.21.15.137:0/57492709 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a40ada30 con 0x7f28bc15de80 2024-04-26T23:44:22.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.330+0000 7f28c2e00640 1 -- 172.21.15.137:0/57492709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28bc15de80 msgr2=0x7f28bc073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:22.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.330+0000 7f28c2e00640 1 --2- 172.21.15.137:0/57492709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28bc15de80 0x7f28bc073d60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f28a40097c0 tx=0x7f28a401c470 comp rx=0 tx=0).stop 2024-04-26T23:44:22.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28c2e00640 1 -- 172.21.15.137:0/57492709 shutdown_connections 2024-04-26T23:44:22.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28c2e00640 1 --2- 172.21.15.137:0/57492709 >> v2:172.21.15.170:3300/0 conn(0x7f28bc0ce7c0 0x7f28bc146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28c2e00640 1 --2- 172.21.15.137:0/57492709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28bc15de80 0x7f28bc073d60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28c2e00640 1 -- 172.21.15.137:0/57492709 >> 172.21.15.137:0/57492709 conn(0x7f28bc06c5d0 msgr2=0x7f28bc06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:22.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28c2e00640 1 -- 172.21.15.137:0/57492709 shutdown_connections 2024-04-26T23:44:22.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28c2e00640 1 -- 172.21.15.137:0/57492709 wait complete. 2024-04-26T23:44:22.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28c2e00640 1 Processor -- start 2024-04-26T23:44:22.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28c2e00640 1 -- start start 2024-04-26T23:44:22.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28c2e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28bc0ce3e0 0x7f28bc145960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:22.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28c2e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28bc0ce7c0 0x7f28bc157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:22.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28c2e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28bc15de80 0x7f28bc13de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:22.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28c2e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc06f0e0 con 0x7f28bc0ce7c0 2024-04-26T23:44:22.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28c2e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc06ef60 con 0x7f28bc15de80 2024-04-26T23:44:22.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28c2e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f28bc06f260 con 0x7f28bc0ce3e0 2024-04-26T23:44:22.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28b3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28bc0ce7c0 0x7f28bc157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:22.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28b3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28bc0ce7c0 0x7f28bc157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45594/0 (socket says 172.21.15.137:45594) 2024-04-26T23:44:22.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28b3400640 1 -- 172.21.15.137:0/851691251 learned_addr learned my addr 172.21.15.137:0/851691251 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:22.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28bbe00640 1 --2- 172.21.15.137:0/851691251 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28bc0ce3e0 0x7f28bc145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:22.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28c0e00640 1 --2- 172.21.15.137:0/851691251 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28bc15de80 0x7f28bc13de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:22.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28b3400640 1 -- 172.21.15.137:0/851691251 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28bc0ce3e0 msgr2=0x7f28bc145960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:22.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28b3400640 1 --2- 172.21.15.137:0/851691251 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28bc0ce3e0 0x7f28bc145960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28b3400640 1 -- 172.21.15.137:0/851691251 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28bc15de80 msgr2=0x7f28bc13de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:22.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28b3400640 1 --2- 172.21.15.137:0/851691251 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28bc15de80 0x7f28bc13de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28b3400640 1 -- 172.21.15.137:0/851691251 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28bc152100 con 0x7f28bc0ce7c0 2024-04-26T23:44:22.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28bbe00640 1 --2- 172.21.15.137:0/851691251 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28bc0ce3e0 0x7f28bc145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:22.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28b3400640 1 --2- 172.21.15.137:0/851691251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28bc0ce7c0 0x7f28bc157370 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f28a4000c10 tx=0x7f28a4019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:22.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28b8c00640 1 -- 172.21.15.137:0/851691251 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a40b2040 con 0x7f28bc0ce7c0 2024-04-26T23:44:22.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28b8c00640 1 -- 172.21.15.137:0/851691251 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28a4004240 con 0x7f28bc0ce7c0 2024-04-26T23:44:22.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.334+0000 7f28c2e00640 1 -- 172.21.15.137:0/851691251 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28bc1f65a0 con 0x7f28bc0ce7c0 2024-04-26T23:44:22.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.338+0000 7f28b8c00640 1 -- 172.21.15.137:0/851691251 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a40ad830 con 0x7f28bc0ce7c0 2024-04-26T23:44:22.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.338+0000 7f28c2e00640 1 -- 172.21.15.137:0/851691251 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28bc152680 con 0x7f28bc0ce7c0 2024-04-26T23:44:22.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.338+0000 7f28c2e00640 1 -- 172.21.15.137:0/851691251 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28bc06a4b0 con 0x7f28bc0ce7c0 2024-04-26T23:44:22.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.338+0000 7f28b8c00640 1 -- 172.21.15.137:0/851691251 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f28a40bd060 con 0x7f28bc0ce7c0 2024-04-26T23:44:22.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.338+0000 7f28b8c00640 1 --2- 172.21.15.137:0/851691251 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f28980683b0 0x7f289806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:22.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.338+0000 7f28b8c00640 1 -- 172.21.15.137:0/851691251 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f28a411f8c0 con 0x7f28bc0ce7c0 2024-04-26T23:44:22.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.338+0000 7f28bbe00640 1 --2- 172.21.15.137:0/851691251 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f28980683b0 0x7f289806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:22.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.338+0000 7f28bbe00640 1 --2- 172.21.15.137:0/851691251 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f28980683b0 0x7f289806a870 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f28ac005c10 tx=0x7f28ac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:22.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.342+0000 7f28b8c00640 1 -- 172.21.15.137:0/851691251 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f28a4016090 con 0x7f28bc0ce7c0 2024-04-26T23:44:22.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.502+0000 7f28c2e00640 1 -- 172.21.15.137:0/851691251 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28bc0b3620 con 0x7f28bc0ce7c0 2024-04-26T23:44:22.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.502+0000 7f28b8c00640 1 -- 172.21.15.137:0/851691251 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16726 (secure 0 0 0) 0x7f28a40efde0 con 0x7f28bc0ce7c0 2024-04-26T23:44:22.510 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:22.510 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":59,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:44:21.180398+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:44:18.876990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T23:44:20.189315+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:44:22.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.506+0000 7f28c2e00640 1 -- 172.21.15.137:0/851691251 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f28980683b0 msgr2=0x7f289806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:22.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.506+0000 7f28c2e00640 1 --2- 172.21.15.137:0/851691251 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f28980683b0 0x7f289806a870 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f28ac005c10 tx=0x7f28ac009040 comp rx=0 tx=0).stop 2024-04-26T23:44:22.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.506+0000 7f28c2e00640 1 -- 172.21.15.137:0/851691251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28bc0ce7c0 msgr2=0x7f28bc157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:22.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.506+0000 7f28c2e00640 1 --2- 172.21.15.137:0/851691251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28bc0ce7c0 0x7f28bc157370 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f28a4000c10 tx=0x7f28a4019210 comp rx=0 tx=0).stop 2024-04-26T23:44:22.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.506+0000 7f28c2e00640 1 -- 172.21.15.137:0/851691251 shutdown_connections 2024-04-26T23:44:22.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.506+0000 7f28c2e00640 1 --2- 172.21.15.137:0/851691251 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f28980683b0 0x7f289806a870 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.506+0000 7f28c2e00640 1 --2- 172.21.15.137:0/851691251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28bc0ce7c0 0x7f28bc157370 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.506+0000 7f28c2e00640 1 --2- 172.21.15.137:0/851691251 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28bc15de80 0x7f28bc13de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.506+0000 7f28c2e00640 1 --2- 172.21.15.137:0/851691251 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28bc0ce3e0 0x7f28bc145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.506+0000 7f28c2e00640 1 -- 172.21.15.137:0/851691251 >> 172.21.15.137:0/851691251 conn(0x7f28bc06c5d0 msgr2=0x7f28bc0b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:22.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.506+0000 7f28c2e00640 1 -- 172.21.15.137:0/851691251 shutdown_connections 2024-04-26T23:44:22.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.506+0000 7f28c2e00640 1 -- 172.21.15.137:0/851691251 wait complete. 2024-04-26T23:44:22.531 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T23:44:22.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.662+0000 7feef5a00640 1 Processor -- start 2024-04-26T23:44:22.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.662+0000 7feef5a00640 1 -- start start 2024-04-26T23:44:22.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.662+0000 7feef5a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7feef00b54e0 0x7feef00b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:22.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.662+0000 7feef5a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7feef00cd710 0x7feef015f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:22.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.662+0000 7feef5a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feef00cffa0 con 0x7feef015fe30 2024-04-26T23:44:22.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.662+0000 7feef5a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7feef00b3d90 con 0x7feef00b54e0 2024-04-26T23:44:22.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.662+0000 7feef5a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7feef00d0840 con 0x7feef00cd710 2024-04-26T23:44:22.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.662+0000 7feeeea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7feef00b54e0 0x7feef00b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:22.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.662+0000 7feeeea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7feef00b54e0 0x7feef00b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45602/0 (socket says 172.21.15.137:45602) 2024-04-26T23:44:22.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.662+0000 7feeeea00640 1 -- 172.21.15.137:0/1396040566 learned_addr learned my addr 172.21.15.137:0/1396040566 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:22.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.662+0000 7feeef400640 1 --1- 172.21.15.137:0/1396040566 >> v1:172.21.15.137:6789/0 conn(0x7feef015fe30 0x7feef0144d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32866/0 (socket says 172.21.15.137:32866) 2024-04-26T23:44:22.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.666+0000 7feee6000640 1 --2- 172.21.15.137:0/1396040566 >> v2:172.21.15.170:3300/0 conn(0x7feef00cd710 0x7feef015f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:22.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.666+0000 7feeeea00640 1 -- 172.21.15.137:0/1396040566 >> v2:172.21.15.170:3300/0 conn(0x7feef00cd710 msgr2=0x7feef015f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:22.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.666+0000 7feeeea00640 1 --2- 172.21.15.137:0/1396040566 >> v2:172.21.15.170:3300/0 conn(0x7feef00cd710 0x7feef015f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.666+0000 7feeeea00640 1 -- 172.21.15.137:0/1396040566 >> v1:172.21.15.137:6789/0 conn(0x7feef015fe30 legacy=0x7feef0144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:22.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.666+0000 7feeeea00640 1 -- 172.21.15.137:0/1396040566 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef00d0280 con 0x7feef00b54e0 2024-04-26T23:44:22.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.666+0000 7feeeea00640 1 --2- 172.21.15.137:0/1396040566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feef00b54e0 0x7feef00b5ee0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7feef0070130 tx=0x7feee001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e40ab0a3639ec59 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:22.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.666+0000 7feeee000640 1 -- 172.21.15.137:0/1396040566 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee00a57d0 con 0x7feef00b54e0 2024-04-26T23:44:22.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.666+0000 7feeee000640 1 -- 172.21.15.137:0/1396040566 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feee00a5970 con 0x7feef00b54e0 2024-04-26T23:44:22.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.666+0000 7feeee000640 1 -- 172.21.15.137:0/1396040566 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee00a5d40 con 0x7feef00b54e0 2024-04-26T23:44:22.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.666+0000 7feef5a00640 1 -- 172.21.15.137:0/1396040566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feef00b54e0 msgr2=0x7feef00b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:22.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feef5a00640 1 --2- 172.21.15.137:0/1396040566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feef00b54e0 0x7feef00b5ee0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7feef0070130 tx=0x7feee001c9f0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feef5a00640 1 -- 172.21.15.137:0/1396040566 shutdown_connections 2024-04-26T23:44:22.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feef5a00640 1 --2- 172.21.15.137:0/1396040566 >> v2:172.21.15.170:3300/0 conn(0x7feef00cd710 0x7feef015f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feef5a00640 1 --2- 172.21.15.137:0/1396040566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feef00b54e0 0x7feef00b5ee0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feef5a00640 1 -- 172.21.15.137:0/1396040566 >> 172.21.15.137:0/1396040566 conn(0x7feef006c800 msgr2=0x7feef006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:22.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feef5a00640 1 -- 172.21.15.137:0/1396040566 shutdown_connections 2024-04-26T23:44:22.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feef5a00640 1 -- 172.21.15.137:0/1396040566 wait complete. 2024-04-26T23:44:22.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feef5a00640 1 Processor -- start 2024-04-26T23:44:22.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feef5a00640 1 -- start start 2024-04-26T23:44:22.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feef5a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feef00b54e0 0x7feef006f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:22.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feef5a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feef00cd710 0x7feef0161b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:22.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feef5a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feef015fe30 0x7feef0140b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:22.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feef5a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feef00cdb20 con 0x7feef015fe30 2024-04-26T23:44:22.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feef5a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7feef0145840 con 0x7feef00b54e0 2024-04-26T23:44:22.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feef5a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7feef0162080 con 0x7feef00cd710 2024-04-26T23:44:22.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feeef400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feef015fe30 0x7feef0140b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:22.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feeef400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feef015fe30 0x7feef0140b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45612/0 (socket says 172.21.15.137:45612) 2024-04-26T23:44:22.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feeef400640 1 -- 172.21.15.137:0/2868365383 learned_addr learned my addr 172.21.15.137:0/2868365383 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:22.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feeeea00640 1 --2- 172.21.15.137:0/2868365383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feef00b54e0 0x7feef006f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:22.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feee6000640 1 --2- 172.21.15.137:0/2868365383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feef00cd710 0x7feef0161b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:22.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feeef400640 1 -- 172.21.15.137:0/2868365383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feef00cd710 msgr2=0x7feef0161b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:22.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feeef400640 1 --2- 172.21.15.137:0/2868365383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feef00cd710 0x7feef0161b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feeef400640 1 -- 172.21.15.137:0/2868365383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feef00b54e0 msgr2=0x7feef006f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:22.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feeef400640 1 --2- 172.21.15.137:0/2868365383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feef00b54e0 0x7feef006f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:22.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feeef400640 1 -- 172.21.15.137:0/2868365383 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef0141ae0 con 0x7feef015fe30 2024-04-26T23:44:22.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feee6000640 1 --2- 172.21.15.137:0/2868365383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feef00cd710 0x7feef0161b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:22.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.670+0000 7feeef400640 1 --2- 172.21.15.137:0/2868365383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feef015fe30 0x7feef0140b00 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7feee800c3c0 tx=0x7feee800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:22.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.674+0000 7feee7400640 1 -- 172.21.15.137:0/2868365383 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee80074e0 con 0x7feef015fe30 2024-04-26T23:44:22.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.674+0000 7feee7400640 1 -- 172.21.15.137:0/2868365383 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feee8007680 con 0x7feef015fe30 2024-04-26T23:44:22.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.674+0000 7feef5a00640 1 -- 172.21.15.137:0/2868365383 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feef0141040 con 0x7feef015fe30 2024-04-26T23:44:22.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.674+0000 7feee7400640 1 -- 172.21.15.137:0/2868365383 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee8004a10 con 0x7feef015fe30 2024-04-26T23:44:22.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.674+0000 7feef5a00640 1 -- 172.21.15.137:0/2868365383 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feef0160d80 con 0x7feef015fe30 2024-04-26T23:44:22.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.674+0000 7feef5a00640 1 -- 172.21.15.137:0/2868365383 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feef006a410 con 0x7feef015fe30 2024-04-26T23:44:22.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.674+0000 7feee7400640 1 -- 172.21.15.137:0/2868365383 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feee801a020 con 0x7feef015fe30 2024-04-26T23:44:22.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.674+0000 7feee7400640 1 --2- 172.21.15.137:0/2868365383 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7feecc068380 0x7feecc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:22.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.674+0000 7feee7400640 1 -- 172.21.15.137:0/2868365383 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7feee8085fe0 con 0x7feef015fe30 2024-04-26T23:44:22.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.674+0000 7feeeea00640 1 --2- 172.21.15.137:0/2868365383 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7feecc068380 0x7feecc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:22.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.674+0000 7feeeea00640 1 --2- 172.21.15.137:0/2868365383 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7feecc068380 0x7feecc06a840 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7feee00ae000 tx=0x7feee00a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:22.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.678+0000 7feee7400640 1 -- 172.21.15.137:0/2868365383 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7feee8056630 con 0x7feef015fe30 2024-04-26T23:44:22.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:22.878+0000 7feef5a00640 1 -- 172.21.15.137:0/2868365383 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7feef015da70 con 0x7feef015fe30 2024-04-26T23:44:23.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.822+0000 7feee7400640 1 -- 172.21.15.137:0/2868365383 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v36) ==== 118+0+0 (secure 0 0 0) 0x7feee8055f30 con 0x7feef015fe30 2024-04-26T23:44:23.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.822+0000 7feef5a00640 1 -- 172.21.15.137:0/2868365383 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7feecc068380 msgr2=0x7feecc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:23.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.822+0000 7feef5a00640 1 --2- 172.21.15.137:0/2868365383 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7feecc068380 0x7feecc06a840 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7feee00ae000 tx=0x7feee00a7070 comp rx=0 tx=0).stop 2024-04-26T23:44:23.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.822+0000 7feef5a00640 1 -- 172.21.15.137:0/2868365383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feef015fe30 msgr2=0x7feef0140b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:23.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.822+0000 7feef5a00640 1 --2- 172.21.15.137:0/2868365383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feef015fe30 0x7feef0140b00 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7feee800c3c0 tx=0x7feee800c880 comp rx=0 tx=0).stop 2024-04-26T23:44:23.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.822+0000 7feef5a00640 1 -- 172.21.15.137:0/2868365383 shutdown_connections 2024-04-26T23:44:23.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.822+0000 7feef5a00640 1 --2- 172.21.15.137:0/2868365383 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7feecc068380 0x7feecc06a840 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:23.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.822+0000 7feef5a00640 1 --2- 172.21.15.137:0/2868365383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feef015fe30 0x7feef0140b00 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:23.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.822+0000 7feef5a00640 1 --2- 172.21.15.137:0/2868365383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feef00cd710 0x7feef0161b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:23.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.822+0000 7feef5a00640 1 --2- 172.21.15.137:0/2868365383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feef00b54e0 0x7feef006f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:23.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.822+0000 7feef5a00640 1 -- 172.21.15.137:0/2868365383 >> 172.21.15.137:0/2868365383 conn(0x7feef006c800 msgr2=0x7feef0144640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:23.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.822+0000 7feef5a00640 1 -- 172.21.15.137:0/2868365383 shutdown_connections 2024-04-26T23:44:23.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.822+0000 7feef5a00640 1 -- 172.21.15.137:0/2868365383 wait complete. 2024-04-26T23:44:23.854 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T23:44:23.855 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T23:44:23.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.990+0000 7f753fa00640 1 Processor -- start 2024-04-26T23:44:23.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.990+0000 7f753fa00640 1 -- start start 2024-04-26T23:44:23.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.990+0000 7f753fa00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f753815f130 0x7f75380b4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:23.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.990+0000 7f753fa00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7538163240 con 0x7f7538162d80 2024-04-26T23:44:23.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.990+0000 7f753fa00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7538163520 con 0x7f753806d0d0 2024-04-26T23:44:23.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.990+0000 7f753fa00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7538163800 con 0x7f753815f130 2024-04-26T23:44:23.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.990+0000 7f753d000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f753815f130 0x7f75380b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:23.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.990+0000 7f753d000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f753815f130 0x7f75380b4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45616/0 (socket says 172.21.15.137:45616) 2024-04-26T23:44:23.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.990+0000 7f753d000640 1 -- 172.21.15.137:0/3376317571 learned_addr learned my addr 172.21.15.137:0/3376317571 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:23.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.990+0000 7f7537e00640 1 --1- 172.21.15.137:0/3376317571 >> v1:172.21.15.137:6789/0 conn(0x7f7538162d80 0x7f753806c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32870/0 (socket says 172.21.15.137:32870) 2024-04-26T23:44:24.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.990+0000 7f753d000640 1 -- 172.21.15.137:0/3376317571 >> v1:172.21.15.170:6789/0 conn(0x7f753806d0d0 legacy=0x7f75380d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:24.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.990+0000 7f753d000640 1 -- 172.21.15.137:0/3376317571 >> v1:172.21.15.137:6789/0 conn(0x7f7538162d80 legacy=0x7f753806c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:24.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.990+0000 7f753d000640 1 -- 172.21.15.137:0/3376317571 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7538163ae0 con 0x7f753815f130 2024-04-26T23:44:24.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.994+0000 7f753d000640 1 --2- 172.21.15.137:0/3376317571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f753815f130 0x7f75380b4370 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f7528009e50 tx=0x7f752801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c90c73977d5ef8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:24.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.994+0000 7f7537400640 1 -- 172.21.15.137:0/3376317571 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75280a57f0 con 0x7f753815f130 2024-04-26T23:44:24.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.994+0000 7f7537400640 1 -- 172.21.15.137:0/3376317571 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75280a5990 con 0x7f753815f130 2024-04-26T23:44:24.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.994+0000 7f7537400640 1 -- 172.21.15.137:0/3376317571 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75280a5d60 con 0x7f753815f130 2024-04-26T23:44:24.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.994+0000 7f753fa00640 1 -- 172.21.15.137:0/3376317571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f753815f130 msgr2=0x7f75380b4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:24.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.994+0000 7f753fa00640 1 --2- 172.21.15.137:0/3376317571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f753815f130 0x7f75380b4370 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f7528009e50 tx=0x7f752801c9b0 comp rx=0 tx=0).stop 2024-04-26T23:44:24.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.994+0000 7f753fa00640 1 -- 172.21.15.137:0/3376317571 shutdown_connections 2024-04-26T23:44:24.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.994+0000 7f753fa00640 1 --2- 172.21.15.137:0/3376317571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f753815f130 0x7f75380b4370 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:24.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.994+0000 7f753fa00640 1 -- 172.21.15.137:0/3376317571 >> 172.21.15.137:0/3376317571 conn(0x7f753809ba60 msgr2=0x7f753809be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:24.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.994+0000 7f753fa00640 1 -- 172.21.15.137:0/3376317571 shutdown_connections 2024-04-26T23:44:24.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.994+0000 7f753fa00640 1 -- 172.21.15.137:0/3376317571 wait complete. 2024-04-26T23:44:24.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f753fa00640 1 Processor -- start 2024-04-26T23:44:24.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f753fa00640 1 -- start start 2024-04-26T23:44:24.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f753fa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f753806d0d0 0x7f75380c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:24.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f753fa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f753815f130 0x7f75380b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:24.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f753fa00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7538162d80 0x7f7538155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:24.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f753fa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f75380b2960 con 0x7f753806d0d0 2024-04-26T23:44:24.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f753fa00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f75380b27e0 con 0x7f753815f130 2024-04-26T23:44:24.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f753fa00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f753816d0d0 con 0x7f7538162d80 2024-04-26T23:44:24.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f753d000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f753806d0d0 0x7f75380c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:24.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f753d000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f753806d0d0 0x7f75380c9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45630/0 (socket says 172.21.15.137:45630) 2024-04-26T23:44:24.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f753d000640 1 -- 172.21.15.137:0/3199176114 learned_addr learned my addr 172.21.15.137:0/3199176114 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:24.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f7537e00640 1 --2- 172.21.15.137:0/3199176114 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f753815f130 0x7f75380b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:24.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f753da00640 1 --2- 172.21.15.137:0/3199176114 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7538162d80 0x7f7538155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:24.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f753d000640 1 -- 172.21.15.137:0/3199176114 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7538162d80 msgr2=0x7f7538155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:24.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f753d000640 1 --2- 172.21.15.137:0/3199176114 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7538162d80 0x7f7538155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:24.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f753d000640 1 -- 172.21.15.137:0/3199176114 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f753815f130 msgr2=0x7f75380b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:24.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f753d000640 1 --2- 172.21.15.137:0/3199176114 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f753815f130 0x7f75380b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:24.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f753d000640 1 -- 172.21.15.137:0/3199176114 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75380c9260 con 0x7f753806d0d0 2024-04-26T23:44:24.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f7537e00640 1 --2- 172.21.15.137:0/3199176114 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f753815f130 0x7f75380b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:24.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f753da00640 1 --2- 172.21.15.137:0/3199176114 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7538162d80 0x7f7538155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:24.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f753d000640 1 --2- 172.21.15.137:0/3199176114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f753806d0d0 0x7f75380c9f50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f752801a5e0 tx=0x7f7528019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:24.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f7534c00640 1 -- 172.21.15.137:0/3199176114 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75280bc020 con 0x7f753806d0d0 2024-04-26T23:44:24.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f7534c00640 1 -- 172.21.15.137:0/3199176114 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75280b8880 con 0x7f753806d0d0 2024-04-26T23:44:24.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f7534c00640 1 -- 172.21.15.137:0/3199176114 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75280b8c70 con 0x7f753806d0d0 2024-04-26T23:44:24.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f753fa00640 1 -- 172.21.15.137:0/3199176114 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75380b88c0 con 0x7f753806d0d0 2024-04-26T23:44:24.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:23.998+0000 7f753fa00640 1 -- 172.21.15.137:0/3199176114 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75380c97e0 con 0x7f753806d0d0 2024-04-26T23:44:24.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.002+0000 7f753fa00640 1 -- 172.21.15.137:0/3199176114 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f753806a410 con 0x7f753806d0d0 2024-04-26T23:44:24.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.002+0000 7f7534c00640 1 -- 172.21.15.137:0/3199176114 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f75280bf020 con 0x7f753806d0d0 2024-04-26T23:44:24.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.002+0000 7f7534c00640 1 --2- 172.21.15.137:0/3199176114 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f75180683b0 0x7f751806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:24.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.002+0000 7f7534c00640 1 -- 172.21.15.137:0/3199176114 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f75281219b0 con 0x7f753806d0d0 2024-04-26T23:44:24.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.002+0000 7f7537e00640 1 --2- 172.21.15.137:0/3199176114 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f75180683b0 0x7f751806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:24.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.002+0000 7f7537e00640 1 --2- 172.21.15.137:0/3199176114 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f75180683b0 0x7f751806a870 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7524007fd0 tx=0x7f7524009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:24.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.006+0000 7f7534c00640 1 -- 172.21.15.137:0/3199176114 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f75280c6070 con 0x7f753806d0d0 2024-04-26T23:44:24.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.198+0000 7f753fa00640 1 -- 172.21.15.137:0/3199176114 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f7538068e40 con 0x7f753806d0d0 2024-04-26T23:44:24.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.826+0000 7f7534c00640 1 -- 172.21.15.137:0/3199176114 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v37) ==== 122+0+0 (secure 0 0 0) 0x7f75280165a0 con 0x7f753806d0d0 2024-04-26T23:44:24.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.830+0000 7f753fa00640 1 -- 172.21.15.137:0/3199176114 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f75180683b0 msgr2=0x7f751806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:24.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.830+0000 7f753fa00640 1 --2- 172.21.15.137:0/3199176114 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f75180683b0 0x7f751806a870 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7524007fd0 tx=0x7f7524009040 comp rx=0 tx=0).stop 2024-04-26T23:44:24.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.830+0000 7f753fa00640 1 -- 172.21.15.137:0/3199176114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f753806d0d0 msgr2=0x7f75380c9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:24.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.830+0000 7f753fa00640 1 --2- 172.21.15.137:0/3199176114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f753806d0d0 0x7f75380c9f50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f752801a5e0 tx=0x7f7528019750 comp rx=0 tx=0).stop 2024-04-26T23:44:24.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.830+0000 7f753fa00640 1 -- 172.21.15.137:0/3199176114 shutdown_connections 2024-04-26T23:44:24.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.830+0000 7f753fa00640 1 --2- 172.21.15.137:0/3199176114 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f75180683b0 0x7f751806a870 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:24.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.830+0000 7f753fa00640 1 --2- 172.21.15.137:0/3199176114 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7538162d80 0x7f7538155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:24.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.830+0000 7f753fa00640 1 --2- 172.21.15.137:0/3199176114 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f753815f130 0x7f75380b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:24.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.830+0000 7f753fa00640 1 --2- 172.21.15.137:0/3199176114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f753806d0d0 0x7f75380c9f50 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:24.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.830+0000 7f753fa00640 1 -- 172.21.15.137:0/3199176114 >> 172.21.15.137:0/3199176114 conn(0x7f753809ba60 msgr2=0x7f75380702a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:24.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.830+0000 7f753fa00640 1 -- 172.21.15.137:0/3199176114 shutdown_connections 2024-04-26T23:44:24.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.830+0000 7f753fa00640 1 -- 172.21.15.137:0/3199176114 wait complete. 2024-04-26T23:44:24.858 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T23:44:24.858 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:44:24.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.990+0000 7fbf09800640 1 Processor -- start 2024-04-26T23:44:24.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.990+0000 7fbf09800640 1 -- start start 2024-04-26T23:44:24.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.990+0000 7fbf09800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbf040b5080 0x7fbf040cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:24.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.990+0000 7fbf09800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf04072980 0x7fbf04072e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:24.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.990+0000 7fbf09800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf040cfef0 con 0x7fbf040725a0 2024-04-26T23:44:24.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.990+0000 7fbf09800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fbf040cddc0 con 0x7fbf040b5080 2024-04-26T23:44:24.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.990+0000 7fbf09800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbf040d01b0 con 0x7fbf04072980 2024-04-26T23:44:24.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.990+0000 7fbf03400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf04072980 0x7fbf04072e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:24.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.990+0000 7fbf03400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf04072980 0x7fbf04072e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:60968/0 (socket says 172.21.15.137:60968) 2024-04-26T23:44:24.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.990+0000 7fbf03400640 1 -- 172.21.15.137:0/1267158369 learned_addr learned my addr 172.21.15.137:0/1267158369 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:24.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.990+0000 7fbf02000640 1 --2- 172.21.15.137:0/1267158369 >> v2:172.21.15.170:3300/0 conn(0x7fbf040b5080 0x7fbf040cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:24.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.990+0000 7fbf03400640 1 -- 172.21.15.137:0/1267158369 >> v2:172.21.15.170:3300/0 conn(0x7fbf040b5080 msgr2=0x7fbf040cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:24.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.990+0000 7fbf03400640 1 --2- 172.21.15.137:0/1267158369 >> v2:172.21.15.170:3300/0 conn(0x7fbf040b5080 0x7fbf040cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:24.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.990+0000 7fbf03400640 1 -- 172.21.15.137:0/1267158369 >> v1:172.21.15.170:6789/0 conn(0x7fbf040725a0 legacy=0x7fbf04073f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:24.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.990+0000 7fbf03400640 1 -- 172.21.15.137:0/1267158369 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf040d0490 con 0x7fbf04072980 2024-04-26T23:44:25.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.994+0000 7fbf03400640 1 --2- 172.21.15.137:0/1267158369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf04072980 0x7fbf04072e30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009e80 tx=0x7fbefc01c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d54e5a6ec103d9b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:25.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.994+0000 7fbf01600640 1 -- 172.21.15.137:0/1267158369 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc0a58a0 con 0x7fbf04072980 2024-04-26T23:44:25.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.994+0000 7fbf01600640 1 -- 172.21.15.137:0/1267158369 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbefc0a5a40 con 0x7fbf04072980 2024-04-26T23:44:25.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.994+0000 7fbf01600640 1 -- 172.21.15.137:0/1267158369 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc0a5e10 con 0x7fbf04072980 2024-04-26T23:44:25.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.994+0000 7fbf09800640 1 -- 172.21.15.137:0/1267158369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf04072980 msgr2=0x7fbf04072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:25.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.994+0000 7fbf09800640 1 --2- 172.21.15.137:0/1267158369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf04072980 0x7fbf04072e30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009e80 tx=0x7fbefc01c9e0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.994+0000 7fbf09800640 1 -- 172.21.15.137:0/1267158369 shutdown_connections 2024-04-26T23:44:25.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.994+0000 7fbf09800640 1 --2- 172.21.15.137:0/1267158369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf04072980 0x7fbf04072e30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.994+0000 7fbf09800640 1 --2- 172.21.15.137:0/1267158369 >> v2:172.21.15.170:3300/0 conn(0x7fbf040b5080 0x7fbf040cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.994+0000 7fbf09800640 1 -- 172.21.15.137:0/1267158369 >> 172.21.15.137:0/1267158369 conn(0x7fbf0406c5d0 msgr2=0x7fbf0406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:25.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.994+0000 7fbf09800640 1 -- 172.21.15.137:0/1267158369 shutdown_connections 2024-04-26T23:44:25.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.994+0000 7fbf09800640 1 -- 172.21.15.137:0/1267158369 wait complete. 2024-04-26T23:44:25.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbf09800640 1 Processor -- start 2024-04-26T23:44:25.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbf09800640 1 -- start start 2024-04-26T23:44:25.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbf09800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf040725a0 0x7fbf0415f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:25.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbf09800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf04072980 0x7fbf0415a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:25.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbf09800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf040b5080 0x7fbf0415a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:25.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbf09800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0406f120 con 0x7fbf04072980 2024-04-26T23:44:25.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbf09800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0406efa0 con 0x7fbf040725a0 2024-04-26T23:44:25.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbf09800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbf0406f2a0 con 0x7fbf040b5080 2024-04-26T23:44:25.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbf02000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf04072980 0x7fbf0415a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:25.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbf02000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf04072980 0x7fbf0415a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45638/0 (socket says 172.21.15.137:45638) 2024-04-26T23:44:25.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbf02000640 1 -- 172.21.15.137:0/2510767358 learned_addr learned my addr 172.21.15.137:0/2510767358 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:25.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbf03400640 1 --2- 172.21.15.137:0/2510767358 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf040b5080 0x7fbf0415a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:25.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbf02a00640 1 --2- 172.21.15.137:0/2510767358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf040725a0 0x7fbf0415f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:25.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbf02000640 1 -- 172.21.15.137:0/2510767358 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf040b5080 msgr2=0x7fbf0415a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:25.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbf02000640 1 --2- 172.21.15.137:0/2510767358 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf040b5080 0x7fbf0415a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbf02000640 1 -- 172.21.15.137:0/2510767358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf040725a0 msgr2=0x7fbf0415f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:25.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbf02000640 1 --2- 172.21.15.137:0/2510767358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf040725a0 0x7fbf0415f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbf02000640 1 -- 172.21.15.137:0/2510767358 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf040b2a80 con 0x7fbf04072980 2024-04-26T23:44:25.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbf02000640 1 --2- 172.21.15.137:0/2510767358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf04072980 0x7fbf0415a200 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fbef000e900 tx=0x7fbef000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:25.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbefaa00640 1 -- 172.21.15.137:0/2510767358 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0017070 con 0x7fbf04072980 2024-04-26T23:44:25.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbefaa00640 1 -- 172.21.15.137:0/2510767358 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef000c9a0 con 0x7fbf04072980 2024-04-26T23:44:25.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbf09800640 1 -- 172.21.15.137:0/2510767358 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf0415fde0 con 0x7fbf04072980 2024-04-26T23:44:25.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbefaa00640 1 -- 172.21.15.137:0/2510767358 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef000cd70 con 0x7fbf04072980 2024-04-26T23:44:25.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbf09800640 1 -- 172.21.15.137:0/2510767358 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf040b2fd0 con 0x7fbf04072980 2024-04-26T23:44:25.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:24.998+0000 7fbf09800640 1 -- 172.21.15.137:0/2510767358 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf0406a4b0 con 0x7fbf04072980 2024-04-26T23:44:25.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.002+0000 7fbefaa00640 1 -- 172.21.15.137:0/2510767358 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbef001a070 con 0x7fbf04072980 2024-04-26T23:44:25.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.002+0000 7fbefaa00640 1 --2- 172.21.15.137:0/2510767358 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbee4068380 0x7fbee406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:25.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.002+0000 7fbefaa00640 1 -- 172.21.15.137:0/2510767358 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fbef00868d0 con 0x7fbf04072980 2024-04-26T23:44:25.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.002+0000 7fbf02a00640 1 --2- 172.21.15.137:0/2510767358 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbee4068380 0x7fbee406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:25.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.002+0000 7fbf02a00640 1 --2- 172.21.15.137:0/2510767358 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbee4068380 0x7fbee406a840 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbef4001770 tx=0x7fbef4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:25.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.006+0000 7fbefaa00640 1 -- 172.21.15.137:0/2510767358 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbef0056830 con 0x7fbf04072980 2024-04-26T23:44:25.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.198+0000 7fbf09800640 1 -- 172.21.15.137:0/2510767358 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf04143e40 con 0x7fbf04072980 2024-04-26T23:44:25.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.198+0000 7fbefaa00640 1 -- 172.21.15.137:0/2510767358 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5190 (secure 0 0 0) 0x7fbef005ab30 con 0x7fbf04072980 2024-04-26T23:44:25.205 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:25.205 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6064,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2903000554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2903000554},{"type":"v1","addr":"172.21.15.170:6834","nonce":2903000554}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6372,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/2879053849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2879053849},{"type":"v1","addr":"172.21.15.137:6836","nonce":2879053849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3081576837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3081576837},{"type":"v1","addr":"172.21.15.137:6837","nonce":3081576837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:44:21.180357+0000","modified":"2024-04-26T23:44:24.204261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6381":{"gid":6381,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/141729149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":141729149},{"type":"v1","addr":"172.21.15.170:6835","nonce":141729149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6381,"qdb_cluster":[6381]},"id":4}]} 2024-04-26T23:44:25.206 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 37 2024-04-26T23:44:25.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.198+0000 7fbf09800640 1 -- 172.21.15.137:0/2510767358 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbee4068380 msgr2=0x7fbee406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:25.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.198+0000 7fbf09800640 1 --2- 172.21.15.137:0/2510767358 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbee4068380 0x7fbee406a840 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbef4001770 tx=0x7fbef4009040 comp rx=0 tx=0).stop 2024-04-26T23:44:25.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.198+0000 7fbf09800640 1 -- 172.21.15.137:0/2510767358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf04072980 msgr2=0x7fbf0415a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:25.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.198+0000 7fbf09800640 1 --2- 172.21.15.137:0/2510767358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf04072980 0x7fbf0415a200 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fbef000e900 tx=0x7fbef000edc0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.198+0000 7fbf09800640 1 -- 172.21.15.137:0/2510767358 shutdown_connections 2024-04-26T23:44:25.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.198+0000 7fbf09800640 1 --2- 172.21.15.137:0/2510767358 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbee4068380 0x7fbee406a840 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.198+0000 7fbf09800640 1 --2- 172.21.15.137:0/2510767358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf04072980 0x7fbf0415a200 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.198+0000 7fbf09800640 1 --2- 172.21.15.137:0/2510767358 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf040b5080 0x7fbf0415a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.198+0000 7fbf09800640 1 --2- 172.21.15.137:0/2510767358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf040725a0 0x7fbf0415f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.198+0000 7fbf09800640 1 -- 172.21.15.137:0/2510767358 >> 172.21.15.137:0/2510767358 conn(0x7fbf0406c5d0 msgr2=0x7fbf04144360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:25.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.198+0000 7fbf09800640 1 -- 172.21.15.137:0/2510767358 shutdown_connections 2024-04-26T23:44:25.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.198+0000 7fbf09800640 1 -- 172.21.15.137:0/2510767358 wait complete. 2024-04-26T23:44:25.227 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:44:25.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.354+0000 7fabf6600640 1 Processor -- start 2024-04-26T23:44:25.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.354+0000 7fabf6600640 1 -- start start 2024-04-26T23:44:25.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.354+0000 7fabf6600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fabf00b5080 0x7fabf00cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:25.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.354+0000 7fabf6600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf0072980 0x7fabf0072e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:25.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.354+0000 7fabf6600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabf00cfef0 con 0x7fabf00725a0 2024-04-26T23:44:25.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.354+0000 7fabf6600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fabf00cddc0 con 0x7fabf00b5080 2024-04-26T23:44:25.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.354+0000 7fabf6600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fabf00d01b0 con 0x7fabf0072980 2024-04-26T23:44:25.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.354+0000 7fabefe00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf0072980 0x7fabf0072e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:25.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.354+0000 7fabef400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fabf00725a0 0x7fabf0073f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:50648/0 (socket says 172.21.15.137:50648) 2024-04-26T23:44:25.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.354+0000 7fabef400640 1 -- 172.21.15.137:0/1587058645 learned_addr learned my addr 172.21.15.137:0/1587058645 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:25.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.354+0000 7fabe6a00640 1 --2- 172.21.15.137:0/1587058645 >> v2:172.21.15.170:3300/0 conn(0x7fabf00b5080 0x7fabf00cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:25.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.358+0000 7fabeea00640 1 -- 172.21.15.137:0/1587058645 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2745822646 0 0) 0x7fabf00cfef0 con 0x7fabf00725a0 2024-04-26T23:44:25.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.358+0000 7fabeea00640 1 -- 172.21.15.137:0/1587058645 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabd4003530 con 0x7fabf00725a0 2024-04-26T23:44:25.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.358+0000 7fabefe00640 1 -- 172.21.15.137:0/1587058645 >> v2:172.21.15.170:3300/0 conn(0x7fabf00b5080 msgr2=0x7fabf00cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:25.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.358+0000 7fabefe00640 1 --2- 172.21.15.137:0/1587058645 >> v2:172.21.15.170:3300/0 conn(0x7fabf00b5080 0x7fabf00cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.358+0000 7fabefe00640 1 -- 172.21.15.137:0/1587058645 >> v1:172.21.15.170:6789/0 conn(0x7fabf00725a0 legacy=0x7fabf0073f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:25.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.358+0000 7fabefe00640 1 -- 172.21.15.137:0/1587058645 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf00d0490 con 0x7fabf0072980 2024-04-26T23:44:25.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.358+0000 7fabefe00640 1 --2- 172.21.15.137:0/1587058645 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf0072980 0x7fabf0072e30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fabe80097f0 tx=0x7fabe801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34a3141caa6f1f07 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:25.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.358+0000 7fabeea00640 1 -- 172.21.15.137:0/1587058645 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe80a7070 con 0x7fabf0072980 2024-04-26T23:44:25.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.358+0000 7fabeea00640 1 -- 172.21.15.137:0/1587058645 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe80b0070 con 0x7fabf0072980 2024-04-26T23:44:25.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.358+0000 7fabeea00640 1 -- 172.21.15.137:0/1587058645 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe80ab870 con 0x7fabf0072980 2024-04-26T23:44:25.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabf6600640 1 -- 172.21.15.137:0/1587058645 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf0072980 msgr2=0x7fabf0072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:25.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabf6600640 1 --2- 172.21.15.137:0/1587058645 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf0072980 0x7fabf0072e30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fabe80097f0 tx=0x7fabe801c470 comp rx=0 tx=0).stop 2024-04-26T23:44:25.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabf6600640 1 -- 172.21.15.137:0/1587058645 shutdown_connections 2024-04-26T23:44:25.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabf6600640 1 --2- 172.21.15.137:0/1587058645 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf0072980 0x7fabf0072e30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabf6600640 1 --2- 172.21.15.137:0/1587058645 >> v2:172.21.15.170:3300/0 conn(0x7fabf00b5080 0x7fabf00cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabf6600640 1 -- 172.21.15.137:0/1587058645 >> 172.21.15.137:0/1587058645 conn(0x7fabf006c5d0 msgr2=0x7fabf006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:25.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabf6600640 1 -- 172.21.15.137:0/1587058645 shutdown_connections 2024-04-26T23:44:25.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabf6600640 1 -- 172.21.15.137:0/1587058645 wait complete. 2024-04-26T23:44:25.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabf6600640 1 Processor -- start 2024-04-26T23:44:25.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabf6600640 1 -- start start 2024-04-26T23:44:25.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabf6600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf00725a0 0x7fabf015f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:25.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabf6600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf0072980 0x7fabf015c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:25.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabf6600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabf00b5080 0x7fabf0138130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:25.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabf6600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fabf01664d0 con 0x7fabf00b5080 2024-04-26T23:44:25.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabf6600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fabf0166350 con 0x7fabf0072980 2024-04-26T23:44:25.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabf6600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fabf0166650 con 0x7fabf00725a0 2024-04-26T23:44:25.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabefe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabf00b5080 0x7fabf0138130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:25.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabefe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabf00b5080 0x7fabf0138130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45640/0 (socket says 172.21.15.137:45640) 2024-04-26T23:44:25.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabefe00640 1 -- 172.21.15.137:0/2666282711 learned_addr learned my addr 172.21.15.137:0/2666282711 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:25.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabef400640 1 --2- 172.21.15.137:0/2666282711 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf00725a0 0x7fabf015f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:25.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabe6a00640 1 --2- 172.21.15.137:0/2666282711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf0072980 0x7fabf015c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:25.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabefe00640 1 -- 172.21.15.137:0/2666282711 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf00725a0 msgr2=0x7fabf015f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:25.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabefe00640 1 --2- 172.21.15.137:0/2666282711 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf00725a0 0x7fabf015f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabefe00640 1 -- 172.21.15.137:0/2666282711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf0072980 msgr2=0x7fabf015c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:25.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabefe00640 1 --2- 172.21.15.137:0/2666282711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf0072980 0x7fabf015c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabefe00640 1 -- 172.21.15.137:0/2666282711 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf00d09b0 con 0x7fabf00b5080 2024-04-26T23:44:25.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.362+0000 7fabe6a00640 1 --2- 172.21.15.137:0/2666282711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf0072980 0x7fabf015c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:25.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.366+0000 7fabefe00640 1 --2- 172.21.15.137:0/2666282711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabf00b5080 0x7fabf0138130 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fabe80ad040 tx=0x7fabe801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:25.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.366+0000 7fabe7e00640 1 -- 172.21.15.137:0/2666282711 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8006e20 con 0x7fabf00b5080 2024-04-26T23:44:25.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.366+0000 7fabe7e00640 1 -- 172.21.15.137:0/2666282711 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe80bf610 con 0x7fabf00b5080 2024-04-26T23:44:25.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.366+0000 7fabe7e00640 1 -- 172.21.15.137:0/2666282711 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe80bf9c0 con 0x7fabf00b5080 2024-04-26T23:44:25.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.366+0000 7fabf6600640 1 -- 172.21.15.137:0/2666282711 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabf015d130 con 0x7fabf00b5080 2024-04-26T23:44:25.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.366+0000 7fabf6600640 1 -- 172.21.15.137:0/2666282711 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabf0164020 con 0x7fabf00b5080 2024-04-26T23:44:25.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.366+0000 7fabf6600640 1 -- 172.21.15.137:0/2666282711 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabf006a4b0 con 0x7fabf00b5080 2024-04-26T23:44:25.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.366+0000 7fabe7e00640 1 -- 172.21.15.137:0/2666282711 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fabe80bd020 con 0x7fabf00b5080 2024-04-26T23:44:25.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.366+0000 7fabe7e00640 1 --2- 172.21.15.137:0/2666282711 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fabcc068380 0x7fabcc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:25.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.366+0000 7fabe7e00640 1 -- 172.21.15.137:0/2666282711 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fabe8120c00 con 0x7fabf00b5080 2024-04-26T23:44:25.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.366+0000 7fabef400640 1 --2- 172.21.15.137:0/2666282711 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fabcc068380 0x7fabcc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:25.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.370+0000 7fabef400640 1 --2- 172.21.15.137:0/2666282711 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fabcc068380 0x7fabcc06a840 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fabe0005c10 tx=0x7fabe0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:25.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.370+0000 7fabe7e00640 1 -- 172.21.15.137:0/2666282711 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fabe8127080 con 0x7fabf00b5080 2024-04-26T23:44:25.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.526+0000 7fabf6600640 1 -- 172.21.15.137:0/2666282711 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fabf01450e0 con 0x7fabf00b5080 2024-04-26T23:44:25.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.530+0000 7fabe7e00640 1 -- 172.21.15.137:0/2666282711 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16713 (secure 0 0 0) 0x7fabe80f7020 con 0x7fabf00b5080 2024-04-26T23:44:25.537 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:25.537 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":60,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:44:22.811626+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:44:18.876990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T23:44:20.189315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:44:25.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.530+0000 7fabf6600640 1 -- 172.21.15.137:0/2666282711 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fabcc068380 msgr2=0x7fabcc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:25.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.530+0000 7fabf6600640 1 --2- 172.21.15.137:0/2666282711 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fabcc068380 0x7fabcc06a840 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fabe0005c10 tx=0x7fabe0009040 comp rx=0 tx=0).stop 2024-04-26T23:44:25.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.530+0000 7fabf6600640 1 -- 172.21.15.137:0/2666282711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabf00b5080 msgr2=0x7fabf0138130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:25.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.530+0000 7fabf6600640 1 --2- 172.21.15.137:0/2666282711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabf00b5080 0x7fabf0138130 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fabe80ad040 tx=0x7fabe801acb0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.530+0000 7fabf6600640 1 -- 172.21.15.137:0/2666282711 shutdown_connections 2024-04-26T23:44:25.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.530+0000 7fabf6600640 1 --2- 172.21.15.137:0/2666282711 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fabcc068380 0x7fabcc06a840 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.530+0000 7fabf6600640 1 --2- 172.21.15.137:0/2666282711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabf00b5080 0x7fabf0138130 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.530+0000 7fabf6600640 1 --2- 172.21.15.137:0/2666282711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf0072980 0x7fabf015c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.530+0000 7fabf6600640 1 --2- 172.21.15.137:0/2666282711 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf00725a0 0x7fabf015f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.530+0000 7fabf6600640 1 -- 172.21.15.137:0/2666282711 >> 172.21.15.137:0/2666282711 conn(0x7fabf006c5d0 msgr2=0x7fabf0143350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:25.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.530+0000 7fabf6600640 1 -- 172.21.15.137:0/2666282711 shutdown_connections 2024-04-26T23:44:25.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.530+0000 7fabf6600640 1 -- 172.21.15.137:0/2666282711 wait complete. 2024-04-26T23:44:25.559 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T23:44:25.559 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:44:25.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.690+0000 7f4679800640 1 Processor -- start 2024-04-26T23:44:25.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.690+0000 7f4679800640 1 -- start start 2024-04-26T23:44:25.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.690+0000 7f4679800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46740d1ac0 0x7f46740b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:25.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.690+0000 7f4679800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f467415d2b0 0x7f46740b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:25.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.690+0000 7f4679800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46740b1b30 con 0x7f467415ced0 2024-04-26T23:44:25.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.690+0000 7f4679800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f46740b1e10 con 0x7f467415d2b0 2024-04-26T23:44:25.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.690+0000 7f4679800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f46740b23f0 con 0x7f46740d1ac0 2024-04-26T23:44:25.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.690+0000 7f4673400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f467415d2b0 0x7f46740b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:25.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.690+0000 7f4673400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f467415d2b0 0x7f46740b12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45648/0 (socket says 172.21.15.137:45648) 2024-04-26T23:44:25.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.690+0000 7f4673400640 1 -- 172.21.15.137:0/2286453655 learned_addr learned my addr 172.21.15.137:0/2286453655 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:25.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.690+0000 7f466a000640 1 --2- 172.21.15.137:0/2286453655 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46740d1ac0 0x7f46740b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:25.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.690+0000 7f4673400640 1 -- 172.21.15.137:0/2286453655 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46740d1ac0 msgr2=0x7f46740b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:25.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.690+0000 7f4673400640 1 --2- 172.21.15.137:0/2286453655 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46740d1ac0 0x7f46740b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.690+0000 7f4673400640 1 -- 172.21.15.137:0/2286453655 >> v1:172.21.15.137:6789/0 conn(0x7f467415ced0 legacy=0x7f46740d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:25.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.690+0000 7f4673400640 1 -- 172.21.15.137:0/2286453655 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46740b26d0 con 0x7f467415d2b0 2024-04-26T23:44:25.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.690+0000 7f466a000640 1 --2- 172.21.15.137:0/2286453655 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46740d1ac0 0x7f46740b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:25.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.694+0000 7f4673400640 1 --2- 172.21.15.137:0/2286453655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f467415d2b0 0x7f46740b12d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f466c009e50 tx=0x7f466c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e921d42fb39647 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:25.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.694+0000 7f4672000640 1 -- 172.21.15.137:0/2286453655 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c0a5810 con 0x7f467415d2b0 2024-04-26T23:44:25.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.694+0000 7f4672000640 1 -- 172.21.15.137:0/2286453655 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f466c0a59b0 con 0x7f467415d2b0 2024-04-26T23:44:25.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.694+0000 7f4672000640 1 -- 172.21.15.137:0/2286453655 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c0a5d80 con 0x7f467415d2b0 2024-04-26T23:44:25.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.694+0000 7f4679800640 1 -- 172.21.15.137:0/2286453655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f467415d2b0 msgr2=0x7f46740b12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:25.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.694+0000 7f4679800640 1 --2- 172.21.15.137:0/2286453655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f467415d2b0 0x7f46740b12d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f466c009e50 tx=0x7f466c01ca30 comp rx=0 tx=0).stop 2024-04-26T23:44:25.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.694+0000 7f4679800640 1 -- 172.21.15.137:0/2286453655 shutdown_connections 2024-04-26T23:44:25.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.694+0000 7f4679800640 1 --2- 172.21.15.137:0/2286453655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f467415d2b0 0x7f46740b12d0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.694+0000 7f4679800640 1 --2- 172.21.15.137:0/2286453655 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46740d1ac0 0x7f46740b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.694+0000 7f4679800640 1 -- 172.21.15.137:0/2286453655 >> 172.21.15.137:0/2286453655 conn(0x7f467409ba60 msgr2=0x7f467409be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:25.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.694+0000 7f4679800640 1 -- 172.21.15.137:0/2286453655 shutdown_connections 2024-04-26T23:44:25.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.694+0000 7f4679800640 1 -- 172.21.15.137:0/2286453655 wait complete. 2024-04-26T23:44:25.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f4679800640 1 Processor -- start 2024-04-26T23:44:25.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f4679800640 1 -- start start 2024-04-26T23:44:25.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f4679800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46740d1ac0 0x7f4674153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:25.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f4679800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f467415ced0 0x7f467414e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:25.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f4679800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f467415d2b0 0x7f4674158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f4679800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f46740b3790 con 0x7f467415d2b0 2024-04-26T23:44:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f4679800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f46740b3610 con 0x7f467415ced0 2024-04-26T23:44:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f4679800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f46740b3910 con 0x7f46740d1ac0 2024-04-26T23:44:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f4673400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f467415d2b0 0x7f4674158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f4673400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f467415d2b0 0x7f4674158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45656/0 (socket says 172.21.15.137:45656) 2024-04-26T23:44:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f4673400640 1 -- 172.21.15.137:0/2965780352 learned_addr learned my addr 172.21.15.137:0/2965780352 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f4672a00640 1 --2- 172.21.15.137:0/2965780352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46740d1ac0 0x7f4674153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f466a000640 1 --2- 172.21.15.137:0/2965780352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f467415ced0 0x7f467414e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f4673400640 1 -- 172.21.15.137:0/2965780352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46740d1ac0 msgr2=0x7f4674153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f4673400640 1 --2- 172.21.15.137:0/2965780352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46740d1ac0 0x7f4674153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f4673400640 1 -- 172.21.15.137:0/2965780352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f467415ced0 msgr2=0x7f467414e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f4673400640 1 --2- 172.21.15.137:0/2965780352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f467415ced0 0x7f467414e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f4673400640 1 -- 172.21.15.137:0/2965780352 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467406c400 con 0x7f467415d2b0 2024-04-26T23:44:25.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f4673400640 1 --2- 172.21.15.137:0/2965780352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f467415d2b0 0x7f4674158d30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f466c0af040 tx=0x7f466c0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:25.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f466b400640 1 -- 172.21.15.137:0/2965780352 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c0b8880 con 0x7f467415d2b0 2024-04-26T23:44:25.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f466b400640 1 -- 172.21.15.137:0/2965780352 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f466c0be070 con 0x7f467415d2b0 2024-04-26T23:44:25.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f466b400640 1 -- 172.21.15.137:0/2965780352 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c0b8ca0 con 0x7f467415d2b0 2024-04-26T23:44:25.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f4679800640 1 -- 172.21.15.137:0/2965780352 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f467406c6a0 con 0x7f467415d2b0 2024-04-26T23:44:25.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f4679800640 1 -- 172.21.15.137:0/2965780352 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f467406cc60 con 0x7f467415d2b0 2024-04-26T23:44:25.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.698+0000 7f4679800640 1 -- 172.21.15.137:0/2965780352 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f467406a4b0 con 0x7f467415d2b0 2024-04-26T23:44:25.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.702+0000 7f466b400640 1 -- 172.21.15.137:0/2965780352 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f466c0c3460 con 0x7f467415d2b0 2024-04-26T23:44:25.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.702+0000 7f466b400640 1 --2- 172.21.15.137:0/2965780352 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4650068380 0x7f465006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:25.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.702+0000 7f466b400640 1 -- 172.21.15.137:0/2965780352 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f466c121f90 con 0x7f467415d2b0 2024-04-26T23:44:25.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.702+0000 7f4672a00640 1 --2- 172.21.15.137:0/2965780352 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4650068380 0x7f465006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:25.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.702+0000 7f4672a00640 1 --2- 172.21.15.137:0/2965780352 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4650068380 0x7f465006a840 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f46740cee50 tx=0x7f4664009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:25.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.706+0000 7f466b400640 1 -- 172.21.15.137:0/2965780352 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f466c016620 con 0x7f467415d2b0 2024-04-26T23:44:25.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.862+0000 7f4679800640 1 -- 172.21.15.137:0/2965780352 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4674075840 con 0x7f4650068380 2024-04-26T23:44:25.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.866+0000 7f466b400640 1 -- 172.21.15.137:0/2965780352 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239819 (secure 0 0 0) 0x7f4674075840 con 0x7f4650068380 2024-04-26T23:44:25.875 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:25.879 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T23:44:25.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.870+0000 7f4679800640 1 -- 172.21.15.137:0/2965780352 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4650068380 msgr2=0x7f465006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:25.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.870+0000 7f4679800640 1 --2- 172.21.15.137:0/2965780352 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4650068380 0x7f465006a840 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f46740cee50 tx=0x7f4664009040 comp rx=0 tx=0).stop 2024-04-26T23:44:25.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.870+0000 7f4679800640 1 -- 172.21.15.137:0/2965780352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f467415d2b0 msgr2=0x7f4674158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:25.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.870+0000 7f4679800640 1 --2- 172.21.15.137:0/2965780352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f467415d2b0 0x7f4674158d30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f466c0af040 tx=0x7f466c0197d0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.870+0000 7f4679800640 1 -- 172.21.15.137:0/2965780352 shutdown_connections 2024-04-26T23:44:25.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.870+0000 7f4679800640 1 --2- 172.21.15.137:0/2965780352 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4650068380 0x7f465006a840 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.870+0000 7f4679800640 1 --2- 172.21.15.137:0/2965780352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f467415d2b0 0x7f4674158d30 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.870+0000 7f4679800640 1 --2- 172.21.15.137:0/2965780352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f467415ced0 0x7f467414e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.870+0000 7f4679800640 1 --2- 172.21.15.137:0/2965780352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46740d1ac0 0x7f4674153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.870+0000 7f4679800640 1 -- 172.21.15.137:0/2965780352 >> 172.21.15.137:0/2965780352 conn(0x7f467409ba60 msgr2=0x7f46740d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:25.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.870+0000 7f4679800640 1 -- 172.21.15.137:0/2965780352 shutdown_connections 2024-04-26T23:44:25.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:25.870+0000 7f4679800640 1 -- 172.21.15.137:0/2965780352 wait complete. 2024-04-26T23:44:25.897 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-04-26T23:44:25.626802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":243460,"kb_used_data":6492,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731260,"statfs":{"total":773094113280,"available":772844810240,"internally_reserved":0,"allocated":6647808,"data_stored":3443951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.839534"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.793748+0000","last_change":"2024-04-26T23:44:19.793748+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.793748+0000","last_undegraded":"2024-04-26T23:44:19.793748+0000","last_fullsized":"2024-04-26T23:44:19.793748+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.793084+0000","last_change":"2024-04-26T23:44:19.793084+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.793084+0000","last_undegraded":"2024-04-26T23:44:19.793084+0000","last_fullsized":"2024-04-26T23:44:19.793084+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.793729+0000","last_change":"2024-04-26T23:44:19.793729+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.793729+0000","last_undegraded":"2024-04-26T23:44:19.793729+0000","last_fullsized":"2024-04-26T23:44:19.793729+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.789194+0000","last_change":"2024-04-26T23:44:19.789194+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.789194+0000","last_undegraded":"2024-04-26T23:44:19.789194+0000","last_fullsized":"2024-04-26T23:44:19.789194+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788770+0000","last_change":"2024-04-26T23:44:19.788770+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788770+0000","last_undegraded":"2024-04-26T23:44:19.788770+0000","last_fullsized":"2024-04-26T23:44:19.788770+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.793676+0000","last_change":"2024-04-26T23:44:19.793676+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.793676+0000","last_undegraded":"2024-04-26T23:44:19.793676+0000","last_fullsized":"2024-04-26T23:44:19.793676+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.789212+0000","last_change":"2024-04-26T23:44:19.789212+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.789212+0000","last_undegraded":"2024-04-26T23:44:19.789212+0000","last_fullsized":"2024-04-26T23:44:19.789212+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788385+0000","last_change":"2024-04-26T23:44:19.788385+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788385+0000","last_undegraded":"2024-04-26T23:44:19.788385+0000","last_fullsized":"2024-04-26T23:44:19.788385+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791828+0000","last_change":"2024-04-26T23:44:19.791828+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791828+0000","last_undegraded":"2024-04-26T23:44:19.791828+0000","last_fullsized":"2024-04-26T23:44:19.791828+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791220+0000","last_change":"2024-04-26T23:44:19.791220+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791220+0000","last_undegraded":"2024-04-26T23:44:19.791220+0000","last_fullsized":"2024-04-26T23:44:19.791220+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791811+0000","last_change":"2024-04-26T23:44:19.791811+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791811+0000","last_undegraded":"2024-04-26T23:44:19.791811+0000","last_fullsized":"2024-04-26T23:44:19.791811+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788418+0000","last_change":"2024-04-26T23:44:19.788418+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788418+0000","last_undegraded":"2024-04-26T23:44:19.788418+0000","last_fullsized":"2024-04-26T23:44:19.788418+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791701+0000","last_change":"2024-04-26T23:44:19.791701+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791701+0000","last_undegraded":"2024-04-26T23:44:19.791701+0000","last_fullsized":"2024-04-26T23:44:19.791701+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.796339+0000","last_change":"2024-04-26T23:44:19.796339+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.796339+0000","last_undegraded":"2024-04-26T23:44:19.796339+0000","last_fullsized":"2024-04-26T23:44:19.796339+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788705+0000","last_change":"2024-04-26T23:44:19.788705+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788705+0000","last_undegraded":"2024-04-26T23:44:19.788705+0000","last_fullsized":"2024-04-26T23:44:19.788705+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791600+0000","last_change":"2024-04-26T23:44:19.791600+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791600+0000","last_undegraded":"2024-04-26T23:44:19.791600+0000","last_fullsized":"2024-04-26T23:44:19.791600+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791618+0000","last_change":"2024-04-26T23:44:19.791618+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791618+0000","last_undegraded":"2024-04-26T23:44:19.791618+0000","last_fullsized":"2024-04-26T23:44:19.791618+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.793626+0000","last_change":"2024-04-26T23:44:19.793626+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.793626+0000","last_undegraded":"2024-04-26T23:44:19.793626+0000","last_fullsized":"2024-04-26T23:44:19.793626+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788556+0000","last_change":"2024-04-26T23:44:19.788556+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788556+0000","last_undegraded":"2024-04-26T23:44:19.788556+0000","last_fullsized":"2024-04-26T23:44:19.788556+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791102+0000","last_change":"2024-04-26T23:44:19.791102+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791102+0000","last_undegraded":"2024-04-26T23:44:19.791102+0000","last_fullsized":"2024-04-26T23:44:19.791102+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791290+0000","last_change":"2024-04-26T23:44:19.791290+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791290+0000","last_undegraded":"2024-04-26T23:44:19.791290+0000","last_fullsized":"2024-04-26T23:44:19.791290+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.792117+0000","last_change":"2024-04-26T23:44:19.792117+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.792117+0000","last_undegraded":"2024-04-26T23:44:19.792117+0000","last_fullsized":"2024-04-26T23:44:19.792117+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788585+0000","last_change":"2024-04-26T23:44:19.788585+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788585+0000","last_undegraded":"2024-04-26T23:44:19.788585+0000","last_fullsized":"2024-04-26T23:44:19.788585+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791254+0000","last_change":"2024-04-26T23:44:19.791254+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791254+0000","last_undegraded":"2024-04-26T23:44:19.791254+0000","last_fullsized":"2024-04-26T23:44:19.791254+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791751+0000","last_change":"2024-04-26T23:44:19.791751+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791751+0000","last_undegraded":"2024-04-26T23:44:19.791751+0000","last_fullsized":"2024-04-26T23:44:19.791751+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.796369+0000","last_change":"2024-04-26T23:44:19.796369+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.796369+0000","last_undegraded":"2024-04-26T23:44:19.796369+0000","last_fullsized":"2024-04-26T23:44:19.796369+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788787+0000","last_change":"2024-04-26T23:44:19.788787+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788787+0000","last_undegraded":"2024-04-26T23:44:19.788787+0000","last_fullsized":"2024-04-26T23:44:19.788787+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791070+0000","last_change":"2024-04-26T23:44:19.791070+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791070+0000","last_undegraded":"2024-04-26T23:44:19.791070+0000","last_fullsized":"2024-04-26T23:44:19.791070+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788842+0000","last_change":"2024-04-26T23:44:19.788842+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788842+0000","last_undegraded":"2024-04-26T23:44:19.788842+0000","last_fullsized":"2024-04-26T23:44:19.788842+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791189+0000","last_change":"2024-04-26T23:44:19.791189+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791189+0000","last_undegraded":"2024-04-26T23:44:19.791189+0000","last_fullsized":"2024-04-26T23:44:19.791189+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.792017+0000","last_change":"2024-04-26T23:44:19.792017+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.792017+0000","last_undegraded":"2024-04-26T23:44:19.792017+0000","last_fullsized":"2024-04-26T23:44:19.792017+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.796330+0000","last_change":"2024-04-26T23:44:19.796330+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.796330+0000","last_undegraded":"2024-04-26T23:44:19.796330+0000","last_fullsized":"2024-04-26T23:44:19.796330+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":242,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-26T23:44:19.792924+0000","last_change":"2024-04-26T23:41:12.783987+0000","last_active":"2024-04-26T23:44:19.792924+0000","last_peered":"2024-04-26T23:44:19.792924+0000","last_clean":"2024-04-26T23:44:19.792924+0000","last_became_active":"2024-04-26T23:41:12.782901+0000","last_became_peered":"2024-04-26T23:41:12.782901+0000","last_unstale":"2024-04-26T23:44:19.792924+0000","last_undegraded":"2024-04-26T23:44:19.792924+0000","last_fullsized":"2024-04-26T23:44:19.792924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_clean_scrub_stamp":"2024-04-26T23:41:11.626255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:16.305521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1277952,"data_stored":873997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1265664,"data_stored":868180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:44:25.902 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:44:26.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.070+0000 7fe29b000640 1 Processor -- start 2024-04-26T23:44:26.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.070+0000 7fe29b000640 1 -- start start 2024-04-26T23:44:26.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.074+0000 7fe29b000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe29406eff0 0x7fe29415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:26.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.074+0000 7fe29b000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe2940b5c90 0x7fe294155510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:26.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.074+0000 7fe29b000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2940b3e30 con 0x7fe29406f3d0 2024-04-26T23:44:26.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.074+0000 7fe29b000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe2940d0850 con 0x7fe2940b5c90 2024-04-26T23:44:26.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.074+0000 7fe29b000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe29415ca00 con 0x7fe29406eff0 2024-04-26T23:44:26.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.074+0000 7fe28b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe2940b5c90 0x7fe294155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:26.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.074+0000 7fe28b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe2940b5c90 0x7fe294155510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45666/0 (socket says 172.21.15.137:45666) 2024-04-26T23:44:26.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.074+0000 7fe28b400640 1 -- 172.21.15.137:0/1950973691 learned_addr learned my addr 172.21.15.137:0/1950973691 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.074+0000 7fe293e00640 1 --2- 172.21.15.137:0/1950973691 >> v2:172.21.15.170:3300/0 conn(0x7fe29406eff0 0x7fe29415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.074+0000 7fe28b400640 1 -- 172.21.15.137:0/1950973691 >> v2:172.21.15.170:3300/0 conn(0x7fe29406eff0 msgr2=0x7fe29415c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.074+0000 7fe28b400640 1 --2- 172.21.15.137:0/1950973691 >> v2:172.21.15.170:3300/0 conn(0x7fe29406eff0 0x7fe29415c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.074+0000 7fe28b400640 1 -- 172.21.15.137:0/1950973691 >> v1:172.21.15.170:6789/0 conn(0x7fe29406f3d0 legacy=0x7fe29415f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.074+0000 7fe28b400640 1 -- 172.21.15.137:0/1950973691 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2940b40a0 con 0x7fe2940b5c90 2024-04-26T23:44:26.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.074+0000 7fe28b400640 1 --2- 172.21.15.137:0/1950973691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2940b5c90 0x7fe294155510 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0098a0 tx=0x7fe27c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d58088bc7d2deb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:26.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe293400640 1 -- 172.21.15.137:0/1950973691 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c0ab650 con 0x7fe2940b5c90 2024-04-26T23:44:26.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe293400640 1 -- 172.21.15.137:0/1950973691 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe27c0b0070 con 0x7fe2940b5c90 2024-04-26T23:44:26.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe293400640 1 -- 172.21.15.137:0/1950973691 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c0aba10 con 0x7fe2940b5c90 2024-04-26T23:44:26.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe29b000640 1 -- 172.21.15.137:0/1950973691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2940b5c90 msgr2=0x7fe294155510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:26.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe29b000640 1 --2- 172.21.15.137:0/1950973691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2940b5c90 0x7fe294155510 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0098a0 tx=0x7fe27c01c4d0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe29b000640 1 -- 172.21.15.137:0/1950973691 shutdown_connections 2024-04-26T23:44:26.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe29b000640 1 --2- 172.21.15.137:0/1950973691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2940b5c90 0x7fe294155510 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe29b000640 1 --2- 172.21.15.137:0/1950973691 >> v2:172.21.15.170:3300/0 conn(0x7fe29406eff0 0x7fe29415c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe29b000640 1 -- 172.21.15.137:0/1950973691 >> 172.21.15.137:0/1950973691 conn(0x7fe29406c5d0 msgr2=0x7fe29406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:26.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe29b000640 1 -- 172.21.15.137:0/1950973691 shutdown_connections 2024-04-26T23:44:26.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe29b000640 1 -- 172.21.15.137:0/1950973691 wait complete. 2024-04-26T23:44:26.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe29b000640 1 Processor -- start 2024-04-26T23:44:26.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe29b000640 1 -- start start 2024-04-26T23:44:26.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe29b000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe29406eff0 0x7fe2941437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:26.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe29b000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe29406f3d0 0x7fe294072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:26.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe29b000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2940b5c90 0x7fe29414c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:26.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe29b000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe2940b4b80 con 0x7fe29406f3d0 2024-04-26T23:44:26.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe29b000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe294155ec0 con 0x7fe29406eff0 2024-04-26T23:44:26.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe29b000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe2940b61e0 con 0x7fe2940b5c90 2024-04-26T23:44:26.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe28b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe29406f3d0 0x7fe294072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:26.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe28b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe29406f3d0 0x7fe294072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45676/0 (socket says 172.21.15.137:45676) 2024-04-26T23:44:26.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe28b400640 1 -- 172.21.15.137:0/1870195314 learned_addr learned my addr 172.21.15.137:0/1870195314 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:26.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe293e00640 1 --2- 172.21.15.137:0/1870195314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe29406eff0 0x7fe2941437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:26.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.078+0000 7fe299000640 1 --2- 172.21.15.137:0/1870195314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2940b5c90 0x7fe29414c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:26.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.082+0000 7fe28b400640 1 -- 172.21.15.137:0/1870195314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2940b5c90 msgr2=0x7fe29414c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:26.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.082+0000 7fe28b400640 1 --2- 172.21.15.137:0/1870195314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2940b5c90 0x7fe29414c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.082+0000 7fe28b400640 1 -- 172.21.15.137:0/1870195314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe29406eff0 msgr2=0x7fe2941437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:26.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.082+0000 7fe28b400640 1 --2- 172.21.15.137:0/1870195314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe29406eff0 0x7fe2941437e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.082+0000 7fe28b400640 1 -- 172.21.15.137:0/1870195314 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe294072170 con 0x7fe29406f3d0 2024-04-26T23:44:26.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.082+0000 7fe28b400640 1 --2- 172.21.15.137:0/1870195314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe29406f3d0 0x7fe294072900 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0ad040 tx=0x7fe27c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:26.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.082+0000 7fe290c00640 1 -- 172.21.15.137:0/1870195314 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c0be5f0 con 0x7fe29406f3d0 2024-04-26T23:44:26.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.082+0000 7fe290c00640 1 -- 172.21.15.137:0/1870195314 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe27c0be7d0 con 0x7fe29406f3d0 2024-04-26T23:44:26.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.082+0000 7fe290c00640 1 -- 172.21.15.137:0/1870195314 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c0bebc0 con 0x7fe29406f3d0 2024-04-26T23:44:26.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.082+0000 7fe29b000640 1 -- 172.21.15.137:0/1870195314 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe294073d80 con 0x7fe29406f3d0 2024-04-26T23:44:26.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.082+0000 7fe29b000640 1 -- 172.21.15.137:0/1870195314 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2940723e0 con 0x7fe29406f3d0 2024-04-26T23:44:26.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.082+0000 7fe29b000640 1 -- 172.21.15.137:0/1870195314 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe29406a4b0 con 0x7fe29406f3d0 2024-04-26T23:44:26.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.082+0000 7fe290c00640 1 -- 172.21.15.137:0/1870195314 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe27c0b43f0 con 0x7fe29406f3d0 2024-04-26T23:44:26.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.082+0000 7fe290c00640 1 --2- 172.21.15.137:0/1870195314 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe270068380 0x7fe27006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:26.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.082+0000 7fe290c00640 1 -- 172.21.15.137:0/1870195314 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fe27c121430 con 0x7fe29406f3d0 2024-04-26T23:44:26.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.082+0000 7fe293e00640 1 --2- 172.21.15.137:0/1870195314 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe270068380 0x7fe27006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:26.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.086+0000 7fe293e00640 1 --2- 172.21.15.137:0/1870195314 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe270068380 0x7fe27006a840 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe2941535e0 tx=0x7fe284008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:26.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.086+0000 7fe290c00640 1 -- 172.21.15.137:0/1870195314 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe27c0160f0 con 0x7fe29406f3d0 2024-04-26T23:44:26.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.242+0000 7fe29b000640 1 -- 172.21.15.137:0/1870195314 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe29415cbc0 con 0x7fe270068380 2024-04-26T23:44:26.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.246+0000 7fe290c00640 1 -- 172.21.15.137:0/1870195314 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239819 (secure 0 0 0) 0x7fe29415cbc0 con 0x7fe270068380 2024-04-26T23:44:26.257 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:26.258 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T23:44:26.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.250+0000 7fe29b000640 1 -- 172.21.15.137:0/1870195314 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe270068380 msgr2=0x7fe27006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:26.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.250+0000 7fe29b000640 1 --2- 172.21.15.137:0/1870195314 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe270068380 0x7fe27006a840 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe2941535e0 tx=0x7fe284008040 comp rx=0 tx=0).stop 2024-04-26T23:44:26.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.250+0000 7fe29b000640 1 -- 172.21.15.137:0/1870195314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe29406f3d0 msgr2=0x7fe294072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:26.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.250+0000 7fe29b000640 1 --2- 172.21.15.137:0/1870195314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe29406f3d0 0x7fe294072900 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0ad040 tx=0x7fe27c01ad10 comp rx=0 tx=0).stop 2024-04-26T23:44:26.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.250+0000 7fe29b000640 1 -- 172.21.15.137:0/1870195314 shutdown_connections 2024-04-26T23:44:26.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.250+0000 7fe29b000640 1 --2- 172.21.15.137:0/1870195314 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe270068380 0x7fe27006a840 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.250+0000 7fe29b000640 1 --2- 172.21.15.137:0/1870195314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe29406f3d0 0x7fe294072900 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.250+0000 7fe29b000640 1 --2- 172.21.15.137:0/1870195314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2940b5c90 0x7fe29414c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.250+0000 7fe29b000640 1 --2- 172.21.15.137:0/1870195314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe29406eff0 0x7fe2941437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.250+0000 7fe29b000640 1 -- 172.21.15.137:0/1870195314 >> 172.21.15.137:0/1870195314 conn(0x7fe29406c5d0 msgr2=0x7fe2940cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:26.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.250+0000 7fe29b000640 1 -- 172.21.15.137:0/1870195314 shutdown_connections 2024-04-26T23:44:26.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.250+0000 7fe29b000640 1 -- 172.21.15.137:0/1870195314 wait complete. 2024-04-26T23:44:26.278 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-04-26T23:44:25.626802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":243460,"kb_used_data":6492,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731260,"statfs":{"total":773094113280,"available":772844810240,"internally_reserved":0,"allocated":6647808,"data_stored":3443951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.839534"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.793748+0000","last_change":"2024-04-26T23:44:19.793748+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.793748+0000","last_undegraded":"2024-04-26T23:44:19.793748+0000","last_fullsized":"2024-04-26T23:44:19.793748+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.793084+0000","last_change":"2024-04-26T23:44:19.793084+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.793084+0000","last_undegraded":"2024-04-26T23:44:19.793084+0000","last_fullsized":"2024-04-26T23:44:19.793084+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.793729+0000","last_change":"2024-04-26T23:44:19.793729+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.793729+0000","last_undegraded":"2024-04-26T23:44:19.793729+0000","last_fullsized":"2024-04-26T23:44:19.793729+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.789194+0000","last_change":"2024-04-26T23:44:19.789194+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.789194+0000","last_undegraded":"2024-04-26T23:44:19.789194+0000","last_fullsized":"2024-04-26T23:44:19.789194+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788770+0000","last_change":"2024-04-26T23:44:19.788770+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788770+0000","last_undegraded":"2024-04-26T23:44:19.788770+0000","last_fullsized":"2024-04-26T23:44:19.788770+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.793676+0000","last_change":"2024-04-26T23:44:19.793676+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.793676+0000","last_undegraded":"2024-04-26T23:44:19.793676+0000","last_fullsized":"2024-04-26T23:44:19.793676+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.789212+0000","last_change":"2024-04-26T23:44:19.789212+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.789212+0000","last_undegraded":"2024-04-26T23:44:19.789212+0000","last_fullsized":"2024-04-26T23:44:19.789212+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788385+0000","last_change":"2024-04-26T23:44:19.788385+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788385+0000","last_undegraded":"2024-04-26T23:44:19.788385+0000","last_fullsized":"2024-04-26T23:44:19.788385+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791828+0000","last_change":"2024-04-26T23:44:19.791828+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791828+0000","last_undegraded":"2024-04-26T23:44:19.791828+0000","last_fullsized":"2024-04-26T23:44:19.791828+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791220+0000","last_change":"2024-04-26T23:44:19.791220+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791220+0000","last_undegraded":"2024-04-26T23:44:19.791220+0000","last_fullsized":"2024-04-26T23:44:19.791220+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791811+0000","last_change":"2024-04-26T23:44:19.791811+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791811+0000","last_undegraded":"2024-04-26T23:44:19.791811+0000","last_fullsized":"2024-04-26T23:44:19.791811+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788418+0000","last_change":"2024-04-26T23:44:19.788418+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788418+0000","last_undegraded":"2024-04-26T23:44:19.788418+0000","last_fullsized":"2024-04-26T23:44:19.788418+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791701+0000","last_change":"2024-04-26T23:44:19.791701+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791701+0000","last_undegraded":"2024-04-26T23:44:19.791701+0000","last_fullsized":"2024-04-26T23:44:19.791701+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.796339+0000","last_change":"2024-04-26T23:44:19.796339+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.796339+0000","last_undegraded":"2024-04-26T23:44:19.796339+0000","last_fullsized":"2024-04-26T23:44:19.796339+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788705+0000","last_change":"2024-04-26T23:44:19.788705+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788705+0000","last_undegraded":"2024-04-26T23:44:19.788705+0000","last_fullsized":"2024-04-26T23:44:19.788705+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791600+0000","last_change":"2024-04-26T23:44:19.791600+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791600+0000","last_undegraded":"2024-04-26T23:44:19.791600+0000","last_fullsized":"2024-04-26T23:44:19.791600+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791618+0000","last_change":"2024-04-26T23:44:19.791618+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791618+0000","last_undegraded":"2024-04-26T23:44:19.791618+0000","last_fullsized":"2024-04-26T23:44:19.791618+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.793626+0000","last_change":"2024-04-26T23:44:19.793626+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.793626+0000","last_undegraded":"2024-04-26T23:44:19.793626+0000","last_fullsized":"2024-04-26T23:44:19.793626+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788556+0000","last_change":"2024-04-26T23:44:19.788556+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788556+0000","last_undegraded":"2024-04-26T23:44:19.788556+0000","last_fullsized":"2024-04-26T23:44:19.788556+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791102+0000","last_change":"2024-04-26T23:44:19.791102+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791102+0000","last_undegraded":"2024-04-26T23:44:19.791102+0000","last_fullsized":"2024-04-26T23:44:19.791102+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791290+0000","last_change":"2024-04-26T23:44:19.791290+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791290+0000","last_undegraded":"2024-04-26T23:44:19.791290+0000","last_fullsized":"2024-04-26T23:44:19.791290+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.792117+0000","last_change":"2024-04-26T23:44:19.792117+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.792117+0000","last_undegraded":"2024-04-26T23:44:19.792117+0000","last_fullsized":"2024-04-26T23:44:19.792117+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788585+0000","last_change":"2024-04-26T23:44:19.788585+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788585+0000","last_undegraded":"2024-04-26T23:44:19.788585+0000","last_fullsized":"2024-04-26T23:44:19.788585+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791254+0000","last_change":"2024-04-26T23:44:19.791254+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791254+0000","last_undegraded":"2024-04-26T23:44:19.791254+0000","last_fullsized":"2024-04-26T23:44:19.791254+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791751+0000","last_change":"2024-04-26T23:44:19.791751+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791751+0000","last_undegraded":"2024-04-26T23:44:19.791751+0000","last_fullsized":"2024-04-26T23:44:19.791751+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.796369+0000","last_change":"2024-04-26T23:44:19.796369+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.796369+0000","last_undegraded":"2024-04-26T23:44:19.796369+0000","last_fullsized":"2024-04-26T23:44:19.796369+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788787+0000","last_change":"2024-04-26T23:44:19.788787+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788787+0000","last_undegraded":"2024-04-26T23:44:19.788787+0000","last_fullsized":"2024-04-26T23:44:19.788787+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791070+0000","last_change":"2024-04-26T23:44:19.791070+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791070+0000","last_undegraded":"2024-04-26T23:44:19.791070+0000","last_fullsized":"2024-04-26T23:44:19.791070+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788842+0000","last_change":"2024-04-26T23:44:19.788842+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788842+0000","last_undegraded":"2024-04-26T23:44:19.788842+0000","last_fullsized":"2024-04-26T23:44:19.788842+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791189+0000","last_change":"2024-04-26T23:44:19.791189+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791189+0000","last_undegraded":"2024-04-26T23:44:19.791189+0000","last_fullsized":"2024-04-26T23:44:19.791189+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.792017+0000","last_change":"2024-04-26T23:44:19.792017+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.792017+0000","last_undegraded":"2024-04-26T23:44:19.792017+0000","last_fullsized":"2024-04-26T23:44:19.792017+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.796330+0000","last_change":"2024-04-26T23:44:19.796330+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.796330+0000","last_undegraded":"2024-04-26T23:44:19.796330+0000","last_fullsized":"2024-04-26T23:44:19.796330+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":242,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-26T23:44:19.792924+0000","last_change":"2024-04-26T23:41:12.783987+0000","last_active":"2024-04-26T23:44:19.792924+0000","last_peered":"2024-04-26T23:44:19.792924+0000","last_clean":"2024-04-26T23:44:19.792924+0000","last_became_active":"2024-04-26T23:41:12.782901+0000","last_became_peered":"2024-04-26T23:41:12.782901+0000","last_unstale":"2024-04-26T23:44:19.792924+0000","last_undegraded":"2024-04-26T23:44:19.792924+0000","last_fullsized":"2024-04-26T23:44:19.792924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_clean_scrub_stamp":"2024-04-26T23:41:11.626255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:16.305521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1277952,"data_stored":873997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1265664,"data_stored":868180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:44:26.282 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:44:26.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.450+0000 7f0506a00640 1 Processor -- start 2024-04-26T23:44:26.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.450+0000 7f0506a00640 1 -- start start 2024-04-26T23:44:26.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.454+0000 7f0506a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0500146920 0x7f0500073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:26.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.454+0000 7f0506a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0500073010 con 0x7f050015de80 2024-04-26T23:44:26.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.454+0000 7f0506a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05000cef90 con 0x7f05000ce3e0 2024-04-26T23:44:26.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.454+0000 7f0506a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0500073280 con 0x7f0500146920 2024-04-26T23:44:26.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.454+0000 7f04f7400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f050015de80 0x7f0500146210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32886/0 (socket says 172.21.15.137:32886) 2024-04-26T23:44:26.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.454+0000 7f04f7400640 1 -- 172.21.15.137:0/3880143486 learned_addr learned my addr 172.21.15.137:0/3880143486 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:26.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.454+0000 7f0504a00640 1 --2- 172.21.15.137:0/3880143486 >> v2:172.21.15.170:3300/0 conn(0x7f0500146920 0x7f0500073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:26.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.454+0000 7f04ff400640 1 -- 172.21.15.137:0/3880143486 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3064327969 0 0) 0x7f0500073010 con 0x7f050015de80 2024-04-26T23:44:26.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.454+0000 7f04ff400640 1 -- 172.21.15.137:0/3880143486 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04e4003530 con 0x7f050015de80 2024-04-26T23:44:26.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.454+0000 7f04ff400640 1 -- 172.21.15.137:0/3880143486 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2383812947 0 0) 0x7f05000cef90 con 0x7f05000ce3e0 2024-04-26T23:44:26.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.454+0000 7f04ff400640 1 -- 172.21.15.137:0/3880143486 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0500073010 con 0x7f05000ce3e0 2024-04-26T23:44:26.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.454+0000 7f04ff400640 1 -- 172.21.15.137:0/3880143486 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1188686577 0 0) 0x7f04e4003530 con 0x7f050015de80 2024-04-26T23:44:26.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.454+0000 7f0504a00640 1 -- 172.21.15.137:0/3880143486 >> v1:172.21.15.170:6789/0 conn(0x7f05000ce3e0 legacy=0x7f05000d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:26.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.454+0000 7f0504a00640 1 -- 172.21.15.137:0/3880143486 >> v1:172.21.15.137:6789/0 conn(0x7f050015de80 legacy=0x7f0500146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:26.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.454+0000 7f0504a00640 1 -- 172.21.15.137:0/3880143486 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0500073560 con 0x7f0500146920 2024-04-26T23:44:26.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.458+0000 7f0504a00640 1 --2- 172.21.15.137:0/3880143486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0500146920 0x7f0500073d60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009dc0 tx=0x7f04f801c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90a59e808ffdf28f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:26.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.458+0000 7f04ff400640 1 -- 172.21.15.137:0/3880143486 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f80b2070 con 0x7f0500146920 2024-04-26T23:44:26.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.458+0000 7f04ff400640 1 -- 172.21.15.137:0/3880143486 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f80a56e0 con 0x7f0500146920 2024-04-26T23:44:26.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.458+0000 7f04ff400640 1 -- 172.21.15.137:0/3880143486 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e8001680 con 0x7f0500146920 2024-04-26T23:44:26.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.458+0000 7f0506a00640 1 -- 172.21.15.137:0/3880143486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0500146920 msgr2=0x7f0500073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:26.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.458+0000 7f0506a00640 1 --2- 172.21.15.137:0/3880143486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0500146920 0x7f0500073d60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009dc0 tx=0x7f04f801c840 comp rx=0 tx=0).stop 2024-04-26T23:44:26.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.458+0000 7f0506a00640 1 -- 172.21.15.137:0/3880143486 shutdown_connections 2024-04-26T23:44:26.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.458+0000 7f0506a00640 1 --2- 172.21.15.137:0/3880143486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0500146920 0x7f0500073d60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.458+0000 7f0506a00640 1 -- 172.21.15.137:0/3880143486 >> 172.21.15.137:0/3880143486 conn(0x7f050006c5d0 msgr2=0x7f050006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:26.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.458+0000 7f0506a00640 1 -- 172.21.15.137:0/3880143486 shutdown_connections 2024-04-26T23:44:26.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.458+0000 7f0506a00640 1 -- 172.21.15.137:0/3880143486 wait complete. 2024-04-26T23:44:26.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.458+0000 7f0506a00640 1 Processor -- start 2024-04-26T23:44:26.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.458+0000 7f0506a00640 1 -- start start 2024-04-26T23:44:26.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f0506a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05000ce3e0 0x7f0500158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:26.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f0506a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0500146920 0x7f05001f9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:26.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f0506a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f050015de80 0x7f050013a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:26.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f0506a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f050006f0e0 con 0x7f050015de80 2024-04-26T23:44:26.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f0506a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f050006ef60 con 0x7f0500146920 2024-04-26T23:44:26.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f0506a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f050006f260 con 0x7f05000ce3e0 2024-04-26T23:44:26.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f0504a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f050015de80 0x7f050013a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:26.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f0504a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f050015de80 0x7f050013a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45684/0 (socket says 172.21.15.137:45684) 2024-04-26T23:44:26.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f0504a00640 1 -- 172.21.15.137:0/3891893737 learned_addr learned my addr 172.21.15.137:0/3891893737 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:26.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f04f7400640 1 --2- 172.21.15.137:0/3891893737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0500146920 0x7f05001f9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:26.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f04ffe00640 1 --2- 172.21.15.137:0/3891893737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05000ce3e0 0x7f0500158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:26.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f0504a00640 1 -- 172.21.15.137:0/3891893737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05000ce3e0 msgr2=0x7f0500158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:26.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f0504a00640 1 --2- 172.21.15.137:0/3891893737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05000ce3e0 0x7f0500158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f0504a00640 1 -- 172.21.15.137:0/3891893737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0500146920 msgr2=0x7f05001f9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:26.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f0504a00640 1 --2- 172.21.15.137:0/3891893737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0500146920 0x7f05001f9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f0504a00640 1 -- 172.21.15.137:0/3891893737 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0500157930 con 0x7f050015de80 2024-04-26T23:44:26.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f0504a00640 1 --2- 172.21.15.137:0/3891893737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f050015de80 0x7f050013a770 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f04f80b0040 tx=0x7f04f80195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:26.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f04fcc00640 1 -- 172.21.15.137:0/3891893737 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f80b2070 con 0x7f050015de80 2024-04-26T23:44:26.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f04fcc00640 1 -- 172.21.15.137:0/3891893737 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f80bc070 con 0x7f050015de80 2024-04-26T23:44:26.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f04fcc00640 1 -- 172.21.15.137:0/3891893737 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f8004040 con 0x7f050015de80 2024-04-26T23:44:26.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f0506a00640 1 -- 172.21.15.137:0/3891893737 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0500157bd0 con 0x7f050015de80 2024-04-26T23:44:26.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f0506a00640 1 -- 172.21.15.137:0/3891893737 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0500158190 con 0x7f050015de80 2024-04-26T23:44:26.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f0506a00640 1 -- 172.21.15.137:0/3891893737 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f050006a4b0 con 0x7f050015de80 2024-04-26T23:44:26.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.462+0000 7f04fcc00640 1 -- 172.21.15.137:0/3891893737 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f04f80041e0 con 0x7f050015de80 2024-04-26T23:44:26.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.466+0000 7f04fcc00640 1 --2- 172.21.15.137:0/3891893737 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f04dc068380 0x7f04dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:26.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.466+0000 7f04fcc00640 1 -- 172.21.15.137:0/3891893737 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f04f8121350 con 0x7f050015de80 2024-04-26T23:44:26.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.466+0000 7f04ffe00640 1 --2- 172.21.15.137:0/3891893737 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f04dc068380 0x7f04dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:26.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.466+0000 7f04ffe00640 1 --2- 172.21.15.137:0/3891893737 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f04dc068380 0x7f04dc06a840 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f04f00011f0 tx=0x7f04f0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:26.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.470+0000 7f04fcc00640 1 -- 172.21.15.137:0/3891893737 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f04f80164a0 con 0x7f050015de80 2024-04-26T23:44:26.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.622+0000 7f0506a00640 1 -- 172.21.15.137:0/3891893737 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0500072770 con 0x7f04dc068380 2024-04-26T23:44:26.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.630+0000 7f04fcc00640 1 -- 172.21.15.137:0/3891893737 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239819 (secure 0 0 0) 0x7f0500072770 con 0x7f04dc068380 2024-04-26T23:44:26.638 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:26.640 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T23:44:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.630+0000 7f0506a00640 1 -- 172.21.15.137:0/3891893737 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f04dc068380 msgr2=0x7f04dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.630+0000 7f0506a00640 1 --2- 172.21.15.137:0/3891893737 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f04dc068380 0x7f04dc06a840 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f04f00011f0 tx=0x7f04f0009040 comp rx=0 tx=0).stop 2024-04-26T23:44:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.630+0000 7f0506a00640 1 -- 172.21.15.137:0/3891893737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f050015de80 msgr2=0x7f050013a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.630+0000 7f0506a00640 1 --2- 172.21.15.137:0/3891893737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f050015de80 0x7f050013a770 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f04f80b0040 tx=0x7f04f80195e0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.630+0000 7f0506a00640 1 -- 172.21.15.137:0/3891893737 shutdown_connections 2024-04-26T23:44:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.630+0000 7f0506a00640 1 --2- 172.21.15.137:0/3891893737 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f04dc068380 0x7f04dc06a840 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.630+0000 7f0506a00640 1 --2- 172.21.15.137:0/3891893737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f050015de80 0x7f050013a770 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.630+0000 7f0506a00640 1 --2- 172.21.15.137:0/3891893737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0500146920 0x7f05001f9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.630+0000 7f0506a00640 1 --2- 172.21.15.137:0/3891893737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05000ce3e0 0x7f0500158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.634+0000 7f0506a00640 1 -- 172.21.15.137:0/3891893737 >> 172.21.15.137:0/3891893737 conn(0x7f050006c5d0 msgr2=0x7f0500141bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:26.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.634+0000 7f0506a00640 1 -- 172.21.15.137:0/3891893737 shutdown_connections 2024-04-26T23:44:26.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.634+0000 7f0506a00640 1 -- 172.21.15.137:0/3891893737 wait complete. 2024-04-26T23:44:26.659 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-04-26T23:44:25.626802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":243460,"kb_used_data":6492,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731260,"statfs":{"total":773094113280,"available":772844810240,"internally_reserved":0,"allocated":6647808,"data_stored":3443951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.839534"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.793748+0000","last_change":"2024-04-26T23:44:19.793748+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.793748+0000","last_undegraded":"2024-04-26T23:44:19.793748+0000","last_fullsized":"2024-04-26T23:44:19.793748+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.793084+0000","last_change":"2024-04-26T23:44:19.793084+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.793084+0000","last_undegraded":"2024-04-26T23:44:19.793084+0000","last_fullsized":"2024-04-26T23:44:19.793084+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.793729+0000","last_change":"2024-04-26T23:44:19.793729+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.793729+0000","last_undegraded":"2024-04-26T23:44:19.793729+0000","last_fullsized":"2024-04-26T23:44:19.793729+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.789194+0000","last_change":"2024-04-26T23:44:19.789194+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.789194+0000","last_undegraded":"2024-04-26T23:44:19.789194+0000","last_fullsized":"2024-04-26T23:44:19.789194+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788770+0000","last_change":"2024-04-26T23:44:19.788770+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788770+0000","last_undegraded":"2024-04-26T23:44:19.788770+0000","last_fullsized":"2024-04-26T23:44:19.788770+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.793676+0000","last_change":"2024-04-26T23:44:19.793676+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.793676+0000","last_undegraded":"2024-04-26T23:44:19.793676+0000","last_fullsized":"2024-04-26T23:44:19.793676+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.789212+0000","last_change":"2024-04-26T23:44:19.789212+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.789212+0000","last_undegraded":"2024-04-26T23:44:19.789212+0000","last_fullsized":"2024-04-26T23:44:19.789212+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788385+0000","last_change":"2024-04-26T23:44:19.788385+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788385+0000","last_undegraded":"2024-04-26T23:44:19.788385+0000","last_fullsized":"2024-04-26T23:44:19.788385+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791828+0000","last_change":"2024-04-26T23:44:19.791828+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791828+0000","last_undegraded":"2024-04-26T23:44:19.791828+0000","last_fullsized":"2024-04-26T23:44:19.791828+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791220+0000","last_change":"2024-04-26T23:44:19.791220+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791220+0000","last_undegraded":"2024-04-26T23:44:19.791220+0000","last_fullsized":"2024-04-26T23:44:19.791220+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791811+0000","last_change":"2024-04-26T23:44:19.791811+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791811+0000","last_undegraded":"2024-04-26T23:44:19.791811+0000","last_fullsized":"2024-04-26T23:44:19.791811+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788418+0000","last_change":"2024-04-26T23:44:19.788418+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788418+0000","last_undegraded":"2024-04-26T23:44:19.788418+0000","last_fullsized":"2024-04-26T23:44:19.788418+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791701+0000","last_change":"2024-04-26T23:44:19.791701+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791701+0000","last_undegraded":"2024-04-26T23:44:19.791701+0000","last_fullsized":"2024-04-26T23:44:19.791701+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.796339+0000","last_change":"2024-04-26T23:44:19.796339+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.796339+0000","last_undegraded":"2024-04-26T23:44:19.796339+0000","last_fullsized":"2024-04-26T23:44:19.796339+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788705+0000","last_change":"2024-04-26T23:44:19.788705+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788705+0000","last_undegraded":"2024-04-26T23:44:19.788705+0000","last_fullsized":"2024-04-26T23:44:19.788705+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791600+0000","last_change":"2024-04-26T23:44:19.791600+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791600+0000","last_undegraded":"2024-04-26T23:44:19.791600+0000","last_fullsized":"2024-04-26T23:44:19.791600+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791618+0000","last_change":"2024-04-26T23:44:19.791618+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791618+0000","last_undegraded":"2024-04-26T23:44:19.791618+0000","last_fullsized":"2024-04-26T23:44:19.791618+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.793626+0000","last_change":"2024-04-26T23:44:19.793626+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.793626+0000","last_undegraded":"2024-04-26T23:44:19.793626+0000","last_fullsized":"2024-04-26T23:44:19.793626+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788556+0000","last_change":"2024-04-26T23:44:19.788556+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788556+0000","last_undegraded":"2024-04-26T23:44:19.788556+0000","last_fullsized":"2024-04-26T23:44:19.788556+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791102+0000","last_change":"2024-04-26T23:44:19.791102+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791102+0000","last_undegraded":"2024-04-26T23:44:19.791102+0000","last_fullsized":"2024-04-26T23:44:19.791102+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791290+0000","last_change":"2024-04-26T23:44:19.791290+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791290+0000","last_undegraded":"2024-04-26T23:44:19.791290+0000","last_fullsized":"2024-04-26T23:44:19.791290+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.792117+0000","last_change":"2024-04-26T23:44:19.792117+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.792117+0000","last_undegraded":"2024-04-26T23:44:19.792117+0000","last_fullsized":"2024-04-26T23:44:19.792117+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788585+0000","last_change":"2024-04-26T23:44:19.788585+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788585+0000","last_undegraded":"2024-04-26T23:44:19.788585+0000","last_fullsized":"2024-04-26T23:44:19.788585+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791254+0000","last_change":"2024-04-26T23:44:19.791254+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791254+0000","last_undegraded":"2024-04-26T23:44:19.791254+0000","last_fullsized":"2024-04-26T23:44:19.791254+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791751+0000","last_change":"2024-04-26T23:44:19.791751+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791751+0000","last_undegraded":"2024-04-26T23:44:19.791751+0000","last_fullsized":"2024-04-26T23:44:19.791751+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.796369+0000","last_change":"2024-04-26T23:44:19.796369+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.796369+0000","last_undegraded":"2024-04-26T23:44:19.796369+0000","last_fullsized":"2024-04-26T23:44:19.796369+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788787+0000","last_change":"2024-04-26T23:44:19.788787+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788787+0000","last_undegraded":"2024-04-26T23:44:19.788787+0000","last_fullsized":"2024-04-26T23:44:19.788787+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791070+0000","last_change":"2024-04-26T23:44:19.791070+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791070+0000","last_undegraded":"2024-04-26T23:44:19.791070+0000","last_fullsized":"2024-04-26T23:44:19.791070+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788842+0000","last_change":"2024-04-26T23:44:19.788842+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788842+0000","last_undegraded":"2024-04-26T23:44:19.788842+0000","last_fullsized":"2024-04-26T23:44:19.788842+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791189+0000","last_change":"2024-04-26T23:44:19.791189+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791189+0000","last_undegraded":"2024-04-26T23:44:19.791189+0000","last_fullsized":"2024-04-26T23:44:19.791189+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.792017+0000","last_change":"2024-04-26T23:44:19.792017+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.792017+0000","last_undegraded":"2024-04-26T23:44:19.792017+0000","last_fullsized":"2024-04-26T23:44:19.792017+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.796330+0000","last_change":"2024-04-26T23:44:19.796330+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.796330+0000","last_undegraded":"2024-04-26T23:44:19.796330+0000","last_fullsized":"2024-04-26T23:44:19.796330+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":242,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-26T23:44:19.792924+0000","last_change":"2024-04-26T23:41:12.783987+0000","last_active":"2024-04-26T23:44:19.792924+0000","last_peered":"2024-04-26T23:44:19.792924+0000","last_clean":"2024-04-26T23:44:19.792924+0000","last_became_active":"2024-04-26T23:41:12.782901+0000","last_became_peered":"2024-04-26T23:41:12.782901+0000","last_unstale":"2024-04-26T23:44:19.792924+0000","last_undegraded":"2024-04-26T23:44:19.792924+0000","last_fullsized":"2024-04-26T23:44:19.792924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_clean_scrub_stamp":"2024-04-26T23:41:11.626255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:16.305521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1277952,"data_stored":873997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1265664,"data_stored":868180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:44:26.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2024-04-26T23:44:26.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2024-04-26T23:44:26.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2024-04-26T23:44:26.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2024-04-26T23:44:26.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2024-04-26T23:44:26.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2024-04-26T23:44:26.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2024-04-26T23:44:26.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2024-04-26T23:44:26.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2024-04-26T23:44:26.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2024-04-26T23:44:26.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2024-04-26T23:44:26.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2024-04-26T23:44:26.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2024-04-26T23:44:26.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2024-04-26T23:44:26.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2024-04-26T23:44:26.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2024-04-26T23:44:26.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2024-04-26T23:44:26.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2024-04-26T23:44:26.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2024-04-26T23:44:26.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2024-04-26T23:44:26.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2024-04-26T23:44:26.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2024-04-26T23:44:26.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2024-04-26T23:44:26.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2024-04-26T23:44:26.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2024-04-26T23:44:26.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2024-04-26T23:44:26.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2024-04-26T23:44:26.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2024-04-26T23:44:26.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2024-04-26T23:44:26.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2024-04-26T23:44:26.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2024-04-26T23:44:26.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2024-04-26T23:44:26.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2024-04-26T23:44:26.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2024-04-26T23:44:26.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.793748+0000', 'last_change': '2024-04-26T23:44:19.793748+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.793748+0000', 'last_undegraded': '2024-04-26T23:44:19.793748+0000', 'last_fullsized': '2024-04-26T23:44:19.793748+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T23:44:26.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2024-04-26T23:44:26.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2024-04-26T23:44:26.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.793084+0000', 'last_change': '2024-04-26T23:44:19.793084+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.793084+0000', 'last_undegraded': '2024-04-26T23:44:19.793084+0000', 'last_fullsized': '2024-04-26T23:44:19.793084+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:44:26.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2024-04-26T23:44:26.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2024-04-26T23:44:26.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.793729+0000', 'last_change': '2024-04-26T23:44:19.793729+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.793729+0000', 'last_undegraded': '2024-04-26T23:44:19.793729+0000', 'last_fullsized': '2024-04-26T23:44:19.793729+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T23:44:26.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2024-04-26T23:44:26.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2024-04-26T23:44:26.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.789194+0000', 'last_change': '2024-04-26T23:44:19.789194+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.789194+0000', 'last_undegraded': '2024-04-26T23:44:19.789194+0000', 'last_fullsized': '2024-04-26T23:44:19.789194+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:44:26.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2024-04-26T23:44:26.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2024-04-26T23:44:26.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.788770+0000', 'last_change': '2024-04-26T23:44:19.788770+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.788770+0000', 'last_undegraded': '2024-04-26T23:44:19.788770+0000', 'last_fullsized': '2024-04-26T23:44:19.788770+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:44:26.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2024-04-26T23:44:26.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2024-04-26T23:44:26.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.793676+0000', 'last_change': '2024-04-26T23:44:19.793676+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.793676+0000', 'last_undegraded': '2024-04-26T23:44:19.793676+0000', 'last_fullsized': '2024-04-26T23:44:19.793676+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T23:44:26.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2024-04-26T23:44:26.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2024-04-26T23:44:26.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.789212+0000', 'last_change': '2024-04-26T23:44:19.789212+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.789212+0000', 'last_undegraded': '2024-04-26T23:44:19.789212+0000', 'last_fullsized': '2024-04-26T23:44:19.789212+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:44:26.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2024-04-26T23:44:26.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2024-04-26T23:44:26.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.788385+0000', 'last_change': '2024-04-26T23:44:19.788385+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.788385+0000', 'last_undegraded': '2024-04-26T23:44:19.788385+0000', 'last_fullsized': '2024-04-26T23:44:19.788385+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:44:26.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2024-04-26T23:44:26.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2024-04-26T23:44:26.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.791828+0000', 'last_change': '2024-04-26T23:44:19.791828+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.791828+0000', 'last_undegraded': '2024-04-26T23:44:19.791828+0000', 'last_fullsized': '2024-04-26T23:44:19.791828+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:44:26.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2024-04-26T23:44:26.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2024-04-26T23:44:26.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.791220+0000', 'last_change': '2024-04-26T23:44:19.791220+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.791220+0000', 'last_undegraded': '2024-04-26T23:44:19.791220+0000', 'last_fullsized': '2024-04-26T23:44:19.791220+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:44:26.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2024-04-26T23:44:26.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2024-04-26T23:44:26.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.791811+0000', 'last_change': '2024-04-26T23:44:19.791811+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.791811+0000', 'last_undegraded': '2024-04-26T23:44:19.791811+0000', 'last_fullsized': '2024-04-26T23:44:19.791811+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:44:26.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2024-04-26T23:44:26.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2024-04-26T23:44:26.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.788418+0000', 'last_change': '2024-04-26T23:44:19.788418+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.788418+0000', 'last_undegraded': '2024-04-26T23:44:19.788418+0000', 'last_fullsized': '2024-04-26T23:44:19.788418+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:44:26.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2024-04-26T23:44:26.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2024-04-26T23:44:26.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.791701+0000', 'last_change': '2024-04-26T23:44:19.791701+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.791701+0000', 'last_undegraded': '2024-04-26T23:44:19.791701+0000', 'last_fullsized': '2024-04-26T23:44:19.791701+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:44:26.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2024-04-26T23:44:26.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2024-04-26T23:44:26.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.796339+0000', 'last_change': '2024-04-26T23:44:19.796339+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.796339+0000', 'last_undegraded': '2024-04-26T23:44:19.796339+0000', 'last_fullsized': '2024-04-26T23:44:19.796339+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:44:26.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2024-04-26T23:44:26.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2024-04-26T23:44:26.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.788705+0000', 'last_change': '2024-04-26T23:44:19.788705+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.788705+0000', 'last_undegraded': '2024-04-26T23:44:19.788705+0000', 'last_fullsized': '2024-04-26T23:44:19.788705+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:44:26.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2024-04-26T23:44:26.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2024-04-26T23:44:26.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.791600+0000', 'last_change': '2024-04-26T23:44:19.791600+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.791600+0000', 'last_undegraded': '2024-04-26T23:44:19.791600+0000', 'last_fullsized': '2024-04-26T23:44:19.791600+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:44:26.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2024-04-26T23:44:26.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2024-04-26T23:44:26.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.791618+0000', 'last_change': '2024-04-26T23:44:19.791618+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.791618+0000', 'last_undegraded': '2024-04-26T23:44:19.791618+0000', 'last_fullsized': '2024-04-26T23:44:19.791618+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:44:26.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2024-04-26T23:44:26.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2024-04-26T23:44:26.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.793626+0000', 'last_change': '2024-04-26T23:44:19.793626+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.793626+0000', 'last_undegraded': '2024-04-26T23:44:19.793626+0000', 'last_fullsized': '2024-04-26T23:44:19.793626+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T23:44:26.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2024-04-26T23:44:26.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2024-04-26T23:44:26.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.788556+0000', 'last_change': '2024-04-26T23:44:19.788556+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.788556+0000', 'last_undegraded': '2024-04-26T23:44:19.788556+0000', 'last_fullsized': '2024-04-26T23:44:19.788556+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:44:26.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2024-04-26T23:44:26.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2024-04-26T23:44:26.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.791102+0000', 'last_change': '2024-04-26T23:44:19.791102+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.791102+0000', 'last_undegraded': '2024-04-26T23:44:19.791102+0000', 'last_fullsized': '2024-04-26T23:44:19.791102+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T23:44:26.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2024-04-26T23:44:26.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2024-04-26T23:44:26.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.791290+0000', 'last_change': '2024-04-26T23:44:19.791290+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.791290+0000', 'last_undegraded': '2024-04-26T23:44:19.791290+0000', 'last_fullsized': '2024-04-26T23:44:19.791290+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:44:26.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2024-04-26T23:44:26.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2024-04-26T23:44:26.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.792117+0000', 'last_change': '2024-04-26T23:44:19.792117+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.792117+0000', 'last_undegraded': '2024-04-26T23:44:19.792117+0000', 'last_fullsized': '2024-04-26T23:44:19.792117+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T23:44:26.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2024-04-26T23:44:26.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2024-04-26T23:44:26.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.788585+0000', 'last_change': '2024-04-26T23:44:19.788585+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.788585+0000', 'last_undegraded': '2024-04-26T23:44:19.788585+0000', 'last_fullsized': '2024-04-26T23:44:19.788585+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:44:26.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2024-04-26T23:44:26.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2024-04-26T23:44:26.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.791254+0000', 'last_change': '2024-04-26T23:44:19.791254+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.791254+0000', 'last_undegraded': '2024-04-26T23:44:19.791254+0000', 'last_fullsized': '2024-04-26T23:44:19.791254+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T23:44:26.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2024-04-26T23:44:26.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2024-04-26T23:44:26.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.791751+0000', 'last_change': '2024-04-26T23:44:19.791751+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.791751+0000', 'last_undegraded': '2024-04-26T23:44:19.791751+0000', 'last_fullsized': '2024-04-26T23:44:19.791751+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T23:44:26.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2024-04-26T23:44:26.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2024-04-26T23:44:26.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.796369+0000', 'last_change': '2024-04-26T23:44:19.796369+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.796369+0000', 'last_undegraded': '2024-04-26T23:44:19.796369+0000', 'last_fullsized': '2024-04-26T23:44:19.796369+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:44:26.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2024-04-26T23:44:26.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2024-04-26T23:44:26.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.788787+0000', 'last_change': '2024-04-26T23:44:19.788787+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.788787+0000', 'last_undegraded': '2024-04-26T23:44:19.788787+0000', 'last_fullsized': '2024-04-26T23:44:19.788787+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:44:26.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2024-04-26T23:44:26.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2024-04-26T23:44:26.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.791070+0000', 'last_change': '2024-04-26T23:44:19.791070+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.791070+0000', 'last_undegraded': '2024-04-26T23:44:19.791070+0000', 'last_fullsized': '2024-04-26T23:44:19.791070+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T23:44:26.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2024-04-26T23:44:26.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2024-04-26T23:44:26.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.788842+0000', 'last_change': '2024-04-26T23:44:19.788842+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.788842+0000', 'last_undegraded': '2024-04-26T23:44:19.788842+0000', 'last_fullsized': '2024-04-26T23:44:19.788842+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:44:26.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2024-04-26T23:44:26.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2024-04-26T23:44:26.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.791189+0000', 'last_change': '2024-04-26T23:44:19.791189+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.791189+0000', 'last_undegraded': '2024-04-26T23:44:19.791189+0000', 'last_fullsized': '2024-04-26T23:44:19.791189+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T23:44:26.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2024-04-26T23:44:26.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2024-04-26T23:44:26.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.792017+0000', 'last_change': '2024-04-26T23:44:19.792017+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.792017+0000', 'last_undegraded': '2024-04-26T23:44:19.792017+0000', 'last_fullsized': '2024-04-26T23:44:19.792017+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:44:26.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2024-04-26T23:44:26.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:44:20.784420+0000', 'last_change': '2024-04-26T23:44:20.784420+0000', 'last_active': '2024-04-26T23:44:20.784420+0000', 'last_peered': '2024-04-26T23:44:20.784420+0000', 'last_clean': '2024-04-26T23:44:20.784420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:20.784420+0000', 'last_undegraded': '2024-04-26T23:44:20.784420+0000', 'last_fullsized': '2024-04-26T23:44:20.784420+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:20.784420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:44:26.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2024-04-26T23:44:26.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:44:19.796330+0000', 'last_change': '2024-04-26T23:44:19.796330+0000', 'last_active': '2024-04-26T23:44:19.776965+0000', 'last_peered': '2024-04-26T23:44:19.776965+0000', 'last_clean': '2024-04-26T23:44:19.776965+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:44:19.796330+0000', 'last_undegraded': '2024-04-26T23:44:19.796330+0000', 'last_fullsized': '2024-04-26T23:44:19.796330+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'last_clean_scrub_stamp': '2024-04-26T23:44:19.776965+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:44:26.685 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T23:44:26.783 INFO:tasks.ceph.mds.b.smithi170.stderr:2024-04-26T23:44:26.779+0000 7f0c5ec00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:44:26.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.834+0000 7fbe55000640 1 Processor -- start 2024-04-26T23:44:26.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.834+0000 7fbe55000640 1 -- start start 2024-04-26T23:44:26.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.834+0000 7fbe55000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbe5015d030 0x7fbe500b5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:26.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.834+0000 7fbe55000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe5006d410 0x7fbe5006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:26.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.834+0000 7fbe55000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe5015d410 con 0x7fbe500b4d50 2024-04-26T23:44:26.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.834+0000 7fbe55000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fbe500b0cb0 con 0x7fbe5015d030 2024-04-26T23:44:26.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.834+0000 7fbe55000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbe500b0f90 con 0x7fbe5006d410 2024-04-26T23:44:26.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.834+0000 7fbe47e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fbe500b4d50 0x7fbe500aeda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32888/0 (socket says 172.21.15.137:32888) 2024-04-26T23:44:26.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.834+0000 7fbe47e00640 1 -- 172.21.15.137:0/1503241048 learned_addr learned my addr 172.21.15.137:0/1503241048 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:26.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.838+0000 7fbe4de00640 1 --2- 172.21.15.137:0/1503241048 >> v2:172.21.15.170:3300/0 conn(0x7fbe5015d030 0x7fbe500b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:26.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.838+0000 7fbe4e800640 1 --2- 172.21.15.137:0/1503241048 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe5006d410 0x7fbe5006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:26.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.838+0000 7fbe4d400640 1 -- 172.21.15.137:0/1503241048 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1138497889 0 0) 0x7fbe5015d410 con 0x7fbe500b4d50 2024-04-26T23:44:26.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.838+0000 7fbe4d400640 1 -- 172.21.15.137:0/1503241048 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe34003530 con 0x7fbe500b4d50 2024-04-26T23:44:26.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.838+0000 7fbe4e800640 1 -- 172.21.15.137:0/1503241048 >> v2:172.21.15.170:3300/0 conn(0x7fbe5015d030 msgr2=0x7fbe500b5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:26.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.838+0000 7fbe4e800640 1 --2- 172.21.15.137:0/1503241048 >> v2:172.21.15.170:3300/0 conn(0x7fbe5015d030 0x7fbe500b5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.838+0000 7fbe4e800640 1 -- 172.21.15.137:0/1503241048 >> v1:172.21.15.137:6789/0 conn(0x7fbe500b4d50 legacy=0x7fbe500aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:26.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.838+0000 7fbe4d400640 1 -- 172.21.15.137:0/1503241048 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1286257628 0 0) 0x7fbe34003530 con 0x7fbe500b4d50 2024-04-26T23:44:26.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.838+0000 7fbe4e800640 1 -- 172.21.15.137:0/1503241048 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe500b1270 con 0x7fbe5006d410 2024-04-26T23:44:26.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.838+0000 7fbe4de00640 1 --2- 172.21.15.137:0/1503241048 >> v2:172.21.15.170:3300/0 conn(0x7fbe5015d030 0x7fbe500b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:44:26.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.838+0000 7fbe4e800640 1 --2- 172.21.15.137:0/1503241048 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe5006d410 0x7fbe5006d8a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe48009d90 tx=0x7fbe4801c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=560460ed1adeaa56 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:26.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.838+0000 7fbe4d400640 1 -- 172.21.15.137:0/1503241048 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe480b2070 con 0x7fbe5006d410 2024-04-26T23:44:26.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.838+0000 7fbe4d400640 1 -- 172.21.15.137:0/1503241048 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe480a55a0 con 0x7fbe5006d410 2024-04-26T23:44:26.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.838+0000 7fbe4d400640 1 -- 172.21.15.137:0/1503241048 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe38001680 con 0x7fbe5006d410 2024-04-26T23:44:26.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.842+0000 7fbe55000640 1 -- 172.21.15.137:0/1503241048 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe5006d410 msgr2=0x7fbe5006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:26.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.842+0000 7fbe55000640 1 --2- 172.21.15.137:0/1503241048 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe5006d410 0x7fbe5006d8a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe48009d90 tx=0x7fbe4801c890 comp rx=0 tx=0).stop 2024-04-26T23:44:26.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.842+0000 7fbe55000640 1 -- 172.21.15.137:0/1503241048 shutdown_connections 2024-04-26T23:44:26.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.842+0000 7fbe55000640 1 --2- 172.21.15.137:0/1503241048 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe5006d410 0x7fbe5006d8a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.842+0000 7fbe55000640 1 --2- 172.21.15.137:0/1503241048 >> v2:172.21.15.170:3300/0 conn(0x7fbe5015d030 0x7fbe500b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.842+0000 7fbe55000640 1 -- 172.21.15.137:0/1503241048 >> 172.21.15.137:0/1503241048 conn(0x7fbe50073180 msgr2=0x7fbe50073560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.842+0000 7fbe55000640 1 -- 172.21.15.137:0/1503241048 shutdown_connections 2024-04-26T23:44:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.842+0000 7fbe55000640 1 -- 172.21.15.137:0/1503241048 wait complete. 2024-04-26T23:44:26.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.842+0000 7fbe55000640 1 Processor -- start 2024-04-26T23:44:26.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.842+0000 7fbe55000640 1 -- start start 2024-04-26T23:44:26.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.842+0000 7fbe55000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe5006d410 0x7fbe50148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:26.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.842+0000 7fbe55000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe500b4d50 0x7fbe5014fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:26.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.842+0000 7fbe55000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe5015d030 0x7fbe5006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:26.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.842+0000 7fbe55000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbe50161910 con 0x7fbe5006d410 2024-04-26T23:44:26.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.842+0000 7fbe55000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbe50161790 con 0x7fbe5015d030 2024-04-26T23:44:26.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.842+0000 7fbe55000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbe50161a90 con 0x7fbe500b4d50 2024-04-26T23:44:26.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.842+0000 7fbe4de00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe5006d410 0x7fbe50148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:26.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.842+0000 7fbe4de00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe5006d410 0x7fbe50148ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45696/0 (socket says 172.21.15.137:45696) 2024-04-26T23:44:26.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.842+0000 7fbe4de00640 1 -- 172.21.15.137:0/309287998 learned_addr learned my addr 172.21.15.137:0/309287998 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:26.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.846+0000 7fbe47e00640 1 --2- 172.21.15.137:0/309287998 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe500b4d50 0x7fbe5014fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:26.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.846+0000 7fbe4e800640 1 --2- 172.21.15.137:0/309287998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe5015d030 0x7fbe5006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:26.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.846+0000 7fbe4de00640 1 -- 172.21.15.137:0/309287998 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe500b4d50 msgr2=0x7fbe5014fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:26.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.846+0000 7fbe4de00640 1 --2- 172.21.15.137:0/309287998 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe500b4d50 0x7fbe5014fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.846+0000 7fbe4de00640 1 -- 172.21.15.137:0/309287998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe5015d030 msgr2=0x7fbe5006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:26.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.846+0000 7fbe4de00640 1 --2- 172.21.15.137:0/309287998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe5015d030 0x7fbe5006ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:26.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.846+0000 7fbe4de00640 1 -- 172.21.15.137:0/309287998 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe5015acd0 con 0x7fbe5006d410 2024-04-26T23:44:26.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.846+0000 7fbe4de00640 1 --2- 172.21.15.137:0/309287998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe5006d410 0x7fbe50148ac0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000e9b0 tx=0x7fbe4000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:26.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.846+0000 7fbe46000640 1 -- 172.21.15.137:0/309287998 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe40017070 con 0x7fbe5006d410 2024-04-26T23:44:26.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.846+0000 7fbe46000640 1 -- 172.21.15.137:0/309287998 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe4000ca00 con 0x7fbe5006d410 2024-04-26T23:44:26.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.846+0000 7fbe55000640 1 -- 172.21.15.137:0/309287998 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe5015afb0 con 0x7fbe5006d410 2024-04-26T23:44:26.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.846+0000 7fbe46000640 1 -- 172.21.15.137:0/309287998 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4000cdd0 con 0x7fbe5006d410 2024-04-26T23:44:26.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.846+0000 7fbe55000640 1 -- 172.21.15.137:0/309287998 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe5015b570 con 0x7fbe5006d410 2024-04-26T23:44:26.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.846+0000 7fbe55000640 1 -- 172.21.15.137:0/309287998 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe5006a4b0 con 0x7fbe5006d410 2024-04-26T23:44:26.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.846+0000 7fbe46000640 1 -- 172.21.15.137:0/309287998 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbe4001a070 con 0x7fbe5006d410 2024-04-26T23:44:26.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.846+0000 7fbe46000640 1 --2- 172.21.15.137:0/309287998 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbe2c068380 0x7fbe2c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:26.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.846+0000 7fbe46000640 1 -- 172.21.15.137:0/309287998 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fbe40086c10 con 0x7fbe5006d410 2024-04-26T23:44:26.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.846+0000 7fbe47e00640 1 --2- 172.21.15.137:0/309287998 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbe2c068380 0x7fbe2c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:26.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.850+0000 7fbe47e00640 1 --2- 172.21.15.137:0/309287998 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbe2c068380 0x7fbe2c06a840 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbe50156750 tx=0x7fbe38009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:26.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:26.850+0000 7fbe46000640 1 -- 172.21.15.137:0/309287998 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbe400571c0 con 0x7fbe5006d410 2024-04-26T23:44:27.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.062+0000 7fbe55000640 1 -- 172.21.15.137:0/309287998 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fbe50073f10 con 0x7fbe5006d410 2024-04-26T23:44:27.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.066+0000 7fbe46000640 1 -- 172.21.15.137:0/309287998 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1399 (secure 0 0 0) 0x7fbe40056ac0 con 0x7fbe5006d410 2024-04-26T23:44:27.072 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:27.072 INFO:teuthology.orchestra.run.smithi137.stdout:{"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":207,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":60,"num_osds":8,"num_up_osds":8,"osd_up_since":1714174870,"num_in_osds":8,"osd_in_since":1714174861,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":249303040,"bytes_avail":772844810240,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":37,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"b","status":"up:active","gid":6381}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-26T23:44:09.624179+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-26T23:44:27.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.066+0000 7fbe55000640 1 -- 172.21.15.137:0/309287998 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbe2c068380 msgr2=0x7fbe2c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:27.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.066+0000 7fbe55000640 1 --2- 172.21.15.137:0/309287998 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbe2c068380 0x7fbe2c06a840 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbe50156750 tx=0x7fbe38009040 comp rx=0 tx=0).stop 2024-04-26T23:44:27.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.066+0000 7fbe55000640 1 -- 172.21.15.137:0/309287998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe5006d410 msgr2=0x7fbe50148ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:27.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.066+0000 7fbe55000640 1 --2- 172.21.15.137:0/309287998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe5006d410 0x7fbe50148ac0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000e9b0 tx=0x7fbe4000ee70 comp rx=0 tx=0).stop 2024-04-26T23:44:27.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.066+0000 7fbe55000640 1 -- 172.21.15.137:0/309287998 shutdown_connections 2024-04-26T23:44:27.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.066+0000 7fbe55000640 1 --2- 172.21.15.137:0/309287998 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbe2c068380 0x7fbe2c06a840 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:27.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.066+0000 7fbe55000640 1 --2- 172.21.15.137:0/309287998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe5015d030 0x7fbe5006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:27.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.066+0000 7fbe55000640 1 --2- 172.21.15.137:0/309287998 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe500b4d50 0x7fbe5014fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:27.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.066+0000 7fbe55000640 1 --2- 172.21.15.137:0/309287998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe5006d410 0x7fbe50148ac0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:27.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.066+0000 7fbe55000640 1 -- 172.21.15.137:0/309287998 >> 172.21.15.137:0/309287998 conn(0x7fbe50073180 msgr2=0x7fbe50155c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:27.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.066+0000 7fbe55000640 1 -- 172.21.15.137:0/309287998 shutdown_connections 2024-04-26T23:44:27.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.066+0000 7fbe55000640 1 -- 172.21.15.137:0/309287998 wait complete. 2024-04-26T23:44:27.093 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-26T23:44:27.093 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:44:27.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6f3a00640 1 Processor -- start 2024-04-26T23:44:27.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6f3a00640 1 -- start start 2024-04-26T23:44:27.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6f3a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe6ec15f3d0 0x7fe6ec0d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:27.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6f3a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec160240 con 0x7fe6ec0b4100 2024-04-26T23:44:27.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6f3a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec160520 con 0x7fe6ec0d2d80 2024-04-26T23:44:27.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6f3a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe6ec0b2960 con 0x7fe6ec15f3d0 2024-04-26T23:44:27.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6e3e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fe6ec0b4100 0x7fe6ec15f7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32894/0 (socket says 172.21.15.137:32894) 2024-04-26T23:44:27.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6e3e00640 1 -- 172.21.15.137:0/2629009752 learned_addr learned my addr 172.21.15.137:0/2629009752 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:27.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6f1000640 1 --2- 172.21.15.137:0/2629009752 >> v2:172.21.15.170:3300/0 conn(0x7fe6ec15f3d0 0x7fe6ec0d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:27.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6ebe00640 1 -- 172.21.15.137:0/2629009752 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 479721509 0 0) 0x7fe6ec160240 con 0x7fe6ec0b4100 2024-04-26T23:44:27.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6ebe00640 1 -- 172.21.15.137:0/2629009752 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6d0003530 con 0x7fe6ec0b4100 2024-04-26T23:44:27.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6ebe00640 1 -- 172.21.15.137:0/2629009752 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3488702463 0 0) 0x7fe6d0003530 con 0x7fe6ec0b4100 2024-04-26T23:44:27.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6ebe00640 1 -- 172.21.15.137:0/2629009752 >> v2:172.21.15.170:3300/0 conn(0x7fe6ec15f3d0 msgr2=0x7fe6ec0d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:27.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6ebe00640 1 --2- 172.21.15.137:0/2629009752 >> v2:172.21.15.170:3300/0 conn(0x7fe6ec15f3d0 0x7fe6ec0d1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:27.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6ebe00640 1 -- 172.21.15.137:0/2629009752 >> v1:172.21.15.170:6789/0 conn(0x7fe6ec0d2d80 legacy=0x7fe6ec0d3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:27.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6ebe00640 1 -- 172.21.15.137:0/2629009752 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec160800 con 0x7fe6ec0b4100 2024-04-26T23:44:27.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6ebe00640 1 -- 172.21.15.137:0/2629009752 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fe6d4001680 con 0x7fe6ec0b4100 2024-04-26T23:44:27.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6ebe00640 1 -- 172.21.15.137:0/2629009752 >> v1:172.21.15.137:6789/0 conn(0x7fe6ec0b4100 legacy=0x7fe6ec15f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:27.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6ebe00640 1 --2- 172.21.15.137:0/2629009752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6d00039c0 0x7fe6d0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:27.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6ebe00640 1 --2- 172.21.15.137:0/2629009752 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6d00043c0 0x7fe6d0004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:27.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6ebe00640 1 --2- 172.21.15.137:0/2629009752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6d0005090 0x7fe6d000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:27.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6ebe00640 1 -- 172.21.15.137:0/2629009752 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec0b2960 con 0x7fe6d00039c0 2024-04-26T23:44:27.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6ebe00640 1 -- 172.21.15.137:0/2629009752 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d000bff0 con 0x7fe6d0005090 2024-04-26T23:44:27.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6ebe00640 1 -- 172.21.15.137:0/2629009752 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe6d000c1f0 con 0x7fe6d00043c0 2024-04-26T23:44:27.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6f1000640 1 --2- 172.21.15.137:0/2629009752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6d00039c0 0x7fe6d0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:27.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6f1a00640 1 --2- 172.21.15.137:0/2629009752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6d0005090 0x7fe6d000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:27.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6e3e00640 1 --2- 172.21.15.137:0/2629009752 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6d00043c0 0x7fe6d0004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:27.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6f1000640 1 -- 172.21.15.137:0/2629009752 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6d00043c0 msgr2=0x7fe6d0004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:27.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6f1000640 1 --2- 172.21.15.137:0/2629009752 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6d00043c0 0x7fe6d0004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:27.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6f1000640 1 -- 172.21.15.137:0/2629009752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6d0005090 msgr2=0x7fe6d000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:27.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6f1000640 1 --2- 172.21.15.137:0/2629009752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6d0005090 0x7fe6d000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:27.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6f1000640 1 -- 172.21.15.137:0/2629009752 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d0003530 con 0x7fe6d00039c0 2024-04-26T23:44:27.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.222+0000 7fe6f1a00640 1 -- 172.21.15.137:0/2629009752 reap_dead start 2024-04-26T23:44:27.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.226+0000 7fe6f1000640 1 --2- 172.21.15.137:0/2629009752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6d00039c0 0x7fe6d0003da0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009ae0 tx=0x7fe6dc01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69304aa91e2bc3fe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:27.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.226+0000 7fe6ebe00640 1 -- 172.21.15.137:0/2629009752 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0b2070 con 0x7fe6d00039c0 2024-04-26T23:44:27.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.226+0000 7fe6ebe00640 1 -- 172.21.15.137:0/2629009752 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6dc0a5660 con 0x7fe6d00039c0 2024-04-26T23:44:27.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.226+0000 7fe6ebe00640 1 -- 172.21.15.137:0/2629009752 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0096b0 con 0x7fe6d00039c0 2024-04-26T23:44:27.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.226+0000 7fe6f3a00640 1 -- 172.21.15.137:0/2629009752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6d00039c0 msgr2=0x7fe6d0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:27.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.226+0000 7fe6f3a00640 1 --2- 172.21.15.137:0/2629009752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6d00039c0 0x7fe6d0003da0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009ae0 tx=0x7fe6dc01ca70 comp rx=0 tx=0).stop 2024-04-26T23:44:27.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.226+0000 7fe6f3a00640 1 -- 172.21.15.137:0/2629009752 shutdown_connections 2024-04-26T23:44:27.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.226+0000 7fe6f3a00640 1 --2- 172.21.15.137:0/2629009752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6d00039c0 0x7fe6d0003da0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:27.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.226+0000 7fe6f3a00640 1 -- 172.21.15.137:0/2629009752 >> 172.21.15.137:0/2629009752 conn(0x7fe6ec09ba60 msgr2=0x7fe6ec09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:27.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.226+0000 7fe6f3a00640 1 -- 172.21.15.137:0/2629009752 shutdown_connections 2024-04-26T23:44:27.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.226+0000 7fe6f3a00640 1 -- 172.21.15.137:0/2629009752 wait complete. 2024-04-26T23:44:27.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6f3a00640 1 Processor -- start 2024-04-26T23:44:27.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6f3a00640 1 -- start start 2024-04-26T23:44:27.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6f3a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6d00039c0 0x7fe6ec1571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:27.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6f3a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6ec0c93e0 0x7fe6ec155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:27.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6f3a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec0cf840 0x7fe6ec0cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:27.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6f3a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec0d13c0 con 0x7fe6ec0cf840 2024-04-26T23:44:27.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6f3a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec0d1240 con 0x7fe6d00039c0 2024-04-26T23:44:27.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6f3a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe6ec0d3180 con 0x7fe6ec0c93e0 2024-04-26T23:44:27.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6f1a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec0cf840 0x7fe6ec0cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:27.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6f1000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6d00039c0 0x7fe6ec1571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:27.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6f1000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6d00039c0 0x7fe6ec1571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:42044/0 (socket says 172.21.15.137:42044) 2024-04-26T23:44:27.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6f1000640 1 -- 172.21.15.137:0/2090191939 learned_addr learned my addr 172.21.15.137:0/2090191939 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:27.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6e3e00640 1 --2- 172.21.15.137:0/2090191939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6ec0c93e0 0x7fe6ec155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:27.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6f1000640 1 -- 172.21.15.137:0/2090191939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6ec0c93e0 msgr2=0x7fe6ec155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:27.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6f1000640 1 --2- 172.21.15.137:0/2090191939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6ec0c93e0 0x7fe6ec155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:27.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6f1000640 1 -- 172.21.15.137:0/2090191939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec0cf840 msgr2=0x7fe6ec0cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:27.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6f1000640 1 --2- 172.21.15.137:0/2090191939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec0cf840 0x7fe6ec0cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:27.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6f1000640 1 -- 172.21.15.137:0/2090191939 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec1596b0 con 0x7fe6d00039c0 2024-04-26T23:44:27.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6f1a00640 1 --2- 172.21.15.137:0/2090191939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec0cf840 0x7fe6ec0cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:44:27.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6f1000640 1 --2- 172.21.15.137:0/2090191939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6d00039c0 0x7fe6ec1571f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc01c8a0 tx=0x7fe6dc019810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:27.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6e9600640 1 -- 172.21.15.137:0/2090191939 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0b2040 con 0x7fe6d00039c0 2024-04-26T23:44:27.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6e9600640 1 -- 172.21.15.137:0/2090191939 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6dc004020 con 0x7fe6d00039c0 2024-04-26T23:44:27.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6e9600640 1 -- 172.21.15.137:0/2090191939 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc004410 con 0x7fe6d00039c0 2024-04-26T23:44:27.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6f3a00640 1 -- 172.21.15.137:0/2090191939 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ec159990 con 0x7fe6d00039c0 2024-04-26T23:44:27.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.230+0000 7fe6f3a00640 1 -- 172.21.15.137:0/2090191939 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6ec159f50 con 0x7fe6d00039c0 2024-04-26T23:44:27.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.234+0000 7fe6f3a00640 1 -- 172.21.15.137:0/2090191939 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6ec06a4b0 con 0x7fe6d00039c0 2024-04-26T23:44:27.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.234+0000 7fe6e9600640 1 -- 172.21.15.137:0/2090191939 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe6dc0bf030 con 0x7fe6d00039c0 2024-04-26T23:44:27.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.234+0000 7fe6e9600640 1 --2- 172.21.15.137:0/2090191939 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6c8068380 0x7fe6c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:27.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.234+0000 7fe6e9600640 1 -- 172.21.15.137:0/2090191939 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fe6dc1207f0 con 0x7fe6d00039c0 2024-04-26T23:44:27.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.234+0000 7fe6e3e00640 1 --2- 172.21.15.137:0/2090191939 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6c8068380 0x7fe6c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:27.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.234+0000 7fe6e3e00640 1 --2- 172.21.15.137:0/2090191939 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6c8068380 0x7fe6c806a840 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4001ec0 tx=0x7fe6d4007040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:27.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.238+0000 7fe6e9600640 1 -- 172.21.15.137:0/2090191939 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe6dc0c6060 con 0x7fe6d00039c0 2024-04-26T23:44:27.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.390+0000 7fe6f3a00640 1 -- 172.21.15.137:0/2090191939 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6ec0b24f0 con 0x7fe6c8068380 2024-04-26T23:44:27.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.398+0000 7fe6e9600640 1 -- 172.21.15.137:0/2090191939 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239819 (secure 0 0 0) 0x7fe6ec0b24f0 con 0x7fe6c8068380 2024-04-26T23:44:27.406 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:27.408 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T23:44:27.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.402+0000 7fe6f3a00640 1 -- 172.21.15.137:0/2090191939 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6c8068380 msgr2=0x7fe6c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:27.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.402+0000 7fe6f3a00640 1 --2- 172.21.15.137:0/2090191939 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6c8068380 0x7fe6c806a840 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4001ec0 tx=0x7fe6d4007040 comp rx=0 tx=0).stop 2024-04-26T23:44:27.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.402+0000 7fe6f3a00640 1 -- 172.21.15.137:0/2090191939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6d00039c0 msgr2=0x7fe6ec1571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:27.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.402+0000 7fe6f3a00640 1 --2- 172.21.15.137:0/2090191939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6d00039c0 0x7fe6ec1571f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc01c8a0 tx=0x7fe6dc019810 comp rx=0 tx=0).stop 2024-04-26T23:44:27.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.402+0000 7fe6f3a00640 1 -- 172.21.15.137:0/2090191939 shutdown_connections 2024-04-26T23:44:27.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.402+0000 7fe6f3a00640 1 --2- 172.21.15.137:0/2090191939 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe6c8068380 0x7fe6c806a840 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:27.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.402+0000 7fe6f3a00640 1 --2- 172.21.15.137:0/2090191939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec0cf840 0x7fe6ec0cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:27.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.402+0000 7fe6f3a00640 1 --2- 172.21.15.137:0/2090191939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6ec0c93e0 0x7fe6ec155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:27.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.402+0000 7fe6f3a00640 1 --2- 172.21.15.137:0/2090191939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6d00039c0 0x7fe6ec1571f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:27.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.402+0000 7fe6f3a00640 1 -- 172.21.15.137:0/2090191939 >> 172.21.15.137:0/2090191939 conn(0x7fe6ec09ba60 msgr2=0x7fe6ec0b5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:27.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.402+0000 7fe6f3a00640 1 -- 172.21.15.137:0/2090191939 shutdown_connections 2024-04-26T23:44:27.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:27.402+0000 7fe6f3a00640 1 -- 172.21.15.137:0/2090191939 wait complete. 2024-04-26T23:44:27.426 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-04-26T23:44:25.626802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":243460,"kb_used_data":6492,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731260,"statfs":{"total":773094113280,"available":772844810240,"internally_reserved":0,"allocated":6647808,"data_stored":3443951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.839534"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.793748+0000","last_change":"2024-04-26T23:44:19.793748+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.793748+0000","last_undegraded":"2024-04-26T23:44:19.793748+0000","last_fullsized":"2024-04-26T23:44:19.793748+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.793084+0000","last_change":"2024-04-26T23:44:19.793084+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.793084+0000","last_undegraded":"2024-04-26T23:44:19.793084+0000","last_fullsized":"2024-04-26T23:44:19.793084+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.793729+0000","last_change":"2024-04-26T23:44:19.793729+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.793729+0000","last_undegraded":"2024-04-26T23:44:19.793729+0000","last_fullsized":"2024-04-26T23:44:19.793729+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.789194+0000","last_change":"2024-04-26T23:44:19.789194+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.789194+0000","last_undegraded":"2024-04-26T23:44:19.789194+0000","last_fullsized":"2024-04-26T23:44:19.789194+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788770+0000","last_change":"2024-04-26T23:44:19.788770+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788770+0000","last_undegraded":"2024-04-26T23:44:19.788770+0000","last_fullsized":"2024-04-26T23:44:19.788770+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.793676+0000","last_change":"2024-04-26T23:44:19.793676+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.793676+0000","last_undegraded":"2024-04-26T23:44:19.793676+0000","last_fullsized":"2024-04-26T23:44:19.793676+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.789212+0000","last_change":"2024-04-26T23:44:19.789212+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.789212+0000","last_undegraded":"2024-04-26T23:44:19.789212+0000","last_fullsized":"2024-04-26T23:44:19.789212+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788385+0000","last_change":"2024-04-26T23:44:19.788385+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788385+0000","last_undegraded":"2024-04-26T23:44:19.788385+0000","last_fullsized":"2024-04-26T23:44:19.788385+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791828+0000","last_change":"2024-04-26T23:44:19.791828+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791828+0000","last_undegraded":"2024-04-26T23:44:19.791828+0000","last_fullsized":"2024-04-26T23:44:19.791828+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791220+0000","last_change":"2024-04-26T23:44:19.791220+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791220+0000","last_undegraded":"2024-04-26T23:44:19.791220+0000","last_fullsized":"2024-04-26T23:44:19.791220+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791811+0000","last_change":"2024-04-26T23:44:19.791811+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791811+0000","last_undegraded":"2024-04-26T23:44:19.791811+0000","last_fullsized":"2024-04-26T23:44:19.791811+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788418+0000","last_change":"2024-04-26T23:44:19.788418+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788418+0000","last_undegraded":"2024-04-26T23:44:19.788418+0000","last_fullsized":"2024-04-26T23:44:19.788418+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791701+0000","last_change":"2024-04-26T23:44:19.791701+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791701+0000","last_undegraded":"2024-04-26T23:44:19.791701+0000","last_fullsized":"2024-04-26T23:44:19.791701+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.796339+0000","last_change":"2024-04-26T23:44:19.796339+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.796339+0000","last_undegraded":"2024-04-26T23:44:19.796339+0000","last_fullsized":"2024-04-26T23:44:19.796339+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788705+0000","last_change":"2024-04-26T23:44:19.788705+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788705+0000","last_undegraded":"2024-04-26T23:44:19.788705+0000","last_fullsized":"2024-04-26T23:44:19.788705+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791600+0000","last_change":"2024-04-26T23:44:19.791600+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791600+0000","last_undegraded":"2024-04-26T23:44:19.791600+0000","last_fullsized":"2024-04-26T23:44:19.791600+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791618+0000","last_change":"2024-04-26T23:44:19.791618+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791618+0000","last_undegraded":"2024-04-26T23:44:19.791618+0000","last_fullsized":"2024-04-26T23:44:19.791618+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.793626+0000","last_change":"2024-04-26T23:44:19.793626+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.793626+0000","last_undegraded":"2024-04-26T23:44:19.793626+0000","last_fullsized":"2024-04-26T23:44:19.793626+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788556+0000","last_change":"2024-04-26T23:44:19.788556+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788556+0000","last_undegraded":"2024-04-26T23:44:19.788556+0000","last_fullsized":"2024-04-26T23:44:19.788556+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791102+0000","last_change":"2024-04-26T23:44:19.791102+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791102+0000","last_undegraded":"2024-04-26T23:44:19.791102+0000","last_fullsized":"2024-04-26T23:44:19.791102+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791290+0000","last_change":"2024-04-26T23:44:19.791290+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791290+0000","last_undegraded":"2024-04-26T23:44:19.791290+0000","last_fullsized":"2024-04-26T23:44:19.791290+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.792117+0000","last_change":"2024-04-26T23:44:19.792117+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.792117+0000","last_undegraded":"2024-04-26T23:44:19.792117+0000","last_fullsized":"2024-04-26T23:44:19.792117+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788585+0000","last_change":"2024-04-26T23:44:19.788585+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788585+0000","last_undegraded":"2024-04-26T23:44:19.788585+0000","last_fullsized":"2024-04-26T23:44:19.788585+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791254+0000","last_change":"2024-04-26T23:44:19.791254+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791254+0000","last_undegraded":"2024-04-26T23:44:19.791254+0000","last_fullsized":"2024-04-26T23:44:19.791254+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791751+0000","last_change":"2024-04-26T23:44:19.791751+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791751+0000","last_undegraded":"2024-04-26T23:44:19.791751+0000","last_fullsized":"2024-04-26T23:44:19.791751+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.796369+0000","last_change":"2024-04-26T23:44:19.796369+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.796369+0000","last_undegraded":"2024-04-26T23:44:19.796369+0000","last_fullsized":"2024-04-26T23:44:19.796369+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788787+0000","last_change":"2024-04-26T23:44:19.788787+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788787+0000","last_undegraded":"2024-04-26T23:44:19.788787+0000","last_fullsized":"2024-04-26T23:44:19.788787+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791070+0000","last_change":"2024-04-26T23:44:19.791070+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791070+0000","last_undegraded":"2024-04-26T23:44:19.791070+0000","last_fullsized":"2024-04-26T23:44:19.791070+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.788842+0000","last_change":"2024-04-26T23:44:19.788842+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.788842+0000","last_undegraded":"2024-04-26T23:44:19.788842+0000","last_fullsized":"2024-04-26T23:44:19.788842+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.791189+0000","last_change":"2024-04-26T23:44:19.791189+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.791189+0000","last_undegraded":"2024-04-26T23:44:19.791189+0000","last_fullsized":"2024-04-26T23:44:19.791189+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.792017+0000","last_change":"2024-04-26T23:44:19.792017+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.792017+0000","last_undegraded":"2024-04-26T23:44:19.792017+0000","last_fullsized":"2024-04-26T23:44:19.792017+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:44:20.784420+0000","last_change":"2024-04-26T23:44:20.784420+0000","last_active":"2024-04-26T23:44:20.784420+0000","last_peered":"2024-04-26T23:44:20.784420+0000","last_clean":"2024-04-26T23:44:20.784420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:20.784420+0000","last_undegraded":"2024-04-26T23:44:20.784420+0000","last_fullsized":"2024-04-26T23:44:20.784420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-04-26T23:44:19.796330+0000","last_change":"2024-04-26T23:44:19.796330+0000","last_active":"2024-04-26T23:44:19.776965+0000","last_peered":"2024-04-26T23:44:19.776965+0000","last_clean":"2024-04-26T23:44:19.776965+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:44:19.796330+0000","last_undegraded":"2024-04-26T23:44:19.796330+0000","last_fullsized":"2024-04-26T23:44:19.796330+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":242,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-26T23:44:19.792924+0000","last_change":"2024-04-26T23:41:12.783987+0000","last_active":"2024-04-26T23:44:19.792924+0000","last_peered":"2024-04-26T23:44:19.792924+0000","last_clean":"2024-04-26T23:44:19.792924+0000","last_became_active":"2024-04-26T23:41:12.782901+0000","last_became_peered":"2024-04-26T23:41:12.782901+0000","last_unstale":"2024-04-26T23:44:19.792924+0000","last_undegraded":"2024-04-26T23:44:19.792924+0000","last_fullsized":"2024-04-26T23:44:19.792924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_clean_scrub_stamp":"2024-04-26T23:41:11.626255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:16.305521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1277952,"data_stored":873997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":283629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1265664,"data_stored":868180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:44:30.432 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:44:30.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.570+0000 7f51e1000640 1 Processor -- start 2024-04-26T23:44:30.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.570+0000 7f51e1000640 1 -- start start 2024-04-26T23:44:30.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.570+0000 7f51e1000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f51dc0b5080 0x7f51dc0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.570+0000 7f51e1000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51dc072980 0x7f51dc072e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.570+0000 7f51e1000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51dc0cfef0 con 0x7f51dc0725a0 2024-04-26T23:44:30.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.570+0000 7f51e1000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f51dc0cddc0 con 0x7f51dc0b5080 2024-04-26T23:44:30.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.570+0000 7f51e1000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f51dc0d01b0 con 0x7f51dc072980 2024-04-26T23:44:30.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.570+0000 7f51da800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51dc072980 0x7f51dc072e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.570+0000 7f51d9e00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f51dc0725a0 0x7f51dc073f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:50692/0 (socket says 172.21.15.137:50692) 2024-04-26T23:44:30.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.570+0000 7f51d9e00640 1 -- 172.21.15.137:0/2680187664 learned_addr learned my addr 172.21.15.137:0/2680187664 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:30.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.570+0000 7f51d1400640 1 --2- 172.21.15.137:0/2680187664 >> v2:172.21.15.170:3300/0 conn(0x7f51dc0b5080 0x7f51dc0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.570+0000 7f51d9400640 1 -- 172.21.15.137:0/2680187664 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2151155293 0 0) 0x7f51dc0cfef0 con 0x7f51dc0725a0 2024-04-26T23:44:30.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.570+0000 7f51d9400640 1 -- 172.21.15.137:0/2680187664 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51c0005740 con 0x7f51dc0725a0 2024-04-26T23:44:30.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.570+0000 7f51da800640 1 -- 172.21.15.137:0/2680187664 >> v2:172.21.15.170:3300/0 conn(0x7f51dc0b5080 msgr2=0x7f51dc0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:30.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.570+0000 7f51da800640 1 --2- 172.21.15.137:0/2680187664 >> v2:172.21.15.170:3300/0 conn(0x7f51dc0b5080 0x7f51dc0cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.570+0000 7f51da800640 1 -- 172.21.15.137:0/2680187664 >> v1:172.21.15.170:6789/0 conn(0x7f51dc0725a0 legacy=0x7f51dc073f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.570+0000 7f51da800640 1 -- 172.21.15.137:0/2680187664 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51dc0d0490 con 0x7f51dc072980 2024-04-26T23:44:30.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.574+0000 7f51da800640 1 --2- 172.21.15.137:0/2680187664 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51dc072980 0x7f51dc072e30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009dc0 tx=0x7f51d401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25f2994e1c93e4c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:30.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.574+0000 7f51d9400640 1 -- 172.21.15.137:0/2680187664 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d40b2070 con 0x7f51dc072980 2024-04-26T23:44:30.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.574+0000 7f51d9400640 1 -- 172.21.15.137:0/2680187664 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51d40a58e0 con 0x7f51dc072980 2024-04-26T23:44:30.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.574+0000 7f51d9400640 1 -- 172.21.15.137:0/2680187664 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d40a5cb0 con 0x7f51dc072980 2024-04-26T23:44:30.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.574+0000 7f51e1000640 1 -- 172.21.15.137:0/2680187664 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51dc072980 msgr2=0x7f51dc072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.574+0000 7f51e1000640 1 --2- 172.21.15.137:0/2680187664 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51dc072980 0x7f51dc072e30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009dc0 tx=0x7f51d401c920 comp rx=0 tx=0).stop 2024-04-26T23:44:30.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.574+0000 7f51e1000640 1 -- 172.21.15.137:0/2680187664 shutdown_connections 2024-04-26T23:44:30.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.574+0000 7f51e1000640 1 --2- 172.21.15.137:0/2680187664 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51dc072980 0x7f51dc072e30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.574+0000 7f51e1000640 1 --2- 172.21.15.137:0/2680187664 >> v2:172.21.15.170:3300/0 conn(0x7f51dc0b5080 0x7f51dc0cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.574+0000 7f51e1000640 1 -- 172.21.15.137:0/2680187664 >> 172.21.15.137:0/2680187664 conn(0x7f51dc06c5d0 msgr2=0x7f51dc06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:30.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.574+0000 7f51e1000640 1 -- 172.21.15.137:0/2680187664 shutdown_connections 2024-04-26T23:44:30.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.574+0000 7f51e1000640 1 -- 172.21.15.137:0/2680187664 wait complete. 2024-04-26T23:44:30.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.578+0000 7f51e1000640 1 Processor -- start 2024-04-26T23:44:30.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.578+0000 7f51e1000640 1 -- start start 2024-04-26T23:44:30.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.578+0000 7f51e1000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51dc0725a0 0x7f51dc13f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.578+0000 7f51e1000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51dc072980 0x7f51dc15d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.578+0000 7f51e1000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51dc0b5080 0x7f51dc15efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.578+0000 7f51e1000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f51dc06f930 con 0x7f51dc072980 2024-04-26T23:44:30.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.578+0000 7f51e1000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f51dc06f7b0 con 0x7f51dc0b5080 2024-04-26T23:44:30.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.578+0000 7f51e1000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f51dc06fab0 con 0x7f51dc0725a0 2024-04-26T23:44:30.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.578+0000 7f51d1400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51dc072980 0x7f51dc15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.578+0000 7f51d1400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51dc072980 0x7f51dc15d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45724/0 (socket says 172.21.15.137:45724) 2024-04-26T23:44:30.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.578+0000 7f51d1400640 1 -- 172.21.15.137:0/4007723166 learned_addr learned my addr 172.21.15.137:0/4007723166 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:30.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.578+0000 7f51d9e00640 1 --2- 172.21.15.137:0/4007723166 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51dc0725a0 0x7f51dc13f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.578+0000 7f51da800640 1 --2- 172.21.15.137:0/4007723166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51dc0b5080 0x7f51dc15efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.578+0000 7f51d1400640 1 -- 172.21.15.137:0/4007723166 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51dc0725a0 msgr2=0x7f51dc13f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.578+0000 7f51d1400640 1 --2- 172.21.15.137:0/4007723166 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51dc0725a0 0x7f51dc13f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.578+0000 7f51d1400640 1 -- 172.21.15.137:0/4007723166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51dc0b5080 msgr2=0x7f51dc15efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.578+0000 7f51d1400640 1 --2- 172.21.15.137:0/4007723166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51dc0b5080 0x7f51dc15efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.578+0000 7f51d1400640 1 -- 172.21.15.137:0/4007723166 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51dc0b1a00 con 0x7f51dc072980 2024-04-26T23:44:30.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.578+0000 7f51d1400640 1 --2- 172.21.15.137:0/4007723166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51dc072980 0x7f51dc15d910 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f51c400e900 tx=0x7f51c400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:30.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.578+0000 7f51d2a00640 1 -- 172.21.15.137:0/4007723166 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c4017070 con 0x7f51dc072980 2024-04-26T23:44:30.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.578+0000 7f51d2a00640 1 -- 172.21.15.137:0/4007723166 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51c400ca00 con 0x7f51dc072980 2024-04-26T23:44:30.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.578+0000 7f51e1000640 1 -- 172.21.15.137:0/4007723166 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51dc15ce30 con 0x7f51dc072980 2024-04-26T23:44:30.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.582+0000 7f51d2a00640 1 -- 172.21.15.137:0/4007723166 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c400cdd0 con 0x7f51dc072980 2024-04-26T23:44:30.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.582+0000 7f51e1000640 1 -- 172.21.15.137:0/4007723166 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51dc0b1ce0 con 0x7f51dc072980 2024-04-26T23:44:30.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.582+0000 7f51e1000640 1 -- 172.21.15.137:0/4007723166 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51dc06a4b0 con 0x7f51dc072980 2024-04-26T23:44:30.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.582+0000 7f51d2a00640 1 -- 172.21.15.137:0/4007723166 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f51c401a070 con 0x7f51dc072980 2024-04-26T23:44:30.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.582+0000 7f51d2a00640 1 --2- 172.21.15.137:0/4007723166 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f51b8068380 0x7f51b806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.582+0000 7f51d2a00640 1 -- 172.21.15.137:0/4007723166 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f51c4086d90 con 0x7f51dc072980 2024-04-26T23:44:30.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.582+0000 7f51d9e00640 1 --2- 172.21.15.137:0/4007723166 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f51b8068380 0x7f51b806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.582+0000 7f51d9e00640 1 --2- 172.21.15.137:0/4007723166 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f51b8068380 0x7f51b806a840 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f51cc007fd0 tx=0x7f51cc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:30.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.586+0000 7f51d2a00640 1 -- 172.21.15.137:0/4007723166 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f51c4056c60 con 0x7f51dc072980 2024-04-26T23:44:30.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.742+0000 7f51e1000640 1 -- 172.21.15.137:0/4007723166 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f51dc06d410 con 0x7f51b8068380 2024-04-26T23:44:30.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.750+0000 7f51d2a00640 1 -- 172.21.15.137:0/4007723166 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251955 (secure 0 0 0) 0x7f51dc06d410 con 0x7f51b8068380 2024-04-26T23:44:30.761 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:30.762 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T23:44:30.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.754+0000 7f51e1000640 1 -- 172.21.15.137:0/4007723166 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f51b8068380 msgr2=0x7f51b806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.754+0000 7f51e1000640 1 --2- 172.21.15.137:0/4007723166 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f51b8068380 0x7f51b806a840 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f51cc007fd0 tx=0x7f51cc009040 comp rx=0 tx=0).stop 2024-04-26T23:44:30.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.754+0000 7f51e1000640 1 -- 172.21.15.137:0/4007723166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51dc072980 msgr2=0x7f51dc15d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.754+0000 7f51e1000640 1 --2- 172.21.15.137:0/4007723166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51dc072980 0x7f51dc15d910 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f51c400e900 tx=0x7f51c400edc0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.754+0000 7f51e1000640 1 -- 172.21.15.137:0/4007723166 shutdown_connections 2024-04-26T23:44:30.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.754+0000 7f51e1000640 1 --2- 172.21.15.137:0/4007723166 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f51b8068380 0x7f51b806a840 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.754+0000 7f51e1000640 1 --2- 172.21.15.137:0/4007723166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51dc072980 0x7f51dc15d910 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.754+0000 7f51e1000640 1 --2- 172.21.15.137:0/4007723166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51dc0b5080 0x7f51dc15efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.754+0000 7f51e1000640 1 --2- 172.21.15.137:0/4007723166 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51dc0725a0 0x7f51dc13f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.754+0000 7f51e1000640 1 -- 172.21.15.137:0/4007723166 >> 172.21.15.137:0/4007723166 conn(0x7f51dc06c5d0 msgr2=0x7f51dc1439d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:30.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.754+0000 7f51e1000640 1 -- 172.21.15.137:0/4007723166 shutdown_connections 2024-04-26T23:44:30.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.754+0000 7f51e1000640 1 -- 172.21.15.137:0/4007723166 wait complete. 2024-04-26T23:44:30.781 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-04-26T23:44:29.627649+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243860,"kb_used_data":6856,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730860,"statfs":{"total":773094113280,"available":772844400640,"internally_reserved":0,"allocated":7020544,"data_stored":3609324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001593"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.871662+0000","last_change":"2024-04-26T23:44:21.828290+0000","last_active":"2024-04-26T23:44:22.871662+0000","last_peered":"2024-04-26T23:44:22.871662+0000","last_clean":"2024-04-26T23:44:22.871662+0000","last_became_active":"2024-04-26T23:44:21.825932+0000","last_became_peered":"2024-04-26T23:44:21.825932+0000","last_unstale":"2024-04-26T23:44:22.871662+0000","last_undegraded":"2024-04-26T23:44:22.871662+0000","last_fullsized":"2024-04-26T23:44:22.871662+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:30:14.559136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823166+0000","last_change":"2024-04-26T23:44:21.828338+0000","last_active":"2024-04-26T23:44:22.823166+0000","last_peered":"2024-04-26T23:44:22.823166+0000","last_clean":"2024-04-26T23:44:22.823166+0000","last_became_active":"2024-04-26T23:44:21.825286+0000","last_became_peered":"2024-04-26T23:44:21.825286+0000","last_unstale":"2024-04-26T23:44:22.823166+0000","last_undegraded":"2024-04-26T23:44:22.823166+0000","last_fullsized":"2024-04-26T23:44:22.823166+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:48.697708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872682+0000","last_change":"2024-04-26T23:44:21.842149+0000","last_active":"2024-04-26T23:44:22.872682+0000","last_peered":"2024-04-26T23:44:22.872682+0000","last_clean":"2024-04-26T23:44:22.872682+0000","last_became_active":"2024-04-26T23:44:21.841765+0000","last_became_peered":"2024-04-26T23:44:21.841765+0000","last_unstale":"2024-04-26T23:44:22.872682+0000","last_undegraded":"2024-04-26T23:44:22.872682+0000","last_fullsized":"2024-04-26T23:44:22.872682+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:18.915001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823163+0000","last_change":"2024-04-26T23:44:21.823789+0000","last_active":"2024-04-26T23:44:22.823163+0000","last_peered":"2024-04-26T23:44:22.823163+0000","last_clean":"2024-04-26T23:44:22.823163+0000","last_became_active":"2024-04-26T23:44:21.823512+0000","last_became_peered":"2024-04-26T23:44:21.823512+0000","last_unstale":"2024-04-26T23:44:22.823163+0000","last_undegraded":"2024-04-26T23:44:22.823163+0000","last_fullsized":"2024-04-26T23:44:22.823163+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:09.879734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.871542+0000","last_change":"2024-04-26T23:44:21.830558+0000","last_active":"2024-04-26T23:44:22.871542+0000","last_peered":"2024-04-26T23:44:22.871542+0000","last_clean":"2024-04-26T23:44:22.871542+0000","last_became_active":"2024-04-26T23:44:21.828687+0000","last_became_peered":"2024-04-26T23:44:21.828687+0000","last_unstale":"2024-04-26T23:44:22.871542+0000","last_undegraded":"2024-04-26T23:44:22.871542+0000","last_fullsized":"2024-04-26T23:44:22.871542+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:20:36.948754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.834898+0000","last_change":"2024-04-26T23:44:21.818120+0000","last_active":"2024-04-26T23:44:22.834898+0000","last_peered":"2024-04-26T23:44:22.834898+0000","last_clean":"2024-04-26T23:44:22.834898+0000","last_became_active":"2024-04-26T23:44:21.817836+0000","last_became_peered":"2024-04-26T23:44:21.817836+0000","last_unstale":"2024-04-26T23:44:22.834898+0000","last_undegraded":"2024-04-26T23:44:22.834898+0000","last_fullsized":"2024-04-26T23:44:22.834898+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:09.879734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823722+0000","last_change":"2024-04-26T23:44:21.814192+0000","last_active":"2024-04-26T23:44:22.823722+0000","last_peered":"2024-04-26T23:44:22.823722+0000","last_clean":"2024-04-26T23:44:22.823722+0000","last_became_active":"2024-04-26T23:44:21.813648+0000","last_became_peered":"2024-04-26T23:44:21.813648+0000","last_unstale":"2024-04-26T23:44:22.823722+0000","last_undegraded":"2024-04-26T23:44:22.823722+0000","last_fullsized":"2024-04-26T23:44:22.823722+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:30.968294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.822821+0000","last_change":"2024-04-26T23:44:21.816817+0000","last_active":"2024-04-26T23:44:22.822821+0000","last_peered":"2024-04-26T23:44:22.822821+0000","last_clean":"2024-04-26T23:44:22.822821+0000","last_became_active":"2024-04-26T23:44:21.816536+0000","last_became_peered":"2024-04-26T23:44:21.816536+0000","last_unstale":"2024-04-26T23:44:22.822821+0000","last_undegraded":"2024-04-26T23:44:22.822821+0000","last_fullsized":"2024-04-26T23:44:22.822821+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:04:52.338649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.824305+0000","last_change":"2024-04-26T23:44:21.811320+0000","last_active":"2024-04-26T23:44:22.824305+0000","last_peered":"2024-04-26T23:44:22.824305+0000","last_clean":"2024-04-26T23:44:22.824305+0000","last_became_active":"2024-04-26T23:44:21.811006+0000","last_became_peered":"2024-04-26T23:44:21.811006+0000","last_unstale":"2024-04-26T23:44:22.824305+0000","last_undegraded":"2024-04-26T23:44:22.824305+0000","last_fullsized":"2024-04-26T23:44:22.824305+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:16.154167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872255+0000","last_change":"2024-04-26T23:44:21.824079+0000","last_active":"2024-04-26T23:44:22.872255+0000","last_peered":"2024-04-26T23:44:22.872255+0000","last_clean":"2024-04-26T23:44:22.872255+0000","last_became_active":"2024-04-26T23:44:21.823797+0000","last_became_peered":"2024-04-26T23:44:21.823797+0000","last_unstale":"2024-04-26T23:44:22.872255+0000","last_undegraded":"2024-04-26T23:44:22.872255+0000","last_fullsized":"2024-04-26T23:44:22.872255+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:07:01.339366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872270+0000","last_change":"2024-04-26T23:44:21.830846+0000","last_active":"2024-04-26T23:44:22.872270+0000","last_peered":"2024-04-26T23:44:22.872270+0000","last_clean":"2024-04-26T23:44:22.872270+0000","last_became_active":"2024-04-26T23:44:21.829406+0000","last_became_peered":"2024-04-26T23:44:21.829406+0000","last_unstale":"2024-04-26T23:44:22.872270+0000","last_undegraded":"2024-04-26T23:44:22.872270+0000","last_fullsized":"2024-04-26T23:44:22.872270+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:58:20.872895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823216+0000","last_change":"2024-04-26T23:44:21.825603+0000","last_active":"2024-04-26T23:44:22.823216+0000","last_peered":"2024-04-26T23:44:22.823216+0000","last_clean":"2024-04-26T23:44:22.823216+0000","last_became_active":"2024-04-26T23:44:21.825270+0000","last_became_peered":"2024-04-26T23:44:21.825270+0000","last_unstale":"2024-04-26T23:44:22.823216+0000","last_undegraded":"2024-04-26T23:44:22.823216+0000","last_fullsized":"2024-04-26T23:44:22.823216+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:18.915001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.839166+0000","last_change":"2024-04-26T23:44:21.827387+0000","last_active":"2024-04-26T23:44:22.839166+0000","last_peered":"2024-04-26T23:44:22.839166+0000","last_clean":"2024-04-26T23:44:22.839166+0000","last_became_active":"2024-04-26T23:44:21.826477+0000","last_became_peered":"2024-04-26T23:44:21.826477+0000","last_unstale":"2024-04-26T23:44:22.839166+0000","last_undegraded":"2024-04-26T23:44:22.839166+0000","last_fullsized":"2024-04-26T23:44:22.839166+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:54:06.670242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.824383+0000","last_change":"2024-04-26T23:44:21.821794+0000","last_active":"2024-04-26T23:44:22.824383+0000","last_peered":"2024-04-26T23:44:22.824383+0000","last_clean":"2024-04-26T23:44:22.824383+0000","last_became_active":"2024-04-26T23:44:21.821474+0000","last_became_peered":"2024-04-26T23:44:21.821474+0000","last_unstale":"2024-04-26T23:44:22.824383+0000","last_undegraded":"2024-04-26T23:44:22.824383+0000","last_fullsized":"2024-04-26T23:44:22.824383+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:54.694740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823881+0000","last_change":"2024-04-26T23:44:21.823597+0000","last_active":"2024-04-26T23:44:22.823881+0000","last_peered":"2024-04-26T23:44:22.823881+0000","last_clean":"2024-04-26T23:44:22.823881+0000","last_became_active":"2024-04-26T23:44:21.823313+0000","last_became_peered":"2024-04-26T23:44:21.823313+0000","last_unstale":"2024-04-26T23:44:22.823881+0000","last_undegraded":"2024-04-26T23:44:22.823881+0000","last_fullsized":"2024-04-26T23:44:22.823881+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:20.434833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.835103+0000","last_change":"2024-04-26T23:44:21.820663+0000","last_active":"2024-04-26T23:44:22.835103+0000","last_peered":"2024-04-26T23:44:22.835103+0000","last_clean":"2024-04-26T23:44:22.835103+0000","last_became_active":"2024-04-26T23:44:21.820366+0000","last_became_peered":"2024-04-26T23:44:21.820366+0000","last_unstale":"2024-04-26T23:44:22.835103+0000","last_undegraded":"2024-04-26T23:44:22.835103+0000","last_fullsized":"2024-04-26T23:44:22.835103+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:22.963344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823552+0000","last_change":"2024-04-26T23:44:21.825345+0000","last_active":"2024-04-26T23:44:22.823552+0000","last_peered":"2024-04-26T23:44:22.823552+0000","last_clean":"2024-04-26T23:44:22.823552+0000","last_became_active":"2024-04-26T23:44:21.824970+0000","last_became_peered":"2024-04-26T23:44:21.824970+0000","last_unstale":"2024-04-26T23:44:22.823552+0000","last_undegraded":"2024-04-26T23:44:22.823552+0000","last_fullsized":"2024-04-26T23:44:22.823552+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:48:25.734847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872823+0000","last_change":"2024-04-26T23:44:21.832349+0000","last_active":"2024-04-26T23:44:22.872823+0000","last_peered":"2024-04-26T23:44:22.872823+0000","last_clean":"2024-04-26T23:44:22.872823+0000","last_became_active":"2024-04-26T23:44:21.831957+0000","last_became_peered":"2024-04-26T23:44:21.831957+0000","last_unstale":"2024-04-26T23:44:22.872823+0000","last_undegraded":"2024-04-26T23:44:22.872823+0000","last_fullsized":"2024-04-26T23:44:22.872823+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:22.963344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.871558+0000","last_change":"2024-04-26T23:44:21.826224+0000","last_active":"2024-04-26T23:44:22.871558+0000","last_peered":"2024-04-26T23:44:22.871558+0000","last_clean":"2024-04-26T23:44:22.871558+0000","last_became_active":"2024-04-26T23:44:21.825885+0000","last_became_peered":"2024-04-26T23:44:21.825885+0000","last_unstale":"2024-04-26T23:44:22.871558+0000","last_undegraded":"2024-04-26T23:44:22.871558+0000","last_fullsized":"2024-04-26T23:44:22.871558+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:48:44.793110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823280+0000","last_change":"2024-04-26T23:44:21.822979+0000","last_active":"2024-04-26T23:44:22.823280+0000","last_peered":"2024-04-26T23:44:22.823280+0000","last_clean":"2024-04-26T23:44:22.823280+0000","last_became_active":"2024-04-26T23:44:21.822531+0000","last_became_peered":"2024-04-26T23:44:21.822531+0000","last_unstale":"2024-04-26T23:44:22.823280+0000","last_undegraded":"2024-04-26T23:44:22.823280+0000","last_fullsized":"2024-04-26T23:44:22.823280+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:45.067331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872585+0000","last_change":"2024-04-26T23:44:21.835032+0000","last_active":"2024-04-26T23:44:22.872585+0000","last_peered":"2024-04-26T23:44:22.872585+0000","last_clean":"2024-04-26T23:44:22.872585+0000","last_became_active":"2024-04-26T23:44:21.834074+0000","last_became_peered":"2024-04-26T23:44:21.834074+0000","last_unstale":"2024-04-26T23:44:22.872585+0000","last_undegraded":"2024-04-26T23:44:22.872585+0000","last_fullsized":"2024-04-26T23:44:22.872585+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:18.875082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.822940+0000","last_change":"2024-04-26T23:44:21.822088+0000","last_active":"2024-04-26T23:44:22.822940+0000","last_peered":"2024-04-26T23:44:22.822940+0000","last_clean":"2024-04-26T23:44:22.822940+0000","last_became_active":"2024-04-26T23:44:21.821582+0000","last_became_peered":"2024-04-26T23:44:21.821582+0000","last_unstale":"2024-04-26T23:44:22.822940+0000","last_undegraded":"2024-04-26T23:44:22.822940+0000","last_fullsized":"2024-04-26T23:44:22.822940+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:38.513833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872428+0000","last_change":"2024-04-26T23:44:21.832720+0000","last_active":"2024-04-26T23:44:22.872428+0000","last_peered":"2024-04-26T23:44:22.872428+0000","last_clean":"2024-04-26T23:44:22.872428+0000","last_became_active":"2024-04-26T23:44:21.829548+0000","last_became_peered":"2024-04-26T23:44:21.829548+0000","last_unstale":"2024-04-26T23:44:22.872428+0000","last_undegraded":"2024-04-26T23:44:22.872428+0000","last_fullsized":"2024-04-26T23:44:22.872428+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:58.446173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.839092+0000","last_change":"2024-04-26T23:44:21.825101+0000","last_active":"2024-04-26T23:44:22.839092+0000","last_peered":"2024-04-26T23:44:22.839092+0000","last_clean":"2024-04-26T23:44:22.839092+0000","last_became_active":"2024-04-26T23:44:21.824568+0000","last_became_peered":"2024-04-26T23:44:21.824568+0000","last_unstale":"2024-04-26T23:44:22.839092+0000","last_undegraded":"2024-04-26T23:44:22.839092+0000","last_fullsized":"2024-04-26T23:44:22.839092+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:21.415290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.871743+0000","last_change":"2024-04-26T23:44:21.824619+0000","last_active":"2024-04-26T23:44:22.871743+0000","last_peered":"2024-04-26T23:44:22.871743+0000","last_clean":"2024-04-26T23:44:22.871743+0000","last_became_active":"2024-04-26T23:44:21.823690+0000","last_became_peered":"2024-04-26T23:44:21.823690+0000","last_unstale":"2024-04-26T23:44:22.871743+0000","last_undegraded":"2024-04-26T23:44:22.871743+0000","last_fullsized":"2024-04-26T23:44:22.871743+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:54:50.103742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823742+0000","last_change":"2024-04-26T23:44:21.823485+0000","last_active":"2024-04-26T23:44:22.823742+0000","last_peered":"2024-04-26T23:44:22.823742+0000","last_clean":"2024-04-26T23:44:22.823742+0000","last_became_active":"2024-04-26T23:44:21.822882+0000","last_became_peered":"2024-04-26T23:44:21.822882+0000","last_unstale":"2024-04-26T23:44:22.823742+0000","last_undegraded":"2024-04-26T23:44:22.823742+0000","last_fullsized":"2024-04-26T23:44:22.823742+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:56:30.330415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.835193+0000","last_change":"2024-04-26T23:44:21.824271+0000","last_active":"2024-04-26T23:44:22.835193+0000","last_peered":"2024-04-26T23:44:22.835193+0000","last_clean":"2024-04-26T23:44:22.835193+0000","last_became_active":"2024-04-26T23:44:21.823981+0000","last_became_peered":"2024-04-26T23:44:21.823981+0000","last_unstale":"2024-04-26T23:44:22.835193+0000","last_undegraded":"2024-04-26T23:44:22.835193+0000","last_fullsized":"2024-04-26T23:44:22.835193+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:07:53.566924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.871764+0000","last_change":"2024-04-26T23:44:21.827050+0000","last_active":"2024-04-26T23:44:22.871764+0000","last_peered":"2024-04-26T23:44:22.871764+0000","last_clean":"2024-04-26T23:44:22.871764+0000","last_became_active":"2024-04-26T23:44:21.826691+0000","last_became_peered":"2024-04-26T23:44:21.826691+0000","last_unstale":"2024-04-26T23:44:22.871764+0000","last_undegraded":"2024-04-26T23:44:22.871764+0000","last_fullsized":"2024-04-26T23:44:22.871764+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:52:44.510866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823748+0000","last_change":"2024-04-26T23:44:21.825381+0000","last_active":"2024-04-26T23:44:22.823748+0000","last_peered":"2024-04-26T23:44:22.823748+0000","last_clean":"2024-04-26T23:44:22.823748+0000","last_became_active":"2024-04-26T23:44:21.825076+0000","last_became_peered":"2024-04-26T23:44:21.825076+0000","last_unstale":"2024-04-26T23:44:22.823748+0000","last_undegraded":"2024-04-26T23:44:22.823748+0000","last_fullsized":"2024-04-26T23:44:22.823748+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:54.608233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872412+0000","last_change":"2024-04-26T23:44:21.830868+0000","last_active":"2024-04-26T23:44:22.872412+0000","last_peered":"2024-04-26T23:44:22.872412+0000","last_clean":"2024-04-26T23:44:22.872412+0000","last_became_active":"2024-04-26T23:44:21.830531+0000","last_became_peered":"2024-04-26T23:44:21.830531+0000","last_unstale":"2024-04-26T23:44:22.872412+0000","last_undegraded":"2024-04-26T23:44:22.872412+0000","last_fullsized":"2024-04-26T23:44:22.872412+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:21:22.952484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.871375+0000","last_change":"2024-04-26T23:44:21.823386+0000","last_active":"2024-04-26T23:44:22.871375+0000","last_peered":"2024-04-26T23:44:22.871375+0000","last_clean":"2024-04-26T23:44:22.871375+0000","last_became_active":"2024-04-26T23:44:21.821773+0000","last_became_peered":"2024-04-26T23:44:21.821773+0000","last_unstale":"2024-04-26T23:44:22.871375+0000","last_undegraded":"2024-04-26T23:44:22.871375+0000","last_fullsized":"2024-04-26T23:44:22.871375+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:24:26.571662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.834963+0000","last_change":"2024-04-26T23:44:21.824928+0000","last_active":"2024-04-26T23:44:22.834963+0000","last_peered":"2024-04-26T23:44:22.834963+0000","last_clean":"2024-04-26T23:44:22.834963+0000","last_became_active":"2024-04-26T23:44:21.824643+0000","last_became_peered":"2024-04-26T23:44:21.824643+0000","last_unstale":"2024-04-26T23:44:22.834963+0000","last_undegraded":"2024-04-26T23:44:22.834963+0000","last_fullsized":"2024-04-26T23:44:22.834963+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:39.392730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.835360+0000","last_change":"2024-04-26T23:44:21.822879+0000","last_active":"2024-04-26T23:44:22.835360+0000","last_peered":"2024-04-26T23:44:22.835360+0000","last_clean":"2024-04-26T23:44:22.835360+0000","last_became_active":"2024-04-26T23:44:21.822653+0000","last_became_peered":"2024-04-26T23:44:21.822653+0000","last_unstale":"2024-04-26T23:44:22.835360+0000","last_undegraded":"2024-04-26T23:44:22.835360+0000","last_fullsized":"2024-04-26T23:44:22.835360+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:42:11.783723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.835265+0000","last_change":"2024-04-26T23:44:20.816632+0000","last_active":"2024-04-26T23:44:22.835265+0000","last_peered":"2024-04-26T23:44:22.835265+0000","last_clean":"2024-04-26T23:44:22.835265+0000","last_became_active":"2024-04-26T23:44:20.816386+0000","last_became_peered":"2024-04-26T23:44:20.816386+0000","last_unstale":"2024-04-26T23:44:22.835265+0000","last_undegraded":"2024-04-26T23:44:22.835265+0000","last_fullsized":"2024-04-26T23:44:22.835265+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:19.427378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872334+0000","last_change":"2024-04-26T23:44:21.831997+0000","last_active":"2024-04-26T23:44:22.872334+0000","last_peered":"2024-04-26T23:44:22.872334+0000","last_clean":"2024-04-26T23:44:22.872334+0000","last_became_active":"2024-04-26T23:44:21.831756+0000","last_became_peered":"2024-04-26T23:44:21.831756+0000","last_unstale":"2024-04-26T23:44:22.872334+0000","last_undegraded":"2024-04-26T23:44:22.872334+0000","last_fullsized":"2024-04-26T23:44:22.872334+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:19:30.670511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823305+0000","last_change":"2024-04-26T23:44:20.806495+0000","last_active":"2024-04-26T23:44:22.823305+0000","last_peered":"2024-04-26T23:44:22.823305+0000","last_clean":"2024-04-26T23:44:22.823305+0000","last_became_active":"2024-04-26T23:44:20.806185+0000","last_became_peered":"2024-04-26T23:44:20.806185+0000","last_unstale":"2024-04-26T23:44:22.823305+0000","last_undegraded":"2024-04-26T23:44:22.823305+0000","last_fullsized":"2024-04-26T23:44:22.823305+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:51.739228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.835211+0000","last_change":"2024-04-26T23:44:21.818237+0000","last_active":"2024-04-26T23:44:22.835211+0000","last_peered":"2024-04-26T23:44:22.835211+0000","last_clean":"2024-04-26T23:44:22.835211+0000","last_became_active":"2024-04-26T23:44:21.817856+0000","last_became_peered":"2024-04-26T23:44:21.817856+0000","last_unstale":"2024-04-26T23:44:22.835211+0000","last_undegraded":"2024-04-26T23:44:22.835211+0000","last_fullsized":"2024-04-26T23:44:22.835211+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:09:25.005981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.835420+0000","last_change":"2024-04-26T23:44:20.818186+0000","last_active":"2024-04-26T23:44:22.835420+0000","last_peered":"2024-04-26T23:44:22.835420+0000","last_clean":"2024-04-26T23:44:22.835420+0000","last_became_active":"2024-04-26T23:44:20.817844+0000","last_became_peered":"2024-04-26T23:44:20.817844+0000","last_unstale":"2024-04-26T23:44:22.835420+0000","last_undegraded":"2024-04-26T23:44:22.835420+0000","last_fullsized":"2024-04-26T23:44:22.835420+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:15.146712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.835372+0000","last_change":"2024-04-26T23:44:21.823657+0000","last_active":"2024-04-26T23:44:22.835372+0000","last_peered":"2024-04-26T23:44:22.835372+0000","last_clean":"2024-04-26T23:44:22.835372+0000","last_became_active":"2024-04-26T23:44:21.819086+0000","last_became_peered":"2024-04-26T23:44:21.819086+0000","last_unstale":"2024-04-26T23:44:22.835372+0000","last_undegraded":"2024-04-26T23:44:22.835372+0000","last_fullsized":"2024-04-26T23:44:22.835372+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:39.452726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823261+0000","last_change":"2024-04-26T23:44:20.812307+0000","last_active":"2024-04-26T23:44:22.823261+0000","last_peered":"2024-04-26T23:44:22.823261+0000","last_clean":"2024-04-26T23:44:22.823261+0000","last_became_active":"2024-04-26T23:44:20.812054+0000","last_became_peered":"2024-04-26T23:44:20.812054+0000","last_unstale":"2024-04-26T23:44:22.823261+0000","last_undegraded":"2024-04-26T23:44:22.823261+0000","last_fullsized":"2024-04-26T23:44:22.823261+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:19.427378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.822875+0000","last_change":"2024-04-26T23:44:21.821858+0000","last_active":"2024-04-26T23:44:22.822875+0000","last_peered":"2024-04-26T23:44:22.822875+0000","last_clean":"2024-04-26T23:44:22.822875+0000","last_became_active":"2024-04-26T23:44:21.821530+0000","last_became_peered":"2024-04-26T23:44:21.821530+0000","last_unstale":"2024-04-26T23:44:22.822875+0000","last_undegraded":"2024-04-26T23:44:22.822875+0000","last_fullsized":"2024-04-26T23:44:22.822875+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:31:39.541201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.824084+0000","last_change":"2024-04-26T23:44:20.811229+0000","last_active":"2024-04-26T23:44:22.824084+0000","last_peered":"2024-04-26T23:44:22.824084+0000","last_clean":"2024-04-26T23:44:22.824084+0000","last_became_active":"2024-04-26T23:44:20.810916+0000","last_became_peered":"2024-04-26T23:44:20.810916+0000","last_unstale":"2024-04-26T23:44:22.824084+0000","last_undegraded":"2024-04-26T23:44:22.824084+0000","last_fullsized":"2024-04-26T23:44:22.824084+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:20.407835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823391+0000","last_change":"2024-04-26T23:44:21.826974+0000","last_active":"2024-04-26T23:44:22.823391+0000","last_peered":"2024-04-26T23:44:22.823391+0000","last_clean":"2024-04-26T23:44:22.823391+0000","last_became_active":"2024-04-26T23:44:21.826705+0000","last_became_peered":"2024-04-26T23:44:21.826705+0000","last_unstale":"2024-04-26T23:44:22.823391+0000","last_undegraded":"2024-04-26T23:44:22.823391+0000","last_fullsized":"2024-04-26T23:44:22.823391+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:33:22.608007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.834880+0000","last_change":"2024-04-26T23:44:20.814655+0000","last_active":"2024-04-26T23:44:22.834880+0000","last_peered":"2024-04-26T23:44:22.834880+0000","last_clean":"2024-04-26T23:44:22.834880+0000","last_became_active":"2024-04-26T23:44:20.814073+0000","last_became_peered":"2024-04-26T23:44:20.814073+0000","last_unstale":"2024-04-26T23:44:22.834880+0000","last_undegraded":"2024-04-26T23:44:22.834880+0000","last_fullsized":"2024-04-26T23:44:22.834880+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:25.652682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.839032+0000","last_change":"2024-04-26T23:44:21.821501+0000","last_active":"2024-04-26T23:44:22.839032+0000","last_peered":"2024-04-26T23:44:22.839032+0000","last_clean":"2024-04-26T23:44:22.839032+0000","last_became_active":"2024-04-26T23:44:21.821248+0000","last_became_peered":"2024-04-26T23:44:21.821248+0000","last_unstale":"2024-04-26T23:44:22.839032+0000","last_undegraded":"2024-04-26T23:44:22.839032+0000","last_fullsized":"2024-04-26T23:44:22.839032+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:22.827057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.822859+0000","last_change":"2024-04-26T23:44:20.816112+0000","last_active":"2024-04-26T23:44:22.822859+0000","last_peered":"2024-04-26T23:44:22.822859+0000","last_clean":"2024-04-26T23:44:22.822859+0000","last_became_active":"2024-04-26T23:44:20.815688+0000","last_became_peered":"2024-04-26T23:44:20.815688+0000","last_unstale":"2024-04-26T23:44:22.822859+0000","last_undegraded":"2024-04-26T23:44:22.822859+0000","last_fullsized":"2024-04-26T23:44:22.822859+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:05.952170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823027+0000","last_change":"2024-04-26T23:44:21.827267+0000","last_active":"2024-04-26T23:44:22.823027+0000","last_peered":"2024-04-26T23:44:22.823027+0000","last_clean":"2024-04-26T23:44:22.823027+0000","last_became_active":"2024-04-26T23:44:21.827029+0000","last_became_peered":"2024-04-26T23:44:21.827029+0000","last_unstale":"2024-04-26T23:44:22.823027+0000","last_undegraded":"2024-04-26T23:44:22.823027+0000","last_fullsized":"2024-04-26T23:44:22.823027+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:45.416918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823591+0000","last_change":"2024-04-26T23:44:20.815462+0000","last_active":"2024-04-26T23:44:22.823591+0000","last_peered":"2024-04-26T23:44:22.823591+0000","last_clean":"2024-04-26T23:44:22.823591+0000","last_became_active":"2024-04-26T23:44:20.815090+0000","last_became_peered":"2024-04-26T23:44:20.815090+0000","last_unstale":"2024-04-26T23:44:22.823591+0000","last_undegraded":"2024-04-26T23:44:22.823591+0000","last_fullsized":"2024-04-26T23:44:22.823591+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:21.819602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.824460+0000","last_change":"2024-04-26T23:44:21.825074+0000","last_active":"2024-04-26T23:44:22.824460+0000","last_peered":"2024-04-26T23:44:22.824460+0000","last_clean":"2024-04-26T23:44:22.824460+0000","last_became_active":"2024-04-26T23:44:21.824496+0000","last_became_peered":"2024-04-26T23:44:21.824496+0000","last_unstale":"2024-04-26T23:44:22.824460+0000","last_undegraded":"2024-04-26T23:44:22.824460+0000","last_fullsized":"2024-04-26T23:44:22.824460+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:27:01.451936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872846+0000","last_change":"2024-04-26T23:44:20.818681+0000","last_active":"2024-04-26T23:44:22.872846+0000","last_peered":"2024-04-26T23:44:22.872846+0000","last_clean":"2024-04-26T23:44:22.872846+0000","last_became_active":"2024-04-26T23:44:20.818383+0000","last_became_peered":"2024-04-26T23:44:20.818383+0000","last_unstale":"2024-04-26T23:44:22.872846+0000","last_undegraded":"2024-04-26T23:44:22.872846+0000","last_fullsized":"2024-04-26T23:44:22.872846+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:05.952170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872874+0000","last_change":"2024-04-26T23:44:21.840516+0000","last_active":"2024-04-26T23:44:22.872874+0000","last_peered":"2024-04-26T23:44:22.872874+0000","last_clean":"2024-04-26T23:44:22.872874+0000","last_became_active":"2024-04-26T23:44:21.838377+0000","last_became_peered":"2024-04-26T23:44:21.838377+0000","last_unstale":"2024-04-26T23:44:22.872874+0000","last_undegraded":"2024-04-26T23:44:22.872874+0000","last_fullsized":"2024-04-26T23:44:22.872874+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:09:25.005981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823278+0000","last_change":"2024-04-26T23:44:20.808230+0000","last_active":"2024-04-26T23:44:22.823278+0000","last_peered":"2024-04-26T23:44:22.823278+0000","last_clean":"2024-04-26T23:44:22.823278+0000","last_became_active":"2024-04-26T23:44:20.807937+0000","last_became_peered":"2024-04-26T23:44:20.807937+0000","last_unstale":"2024-04-26T23:44:22.823278+0000","last_undegraded":"2024-04-26T23:44:22.823278+0000","last_fullsized":"2024-04-26T23:44:22.823278+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:51.440919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872071+0000","last_change":"2024-04-26T23:44:21.823754+0000","last_active":"2024-04-26T23:44:22.872071+0000","last_peered":"2024-04-26T23:44:22.872071+0000","last_clean":"2024-04-26T23:44:22.872071+0000","last_became_active":"2024-04-26T23:44:21.823385+0000","last_became_peered":"2024-04-26T23:44:21.823385+0000","last_unstale":"2024-04-26T23:44:22.872071+0000","last_undegraded":"2024-04-26T23:44:22.872071+0000","last_fullsized":"2024-04-26T23:44:22.872071+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:54:06.670242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872839+0000","last_change":"2024-04-26T23:44:20.813856+0000","last_active":"2024-04-26T23:44:22.872839+0000","last_peered":"2024-04-26T23:44:22.872839+0000","last_clean":"2024-04-26T23:44:22.872839+0000","last_became_active":"2024-04-26T23:44:20.813606+0000","last_became_peered":"2024-04-26T23:44:20.813606+0000","last_unstale":"2024-04-26T23:44:22.872839+0000","last_undegraded":"2024-04-26T23:44:22.872839+0000","last_fullsized":"2024-04-26T23:44:22.872839+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:19:29.663056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872736+0000","last_change":"2024-04-26T23:44:21.833603+0000","last_active":"2024-04-26T23:44:22.872736+0000","last_peered":"2024-04-26T23:44:22.872736+0000","last_clean":"2024-04-26T23:44:22.872736+0000","last_became_active":"2024-04-26T23:44:21.833209+0000","last_became_peered":"2024-04-26T23:44:21.833209+0000","last_unstale":"2024-04-26T23:44:22.872736+0000","last_undegraded":"2024-04-26T23:44:22.872736+0000","last_fullsized":"2024-04-26T23:44:22.872736+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:39.392730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":20,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.824222+0000","last_change":"2024-04-26T23:44:20.819099+0000","last_active":"2024-04-26T23:44:22.824222+0000","last_peered":"2024-04-26T23:44:22.824222+0000","last_clean":"2024-04-26T23:44:22.824222+0000","last_became_active":"2024-04-26T23:44:20.818727+0000","last_became_peered":"2024-04-26T23:44:20.818727+0000","last_unstale":"2024-04-26T23:44:22.824222+0000","last_undegraded":"2024-04-26T23:44:22.824222+0000","last_fullsized":"2024-04-26T23:44:22.824222+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:54:05.662787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.822941+0000","last_change":"2024-04-26T23:44:21.822102+0000","last_active":"2024-04-26T23:44:22.822941+0000","last_peered":"2024-04-26T23:44:22.822941+0000","last_clean":"2024-04-26T23:44:22.822941+0000","last_became_active":"2024-04-26T23:44:21.821818+0000","last_became_peered":"2024-04-26T23:44:21.821818+0000","last_unstale":"2024-04-26T23:44:22.822941+0000","last_undegraded":"2024-04-26T23:44:22.822941+0000","last_fullsized":"2024-04-26T23:44:22.822941+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:58.446173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823407+0000","last_change":"2024-04-26T23:44:20.809334+0000","last_active":"2024-04-26T23:44:22.823407+0000","last_peered":"2024-04-26T23:44:22.823407+0000","last_clean":"2024-04-26T23:44:22.823407+0000","last_became_active":"2024-04-26T23:44:20.808401+0000","last_became_peered":"2024-04-26T23:44:20.808401+0000","last_unstale":"2024-04-26T23:44:22.823407+0000","last_undegraded":"2024-04-26T23:44:22.823407+0000","last_fullsized":"2024-04-26T23:44:22.823407+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:34:25.427691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872427+0000","last_change":"2024-04-26T23:44:21.834809+0000","last_active":"2024-04-26T23:44:22.872427+0000","last_peered":"2024-04-26T23:44:22.872427+0000","last_clean":"2024-04-26T23:44:22.872427+0000","last_became_active":"2024-04-26T23:44:21.833571+0000","last_became_peered":"2024-04-26T23:44:21.833571+0000","last_unstale":"2024-04-26T23:44:22.872427+0000","last_undegraded":"2024-04-26T23:44:22.872427+0000","last_fullsized":"2024-04-26T23:44:22.872427+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:05.227718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.838843+0000","last_change":"2024-04-26T23:44:20.804110+0000","last_active":"2024-04-26T23:44:22.838843+0000","last_peered":"2024-04-26T23:44:22.838843+0000","last_clean":"2024-04-26T23:44:22.838843+0000","last_became_active":"2024-04-26T23:44:20.803752+0000","last_became_peered":"2024-04-26T23:44:20.803752+0000","last_unstale":"2024-04-26T23:44:22.838843+0000","last_undegraded":"2024-04-26T23:44:22.838843+0000","last_fullsized":"2024-04-26T23:44:22.838843+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:47:31.210526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823012+0000","last_change":"2024-04-26T23:44:21.825764+0000","last_active":"2024-04-26T23:44:22.823012+0000","last_peered":"2024-04-26T23:44:22.823012+0000","last_clean":"2024-04-26T23:44:22.823012+0000","last_became_active":"2024-04-26T23:44:21.825485+0000","last_became_peered":"2024-04-26T23:44:21.825485+0000","last_unstale":"2024-04-26T23:44:22.823012+0000","last_undegraded":"2024-04-26T23:44:22.823012+0000","last_fullsized":"2024-04-26T23:44:22.823012+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:55:46.834845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.822998+0000","last_change":"2024-04-26T23:44:20.810284+0000","last_active":"2024-04-26T23:44:22.822998+0000","last_peered":"2024-04-26T23:44:22.822998+0000","last_clean":"2024-04-26T23:44:22.822998+0000","last_became_active":"2024-04-26T23:44:20.809463+0000","last_became_peered":"2024-04-26T23:44:20.809463+0000","last_unstale":"2024-04-26T23:44:22.822998+0000","last_undegraded":"2024-04-26T23:44:22.822998+0000","last_fullsized":"2024-04-26T23:44:22.822998+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:25.652682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872455+0000","last_change":"2024-04-26T23:44:21.836505+0000","last_active":"2024-04-26T23:44:22.872455+0000","last_peered":"2024-04-26T23:44:22.872455+0000","last_clean":"2024-04-26T23:44:22.872455+0000","last_became_active":"2024-04-26T23:44:21.835639+0000","last_became_peered":"2024-04-26T23:44:21.835639+0000","last_unstale":"2024-04-26T23:44:22.872455+0000","last_undegraded":"2024-04-26T23:44:22.872455+0000","last_fullsized":"2024-04-26T23:44:22.872455+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:56:30.330415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":22,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872290+0000","last_change":"2024-04-26T23:44:20.807471+0000","last_active":"2024-04-26T23:44:22.872290+0000","last_peered":"2024-04-26T23:44:22.872290+0000","last_clean":"2024-04-26T23:44:22.872290+0000","last_became_active":"2024-04-26T23:44:20.807167+0000","last_became_peered":"2024-04-26T23:44:20.807167+0000","last_unstale":"2024-04-26T23:44:22.872290+0000","last_undegraded":"2024-04-26T23:44:22.872290+0000","last_fullsized":"2024-04-26T23:44:22.872290+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:58:19.865440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872847+0000","last_change":"2024-04-26T23:44:21.841444+0000","last_active":"2024-04-26T23:44:22.872847+0000","last_peered":"2024-04-26T23:44:22.872847+0000","last_clean":"2024-04-26T23:44:22.872847+0000","last_became_active":"2024-04-26T23:44:21.841164+0000","last_became_peered":"2024-04-26T23:44:21.841164+0000","last_unstale":"2024-04-26T23:44:22.872847+0000","last_undegraded":"2024-04-26T23:44:22.872847+0000","last_fullsized":"2024-04-26T23:44:22.872847+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:37:11.152874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823515+0000","last_change":"2024-04-26T23:44:20.809109+0000","last_active":"2024-04-26T23:44:22.823515+0000","last_peered":"2024-04-26T23:44:22.823515+0000","last_clean":"2024-04-26T23:44:22.823515+0000","last_became_active":"2024-04-26T23:44:20.808803+0000","last_became_peered":"2024-04-26T23:44:20.808803+0000","last_unstale":"2024-04-26T23:44:22.823515+0000","last_undegraded":"2024-04-26T23:44:22.823515+0000","last_fullsized":"2024-04-26T23:44:22.823515+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:58:51.777191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823142+0000","last_change":"2024-04-26T23:44:21.821711+0000","last_active":"2024-04-26T23:44:22.823142+0000","last_peered":"2024-04-26T23:44:22.823142+0000","last_clean":"2024-04-26T23:44:22.823142+0000","last_became_active":"2024-04-26T23:44:21.821067+0000","last_became_peered":"2024-04-26T23:44:21.821067+0000","last_unstale":"2024-04-26T23:44:22.823142+0000","last_undegraded":"2024-04-26T23:44:22.823142+0000","last_fullsized":"2024-04-26T23:44:22.823142+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:18.875082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.835310+0000","last_change":"2024-04-26T23:44:20.810819+0000","last_active":"2024-04-26T23:44:22.835310+0000","last_peered":"2024-04-26T23:44:22.835310+0000","last_clean":"2024-04-26T23:44:22.835310+0000","last_became_active":"2024-04-26T23:44:20.810535+0000","last_became_peered":"2024-04-26T23:44:20.810535+0000","last_unstale":"2024-04-26T23:44:22.835310+0000","last_undegraded":"2024-04-26T23:44:22.835310+0000","last_fullsized":"2024-04-26T23:44:22.835310+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:29.960840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823317+0000","last_change":"2024-04-26T23:44:21.822780+0000","last_active":"2024-04-26T23:44:22.823317+0000","last_peered":"2024-04-26T23:44:22.823317+0000","last_clean":"2024-04-26T23:44:22.823317+0000","last_became_active":"2024-04-26T23:44:21.822246+0000","last_became_peered":"2024-04-26T23:44:21.822246+0000","last_unstale":"2024-04-26T23:44:22.823317+0000","last_undegraded":"2024-04-26T23:44:22.823317+0000","last_fullsized":"2024-04-26T23:44:22.823317+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:45:21.319485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823358+0000","last_change":"2024-04-26T23:44:20.809252+0000","last_active":"2024-04-26T23:44:22.823358+0000","last_peered":"2024-04-26T23:44:22.823358+0000","last_clean":"2024-04-26T23:44:22.823358+0000","last_became_active":"2024-04-26T23:44:20.808929+0000","last_became_peered":"2024-04-26T23:44:20.808929+0000","last_unstale":"2024-04-26T23:44:22.823358+0000","last_undegraded":"2024-04-26T23:44:22.823358+0000","last_fullsized":"2024-04-26T23:44:22.823358+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:55:45.827390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872865+0000","last_change":"2024-04-26T23:44:21.833909+0000","last_active":"2024-04-26T23:44:22.872865+0000","last_peered":"2024-04-26T23:44:22.872865+0000","last_clean":"2024-04-26T23:44:22.872865+0000","last_became_active":"2024-04-26T23:44:21.833548+0000","last_became_peered":"2024-04-26T23:44:21.833548+0000","last_unstale":"2024-04-26T23:44:22.872865+0000","last_undegraded":"2024-04-26T23:44:22.872865+0000","last_fullsized":"2024-04-26T23:44:22.872865+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:07:53.566924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.835202+0000","last_change":"2024-04-26T23:44:20.817896+0000","last_active":"2024-04-26T23:44:22.835202+0000","last_peered":"2024-04-26T23:44:22.835202+0000","last_clean":"2024-04-26T23:44:22.835202+0000","last_became_active":"2024-04-26T23:44:20.817610+0000","last_became_peered":"2024-04-26T23:44:20.817610+0000","last_unstale":"2024-04-26T23:44:22.835202+0000","last_undegraded":"2024-04-26T23:44:22.835202+0000","last_fullsized":"2024-04-26T23:44:22.835202+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:55:45.827390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823836+0000","last_change":"2024-04-26T23:44:21.820276+0000","last_active":"2024-04-26T23:44:22.823836+0000","last_peered":"2024-04-26T23:44:22.823836+0000","last_clean":"2024-04-26T23:44:22.823836+0000","last_became_active":"2024-04-26T23:44:21.819950+0000","last_became_peered":"2024-04-26T23:44:21.819950+0000","last_unstale":"2024-04-26T23:44:22.823836+0000","last_undegraded":"2024-04-26T23:44:22.823836+0000","last_fullsized":"2024-04-26T23:44:22.823836+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:37:11.152874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823576+0000","last_change":"2024-04-26T23:44:20.806472+0000","last_active":"2024-04-26T23:44:22.823576+0000","last_peered":"2024-04-26T23:44:22.823576+0000","last_clean":"2024-04-26T23:44:22.823576+0000","last_became_active":"2024-04-26T23:44:20.806144+0000","last_became_peered":"2024-04-26T23:44:20.806144+0000","last_unstale":"2024-04-26T23:44:22.823576+0000","last_undegraded":"2024-04-26T23:44:22.823576+0000","last_fullsized":"2024-04-26T23:44:22.823576+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:21:21.945029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.835105+0000","last_change":"2024-04-26T23:44:21.824562+0000","last_active":"2024-04-26T23:44:22.835105+0000","last_peered":"2024-04-26T23:44:22.835105+0000","last_clean":"2024-04-26T23:44:22.835105+0000","last_became_active":"2024-04-26T23:44:21.824284+0000","last_became_peered":"2024-04-26T23:44:21.824284+0000","last_unstale":"2024-04-26T23:44:22.835105+0000","last_undegraded":"2024-04-26T23:44:22.835105+0000","last_fullsized":"2024-04-26T23:44:22.835105+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:37:11.152874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.871846+0000","last_change":"2024-04-26T23:44:20.809084+0000","last_active":"2024-04-26T23:44:22.871846+0000","last_peered":"2024-04-26T23:44:22.871846+0000","last_clean":"2024-04-26T23:44:22.871846+0000","last_became_active":"2024-04-26T23:44:20.808791+0000","last_became_peered":"2024-04-26T23:44:20.808791+0000","last_unstale":"2024-04-26T23:44:22.871846+0000","last_undegraded":"2024-04-26T23:44:22.871846+0000","last_fullsized":"2024-04-26T23:44:22.871846+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:45:25.774765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.834931+0000","last_change":"2024-04-26T23:44:21.822303+0000","last_active":"2024-04-26T23:44:22.834931+0000","last_peered":"2024-04-26T23:44:22.834931+0000","last_clean":"2024-04-26T23:44:22.834931+0000","last_became_active":"2024-04-26T23:44:21.822043+0000","last_became_peered":"2024-04-26T23:44:21.822043+0000","last_unstale":"2024-04-26T23:44:22.834931+0000","last_undegraded":"2024-04-26T23:44:22.834931+0000","last_fullsized":"2024-04-26T23:44:22.834931+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:18.915001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.822697+0000","last_change":"2024-04-26T23:44:20.817531+0000","last_active":"2024-04-26T23:44:22.822697+0000","last_peered":"2024-04-26T23:44:22.822697+0000","last_clean":"2024-04-26T23:44:22.822697+0000","last_became_active":"2024-04-26T23:44:20.817056+0000","last_became_peered":"2024-04-26T23:44:20.817056+0000","last_unstale":"2024-04-26T23:44:22.822697+0000","last_undegraded":"2024-04-26T23:44:22.822697+0000","last_fullsized":"2024-04-26T23:44:22.822697+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:19:29.663056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823677+0000","last_change":"2024-04-26T23:44:21.820111+0000","last_active":"2024-04-26T23:44:22.823677+0000","last_peered":"2024-04-26T23:44:22.823677+0000","last_clean":"2024-04-26T23:44:22.823677+0000","last_became_active":"2024-04-26T23:44:21.819793+0000","last_became_peered":"2024-04-26T23:44:21.819793+0000","last_unstale":"2024-04-26T23:44:22.823677+0000","last_undegraded":"2024-04-26T23:44:22.823677+0000","last_fullsized":"2024-04-26T23:44:22.823677+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:22.963344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872303+0000","last_change":"2024-04-26T23:44:20.815218+0000","last_active":"2024-04-26T23:44:22.872303+0000","last_peered":"2024-04-26T23:44:22.872303+0000","last_clean":"2024-04-26T23:44:22.872303+0000","last_became_active":"2024-04-26T23:44:20.814659+0000","last_became_peered":"2024-04-26T23:44:20.814659+0000","last_unstale":"2024-04-26T23:44:22.872303+0000","last_undegraded":"2024-04-26T23:44:22.872303+0000","last_fullsized":"2024-04-26T23:44:22.872303+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:44:33.424350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823371+0000","last_change":"2024-04-26T23:44:21.828886+0000","last_active":"2024-04-26T23:44:22.823371+0000","last_peered":"2024-04-26T23:44:22.823371+0000","last_clean":"2024-04-26T23:44:22.823371+0000","last_became_active":"2024-04-26T23:44:21.828423+0000","last_became_peered":"2024-04-26T23:44:21.828423+0000","last_unstale":"2024-04-26T23:44:22.823371+0000","last_undegraded":"2024-04-26T23:44:22.823371+0000","last_fullsized":"2024-04-26T23:44:22.823371+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:39.392730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"60'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.835442+0000","last_change":"2024-04-26T23:44:20.815065+0000","last_active":"2024-04-26T23:44:22.835442+0000","last_peered":"2024-04-26T23:44:22.835442+0000","last_clean":"2024-04-26T23:44:22.835442+0000","last_became_active":"2024-04-26T23:44:20.814822+0000","last_became_peered":"2024-04-26T23:44:20.814822+0000","last_unstale":"2024-04-26T23:44:22.835442+0000","last_undegraded":"2024-04-26T23:44:22.835442+0000","last_fullsized":"2024-04-26T23:44:22.835442+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:53.687285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872123+0000","last_change":"2024-04-26T23:44:21.823466+0000","last_active":"2024-04-26T23:44:22.872123+0000","last_peered":"2024-04-26T23:44:22.872123+0000","last_clean":"2024-04-26T23:44:22.872123+0000","last_became_active":"2024-04-26T23:44:21.823029+0000","last_became_peered":"2024-04-26T23:44:21.823029+0000","last_unstale":"2024-04-26T23:44:22.872123+0000","last_undegraded":"2024-04-26T23:44:22.872123+0000","last_fullsized":"2024-04-26T23:44:22.872123+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:45.791702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.838975+0000","last_change":"2024-04-26T23:44:20.801057+0000","last_active":"2024-04-26T23:44:22.838975+0000","last_peered":"2024-04-26T23:44:22.838975+0000","last_clean":"2024-04-26T23:44:22.838975+0000","last_became_active":"2024-04-26T23:44:20.800666+0000","last_became_peered":"2024-04-26T23:44:20.800666+0000","last_unstale":"2024-04-26T23:44:22.838975+0000","last_undegraded":"2024-04-26T23:44:22.838975+0000","last_fullsized":"2024-04-26T23:44:22.838975+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:40.294613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.835387+0000","last_change":"2024-04-26T23:44:21.819041+0000","last_active":"2024-04-26T23:44:22.835387+0000","last_peered":"2024-04-26T23:44:22.835387+0000","last_clean":"2024-04-26T23:44:22.835387+0000","last_became_active":"2024-04-26T23:44:21.818744+0000","last_became_peered":"2024-04-26T23:44:21.818744+0000","last_unstale":"2024-04-26T23:44:22.835387+0000","last_undegraded":"2024-04-26T23:44:22.835387+0000","last_fullsized":"2024-04-26T23:44:22.835387+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:50.013243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823287+0000","last_change":"2024-04-26T23:44:20.815837+0000","last_active":"2024-04-26T23:44:22.823287+0000","last_peered":"2024-04-26T23:44:22.823287+0000","last_clean":"2024-04-26T23:44:22.823287+0000","last_became_active":"2024-04-26T23:44:20.815577+0000","last_became_peered":"2024-04-26T23:44:20.815577+0000","last_unstale":"2024-04-26T23:44:22.823287+0000","last_undegraded":"2024-04-26T23:44:22.823287+0000","last_fullsized":"2024-04-26T23:44:22.823287+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:29.960840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823612+0000","last_change":"2024-04-26T23:44:21.823953+0000","last_active":"2024-04-26T23:44:22.823612+0000","last_peered":"2024-04-26T23:44:22.823612+0000","last_clean":"2024-04-26T23:44:22.823612+0000","last_became_active":"2024-04-26T23:44:21.823663+0000","last_became_peered":"2024-04-26T23:44:21.823663+0000","last_unstale":"2024-04-26T23:44:22.823612+0000","last_undegraded":"2024-04-26T23:44:22.823612+0000","last_fullsized":"2024-04-26T23:44:22.823612+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:39.961106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.871869+0000","last_change":"2024-04-26T23:44:20.816491+0000","last_active":"2024-04-26T23:44:22.871869+0000","last_peered":"2024-04-26T23:44:22.871869+0000","last_clean":"2024-04-26T23:44:22.871869+0000","last_became_active":"2024-04-26T23:44:20.816225+0000","last_became_peered":"2024-04-26T23:44:20.816225+0000","last_unstale":"2024-04-26T23:44:22.871869+0000","last_undegraded":"2024-04-26T23:44:22.871869+0000","last_fullsized":"2024-04-26T23:44:22.871869+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:47:31.210526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872633+0000","last_change":"2024-04-26T23:44:21.835109+0000","last_active":"2024-04-26T23:44:22.872633+0000","last_peered":"2024-04-26T23:44:22.872633+0000","last_clean":"2024-04-26T23:44:22.872633+0000","last_became_active":"2024-04-26T23:44:21.834525+0000","last_became_peered":"2024-04-26T23:44:21.834525+0000","last_unstale":"2024-04-26T23:44:22.872633+0000","last_undegraded":"2024-04-26T23:44:22.872633+0000","last_fullsized":"2024-04-26T23:44:22.872633+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:09.879734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.824172+0000","last_change":"2024-04-26T23:44:20.808511+0000","last_active":"2024-04-26T23:44:22.824172+0000","last_peered":"2024-04-26T23:44:22.824172+0000","last_clean":"2024-04-26T23:44:22.824172+0000","last_became_active":"2024-04-26T23:44:20.808209+0000","last_became_peered":"2024-04-26T23:44:20.808209+0000","last_unstale":"2024-04-26T23:44:22.824172+0000","last_undegraded":"2024-04-26T23:44:22.824172+0000","last_fullsized":"2024-04-26T23:44:22.824172+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:33.951159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.871878+0000","last_change":"2024-04-26T23:44:21.821053+0000","last_active":"2024-04-26T23:44:22.871878+0000","last_peered":"2024-04-26T23:44:22.871878+0000","last_clean":"2024-04-26T23:44:22.871878+0000","last_became_active":"2024-04-26T23:44:21.820789+0000","last_became_peered":"2024-04-26T23:44:21.820789+0000","last_unstale":"2024-04-26T23:44:22.871878+0000","last_undegraded":"2024-04-26T23:44:22.871878+0000","last_fullsized":"2024-04-26T23:44:22.871878+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:21.415290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.871688+0000","last_change":"2024-04-26T23:44:20.812362+0000","last_active":"2024-04-26T23:44:22.871688+0000","last_peered":"2024-04-26T23:44:22.871688+0000","last_clean":"2024-04-26T23:44:22.871688+0000","last_became_active":"2024-04-26T23:44:20.812080+0000","last_became_peered":"2024-04-26T23:44:20.812080+0000","last_unstale":"2024-04-26T23:44:22.871688+0000","last_undegraded":"2024-04-26T23:44:22.871688+0000","last_fullsized":"2024-04-26T23:44:22.871688+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:27.154916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.822883+0000","last_change":"2024-04-26T23:44:21.827573+0000","last_active":"2024-04-26T23:44:22.822883+0000","last_peered":"2024-04-26T23:44:22.822883+0000","last_clean":"2024-04-26T23:44:22.822883+0000","last_became_active":"2024-04-26T23:44:21.827180+0000","last_became_peered":"2024-04-26T23:44:21.827180+0000","last_unstale":"2024-04-26T23:44:22.822883+0000","last_undegraded":"2024-04-26T23:44:22.822883+0000","last_fullsized":"2024-04-26T23:44:22.822883+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:11:59.899354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.822873+0000","last_change":"2024-04-26T23:44:20.812051+0000","last_active":"2024-04-26T23:44:22.822873+0000","last_peered":"2024-04-26T23:44:22.822873+0000","last_clean":"2024-04-26T23:44:22.822873+0000","last_became_active":"2024-04-26T23:44:20.811743+0000","last_became_peered":"2024-04-26T23:44:20.811743+0000","last_unstale":"2024-04-26T23:44:22.822873+0000","last_undegraded":"2024-04-26T23:44:22.822873+0000","last_fullsized":"2024-04-26T23:44:22.822873+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:04.220263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.823163+0000","last_change":"2024-04-26T23:44:21.823375+0000","last_active":"2024-04-26T23:44:22.823163+0000","last_peered":"2024-04-26T23:44:22.823163+0000","last_clean":"2024-04-26T23:44:22.823163+0000","last_became_active":"2024-04-26T23:44:21.823121+0000","last_became_peered":"2024-04-26T23:44:21.823121+0000","last_unstale":"2024-04-26T23:44:22.823163+0000","last_undegraded":"2024-04-26T23:44:22.823163+0000","last_fullsized":"2024-04-26T23:44:22.823163+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:20.784420+0000","last_clean_scrub_stamp":"2024-04-26T23:44:20.784420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:23:25.949758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.838980+0000","last_change":"2024-04-26T23:44:20.812096+0000","last_active":"2024-04-26T23:44:22.838980+0000","last_peered":"2024-04-26T23:44:22.838980+0000","last_clean":"2024-04-26T23:44:22.838980+0000","last_became_active":"2024-04-26T23:44:20.811802+0000","last_became_peered":"2024-04-26T23:44:20.811802+0000","last_unstale":"2024-04-26T23:44:22.838980+0000","last_undegraded":"2024-04-26T23:44:22.838980+0000","last_fullsized":"2024-04-26T23:44:22.838980+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:44:19.776965+0000","last_clean_scrub_stamp":"2024-04-26T23:44:19.776965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:08.361571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":248,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872281+0000","last_change":"2024-04-26T23:41:12.783987+0000","last_active":"2024-04-26T23:44:22.872281+0000","last_peered":"2024-04-26T23:44:22.872281+0000","last_clean":"2024-04-26T23:44:22.872281+0000","last_became_active":"2024-04-26T23:41:12.782901+0000","last_became_peered":"2024-04-26T23:41:12.782901+0000","last_unstale":"2024-04-26T23:44:22.872281+0000","last_undegraded":"2024-04-26T23:44:22.872281+0000","last_fullsized":"2024-04-26T23:44:22.872281+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_clean_scrub_stamp":"2024-04-26T23:41:11.626255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:16.305521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1323008,"data_stored":893499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":720896,"data_stored":302971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":729088,"data_stored":303623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":304583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":729088,"data_stored":303027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":729088,"data_stored":303027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":724992,"data_stored":303061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1331200,"data_stored":895533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:44:30.785 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T23:44:30.786 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-26T23:44:30.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.958+0000 7f0a21600640 1 Processor -- start 2024-04-26T23:44:30.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.958+0000 7f0a21600640 1 -- start start 2024-04-26T23:44:30.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.958+0000 7f0a21600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0a1c073f20 0x7f0a1c15df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.962+0000 7f0a21600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a1c0affa0 0x7f0a1c0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.962+0000 7f0a21600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a1c072860 con 0x7f0a1c0afbc0 2024-04-26T23:44:30.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.962+0000 7f0a21600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0a1c0743b0 con 0x7f0a1c073f20 2024-04-26T23:44:30.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.962+0000 7f0a21600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0a1c072b00 con 0x7f0a1c0affa0 2024-04-26T23:44:30.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.962+0000 7f0a12000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0a1c073f20 0x7f0a1c15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.962+0000 7f0a1aa00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f0a1c0afbc0 0x7f0a1c0735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32830/0 (socket says 172.21.15.137:32830) 2024-04-26T23:44:30.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.962+0000 7f0a1aa00640 1 -- 172.21.15.137:0/2012658802 learned_addr learned my addr 172.21.15.137:0/2012658802 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:30.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.962+0000 7f0a1b400640 1 --2- 172.21.15.137:0/2012658802 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a1c0affa0 0x7f0a1c0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.962+0000 7f0a12000640 1 -- 172.21.15.137:0/2012658802 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a1c0affa0 msgr2=0x7f0a1c0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:30.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.962+0000 7f0a12000640 1 --2- 172.21.15.137:0/2012658802 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a1c0affa0 0x7f0a1c0ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.962+0000 7f0a12000640 1 -- 172.21.15.137:0/2012658802 >> v1:172.21.15.137:6789/0 conn(0x7f0a1c0afbc0 legacy=0x7f0a1c0735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.962+0000 7f0a12000640 1 -- 172.21.15.137:0/2012658802 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1c072de0 con 0x7f0a1c073f20 2024-04-26T23:44:30.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.962+0000 7f0a12000640 1 --2- 172.21.15.137:0/2012658802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a1c073f20 0x7f0a1c15df90 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0a040097f0 tx=0x7f0a0401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3297401005816bd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:30.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.962+0000 7f0a1a000640 1 -- 172.21.15.137:0/2012658802 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a040b0070 con 0x7f0a1c073f20 2024-04-26T23:44:30.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.962+0000 7f0a1a000640 1 -- 172.21.15.137:0/2012658802 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a040ab600 con 0x7f0a1c073f20 2024-04-26T23:44:30.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.962+0000 7f0a1a000640 1 -- 172.21.15.137:0/2012658802 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a040ab9d0 con 0x7f0a1c073f20 2024-04-26T23:44:30.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a21600640 1 -- 172.21.15.137:0/2012658802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a1c073f20 msgr2=0x7f0a1c15df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a21600640 1 --2- 172.21.15.137:0/2012658802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a1c073f20 0x7f0a1c15df90 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0a040097f0 tx=0x7f0a0401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a21600640 1 -- 172.21.15.137:0/2012658802 shutdown_connections 2024-04-26T23:44:30.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a21600640 1 --2- 172.21.15.137:0/2012658802 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a1c0affa0 0x7f0a1c0ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a21600640 1 --2- 172.21.15.137:0/2012658802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a1c073f20 0x7f0a1c15df90 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a21600640 1 -- 172.21.15.137:0/2012658802 >> 172.21.15.137:0/2012658802 conn(0x7f0a1c06c800 msgr2=0x7f0a1c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:30.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a21600640 1 -- 172.21.15.137:0/2012658802 shutdown_connections 2024-04-26T23:44:30.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a21600640 1 -- 172.21.15.137:0/2012658802 wait complete. 2024-04-26T23:44:30.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a21600640 1 Processor -- start 2024-04-26T23:44:30.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a21600640 1 -- start start 2024-04-26T23:44:30.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a21600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a1c0afbc0 0x7f0a1c14ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a21600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a1c0affa0 0x7f0a1c152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a21600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a1c14a650 0x7f0a1c0b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a21600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1c06f360 con 0x7f0a1c14a650 2024-04-26T23:44:30.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a21600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1c06f1e0 con 0x7f0a1c0affa0 2024-04-26T23:44:30.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a21600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0a1c06f4e0 con 0x7f0a1c0afbc0 2024-04-26T23:44:30.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a1b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a1c14a650 0x7f0a1c0b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a1b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a1c14a650 0x7f0a1c0b13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35834/0 (socket says 172.21.15.137:35834) 2024-04-26T23:44:30.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a1b400640 1 -- 172.21.15.137:0/520165730 learned_addr learned my addr 172.21.15.137:0/520165730 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:30.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a1aa00640 1 --2- 172.21.15.137:0/520165730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a1c0afbc0 0x7f0a1c14ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a12000640 1 --2- 172.21.15.137:0/520165730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a1c0affa0 0x7f0a1c152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a1b400640 1 -- 172.21.15.137:0/520165730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a1c0afbc0 msgr2=0x7f0a1c14ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a1b400640 1 --2- 172.21.15.137:0/520165730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a1c0afbc0 0x7f0a1c14ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a1b400640 1 -- 172.21.15.137:0/520165730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a1c0affa0 msgr2=0x7f0a1c152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a1b400640 1 --2- 172.21.15.137:0/520165730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a1c0affa0 0x7f0a1c152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.966+0000 7f0a1b400640 1 -- 172.21.15.137:0/520165730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1c14fe40 con 0x7f0a1c14a650 2024-04-26T23:44:30.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.970+0000 7f0a1b400640 1 --2- 172.21.15.137:0/520165730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a1c14a650 0x7f0a1c0b13d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0a14009fd0 tx=0x7f0a1400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:30.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.970+0000 7f0a13400640 1 -- 172.21.15.137:0/520165730 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a14014420 con 0x7f0a1c14a650 2024-04-26T23:44:30.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.970+0000 7f0a13400640 1 -- 172.21.15.137:0/520165730 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a14019070 con 0x7f0a1c14a650 2024-04-26T23:44:30.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.970+0000 7f0a13400640 1 -- 172.21.15.137:0/520165730 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a14014800 con 0x7f0a1c14a650 2024-04-26T23:44:30.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.970+0000 7f0a21600640 1 -- 172.21.15.137:0/520165730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a1c150120 con 0x7f0a1c14a650 2024-04-26T23:44:30.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.970+0000 7f0a21600640 1 -- 172.21.15.137:0/520165730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a1c14e570 con 0x7f0a1c14a650 2024-04-26T23:44:30.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.970+0000 7f0a21600640 1 -- 172.21.15.137:0/520165730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a1c06a410 con 0x7f0a1c14a650 2024-04-26T23:44:30.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.970+0000 7f0a13400640 1 -- 172.21.15.137:0/520165730 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0a140149a0 con 0x7f0a1c14a650 2024-04-26T23:44:30.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.970+0000 7f0a13400640 1 --2- 172.21.15.137:0/520165730 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f09f80683b0 0x7f09f806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.970+0000 7f0a13400640 1 -- 172.21.15.137:0/520165730 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f0a14087060 con 0x7f0a1c14a650 2024-04-26T23:44:30.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.970+0000 7f0a1aa00640 1 --2- 172.21.15.137:0/520165730 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f09f80683b0 0x7f09f806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.974+0000 7f0a1aa00640 1 --2- 172.21.15.137:0/520165730 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f09f80683b0 0x7f09f806a870 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c000f70 tx=0x7f0a0c007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:30.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:30.978+0000 7f0a13400640 1 -- 172.21.15.137:0/520165730 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0a14056fc0 con 0x7f0a1c14a650 2024-04-26T23:44:31.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.190+0000 7f0a21600640 1 -- 172.21.15.137:0/520165730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f0a1c0ae830 con 0x7f0a1c14a650 2024-04-26T23:44:31.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.190+0000 7f0a13400640 1 -- 172.21.15.137:0/520165730 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f0a1405b2c0 con 0x7f0a1c14a650 2024-04-26T23:44:31.199 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-04-26T23:44:31.199 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBlOyxmNsaKARAAi0ecpgpB9GUVCXS04Xi03g== 2024-04-26T23:44:31.199 INFO:teuthology.orchestra.run.smithi137.stdout: caps mds = "allow" 2024-04-26T23:44:31.199 INFO:teuthology.orchestra.run.smithi137.stdout: caps mon = "allow r" 2024-04-26T23:44:31.199 INFO:teuthology.orchestra.run.smithi137.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-26T23:44:31.200 INFO:teuthology.orchestra.run.smithi137.stderr:updated caps for client.0 2024-04-26T23:44:31.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.194+0000 7f0a21600640 1 -- 172.21.15.137:0/520165730 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f09f80683b0 msgr2=0x7f09f806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:31.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.194+0000 7f0a21600640 1 --2- 172.21.15.137:0/520165730 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f09f80683b0 0x7f09f806a870 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c000f70 tx=0x7f0a0c007e90 comp rx=0 tx=0).stop 2024-04-26T23:44:31.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.194+0000 7f0a21600640 1 -- 172.21.15.137:0/520165730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a1c14a650 msgr2=0x7f0a1c0b13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:31.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.194+0000 7f0a21600640 1 --2- 172.21.15.137:0/520165730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a1c14a650 0x7f0a1c0b13d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0a14009fd0 tx=0x7f0a1400e4b0 comp rx=0 tx=0).stop 2024-04-26T23:44:31.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.194+0000 7f0a21600640 1 -- 172.21.15.137:0/520165730 shutdown_connections 2024-04-26T23:44:31.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.194+0000 7f0a21600640 1 --2- 172.21.15.137:0/520165730 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f09f80683b0 0x7f09f806a870 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:31.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.194+0000 7f0a21600640 1 --2- 172.21.15.137:0/520165730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a1c14a650 0x7f0a1c0b13d0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:31.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.194+0000 7f0a21600640 1 --2- 172.21.15.137:0/520165730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a1c0affa0 0x7f0a1c152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:31.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.194+0000 7f0a21600640 1 --2- 172.21.15.137:0/520165730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a1c0afbc0 0x7f0a1c14ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:31.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.194+0000 7f0a21600640 1 -- 172.21.15.137:0/520165730 >> 172.21.15.137:0/520165730 conn(0x7f0a1c06c800 msgr2=0x7f0a1c15dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:31.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.194+0000 7f0a21600640 1 -- 172.21.15.137:0/520165730 shutdown_connections 2024-04-26T23:44:31.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.194+0000 7f0a21600640 1 -- 172.21.15.137:0/520165730 wait complete. 2024-04-26T23:44:31.221 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:44:31.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.350+0000 7f9dcd000640 1 Processor -- start 2024-04-26T23:44:31.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.350+0000 7f9dcd000640 1 -- start start 2024-04-26T23:44:31.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.350+0000 7f9dcd000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9dc8073090 0x7f9dc80cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:31.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.350+0000 7f9dcd000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dc80cfef0 con 0x7f9dc80725a0 2024-04-26T23:44:31.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.350+0000 7f9dcd000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dc80cddc0 con 0x7f9dc80b5080 2024-04-26T23:44:31.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.350+0000 7f9dcd000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f9dc80d01b0 con 0x7f9dc8073090 2024-04-26T23:44:31.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.350+0000 7f9dc5e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f9dc80725a0 0x7f9dc8073f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32846/0 (socket says 172.21.15.137:32846) 2024-04-26T23:44:31.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.350+0000 7f9dc5e00640 1 -- 172.21.15.137:0/1122755142 learned_addr learned my addr 172.21.15.137:0/1122755142 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:31.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.350+0000 7f9dc6800640 1 --2- 172.21.15.137:0/1122755142 >> v2:172.21.15.137:3300/0 conn(0x7f9dc8073090 0x7f9dc80cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:31.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.350+0000 7f9dc6800640 1 -- 172.21.15.137:0/1122755142 >> v1:172.21.15.170:6789/0 conn(0x7f9dc80b5080 legacy=0x7f9dc8072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:31.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.350+0000 7f9dc6800640 1 -- 172.21.15.137:0/1122755142 >> v1:172.21.15.137:6789/0 conn(0x7f9dc80725a0 legacy=0x7f9dc8073f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:31.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.350+0000 7f9dc6800640 1 -- 172.21.15.137:0/1122755142 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc80d0490 con 0x7f9dc8073090 2024-04-26T23:44:31.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.350+0000 7f9dc5400640 1 -- 172.21.15.137:0/1122755142 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1054707723 0 0) 0x7f9dc80cfef0 con 0x7f9dc80725a0 2024-04-26T23:44:31.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.354+0000 7f9dc6800640 1 --2- 172.21.15.137:0/1122755142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dc8073090 0x7f9dc80cd770 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0009dc0 tx=0x7f9dc001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3a0acd4850b1a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:31.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.354+0000 7f9dc5400640 1 -- 172.21.15.137:0/1122755142 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc00b2070 con 0x7f9dc8073090 2024-04-26T23:44:31.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.354+0000 7f9dc5400640 1 -- 172.21.15.137:0/1122755142 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc00a5a00 con 0x7f9dc8073090 2024-04-26T23:44:31.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.354+0000 7f9dc5400640 1 -- 172.21.15.137:0/1122755142 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc00a5dd0 con 0x7f9dc8073090 2024-04-26T23:44:31.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.354+0000 7f9dcd000640 1 -- 172.21.15.137:0/1122755142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dc8073090 msgr2=0x7f9dc80cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:31.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.354+0000 7f9dcd000640 1 --2- 172.21.15.137:0/1122755142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dc8073090 0x7f9dc80cd770 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0009dc0 tx=0x7f9dc001c920 comp rx=0 tx=0).stop 2024-04-26T23:44:31.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.354+0000 7f9dcd000640 1 -- 172.21.15.137:0/1122755142 shutdown_connections 2024-04-26T23:44:31.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.354+0000 7f9dcd000640 1 --2- 172.21.15.137:0/1122755142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dc8073090 0x7f9dc80cd770 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:31.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.354+0000 7f9dcd000640 1 -- 172.21.15.137:0/1122755142 >> 172.21.15.137:0/1122755142 conn(0x7f9dc806c5d0 msgr2=0x7f9dc806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:31.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.354+0000 7f9dcd000640 1 -- 172.21.15.137:0/1122755142 shutdown_connections 2024-04-26T23:44:31.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.354+0000 7f9dcd000640 1 -- 172.21.15.137:0/1122755142 wait complete. 2024-04-26T23:44:31.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dcd000640 1 Processor -- start 2024-04-26T23:44:31.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dcd000640 1 -- start start 2024-04-26T23:44:31.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dcd000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dc80725a0 0x7f9dc813ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:31.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dcd000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dc8073090 0x7f9dc80b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:31.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dcd000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9dc80b5080 0x7f9dc815aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:31.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dcd000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc8169900 con 0x7f9dc8073090 2024-04-26T23:44:31.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dcd000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc8169780 con 0x7f9dc80b5080 2024-04-26T23:44:31.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dcd000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9dc8169a80 con 0x7f9dc80725a0 2024-04-26T23:44:31.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dbd400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dc8073090 0x7f9dc80b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:31.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dbd400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dc8073090 0x7f9dc80b2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35862/0 (socket says 172.21.15.137:35862) 2024-04-26T23:44:31.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dbd400640 1 -- 172.21.15.137:0/35631881 learned_addr learned my addr 172.21.15.137:0/35631881 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:31.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dc5e00640 1 --2- 172.21.15.137:0/35631881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dc80725a0 0x7f9dc813ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:31.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dc6800640 1 --2- 172.21.15.137:0/35631881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9dc80b5080 0x7f9dc815aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:31.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dbd400640 1 -- 172.21.15.137:0/35631881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dc80725a0 msgr2=0x7f9dc813ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:31.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dbd400640 1 --2- 172.21.15.137:0/35631881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dc80725a0 0x7f9dc813ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:31.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dbd400640 1 -- 172.21.15.137:0/35631881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9dc80b5080 msgr2=0x7f9dc815aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:31.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dbd400640 1 --2- 172.21.15.137:0/35631881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9dc80b5080 0x7f9dc815aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:31.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dbd400640 1 -- 172.21.15.137:0/35631881 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc80b0850 con 0x7f9dc8073090 2024-04-26T23:44:31.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dbd400640 1 --2- 172.21.15.137:0/35631881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dc8073090 0x7f9dc80b2570 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9db000c4d0 tx=0x7f9db000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:31.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dbea00640 1 -- 172.21.15.137:0/35631881 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db0017070 con 0x7f9dc8073090 2024-04-26T23:44:31.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dbea00640 1 -- 172.21.15.137:0/35631881 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9db00052d0 con 0x7f9dc8073090 2024-04-26T23:44:31.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dcd000640 1 -- 172.21.15.137:0/35631881 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc80b0b30 con 0x7f9dc8073090 2024-04-26T23:44:31.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dbea00640 1 -- 172.21.15.137:0/35631881 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db0003800 con 0x7f9dc8073090 2024-04-26T23:44:31.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dcd000640 1 -- 172.21.15.137:0/35631881 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc80b10f0 con 0x7f9dc8073090 2024-04-26T23:44:31.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.358+0000 7f9dcd000640 1 -- 172.21.15.137:0/35631881 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dc806a4b0 con 0x7f9dc8073090 2024-04-26T23:44:31.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.362+0000 7f9dbea00640 1 -- 172.21.15.137:0/35631881 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9db001a070 con 0x7f9dc8073090 2024-04-26T23:44:31.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.362+0000 7f9dbea00640 1 --2- 172.21.15.137:0/35631881 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9da4068380 0x7f9da406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:31.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.362+0000 7f9dbea00640 1 -- 172.21.15.137:0/35631881 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f9db0085c70 con 0x7f9dc8073090 2024-04-26T23:44:31.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.362+0000 7f9dc5e00640 1 --2- 172.21.15.137:0/35631881 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9da4068380 0x7f9da406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:31.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.362+0000 7f9dc5e00640 1 --2- 172.21.15.137:0/35631881 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9da4068380 0x7f9da406a840 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9db8000f70 tx=0x7f9db8007d10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:31.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.366+0000 7f9dbea00640 1 -- 172.21.15.137:0/35631881 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9db0005480 con 0x7f9dc8073090 2024-04-26T23:44:31.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.558+0000 7f9dcd000640 1 -- 172.21.15.137:0/35631881 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9dc8072380 con 0x7f9dc8073090 2024-04-26T23:44:31.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.562+0000 7f9dbea00640 1 -- 172.21.15.137:0/35631881 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5190 (secure 0 0 0) 0x7f9db0055b40 con 0x7f9dc8073090 2024-04-26T23:44:31.568 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:31.568 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6064,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2903000554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2903000554},{"type":"v1","addr":"172.21.15.170:6834","nonce":2903000554}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6372,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/2879053849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2879053849},{"type":"v1","addr":"172.21.15.137:6836","nonce":2879053849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3081576837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3081576837},{"type":"v1","addr":"172.21.15.137:6837","nonce":3081576837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:44:21.180357+0000","modified":"2024-04-26T23:44:24.204261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6381":{"gid":6381,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/141729149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":141729149},{"type":"v1","addr":"172.21.15.170:6835","nonce":141729149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6381,"qdb_cluster":[6381]},"id":4}]} 2024-04-26T23:44:31.568 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 37 2024-04-26T23:44:31.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.562+0000 7f9dcd000640 1 -- 172.21.15.137:0/35631881 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9da4068380 msgr2=0x7f9da406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:31.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.562+0000 7f9dcd000640 1 --2- 172.21.15.137:0/35631881 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9da4068380 0x7f9da406a840 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9db8000f70 tx=0x7f9db8007d10 comp rx=0 tx=0).stop 2024-04-26T23:44:31.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.562+0000 7f9dcd000640 1 -- 172.21.15.137:0/35631881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dc8073090 msgr2=0x7f9dc80b2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:31.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.562+0000 7f9dcd000640 1 --2- 172.21.15.137:0/35631881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dc8073090 0x7f9dc80b2570 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9db000c4d0 tx=0x7f9db000c990 comp rx=0 tx=0).stop 2024-04-26T23:44:31.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.562+0000 7f9dcd000640 1 -- 172.21.15.137:0/35631881 shutdown_connections 2024-04-26T23:44:31.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.562+0000 7f9dcd000640 1 --2- 172.21.15.137:0/35631881 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9da4068380 0x7f9da406a840 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:31.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.562+0000 7f9dcd000640 1 --2- 172.21.15.137:0/35631881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dc8073090 0x7f9dc80b2570 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:31.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.562+0000 7f9dcd000640 1 --2- 172.21.15.137:0/35631881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9dc80b5080 0x7f9dc815aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:31.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.562+0000 7f9dcd000640 1 --2- 172.21.15.137:0/35631881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dc80725a0 0x7f9dc813ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:31.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.562+0000 7f9dcd000640 1 -- 172.21.15.137:0/35631881 >> 172.21.15.137:0/35631881 conn(0x7f9dc806c5d0 msgr2=0x7f9dc806c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:31.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.562+0000 7f9dcd000640 1 -- 172.21.15.137:0/35631881 shutdown_connections 2024-04-26T23:44:31.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:31.562+0000 7f9dcd000640 1 -- 172.21.15.137:0/35631881 wait complete. 2024-04-26T23:44:31.991 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T23:44:21.180357+0000', 'modified': '2024-04-26T23:44:24.204261+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6381}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6381': {'gid': 6381, 'name': 'b', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.170:6835/141729149', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6833', 'nonce': 141729149}, {'type': 'v1', 'addr': '172.21.15.170:6835', 'nonce': 141729149}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6381, 'qdb_cluster': [6381]} 2024-04-26T23:44:31.991 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T23:44:31.991 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T23:44:32.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.122+0000 7f38f4a00640 1 Processor -- start 2024-04-26T23:44:32.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.122+0000 7f38f4a00640 1 -- start start 2024-04-26T23:44:32.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.126+0000 7f38f4a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f38f01596f0 0x7f38f015f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.126+0000 7f38f4a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f0073040 0x7f38f00afb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.126+0000 7f38f4a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38f0159ad0 con 0x7f38f00b5290 2024-04-26T23:44:32.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.126+0000 7f38f4a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f38f00b5a70 con 0x7f38f01596f0 2024-04-26T23:44:32.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.126+0000 7f38f4a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f38f00b5d50 con 0x7f38f0073040 2024-04-26T23:44:32.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.126+0000 7f38e5400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f38f00b5290 0x7f38f0072930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32856/0 (socket says 172.21.15.137:32856) 2024-04-26T23:44:32.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.126+0000 7f38e5400640 1 -- 172.21.15.137:0/1587934663 learned_addr learned my addr 172.21.15.137:0/1587934663 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:32.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.126+0000 7f38ede00640 1 --2- 172.21.15.137:0/1587934663 >> v2:172.21.15.170:3300/0 conn(0x7f38f01596f0 0x7f38f015f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.126+0000 7f38ee800640 1 --2- 172.21.15.137:0/1587934663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f0073040 0x7f38f00afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.126+0000 7f38ed400640 1 -- 172.21.15.137:0/1587934663 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1523399978 0 0) 0x7f38f0159ad0 con 0x7f38f00b5290 2024-04-26T23:44:32.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.126+0000 7f38ed400640 1 -- 172.21.15.137:0/1587934663 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38d4003530 con 0x7f38f00b5290 2024-04-26T23:44:32.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.126+0000 7f38ede00640 1 -- 172.21.15.137:0/1587934663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f0073040 msgr2=0x7f38f00afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:32.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.126+0000 7f38ede00640 1 --2- 172.21.15.137:0/1587934663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f0073040 0x7f38f00afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.126+0000 7f38ede00640 1 -- 172.21.15.137:0/1587934663 >> v1:172.21.15.137:6789/0 conn(0x7f38f00b5290 legacy=0x7f38f0072930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:32.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.126+0000 7f38ed400640 1 -- 172.21.15.137:0/1587934663 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3189061855 0 0) 0x7f38d4003530 con 0x7f38f00b5290 2024-04-26T23:44:32.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.126+0000 7f38ede00640 1 -- 172.21.15.137:0/1587934663 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38f00b6030 con 0x7f38f01596f0 2024-04-26T23:44:32.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.130+0000 7f38ede00640 1 --2- 172.21.15.137:0/1587934663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38f01596f0 0x7f38f015f630 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f38e00097c0 tx=0x7f38e001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1513e794c7428758 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:32.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.130+0000 7f38ed400640 1 -- 172.21.15.137:0/1587934663 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e00b0070 con 0x7f38f01596f0 2024-04-26T23:44:32.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.130+0000 7f38ed400640 1 -- 172.21.15.137:0/1587934663 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38e00ab400 con 0x7f38f01596f0 2024-04-26T23:44:32.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.130+0000 7f38ed400640 1 -- 172.21.15.137:0/1587934663 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8001680 con 0x7f38f01596f0 2024-04-26T23:44:32.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.130+0000 7f38f4a00640 1 -- 172.21.15.137:0/1587934663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38f01596f0 msgr2=0x7f38f015f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:32.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.130+0000 7f38f4a00640 1 --2- 172.21.15.137:0/1587934663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38f01596f0 0x7f38f015f630 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f38e00097c0 tx=0x7f38e001c3c0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.130+0000 7f38f4a00640 1 -- 172.21.15.137:0/1587934663 shutdown_connections 2024-04-26T23:44:32.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.130+0000 7f38f4a00640 1 --2- 172.21.15.137:0/1587934663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f0073040 0x7f38f00afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.130+0000 7f38f4a00640 1 --2- 172.21.15.137:0/1587934663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38f01596f0 0x7f38f015f630 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.130+0000 7f38f4a00640 1 -- 172.21.15.137:0/1587934663 >> 172.21.15.137:0/1587934663 conn(0x7f38f00b3370 msgr2=0x7f38f00b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:32.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.130+0000 7f38f4a00640 1 -- 172.21.15.137:0/1587934663 shutdown_connections 2024-04-26T23:44:32.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.130+0000 7f38f4a00640 1 -- 172.21.15.137:0/1587934663 wait complete. 2024-04-26T23:44:32.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.130+0000 7f38f4a00640 1 Processor -- start 2024-04-26T23:44:32.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.130+0000 7f38f4a00640 1 -- start start 2024-04-26T23:44:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38f4a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f0073040 0x7f38f014b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38f4a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38f00b5290 0x7f38f0155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38f4a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38f01596f0 0x7f38f014edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38f4a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f38f00b09e0 con 0x7f38f01596f0 2024-04-26T23:44:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38f4a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f38f00b0860 con 0x7f38f00b5290 2024-04-26T23:44:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38f4a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f38f00b0b60 con 0x7f38f0073040 2024-04-26T23:44:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38ee800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38f01596f0 0x7f38f014edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38ee800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38f01596f0 0x7f38f014edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35868/0 (socket says 172.21.15.137:35868) 2024-04-26T23:44:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38ee800640 1 -- 172.21.15.137:0/3946875929 learned_addr learned my addr 172.21.15.137:0/3946875929 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38ede00640 1 --2- 172.21.15.137:0/3946875929 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f0073040 0x7f38f014b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38e5400640 1 --2- 172.21.15.137:0/3946875929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38f00b5290 0x7f38f0155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38ee800640 1 -- 172.21.15.137:0/3946875929 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f0073040 msgr2=0x7f38f014b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:32.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38ee800640 1 --2- 172.21.15.137:0/3946875929 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f0073040 0x7f38f014b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38ee800640 1 -- 172.21.15.137:0/3946875929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38f00b5290 msgr2=0x7f38f0155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:32.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38ee800640 1 --2- 172.21.15.137:0/3946875929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38f00b5290 0x7f38f0155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38ee800640 1 -- 172.21.15.137:0/3946875929 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38f01560c0 con 0x7f38f01596f0 2024-04-26T23:44:32.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38ee800640 1 --2- 172.21.15.137:0/3946875929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38f01596f0 0x7f38f014edd0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f38e800efc0 tx=0x7f38e800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:32.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38e6a00640 1 -- 172.21.15.137:0/3946875929 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e8018020 con 0x7f38f01596f0 2024-04-26T23:44:32.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38e6a00640 1 -- 172.21.15.137:0/3946875929 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38e8014480 con 0x7f38f01596f0 2024-04-26T23:44:32.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38f4a00640 1 -- 172.21.15.137:0/3946875929 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38f01563a0 con 0x7f38f01596f0 2024-04-26T23:44:32.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38e6a00640 1 -- 172.21.15.137:0/3946875929 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e8014870 con 0x7f38f01596f0 2024-04-26T23:44:32.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38f4a00640 1 -- 172.21.15.137:0/3946875929 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38f014bc30 con 0x7f38f01596f0 2024-04-26T23:44:32.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.134+0000 7f38e6a00640 1 -- 172.21.15.137:0/3946875929 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f38e801b020 con 0x7f38f01596f0 2024-04-26T23:44:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38e6a00640 1 --2- 172.21.15.137:0/3946875929 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f38cc068380 0x7f38cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38e6a00640 1 -- 172.21.15.137:0/3946875929 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f38e80877d0 con 0x7f38f01596f0 2024-04-26T23:44:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38ede00640 1 --2- 172.21.15.137:0/3946875929 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f38cc068380 0x7f38cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38f7eb5000 1 Processor -- start 2024-04-26T23:44:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38f7eb5000 1 -- start start 2024-04-26T23:44:32.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38ede00640 1 --2- 172.21.15.137:0/3946875929 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f38cc068380 0x7f38cc06a840 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f38e00ad000 tx=0x7f38e00a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:32.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38f7eb5000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a98221c700 0x55a98221cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38f7eb5000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a98221d020 0x55a9821d3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38f7eb5000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9821d3740 0x55a9821d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38f7eb5000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a98208b140 con 0x55a98221d020 2024-04-26T23:44:32.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38f7eb5000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a982020e00 con 0x55a9821d3740 2024-04-26T23:44:32.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38f7eb5000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a981fd9a00 con 0x55a98221c700 2024-04-26T23:44:32.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38e5400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a98221d020 0x55a9821d3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38e5400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a98221d020 0x55a9821d3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35870/0 (socket says 172.21.15.137:35870) 2024-04-26T23:44:32.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38e5400640 1 -- 172.21.15.137:0/333993153 learned_addr learned my addr 172.21.15.137:0/333993153 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:32.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38ede00640 1 --2- 172.21.15.137:0/333993153 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a98221c700 0x55a98221cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38ee800640 1 --2- 172.21.15.137:0/333993153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9821d3740 0x55a9821d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38e5400640 1 -- 172.21.15.137:0/333993153 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a98221c700 msgr2=0x55a98221cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:32.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38e5400640 1 --2- 172.21.15.137:0/333993153 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a98221c700 0x55a98221cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38e5400640 1 -- 172.21.15.137:0/333993153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9821d3740 msgr2=0x55a9821d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:32.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38e5400640 1 --2- 172.21.15.137:0/333993153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9821d3740 0x55a9821d3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38e5400640 1 -- 172.21.15.137:0/333993153 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a981fde0e0 con 0x55a98221d020 2024-04-26T23:44:32.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38ee800640 1 --2- 172.21.15.137:0/333993153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9821d3740 0x55a9821d3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:32.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38e5400640 1 --2- 172.21.15.137:0/333993153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a98221d020 0x55a9821d3200 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f38d80017e0 tx=0x7f38d8007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d944cfbd043532fc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:32.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38dea00640 1 -- 172.21.15.137:0/333993153 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8019070 con 0x55a98221d020 2024-04-26T23:44:32.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38dea00640 1 -- 172.21.15.137:0/333993153 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38d8005af0 con 0x55a98221d020 2024-04-26T23:44:32.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.138+0000 7f38dea00640 1 -- 172.21.15.137:0/333993153 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d80070d0 con 0x55a98221d020 2024-04-26T23:44:32.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38f7eb5000 1 -- 172.21.15.137:0/333993153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a98221d020 msgr2=0x55a9821d3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:32.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38f7eb5000 1 --2- 172.21.15.137:0/333993153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a98221d020 0x55a9821d3200 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f38d80017e0 tx=0x7f38d8007d90 comp rx=0 tx=0).stop 2024-04-26T23:44:32.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38f7eb5000 1 -- 172.21.15.137:0/333993153 shutdown_connections 2024-04-26T23:44:32.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38f7eb5000 1 --2- 172.21.15.137:0/333993153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a98221d020 0x55a9821d3200 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38f7eb5000 1 --2- 172.21.15.137:0/333993153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9821d3740 0x55a9821d3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38f7eb5000 1 --2- 172.21.15.137:0/333993153 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a98221c700 0x55a98221cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38f7eb5000 1 -- 172.21.15.137:0/333993153 >> 172.21.15.137:0/333993153 conn(0x55a9821cf6f0 msgr2=0x55a9821d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:32.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38f7eb5000 1 -- 172.21.15.137:0/333993153 shutdown_connections 2024-04-26T23:44:32.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38f7eb5000 1 -- 172.21.15.137:0/333993153 wait complete. 2024-04-26T23:44:32.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38f7eb5000 1 -- start start 2024-04-26T23:44:32.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38f7eb5000 1 Processor -- start 2024-04-26T23:44:32.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38f7eb5000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9821d3740 0x55a9821de0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38f7eb5000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98221c700 0x55a9821de5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38f7eb5000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a98221d020 0x55a9821deb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38f7eb5000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a98202e200 con 0x55a9821d3740 2024-04-26T23:44:32.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38f7eb5000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a981fc4e80 con 0x55a98221c700 2024-04-26T23:44:32.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38f7eb5000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a98201bae0 con 0x55a98221d020 2024-04-26T23:44:32.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38f7eb5000 10 client.0 _ll_register_callbacks cb 0x55a98202dda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:44:32.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38ede00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9821d3740 0x55a9821de0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38ede00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9821d3740 0x55a9821de0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35874/0 (socket says 172.21.15.137:35874) 2024-04-26T23:44:32.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38ede00640 1 -- 172.21.15.137:0/3247888359 learned_addr learned my addr 172.21.15.137:0/3247888359 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:32.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38ede00640 1 -- 172.21.15.137:0/3247888359 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a98221d020 msgr2=0x55a9821deb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:32.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38ede00640 1 --2- 172.21.15.137:0/3247888359 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a98221d020 0x55a9821deb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38ede00640 1 -- 172.21.15.137:0/3247888359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98221c700 msgr2=0x55a9821de5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:32.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38ede00640 1 --2- 172.21.15.137:0/3247888359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98221c700 0x55a9821de5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38ede00640 1 -- 172.21.15.137:0/3247888359 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a981fc04e0 con 0x55a9821d3740 2024-04-26T23:44:32.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38ede00640 1 --2- 172.21.15.137:0/3247888359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9821d3740 0x55a9821de0a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f38e001aa70 tx=0x7f38e001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3fa73edcfe5316 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:32.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38d3400640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T23:44:32.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38d3400640 1 -- 172.21.15.137:0/3247888359 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e00b0040 con 0x55a9821d3740 2024-04-26T23:44:32.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38f7eb5000 1 -- 172.21.15.137:0/3247888359 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38d8005af0 con 0x55a9821d3740 2024-04-26T23:44:32.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38d3400640 1 -- 172.21.15.137:0/3247888359 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f38e00c3440 con 0x55a9821d3740 2024-04-26T23:44:32.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38d3400640 1 -- 172.21.15.137:0/3247888359 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f38e00d2050 con 0x55a9821d3740 2024-04-26T23:44:32.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38f7eb5000 10 client.6534 fetch_fsmap learned FSMap version 37 2024-04-26T23:44:32.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.142+0000 7f38f7eb5000 1 -- 172.21.15.137:0/3247888359 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) -- 0x55a981fa6e80 con 0x55a9821d3740 2024-04-26T23:44:32.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38d3400640 1 -- 172.21.15.137:0/3247888359 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38d8005af0 con 0x55a9821d3740 2024-04-26T23:44:32.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38d3400640 1 -- 172.21.15.137:0/3247888359 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 37) ==== 3494+0+0 (secure 0 0 0) 0x7f38e00d5020 con 0x55a9821d3740 2024-04-26T23:44:32.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38f7eb5000 10 client.6534 fetch_fsmap finished waiting for FSMap version 37 2024-04-26T23:44:32.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38f7eb5000 10 client.6534 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T23:44:32.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38f7eb5000 20 client.6534 populate_metadata read hostname 'smithi137' 2024-04-26T23:44:32.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38f7eb5000 1 --2- 172.21.15.137:0/3247888359 >> [v2:172.21.15.170:6833/141729149,v1:172.21.15.170:6835/141729149] conn(0x55a9821df530 0x55a98222e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38f7eb5000 4 client.6534 mds_command: new command op to 6381 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T23:44:32.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38f7eb5000 1 -- 172.21.15.137:0/3247888359 --> [v2:172.21.15.170:6833/141729149,v1:172.21.15.170:6835/141729149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a981fb9bc0 con 0x55a9821df530 2024-04-26T23:44:32.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38e5400640 1 --2- 172.21.15.137:0/3247888359 >> [v2:172.21.15.170:6833/141729149,v1:172.21.15.170:6835/141729149] conn(0x55a9821df530 0x55a98222e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38d3400640 10 client.6534 ms_handle_connect on v2:172.21.15.170:6833/141729149 2024-04-26T23:44:32.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38e5400640 1 --2- 172.21.15.137:0/3247888359 >> [v2:172.21.15.170:6833/141729149,v1:172.21.15.170:6835/141729149] conn(0x55a9821df530 0x55a98222e7b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec3d509faa003b0 server_cookie=9595c9eb63a2458e in_seq=0 out_seq=0 2024-04-26T23:44:32.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38d3400640 1 -- 172.21.15.137:0/3247888359 <== mds.0 v2:172.21.15.170:6833/141729149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a981fb9bc0 con 0x55a9821df530 2024-04-26T23:44:32.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38d3400640 10 client.6534 handle_command_reply: tid=0 2024-04-26T23:44:32.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38f7eb5000 1 client.6534 shutdown 2024-04-26T23:44:32.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38f7eb5000 1 -- 172.21.15.137:0/3247888359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9821d3740 msgr2=0x55a9821de0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:32.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38f7eb5000 1 --2- 172.21.15.137:0/3247888359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9821d3740 0x55a9821de0a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f38e001aa70 tx=0x7f38e001ac00 comp rx=0 tx=0).stop 2024-04-26T23:44:32.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38f7eb5000 1 -- 172.21.15.137:0/3247888359 shutdown_connections 2024-04-26T23:44:32.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38f7eb5000 1 --2- 172.21.15.137:0/3247888359 >> [v2:172.21.15.170:6833/141729149,v1:172.21.15.170:6835/141729149] conn(0x55a9821df530 0x55a98222e7b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38f7eb5000 1 --2- 172.21.15.137:0/3247888359 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a98221d020 0x55a9821deb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38f7eb5000 1 --2- 172.21.15.137:0/3247888359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98221c700 0x55a9821de5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38f7eb5000 1 --2- 172.21.15.137:0/3247888359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9821d3740 0x55a9821de0a0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38d3400640 0 client.6534 ms_handle_reset on v2:172.21.15.170:6833/141729149 2024-04-26T23:44:32.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38f7eb5000 1 -- 172.21.15.137:0/3247888359 >> 172.21.15.137:0/3247888359 conn(0x55a9821cf6f0 msgr2=0x55a9821d2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:32.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38f7eb5000 1 -- 172.21.15.137:0/3247888359 shutdown_connections 2024-04-26T23:44:32.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38f7eb5000 1 -- 172.21.15.137:0/3247888359 wait complete. 2024-04-26T23:44:32.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.146+0000 7f38f7eb5000 20 client.6534 trim_cache size 0 max 16384 2024-04-26T23:44:32.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38f7eb5000 1 Processor -- start 2024-04-26T23:44:32.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38f7eb5000 1 -- start start 2024-04-26T23:44:32.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38f7eb5000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9821d3740 0x55a9821d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38f7eb5000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98221c700 0x55a9821d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38f7eb5000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a98221d020 0x55a9821d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38f7eb5000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f38f01550a0 con 0x55a9821d3740 2024-04-26T23:44:32.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38f7eb5000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f38f014d280 con 0x55a98221c700 2024-04-26T23:44:32.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38f7eb5000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f38f0154a50 con 0x55a98221d020 2024-04-26T23:44:32.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38ede00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9821d3740 0x55a9821d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38ede00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9821d3740 0x55a9821d1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35882/0 (socket says 172.21.15.137:35882) 2024-04-26T23:44:32.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38ede00640 1 -- 172.21.15.137:0/2686438208 learned_addr learned my addr 172.21.15.137:0/2686438208 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:32.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38ee800640 1 --2- 172.21.15.137:0/2686438208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a98221d020 0x55a9821d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38e5400640 1 --2- 172.21.15.137:0/2686438208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98221c700 0x55a9821d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38ede00640 1 -- 172.21.15.137:0/2686438208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a98221d020 msgr2=0x55a9821d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:32.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38ede00640 1 --2- 172.21.15.137:0/2686438208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a98221d020 0x55a9821d2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38ede00640 1 -- 172.21.15.137:0/2686438208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98221c700 msgr2=0x55a9821d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:32.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38ede00640 1 --2- 172.21.15.137:0/2686438208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98221c700 0x55a9821d2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38ede00640 1 -- 172.21.15.137:0/2686438208 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a981fd9c50 con 0x55a9821d3740 2024-04-26T23:44:32.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38e5400640 1 --2- 172.21.15.137:0/2686438208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98221c700 0x55a9821d2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:32.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38ede00640 1 --2- 172.21.15.137:0/2686438208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9821d3740 0x55a9821d1ae0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f38e00096c0 tx=0x7f38e00c1000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab72e04ed80000e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:32.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38de000640 1 -- 172.21.15.137:0/2686438208 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e00b0050 con 0x55a9821d3740 2024-04-26T23:44:32.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38de000640 1 -- 172.21.15.137:0/2686438208 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38e00ca070 con 0x55a9821d3740 2024-04-26T23:44:32.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38de000640 1 -- 172.21.15.137:0/2686438208 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e00c39c0 con 0x55a9821d3740 2024-04-26T23:44:32.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38f7eb5000 1 -- 172.21.15.137:0/2686438208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9821d3740 msgr2=0x55a9821d1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:32.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38f7eb5000 1 --2- 172.21.15.137:0/2686438208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9821d3740 0x55a9821d1ae0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f38e00096c0 tx=0x7f38e00c1000 comp rx=0 tx=0).stop 2024-04-26T23:44:32.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38f7eb5000 1 -- 172.21.15.137:0/2686438208 shutdown_connections 2024-04-26T23:44:32.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38f7eb5000 1 --2- 172.21.15.137:0/2686438208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a98221d020 0x55a9821d2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38f7eb5000 1 --2- 172.21.15.137:0/2686438208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98221c700 0x55a9821d2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38f7eb5000 1 --2- 172.21.15.137:0/2686438208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9821d3740 0x55a9821d1ae0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38f7eb5000 1 -- 172.21.15.137:0/2686438208 >> 172.21.15.137:0/2686438208 conn(0x55a9821cf6f0 msgr2=0x55a9821de930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:32.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38f7eb5000 1 -- 172.21.15.137:0/2686438208 shutdown_connections 2024-04-26T23:44:32.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38f7eb5000 1 -- 172.21.15.137:0/2686438208 wait complete. 2024-04-26T23:44:32.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38f7eb5000 1 -- start start 2024-04-26T23:44:32.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.166+0000 7f38f7eb5000 1 Processor -- start 2024-04-26T23:44:32.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9821d3740 0x55a982230f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a98221c700 0x55a982231470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a98221d020 0x55a982248340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a982020110 con 0x55a98221d020 2024-04-26T23:44:32.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a981fb67b0 con 0x55a9821d3740 2024-04-26T23:44:32.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a982025430 con 0x55a98221c700 2024-04-26T23:44:32.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 10 client.0 _ll_register_callbacks cb 0x7f38e80095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:44:32.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38ee800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a98221d020 0x55a982248340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38ee800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a98221d020 0x55a982248340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35884/0 (socket says 172.21.15.137:35884) 2024-04-26T23:44:32.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38ee800640 1 -- 172.21.15.137:0/2916400936 learned_addr learned my addr 172.21.15.137:0/2916400936 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:32.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38e5400640 1 --2- 172.21.15.137:0/2916400936 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a98221c700 0x55a982231470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38ede00640 1 --2- 172.21.15.137:0/2916400936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9821d3740 0x55a982230f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38ee800640 1 -- 172.21.15.137:0/2916400936 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a98221c700 msgr2=0x55a982231470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:32.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38ee800640 1 --2- 172.21.15.137:0/2916400936 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a98221c700 0x55a982231470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38ee800640 1 -- 172.21.15.137:0/2916400936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9821d3740 msgr2=0x55a982230f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:32.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38ee800640 1 --2- 172.21.15.137:0/2916400936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9821d3740 0x55a982230f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38ee800640 1 -- 172.21.15.137:0/2916400936 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9820a3160 con 0x55a98221d020 2024-04-26T23:44:32.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38ee800640 1 --2- 172.21.15.137:0/2916400936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a98221d020 0x55a982248340 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f38e800ef90 tx=0x7f38e80570d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4be45829c94a5cf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:32.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38d3400640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T23:44:32.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38d3400640 1 -- 172.21.15.137:0/2916400936 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e8074060 con 0x55a98221d020 2024-04-26T23:44:32.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 1 -- 172.21.15.137:0/2916400936 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38e00ca070 con 0x55a98221d020 2024-04-26T23:44:32.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38d3400640 1 -- 172.21.15.137:0/2916400936 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f38e805cbc0 con 0x55a98221d020 2024-04-26T23:44:32.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38d3400640 1 -- 172.21.15.137:0/2916400936 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f38e8084050 con 0x55a98221d020 2024-04-26T23:44:32.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 10 client.6540 fetch_fsmap learned FSMap version 37 2024-04-26T23:44:32.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 1 -- 172.21.15.137:0/2916400936 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) -- 0x55a981cda0c0 con 0x55a98221d020 2024-04-26T23:44:32.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38d3400640 1 -- 172.21.15.137:0/2916400936 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38e00ca070 con 0x55a98221d020 2024-04-26T23:44:32.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38d3400640 1 -- 172.21.15.137:0/2916400936 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 37) ==== 3494+0+0 (secure 0 0 0) 0x7f38e8056ad0 con 0x55a98221d020 2024-04-26T23:44:32.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 10 client.6540 fetch_fsmap finished waiting for FSMap version 37 2024-04-26T23:44:32.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 10 client.6540 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T23:44:32.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 20 client.6540 populate_metadata read hostname 'smithi137' 2024-04-26T23:44:32.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 1 --2- 172.21.15.137:0/2916400936 >> [v2:172.21.15.170:6833/141729149,v1:172.21.15.170:6835/141729149] conn(0x55a9822917a0 0x55a982293b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 4 client.6540 mds_command: new command op to 6381 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T23:44:32.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 1 -- 172.21.15.137:0/2916400936 --> [v2:172.21.15.170:6833/141729149,v1:172.21.15.170:6835/141729149] -- command(tid 0: {"prefix": "status"}) -- 0x55a98202ea10 con 0x55a9822917a0 2024-04-26T23:44:32.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38ede00640 1 --2- 172.21.15.137:0/2916400936 >> [v2:172.21.15.170:6833/141729149,v1:172.21.15.170:6835/141729149] conn(0x55a9822917a0 0x55a982293b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38d3400640 10 client.6540 ms_handle_connect on v2:172.21.15.170:6833/141729149 2024-04-26T23:44:32.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38ede00640 1 --2- 172.21.15.137:0/2916400936 >> [v2:172.21.15.170:6833/141729149,v1:172.21.15.170:6835/141729149] conn(0x55a9822917a0 0x55a982293b90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0f9934cfe8851b1 server_cookie=5a84bd2d972e9cbf in_seq=0 out_seq=0 2024-04-26T23:44:32.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38d3400640 1 -- 172.21.15.137:0/2916400936 <== mds.0 v2:172.21.15.170:6833/141729149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55a98202ea10 con 0x55a9822917a0 2024-04-26T23:44:32.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38d3400640 10 client.6540 handle_command_reply: tid=0 2024-04-26T23:44:32.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 1 client.6540 shutdown 2024-04-26T23:44:32.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 1 -- 172.21.15.137:0/2916400936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a98221d020 msgr2=0x55a982248340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:32.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 1 --2- 172.21.15.137:0/2916400936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a98221d020 0x55a982248340 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f38e800ef90 tx=0x7f38e80570d0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 1 -- 172.21.15.137:0/2916400936 shutdown_connections 2024-04-26T23:44:32.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 1 --2- 172.21.15.137:0/2916400936 >> [v2:172.21.15.170:6833/141729149,v1:172.21.15.170:6835/141729149] conn(0x55a9822917a0 0x55a982293b90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 1 --2- 172.21.15.137:0/2916400936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a98221d020 0x55a982248340 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 1 --2- 172.21.15.137:0/2916400936 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a98221c700 0x55a982231470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 1 --2- 172.21.15.137:0/2916400936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9821d3740 0x55a982230f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38d3400640 0 client.6540 ms_handle_reset on v2:172.21.15.170:6833/141729149 2024-04-26T23:44:32.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.170+0000 7f38f7eb5000 1 -- 172.21.15.137:0/2916400936 >> 172.21.15.137:0/2916400936 conn(0x55a9821cf6f0 msgr2=0x55a982229460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:32.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.174+0000 7f38f7eb5000 1 -- 172.21.15.137:0/2916400936 shutdown_connections 2024-04-26T23:44:32.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.174+0000 7f38f7eb5000 1 -- 172.21.15.137:0/2916400936 wait complete. 2024-04-26T23:44:32.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.174+0000 7f38f7eb5000 20 client.6540 trim_cache size 0 max 16384 2024-04-26T23:44:32.184 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:44:32.184 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "efde6204-be0d-4c4f-9ea0-954d26627e78", 2024-04-26T23:44:32.184 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 0, 2024-04-26T23:44:32.184 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 6381, 2024-04-26T23:44:32.184 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-26T23:44:32.184 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-26T23:44:32.184 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-26T23:44:32.185 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 10.362735288, 2024-04-26T23:44:32.185 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 37, 2024-04-26T23:44:32.185 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 60, 2024-04-26T23:44:32.185 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 60, 2024-04-26T23:44:32.185 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 16.226212758999999 2024-04-26T23:44:32.185 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:44:32.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.174+0000 7f38f4a00640 1 -- 172.21.15.137:0/3946875929 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f38cc068380 msgr2=0x7f38cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:32.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.174+0000 7f38f4a00640 1 --2- 172.21.15.137:0/3946875929 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f38cc068380 0x7f38cc06a840 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f38e00ad000 tx=0x7f38e00a6000 comp rx=0 tx=0).stop 2024-04-26T23:44:32.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.174+0000 7f38f4a00640 1 -- 172.21.15.137:0/3946875929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38f01596f0 msgr2=0x7f38f014edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:32.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.174+0000 7f38f4a00640 1 --2- 172.21.15.137:0/3946875929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38f01596f0 0x7f38f014edd0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f38e800efc0 tx=0x7f38e800c490 comp rx=0 tx=0).stop 2024-04-26T23:44:32.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.174+0000 7f38f4a00640 1 -- 172.21.15.137:0/3946875929 shutdown_connections 2024-04-26T23:44:32.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.174+0000 7f38f4a00640 1 --2- 172.21.15.137:0/3946875929 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f38cc068380 0x7f38cc06a840 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.174+0000 7f38f4a00640 1 --2- 172.21.15.137:0/3946875929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38f01596f0 0x7f38f014edd0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.174+0000 7f38f4a00640 1 --2- 172.21.15.137:0/3946875929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38f00b5290 0x7f38f0155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.174+0000 7f38f4a00640 1 --2- 172.21.15.137:0/3946875929 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f0073040 0x7f38f014b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.174+0000 7f38f4a00640 1 -- 172.21.15.137:0/3946875929 >> 172.21.15.137:0/3946875929 conn(0x7f38f00b3370 msgr2=0x7f38f0161fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:32.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.174+0000 7f38f4a00640 1 -- 172.21.15.137:0/3946875929 shutdown_connections 2024-04-26T23:44:32.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.174+0000 7f38f4a00640 1 -- 172.21.15.137:0/3946875929 wait complete. 2024-04-26T23:44:32.199 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:44:32.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.326+0000 7f3dc3000640 1 Processor -- start 2024-04-26T23:44:32.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.326+0000 7f3dc3000640 1 -- start start 2024-04-26T23:44:32.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dc3000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3dbc15de80 0x7f3dbc073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dc3000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dbc073010 con 0x7f3dbc0ce3e0 2024-04-26T23:44:32.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dc3000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dbc0cef90 con 0x7f3dbc0ce7c0 2024-04-26T23:44:32.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dc3000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f3dbc073280 con 0x7f3dbc15de80 2024-04-26T23:44:32.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dbbe00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f3dbc0ce3e0 0x7f3dbc0d04e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32872/0 (socket says 172.21.15.137:32872) 2024-04-26T23:44:32.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dbbe00640 1 -- 172.21.15.137:0/4242635461 learned_addr learned my addr 172.21.15.137:0/4242635461 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:32.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dbaa00640 1 -- 172.21.15.137:0/4242635461 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2513655559 0 0) 0x7f3dbc073010 con 0x7f3dbc0ce3e0 2024-04-26T23:44:32.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dbb400640 1 --2- 172.21.15.137:0/4242635461 >> v2:172.21.15.170:3300/0 conn(0x7f3dbc15de80 0x7f3dbc073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dbaa00640 1 -- 172.21.15.137:0/4242635461 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3da0003530 con 0x7f3dbc0ce3e0 2024-04-26T23:44:32.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dbaa00640 1 -- 172.21.15.137:0/4242635461 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 672483323 0 0) 0x7f3da0003530 con 0x7f3dbc0ce3e0 2024-04-26T23:44:32.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dbaa00640 1 -- 172.21.15.137:0/4242635461 >> v2:172.21.15.170:3300/0 conn(0x7f3dbc15de80 msgr2=0x7f3dbc073d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:32.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dbaa00640 1 --2- 172.21.15.137:0/4242635461 >> v2:172.21.15.170:3300/0 conn(0x7f3dbc15de80 0x7f3dbc073d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dbaa00640 1 -- 172.21.15.137:0/4242635461 >> v1:172.21.15.170:6789/0 conn(0x7f3dbc0ce7c0 legacy=0x7f3dbc146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:32.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dbaa00640 1 -- 172.21.15.137:0/4242635461 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dbc073560 con 0x7f3dbc0ce3e0 2024-04-26T23:44:32.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dbaa00640 1 -- 172.21.15.137:0/4242635461 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f3dac001a00 con 0x7f3dbc0ce3e0 2024-04-26T23:44:32.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dbaa00640 1 -- 172.21.15.137:0/4242635461 >> v1:172.21.15.137:6789/0 conn(0x7f3dbc0ce3e0 legacy=0x7f3dbc0d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:32.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dbaa00640 1 --2- 172.21.15.137:0/4242635461 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3da00039f0 0x7f3da0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dbaa00640 1 --2- 172.21.15.137:0/4242635461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3da0004810 0x7f3da0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dbaa00640 1 --2- 172.21.15.137:0/4242635461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3da00051d0 0x7f3da000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dbaa00640 1 -- 172.21.15.137:0/4242635461 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc073280 con 0x7f3da00051d0 2024-04-26T23:44:32.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dbaa00640 1 -- 172.21.15.137:0/4242635461 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3da000c0a0 con 0x7f3da0004810 2024-04-26T23:44:32.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dbaa00640 1 -- 172.21.15.137:0/4242635461 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3da000c2a0 con 0x7f3da00039f0 2024-04-26T23:44:32.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dbb400640 1 --2- 172.21.15.137:0/4242635461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3da0004810 0x7f3da0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dc1000640 1 --2- 172.21.15.137:0/4242635461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3da00051d0 0x7f3da000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dbbe00640 1 --2- 172.21.15.137:0/4242635461 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3da00039f0 0x7f3da0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dc1000640 1 -- 172.21.15.137:0/4242635461 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3da00039f0 msgr2=0x7f3da0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:32.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dc1000640 1 --2- 172.21.15.137:0/4242635461 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3da00039f0 0x7f3da0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dc1000640 1 -- 172.21.15.137:0/4242635461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3da0004810 msgr2=0x7f3da0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:32.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dc1000640 1 --2- 172.21.15.137:0/4242635461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3da0004810 0x7f3da0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dc1000640 1 -- 172.21.15.137:0/4242635461 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da0003530 con 0x7f3da00051d0 2024-04-26T23:44:32.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.330+0000 7f3dbb400640 1 --2- 172.21.15.137:0/4242635461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3da0004810 0x7f3da0004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:44:32.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.334+0000 7f3dc1000640 1 -- 172.21.15.137:0/4242635461 reap_dead start 2024-04-26T23:44:32.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.334+0000 7f3dc1000640 1 --2- 172.21.15.137:0/4242635461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3da00051d0 0x7f3da000b9d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f3db4001780 tx=0x7f3db401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7cb58fa2f53b839 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:32.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.334+0000 7f3dbaa00640 1 -- 172.21.15.137:0/4242635461 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da80096b0 con 0x7f3da00051d0 2024-04-26T23:44:32.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.334+0000 7f3dbaa00640 1 -- 172.21.15.137:0/4242635461 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3db40a9070 con 0x7f3da00051d0 2024-04-26T23:44:32.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.334+0000 7f3dbaa00640 1 -- 172.21.15.137:0/4242635461 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db40013a0 con 0x7f3da00051d0 2024-04-26T23:44:32.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.334+0000 7f3dc3000640 1 -- 172.21.15.137:0/4242635461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3da00051d0 msgr2=0x7f3da000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:32.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.334+0000 7f3dc3000640 1 --2- 172.21.15.137:0/4242635461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3da00051d0 0x7f3da000b9d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f3db4001780 tx=0x7f3db401c420 comp rx=0 tx=0).stop 2024-04-26T23:44:32.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.334+0000 7f3dc3000640 1 -- 172.21.15.137:0/4242635461 shutdown_connections 2024-04-26T23:44:32.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.334+0000 7f3dc3000640 1 --2- 172.21.15.137:0/4242635461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3da00051d0 0x7f3da000b9d0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.334+0000 7f3dc3000640 1 -- 172.21.15.137:0/4242635461 >> 172.21.15.137:0/4242635461 conn(0x7f3dbc06c5d0 msgr2=0x7f3dbc06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:32.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.334+0000 7f3dc3000640 1 -- 172.21.15.137:0/4242635461 shutdown_connections 2024-04-26T23:44:32.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.334+0000 7f3dc3000640 1 -- 172.21.15.137:0/4242635461 wait complete. 2024-04-26T23:44:32.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.334+0000 7f3dc3000640 1 Processor -- start 2024-04-26T23:44:32.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3dc3000640 1 -- start start 2024-04-26T23:44:32.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3dc3000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3da00051d0 0x7f3dbc0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3dc3000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dbc0aff70 0x7f3dbc13a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3dc3000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc0b55a0 0x7f3dbc0b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3dc3000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc15e400 con 0x7f3da00051d0 2024-04-26T23:44:32.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3dc3000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc15e280 con 0x7f3dbc0b55a0 2024-04-26T23:44:32.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3dc3000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3dbc073d60 con 0x7f3dbc0aff70 2024-04-26T23:44:32.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3dbbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3da00051d0 0x7f3dbc0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3dbbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3da00051d0 0x7f3dbc0b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35888/0 (socket says 172.21.15.137:35888) 2024-04-26T23:44:32.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3dbbe00640 1 -- 172.21.15.137:0/854085308 learned_addr learned my addr 172.21.15.137:0/854085308 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:32.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3dbb400640 1 --2- 172.21.15.137:0/854085308 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dbc0aff70 0x7f3dbc13a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3dc1000640 1 --2- 172.21.15.137:0/854085308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc0b55a0 0x7f3dbc0b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3dbbe00640 1 -- 172.21.15.137:0/854085308 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dbc0aff70 msgr2=0x7f3dbc13a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:32.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3dbbe00640 1 --2- 172.21.15.137:0/854085308 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dbc0aff70 0x7f3dbc13a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3dbbe00640 1 -- 172.21.15.137:0/854085308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc0b55a0 msgr2=0x7f3dbc0b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:32.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3dbbe00640 1 --2- 172.21.15.137:0/854085308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc0b55a0 0x7f3dbc0b18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3dbbe00640 1 -- 172.21.15.137:0/854085308 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dbc0b4500 con 0x7f3da00051d0 2024-04-26T23:44:32.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3dbbe00640 1 --2- 172.21.15.137:0/854085308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3da00051d0 0x7f3dbc0b3e90 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0079a0 tx=0x7f3dac00a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:32.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3db3e00640 1 -- 172.21.15.137:0/854085308 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac017020 con 0x7f3da00051d0 2024-04-26T23:44:32.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3db3e00640 1 -- 172.21.15.137:0/854085308 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dac0079d0 con 0x7f3da00051d0 2024-04-26T23:44:32.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3db3e00640 1 -- 172.21.15.137:0/854085308 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac013630 con 0x7f3da00051d0 2024-04-26T23:44:32.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3dc3000640 1 -- 172.21.15.137:0/854085308 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dbc0b47e0 con 0x7f3da00051d0 2024-04-26T23:44:32.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3dc3000640 1 -- 172.21.15.137:0/854085308 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dbc0b4da0 con 0x7f3da00051d0 2024-04-26T23:44:32.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.338+0000 7f3dc3000640 1 -- 172.21.15.137:0/854085308 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dbc06a4b0 con 0x7f3da00051d0 2024-04-26T23:44:32.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.342+0000 7f3db3e00640 1 -- 172.21.15.137:0/854085308 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3dac01a020 con 0x7f3da00051d0 2024-04-26T23:44:32.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.342+0000 7f3db3e00640 1 --2- 172.21.15.137:0/854085308 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3d9c068380 0x7f3d9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:32.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.342+0000 7f3db3e00640 1 -- 172.21.15.137:0/854085308 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f3dac0873b0 con 0x7f3da00051d0 2024-04-26T23:44:32.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.342+0000 7f3dbb400640 1 --2- 172.21.15.137:0/854085308 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3d9c068380 0x7f3d9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:32.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.342+0000 7f3dbb400640 1 --2- 172.21.15.137:0/854085308 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3d9c068380 0x7f3d9c06a840 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc154290 tx=0x7f3da8009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:32.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.346+0000 7f3db3e00640 1 -- 172.21.15.137:0/854085308 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3dac021020 con 0x7f3da00051d0 2024-04-26T23:44:32.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.534+0000 7f3dc3000640 1 -- 172.21.15.137:0/854085308 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3dbc1618f0 con 0x7f3da00051d0 2024-04-26T23:44:32.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.538+0000 7f3db3e00640 1 -- 172.21.15.137:0/854085308 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) ==== 53+0+73 (secure 0 0 0) 0x7f3dac057960 con 0x7f3da00051d0 2024-04-26T23:44:32.544 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:44:32.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.538+0000 7f3dc3000640 1 -- 172.21.15.137:0/854085308 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3d9c068380 msgr2=0x7f3d9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:32.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.538+0000 7f3dc3000640 1 --2- 172.21.15.137:0/854085308 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3d9c068380 0x7f3d9c06a840 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc154290 tx=0x7f3da8009190 comp rx=0 tx=0).stop 2024-04-26T23:44:32.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.538+0000 7f3dc3000640 1 -- 172.21.15.137:0/854085308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3da00051d0 msgr2=0x7f3dbc0b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:32.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.538+0000 7f3dc3000640 1 --2- 172.21.15.137:0/854085308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3da00051d0 0x7f3dbc0b3e90 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0079a0 tx=0x7f3dac00a730 comp rx=0 tx=0).stop 2024-04-26T23:44:32.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.538+0000 7f3dc3000640 1 -- 172.21.15.137:0/854085308 shutdown_connections 2024-04-26T23:44:32.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.538+0000 7f3dc3000640 1 --2- 172.21.15.137:0/854085308 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3d9c068380 0x7f3d9c06a840 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.538+0000 7f3dc3000640 1 --2- 172.21.15.137:0/854085308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc0b55a0 0x7f3dbc0b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.538+0000 7f3dc3000640 1 --2- 172.21.15.137:0/854085308 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dbc0aff70 0x7f3dbc13a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.538+0000 7f3dc3000640 1 --2- 172.21.15.137:0/854085308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3da00051d0 0x7f3dbc0b3e90 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:32.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.538+0000 7f3dc3000640 1 -- 172.21.15.137:0/854085308 >> 172.21.15.137:0/854085308 conn(0x7f3dbc06c5d0 msgr2=0x7f3dbc06f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:32.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.538+0000 7f3dc3000640 1 -- 172.21.15.137:0/854085308 shutdown_connections 2024-04-26T23:44:32.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32.538+0000 7f3dc3000640 1 -- 172.21.15.137:0/854085308 wait complete. 2024-04-26T23:44:32.565 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:44:32.566 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:44:32.566 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T23:44:32.566 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T23:44:32.566 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T23:44:32.566 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:44:32.566 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:44:32.566 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:44:32.566 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:44:32.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:32.566 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T23:44:32.576 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:44:32.576 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:44:32.576 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:44:32.576 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:32.576 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T23:44:32.576 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:32.576 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:44:32.576 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T23:44:32.576 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T23:44:32.576 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:44:32.576 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T23:44:32.576 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T23:44:32.577 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:44:32.577 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:44:32.577 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:44:32.577 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:44:32.577 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:44:32.577 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42290sec preferred_lft 42290sec 2024-04-26T23:44:32.577 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link 2024-04-26T23:44:32.577 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:32.577 INFO:teuthology.orchestra.run.smithi137.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:44:32.577 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 02:42:f4:6f:af:56 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:44:32.577 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:44:32.577 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:32.577 INFO:teuthology.orchestra.run.smithi137.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:44:32.577 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:44:32.577 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:44:32.578 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:32.578 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T23:44:32.578 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:32.578 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:44:32.578 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:44:32.578 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:44:32.578 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:32.578 INFO:teuthology.orchestra.run.smithi137.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:44:32.578 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:44:32.578 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-26T23:44:32.578 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:32.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:32.579 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:44:32.637 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T23:44:32.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:32.643 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T23:44:32.694 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T23:44:32.695 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:44:32.695 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:44:32.695 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:44:32.695 INFO:teuthology.orchestra.run.smithi137.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:44:32.695 INFO:teuthology.orchestra.run.smithi137.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:44:32.695 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:44:32.695 INFO:teuthology.orchestra.run.smithi137.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:44:32.695 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:44:32.695 INFO:teuthology.orchestra.run.smithi137.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:44:32.695 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:44:32.695 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:44:32.696 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T23:44:32.696 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:44:32.696 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:44:32.696 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:44:32.696 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T23:44:32.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:44:32.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:44:32.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:32.829 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T23:44:32.838 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T23:44:32.838 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T23:44:32.838 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:44:32.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:32.839 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-26T23:44:32.903 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-26T23:44:32.903 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:44:32.903 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T23:44:32.955 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:44:32.955 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:44:32.955 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:44:33.003 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-26T23:44:33.063 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:44:33.120 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-26T23:44:33.120 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-26T23:44:33.120 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-26T23:44:33.121 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-26T23:44:33.121 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-26T23:44:33.121 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-26T23:44:33.121 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-26T23:44:33.121 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-26T23:44:33.121 INFO:teuthology.orchestra.run.smithi137.stdout:/run/lock 2024-04-26T23:44:33.121 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-26T23:44:33.121 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-26T23:44:33.121 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-26T23:44:33.121 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:44:33.121 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-26T23:44:33.121 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-26T23:44:33.121 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-26T23:44:33.121 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-26T23:44:33.122 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/fs/nfsd 2024-04-26T23:44:33.122 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-26T23:44:33.122 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-26T23:44:33.122 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:44:33.122 INFO:teuthology.orchestra.run.smithi137.stdout:/run/rpc_pipefs 2024-04-26T23:44:33.122 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-26T23:44:33.122 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-26T23:44:33.122 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:44:33.122 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:44:33.122 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:44:33.122 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:44:33.122 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-26T23:44:33.122 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:44:33.122 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:44:33.123 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:44:33.123 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:44:33.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:33.126 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-26T23:44:33.179 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T23:44:33.179 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-26T23:44:33.222 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-26T23:44:33.242 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:44:33.293 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-26T23:44:33.293 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-26T23:44:33.294 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-26T23:44:33.294 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-26T23:44:33.294 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-26T23:44:33.294 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-26T23:44:33.294 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-26T23:44:33.294 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-26T23:44:33.294 INFO:teuthology.orchestra.run.smithi137.stdout:/run/lock 2024-04-26T23:44:33.294 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-26T23:44:33.294 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-26T23:44:33.294 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-26T23:44:33.294 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:44:33.294 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-26T23:44:33.294 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-26T23:44:33.295 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-26T23:44:33.295 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-26T23:44:33.295 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/fs/nfsd 2024-04-26T23:44:33.295 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-26T23:44:33.295 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-26T23:44:33.295 INFO:teuthology.orchestra.run.smithi137.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:44:33.295 INFO:teuthology.orchestra.run.smithi137.stdout:/run/rpc_pipefs 2024-04-26T23:44:33.295 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-26T23:44:33.295 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-26T23:44:33.295 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:44:33.295 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:44:33.295 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:44:33.295 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:44:33.295 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-26T23:44:33.296 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:44:33.296 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:44:33.296 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:44:33.296 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:44:33.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:33.297 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-26T23:44:33.316 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:2024-04-26T23:44:33.310+0000 7f3a90e49580 -1 init, newargv = 0x562c988a45c0 newargc=15 2024-04-26T23:44:33.316 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:ceph-fuse[42314]: starting ceph client 2024-04-26T23:44:33.324 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:ceph-fuse[42314]: starting fuse 2024-04-26T23:44:33.324 INFO:teuthology.orchestra.run.smithi137.stdout:44 2024-04-26T23:44:33.325 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T23:44:33.325 DEBUG:teuthology.orchestra.run.smithi137:> sudo stdin-killer -- python3 -c ' 2024-04-26T23:44:33.325 DEBUG:teuthology.orchestra.run.smithi137:> import glob 2024-04-26T23:44:33.325 DEBUG:teuthology.orchestra.run.smithi137:> import re 2024-04-26T23:44:33.325 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T23:44:33.325 DEBUG:teuthology.orchestra.run.smithi137:> import subprocess 2024-04-26T23:44:33.325 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:44:33.325 DEBUG:teuthology.orchestra.run.smithi137:> def _find_admin_socket(client_name): 2024-04-26T23:44:33.325 DEBUG:teuthology.orchestra.run.smithi137:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T23:44:33.325 DEBUG:teuthology.orchestra.run.smithi137:> files = glob.glob(asok_path) 2024-04-26T23:44:33.325 DEBUG:teuthology.orchestra.run.smithi137:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T23:44:33.326 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:44:33.326 DEBUG:teuthology.orchestra.run.smithi137:> # Given a non-glob path, it better be there 2024-04-26T23:44:33.326 DEBUG:teuthology.orchestra.run.smithi137:> if "*" not in asok_path: 2024-04-26T23:44:33.326 DEBUG:teuthology.orchestra.run.smithi137:> assert(len(files) == 1) 2024-04-26T23:44:33.326 DEBUG:teuthology.orchestra.run.smithi137:> return files[0] 2024-04-26T23:44:33.326 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:44:33.326 DEBUG:teuthology.orchestra.run.smithi137:> for f in files: 2024-04-26T23:44:33.326 DEBUG:teuthology.orchestra.run.smithi137:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T23:44:33.326 DEBUG:teuthology.orchestra.run.smithi137:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T23:44:33.326 DEBUG:teuthology.orchestra.run.smithi137:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T23:44:33.326 DEBUG:teuthology.orchestra.run.smithi137:> contents = proc_f.read() 2024-04-26T23:44:33.326 DEBUG:teuthology.orchestra.run.smithi137:> if mountpoint in contents: 2024-04-26T23:44:33.326 DEBUG:teuthology.orchestra.run.smithi137:> return f 2024-04-26T23:44:33.326 DEBUG:teuthology.orchestra.run.smithi137:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T23:44:33.326 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T23:44:33.329 DEBUG:teuthology.orchestra.run.smithi137:> print(_find_admin_socket("client.0")) 2024-04-26T23:44:33.330 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T23:44:33.451 INFO:teuthology.orchestra.run.smithi137.stdout:/var/run/ceph/ceph-client.0.42314.asok 2024-04-26T23:44:33.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:44:33.463 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.42314.asok 2024-04-26T23:44:33.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:33.463 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.42314.asok status 2024-04-26T23:44:33.634 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:44:33.634 INFO:teuthology.orchestra.run.smithi137.stdout: "metadata": { 2024-04-26T23:44:33.634 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T23:44:33.634 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T23:44:33.634 INFO:teuthology.orchestra.run.smithi137.stdout: "entity_id": "0", 2024-04-26T23:44:33.634 INFO:teuthology.orchestra.run.smithi137.stdout: "hostname": "smithi137", 2024-04-26T23:44:33.634 INFO:teuthology.orchestra.run.smithi137.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-26T23:44:33.635 INFO:teuthology.orchestra.run.smithi137.stdout: "pid": "42314", 2024-04-26T23:44:33.635 INFO:teuthology.orchestra.run.smithi137.stdout: "root": "/" 2024-04-26T23:44:33.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:33.635 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_count": 0, 2024-04-26T23:44:33.635 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_pinned_count": 0, 2024-04-26T23:44:33.635 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 6555, 2024-04-26T23:44:33.635 INFO:teuthology.orchestra.run.smithi137.stdout: "inst": { 2024-04-26T23:44:33.635 INFO:teuthology.orchestra.run.smithi137.stdout: "name": { 2024-04-26T23:44:33.635 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "client", 2024-04-26T23:44:33.635 INFO:teuthology.orchestra.run.smithi137.stdout: "num": 6555 2024-04-26T23:44:33.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:33.635 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2024-04-26T23:44:33.635 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-26T23:44:33.635 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:44:33.636 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 1507151952 2024-04-26T23:44:33.636 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T23:44:33.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:33.636 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2024-04-26T23:44:33.636 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-26T23:44:33.636 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:44:33.636 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 1507151952 2024-04-26T23:44:33.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T23:44:33.636 INFO:teuthology.orchestra.run.smithi137.stdout: "inst_str": "client.6555 192.168.0.1:0/1507151952", 2024-04-26T23:44:33.636 INFO:teuthology.orchestra.run.smithi137.stdout: "addr_str": "192.168.0.1:0/1507151952", 2024-04-26T23:44:33.636 INFO:teuthology.orchestra.run.smithi137.stdout: "inode_count": 1, 2024-04-26T23:44:33.636 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_epoch": 37, 2024-04-26T23:44:33.636 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch": 60, 2024-04-26T23:44:33.636 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch_barrier": 0, 2024-04-26T23:44:33.636 INFO:teuthology.orchestra.run.smithi137.stdout: "blocklisted": false, 2024-04-26T23:44:33.636 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs" 2024-04-26T23:44:33.637 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:44:33.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:33.650 DEBUG:teuthology.orchestra.run.smithi137:> stat --file-system '--printf=%T 2024-04-26T23:44:33.650 DEBUG:teuthology.orchestra.run.smithi137:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-26T23:44:33.659 INFO:teuthology.orchestra.run.smithi137.stdout:fuseblk 2024-04-26T23:44:33.660 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-26T23:44:33.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:33.660 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:44:33.728 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:44:33.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.902+0000 7fe32de00640 1 Processor -- start 2024-04-26T23:44:33.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.902+0000 7fe32de00640 1 -- start start 2024-04-26T23:44:33.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.902+0000 7fe32de00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe32815c4c0 0x7fe32806eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:33.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.902+0000 7fe32de00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3280b3e30 con 0x7fe3280b5c90 2024-04-26T23:44:33.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.902+0000 7fe32de00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3280b40a0 con 0x7fe328155510 2024-04-26T23:44:33.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.902+0000 7fe32de00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe32806ec10 con 0x7fe32815c4c0 2024-04-26T23:44:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.902+0000 7fe326a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fe3280b5c90 0x7fe32806e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32880/0 (socket says 172.21.15.137:32880) 2024-04-26T23:44:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.902+0000 7fe326a00640 1 -- 172.21.15.137:0/2199702506 learned_addr learned my addr 172.21.15.137:0/2199702506 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.906+0000 7fe31e000640 1 --2- 172.21.15.137:0/2199702506 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe32815c4c0 0x7fe32806eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.906+0000 7fe326000640 1 -- 172.21.15.137:0/2199702506 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1731457870 0 0) 0x7fe3280b3e30 con 0x7fe3280b5c90 2024-04-26T23:44:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.906+0000 7fe326000640 1 -- 172.21.15.137:0/2199702506 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe30c003530 con 0x7fe3280b5c90 2024-04-26T23:44:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.906+0000 7fe326000640 1 -- 172.21.15.137:0/2199702506 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1067774759 0 0) 0x7fe3280b40a0 con 0x7fe328155510 2024-04-26T23:44:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.906+0000 7fe326000640 1 -- 172.21.15.137:0/2199702506 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3280b3e30 con 0x7fe328155510 2024-04-26T23:44:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.906+0000 7fe326000640 1 -- 172.21.15.137:0/2199702506 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3219935766 0 0) 0x7fe30c003530 con 0x7fe3280b5c90 2024-04-26T23:44:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.906+0000 7fe31e000640 1 -- 172.21.15.137:0/2199702506 >> v1:172.21.15.170:6789/0 conn(0x7fe328155510 legacy=0x7fe3281559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.906+0000 7fe31e000640 1 -- 172.21.15.137:0/2199702506 >> v1:172.21.15.137:6789/0 conn(0x7fe3280b5c90 legacy=0x7fe32806e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.906+0000 7fe31e000640 1 -- 172.21.15.137:0/2199702506 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3280b4380 con 0x7fe32815c4c0 2024-04-26T23:44:33.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.906+0000 7fe31e000640 1 --2- 172.21.15.137:0/2199702506 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe32815c4c0 0x7fe32806eff0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe3100097f0 tx=0x7fe31001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c94ac005701efc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:33.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.906+0000 7fe326000640 1 -- 172.21.15.137:0/2199702506 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3100b0070 con 0x7fe32815c4c0 2024-04-26T23:44:33.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.906+0000 7fe326000640 1 -- 172.21.15.137:0/2199702506 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3100ab400 con 0x7fe32815c4c0 2024-04-26T23:44:33.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.906+0000 7fe326000640 1 -- 172.21.15.137:0/2199702506 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe318001600 con 0x7fe32815c4c0 2024-04-26T23:44:33.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe32de00640 1 -- 172.21.15.137:0/2199702506 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe32815c4c0 msgr2=0x7fe32806eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:33.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe32de00640 1 --2- 172.21.15.137:0/2199702506 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe32815c4c0 0x7fe32806eff0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe3100097f0 tx=0x7fe31001c400 comp rx=0 tx=0).stop 2024-04-26T23:44:33.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe32de00640 1 -- 172.21.15.137:0/2199702506 shutdown_connections 2024-04-26T23:44:33.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe32de00640 1 --2- 172.21.15.137:0/2199702506 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe32815c4c0 0x7fe32806eff0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:33.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe32de00640 1 -- 172.21.15.137:0/2199702506 >> 172.21.15.137:0/2199702506 conn(0x7fe32806c5d0 msgr2=0x7fe32806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:33.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe32de00640 1 -- 172.21.15.137:0/2199702506 shutdown_connections 2024-04-26T23:44:33.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe32de00640 1 -- 172.21.15.137:0/2199702506 wait complete. 2024-04-26T23:44:33.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe32de00640 1 Processor -- start 2024-04-26T23:44:33.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe32de00640 1 -- start start 2024-04-26T23:44:33.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe32de00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3280b5c90 0x7fe32814b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:33.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe32de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe328155510 0x7fe328153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:33.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe32de00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe32815c4c0 0x7fe3281510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:33.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe32de00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe32806f530 con 0x7fe3280b5c90 2024-04-26T23:44:33.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe32de00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe3280b61e0 con 0x7fe328155510 2024-04-26T23:44:33.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe32de00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe32806f6b0 con 0x7fe32815c4c0 2024-04-26T23:44:33.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe326a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3280b5c90 0x7fe32814b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:33.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe326a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3280b5c90 0x7fe32814b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35896/0 (socket says 172.21.15.137:35896) 2024-04-26T23:44:33.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe326a00640 1 -- 172.21.15.137:0/837101973 learned_addr learned my addr 172.21.15.137:0/837101973 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:33.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe327400640 1 --2- 172.21.15.137:0/837101973 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe32815c4c0 0x7fe3281510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:33.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe31e000640 1 --2- 172.21.15.137:0/837101973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe328155510 0x7fe328153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:33.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe326a00640 1 -- 172.21.15.137:0/837101973 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe32815c4c0 msgr2=0x7fe3281510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:33.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe326a00640 1 --2- 172.21.15.137:0/837101973 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe32815c4c0 0x7fe3281510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:33.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe326a00640 1 -- 172.21.15.137:0/837101973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe328155510 msgr2=0x7fe328153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:33.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe326a00640 1 --2- 172.21.15.137:0/837101973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe328155510 0x7fe328153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:33.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe326a00640 1 -- 172.21.15.137:0/837101973 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32814bdc0 con 0x7fe3280b5c90 2024-04-26T23:44:33.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.910+0000 7fe31e000640 1 --2- 172.21.15.137:0/837101973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe328155510 0x7fe328153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:33.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.914+0000 7fe326a00640 1 --2- 172.21.15.137:0/837101973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3280b5c90 0x7fe32814b880 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe31800c6b0 tx=0x7fe31800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:33.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.914+0000 7fe31fe00640 1 -- 172.21.15.137:0/837101973 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe318017070 con 0x7fe3280b5c90 2024-04-26T23:44:33.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.914+0000 7fe31fe00640 1 -- 172.21.15.137:0/837101973 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe318005ae0 con 0x7fe3280b5c90 2024-04-26T23:44:33.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.914+0000 7fe31fe00640 1 -- 172.21.15.137:0/837101973 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe318007070 con 0x7fe3280b5c90 2024-04-26T23:44:33.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.914+0000 7fe32de00640 1 -- 172.21.15.137:0/837101973 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe328154440 con 0x7fe3280b5c90 2024-04-26T23:44:33.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.914+0000 7fe32de00640 1 -- 172.21.15.137:0/837101973 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe328154a00 con 0x7fe3280b5c90 2024-04-26T23:44:33.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.914+0000 7fe32de00640 1 -- 172.21.15.137:0/837101973 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe32806a4b0 con 0x7fe3280b5c90 2024-04-26T23:44:33.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.914+0000 7fe31fe00640 1 -- 172.21.15.137:0/837101973 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe31801a070 con 0x7fe3280b5c90 2024-04-26T23:44:33.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.914+0000 7fe31fe00640 1 --2- 172.21.15.137:0/837101973 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe304068380 0x7fe30406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:33.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.914+0000 7fe31fe00640 1 -- 172.21.15.137:0/837101973 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fe318085f70 con 0x7fe3280b5c90 2024-04-26T23:44:33.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.914+0000 7fe31e000640 1 --2- 172.21.15.137:0/837101973 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe304068380 0x7fe30406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:33.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.918+0000 7fe31e000640 1 --2- 172.21.15.137:0/837101973 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe304068380 0x7fe30406a840 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe3100ad000 tx=0x7fe3100a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:33.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:33.922+0000 7fe31fe00640 1 -- 172.21.15.137:0/837101973 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe318056490 con 0x7fe3280b5c90 2024-04-26T23:44:34.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:34.110+0000 7fe32de00640 1 -- 172.21.15.137:0/837101973 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe328166fb0 con 0x7fe3280b5c90 2024-04-26T23:44:34.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:34.110+0000 7fe31fe00640 1 -- 172.21.15.137:0/837101973 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) ==== 53+0+73 (secure 0 0 0) 0x7fe318055d90 con 0x7fe3280b5c90 2024-04-26T23:44:34.118 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:44:34.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:34.114+0000 7fe32de00640 1 -- 172.21.15.137:0/837101973 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe304068380 msgr2=0x7fe30406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:34.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:34.114+0000 7fe32de00640 1 --2- 172.21.15.137:0/837101973 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe304068380 0x7fe30406a840 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe3100ad000 tx=0x7fe3100a6000 comp rx=0 tx=0).stop 2024-04-26T23:44:34.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:34.114+0000 7fe32de00640 1 -- 172.21.15.137:0/837101973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3280b5c90 msgr2=0x7fe32814b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:34.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:34.114+0000 7fe32de00640 1 --2- 172.21.15.137:0/837101973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3280b5c90 0x7fe32814b880 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe31800c6b0 tx=0x7fe31800cb70 comp rx=0 tx=0).stop 2024-04-26T23:44:34.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:34.114+0000 7fe32de00640 1 -- 172.21.15.137:0/837101973 shutdown_connections 2024-04-26T23:44:34.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:34.114+0000 7fe32de00640 1 --2- 172.21.15.137:0/837101973 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe304068380 0x7fe30406a840 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:34.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:34.114+0000 7fe32de00640 1 --2- 172.21.15.137:0/837101973 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe32815c4c0 0x7fe3281510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:34.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:34.114+0000 7fe32de00640 1 --2- 172.21.15.137:0/837101973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe328155510 0x7fe328153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:34.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:34.114+0000 7fe32de00640 1 --2- 172.21.15.137:0/837101973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3280b5c90 0x7fe32814b880 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:34.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:34.114+0000 7fe32de00640 1 -- 172.21.15.137:0/837101973 >> 172.21.15.137:0/837101973 conn(0x7fe32806c5d0 msgr2=0x7fe32814ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:34.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:34.114+0000 7fe32de00640 1 -- 172.21.15.137:0/837101973 shutdown_connections 2024-04-26T23:44:34.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:34.114+0000 7fe32de00640 1 -- 172.21.15.137:0/837101973 wait complete. 2024-04-26T23:44:34.139 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:44:34.139 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:44:34.139 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi170.front.sepia.ceph.com 2024-04-26T23:44:34.139 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-26T23:44:34.139 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T23:44:34.139 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:44:34.139 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:44:34.139 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:44:34.140 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:44:34.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:34.140 DEBUG:teuthology.orchestra.run.smithi170:> ip addr 2024-04-26T23:44:34.151 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:44:34.151 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:44:34.151 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:44:34.151 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:34.151 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2024-04-26T23:44:34.151 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:34.151 INFO:teuthology.orchestra.run.smithi170.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:44:34.151 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:54 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:44:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f0 2024-04-26T23:44:34.152 INFO:teuthology.orchestra.run.smithi170.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:44:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:55 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:44:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f1 2024-04-26T23:44:34.152 INFO:teuthology.orchestra.run.smithi170.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:44:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:54 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:44:34.152 INFO:teuthology.orchestra.run.smithi170.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:44:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:55 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:44:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: inet 172.21.15.170/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:44:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft 42292sec preferred_lft 42292sec 2024-04-26T23:44:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::ec4:7aff:fe88:7255/64 scope link 2024-04-26T23:44:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:34.152 INFO:teuthology.orchestra.run.smithi170.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:44:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 02:42:23:a7:19:38 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:44:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:44:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:34.153 INFO:teuthology.orchestra.run.smithi170.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:44:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:44:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:44:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T23:44:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:34.153 INFO:teuthology.orchestra.run.smithi170.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:44:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:44:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:44:34.154 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:34.154 INFO:teuthology.orchestra.run.smithi170.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:44:34.154 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:44:34.154 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-26T23:44:34.154 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:34.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:34.155 DEBUG:teuthology.orchestra.run.smithi170:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:44:34.214 INFO:teuthology.orchestra.run.smithi170.stdout:1 2024-04-26T23:44:34.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:34.216 DEBUG:teuthology.orchestra.run.smithi170:> route 2024-04-26T23:44:34.272 INFO:teuthology.orchestra.run.smithi170.stdout:Kernel IP routing table 2024-04-26T23:44:34.272 INFO:teuthology.orchestra.run.smithi170.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:44:34.272 INFO:teuthology.orchestra.run.smithi170.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:44:34.272 INFO:teuthology.orchestra.run.smithi170.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:44:34.272 INFO:teuthology.orchestra.run.smithi170.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:44:34.273 INFO:teuthology.orchestra.run.smithi170.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:44:34.273 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:44:34.273 INFO:teuthology.orchestra.run.smithi170.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:44:34.273 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:44:34.273 INFO:teuthology.orchestra.run.smithi170.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:44:34.273 INFO:teuthology.orchestra.run.smithi170.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:44:34.273 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:44:34.273 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-04-26T23:44:34.273 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:44:34.273 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:44:34.273 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:44:34.273 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-04-26T23:44:34.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:44:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:44:34.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:44:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:44:34.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:34.418 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-04-26T23:44:34.427 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T23:44:34.427 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-26T23:44:34.428 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:44:34.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:34.428 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set brx.0 up 2024-04-26T23:44:34.488 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-26T23:44:34.488 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:44:34.488 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-26T23:44:34.540 INFO:teuthology.orchestra.run.smithi170.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:44:34.541 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:44:34.541 DEBUG:teuthology.orchestra.run.smithi170:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:44:34.592 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2024-04-26T23:44:34.659 DEBUG:teuthology.orchestra.run.smithi170:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:44:34.714 INFO:teuthology.orchestra.run.smithi170.stdout:/sys 2024-04-26T23:44:34.714 INFO:teuthology.orchestra.run.smithi170.stdout:/proc 2024-04-26T23:44:34.714 INFO:teuthology.orchestra.run.smithi170.stdout:/dev 2024-04-26T23:44:34.714 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/pts 2024-04-26T23:44:34.714 INFO:teuthology.orchestra.run.smithi170.stdout:/run 2024-04-26T23:44:34.714 INFO:teuthology.orchestra.run.smithi170.stdout:/ 2024-04-26T23:44:34.714 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/security 2024-04-26T23:44:34.714 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/shm 2024-04-26T23:44:34.714 INFO:teuthology.orchestra.run.smithi170.stdout:/run/lock 2024-04-26T23:44:34.714 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/cgroup 2024-04-26T23:44:34.715 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/pstore 2024-04-26T23:44:34.715 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/bpf 2024-04-26T23:44:34.715 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:44:34.715 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/hugepages 2024-04-26T23:44:34.715 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/mqueue 2024-04-26T23:44:34.715 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/debug 2024-04-26T23:44:34.715 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/tracing 2024-04-26T23:44:34.715 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/fs/nfsd 2024-04-26T23:44:34.715 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/fuse/connections 2024-04-26T23:44:34.715 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/config 2024-04-26T23:44:34.715 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:44:34.715 INFO:teuthology.orchestra.run.smithi170.stdout:/run/rpc_pipefs 2024-04-26T23:44:34.716 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/1000 2024-04-26T23:44:34.716 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph 2024-04-26T23:44:34.716 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:44:34.716 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:44:34.716 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:44:34.716 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:44:34.716 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns 2024-04-26T23:44:34.716 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:44:34.716 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:44:34.716 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:44:34.716 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:44:34.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:34.717 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2024-04-26T23:44:34.772 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T23:44:34.772 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-26T23:44:34.815 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2024-04-26T23:44:34.835 DEBUG:teuthology.orchestra.run.smithi170:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:44:34.885 INFO:teuthology.orchestra.run.smithi170.stdout:/sys 2024-04-26T23:44:34.885 INFO:teuthology.orchestra.run.smithi170.stdout:/proc 2024-04-26T23:44:34.886 INFO:teuthology.orchestra.run.smithi170.stdout:/dev 2024-04-26T23:44:34.886 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/pts 2024-04-26T23:44:34.886 INFO:teuthology.orchestra.run.smithi170.stdout:/run 2024-04-26T23:44:34.886 INFO:teuthology.orchestra.run.smithi170.stdout:/ 2024-04-26T23:44:34.886 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/security 2024-04-26T23:44:34.886 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/shm 2024-04-26T23:44:34.886 INFO:teuthology.orchestra.run.smithi170.stdout:/run/lock 2024-04-26T23:44:34.886 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/cgroup 2024-04-26T23:44:34.886 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/pstore 2024-04-26T23:44:34.886 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/bpf 2024-04-26T23:44:34.886 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:44:34.886 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/hugepages 2024-04-26T23:44:34.886 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/mqueue 2024-04-26T23:44:34.887 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/debug 2024-04-26T23:44:34.887 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/tracing 2024-04-26T23:44:34.887 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/fs/nfsd 2024-04-26T23:44:34.887 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/fuse/connections 2024-04-26T23:44:34.887 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/config 2024-04-26T23:44:34.887 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:44:34.887 INFO:teuthology.orchestra.run.smithi170.stdout:/run/rpc_pipefs 2024-04-26T23:44:34.887 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/1000 2024-04-26T23:44:34.887 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph 2024-04-26T23:44:34.887 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:44:34.887 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:44:34.887 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:44:34.887 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:44:34.887 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns 2024-04-26T23:44:34.887 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:44:34.888 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:44:34.888 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:44:34.888 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:44:34.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:34.889 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2024-04-26T23:44:34.909 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:2024-04-26T23:44:34.907+0000 7fa302fc9580 -1 init, newargv = 0x562cf8ba5770 newargc=15 2024-04-26T23:44:34.909 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:ceph-fuse[32774]: starting ceph client 2024-04-26T23:44:34.915 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:ceph-fuse[32774]: starting fuse 2024-04-26T23:44:34.918 INFO:teuthology.orchestra.run.smithi170.stdout:44 2024-04-26T23:44:34.918 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T23:44:34.918 DEBUG:teuthology.orchestra.run.smithi170:> sudo stdin-killer -- python3 -c ' 2024-04-26T23:44:34.919 DEBUG:teuthology.orchestra.run.smithi170:> import glob 2024-04-26T23:44:34.919 DEBUG:teuthology.orchestra.run.smithi170:> import re 2024-04-26T23:44:34.919 DEBUG:teuthology.orchestra.run.smithi170:> import os 2024-04-26T23:44:34.919 DEBUG:teuthology.orchestra.run.smithi170:> import subprocess 2024-04-26T23:44:34.919 DEBUG:teuthology.orchestra.run.smithi170:> 2024-04-26T23:44:34.919 DEBUG:teuthology.orchestra.run.smithi170:> def _find_admin_socket(client_name): 2024-04-26T23:44:34.919 DEBUG:teuthology.orchestra.run.smithi170:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-26T23:44:34.919 DEBUG:teuthology.orchestra.run.smithi170:> files = glob.glob(asok_path) 2024-04-26T23:44:34.919 DEBUG:teuthology.orchestra.run.smithi170:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-26T23:44:34.919 DEBUG:teuthology.orchestra.run.smithi170:> 2024-04-26T23:44:34.919 DEBUG:teuthology.orchestra.run.smithi170:> # Given a non-glob path, it better be there 2024-04-26T23:44:34.919 DEBUG:teuthology.orchestra.run.smithi170:> if "*" not in asok_path: 2024-04-26T23:44:34.919 DEBUG:teuthology.orchestra.run.smithi170:> assert(len(files) == 1) 2024-04-26T23:44:34.919 DEBUG:teuthology.orchestra.run.smithi170:> return files[0] 2024-04-26T23:44:34.920 DEBUG:teuthology.orchestra.run.smithi170:> 2024-04-26T23:44:34.920 DEBUG:teuthology.orchestra.run.smithi170:> for f in files: 2024-04-26T23:44:34.920 DEBUG:teuthology.orchestra.run.smithi170:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T23:44:34.920 DEBUG:teuthology.orchestra.run.smithi170:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T23:44:34.920 DEBUG:teuthology.orchestra.run.smithi170:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T23:44:34.920 DEBUG:teuthology.orchestra.run.smithi170:> contents = proc_f.read() 2024-04-26T23:44:34.920 DEBUG:teuthology.orchestra.run.smithi170:> if mountpoint in contents: 2024-04-26T23:44:34.920 DEBUG:teuthology.orchestra.run.smithi170:> return f 2024-04-26T23:44:34.920 DEBUG:teuthology.orchestra.run.smithi170:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T23:44:34.920 DEBUG:teuthology.orchestra.run.smithi170:> 2024-04-26T23:44:34.920 DEBUG:teuthology.orchestra.run.smithi170:> print(_find_admin_socket("client.1")) 2024-04-26T23:44:34.920 DEBUG:teuthology.orchestra.run.smithi170:> ' 2024-04-26T23:44:35.041 INFO:teuthology.orchestra.run.smithi170.stdout:/var/run/ceph/ceph-client.1.32774.asok 2024-04-26T23:44:35.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:44:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:44:35.052 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.32774.asok 2024-04-26T23:44:35.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:35.053 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.32774.asok status 2024-04-26T23:44:35.225 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-26T23:44:35.225 INFO:teuthology.orchestra.run.smithi170.stdout: "metadata": { 2024-04-26T23:44:35.225 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T23:44:35.225 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T23:44:35.225 INFO:teuthology.orchestra.run.smithi170.stdout: "entity_id": "1", 2024-04-26T23:44:35.225 INFO:teuthology.orchestra.run.smithi170.stdout: "hostname": "smithi170", 2024-04-26T23:44:35.225 INFO:teuthology.orchestra.run.smithi170.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-26T23:44:35.225 INFO:teuthology.orchestra.run.smithi170.stdout: "pid": "32774", 2024-04-26T23:44:35.225 INFO:teuthology.orchestra.run.smithi170.stdout: "root": "/" 2024-04-26T23:44:35.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-26T23:44:35.226 INFO:teuthology.orchestra.run.smithi170.stdout: "dentry_count": 0, 2024-04-26T23:44:35.226 INFO:teuthology.orchestra.run.smithi170.stdout: "dentry_pinned_count": 0, 2024-04-26T23:44:35.226 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 35624, 2024-04-26T23:44:35.226 INFO:teuthology.orchestra.run.smithi170.stdout: "inst": { 2024-04-26T23:44:35.226 INFO:teuthology.orchestra.run.smithi170.stdout: "name": { 2024-04-26T23:44:35.226 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "client", 2024-04-26T23:44:35.226 INFO:teuthology.orchestra.run.smithi170.stdout: "num": 35624 2024-04-26T23:44:35.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-26T23:44:35.226 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": { 2024-04-26T23:44:35.226 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2024-04-26T23:44:35.226 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:44:35.226 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 2284768616 2024-04-26T23:44:35.226 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-26T23:44:35.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-26T23:44:35.226 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": { 2024-04-26T23:44:35.227 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2024-04-26T23:44:35.227 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:44:35.227 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 2284768616 2024-04-26T23:44:35.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-26T23:44:35.227 INFO:teuthology.orchestra.run.smithi170.stdout: "inst_str": "client.35624 192.168.0.1:0/2284768616", 2024-04-26T23:44:35.227 INFO:teuthology.orchestra.run.smithi170.stdout: "addr_str": "192.168.0.1:0/2284768616", 2024-04-26T23:44:35.227 INFO:teuthology.orchestra.run.smithi170.stdout: "inode_count": 1, 2024-04-26T23:44:35.227 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_epoch": 37, 2024-04-26T23:44:35.227 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_epoch": 60, 2024-04-26T23:44:35.227 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_epoch_barrier": 0, 2024-04-26T23:44:35.227 INFO:teuthology.orchestra.run.smithi170.stdout: "blocklisted": false, 2024-04-26T23:44:35.227 INFO:teuthology.orchestra.run.smithi170.stdout: "fs_name": "cephfs" 2024-04-26T23:44:35.227 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-26T23:44:35.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:35.239 DEBUG:teuthology.orchestra.run.smithi170:> stat --file-system '--printf=%T 2024-04-26T23:44:35.240 DEBUG:teuthology.orchestra.run.smithi170:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-26T23:44:35.248 INFO:teuthology.orchestra.run.smithi170.stdout:fuseblk 2024-04-26T23:44:35.249 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-26T23:44:35.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:35.249 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:44:35.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:35.311 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir foo) 2024-04-26T23:44:35.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:35.329 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir foo/bar) 2024-04-26T23:44:35.385 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:44:35.385 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:44:35.436 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:44:35.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f7245600640 1 Processor -- start 2024-04-26T23:44:35.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f7245600640 1 -- start start 2024-04-26T23:44:35.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f7245600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f72400b4100 0x7f72400d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:35.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f7245600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7240160240 con 0x7f724015f3d0 2024-04-26T23:44:35.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f7245600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7240160520 con 0x7f72400d2d80 2024-04-26T23:44:35.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f7245600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f72400b2960 con 0x7f72400b4100 2024-04-26T23:44:35.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f723ea00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f724015f3d0 0x7f724015f7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32892/0 (socket says 172.21.15.137:32892) 2024-04-26T23:44:35.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f723ea00640 1 -- 172.21.15.137:0/305708138 learned_addr learned my addr 172.21.15.137:0/305708138 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:35.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f723e000640 1 --2- 172.21.15.137:0/305708138 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f72400b4100 0x7f72400d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:35.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f723d600640 1 -- 172.21.15.137:0/305708138 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1658595375 0 0) 0x7f7240160240 con 0x7f724015f3d0 2024-04-26T23:44:35.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f723d600640 1 -- 172.21.15.137:0/305708138 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7224003530 con 0x7f724015f3d0 2024-04-26T23:44:35.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f723d600640 1 -- 172.21.15.137:0/305708138 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2640951862 0 0) 0x7f7240160520 con 0x7f72400d2d80 2024-04-26T23:44:35.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f723d600640 1 -- 172.21.15.137:0/305708138 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7240160240 con 0x7f72400d2d80 2024-04-26T23:44:35.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f723d600640 1 -- 172.21.15.137:0/305708138 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1225392546 0 0) 0x7f7224003530 con 0x7f724015f3d0 2024-04-26T23:44:35.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f723d600640 1 -- 172.21.15.137:0/305708138 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f72400b4100 msgr2=0x7f72400d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:35.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f723d600640 1 --2- 172.21.15.137:0/305708138 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f72400b4100 0x7f72400d1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:35.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f723d600640 1 -- 172.21.15.137:0/305708138 >> v1:172.21.15.170:6789/0 conn(0x7f72400d2d80 legacy=0x7f72400b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:35.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f723d600640 1 -- 172.21.15.137:0/305708138 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7240160800 con 0x7f724015f3d0 2024-04-26T23:44:35.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f723d600640 1 -- 172.21.15.137:0/305708138 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f7230001680 con 0x7f724015f3d0 2024-04-26T23:44:35.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f723e000640 1 --2- 172.21.15.137:0/305708138 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f72400b4100 0x7f72400d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:44:35.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f723d600640 1 -- 172.21.15.137:0/305708138 >> v1:172.21.15.137:6789/0 conn(0x7f724015f3d0 legacy=0x7f724015f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:35.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f723d600640 1 --2- 172.21.15.137:0/305708138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7224003b80 0x7f7224003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:35.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f723d600640 1 --2- 172.21.15.137:0/305708138 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f72400b4100 0x7f7224004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:35.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f723d600640 1 --2- 172.21.15.137:0/305708138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7224004d50 0x7f72240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:35.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f723d600640 1 -- 172.21.15.137:0/305708138 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f72400b2960 con 0x7f7224004d50 2024-04-26T23:44:35.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f723d600640 1 -- 172.21.15.137:0/305708138 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f722400ba80 con 0x7f7224003b80 2024-04-26T23:44:35.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.614+0000 7f723d600640 1 -- 172.21.15.137:0/305708138 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f722400bc00 con 0x7f72400b4100 2024-04-26T23:44:35.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.618+0000 7f723f400640 1 --2- 172.21.15.137:0/305708138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7224004d50 0x7f72240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:35.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.618+0000 7f723e000640 1 --2- 172.21.15.137:0/305708138 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f72400b4100 0x7f7224004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:35.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.618+0000 7f723ea00640 1 --2- 172.21.15.137:0/305708138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7224003b80 0x7f7224003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:35.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.618+0000 7f723f400640 1 -- 172.21.15.137:0/305708138 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f72400b4100 msgr2=0x7f7224004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:35.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.618+0000 7f723f400640 1 --2- 172.21.15.137:0/305708138 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f72400b4100 0x7f7224004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:35.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.618+0000 7f723f400640 1 -- 172.21.15.137:0/305708138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7224003b80 msgr2=0x7f7224003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:35.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.618+0000 7f723f400640 1 --2- 172.21.15.137:0/305708138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7224003b80 0x7f7224003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:35.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.618+0000 7f723f400640 1 -- 172.21.15.137:0/305708138 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7224003530 con 0x7f7224004d50 2024-04-26T23:44:35.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.618+0000 7f723f400640 1 --2- 172.21.15.137:0/305708138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7224004d50 0x7f72240051d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f7238002000 tx=0x7f723801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63511e5537f9f1b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:35.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.618+0000 7f723d600640 1 -- 172.21.15.137:0/305708138 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7238001c20 con 0x7f7224004d50 2024-04-26T23:44:35.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.618+0000 7f723d600640 1 -- 172.21.15.137:0/305708138 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7238003ba0 con 0x7f7224004d50 2024-04-26T23:44:35.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.618+0000 7f723d600640 1 -- 172.21.15.137:0/305708138 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72380050d0 con 0x7f7224004d50 2024-04-26T23:44:35.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.618+0000 7f7245600640 1 -- 172.21.15.137:0/305708138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7224004d50 msgr2=0x7f72240051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:35.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.618+0000 7f7245600640 1 --2- 172.21.15.137:0/305708138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7224004d50 0x7f72240051d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f7238002000 tx=0x7f723801c900 comp rx=0 tx=0).stop 2024-04-26T23:44:35.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.618+0000 7f723f400640 1 -- 172.21.15.137:0/305708138 reap_dead start 2024-04-26T23:44:35.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f7245600640 1 -- 172.21.15.137:0/305708138 shutdown_connections 2024-04-26T23:44:35.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f7245600640 1 -- 172.21.15.137:0/305708138 >> 172.21.15.137:0/305708138 conn(0x7f724009ba60 msgr2=0x7f724009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:35.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f7245600640 1 -- 172.21.15.137:0/305708138 shutdown_connections 2024-04-26T23:44:35.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f7245600640 1 -- 172.21.15.137:0/305708138 wait complete. 2024-04-26T23:44:35.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f7245600640 1 Processor -- start 2024-04-26T23:44:35.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f7245600640 1 -- start start 2024-04-26T23:44:35.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f7245600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7224004d50 0x7f72400b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:35.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f7245600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7240156790 0x7f7240158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:35.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f7245600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7240158d70 0x7f72400b7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:35.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f7245600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f72400d11b0 con 0x7f7240156790 2024-04-26T23:44:35.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f7245600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f72400d1030 con 0x7f7240158d70 2024-04-26T23:44:35.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f7245600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f72400d1330 con 0x7f7224004d50 2024-04-26T23:44:35.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f723e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7240156790 0x7f7240158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:35.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f723e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7240156790 0x7f7240158830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35912/0 (socket says 172.21.15.137:35912) 2024-04-26T23:44:35.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f723e000640 1 -- 172.21.15.137:0/3444372547 learned_addr learned my addr 172.21.15.137:0/3444372547 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:35.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f723f400640 1 --2- 172.21.15.137:0/3444372547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7240158d70 0x7f72400b7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:35.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f723ea00640 1 --2- 172.21.15.137:0/3444372547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7224004d50 0x7f72400b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:35.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f723e000640 1 -- 172.21.15.137:0/3444372547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7224004d50 msgr2=0x7f72400b6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:35.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f723e000640 1 --2- 172.21.15.137:0/3444372547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7224004d50 0x7f72400b6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:35.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f723e000640 1 -- 172.21.15.137:0/3444372547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7240158d70 msgr2=0x7f72400b7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:35.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f723e000640 1 --2- 172.21.15.137:0/3444372547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7240158d70 0x7f72400b7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:35.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f723e000640 1 -- 172.21.15.137:0/3444372547 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7240157790 con 0x7f7240156790 2024-04-26T23:44:35.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f723f400640 1 --2- 172.21.15.137:0/3444372547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7240158d70 0x7f72400b7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:35.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.622+0000 7f723e000640 1 --2- 172.21.15.137:0/3444372547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7240156790 0x7f7240158830 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f722c011970 tx=0x7f722c011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:35.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.626+0000 7f7236a00640 1 -- 172.21.15.137:0/3444372547 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c00fbb0 con 0x7f7240156790 2024-04-26T23:44:35.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.626+0000 7f7236a00640 1 -- 172.21.15.137:0/3444372547 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f722c00fd50 con 0x7f7240156790 2024-04-26T23:44:35.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.626+0000 7f7236a00640 1 -- 172.21.15.137:0/3444372547 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c004270 con 0x7f7240156790 2024-04-26T23:44:35.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.626+0000 7f7245600640 1 -- 172.21.15.137:0/3444372547 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7240157a70 con 0x7f7240156790 2024-04-26T23:44:35.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.626+0000 7f7245600640 1 -- 172.21.15.137:0/3444372547 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7240158030 con 0x7f7240156790 2024-04-26T23:44:35.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.626+0000 7f7245600640 1 -- 172.21.15.137:0/3444372547 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f724006a4b0 con 0x7f7240156790 2024-04-26T23:44:35.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.626+0000 7f7236a00640 1 -- 172.21.15.137:0/3444372547 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f722c012040 con 0x7f7240156790 2024-04-26T23:44:35.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.626+0000 7f7236a00640 1 --2- 172.21.15.137:0/3444372547 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7220068380 0x7f722006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:35.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.626+0000 7f7236a00640 1 -- 172.21.15.137:0/3444372547 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f722c0871c0 con 0x7f7240156790 2024-04-26T23:44:35.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.626+0000 7f723ea00640 1 --2- 172.21.15.137:0/3444372547 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7220068380 0x7f722006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:35.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.630+0000 7f723ea00640 1 --2- 172.21.15.137:0/3444372547 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7220068380 0x7f722006a840 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7240075930 tx=0x7f7230009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:35.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.630+0000 7f7236a00640 1 -- 172.21.15.137:0/3444372547 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f722c019070 con 0x7f7240156790 2024-04-26T23:44:35.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.790+0000 7f7245600640 1 -- 172.21.15.137:0/3444372547 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72400b24f0 con 0x7f7240156790 2024-04-26T23:44:35.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.790+0000 7f7236a00640 1 -- 172.21.15.137:0/3444372547 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16713 (secure 0 0 0) 0x7f722c0577f0 con 0x7f7240156790 2024-04-26T23:44:35.799 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:35.799 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":60,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:44:22.811626+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:44:18.876990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T23:44:20.189315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:44:35.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.794+0000 7f7245600640 1 -- 172.21.15.137:0/3444372547 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7220068380 msgr2=0x7f722006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:35.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.794+0000 7f7245600640 1 --2- 172.21.15.137:0/3444372547 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7220068380 0x7f722006a840 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7240075930 tx=0x7f7230009040 comp rx=0 tx=0).stop 2024-04-26T23:44:35.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.794+0000 7f7245600640 1 -- 172.21.15.137:0/3444372547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7240156790 msgr2=0x7f7240158830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:35.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.794+0000 7f7245600640 1 --2- 172.21.15.137:0/3444372547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7240156790 0x7f7240158830 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f722c011970 tx=0x7f722c011e30 comp rx=0 tx=0).stop 2024-04-26T23:44:35.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.794+0000 7f7245600640 1 -- 172.21.15.137:0/3444372547 shutdown_connections 2024-04-26T23:44:35.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.794+0000 7f7245600640 1 --2- 172.21.15.137:0/3444372547 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7220068380 0x7f722006a840 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:35.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.794+0000 7f7245600640 1 --2- 172.21.15.137:0/3444372547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7240156790 0x7f7240158830 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:35.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.794+0000 7f7245600640 1 --2- 172.21.15.137:0/3444372547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7240158d70 0x7f72400b7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:35.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.794+0000 7f7245600640 1 --2- 172.21.15.137:0/3444372547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7224004d50 0x7f72400b6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:35.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.794+0000 7f7245600640 1 -- 172.21.15.137:0/3444372547 >> 172.21.15.137:0/3444372547 conn(0x7f724009ba60 msgr2=0x7f72400b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:35.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.794+0000 7f7245600640 1 -- 172.21.15.137:0/3444372547 shutdown_connections 2024-04-26T23:44:35.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.794+0000 7f7245600640 1 -- 172.21.15.137:0/3444372547 wait complete. 2024-04-26T23:44:35.820 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:44:18.876990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:44:20.189315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:44:35.821 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:44:35.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.950+0000 7f1268400640 1 Processor -- start 2024-04-26T23:44:35.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.950+0000 7f1268400640 1 -- start start 2024-04-26T23:44:35.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.954+0000 7f1268400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f12600b54e0 0x7f12600b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:35.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.954+0000 7f1268400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f12600cd710 0x7f126015f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:35.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.954+0000 7f1268400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1260160250 con 0x7f126015fe30 2024-04-26T23:44:35.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.954+0000 7f1268400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f12600b3d90 con 0x7f12600cd710 2024-04-26T23:44:35.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.954+0000 7f1268400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f12600d0840 con 0x7f12600b54e0 2024-04-26T23:44:35.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.954+0000 7f1265a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f12600b54e0 0x7f12600b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:35.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.954+0000 7f1265000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f12600cd710 0x7f126015f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:35.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.954+0000 7f1265a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f12600b54e0 0x7f12600b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:38312/0 (socket says 172.21.15.137:38312) 2024-04-26T23:44:35.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.954+0000 7f1266400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f126015fe30 0x7f1260144d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:45492/0 (socket says 172.21.15.137:45492) 2024-04-26T23:44:35.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.954+0000 7f1265a00640 1 -- 172.21.15.137:0/239406297 learned_addr learned my addr 172.21.15.137:0/239406297 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:35.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.954+0000 7f1265a00640 1 -- 172.21.15.137:0/239406297 >> v2:172.21.15.170:3300/0 conn(0x7f12600cd710 msgr2=0x7f126015f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:35.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.954+0000 7f1265a00640 1 --2- 172.21.15.137:0/239406297 >> v2:172.21.15.170:3300/0 conn(0x7f12600cd710 0x7f126015f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:35.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.954+0000 7f1265a00640 1 -- 172.21.15.137:0/239406297 >> v1:172.21.15.170:6789/0 conn(0x7f126015fe30 legacy=0x7f1260144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:35.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.954+0000 7f1265a00640 1 -- 172.21.15.137:0/239406297 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12600cffa0 con 0x7f12600b54e0 2024-04-26T23:44:35.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.954+0000 7f125fe00640 1 -- 172.21.15.137:0/239406297 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1186821266 0 0) 0x7f1260160250 con 0x7f126015fe30 2024-04-26T23:44:35.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.958+0000 7f1265a00640 1 --2- 172.21.15.137:0/239406297 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f12600b54e0 0x7f12600b5ee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1254009870 tx=0x7f125401c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9abe41641677bed3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:35.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.958+0000 7f125fe00640 1 -- 172.21.15.137:0/239406297 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12540a95f0 con 0x7f12600b54e0 2024-04-26T23:44:35.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.958+0000 7f125fe00640 1 -- 172.21.15.137:0/239406297 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12540a9790 con 0x7f12600b54e0 2024-04-26T23:44:35.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.958+0000 7f125fe00640 1 -- 172.21.15.137:0/239406297 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12540a9b60 con 0x7f12600b54e0 2024-04-26T23:44:35.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.958+0000 7f1268400640 1 -- 172.21.15.137:0/239406297 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f12600b54e0 msgr2=0x7f12600b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:35.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.958+0000 7f1268400640 1 --2- 172.21.15.137:0/239406297 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f12600b54e0 0x7f12600b5ee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1254009870 tx=0x7f125401c530 comp rx=0 tx=0).stop 2024-04-26T23:44:35.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.958+0000 7f1268400640 1 -- 172.21.15.137:0/239406297 shutdown_connections 2024-04-26T23:44:35.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.958+0000 7f1268400640 1 --2- 172.21.15.137:0/239406297 >> v2:172.21.15.170:3300/0 conn(0x7f12600cd710 0x7f126015f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:35.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.958+0000 7f1268400640 1 --2- 172.21.15.137:0/239406297 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f12600b54e0 0x7f12600b5ee0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:35.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.958+0000 7f1268400640 1 -- 172.21.15.137:0/239406297 >> 172.21.15.137:0/239406297 conn(0x7f126006c800 msgr2=0x7f126006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:35.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.958+0000 7f1268400640 1 -- 172.21.15.137:0/239406297 shutdown_connections 2024-04-26T23:44:35.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.958+0000 7f1268400640 1 -- 172.21.15.137:0/239406297 wait complete. 2024-04-26T23:44:35.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.958+0000 7f1268400640 1 Processor -- start 2024-04-26T23:44:35.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.958+0000 7f1268400640 1 -- start start 2024-04-26T23:44:35.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f1268400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12600b54e0 0x7f126013ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:35.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f1268400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f12600cd710 0x7f126013ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:35.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f1268400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f126015fe30 0x7f1260166bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:35.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f1268400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12600cdaf0 con 0x7f126015fe30 2024-04-26T23:44:35.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f1268400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f12600cded0 con 0x7f12600b54e0 2024-04-26T23:44:35.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f1268400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f12600cdc70 con 0x7f12600cd710 2024-04-26T23:44:35.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f1266400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f126015fe30 0x7f1260166bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:35.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f1266400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f126015fe30 0x7f1260166bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35918/0 (socket says 172.21.15.137:35918) 2024-04-26T23:44:35.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f1266400640 1 -- 172.21.15.137:0/3059304129 learned_addr learned my addr 172.21.15.137:0/3059304129 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:35.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f1265000640 1 --2- 172.21.15.137:0/3059304129 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f12600cd710 0x7f126013ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:35.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f1265a00640 1 --2- 172.21.15.137:0/3059304129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12600b54e0 0x7f126013ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:35.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f1266400640 1 -- 172.21.15.137:0/3059304129 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f12600cd710 msgr2=0x7f126013ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:35.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f1266400640 1 --2- 172.21.15.137:0/3059304129 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f12600cd710 0x7f126013ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:35.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f1266400640 1 -- 172.21.15.137:0/3059304129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12600b54e0 msgr2=0x7f126013ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:35.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f1266400640 1 --2- 172.21.15.137:0/3059304129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12600b54e0 0x7f126013ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:35.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f1266400640 1 -- 172.21.15.137:0/3059304129 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126013f3a0 con 0x7f126015fe30 2024-04-26T23:44:35.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f1266400640 1 --2- 172.21.15.137:0/3059304129 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f126015fe30 0x7f1260166bf0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f125800c800 tx=0x7f125800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:35.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f125d600640 1 -- 172.21.15.137:0/3059304129 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1258018070 con 0x7f126015fe30 2024-04-26T23:44:35.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f125d600640 1 -- 172.21.15.137:0/3059304129 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f125800a5e0 con 0x7f126015fe30 2024-04-26T23:44:35.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f1268400640 1 -- 172.21.15.137:0/3059304129 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f126013f640 con 0x7f126015fe30 2024-04-26T23:44:35.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f125d600640 1 -- 172.21.15.137:0/3059304129 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125800a9d0 con 0x7f126015fe30 2024-04-26T23:44:35.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f1268400640 1 -- 172.21.15.137:0/3059304129 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12600b1220 con 0x7f126015fe30 2024-04-26T23:44:35.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.962+0000 7f1268400640 1 -- 172.21.15.137:0/3059304129 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f126006a410 con 0x7f126015fe30 2024-04-26T23:44:35.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.966+0000 7f125d600640 1 -- 172.21.15.137:0/3059304129 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f125800ab70 con 0x7f126015fe30 2024-04-26T23:44:35.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.966+0000 7f125d600640 1 --2- 172.21.15.137:0/3059304129 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1240068380 0x7f124006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:35.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.966+0000 7f125d600640 1 -- 172.21.15.137:0/3059304129 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f1258085e60 con 0x7f126015fe30 2024-04-26T23:44:35.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.966+0000 7f1265a00640 1 --2- 172.21.15.137:0/3059304129 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1240068380 0x7f124006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:35.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.966+0000 7f1265a00640 1 --2- 172.21.15.137:0/3059304129 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1240068380 0x7f124006a840 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1254009870 tx=0x7f12540b3040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:35.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:35.970+0000 7f125d600640 1 -- 172.21.15.137:0/3059304129 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1258055d40 con 0x7f126015fe30 2024-04-26T23:44:36.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.122+0000 7f1268400640 1 -- 172.21.15.137:0/3059304129 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f126006cd80 con 0x7f126015fe30 2024-04-26T23:44:36.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.126+0000 7f125d600640 1 -- 172.21.15.137:0/3059304129 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) ==== 93+0+10 (secure 0 0 0) 0x7f125805a040 con 0x7f126015fe30 2024-04-26T23:44:36.132 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:44:36.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.126+0000 7f1268400640 1 -- 172.21.15.137:0/3059304129 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1240068380 msgr2=0x7f124006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:36.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.126+0000 7f1268400640 1 --2- 172.21.15.137:0/3059304129 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1240068380 0x7f124006a840 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1254009870 tx=0x7f12540b3040 comp rx=0 tx=0).stop 2024-04-26T23:44:36.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.126+0000 7f1268400640 1 -- 172.21.15.137:0/3059304129 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f126015fe30 msgr2=0x7f1260166bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:36.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.126+0000 7f1268400640 1 --2- 172.21.15.137:0/3059304129 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f126015fe30 0x7f1260166bf0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f125800c800 tx=0x7f125800ccc0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.126+0000 7f1268400640 1 -- 172.21.15.137:0/3059304129 shutdown_connections 2024-04-26T23:44:36.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.126+0000 7f1268400640 1 --2- 172.21.15.137:0/3059304129 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1240068380 0x7f124006a840 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.126+0000 7f1268400640 1 --2- 172.21.15.137:0/3059304129 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f126015fe30 0x7f1260166bf0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.126+0000 7f1268400640 1 --2- 172.21.15.137:0/3059304129 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f12600cd710 0x7f126013ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.126+0000 7f1268400640 1 --2- 172.21.15.137:0/3059304129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12600b54e0 0x7f126013ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.126+0000 7f1268400640 1 -- 172.21.15.137:0/3059304129 >> 172.21.15.137:0/3059304129 conn(0x7f126006c800 msgr2=0x7f1260144620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:36.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.126+0000 7f1268400640 1 -- 172.21.15.137:0/3059304129 shutdown_connections 2024-04-26T23:44:36.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.126+0000 7f1268400640 1 -- 172.21.15.137:0/3059304129 wait complete. 2024-04-26T23:44:36.153 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:44:36.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.286+0000 7f8e6ea00640 1 Processor -- start 2024-04-26T23:44:36.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.286+0000 7f8e6ea00640 1 -- start start 2024-04-26T23:44:36.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.286+0000 7f8e6ea00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e68148a10 0x7f8e680b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:36.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.286+0000 7f8e6ea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8e680b5810 0x7f8e680af530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:36.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.286+0000 7f8e6ea00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e680b5c70 con 0x7f8e680afa70 2024-04-26T23:44:36.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.286+0000 7f8e6ea00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8e6806f6e0 con 0x7f8e680b5810 2024-04-26T23:44:36.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.286+0000 7f8e6ea00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8e68073290 con 0x7f8e68148a10 2024-04-26T23:44:36.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.286+0000 7f8e5f400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8e680b5810 0x7f8e680af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:36.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.286+0000 7f8e5f400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8e680b5810 0x7f8e680af530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35930/0 (socket says 172.21.15.137:35930) 2024-04-26T23:44:36.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.286+0000 7f8e5f400640 1 -- 172.21.15.137:0/689177005 learned_addr learned my addr 172.21.15.137:0/689177005 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:36.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.286+0000 7f8e67e00640 1 --2- 172.21.15.137:0/689177005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e68148a10 0x7f8e680b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:36.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.286+0000 7f8e6ca00640 1 --1- 172.21.15.137:0/689177005 >> v1:172.21.15.170:6789/0 conn(0x7f8e680afa70 0x7f8e68162bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:45502/0 (socket says 172.21.15.137:45502) 2024-04-26T23:44:36.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.286+0000 7f8e5f400640 1 -- 172.21.15.137:0/689177005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e68148a10 msgr2=0x7f8e680b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:36.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.286+0000 7f8e5f400640 1 --2- 172.21.15.137:0/689177005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e68148a10 0x7f8e680b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.286+0000 7f8e5f400640 1 -- 172.21.15.137:0/689177005 >> v1:172.21.15.170:6789/0 conn(0x7f8e680afa70 legacy=0x7f8e68162bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:36.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.286+0000 7f8e5f400640 1 -- 172.21.15.137:0/689177005 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e68073570 con 0x7f8e680b5810 2024-04-26T23:44:36.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.290+0000 7f8e5f400640 1 --2- 172.21.15.137:0/689177005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e680b5810 0x7f8e680af530 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f8e50009870 tx=0x7f8e5001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86919831672b69 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:36.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.290+0000 7f8e67400640 1 -- 172.21.15.137:0/689177005 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e500b0070 con 0x7f8e680b5810 2024-04-26T23:44:36.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.290+0000 7f8e67400640 1 -- 172.21.15.137:0/689177005 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e500ab600 con 0x7f8e680b5810 2024-04-26T23:44:36.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.290+0000 7f8e67400640 1 -- 172.21.15.137:0/689177005 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e500ab9d0 con 0x7f8e680b5810 2024-04-26T23:44:36.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.290+0000 7f8e6ea00640 1 -- 172.21.15.137:0/689177005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e680b5810 msgr2=0x7f8e680af530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:36.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.290+0000 7f8e6ea00640 1 --2- 172.21.15.137:0/689177005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e680b5810 0x7f8e680af530 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f8e50009870 tx=0x7f8e5001c560 comp rx=0 tx=0).stop 2024-04-26T23:44:36.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.290+0000 7f8e6ea00640 1 -- 172.21.15.137:0/689177005 shutdown_connections 2024-04-26T23:44:36.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.290+0000 7f8e6ea00640 1 --2- 172.21.15.137:0/689177005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e680b5810 0x7f8e680af530 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.290+0000 7f8e6ea00640 1 --2- 172.21.15.137:0/689177005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e68148a10 0x7f8e680b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.290+0000 7f8e6ea00640 1 -- 172.21.15.137:0/689177005 >> 172.21.15.137:0/689177005 conn(0x7f8e6806c800 msgr2=0x7f8e6806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:36.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.290+0000 7f8e6ea00640 1 -- 172.21.15.137:0/689177005 shutdown_connections 2024-04-26T23:44:36.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.290+0000 7f8e6ea00640 1 -- 172.21.15.137:0/689177005 wait complete. 2024-04-26T23:44:36.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e6ea00640 1 Processor -- start 2024-04-26T23:44:36.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e6ea00640 1 -- start start 2024-04-26T23:44:36.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e6ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e680afa70 0x7f8e680cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:36.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e6ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e680b5810 0x7f8e6815f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:36.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e6ea00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e68148a10 0x7f8e6813b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:36.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e6ea00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8e68074330 con 0x7f8e680b5810 2024-04-26T23:44:36.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e6ea00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8e680afe80 con 0x7f8e680afa70 2024-04-26T23:44:36.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e6ea00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8e681617d0 con 0x7f8e68148a10 2024-04-26T23:44:36.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e5f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e680b5810 0x7f8e6815f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:36.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e5f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e680b5810 0x7f8e6815f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35934/0 (socket says 172.21.15.137:35934) 2024-04-26T23:44:36.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e5f400640 1 -- 172.21.15.137:0/192336889 learned_addr learned my addr 172.21.15.137:0/192336889 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:36.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e67e00640 1 --2- 172.21.15.137:0/192336889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e680afa70 0x7f8e680cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:36.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e6ca00640 1 --2- 172.21.15.137:0/192336889 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e68148a10 0x7f8e6813b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:36.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e5f400640 1 -- 172.21.15.137:0/192336889 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e68148a10 msgr2=0x7f8e6813b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:36.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e5f400640 1 --2- 172.21.15.137:0/192336889 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e68148a10 0x7f8e6813b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e5f400640 1 -- 172.21.15.137:0/192336889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e680afa70 msgr2=0x7f8e680cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:36.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e5f400640 1 --2- 172.21.15.137:0/192336889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e680afa70 0x7f8e680cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e5f400640 1 -- 172.21.15.137:0/192336889 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e68161ab0 con 0x7f8e680b5810 2024-04-26T23:44:36.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e5f400640 1 --2- 172.21.15.137:0/192336889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e680b5810 0x7f8e6815f680 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8e500ae040 tx=0x7f8e50019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:36.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e64c00640 1 -- 172.21.15.137:0/192336889 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e500ba070 con 0x7f8e680b5810 2024-04-26T23:44:36.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e64c00640 1 -- 172.21.15.137:0/192336889 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e500b4420 con 0x7f8e680b5810 2024-04-26T23:44:36.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e6ea00640 1 -- 172.21.15.137:0/192336889 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e68161d90 con 0x7f8e680b5810 2024-04-26T23:44:36.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e64c00640 1 -- 172.21.15.137:0/192336889 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e500b0040 con 0x7f8e680b5810 2024-04-26T23:44:36.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.294+0000 7f8e6ea00640 1 -- 172.21.15.137:0/192336889 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e680cfee0 con 0x7f8e680b5810 2024-04-26T23:44:36.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.298+0000 7f8e6ea00640 1 -- 172.21.15.137:0/192336889 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e6806a410 con 0x7f8e680b5810 2024-04-26T23:44:36.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.298+0000 7f8e64c00640 1 -- 172.21.15.137:0/192336889 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8e500bd070 con 0x7f8e680b5810 2024-04-26T23:44:36.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.298+0000 7f8e64c00640 1 --2- 172.21.15.137:0/192336889 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8e440683b0 0x7f8e4406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:36.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.298+0000 7f8e64c00640 1 -- 172.21.15.137:0/192336889 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f8e5011f9c0 con 0x7f8e680b5810 2024-04-26T23:44:36.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.298+0000 7f8e67e00640 1 --2- 172.21.15.137:0/192336889 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8e440683b0 0x7f8e4406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:36.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.298+0000 7f8e67e00640 1 --2- 172.21.15.137:0/192336889 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8e440683b0 0x7f8e4406a870 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009b60 tx=0x7f8e58009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:36.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.302+0000 7f8e64c00640 1 -- 172.21.15.137:0/192336889 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8e50121e20 con 0x7f8e680b5810 2024-04-26T23:44:36.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.458+0000 7f8e6ea00640 1 -- 172.21.15.137:0/192336889 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8e680b6000 con 0x7f8e680b5810 2024-04-26T23:44:36.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.458+0000 7f8e64c00640 1 -- 172.21.15.137:0/192336889 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) ==== 104+0+11 (secure 0 0 0) 0x7f8e50016150 con 0x7f8e680b5810 2024-04-26T23:44:36.466 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:44:36.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.462+0000 7f8e6ea00640 1 -- 172.21.15.137:0/192336889 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8e440683b0 msgr2=0x7f8e4406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:36.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.462+0000 7f8e6ea00640 1 --2- 172.21.15.137:0/192336889 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8e440683b0 0x7f8e4406a870 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009b60 tx=0x7f8e58009190 comp rx=0 tx=0).stop 2024-04-26T23:44:36.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.462+0000 7f8e6ea00640 1 -- 172.21.15.137:0/192336889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e680b5810 msgr2=0x7f8e6815f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:36.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.462+0000 7f8e6ea00640 1 --2- 172.21.15.137:0/192336889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e680b5810 0x7f8e6815f680 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8e500ae040 tx=0x7f8e50019300 comp rx=0 tx=0).stop 2024-04-26T23:44:36.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.462+0000 7f8e6ea00640 1 -- 172.21.15.137:0/192336889 shutdown_connections 2024-04-26T23:44:36.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.462+0000 7f8e6ea00640 1 --2- 172.21.15.137:0/192336889 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8e440683b0 0x7f8e4406a870 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.462+0000 7f8e6ea00640 1 --2- 172.21.15.137:0/192336889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e680b5810 0x7f8e6815f680 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.462+0000 7f8e6ea00640 1 --2- 172.21.15.137:0/192336889 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e68148a10 0x7f8e6813b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.462+0000 7f8e6ea00640 1 --2- 172.21.15.137:0/192336889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e680afa70 0x7f8e680cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.462+0000 7f8e6ea00640 1 -- 172.21.15.137:0/192336889 >> 172.21.15.137:0/192336889 conn(0x7f8e6806c800 msgr2=0x7f8e68144850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:36.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.462+0000 7f8e6ea00640 1 -- 172.21.15.137:0/192336889 shutdown_connections 2024-04-26T23:44:36.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.462+0000 7f8e6ea00640 1 -- 172.21.15.137:0/192336889 wait complete. 2024-04-26T23:44:36.488 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:44:36.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.622+0000 7f2fc2e00640 1 Processor -- start 2024-04-26T23:44:36.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.622+0000 7f2fc2e00640 1 -- start start 2024-04-26T23:44:36.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.622+0000 7f2fc2e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fbc0afbc0 0x7f2fbc15df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:36.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.622+0000 7f2fc2e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2fbc0affa0 0x7f2fbc0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:36.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.622+0000 7f2fc2e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fbc072860 con 0x7f2fbc073f20 2024-04-26T23:44:36.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.622+0000 7f2fc2e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2fbc0743b0 con 0x7f2fbc0affa0 2024-04-26T23:44:36.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.622+0000 7f2fc2e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2fbc072b00 con 0x7f2fbc0afbc0 2024-04-26T23:44:36.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.622+0000 7f2fc0e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2fbc0affa0 0x7f2fbc0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:36.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.622+0000 7f2fc0e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2fbc0affa0 0x7f2fbc0ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35946/0 (socket says 172.21.15.137:35946) 2024-04-26T23:44:36.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.622+0000 7f2fc0e00640 1 -- 172.21.15.137:0/3531986113 learned_addr learned my addr 172.21.15.137:0/3531986113 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:36.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.622+0000 7f2fb3400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f2fbc073f20 0x7f2fbc0735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32906/0 (socket says 172.21.15.137:32906) 2024-04-26T23:44:36.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.622+0000 7f2fbbe00640 1 --2- 172.21.15.137:0/3531986113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fbc0afbc0 0x7f2fbc15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:36.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.622+0000 7f2fc0e00640 1 -- 172.21.15.137:0/3531986113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fbc0afbc0 msgr2=0x7f2fbc15df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:36.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.622+0000 7f2fc0e00640 1 --2- 172.21.15.137:0/3531986113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fbc0afbc0 0x7f2fbc15df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.622+0000 7f2fc0e00640 1 -- 172.21.15.137:0/3531986113 >> v1:172.21.15.137:6789/0 conn(0x7f2fbc073f20 legacy=0x7f2fbc0735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:36.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.622+0000 7f2fc0e00640 1 -- 172.21.15.137:0/3531986113 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fbc072de0 con 0x7f2fbc0affa0 2024-04-26T23:44:36.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.622+0000 7f2fbb400640 1 -- 172.21.15.137:0/3531986113 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2224588317 0 0) 0x7f2fbc072860 con 0x7f2fbc073f20 2024-04-26T23:44:36.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.626+0000 7f2fc0e00640 1 --2- 172.21.15.137:0/3531986113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fbc0affa0 0x7f2fbc0ce3b0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009e50 tx=0x7f2fb401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94e416f3c1e1610 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:36.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.626+0000 7f2fbb400640 1 -- 172.21.15.137:0/3531986113 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb40a5700 con 0x7f2fbc0affa0 2024-04-26T23:44:36.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.626+0000 7f2fbb400640 1 -- 172.21.15.137:0/3531986113 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb40a58a0 con 0x7f2fbc0affa0 2024-04-26T23:44:36.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.626+0000 7f2fbb400640 1 -- 172.21.15.137:0/3531986113 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb40a5c70 con 0x7f2fbc0affa0 2024-04-26T23:44:36.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.626+0000 7f2fc2e00640 1 -- 172.21.15.137:0/3531986113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fbc0affa0 msgr2=0x7f2fbc0ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:36.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.626+0000 7f2fc2e00640 1 --2- 172.21.15.137:0/3531986113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fbc0affa0 0x7f2fbc0ce3b0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009e50 tx=0x7f2fb401ca30 comp rx=0 tx=0).stop 2024-04-26T23:44:36.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.626+0000 7f2fc2e00640 1 -- 172.21.15.137:0/3531986113 shutdown_connections 2024-04-26T23:44:36.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.626+0000 7f2fc2e00640 1 --2- 172.21.15.137:0/3531986113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fbc0affa0 0x7f2fbc0ce3b0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.626+0000 7f2fc2e00640 1 --2- 172.21.15.137:0/3531986113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fbc0afbc0 0x7f2fbc15df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.626+0000 7f2fc2e00640 1 -- 172.21.15.137:0/3531986113 >> 172.21.15.137:0/3531986113 conn(0x7f2fbc06c800 msgr2=0x7f2fbc06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:36.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.626+0000 7f2fc2e00640 1 -- 172.21.15.137:0/3531986113 shutdown_connections 2024-04-26T23:44:36.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.626+0000 7f2fc2e00640 1 -- 172.21.15.137:0/3531986113 wait complete. 2024-04-26T23:44:36.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.626+0000 7f2fc2e00640 1 Processor -- start 2024-04-26T23:44:36.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.626+0000 7f2fc2e00640 1 -- start start 2024-04-26T23:44:36.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.626+0000 7f2fc2e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fbc0afbc0 0x7f2fbc1499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:36.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.626+0000 7f2fc2e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fbc0affa0 0x7f2fbc1504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:36.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.626+0000 7f2fc2e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fbc0b5320 0x7f2fbc0b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:36.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.626+0000 7f2fc2e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc06f3e0 con 0x7f2fbc0affa0 2024-04-26T23:44:36.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.626+0000 7f2fc2e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc06f260 con 0x7f2fbc0b5320 2024-04-26T23:44:36.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.626+0000 7f2fc2e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2fbc06f560 con 0x7f2fbc0afbc0 2024-04-26T23:44:36.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.630+0000 7f2fb3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fbc0affa0 0x7f2fbc1504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:36.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.630+0000 7f2fb3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fbc0affa0 0x7f2fbc1504c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35954/0 (socket says 172.21.15.137:35954) 2024-04-26T23:44:36.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.630+0000 7f2fb3400640 1 -- 172.21.15.137:0/1792041123 learned_addr learned my addr 172.21.15.137:0/1792041123 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:36.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.630+0000 7f2fbbe00640 1 --2- 172.21.15.137:0/1792041123 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fbc0afbc0 0x7f2fbc1499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:36.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.630+0000 7f2fc0e00640 1 --2- 172.21.15.137:0/1792041123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fbc0b5320 0x7f2fbc0b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:36.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.630+0000 7f2fb3400640 1 -- 172.21.15.137:0/1792041123 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fbc0afbc0 msgr2=0x7f2fbc1499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:36.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.630+0000 7f2fb3400640 1 --2- 172.21.15.137:0/1792041123 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fbc0afbc0 0x7f2fbc1499b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.630+0000 7f2fb3400640 1 -- 172.21.15.137:0/1792041123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fbc0b5320 msgr2=0x7f2fbc0b57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:36.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.630+0000 7f2fb3400640 1 --2- 172.21.15.137:0/1792041123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fbc0b5320 0x7f2fbc0b57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.630+0000 7f2fb3400640 1 -- 172.21.15.137:0/1792041123 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fbc14f760 con 0x7f2fbc0affa0 2024-04-26T23:44:36.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.630+0000 7f2fb3400640 1 --2- 172.21.15.137:0/1792041123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fbc0affa0 0x7f2fbc1504c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40011f0 tx=0x7f2fa400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:36.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.630+0000 7f2fb8c00640 1 -- 172.21.15.137:0/1792041123 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4018070 con 0x7f2fbc0affa0 2024-04-26T23:44:36.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.630+0000 7f2fb8c00640 1 -- 172.21.15.137:0/1792041123 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa40074e0 con 0x7f2fbc0affa0 2024-04-26T23:44:36.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.630+0000 7f2fc2e00640 1 -- 172.21.15.137:0/1792041123 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fbc138660 con 0x7f2fbc0affa0 2024-04-26T23:44:36.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.630+0000 7f2fb8c00640 1 -- 172.21.15.137:0/1792041123 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4004a10 con 0x7f2fbc0affa0 2024-04-26T23:44:36.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.630+0000 7f2fc2e00640 1 -- 172.21.15.137:0/1792041123 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fbc14fcc0 con 0x7f2fbc0affa0 2024-04-26T23:44:36.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.630+0000 7f2fc2e00640 1 -- 172.21.15.137:0/1792041123 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fbc06a410 con 0x7f2fbc0affa0 2024-04-26T23:44:36.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.630+0000 7f2fb8c00640 1 -- 172.21.15.137:0/1792041123 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2fa401b070 con 0x7f2fbc0affa0 2024-04-26T23:44:36.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.634+0000 7f2fb8c00640 1 --2- 172.21.15.137:0/1792041123 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2f98068380 0x7f2f9806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:36.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.634+0000 7f2fb8c00640 1 -- 172.21.15.137:0/1792041123 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f2fa4085c60 con 0x7f2fbc0affa0 2024-04-26T23:44:36.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.634+0000 7f2fbbe00640 1 --2- 172.21.15.137:0/1792041123 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2f98068380 0x7f2f9806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:36.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.634+0000 7f2fbbe00640 1 --2- 172.21.15.137:0/1792041123 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2f98068380 0x7f2f9806a840 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc153150 tx=0x7f2fac009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:36.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.638+0000 7f2fb8c00640 1 -- 172.21.15.137:0/1792041123 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2fbc14f760 con 0x7f2fbc0affa0 2024-04-26T23:44:36.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.794+0000 7f2fc2e00640 1 -- 172.21.15.137:0/1792041123 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2fbc160870 con 0x7f2fbc0affa0 2024-04-26T23:44:36.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.794+0000 7f2fb8c00640 1 -- 172.21.15.137:0/1792041123 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) ==== 100+0+11 (secure 0 0 0) 0x7f2fa4055b30 con 0x7f2fbc0affa0 2024-04-26T23:44:36.801 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:44:36.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.794+0000 7f2fc2e00640 1 -- 172.21.15.137:0/1792041123 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2f98068380 msgr2=0x7f2f9806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:36.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.794+0000 7f2fc2e00640 1 --2- 172.21.15.137:0/1792041123 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2f98068380 0x7f2f9806a840 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc153150 tx=0x7f2fac009190 comp rx=0 tx=0).stop 2024-04-26T23:44:36.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.794+0000 7f2fc2e00640 1 -- 172.21.15.137:0/1792041123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fbc0affa0 msgr2=0x7f2fbc1504c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:36.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.794+0000 7f2fc2e00640 1 --2- 172.21.15.137:0/1792041123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fbc0affa0 0x7f2fbc1504c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40011f0 tx=0x7f2fa400c9b0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.794+0000 7f2fc2e00640 1 -- 172.21.15.137:0/1792041123 shutdown_connections 2024-04-26T23:44:36.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.794+0000 7f2fc2e00640 1 --2- 172.21.15.137:0/1792041123 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2f98068380 0x7f2f9806a840 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.794+0000 7f2fc2e00640 1 --2- 172.21.15.137:0/1792041123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fbc0affa0 0x7f2fbc1504c0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.794+0000 7f2fc2e00640 1 --2- 172.21.15.137:0/1792041123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fbc0b5320 0x7f2fbc0b57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.794+0000 7f2fc2e00640 1 --2- 172.21.15.137:0/1792041123 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fbc0afbc0 0x7f2fbc1499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.794+0000 7f2fc2e00640 1 -- 172.21.15.137:0/1792041123 >> 172.21.15.137:0/1792041123 conn(0x7f2fbc06c800 msgr2=0x7f2fbc0ccf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:36.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.794+0000 7f2fc2e00640 1 -- 172.21.15.137:0/1792041123 shutdown_connections 2024-04-26T23:44:36.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.794+0000 7f2fc2e00640 1 -- 172.21.15.137:0/1792041123 wait complete. 2024-04-26T23:44:36.823 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:44:36.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f4533a00640 1 Processor -- start 2024-04-26T23:44:36.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f4533a00640 1 -- start start 2024-04-26T23:44:36.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f4533a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f452c0ce3e0 0x7f452c073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:36.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f4533a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f452c073010 con 0x7f452c15de80 2024-04-26T23:44:36.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f4533a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f452c0cef90 con 0x7f452c0ce7c0 2024-04-26T23:44:36.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f4533a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f452c073280 con 0x7f452c0ce3e0 2024-04-26T23:44:36.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f452be00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f452c15de80 0x7f452c0d04e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32910/0 (socket says 172.21.15.137:32910) 2024-04-26T23:44:36.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f452be00640 1 -- 172.21.15.137:0/2780828740 learned_addr learned my addr 172.21.15.137:0/2780828740 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:36.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f4531000640 1 --2- 172.21.15.137:0/2780828740 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f452c0ce3e0 0x7f452c073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:36.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f452b400640 1 -- 172.21.15.137:0/2780828740 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 378976132 0 0) 0x7f452c073010 con 0x7f452c15de80 2024-04-26T23:44:36.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f452b400640 1 -- 172.21.15.137:0/2780828740 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4514003530 con 0x7f452c15de80 2024-04-26T23:44:36.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f452b400640 1 -- 172.21.15.137:0/2780828740 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2846631403 0 0) 0x7f452c0cef90 con 0x7f452c0ce7c0 2024-04-26T23:44:36.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f452b400640 1 -- 172.21.15.137:0/2780828740 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f452c073010 con 0x7f452c0ce7c0 2024-04-26T23:44:36.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f4531000640 1 -- 172.21.15.137:0/2780828740 >> v1:172.21.15.170:6789/0 conn(0x7f452c0ce7c0 legacy=0x7f452c146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:36.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f4531000640 1 -- 172.21.15.137:0/2780828740 >> v1:172.21.15.137:6789/0 conn(0x7f452c15de80 legacy=0x7f452c0d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:36.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f4531000640 1 -- 172.21.15.137:0/2780828740 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f452c073560 con 0x7f452c0ce3e0 2024-04-26T23:44:36.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f4531000640 1 --2- 172.21.15.137:0/2780828740 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f452c0ce3e0 0x7f452c073d60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f45200097f0 tx=0x7f452001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=952f35e3483b62d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:36.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f452b400640 1 -- 172.21.15.137:0/2780828740 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45200aa430 con 0x7f452c0ce3e0 2024-04-26T23:44:36.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f452b400640 1 -- 172.21.15.137:0/2780828740 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45200af070 con 0x7f452c0ce3e0 2024-04-26T23:44:36.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f452b400640 1 -- 172.21.15.137:0/2780828740 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45200aa7d0 con 0x7f452c0ce3e0 2024-04-26T23:44:36.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f4533a00640 1 -- 172.21.15.137:0/2780828740 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f452c0ce3e0 msgr2=0x7f452c073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:36.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f4533a00640 1 --2- 172.21.15.137:0/2780828740 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f452c0ce3e0 0x7f452c073d60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f45200097f0 tx=0x7f452001c4b0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f4533a00640 1 -- 172.21.15.137:0/2780828740 shutdown_connections 2024-04-26T23:44:36.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f4533a00640 1 --2- 172.21.15.137:0/2780828740 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f452c0ce3e0 0x7f452c073d60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f4533a00640 1 -- 172.21.15.137:0/2780828740 >> 172.21.15.137:0/2780828740 conn(0x7f452c06c5d0 msgr2=0x7f452c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:36.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f4533a00640 1 -- 172.21.15.137:0/2780828740 shutdown_connections 2024-04-26T23:44:36.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.958+0000 7f4533a00640 1 -- 172.21.15.137:0/2780828740 wait complete. 2024-04-26T23:44:36.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4533a00640 1 Processor -- start 2024-04-26T23:44:36.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4533a00640 1 -- start start 2024-04-26T23:44:36.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4533a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f452c0ce3e0 0x7f452c0b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:36.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4533a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f452c0ce7c0 0x7f452c0b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:36.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4533a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f452c15de80 0x7f452c15bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:36.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4533a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f452c06ed10 con 0x7f452c15de80 2024-04-26T23:44:36.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4533a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f452c06ee90 con 0x7f452c0ce3e0 2024-04-26T23:44:36.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4533a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f452c06f010 con 0x7f452c0ce7c0 2024-04-26T23:44:36.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4531a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f452c15de80 0x7f452c15bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:36.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4531a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f452c15de80 0x7f452c15bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35968/0 (socket says 172.21.15.137:35968) 2024-04-26T23:44:36.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4531a00640 1 -- 172.21.15.137:0/3359693419 learned_addr learned my addr 172.21.15.137:0/3359693419 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:36.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f452be00640 1 --2- 172.21.15.137:0/3359693419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f452c0ce7c0 0x7f452c0b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:36.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4531000640 1 --2- 172.21.15.137:0/3359693419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f452c0ce3e0 0x7f452c0b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:36.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4531a00640 1 -- 172.21.15.137:0/3359693419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f452c0ce7c0 msgr2=0x7f452c0b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:36.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4531a00640 1 --2- 172.21.15.137:0/3359693419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f452c0ce7c0 0x7f452c0b2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4531a00640 1 -- 172.21.15.137:0/3359693419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f452c0ce3e0 msgr2=0x7f452c0b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:36.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4531a00640 1 --2- 172.21.15.137:0/3359693419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f452c0ce3e0 0x7f452c0b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:36.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4531a00640 1 -- 172.21.15.137:0/3359693419 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f452c0b0e40 con 0x7f452c15de80 2024-04-26T23:44:36.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4531a00640 1 --2- 172.21.15.137:0/3359693419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f452c15de80 0x7f452c15bb60 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f452400c780 tx=0x7f452400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:36.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4528c00640 1 -- 172.21.15.137:0/3359693419 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4524003b80 con 0x7f452c15de80 2024-04-26T23:44:36.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4528c00640 1 -- 172.21.15.137:0/3359693419 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4524003d40 con 0x7f452c15de80 2024-04-26T23:44:36.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4533a00640 1 -- 172.21.15.137:0/3359693419 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f452c13cc60 con 0x7f452c15de80 2024-04-26T23:44:36.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4528c00640 1 -- 172.21.15.137:0/3359693419 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452400aa90 con 0x7f452c15de80 2024-04-26T23:44:36.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.962+0000 7f4533a00640 1 -- 172.21.15.137:0/3359693419 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f452c13d220 con 0x7f452c15de80 2024-04-26T23:44:36.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.966+0000 7f4533a00640 1 -- 172.21.15.137:0/3359693419 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f452c06a4b0 con 0x7f452c15de80 2024-04-26T23:44:36.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.966+0000 7f4528c00640 1 -- 172.21.15.137:0/3359693419 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f452400ac30 con 0x7f452c15de80 2024-04-26T23:44:36.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.966+0000 7f4528c00640 1 --2- 172.21.15.137:0/3359693419 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f450c068380 0x7f450c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:36.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.966+0000 7f4528c00640 1 -- 172.21.15.137:0/3359693419 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f4524086850 con 0x7f452c15de80 2024-04-26T23:44:36.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.966+0000 7f4531000640 1 --2- 172.21.15.137:0/3359693419 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f450c068380 0x7f450c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:36.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.966+0000 7f4531000640 1 --2- 172.21.15.137:0/3359693419 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f450c068380 0x7f450c06a840 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f45200ae000 tx=0x7f45200b5040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:36.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:36.970+0000 7f4528c00640 1 -- 172.21.15.137:0/3359693419 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4524056720 con 0x7f452c15de80 2024-04-26T23:44:37.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.138+0000 7f4533a00640 1 -- 172.21.15.137:0/3359693419 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f452c06cb30 con 0x7f452c15de80 2024-04-26T23:44:37.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.138+0000 7f4528c00640 1 -- 172.21.15.137:0/3359693419 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v60) ==== 80+0+0 (secure 0 0 0) 0x7f452405aa20 con 0x7f452c15de80 2024-04-26T23:44:37.146 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T23:44:37.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.142+0000 7f4533a00640 1 -- 172.21.15.137:0/3359693419 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f450c068380 msgr2=0x7f450c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:37.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.142+0000 7f4533a00640 1 --2- 172.21.15.137:0/3359693419 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f450c068380 0x7f450c06a840 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f45200ae000 tx=0x7f45200b5040 comp rx=0 tx=0).stop 2024-04-26T23:44:37.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.142+0000 7f4533a00640 1 -- 172.21.15.137:0/3359693419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f452c15de80 msgr2=0x7f452c15bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:37.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.142+0000 7f4533a00640 1 --2- 172.21.15.137:0/3359693419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f452c15de80 0x7f452c15bb60 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f452400c780 tx=0x7f452400cc40 comp rx=0 tx=0).stop 2024-04-26T23:44:37.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.142+0000 7f4533a00640 1 -- 172.21.15.137:0/3359693419 shutdown_connections 2024-04-26T23:44:37.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.142+0000 7f4533a00640 1 --2- 172.21.15.137:0/3359693419 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f450c068380 0x7f450c06a840 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.142+0000 7f4533a00640 1 --2- 172.21.15.137:0/3359693419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f452c15de80 0x7f452c15bb60 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.142+0000 7f4533a00640 1 --2- 172.21.15.137:0/3359693419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f452c0ce7c0 0x7f452c0b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.142+0000 7f4533a00640 1 --2- 172.21.15.137:0/3359693419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f452c0ce3e0 0x7f452c0b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.142+0000 7f4533a00640 1 -- 172.21.15.137:0/3359693419 >> 172.21.15.137:0/3359693419 conn(0x7f452c06c5d0 msgr2=0x7f452c0d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:37.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.142+0000 7f4533a00640 1 -- 172.21.15.137:0/3359693419 shutdown_connections 2024-04-26T23:44:37.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.142+0000 7f4533a00640 1 -- 172.21.15.137:0/3359693419 wait complete. 2024-04-26T23:44:37.167 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:44:37.167 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:44:37.176 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:44:37.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.350+0000 7f9196400640 1 Processor -- start 2024-04-26T23:44:37.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.350+0000 7f9196400640 1 -- start start 2024-04-26T23:44:37.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.350+0000 7f9196400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f91900b30b0 0x7f91900b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:37.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.350+0000 7f9196400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91900703f0 0x7f91900b3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:37.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.350+0000 7f9196400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91900b39d0 con 0x7f919015d3a0 2024-04-26T23:44:37.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.350+0000 7f9196400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f91900b58c0 con 0x7f91900b30b0 2024-04-26T23:44:37.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.350+0000 7f9196400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f91900708a0 con 0x7f91900703f0 2024-04-26T23:44:37.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.350+0000 7f9195a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f919015d3a0 0x7f919015c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32926/0 (socket says 172.21.15.137:32926) 2024-04-26T23:44:37.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.350+0000 7f9195a00640 1 -- 172.21.15.137:0/2863329053 learned_addr learned my addr 172.21.15.137:0/2863329053 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:37.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.350+0000 7f918fe00640 1 --2- 172.21.15.137:0/2863329053 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91900703f0 0x7f91900b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:37.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.350+0000 7f9195000640 1 --2- 172.21.15.137:0/2863329053 >> v2:172.21.15.170:3300/0 conn(0x7f91900b30b0 0x7f91900b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:37.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.350+0000 7f918f400640 1 -- 172.21.15.137:0/2863329053 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2203354482 0 0) 0x7f91900b39d0 con 0x7f919015d3a0 2024-04-26T23:44:37.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.350+0000 7f918f400640 1 -- 172.21.15.137:0/2863329053 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9178005740 con 0x7f919015d3a0 2024-04-26T23:44:37.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.350+0000 7f918f400640 1 -- 172.21.15.137:0/2863329053 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1190999809 0 0) 0x7f9178005740 con 0x7f919015d3a0 2024-04-26T23:44:37.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.350+0000 7f9195000640 1 -- 172.21.15.137:0/2863329053 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91900703f0 msgr2=0x7f91900b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:37.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.350+0000 7f9195000640 1 --2- 172.21.15.137:0/2863329053 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91900703f0 0x7f91900b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.350+0000 7f9195000640 1 -- 172.21.15.137:0/2863329053 >> v1:172.21.15.137:6789/0 conn(0x7f919015d3a0 legacy=0x7f919015c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:37.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.350+0000 7f9195000640 1 -- 172.21.15.137:0/2863329053 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91900b4ab0 con 0x7f91900b30b0 2024-04-26T23:44:37.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.350+0000 7f918fe00640 1 --2- 172.21.15.137:0/2863329053 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91900703f0 0x7f91900b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:44:37.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.354+0000 7f9195000640 1 --2- 172.21.15.137:0/2863329053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91900b30b0 0x7f91900b4420 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f91840097c0 tx=0x7f918401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2eb94997d238c12a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:37.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.354+0000 7f918f400640 1 -- 172.21.15.137:0/2863329053 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91840b0070 con 0x7f91900b30b0 2024-04-26T23:44:37.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.354+0000 7f918f400640 1 -- 172.21.15.137:0/2863329053 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91840ab400 con 0x7f91900b30b0 2024-04-26T23:44:37.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.354+0000 7f918f400640 1 -- 172.21.15.137:0/2863329053 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9188001a00 con 0x7f91900b30b0 2024-04-26T23:44:37.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.354+0000 7f9196400640 1 -- 172.21.15.137:0/2863329053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91900b30b0 msgr2=0x7f91900b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:37.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.354+0000 7f9196400640 1 --2- 172.21.15.137:0/2863329053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91900b30b0 0x7f91900b4420 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f91840097c0 tx=0x7f918401c3c0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.354+0000 7f9196400640 1 -- 172.21.15.137:0/2863329053 shutdown_connections 2024-04-26T23:44:37.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.354+0000 7f9196400640 1 --2- 172.21.15.137:0/2863329053 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91900703f0 0x7f91900b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.354+0000 7f9196400640 1 --2- 172.21.15.137:0/2863329053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91900b30b0 0x7f91900b4420 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.354+0000 7f9196400640 1 -- 172.21.15.137:0/2863329053 >> 172.21.15.137:0/2863329053 conn(0x7f91900d1540 msgr2=0x7f91900d1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:37.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.354+0000 7f9196400640 1 -- 172.21.15.137:0/2863329053 shutdown_connections 2024-04-26T23:44:37.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.354+0000 7f9196400640 1 -- 172.21.15.137:0/2863329053 wait complete. 2024-04-26T23:44:37.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f9196400640 1 Processor -- start 2024-04-26T23:44:37.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f9196400640 1 -- start start 2024-04-26T23:44:37.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f9196400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91900703f0 0x7f919014dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:37.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f9196400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91900b30b0 0x7f9190159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:37.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f9196400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f919015d3a0 0x7f919015ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:37.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f9196400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f919015dbe0 con 0x7f91900b30b0 2024-04-26T23:44:37.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f9196400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f91900b5350 con 0x7f91900703f0 2024-04-26T23:44:37.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f9196400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f91900d1060 con 0x7f919015d3a0 2024-04-26T23:44:37.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f918fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91900b30b0 0x7f9190159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:37.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f9195000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91900703f0 0x7f919014dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:37.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f918fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91900b30b0 0x7f9190159100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35984/0 (socket says 172.21.15.137:35984) 2024-04-26T23:44:37.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f918fe00640 1 -- 172.21.15.137:0/2906033109 learned_addr learned my addr 172.21.15.137:0/2906033109 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:37.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f9195a00640 1 --2- 172.21.15.137:0/2906033109 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f919015d3a0 0x7f919015ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:37.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f918fe00640 1 -- 172.21.15.137:0/2906033109 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f919015d3a0 msgr2=0x7f919015ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:37.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f918fe00640 1 --2- 172.21.15.137:0/2906033109 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f919015d3a0 0x7f919015ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f918fe00640 1 -- 172.21.15.137:0/2906033109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91900703f0 msgr2=0x7f919014dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:37.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f918fe00640 1 --2- 172.21.15.137:0/2906033109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91900703f0 0x7f919014dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f918fe00640 1 -- 172.21.15.137:0/2906033109 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9190153fa0 con 0x7f91900b30b0 2024-04-26T23:44:37.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f918fe00640 1 --2- 172.21.15.137:0/2906033109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91900b30b0 0x7f9190159100 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f917c00ebe0 tx=0x7f917c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:37.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f918cc00640 1 -- 172.21.15.137:0/2906033109 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c017070 con 0x7f91900b30b0 2024-04-26T23:44:37.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f918cc00640 1 -- 172.21.15.137:0/2906033109 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f917c00cc30 con 0x7f91900b30b0 2024-04-26T23:44:37.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f918cc00640 1 -- 172.21.15.137:0/2906033109 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c013470 con 0x7f91900b30b0 2024-04-26T23:44:37.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f9196400640 1 -- 172.21.15.137:0/2906033109 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9190154280 con 0x7f91900b30b0 2024-04-26T23:44:37.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f9196400640 1 -- 172.21.15.137:0/2906033109 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9190154840 con 0x7f91900b30b0 2024-04-26T23:44:37.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.358+0000 7f9196400640 1 -- 172.21.15.137:0/2906033109 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f919006a410 con 0x7f91900b30b0 2024-04-26T23:44:37.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.362+0000 7f918cc00640 1 -- 172.21.15.137:0/2906033109 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f917c01a070 con 0x7f91900b30b0 2024-04-26T23:44:37.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.362+0000 7f918cc00640 1 --2- 172.21.15.137:0/2906033109 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f91700683b0 0x7f917006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:37.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.362+0000 7f918cc00640 1 -- 172.21.15.137:0/2906033109 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f917c0868c0 con 0x7f91900b30b0 2024-04-26T23:44:37.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.362+0000 7f9195000640 1 --2- 172.21.15.137:0/2906033109 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f91700683b0 0x7f917006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:37.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.362+0000 7f9195000640 1 --2- 172.21.15.137:0/2906033109 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f91700683b0 0x7f917006a870 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f91840ad000 tx=0x7f9184008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:37.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.366+0000 7f918cc00640 1 -- 172.21.15.137:0/2906033109 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f917c056790 con 0x7f91900b30b0 2024-04-26T23:44:37.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.522+0000 7f9196400640 1 -- 172.21.15.137:0/2906033109 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91900b28a0 con 0x7f91900b30b0 2024-04-26T23:44:37.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.526+0000 7f918cc00640 1 -- 172.21.15.137:0/2906033109 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16713 (secure 0 0 0) 0x7f917c05aa90 con 0x7f91900b30b0 2024-04-26T23:44:37.532 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:37.532 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":60,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:44:22.811626+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:44:18.876990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T23:44:20.189315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:44:37.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.526+0000 7f9196400640 1 -- 172.21.15.137:0/2906033109 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f91700683b0 msgr2=0x7f917006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:37.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.526+0000 7f9196400640 1 --2- 172.21.15.137:0/2906033109 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f91700683b0 0x7f917006a870 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f91840ad000 tx=0x7f9184008040 comp rx=0 tx=0).stop 2024-04-26T23:44:37.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.526+0000 7f9196400640 1 -- 172.21.15.137:0/2906033109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91900b30b0 msgr2=0x7f9190159100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:37.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.526+0000 7f9196400640 1 --2- 172.21.15.137:0/2906033109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91900b30b0 0x7f9190159100 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f917c00ebe0 tx=0x7f917c00c520 comp rx=0 tx=0).stop 2024-04-26T23:44:37.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.526+0000 7f9196400640 1 -- 172.21.15.137:0/2906033109 shutdown_connections 2024-04-26T23:44:37.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.526+0000 7f9196400640 1 --2- 172.21.15.137:0/2906033109 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f91700683b0 0x7f917006a870 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.526+0000 7f9196400640 1 --2- 172.21.15.137:0/2906033109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91900b30b0 0x7f9190159100 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.526+0000 7f9196400640 1 --2- 172.21.15.137:0/2906033109 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f919015d3a0 0x7f919015ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.526+0000 7f9196400640 1 --2- 172.21.15.137:0/2906033109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91900703f0 0x7f919014dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.526+0000 7f9196400640 1 -- 172.21.15.137:0/2906033109 >> 172.21.15.137:0/2906033109 conn(0x7f91900d1540 msgr2=0x7f919015eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:37.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.526+0000 7f9196400640 1 -- 172.21.15.137:0/2906033109 shutdown_connections 2024-04-26T23:44:37.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.526+0000 7f9196400640 1 -- 172.21.15.137:0/2906033109 wait complete. 2024-04-26T23:44:37.554 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:44:18.876990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:44:20.189315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:44:37.555 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:44:37.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.690+0000 7f0766800640 1 Processor -- start 2024-04-26T23:44:37.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.690+0000 7f0766800640 1 -- start start 2024-04-26T23:44:37.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.690+0000 7f0766800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0760152510 0x7f076006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:37.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.690+0000 7f0766800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f07600ceb00 0x7f076006f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:37.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.690+0000 7f0766800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f07600738d0 0x7f0760073d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:37.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.690+0000 7f0766800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f076015baf0 con 0x7f07600738d0 2024-04-26T23:44:37.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.690+0000 7f0766800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f076015bdb0 con 0x7f07600ceb00 2024-04-26T23:44:37.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.690+0000 7f0766800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f076015c090 con 0x7f0760152510 2024-04-26T23:44:37.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.690+0000 7f075fe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f07600738d0 0x7f0760073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:37.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.690+0000 7f075fe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f07600738d0 0x7f0760073d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35990/0 (socket says 172.21.15.137:35990) 2024-04-26T23:44:37.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.690+0000 7f075fe00640 1 -- 172.21.15.137:0/2629842978 learned_addr learned my addr 172.21.15.137:0/2629842978 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:37.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.690+0000 7f0756a00640 1 --2- 172.21.15.137:0/2629842978 >> v2:172.21.15.170:3300/0 conn(0x7f07600ceb00 0x7f076006f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:37.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.690+0000 7f075f400640 1 --2- 172.21.15.137:0/2629842978 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0760152510 0x7f076006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:37.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.690+0000 7f075fe00640 1 -- 172.21.15.137:0/2629842978 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0760152510 msgr2=0x7f076006ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:37.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.690+0000 7f075fe00640 1 --2- 172.21.15.137:0/2629842978 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0760152510 0x7f076006ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.690+0000 7f075fe00640 1 -- 172.21.15.137:0/2629842978 >> v2:172.21.15.170:3300/0 conn(0x7f07600ceb00 msgr2=0x7f076006f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:37.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.690+0000 7f075fe00640 1 --2- 172.21.15.137:0/2629842978 >> v2:172.21.15.170:3300/0 conn(0x7f07600ceb00 0x7f076006f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.690+0000 7f075fe00640 1 -- 172.21.15.137:0/2629842978 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f076015c370 con 0x7f07600738d0 2024-04-26T23:44:37.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.690+0000 7f0756a00640 1 --2- 172.21.15.137:0/2629842978 >> v2:172.21.15.170:3300/0 conn(0x7f07600ceb00 0x7f076006f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:37.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.694+0000 7f075fe00640 1 --2- 172.21.15.137:0/2629842978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07600738d0 0x7f0760073d20 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f076015bfc0 tx=0x7f075801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452ac7c062964b0b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:37.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.694+0000 7f075ea00640 1 -- 172.21.15.137:0/2629842978 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07580a56d0 con 0x7f07600738d0 2024-04-26T23:44:37.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.694+0000 7f075ea00640 1 -- 172.21.15.137:0/2629842978 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07580a5870 con 0x7f07600738d0 2024-04-26T23:44:37.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.694+0000 7f075ea00640 1 -- 172.21.15.137:0/2629842978 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07580a5c40 con 0x7f07600738d0 2024-04-26T23:44:37.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.694+0000 7f0766800640 1 -- 172.21.15.137:0/2629842978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07600738d0 msgr2=0x7f0760073d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:37.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.694+0000 7f0766800640 1 --2- 172.21.15.137:0/2629842978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07600738d0 0x7f0760073d20 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f076015bfc0 tx=0x7f075801c930 comp rx=0 tx=0).stop 2024-04-26T23:44:37.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.694+0000 7f0766800640 1 -- 172.21.15.137:0/2629842978 shutdown_connections 2024-04-26T23:44:37.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.694+0000 7f0766800640 1 --2- 172.21.15.137:0/2629842978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07600738d0 0x7f0760073d20 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.694+0000 7f0766800640 1 --2- 172.21.15.137:0/2629842978 >> v2:172.21.15.170:3300/0 conn(0x7f07600ceb00 0x7f076006f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.694+0000 7f0766800640 1 --2- 172.21.15.137:0/2629842978 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0760152510 0x7f076006ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.694+0000 7f0766800640 1 -- 172.21.15.137:0/2629842978 >> 172.21.15.137:0/2629842978 conn(0x7f076006c800 msgr2=0x7f076006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:37.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.694+0000 7f0766800640 1 -- 172.21.15.137:0/2629842978 shutdown_connections 2024-04-26T23:44:37.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.694+0000 7f0766800640 1 -- 172.21.15.137:0/2629842978 wait complete. 2024-04-26T23:44:37.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.694+0000 7f0766800640 1 Processor -- start 2024-04-26T23:44:37.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.694+0000 7f0766800640 1 -- start start 2024-04-26T23:44:37.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.694+0000 7f0766800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07600738d0 0x7f076013a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:37.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.694+0000 7f0766800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0760152510 0x7f07600b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:37.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f0766800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07600b2270 0x7f07600b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:37.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f0766800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f076015f260 con 0x7f07600b2270 2024-04-26T23:44:37.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f0766800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f076015f0e0 con 0x7f0760152510 2024-04-26T23:44:37.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f0766800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f076015f3e0 con 0x7f07600738d0 2024-04-26T23:44:37.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f075fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07600b2270 0x7f07600b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:37.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f075fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07600b2270 0x7f07600b3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36006/0 (socket says 172.21.15.137:36006) 2024-04-26T23:44:37.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f075fe00640 1 -- 172.21.15.137:0/1485230599 learned_addr learned my addr 172.21.15.137:0/1485230599 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:37.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f075f400640 1 --2- 172.21.15.137:0/1485230599 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07600738d0 0x7f076013a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:37.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f0756a00640 1 --2- 172.21.15.137:0/1485230599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0760152510 0x7f07600b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:37.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f075fe00640 1 -- 172.21.15.137:0/1485230599 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07600738d0 msgr2=0x7f076013a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:37.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f075fe00640 1 --2- 172.21.15.137:0/1485230599 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07600738d0 0x7f076013a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f075fe00640 1 -- 172.21.15.137:0/1485230599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0760152510 msgr2=0x7f07600b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:37.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f075fe00640 1 --2- 172.21.15.137:0/1485230599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0760152510 0x7f07600b1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f075fe00640 1 -- 172.21.15.137:0/1485230599 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f076013ad80 con 0x7f07600b2270 2024-04-26T23:44:37.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f075fe00640 1 --2- 172.21.15.137:0/1485230599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07600b2270 0x7f07600b3b60 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f07580af040 tx=0x7f07580196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:37.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f0757e00640 1 -- 172.21.15.137:0/1485230599 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07580bc020 con 0x7f07600b2270 2024-04-26T23:44:37.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f0757e00640 1 -- 172.21.15.137:0/1485230599 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07580b8670 con 0x7f07600b2270 2024-04-26T23:44:37.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f0757e00640 1 -- 172.21.15.137:0/1485230599 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07580b8a60 con 0x7f07600b2270 2024-04-26T23:44:37.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f0766800640 1 -- 172.21.15.137:0/1485230599 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07601f8eb0 con 0x7f07600b2270 2024-04-26T23:44:37.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f0766800640 1 -- 172.21.15.137:0/1485230599 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07601f9470 con 0x7f07600b2270 2024-04-26T23:44:37.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f0766800640 1 -- 172.21.15.137:0/1485230599 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f076006a410 con 0x7f07600b2270 2024-04-26T23:44:37.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f0757e00640 1 -- 172.21.15.137:0/1485230599 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f07580bf020 con 0x7f07600b2270 2024-04-26T23:44:37.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.698+0000 7f0757e00640 1 --2- 172.21.15.137:0/1485230599 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f073c068380 0x7f073c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:37.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.702+0000 7f0757e00640 1 -- 172.21.15.137:0/1485230599 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f0758121980 con 0x7f07600b2270 2024-04-26T23:44:37.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.702+0000 7f075f400640 1 --2- 172.21.15.137:0/1485230599 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f073c068380 0x7f073c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:37.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.702+0000 7f075f400640 1 --2- 172.21.15.137:0/1485230599 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f073c068380 0x7f073c06a840 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f07500079c0 tx=0x7f0750008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:37.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.706+0000 7f0757e00640 1 -- 172.21.15.137:0/1485230599 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f07580c6030 con 0x7f07600b2270 2024-04-26T23:44:37.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.866+0000 7f0766800640 1 -- 172.21.15.137:0/1485230599 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f07601590a0 con 0x7f07600b2270 2024-04-26T23:44:37.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.866+0000 7f0757e00640 1 -- 172.21.15.137:0/1485230599 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) ==== 93+0+10 (secure 0 0 0) 0x7f07580165e0 con 0x7f07600b2270 2024-04-26T23:44:37.874 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:44:37.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.870+0000 7f0766800640 1 -- 172.21.15.137:0/1485230599 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f073c068380 msgr2=0x7f073c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:37.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.870+0000 7f0766800640 1 --2- 172.21.15.137:0/1485230599 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f073c068380 0x7f073c06a840 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f07500079c0 tx=0x7f0750008040 comp rx=0 tx=0).stop 2024-04-26T23:44:37.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.870+0000 7f0766800640 1 -- 172.21.15.137:0/1485230599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07600b2270 msgr2=0x7f07600b3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:37.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.870+0000 7f0766800640 1 --2- 172.21.15.137:0/1485230599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07600b2270 0x7f07600b3b60 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f07580af040 tx=0x7f07580196d0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.870+0000 7f0766800640 1 -- 172.21.15.137:0/1485230599 shutdown_connections 2024-04-26T23:44:37.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.870+0000 7f0766800640 1 --2- 172.21.15.137:0/1485230599 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f073c068380 0x7f073c06a840 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.870+0000 7f0766800640 1 --2- 172.21.15.137:0/1485230599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07600b2270 0x7f07600b3b60 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.870+0000 7f0766800640 1 --2- 172.21.15.137:0/1485230599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0760152510 0x7f07600b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.870+0000 7f0766800640 1 --2- 172.21.15.137:0/1485230599 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07600738d0 0x7f076013a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:37.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.870+0000 7f0766800640 1 -- 172.21.15.137:0/1485230599 >> 172.21.15.137:0/1485230599 conn(0x7f076006c800 msgr2=0x7f07600ccf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:37.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.870+0000 7f0766800640 1 -- 172.21.15.137:0/1485230599 shutdown_connections 2024-04-26T23:44:37.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:37.870+0000 7f0766800640 1 -- 172.21.15.137:0/1485230599 wait complete. 2024-04-26T23:44:37.895 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:44:38.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa87f800640 1 Processor -- start 2024-04-26T23:44:38.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa87f800640 1 -- start start 2024-04-26T23:44:38.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa87f800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa8780b54e0 0x7fa8780b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:38.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa87f800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8780cd710 0x7fa87815f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:38.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa87f800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa87815fe30 0x7fa878144d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:38.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa87f800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa8780b3d90 con 0x7fa87815fe30 2024-04-26T23:44:38.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa87f800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fa8780d0840 con 0x7fa8780b54e0 2024-04-26T23:44:38.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa87f800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa878160280 con 0x7fa8780cd710 2024-04-26T23:44:38.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa87d800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa87815fe30 0x7fa878144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:38.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa87d800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa87815fe30 0x7fa878144d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36008/0 (socket says 172.21.15.137:36008) 2024-04-26T23:44:38.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa87d800640 1 -- 172.21.15.137:0/342133169 learned_addr learned my addr 172.21.15.137:0/342133169 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:38.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa87ce00640 1 --2- 172.21.15.137:0/342133169 >> v2:172.21.15.170:3300/0 conn(0x7fa8780b54e0 0x7fa8780b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:38.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa86fe00640 1 --2- 172.21.15.137:0/342133169 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8780cd710 0x7fa87815f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:38.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa87d800640 1 -- 172.21.15.137:0/342133169 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8780cd710 msgr2=0x7fa87815f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:38.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa87d800640 1 --2- 172.21.15.137:0/342133169 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8780cd710 0x7fa87815f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa87d800640 1 -- 172.21.15.137:0/342133169 >> v2:172.21.15.170:3300/0 conn(0x7fa8780b54e0 msgr2=0x7fa8780b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:38.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa87d800640 1 --2- 172.21.15.137:0/342133169 >> v2:172.21.15.170:3300/0 conn(0x7fa8780b54e0 0x7fa8780b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa87d800640 1 -- 172.21.15.137:0/342133169 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8780cffa0 con 0x7fa87815fe30 2024-04-26T23:44:38.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa87ce00640 1 --2- 172.21.15.137:0/342133169 >> v2:172.21.15.170:3300/0 conn(0x7fa8780b54e0 0x7fa8780b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:38.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa87d800640 1 --2- 172.21.15.137:0/342133169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa87815fe30 0x7fa878144d20 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa87806de40 tx=0x7fa87001ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7185c41e44440ac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:38.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa877e00640 1 -- 172.21.15.137:0/342133169 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa87000b2d0 con 0x7fa87815fe30 2024-04-26T23:44:38.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa877e00640 1 -- 172.21.15.137:0/342133169 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa878145a70 con 0x7fa87815fe30 2024-04-26T23:44:38.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.030+0000 7fa877e00640 1 -- 172.21.15.137:0/342133169 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8700a7c70 con 0x7fa87815fe30 2024-04-26T23:44:38.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87f800640 1 -- 172.21.15.137:0/342133169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa87815fe30 msgr2=0x7fa878144d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:38.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87f800640 1 --2- 172.21.15.137:0/342133169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa87815fe30 0x7fa878144d20 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa87806de40 tx=0x7fa87001ebc0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87f800640 1 -- 172.21.15.137:0/342133169 shutdown_connections 2024-04-26T23:44:38.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87f800640 1 --2- 172.21.15.137:0/342133169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa87815fe30 0x7fa878144d20 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87f800640 1 --2- 172.21.15.137:0/342133169 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8780cd710 0x7fa87815f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87f800640 1 --2- 172.21.15.137:0/342133169 >> v2:172.21.15.170:3300/0 conn(0x7fa8780b54e0 0x7fa8780b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87f800640 1 -- 172.21.15.137:0/342133169 >> 172.21.15.137:0/342133169 conn(0x7fa87806c800 msgr2=0x7fa87806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:38.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87f800640 1 -- 172.21.15.137:0/342133169 shutdown_connections 2024-04-26T23:44:38.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87f800640 1 -- 172.21.15.137:0/342133169 wait complete. 2024-04-26T23:44:38.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87f800640 1 Processor -- start 2024-04-26T23:44:38.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87f800640 1 -- start start 2024-04-26T23:44:38.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87f800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8780b54e0 0x7fa87815afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:38.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87f800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8780cd710 0x7fa8780ad210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:38.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87f800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa87815fe30 0x7fa878144750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:38.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87f800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa8780cdb20 con 0x7fa87815fe30 2024-04-26T23:44:38.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87f800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa8780cded0 con 0x7fa8780cd710 2024-04-26T23:44:38.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87f800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa8781436b0 con 0x7fa8780b54e0 2024-04-26T23:44:38.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa87815fe30 0x7fa878144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:38.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87ce00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8780b54e0 0x7fa87815afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:38.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa87815fe30 0x7fa878144750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36010/0 (socket says 172.21.15.137:36010) 2024-04-26T23:44:38.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87d800640 1 -- 172.21.15.137:0/1753333419 learned_addr learned my addr 172.21.15.137:0/1753333419 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:38.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa86fe00640 1 --2- 172.21.15.137:0/1753333419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8780cd710 0x7fa8780ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:38.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87d800640 1 -- 172.21.15.137:0/1753333419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8780b54e0 msgr2=0x7fa87815afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:38.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87d800640 1 --2- 172.21.15.137:0/1753333419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8780b54e0 0x7fa87815afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87d800640 1 -- 172.21.15.137:0/1753333419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8780cd710 msgr2=0x7fa8780ad210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:38.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87d800640 1 --2- 172.21.15.137:0/1753333419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8780cd710 0x7fa8780ad210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.034+0000 7fa87d800640 1 -- 172.21.15.137:0/1753333419 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa878143990 con 0x7fa87815fe30 2024-04-26T23:44:38.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.038+0000 7fa87d800640 1 --2- 172.21.15.137:0/1753333419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa87815fe30 0x7fa878144750 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fa8700b1040 tx=0x7fa87001b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:38.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.038+0000 7fa875600640 1 -- 172.21.15.137:0/1753333419 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8700bd030 con 0x7fa87815fe30 2024-04-26T23:44:38.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.038+0000 7fa875600640 1 -- 172.21.15.137:0/1753333419 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8700a7c60 con 0x7fa87815fe30 2024-04-26T23:44:38.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.038+0000 7fa875600640 1 -- 172.21.15.137:0/1753333419 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa870009820 con 0x7fa87815fe30 2024-04-26T23:44:38.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.038+0000 7fa87f800640 1 -- 172.21.15.137:0/1753333419 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa878143c70 con 0x7fa87815fe30 2024-04-26T23:44:38.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.038+0000 7fa87f800640 1 -- 172.21.15.137:0/1753333419 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa878144230 con 0x7fa87815fe30 2024-04-26T23:44:38.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.038+0000 7fa87f800640 1 -- 172.21.15.137:0/1753333419 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa87806a410 con 0x7fa87815fe30 2024-04-26T23:44:38.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.038+0000 7fa875600640 1 -- 172.21.15.137:0/1753333419 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa8700c0070 con 0x7fa87815fe30 2024-04-26T23:44:38.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.038+0000 7fa875600640 1 --2- 172.21.15.137:0/1753333419 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa854068380 0x7fa85406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:38.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.038+0000 7fa875600640 1 -- 172.21.15.137:0/1753333419 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fa870121470 con 0x7fa87815fe30 2024-04-26T23:44:38.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.038+0000 7fa87ce00640 1 --2- 172.21.15.137:0/1753333419 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa854068380 0x7fa85406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:38.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.038+0000 7fa87ce00640 1 --2- 172.21.15.137:0/1753333419 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa854068380 0x7fa85406a840 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa8680045f0 tx=0x7fa868008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:38.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.042+0000 7fa875600640 1 -- 172.21.15.137:0/1753333419 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa8700c8020 con 0x7fa87815fe30 2024-04-26T23:44:38.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.198+0000 7fa87f800640 1 -- 172.21.15.137:0/1753333419 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa8781564b0 con 0x7fa87815fe30 2024-04-26T23:44:38.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.198+0000 7fa875600640 1 -- 172.21.15.137:0/1753333419 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) ==== 104+0+11 (secure 0 0 0) 0x7fa8700187e0 con 0x7fa87815fe30 2024-04-26T23:44:38.206 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:44:38.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.202+0000 7fa87f800640 1 -- 172.21.15.137:0/1753333419 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa854068380 msgr2=0x7fa85406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:38.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.202+0000 7fa87f800640 1 --2- 172.21.15.137:0/1753333419 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa854068380 0x7fa85406a840 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa8680045f0 tx=0x7fa868008040 comp rx=0 tx=0).stop 2024-04-26T23:44:38.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.202+0000 7fa87f800640 1 -- 172.21.15.137:0/1753333419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa87815fe30 msgr2=0x7fa878144750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:38.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.202+0000 7fa87f800640 1 --2- 172.21.15.137:0/1753333419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa87815fe30 0x7fa878144750 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fa8700b1040 tx=0x7fa87001b960 comp rx=0 tx=0).stop 2024-04-26T23:44:38.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.202+0000 7fa87f800640 1 -- 172.21.15.137:0/1753333419 shutdown_connections 2024-04-26T23:44:38.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.202+0000 7fa87f800640 1 --2- 172.21.15.137:0/1753333419 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa854068380 0x7fa85406a840 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.202+0000 7fa87f800640 1 --2- 172.21.15.137:0/1753333419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa87815fe30 0x7fa878144750 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.202+0000 7fa87f800640 1 --2- 172.21.15.137:0/1753333419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8780cd710 0x7fa8780ad210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.202+0000 7fa87f800640 1 --2- 172.21.15.137:0/1753333419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8780b54e0 0x7fa87815afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.202+0000 7fa87f800640 1 -- 172.21.15.137:0/1753333419 >> 172.21.15.137:0/1753333419 conn(0x7fa87806c800 msgr2=0x7fa8780b0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:38.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.202+0000 7fa87f800640 1 -- 172.21.15.137:0/1753333419 shutdown_connections 2024-04-26T23:44:38.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.202+0000 7fa87f800640 1 -- 172.21.15.137:0/1753333419 wait complete. 2024-04-26T23:44:38.231 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:44:38.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.366+0000 7f692da00640 1 Processor -- start 2024-04-26T23:44:38.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.366+0000 7f692da00640 1 -- start start 2024-04-26T23:44:38.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.366+0000 7f692da00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6928073f20 0x7f692815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:38.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.366+0000 7f692da00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f69280affa0 0x7f69280ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:38.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.366+0000 7f692da00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6928072860 con 0x7f69280afbc0 2024-04-26T23:44:38.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.366+0000 7f692da00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f69280743b0 con 0x7f69280affa0 2024-04-26T23:44:38.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.366+0000 7f692da00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6928072b00 con 0x7f6928073f20 2024-04-26T23:44:38.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.366+0000 7f691e000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6928073f20 0x7f692815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:38.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.366+0000 7f691e000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6928073f20 0x7f692815df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:38436/0 (socket says 172.21.15.137:38436) 2024-04-26T23:44:38.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.366+0000 7f691e000640 1 -- 172.21.15.137:0/893731165 learned_addr learned my addr 172.21.15.137:0/893731165 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:38.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.366+0000 7f6926a00640 1 --1- 172.21.15.137:0/893731165 >> v1:172.21.15.170:6789/0 conn(0x7f69280afbc0 0x7f69280735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:45516/0 (socket says 172.21.15.137:45516) 2024-04-26T23:44:38.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.366+0000 7f6927400640 1 --2- 172.21.15.137:0/893731165 >> v2:172.21.15.170:3300/0 conn(0x7f69280affa0 0x7f69280ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:38.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.366+0000 7f691e000640 1 -- 172.21.15.137:0/893731165 >> v2:172.21.15.170:3300/0 conn(0x7f69280affa0 msgr2=0x7f69280ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:38.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.366+0000 7f691e000640 1 --2- 172.21.15.137:0/893731165 >> v2:172.21.15.170:3300/0 conn(0x7f69280affa0 0x7f69280ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.366+0000 7f691e000640 1 -- 172.21.15.137:0/893731165 >> v1:172.21.15.170:6789/0 conn(0x7f69280afbc0 legacy=0x7f69280735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:38.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.366+0000 7f691e000640 1 -- 172.21.15.137:0/893731165 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6928072de0 con 0x7f6928073f20 2024-04-26T23:44:38.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.366+0000 7f691e000640 1 --2- 172.21.15.137:0/893731165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6928073f20 0x7f692815df90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6910009870 tx=0x7f691001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be2d03f2020aca37 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:38.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.366+0000 7f6926000640 1 -- 172.21.15.137:0/893731165 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69100b2070 con 0x7f6928073f20 2024-04-26T23:44:38.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.366+0000 7f6926000640 1 -- 172.21.15.137:0/893731165 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69100a9070 con 0x7f6928073f20 2024-04-26T23:44:38.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.366+0000 7f6926000640 1 -- 172.21.15.137:0/893731165 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69100ad880 con 0x7f6928073f20 2024-04-26T23:44:38.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f692da00640 1 -- 172.21.15.137:0/893731165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6928073f20 msgr2=0x7f692815df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:38.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f692da00640 1 --2- 172.21.15.137:0/893731165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6928073f20 0x7f692815df90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6910009870 tx=0x7f691001c560 comp rx=0 tx=0).stop 2024-04-26T23:44:38.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f692da00640 1 -- 172.21.15.137:0/893731165 shutdown_connections 2024-04-26T23:44:38.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f692da00640 1 --2- 172.21.15.137:0/893731165 >> v2:172.21.15.170:3300/0 conn(0x7f69280affa0 0x7f69280ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f692da00640 1 --2- 172.21.15.137:0/893731165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6928073f20 0x7f692815df90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f692da00640 1 -- 172.21.15.137:0/893731165 >> 172.21.15.137:0/893731165 conn(0x7f692806c800 msgr2=0x7f692806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:38.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f692da00640 1 -- 172.21.15.137:0/893731165 shutdown_connections 2024-04-26T23:44:38.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f692da00640 1 -- 172.21.15.137:0/893731165 wait complete. 2024-04-26T23:44:38.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f692da00640 1 Processor -- start 2024-04-26T23:44:38.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f692da00640 1 -- start start 2024-04-26T23:44:38.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f692da00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69280afbc0 0x7f692814f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:38.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f692da00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69280affa0 0x7f692814e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:38.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f692da00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69280b13d0 0x7f6928151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:38.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f692da00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f692806f3a0 con 0x7f69280afbc0 2024-04-26T23:44:38.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f692da00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f692806f220 con 0x7f69280affa0 2024-04-26T23:44:38.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f692da00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f692806f520 con 0x7f69280b13d0 2024-04-26T23:44:38.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f6926a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69280afbc0 0x7f692814f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:38.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f6926a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69280afbc0 0x7f692814f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36016/0 (socket says 172.21.15.137:36016) 2024-04-26T23:44:38.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f6926a00640 1 -- 172.21.15.137:0/2330276392 learned_addr learned my addr 172.21.15.137:0/2330276392 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:38.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f6927400640 1 --2- 172.21.15.137:0/2330276392 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69280b13d0 0x7f6928151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:38.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f691e000640 1 --2- 172.21.15.137:0/2330276392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69280affa0 0x7f692814e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:38.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f6926a00640 1 -- 172.21.15.137:0/2330276392 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69280b13d0 msgr2=0x7f6928151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:38.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f6926a00640 1 --2- 172.21.15.137:0/2330276392 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69280b13d0 0x7f6928151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f6926a00640 1 -- 172.21.15.137:0/2330276392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69280affa0 msgr2=0x7f692814e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:38.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f6926a00640 1 --2- 172.21.15.137:0/2330276392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69280affa0 0x7f692814e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f6926a00640 1 -- 172.21.15.137:0/2330276392 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f692815cec0 con 0x7f69280afbc0 2024-04-26T23:44:38.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f691e000640 1 --2- 172.21.15.137:0/2330276392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69280affa0 0x7f692814e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:38.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f6927400640 1 --2- 172.21.15.137:0/2330276392 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69280b13d0 0x7f6928151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:38.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.370+0000 7f6926a00640 1 --2- 172.21.15.137:0/2330276392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69280afbc0 0x7f692814f940 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f691800c420 tx=0x7f691800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:38.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.374+0000 7f691f400640 1 -- 172.21.15.137:0/2330276392 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69180074e0 con 0x7f69280afbc0 2024-04-26T23:44:38.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.374+0000 7f691f400640 1 -- 172.21.15.137:0/2330276392 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69180076a0 con 0x7f69280afbc0 2024-04-26T23:44:38.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.374+0000 7f692da00640 1 -- 172.21.15.137:0/2330276392 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6928150290 con 0x7f69280afbc0 2024-04-26T23:44:38.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.374+0000 7f691f400640 1 -- 172.21.15.137:0/2330276392 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6918004a30 con 0x7f69280afbc0 2024-04-26T23:44:38.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.374+0000 7f692da00640 1 -- 172.21.15.137:0/2330276392 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6928150ab0 con 0x7f69280afbc0 2024-04-26T23:44:38.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.374+0000 7f692da00640 1 -- 172.21.15.137:0/2330276392 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f692806a410 con 0x7f69280afbc0 2024-04-26T23:44:38.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.374+0000 7f691f400640 1 -- 172.21.15.137:0/2330276392 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f691801a020 con 0x7f69280afbc0 2024-04-26T23:44:38.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.374+0000 7f691f400640 1 --2- 172.21.15.137:0/2330276392 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6904068380 0x7f690406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:38.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.374+0000 7f691f400640 1 -- 172.21.15.137:0/2330276392 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f6918086160 con 0x7f69280afbc0 2024-04-26T23:44:38.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.374+0000 7f691e000640 1 --2- 172.21.15.137:0/2330276392 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6904068380 0x7f690406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:38.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.378+0000 7f691e000640 1 --2- 172.21.15.137:0/2330276392 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6904068380 0x7f690406a840 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f69100af000 tx=0x7f69100a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:38.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.382+0000 7f691f400640 1 -- 172.21.15.137:0/2330276392 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f692815cec0 con 0x7f69280afbc0 2024-04-26T23:44:38.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.538+0000 7f692da00640 1 -- 172.21.15.137:0/2330276392 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f69280695f0 con 0x7f69280afbc0 2024-04-26T23:44:38.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.538+0000 7f691f400640 1 -- 172.21.15.137:0/2330276392 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) ==== 100+0+11 (secure 0 0 0) 0x7f69180567b0 con 0x7f69280afbc0 2024-04-26T23:44:38.546 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:44:38.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.538+0000 7f692da00640 1 -- 172.21.15.137:0/2330276392 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6904068380 msgr2=0x7f690406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:38.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.542+0000 7f692da00640 1 --2- 172.21.15.137:0/2330276392 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6904068380 0x7f690406a840 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f69100af000 tx=0x7f69100a7000 comp rx=0 tx=0).stop 2024-04-26T23:44:38.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.542+0000 7f692da00640 1 -- 172.21.15.137:0/2330276392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69280afbc0 msgr2=0x7f692814f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:38.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.542+0000 7f692da00640 1 --2- 172.21.15.137:0/2330276392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69280afbc0 0x7f692814f940 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f691800c420 tx=0x7f691800c8e0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.542+0000 7f692da00640 1 -- 172.21.15.137:0/2330276392 shutdown_connections 2024-04-26T23:44:38.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.542+0000 7f692da00640 1 --2- 172.21.15.137:0/2330276392 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6904068380 0x7f690406a840 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.542+0000 7f692da00640 1 --2- 172.21.15.137:0/2330276392 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69280b13d0 0x7f6928151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.542+0000 7f692da00640 1 --2- 172.21.15.137:0/2330276392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69280affa0 0x7f692814e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.542+0000 7f692da00640 1 --2- 172.21.15.137:0/2330276392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69280afbc0 0x7f692814f940 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.542+0000 7f692da00640 1 -- 172.21.15.137:0/2330276392 >> 172.21.15.137:0/2330276392 conn(0x7f692806c800 msgr2=0x7f69280ae8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:38.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.542+0000 7f692da00640 1 -- 172.21.15.137:0/2330276392 shutdown_connections 2024-04-26T23:44:38.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.542+0000 7f692da00640 1 -- 172.21.15.137:0/2330276392 wait complete. 2024-04-26T23:44:38.567 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:44:38.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.698+0000 7fb1f9200640 1 Processor -- start 2024-04-26T23:44:38.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.698+0000 7fb1f9200640 1 -- start start 2024-04-26T23:44:38.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.698+0000 7fb1f9200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb1f40725a0 0x7fb1f40cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:38.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.698+0000 7fb1f9200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb1f40b5080 0x7fb1f4165930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:38.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.698+0000 7fb1f9200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f40cfef0 con 0x7fb1f4073f30 2024-04-26T23:44:38.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.698+0000 7fb1f9200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb1f40cddc0 con 0x7fb1f40b5080 2024-04-26T23:44:38.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.698+0000 7fb1f9200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb1f40d01b0 con 0x7fb1f40725a0 2024-04-26T23:44:38.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.698+0000 7fb1f2800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb1f40b5080 0x7fb1f4165930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:38.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.698+0000 7fb1e9400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb1f4073f30 0x7fb1f4072980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32940/0 (socket says 172.21.15.137:32940) 2024-04-26T23:44:38.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.698+0000 7fb1e9400640 1 -- 172.21.15.137:0/2984194026 learned_addr learned my addr 172.21.15.137:0/2984194026 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:38.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.698+0000 7fb1f1e00640 1 --2- 172.21.15.137:0/2984194026 >> v2:172.21.15.170:3300/0 conn(0x7fb1f40725a0 0x7fb1f40cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:38.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.698+0000 7fb1f2800640 1 -- 172.21.15.137:0/2984194026 >> v2:172.21.15.170:3300/0 conn(0x7fb1f40725a0 msgr2=0x7fb1f40cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:38.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.698+0000 7fb1f2800640 1 --2- 172.21.15.137:0/2984194026 >> v2:172.21.15.170:3300/0 conn(0x7fb1f40725a0 0x7fb1f40cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.698+0000 7fb1f2800640 1 -- 172.21.15.137:0/2984194026 >> v1:172.21.15.137:6789/0 conn(0x7fb1f4073f30 legacy=0x7fb1f4072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:38.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.698+0000 7fb1f2800640 1 -- 172.21.15.137:0/2984194026 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f40d0490 con 0x7fb1f40b5080 2024-04-26T23:44:38.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.702+0000 7fb1f2800640 1 --2- 172.21.15.137:0/2984194026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1f40b5080 0x7fb1f4165930 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb1f406ffc0 tx=0x7fb1ec01eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b47bcd3785f6bc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:38.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.702+0000 7fb1f1400640 1 -- 172.21.15.137:0/2984194026 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec0b4070 con 0x7fb1f40b5080 2024-04-26T23:44:38.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.702+0000 7fb1f1400640 1 -- 172.21.15.137:0/2984194026 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1ec0a79f0 con 0x7fb1f40b5080 2024-04-26T23:44:38.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.702+0000 7fb1f1400640 1 -- 172.21.15.137:0/2984194026 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec0a7dc0 con 0x7fb1f40b5080 2024-04-26T23:44:38.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.702+0000 7fb1f9200640 1 -- 172.21.15.137:0/2984194026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1f40b5080 msgr2=0x7fb1f4165930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:38.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.702+0000 7fb1f9200640 1 --2- 172.21.15.137:0/2984194026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1f40b5080 0x7fb1f4165930 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb1f406ffc0 tx=0x7fb1ec01eb10 comp rx=0 tx=0).stop 2024-04-26T23:44:38.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.702+0000 7fb1f9200640 1 -- 172.21.15.137:0/2984194026 shutdown_connections 2024-04-26T23:44:38.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.702+0000 7fb1f9200640 1 --2- 172.21.15.137:0/2984194026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1f40b5080 0x7fb1f4165930 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.702+0000 7fb1f9200640 1 --2- 172.21.15.137:0/2984194026 >> v2:172.21.15.170:3300/0 conn(0x7fb1f40725a0 0x7fb1f40cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.702+0000 7fb1f9200640 1 -- 172.21.15.137:0/2984194026 >> 172.21.15.137:0/2984194026 conn(0x7fb1f406c5d0 msgr2=0x7fb1f406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:38.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.702+0000 7fb1f9200640 1 -- 172.21.15.137:0/2984194026 shutdown_connections 2024-04-26T23:44:38.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.702+0000 7fb1f9200640 1 -- 172.21.15.137:0/2984194026 wait complete. 2024-04-26T23:44:38.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.702+0000 7fb1f9200640 1 Processor -- start 2024-04-26T23:44:38.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.702+0000 7fb1f9200640 1 -- start start 2024-04-26T23:44:38.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1f9200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1f40725a0 0x7fb1f415c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:38.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1f9200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1f4073f30 0x7fb1f4141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:38.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1f9200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1f40b5080 0x7fb1f413c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:38.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1f9200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f406f930 con 0x7fb1f40b5080 2024-04-26T23:44:38.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1f9200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f406f7b0 con 0x7fb1f40725a0 2024-04-26T23:44:38.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1f9200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f406fab0 con 0x7fb1f4073f30 2024-04-26T23:44:38.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1f2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1f40b5080 0x7fb1f413c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:38.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1f2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1f40b5080 0x7fb1f413c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36028/0 (socket says 172.21.15.137:36028) 2024-04-26T23:44:38.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1f2800640 1 -- 172.21.15.137:0/2521454045 learned_addr learned my addr 172.21.15.137:0/2521454045 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:38.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1f1e00640 1 --2- 172.21.15.137:0/2521454045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1f40725a0 0x7fb1f415c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:38.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1e9400640 1 --2- 172.21.15.137:0/2521454045 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1f4073f30 0x7fb1f4141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:38.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1f2800640 1 -- 172.21.15.137:0/2521454045 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1f4073f30 msgr2=0x7fb1f4141bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:38.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1f2800640 1 --2- 172.21.15.137:0/2521454045 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1f4073f30 0x7fb1f4141bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1f2800640 1 -- 172.21.15.137:0/2521454045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1f40725a0 msgr2=0x7fb1f415c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:38.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1f2800640 1 --2- 172.21.15.137:0/2521454045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1f40725a0 0x7fb1f415c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1f2800640 1 -- 172.21.15.137:0/2521454045 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f415cc80 con 0x7fb1f40b5080 2024-04-26T23:44:38.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1f2800640 1 --2- 172.21.15.137:0/2521454045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1f40b5080 0x7fb1f413c630 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec0b2040 tx=0x7fb1ec01b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:38.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1eaa00640 1 -- 172.21.15.137:0/2521454045 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec0b4040 con 0x7fb1f40b5080 2024-04-26T23:44:38.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1eaa00640 1 -- 172.21.15.137:0/2521454045 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1ec0bd070 con 0x7fb1f40b5080 2024-04-26T23:44:38.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1eaa00640 1 -- 172.21.15.137:0/2521454045 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec0af860 con 0x7fb1f40b5080 2024-04-26T23:44:38.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1f9200640 1 -- 172.21.15.137:0/2521454045 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f415d240 con 0x7fb1f40b5080 2024-04-26T23:44:38.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1f9200640 1 -- 172.21.15.137:0/2521454045 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f415d800 con 0x7fb1f40b5080 2024-04-26T23:44:38.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1f9200640 1 -- 172.21.15.137:0/2521454045 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1f406a4b0 con 0x7fb1f40b5080 2024-04-26T23:44:38.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.706+0000 7fb1eaa00640 1 -- 172.21.15.137:0/2521454045 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb1ec0afa00 con 0x7fb1f40b5080 2024-04-26T23:44:38.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.710+0000 7fb1eaa00640 1 --2- 172.21.15.137:0/2521454045 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb1d0068380 0x7fb1d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:38.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.710+0000 7fb1eaa00640 1 -- 172.21.15.137:0/2521454045 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fb1ec120e90 con 0x7fb1f40b5080 2024-04-26T23:44:38.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.710+0000 7fb1f1e00640 1 --2- 172.21.15.137:0/2521454045 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb1d0068380 0x7fb1d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:38.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.710+0000 7fb1f1e00640 1 --2- 172.21.15.137:0/2521454045 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb1d0068380 0x7fb1d006a840 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4009ac0 tx=0x7fb1e4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:38.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.714+0000 7fb1eaa00640 1 -- 172.21.15.137:0/2521454045 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb1ec018730 con 0x7fb1f40b5080 2024-04-26T23:44:38.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.882+0000 7fb1f9200640 1 -- 172.21.15.137:0/2521454045 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb1f40cd550 con 0x7fb1f40b5080 2024-04-26T23:44:38.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.882+0000 7fb1eaa00640 1 -- 172.21.15.137:0/2521454045 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v60) ==== 80+0+0 (secure 0 0 0) 0x7fb1ec0a79c0 con 0x7fb1f40b5080 2024-04-26T23:44:38.889 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T23:44:38.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.882+0000 7fb1f9200640 1 -- 172.21.15.137:0/2521454045 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb1d0068380 msgr2=0x7fb1d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:38.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.882+0000 7fb1f9200640 1 --2- 172.21.15.137:0/2521454045 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb1d0068380 0x7fb1d006a840 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4009ac0 tx=0x7fb1e4009190 comp rx=0 tx=0).stop 2024-04-26T23:44:38.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.882+0000 7fb1f9200640 1 -- 172.21.15.137:0/2521454045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1f40b5080 msgr2=0x7fb1f413c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:38.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.882+0000 7fb1f9200640 1 --2- 172.21.15.137:0/2521454045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1f40b5080 0x7fb1f413c630 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec0b2040 tx=0x7fb1ec01b8b0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.882+0000 7fb1f9200640 1 -- 172.21.15.137:0/2521454045 shutdown_connections 2024-04-26T23:44:38.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.882+0000 7fb1f9200640 1 --2- 172.21.15.137:0/2521454045 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb1d0068380 0x7fb1d006a840 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.882+0000 7fb1f9200640 1 --2- 172.21.15.137:0/2521454045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1f40b5080 0x7fb1f413c630 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.882+0000 7fb1f9200640 1 --2- 172.21.15.137:0/2521454045 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1f4073f30 0x7fb1f4141bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.882+0000 7fb1f9200640 1 --2- 172.21.15.137:0/2521454045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1f40725a0 0x7fb1f415c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:38.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.882+0000 7fb1f9200640 1 -- 172.21.15.137:0/2521454045 >> 172.21.15.137:0/2521454045 conn(0x7fb1f406c5d0 msgr2=0x7fb1f40afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:38.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.882+0000 7fb1f9200640 1 -- 172.21.15.137:0/2521454045 shutdown_connections 2024-04-26T23:44:38.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:38.882+0000 7fb1f9200640 1 -- 172.21.15.137:0/2521454045 wait complete. 2024-04-26T23:44:38.910 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi137.front.sepia.ceph.com... 2024-04-26T23:44:38.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:38.911 DEBUG:teuthology.orchestra.run.smithi137:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-26T23:44:38.928 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi137.stderr:ceph-fuse[42314]: fuse finished with error 0 and tester_r 0 2024-04-26T23:44:38.931 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:44:45.032 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T23:44:45.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:45.033 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T23:44:45.043 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:44:45.043 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:44:45.053 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:44:45.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3927200640 1 Processor -- start 2024-04-26T23:44:45.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3927200640 1 -- start start 2024-04-26T23:44:45.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3927200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39280cee50 0x7f39280d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:45.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3927200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39280b44e0 con 0x7f392806c400 2024-04-26T23:44:45.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3927200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39280d1340 con 0x7f39280d3270 2024-04-26T23:44:45.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3927200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f39280d1f50 con 0x7f39280cee50 2024-04-26T23:44:45.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3925400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f392806c400 0x7f39280d2b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:59548/0 (socket says 172.21.15.137:59548) 2024-04-26T23:44:45.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3925400640 1 -- 172.21.15.137:0/473064779 learned_addr learned my addr 172.21.15.137:0/473064779 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:45.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3925e00640 1 --2- 172.21.15.137:0/473064779 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39280cee50 0x7f39280d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:45.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3924a00640 1 -- 172.21.15.137:0/473064779 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2720454738 0 0) 0x7f39280b44e0 con 0x7f392806c400 2024-04-26T23:44:45.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3924a00640 1 -- 172.21.15.137:0/473064779 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f390c003530 con 0x7f392806c400 2024-04-26T23:44:45.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3924a00640 1 -- 172.21.15.137:0/473064779 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4159660399 0 0) 0x7f39280d1340 con 0x7f39280d3270 2024-04-26T23:44:45.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3924a00640 1 -- 172.21.15.137:0/473064779 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39280b44e0 con 0x7f39280d3270 2024-04-26T23:44:45.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3924a00640 1 -- 172.21.15.137:0/473064779 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 845306220 0 0) 0x7f390c003530 con 0x7f392806c400 2024-04-26T23:44:45.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3924a00640 1 -- 172.21.15.137:0/473064779 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39280cee50 msgr2=0x7f39280d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:45.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3924a00640 1 --2- 172.21.15.137:0/473064779 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39280cee50 0x7f39280d0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:45.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3924a00640 1 -- 172.21.15.137:0/473064779 >> v1:172.21.15.170:6789/0 conn(0x7f39280d3270 legacy=0x7f39280b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:45.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3924a00640 1 -- 172.21.15.137:0/473064779 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39280d1620 con 0x7f392806c400 2024-04-26T23:44:45.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3924a00640 1 -- 172.21.15.137:0/473064779 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f3914001680 con 0x7f392806c400 2024-04-26T23:44:45.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3924a00640 1 -- 172.21.15.137:0/473064779 >> v1:172.21.15.137:6789/0 conn(0x7f392806c400 legacy=0x7f39280d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:45.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3924a00640 1 --2- 172.21.15.137:0/473064779 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39280cee50 0x7f390c003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:45.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3924a00640 1 --2- 172.21.15.137:0/473064779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f390c0040e0 0x7f390c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:45.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3924a00640 1 --2- 172.21.15.137:0/473064779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f390c004d50 0x7f390c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:45.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3924a00640 1 -- 172.21.15.137:0/473064779 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f39280d1f50 con 0x7f390c0040e0 2024-04-26T23:44:45.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3924a00640 1 -- 172.21.15.137:0/473064779 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f390c00bb60 con 0x7f390c004d50 2024-04-26T23:44:45.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3924a00640 1 -- 172.21.15.137:0/473064779 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f390c00bd30 con 0x7f39280cee50 2024-04-26T23:44:45.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3925400640 1 --2- 172.21.15.137:0/473064779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f390c0040e0 0x7f390c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:45.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3925e00640 1 --2- 172.21.15.137:0/473064779 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39280cee50 0x7f390c003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:45.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3926800640 1 --2- 172.21.15.137:0/473064779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f390c004d50 0x7f390c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:45.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3925400640 1 -- 172.21.15.137:0/473064779 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39280cee50 msgr2=0x7f390c003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:45.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3925400640 1 --2- 172.21.15.137:0/473064779 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39280cee50 0x7f390c003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:45.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3925400640 1 -- 172.21.15.137:0/473064779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f390c004d50 msgr2=0x7f390c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:45.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3925400640 1 --2- 172.21.15.137:0/473064779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f390c004d50 0x7f390c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:45.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3925400640 1 -- 172.21.15.137:0/473064779 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390c003530 con 0x7f390c0040e0 2024-04-26T23:44:45.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.229+0000 7f3926800640 1 --2- 172.21.15.137:0/473064779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f390c004d50 0x7f390c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:45.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.233+0000 7f3925400640 1 --2- 172.21.15.137:0/473064779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f390c0040e0 0x7f390c004810 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f391400c190 tx=0x7f391401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34826b8deaef3a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:45.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.233+0000 7f3924a00640 1 -- 172.21.15.137:0/473064779 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3914007cd0 con 0x7f390c0040e0 2024-04-26T23:44:45.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.233+0000 7f3924a00640 1 -- 172.21.15.137:0/473064779 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39140a9020 con 0x7f390c0040e0 2024-04-26T23:44:45.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.233+0000 7f3924a00640 1 -- 172.21.15.137:0/473064779 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3914005ae0 con 0x7f390c0040e0 2024-04-26T23:44:45.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.233+0000 7f3927200640 1 -- 172.21.15.137:0/473064779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f390c0040e0 msgr2=0x7f390c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:45.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.233+0000 7f3927200640 1 --2- 172.21.15.137:0/473064779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f390c0040e0 0x7f390c004810 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f391400c190 tx=0x7f391401cc00 comp rx=0 tx=0).stop 2024-04-26T23:44:45.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.233+0000 7f3926800640 1 -- 172.21.15.137:0/473064779 reap_dead start 2024-04-26T23:44:45.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.233+0000 7f3927200640 1 -- 172.21.15.137:0/473064779 shutdown_connections 2024-04-26T23:44:45.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.233+0000 7f3927200640 1 -- 172.21.15.137:0/473064779 >> 172.21.15.137:0/473064779 conn(0x7f392809ba60 msgr2=0x7f392809be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:45.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.233+0000 7f3927200640 1 -- 172.21.15.137:0/473064779 shutdown_connections 2024-04-26T23:44:45.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.233+0000 7f3927200640 1 -- 172.21.15.137:0/473064779 wait complete. 2024-04-26T23:44:45.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.237+0000 7f3927200640 1 Processor -- start 2024-04-26T23:44:45.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.237+0000 7f3927200640 1 -- start start 2024-04-26T23:44:45.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.237+0000 7f3927200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f390c0040e0 0x7f392815e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:45.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.237+0000 7f3927200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f392815fda0 0x7f3928070d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:45.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.237+0000 7f3927200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3928071260 0x7f392815ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:45.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.237+0000 7f3927200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f392816acd0 con 0x7f392815fda0 2024-04-26T23:44:45.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.237+0000 7f3927200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f39280b3e60 con 0x7f3928071260 2024-04-26T23:44:45.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.237+0000 7f3927200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f392816ae50 con 0x7f390c0040e0 2024-04-26T23:44:45.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.237+0000 7f3925400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f392815fda0 0x7f3928070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:45.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.237+0000 7f3925400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f392815fda0 0x7f3928070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41132/0 (socket says 172.21.15.137:41132) 2024-04-26T23:44:45.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.237+0000 7f3925400640 1 -- 172.21.15.137:0/952964446 learned_addr learned my addr 172.21.15.137:0/952964446 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:45.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.237+0000 7f3925e00640 1 --2- 172.21.15.137:0/952964446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f390c0040e0 0x7f392815e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:45.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.237+0000 7f3926800640 1 --2- 172.21.15.137:0/952964446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3928071260 0x7f392815ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:45.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.237+0000 7f3925400640 1 -- 172.21.15.137:0/952964446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f390c0040e0 msgr2=0x7f392815e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:45.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.237+0000 7f3925400640 1 --2- 172.21.15.137:0/952964446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f390c0040e0 0x7f392815e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:45.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.237+0000 7f3925400640 1 -- 172.21.15.137:0/952964446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3928071260 msgr2=0x7f392815ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:45.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.237+0000 7f3925400640 1 --2- 172.21.15.137:0/952964446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3928071260 0x7f392815ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:45.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.241+0000 7f3925400640 1 -- 172.21.15.137:0/952964446 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392815ed00 con 0x7f392815fda0 2024-04-26T23:44:45.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.241+0000 7f3925400640 1 --2- 172.21.15.137:0/952964446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f392815fda0 0x7f3928070d20 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f391400c190 tx=0x7f390c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:45.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.241+0000 7f391e000640 1 -- 172.21.15.137:0/952964446 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39140049f0 con 0x7f392815fda0 2024-04-26T23:44:45.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.241+0000 7f391e000640 1 -- 172.21.15.137:0/952964446 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3914004b90 con 0x7f392815fda0 2024-04-26T23:44:45.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.241+0000 7f3927200640 1 -- 172.21.15.137:0/952964446 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392815efe0 con 0x7f392815fda0 2024-04-26T23:44:45.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.241+0000 7f391e000640 1 -- 172.21.15.137:0/952964446 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39140070d0 con 0x7f392815fda0 2024-04-26T23:44:45.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.241+0000 7f3927200640 1 -- 172.21.15.137:0/952964446 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f392815f5a0 con 0x7f392815fda0 2024-04-26T23:44:45.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.241+0000 7f3927200640 1 -- 172.21.15.137:0/952964446 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f392806a410 con 0x7f392815fda0 2024-04-26T23:44:45.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.241+0000 7f391e000640 1 -- 172.21.15.137:0/952964446 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3914007270 con 0x7f392815fda0 2024-04-26T23:44:45.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.241+0000 7f391e000640 1 --2- 172.21.15.137:0/952964446 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3908068380 0x7f390806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:45.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.241+0000 7f391e000640 1 -- 172.21.15.137:0/952964446 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f391411fbe0 con 0x7f392815fda0 2024-04-26T23:44:45.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.241+0000 7f3925e00640 1 --2- 172.21.15.137:0/952964446 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3908068380 0x7f390806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:45.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.245+0000 7f3925e00640 1 --2- 172.21.15.137:0/952964446 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3908068380 0x7f390806a840 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f392809c3f0 tx=0x7f3918009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:45.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.249+0000 7f391e000640 1 -- 172.21.15.137:0/952964446 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3914016910 con 0x7f392815fda0 2024-04-26T23:44:45.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.405+0000 7f3927200640 1 -- 172.21.15.137:0/952964446 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39280698f0 con 0x7f392815fda0 2024-04-26T23:44:45.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.405+0000 7f391e000640 1 -- 172.21.15.137:0/952964446 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16713 (secure 0 0 0) 0x7f39140efb40 con 0x7f392815fda0 2024-04-26T23:44:45.411 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:45.411 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":60,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:44:22.811626+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:44:18.876990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T23:44:20.189315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:44:45.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.409+0000 7f3927200640 1 -- 172.21.15.137:0/952964446 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3908068380 msgr2=0x7f390806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:45.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.409+0000 7f3927200640 1 --2- 172.21.15.137:0/952964446 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3908068380 0x7f390806a840 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f392809c3f0 tx=0x7f3918009190 comp rx=0 tx=0).stop 2024-04-26T23:44:45.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.409+0000 7f3927200640 1 -- 172.21.15.137:0/952964446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f392815fda0 msgr2=0x7f3928070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:45.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.409+0000 7f3927200640 1 --2- 172.21.15.137:0/952964446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f392815fda0 0x7f3928070d20 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f391400c190 tx=0x7f390c005840 comp rx=0 tx=0).stop 2024-04-26T23:44:45.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.409+0000 7f3927200640 1 -- 172.21.15.137:0/952964446 shutdown_connections 2024-04-26T23:44:45.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.409+0000 7f3927200640 1 --2- 172.21.15.137:0/952964446 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3908068380 0x7f390806a840 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:45.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.409+0000 7f3927200640 1 --2- 172.21.15.137:0/952964446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f392815fda0 0x7f3928070d20 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:45.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.409+0000 7f3927200640 1 --2- 172.21.15.137:0/952964446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3928071260 0x7f392815ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:45.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.409+0000 7f3927200640 1 --2- 172.21.15.137:0/952964446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f390c0040e0 0x7f392815e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:45.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.409+0000 7f3927200640 1 -- 172.21.15.137:0/952964446 >> 172.21.15.137:0/952964446 conn(0x7f392809ba60 msgr2=0x7f39280cd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:45.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.409+0000 7f3927200640 1 -- 172.21.15.137:0/952964446 shutdown_connections 2024-04-26T23:44:45.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.409+0000 7f3927200640 1 -- 172.21.15.137:0/952964446 wait complete. 2024-04-26T23:44:45.433 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:44:18.876990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:44:20.189315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:44:45.433 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:44:45.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.565+0000 7f7edbc00640 1 Processor -- start 2024-04-26T23:44:45.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.565+0000 7f7edbc00640 1 -- start start 2024-04-26T23:44:45.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.569+0000 7f7edbc00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7ed40afbc0 0x7f7ed415df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:45.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.569+0000 7f7edbc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ed4072860 con 0x7f7ed40affa0 2024-04-26T23:44:45.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.569+0000 7f7edbc00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ed40743b0 con 0x7f7ed4073f20 2024-04-26T23:44:45.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.569+0000 7f7edbc00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f7ed4072b00 con 0x7f7ed40afbc0 2024-04-26T23:44:45.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.569+0000 7f7ed9c00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f7ed40affa0 0x7f7ed40ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:59564/0 (socket says 172.21.15.137:59564) 2024-04-26T23:44:45.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.569+0000 7f7ed9c00640 1 -- 172.21.15.137:0/1858725248 learned_addr learned my addr 172.21.15.137:0/1858725248 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:45.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.569+0000 7f7ed9200640 1 --2- 172.21.15.137:0/1858725248 >> v2:172.21.15.170:3300/0 conn(0x7f7ed40afbc0 0x7f7ed415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:45.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.569+0000 7f7ed3e00640 1 -- 172.21.15.137:0/1858725248 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 903950724 0 0) 0x7f7ed4072860 con 0x7f7ed40affa0 2024-04-26T23:44:45.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.569+0000 7f7ed3e00640 1 -- 172.21.15.137:0/1858725248 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7eb8003530 con 0x7f7ed40affa0 2024-04-26T23:44:45.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.569+0000 7f7ed3e00640 1 -- 172.21.15.137:0/1858725248 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1063055366 0 0) 0x7f7ed40743b0 con 0x7f7ed4073f20 2024-04-26T23:44:45.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.569+0000 7f7ed3e00640 1 -- 172.21.15.137:0/1858725248 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ed4072860 con 0x7f7ed4073f20 2024-04-26T23:44:45.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.569+0000 7f7ed9200640 1 -- 172.21.15.137:0/1858725248 >> v1:172.21.15.170:6789/0 conn(0x7f7ed4073f20 legacy=0x7f7ed40735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:45.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.569+0000 7f7ed9200640 1 -- 172.21.15.137:0/1858725248 >> v1:172.21.15.137:6789/0 conn(0x7f7ed40affa0 legacy=0x7f7ed40ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:45.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.569+0000 7f7ed3e00640 1 -- 172.21.15.137:0/1858725248 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1668769339 0 0) 0x7f7eb8003530 con 0x7f7ed40affa0 2024-04-26T23:44:45.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.569+0000 7f7ed9200640 1 -- 172.21.15.137:0/1858725248 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed4072de0 con 0x7f7ed40afbc0 2024-04-26T23:44:45.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.573+0000 7f7ed9200640 1 --2- 172.21.15.137:0/1858725248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ed40afbc0 0x7f7ed415df90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7ec40097f0 tx=0x7f7ec401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21f0a103f1f3fb9f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:45.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.573+0000 7f7ed3e00640 1 -- 172.21.15.137:0/1858725248 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec40b0070 con 0x7f7ed40afbc0 2024-04-26T23:44:45.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.573+0000 7f7ed3e00640 1 -- 172.21.15.137:0/1858725248 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ec40ab400 con 0x7f7ed40afbc0 2024-04-26T23:44:45.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.573+0000 7f7ed3e00640 1 -- 172.21.15.137:0/1858725248 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc001a00 con 0x7f7ed40afbc0 2024-04-26T23:44:45.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.573+0000 7f7edbc00640 1 -- 172.21.15.137:0/1858725248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ed40afbc0 msgr2=0x7f7ed415df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:45.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.573+0000 7f7edbc00640 1 --2- 172.21.15.137:0/1858725248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ed40afbc0 0x7f7ed415df90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7ec40097f0 tx=0x7f7ec401c3c0 comp rx=0 tx=0).stop 2024-04-26T23:44:45.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.573+0000 7f7edbc00640 1 -- 172.21.15.137:0/1858725248 shutdown_connections 2024-04-26T23:44:45.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.573+0000 7f7edbc00640 1 --2- 172.21.15.137:0/1858725248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ed40afbc0 0x7f7ed415df90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:45.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.573+0000 7f7edbc00640 1 -- 172.21.15.137:0/1858725248 >> 172.21.15.137:0/1858725248 conn(0x7f7ed406c800 msgr2=0x7f7ed406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:45.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.573+0000 7f7edbc00640 1 -- 172.21.15.137:0/1858725248 shutdown_connections 2024-04-26T23:44:45.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.573+0000 7f7edbc00640 1 -- 172.21.15.137:0/1858725248 wait complete. 2024-04-26T23:44:45.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.573+0000 7f7edbc00640 1 Processor -- start 2024-04-26T23:44:45.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.573+0000 7f7edbc00640 1 -- start start 2024-04-26T23:44:45.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7edbc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ed40afbc0 0x7f7ed4141530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:45.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7edbc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ed40affa0 0x7f7ed40aa610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:45.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7edbc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ed40aab50 0x7f7ed40ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:45.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7edbc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed406ffe0 con 0x7f7ed40afbc0 2024-04-26T23:44:45.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7edbc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed40cecd0 con 0x7f7ed40aab50 2024-04-26T23:44:45.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7edbc00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7ed4070160 con 0x7f7ed40affa0 2024-04-26T23:44:45.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7ed9200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ed40afbc0 0x7f7ed4141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:45.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7ed9200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ed40afbc0 0x7f7ed4141530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41134/0 (socket says 172.21.15.137:41134) 2024-04-26T23:44:45.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7ed9200640 1 -- 172.21.15.137:0/2858364778 learned_addr learned my addr 172.21.15.137:0/2858364778 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:45.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7ecbe00640 1 --2- 172.21.15.137:0/2858364778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ed40affa0 0x7f7ed40aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:45.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7ed9c00640 1 --2- 172.21.15.137:0/2858364778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ed40aab50 0x7f7ed40ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:45.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7ed9200640 1 -- 172.21.15.137:0/2858364778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ed40affa0 msgr2=0x7f7ed40aa610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:45.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7ed9200640 1 --2- 172.21.15.137:0/2858364778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ed40affa0 0x7f7ed40aa610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:45.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7ed9200640 1 -- 172.21.15.137:0/2858364778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ed40aab50 msgr2=0x7f7ed40ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:45.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7ed9200640 1 --2- 172.21.15.137:0/2858364778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ed40aab50 0x7f7ed40ca570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:45.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7ed9200640 1 -- 172.21.15.137:0/2858364778 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed40cb2e0 con 0x7f7ed40afbc0 2024-04-26T23:44:45.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7ed9c00640 1 --2- 172.21.15.137:0/2858364778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ed40aab50 0x7f7ed40ca570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:45.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7ed9200640 1 --2- 172.21.15.137:0/2858364778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ed40afbc0 0x7f7ed4141530 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4018fd0 tx=0x7f7ec401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:45.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7ed1600640 1 -- 172.21.15.137:0/2858364778 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec40b0050 con 0x7f7ed40afbc0 2024-04-26T23:44:45.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7ed1600640 1 -- 172.21.15.137:0/2858364778 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ec40b1040 con 0x7f7ed40afbc0 2024-04-26T23:44:45.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7ed1600640 1 -- 172.21.15.137:0/2858364778 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec40b7650 con 0x7f7ed40afbc0 2024-04-26T23:44:45.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7edbc00640 1 -- 172.21.15.137:0/2858364778 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ed40cb5c0 con 0x7f7ed40afbc0 2024-04-26T23:44:45.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7edbc00640 1 -- 172.21.15.137:0/2858364778 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ed40cbb80 con 0x7f7ed40afbc0 2024-04-26T23:44:45.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7edbc00640 1 -- 172.21.15.137:0/2858364778 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ed40aaf60 con 0x7f7ed40afbc0 2024-04-26T23:44:45.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.577+0000 7f7ed1600640 1 -- 172.21.15.137:0/2858364778 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7ec40be030 con 0x7f7ed40afbc0 2024-04-26T23:44:45.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.581+0000 7f7ed1600640 1 --2- 172.21.15.137:0/2858364778 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7eb00683b0 0x7f7eb006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:45.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.581+0000 7f7ed1600640 1 -- 172.21.15.137:0/2858364778 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f7ec4120590 con 0x7f7ed40afbc0 2024-04-26T23:44:45.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.581+0000 7f7ecbe00640 1 --2- 172.21.15.137:0/2858364778 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7eb00683b0 0x7f7eb006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:45.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.581+0000 7f7ecbe00640 1 --2- 172.21.15.137:0/2858364778 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7eb00683b0 0x7f7eb006a870 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7ed41fb510 tx=0x7f7ebc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:45.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.585+0000 7f7ed1600640 1 -- 172.21.15.137:0/2858364778 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7ed40aaf60 con 0x7f7ed40afbc0 2024-04-26T23:44:45.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.741+0000 7f7edbc00640 1 -- 172.21.15.137:0/2858364778 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7ed406a410 con 0x7f7ed40afbc0 2024-04-26T23:44:45.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.741+0000 7f7ed1600640 1 -- 172.21.15.137:0/2858364778 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) ==== 93+0+10 (secure 0 0 0) 0x7f7ec40c5060 con 0x7f7ed40afbc0 2024-04-26T23:44:45.747 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:44:45.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.745+0000 7f7edbc00640 1 -- 172.21.15.137:0/2858364778 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7eb00683b0 msgr2=0x7f7eb006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:45.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.745+0000 7f7edbc00640 1 --2- 172.21.15.137:0/2858364778 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7eb00683b0 0x7f7eb006a870 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7ed41fb510 tx=0x7f7ebc009040 comp rx=0 tx=0).stop 2024-04-26T23:44:45.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.745+0000 7f7edbc00640 1 -- 172.21.15.137:0/2858364778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ed40afbc0 msgr2=0x7f7ed4141530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:45.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.745+0000 7f7edbc00640 1 --2- 172.21.15.137:0/2858364778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ed40afbc0 0x7f7ed4141530 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4018fd0 tx=0x7f7ec401ac00 comp rx=0 tx=0).stop 2024-04-26T23:44:45.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.745+0000 7f7edbc00640 1 -- 172.21.15.137:0/2858364778 shutdown_connections 2024-04-26T23:44:45.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.745+0000 7f7edbc00640 1 --2- 172.21.15.137:0/2858364778 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f7eb00683b0 0x7f7eb006a870 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:45.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.745+0000 7f7edbc00640 1 --2- 172.21.15.137:0/2858364778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ed40aab50 0x7f7ed40ca570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:45.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.745+0000 7f7edbc00640 1 --2- 172.21.15.137:0/2858364778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ed40affa0 0x7f7ed40aa610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:45.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.745+0000 7f7edbc00640 1 --2- 172.21.15.137:0/2858364778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ed40afbc0 0x7f7ed4141530 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:45.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.745+0000 7f7edbc00640 1 -- 172.21.15.137:0/2858364778 >> 172.21.15.137:0/2858364778 conn(0x7f7ed406c800 msgr2=0x7f7ed40ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:45.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.745+0000 7f7edbc00640 1 -- 172.21.15.137:0/2858364778 shutdown_connections 2024-04-26T23:44:45.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.745+0000 7f7edbc00640 1 -- 172.21.15.137:0/2858364778 wait complete. 2024-04-26T23:44:45.767 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:44:45.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.905+0000 7fe7f8a00640 1 Processor -- start 2024-04-26T23:44:45.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.905+0000 7fe7f8a00640 1 -- start start 2024-04-26T23:44:45.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.909+0000 7fe7f8a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7f406dfd0 0x7fe7f40d0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:45.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.909+0000 7fe7f8a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe7f41467c0 0x7fe7f40d1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:45.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.909+0000 7fe7f8a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7f406e4d0 con 0x7fe7f41463e0 2024-04-26T23:44:45.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.909+0000 7fe7f8a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe7f40cf030 con 0x7fe7f41467c0 2024-04-26T23:44:45.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.909+0000 7fe7f8a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f406e7b0 con 0x7fe7f406dfd0 2024-04-26T23:44:45.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.909+0000 7fe7f3e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe7f41467c0 0x7fe7f40d1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:45.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.909+0000 7fe7f3400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fe7f41463e0 0x7fe7f415de30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:59566/0 (socket says 172.21.15.137:59566) 2024-04-26T23:44:45.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.909+0000 7fe7f3e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe7f41467c0 0x7fe7f40d1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41146/0 (socket says 172.21.15.137:41146) 2024-04-26T23:44:45.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.909+0000 7fe7f3400640 1 -- 172.21.15.137:0/258845631 learned_addr learned my addr 172.21.15.137:0/258845631 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:45.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.909+0000 7fe7eaa00640 1 --2- 172.21.15.137:0/258845631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7f406dfd0 0x7fe7f40d0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:45.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.909+0000 7fe7f3e00640 1 -- 172.21.15.137:0/258845631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7f406dfd0 msgr2=0x7fe7f40d0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:45.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.909+0000 7fe7f3e00640 1 --2- 172.21.15.137:0/258845631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7f406dfd0 0x7fe7f40d0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:45.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.909+0000 7fe7f3e00640 1 -- 172.21.15.137:0/258845631 >> v1:172.21.15.137:6789/0 conn(0x7fe7f41463e0 legacy=0x7fe7f415de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:45.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.909+0000 7fe7f3e00640 1 -- 172.21.15.137:0/258845631 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f406ea90 con 0x7fe7f41467c0 2024-04-26T23:44:45.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.909+0000 7fe7f3e00640 1 --2- 172.21.15.137:0/258845631 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7f41467c0 0x7fe7f40d1250 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec009d90 tx=0x7fe7ec01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed95f321e8c673ab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:45.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.913+0000 7fe7f2a00640 1 -- 172.21.15.137:0/258845631 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec0b2070 con 0x7fe7f41467c0 2024-04-26T23:44:45.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.913+0000 7fe7f2a00640 1 -- 172.21.15.137:0/258845631 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7ec0a5830 con 0x7fe7f41467c0 2024-04-26T23:44:45.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.913+0000 7fe7f2a00640 1 -- 172.21.15.137:0/258845631 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec0a5c00 con 0x7fe7f41467c0 2024-04-26T23:44:45.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.913+0000 7fe7f8a00640 1 -- 172.21.15.137:0/258845631 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7f41467c0 msgr2=0x7fe7f40d1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:45.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.913+0000 7fe7f8a00640 1 --2- 172.21.15.137:0/258845631 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7f41467c0 0x7fe7f40d1250 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec009d90 tx=0x7fe7ec01c970 comp rx=0 tx=0).stop 2024-04-26T23:44:45.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.913+0000 7fe7f8a00640 1 -- 172.21.15.137:0/258845631 shutdown_connections 2024-04-26T23:44:45.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.913+0000 7fe7f8a00640 1 --2- 172.21.15.137:0/258845631 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7f41467c0 0x7fe7f40d1250 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:45.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.913+0000 7fe7f8a00640 1 --2- 172.21.15.137:0/258845631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7f406dfd0 0x7fe7f40d0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:45.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.913+0000 7fe7f8a00640 1 -- 172.21.15.137:0/258845631 >> 172.21.15.137:0/258845631 conn(0x7fe7f406c5d0 msgr2=0x7fe7f406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:45.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.913+0000 7fe7f8a00640 1 -- 172.21.15.137:0/258845631 shutdown_connections 2024-04-26T23:44:45.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.913+0000 7fe7f8a00640 1 -- 172.21.15.137:0/258845631 wait complete. 2024-04-26T23:44:45.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.913+0000 7fe7f8a00640 1 Processor -- start 2024-04-26T23:44:45.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.913+0000 7fe7f8a00640 1 -- start start 2024-04-26T23:44:45.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.913+0000 7fe7f8a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7f406dfd0 0x7fe7f413c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:45.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.913+0000 7fe7f8a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7f41463e0 0x7fe7f415e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:45.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.913+0000 7fe7f8a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7f41467c0 0x7fe7f415e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:45.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.913+0000 7fe7f8a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f40d0040 con 0x7fe7f41467c0 2024-04-26T23:44:45.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.913+0000 7fe7f8a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f40cfec0 con 0x7fe7f41463e0 2024-04-26T23:44:45.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.913+0000 7fe7f8a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f40d01c0 con 0x7fe7f406dfd0 2024-04-26T23:44:45.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.913+0000 7fe7f3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7f41467c0 0x7fe7f415e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:45.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.913+0000 7fe7f3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7f41467c0 0x7fe7f415e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41148/0 (socket says 172.21.15.137:41148) 2024-04-26T23:44:45.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.913+0000 7fe7f3e00640 1 -- 172.21.15.137:0/4030611526 learned_addr learned my addr 172.21.15.137:0/4030611526 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:45.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.917+0000 7fe7eaa00640 1 --2- 172.21.15.137:0/4030611526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7f41463e0 0x7fe7f415e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:45.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.917+0000 7fe7f3e00640 1 -- 172.21.15.137:0/4030611526 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7f406dfd0 msgr2=0x7fe7f413c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:45.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.917+0000 7fe7f3e00640 1 --2- 172.21.15.137:0/4030611526 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7f406dfd0 0x7fe7f413c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:45.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.917+0000 7fe7f3e00640 1 -- 172.21.15.137:0/4030611526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7f41463e0 msgr2=0x7fe7f415e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:45.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.917+0000 7fe7f3e00640 1 --2- 172.21.15.137:0/4030611526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7f41463e0 0x7fe7f415e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:45.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.917+0000 7fe7f3e00640 1 -- 172.21.15.137:0/4030611526 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f415eed0 con 0x7fe7f41467c0 2024-04-26T23:44:45.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.917+0000 7fe7eaa00640 1 --2- 172.21.15.137:0/4030611526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7f41463e0 0x7fe7f415e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:45.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.917+0000 7fe7f3e00640 1 --2- 172.21.15.137:0/4030611526 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7f41467c0 0x7fe7f415e8c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec01b020 tx=0x7fe7ec019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:45.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.917+0000 7fe7ebe00640 1 -- 172.21.15.137:0/4030611526 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec0b2050 con 0x7fe7f41467c0 2024-04-26T23:44:45.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.917+0000 7fe7ebe00640 1 -- 172.21.15.137:0/4030611526 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7ec0be070 con 0x7fe7f41467c0 2024-04-26T23:44:45.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.917+0000 7fe7ebe00640 1 -- 172.21.15.137:0/4030611526 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec0ad850 con 0x7fe7f41467c0 2024-04-26T23:44:45.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.917+0000 7fe7f8a00640 1 -- 172.21.15.137:0/4030611526 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f415f1b0 con 0x7fe7f41467c0 2024-04-26T23:44:45.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.917+0000 7fe7f8a00640 1 -- 172.21.15.137:0/4030611526 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f415f770 con 0x7fe7f41467c0 2024-04-26T23:44:45.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.917+0000 7fe7f8a00640 1 -- 172.21.15.137:0/4030611526 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7f406a300 con 0x7fe7f41467c0 2024-04-26T23:44:45.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.917+0000 7fe7ebe00640 1 -- 172.21.15.137:0/4030611526 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe7ec0ad9f0 con 0x7fe7f41467c0 2024-04-26T23:44:45.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.917+0000 7fe7ebe00640 1 --2- 172.21.15.137:0/4030611526 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe7d0068380 0x7fe7d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:45.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.917+0000 7fe7ebe00640 1 -- 172.21.15.137:0/4030611526 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fe7ec121a80 con 0x7fe7f41467c0 2024-04-26T23:44:45.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.917+0000 7fe7f3400640 1 --2- 172.21.15.137:0/4030611526 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe7d0068380 0x7fe7d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:45.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.921+0000 7fe7f3400640 1 --2- 172.21.15.137:0/4030611526 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe7d0068380 0x7fe7d006a840 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4000f70 tx=0x7fe7e4007a90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:45.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:45.921+0000 7fe7ebe00640 1 -- 172.21.15.137:0/4030611526 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe7ec123e20 con 0x7fe7f41467c0 2024-04-26T23:44:46.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.077+0000 7fe7f8a00640 1 -- 172.21.15.137:0/4030611526 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe7f415fe70 con 0x7fe7f41467c0 2024-04-26T23:44:46.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.081+0000 7fe7ebe00640 1 -- 172.21.15.137:0/4030611526 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) ==== 104+0+11 (secure 0 0 0) 0x7fe7ec016560 con 0x7fe7f41467c0 2024-04-26T23:44:46.084 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:44:46.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.081+0000 7fe7f8a00640 1 -- 172.21.15.137:0/4030611526 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe7d0068380 msgr2=0x7fe7d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:46.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.081+0000 7fe7f8a00640 1 --2- 172.21.15.137:0/4030611526 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe7d0068380 0x7fe7d006a840 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4000f70 tx=0x7fe7e4007a90 comp rx=0 tx=0).stop 2024-04-26T23:44:46.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.081+0000 7fe7f8a00640 1 -- 172.21.15.137:0/4030611526 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7f41467c0 msgr2=0x7fe7f415e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:46.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.081+0000 7fe7f8a00640 1 --2- 172.21.15.137:0/4030611526 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7f41467c0 0x7fe7f415e8c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec01b020 tx=0x7fe7ec019710 comp rx=0 tx=0).stop 2024-04-26T23:44:46.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.081+0000 7fe7f8a00640 1 -- 172.21.15.137:0/4030611526 shutdown_connections 2024-04-26T23:44:46.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.081+0000 7fe7f8a00640 1 --2- 172.21.15.137:0/4030611526 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe7d0068380 0x7fe7d006a840 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.081+0000 7fe7f8a00640 1 --2- 172.21.15.137:0/4030611526 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7f41467c0 0x7fe7f415e8c0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.081+0000 7fe7f8a00640 1 --2- 172.21.15.137:0/4030611526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7f41463e0 0x7fe7f415e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.081+0000 7fe7f8a00640 1 --2- 172.21.15.137:0/4030611526 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7f406dfd0 0x7fe7f413c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.081+0000 7fe7f8a00640 1 -- 172.21.15.137:0/4030611526 >> 172.21.15.137:0/4030611526 conn(0x7fe7f406c5d0 msgr2=0x7fe7f4165fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:46.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.081+0000 7fe7f8a00640 1 -- 172.21.15.137:0/4030611526 shutdown_connections 2024-04-26T23:44:46.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.081+0000 7fe7f8a00640 1 -- 172.21.15.137:0/4030611526 wait complete. 2024-04-26T23:44:46.105 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:44:46.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.241+0000 7f1db8c00640 1 Processor -- start 2024-04-26T23:44:46.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.241+0000 7f1db8c00640 1 -- start start 2024-04-26T23:44:46.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.241+0000 7f1db8c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1db415f4d0 0x7f1db40b2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:46.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.241+0000 7f1db8c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1db406d370 0x7f1db40cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:46.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.241+0000 7f1db8c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1db40d0680 con 0x7f1db406c610 2024-04-26T23:44:46.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.241+0000 7f1db8c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f1db40d0f80 con 0x7f1db415f4d0 2024-04-26T23:44:46.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.241+0000 7f1db8c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1db40cfbb0 con 0x7f1db406d370 2024-04-26T23:44:46.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.241+0000 7f1dabe00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f1db406c610 0x7f1db406cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:59576/0 (socket says 172.21.15.137:59576) 2024-04-26T23:44:46.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.241+0000 7f1dabe00640 1 -- 172.21.15.137:0/3164784006 learned_addr learned my addr 172.21.15.137:0/3164784006 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:46.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.241+0000 7f1db1e00640 1 --2- 172.21.15.137:0/3164784006 >> v2:172.21.15.170:3300/0 conn(0x7f1db415f4d0 0x7f1db40b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:46.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.241+0000 7f1db2800640 1 --2- 172.21.15.137:0/3164784006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1db406d370 0x7f1db40cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:46.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.241+0000 7f1db1e00640 1 -- 172.21.15.137:0/3164784006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1db406d370 msgr2=0x7f1db40cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:46.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.241+0000 7f1db1e00640 1 --2- 172.21.15.137:0/3164784006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1db406d370 0x7f1db40cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.241+0000 7f1db1e00640 1 -- 172.21.15.137:0/3164784006 >> v1:172.21.15.137:6789/0 conn(0x7f1db406c610 legacy=0x7f1db406cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:46.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.241+0000 7f1db1e00640 1 -- 172.21.15.137:0/3164784006 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1db40cfde0 con 0x7f1db415f4d0 2024-04-26T23:44:46.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.241+0000 7f1db2800640 1 --2- 172.21.15.137:0/3164784006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1db406d370 0x7f1db40cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:44:46.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.245+0000 7f1db1e00640 1 --2- 172.21.15.137:0/3164784006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1db415f4d0 0x7f1db40b2750 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1da40097c0 tx=0x7f1da401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27541ae36814a78 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:46.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.245+0000 7f1db1400640 1 -- 172.21.15.137:0/3164784006 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da40b1070 con 0x7f1db415f4d0 2024-04-26T23:44:46.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.245+0000 7f1db1400640 1 -- 172.21.15.137:0/3164784006 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da40ac410 con 0x7f1db415f4d0 2024-04-26T23:44:46.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.245+0000 7f1db1400640 1 -- 172.21.15.137:0/3164784006 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da40ac7e0 con 0x7f1db415f4d0 2024-04-26T23:44:46.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.245+0000 7f1db8c00640 1 -- 172.21.15.137:0/3164784006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1db415f4d0 msgr2=0x7f1db40b2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:46.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.245+0000 7f1db8c00640 1 --2- 172.21.15.137:0/3164784006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1db415f4d0 0x7f1db40b2750 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1da40097c0 tx=0x7f1da401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.245+0000 7f1db8c00640 1 -- 172.21.15.137:0/3164784006 shutdown_connections 2024-04-26T23:44:46.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.245+0000 7f1db8c00640 1 --2- 172.21.15.137:0/3164784006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1db406d370 0x7f1db40cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.245+0000 7f1db8c00640 1 --2- 172.21.15.137:0/3164784006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1db415f4d0 0x7f1db40b2750 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.245+0000 7f1db8c00640 1 -- 172.21.15.137:0/3164784006 >> 172.21.15.137:0/3164784006 conn(0x7f1db409ba60 msgr2=0x7f1db409be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:46.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.245+0000 7f1db8c00640 1 -- 172.21.15.137:0/3164784006 shutdown_connections 2024-04-26T23:44:46.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.245+0000 7f1db8c00640 1 -- 172.21.15.137:0/3164784006 wait complete. 2024-04-26T23:44:46.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1db8c00640 1 Processor -- start 2024-04-26T23:44:46.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1db8c00640 1 -- start start 2024-04-26T23:44:46.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1db8c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1db406c610 0x7f1db414c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:46.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1db8c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1db406d370 0x7f1db40c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:46.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1db8c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1db415f4d0 0x7f1db4150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:46.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1db8c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1db40d2060 con 0x7f1db415f4d0 2024-04-26T23:44:46.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1db8c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1db40d1ee0 con 0x7f1db406c610 2024-04-26T23:44:46.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1db8c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1db40d21e0 con 0x7f1db406d370 2024-04-26T23:44:46.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1db2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1db415f4d0 0x7f1db4150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:46.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1db2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1db415f4d0 0x7f1db4150c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41160/0 (socket says 172.21.15.137:41160) 2024-04-26T23:44:46.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1db2800640 1 -- 172.21.15.137:0/2715497385 learned_addr learned my addr 172.21.15.137:0/2715497385 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:46.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1db1e00640 1 --2- 172.21.15.137:0/2715497385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1db406c610 0x7f1db414c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:46.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1dabe00640 1 --2- 172.21.15.137:0/2715497385 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1db406d370 0x7f1db40c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:46.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1db2800640 1 -- 172.21.15.137:0/2715497385 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1db406d370 msgr2=0x7f1db40c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:46.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1db2800640 1 --2- 172.21.15.137:0/2715497385 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1db406d370 0x7f1db40c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1db2800640 1 -- 172.21.15.137:0/2715497385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1db406c610 msgr2=0x7f1db414c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:46.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1db2800640 1 --2- 172.21.15.137:0/2715497385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1db406c610 0x7f1db414c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1db2800640 1 -- 172.21.15.137:0/2715497385 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1db415d850 con 0x7f1db415f4d0 2024-04-26T23:44:46.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1db2800640 1 --2- 172.21.15.137:0/2715497385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1db415f4d0 0x7f1db4150c80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009ea0 tx=0x7f1dac009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:46.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1daa000640 1 -- 172.21.15.137:0/2715497385 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dac018030 con 0x7f1db415f4d0 2024-04-26T23:44:46.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1daa000640 1 -- 172.21.15.137:0/2715497385 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dac00cde0 con 0x7f1db415f4d0 2024-04-26T23:44:46.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1db8c00640 1 -- 172.21.15.137:0/2715497385 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1db4151b50 con 0x7f1db415f4d0 2024-04-26T23:44:46.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1daa000640 1 -- 172.21.15.137:0/2715497385 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dac003bc0 con 0x7f1db415f4d0 2024-04-26T23:44:46.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1db8c00640 1 -- 172.21.15.137:0/2715497385 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1db4152110 con 0x7f1db415f4d0 2024-04-26T23:44:46.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.249+0000 7f1db8c00640 1 -- 172.21.15.137:0/2715497385 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1db406a410 con 0x7f1db415f4d0 2024-04-26T23:44:46.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.253+0000 7f1daa000640 1 -- 172.21.15.137:0/2715497385 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1dac01b070 con 0x7f1db415f4d0 2024-04-26T23:44:46.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.253+0000 7f1daa000640 1 --2- 172.21.15.137:0/2715497385 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d90068380 0x7f1d9006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:46.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.253+0000 7f1daa000640 1 -- 172.21.15.137:0/2715497385 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f1dac0872e0 con 0x7f1db415f4d0 2024-04-26T23:44:46.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.253+0000 7f1db1e00640 1 --2- 172.21.15.137:0/2715497385 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d90068380 0x7f1d9006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:46.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.253+0000 7f1db1e00640 1 --2- 172.21.15.137:0/2715497385 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d90068380 0x7f1d9006a840 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1da40ae000 tx=0x7f1da4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:46.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.257+0000 7f1daa000640 1 -- 172.21.15.137:0/2715497385 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1dac022070 con 0x7f1db415f4d0 2024-04-26T23:44:46.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.417+0000 7f1db8c00640 1 -- 172.21.15.137:0/2715497385 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1db40cf690 con 0x7f1db415f4d0 2024-04-26T23:44:46.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.417+0000 7f1daa000640 1 -- 172.21.15.137:0/2715497385 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) ==== 100+0+11 (secure 0 0 0) 0x7f1dac010040 con 0x7f1db415f4d0 2024-04-26T23:44:46.420 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:44:46.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.417+0000 7f1db8c00640 1 -- 172.21.15.137:0/2715497385 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d90068380 msgr2=0x7f1d9006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:46.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.417+0000 7f1db8c00640 1 --2- 172.21.15.137:0/2715497385 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d90068380 0x7f1d9006a840 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1da40ae000 tx=0x7f1da4008040 comp rx=0 tx=0).stop 2024-04-26T23:44:46.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.417+0000 7f1db8c00640 1 -- 172.21.15.137:0/2715497385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1db415f4d0 msgr2=0x7f1db4150c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:46.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.417+0000 7f1db8c00640 1 --2- 172.21.15.137:0/2715497385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1db415f4d0 0x7f1db4150c80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009ea0 tx=0x7f1dac009f90 comp rx=0 tx=0).stop 2024-04-26T23:44:46.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.417+0000 7f1db8c00640 1 -- 172.21.15.137:0/2715497385 shutdown_connections 2024-04-26T23:44:46.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.417+0000 7f1db8c00640 1 --2- 172.21.15.137:0/2715497385 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f1d90068380 0x7f1d9006a840 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.417+0000 7f1db8c00640 1 --2- 172.21.15.137:0/2715497385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1db415f4d0 0x7f1db4150c80 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.417+0000 7f1db8c00640 1 --2- 172.21.15.137:0/2715497385 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1db406d370 0x7f1db40c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.417+0000 7f1db8c00640 1 --2- 172.21.15.137:0/2715497385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1db406c610 0x7f1db414c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.417+0000 7f1db8c00640 1 -- 172.21.15.137:0/2715497385 >> 172.21.15.137:0/2715497385 conn(0x7f1db409ba60 msgr2=0x7f1db4071140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:46.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.417+0000 7f1db8c00640 1 -- 172.21.15.137:0/2715497385 shutdown_connections 2024-04-26T23:44:46.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.417+0000 7f1db8c00640 1 -- 172.21.15.137:0/2715497385 wait complete. 2024-04-26T23:44:46.442 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:44:46.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.577+0000 7f2562200640 1 Processor -- start 2024-04-26T23:44:46.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.577+0000 7f2562200640 1 -- start start 2024-04-26T23:44:46.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.577+0000 7f2562200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f255c15cf60 0x7f255c0d1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:46.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.577+0000 7f2562200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f255c0b3420 0x7f255c0cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:46.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.577+0000 7f2562200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f255c0b3a40 con 0x7f255c0d1780 2024-04-26T23:44:46.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.577+0000 7f2562200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f255c0d1be0 con 0x7f255c15cf60 2024-04-26T23:44:46.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.577+0000 7f2562200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f255c0b4650 con 0x7f255c0b3420 2024-04-26T23:44:46.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.577+0000 7f255b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f255c15cf60 0x7f255c0d1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:46.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.577+0000 7f255b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f255c15cf60 0x7f255c0d1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41164/0 (socket says 172.21.15.137:41164) 2024-04-26T23:44:46.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.577+0000 7f255b400640 1 -- 172.21.15.137:0/2063460793 learned_addr learned my addr 172.21.15.137:0/2063460793 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:46.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.577+0000 7f255b400640 1 -- 172.21.15.137:0/2063460793 >> v2:172.21.15.170:3300/0 conn(0x7f255c0b3420 msgr2=0x7f255c0cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:46.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.577+0000 7f255b400640 1 --2- 172.21.15.137:0/2063460793 >> v2:172.21.15.170:3300/0 conn(0x7f255c0b3420 0x7f255c0cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.577+0000 7f255b400640 1 -- 172.21.15.137:0/2063460793 >> v1:172.21.15.170:6789/0 conn(0x7f255c0d1780 legacy=0x7f255c0b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:46.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.577+0000 7f255b400640 1 -- 172.21.15.137:0/2063460793 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f255c0b3d20 con 0x7f255c15cf60 2024-04-26T23:44:46.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.581+0000 7f255b400640 1 --2- 172.21.15.137:0/2063460793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f255c15cf60 0x7f255c0d1240 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f255c0c6900 tx=0x7f254c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9bdf8d66757012 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:46.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.581+0000 7f255a000640 1 -- 172.21.15.137:0/2063460793 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c0a56d0 con 0x7f255c15cf60 2024-04-26T23:44:46.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.581+0000 7f255a000640 1 -- 172.21.15.137:0/2063460793 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f254c0a5870 con 0x7f255c15cf60 2024-04-26T23:44:46.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.581+0000 7f255a000640 1 -- 172.21.15.137:0/2063460793 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c0a5c40 con 0x7f255c15cf60 2024-04-26T23:44:46.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.581+0000 7f2562200640 1 -- 172.21.15.137:0/2063460793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f255c15cf60 msgr2=0x7f255c0d1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:46.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.581+0000 7f2562200640 1 --2- 172.21.15.137:0/2063460793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f255c15cf60 0x7f255c0d1240 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f255c0c6900 tx=0x7f254c01c920 comp rx=0 tx=0).stop 2024-04-26T23:44:46.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.581+0000 7f2562200640 1 -- 172.21.15.137:0/2063460793 shutdown_connections 2024-04-26T23:44:46.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.581+0000 7f2562200640 1 --2- 172.21.15.137:0/2063460793 >> v2:172.21.15.170:3300/0 conn(0x7f255c0b3420 0x7f255c0cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.581+0000 7f2562200640 1 --2- 172.21.15.137:0/2063460793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f255c15cf60 0x7f255c0d1240 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.581+0000 7f2562200640 1 -- 172.21.15.137:0/2063460793 >> 172.21.15.137:0/2063460793 conn(0x7f255c09ba60 msgr2=0x7f255c09be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:46.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.581+0000 7f2562200640 1 -- 172.21.15.137:0/2063460793 shutdown_connections 2024-04-26T23:44:46.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.581+0000 7f2562200640 1 -- 172.21.15.137:0/2063460793 wait complete. 2024-04-26T23:44:46.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f2562200640 1 Processor -- start 2024-04-26T23:44:46.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f2562200640 1 -- start start 2024-04-26T23:44:46.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f2562200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f255c0b3420 0x7f255c153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:46.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f2562200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f255c0d1780 0x7f255c1fbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:46.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f2562200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f255c15cf60 0x7f255c1fc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:46.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f2562200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f255c0aff20 con 0x7f255c0d1780 2024-04-26T23:44:46.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f2562200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f255c0afda0 con 0x7f255c15cf60 2024-04-26T23:44:46.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f2562200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f255c0b00a0 con 0x7f255c0b3420 2024-04-26T23:44:46.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f255aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f255c0d1780 0x7f255c1fbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:46.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f255aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f255c0d1780 0x7f255c1fbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41168/0 (socket says 172.21.15.137:41168) 2024-04-26T23:44:46.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f255aa00640 1 -- 172.21.15.137:0/718321166 learned_addr learned my addr 172.21.15.137:0/718321166 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:46.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f255b400640 1 --2- 172.21.15.137:0/718321166 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f255c0b3420 0x7f255c153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:46.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f255be00640 1 --2- 172.21.15.137:0/718321166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f255c15cf60 0x7f255c1fc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:46.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f255aa00640 1 -- 172.21.15.137:0/718321166 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f255c0b3420 msgr2=0x7f255c153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:46.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f255aa00640 1 --2- 172.21.15.137:0/718321166 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f255c0b3420 0x7f255c153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f255aa00640 1 -- 172.21.15.137:0/718321166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f255c15cf60 msgr2=0x7f255c1fc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:46.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f255aa00640 1 --2- 172.21.15.137:0/718321166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f255c15cf60 0x7f255c1fc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f255aa00640 1 -- 172.21.15.137:0/718321166 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f255c0b5cd0 con 0x7f255c0d1780 2024-04-26T23:44:46.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f255aa00640 1 --2- 172.21.15.137:0/718321166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f255c0d1780 0x7f255c1fbef0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f254800c490 tx=0x7f2548001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:46.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f2553400640 1 -- 172.21.15.137:0/718321166 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2548017070 con 0x7f255c0d1780 2024-04-26T23:44:46.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f2553400640 1 -- 172.21.15.137:0/718321166 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2548003600 con 0x7f255c0d1780 2024-04-26T23:44:46.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f2553400640 1 -- 172.21.15.137:0/718321166 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2548003a30 con 0x7f255c0d1780 2024-04-26T23:44:46.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f2562200640 1 -- 172.21.15.137:0/718321166 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f255c1498b0 con 0x7f255c0d1780 2024-04-26T23:44:46.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.585+0000 7f2562200640 1 -- 172.21.15.137:0/718321166 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f255c0c7e90 con 0x7f255c0d1780 2024-04-26T23:44:46.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.589+0000 7f2562200640 1 -- 172.21.15.137:0/718321166 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f255c0c8090 con 0x7f255c0d1780 2024-04-26T23:44:46.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.589+0000 7f2553400640 1 -- 172.21.15.137:0/718321166 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2548003bd0 con 0x7f255c0d1780 2024-04-26T23:44:46.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.589+0000 7f2553400640 1 --2- 172.21.15.137:0/718321166 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f253c068380 0x7f253c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:46.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.589+0000 7f2553400640 1 -- 172.21.15.137:0/718321166 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f2548085d60 con 0x7f255c0d1780 2024-04-26T23:44:46.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.589+0000 7f255b400640 1 --2- 172.21.15.137:0/718321166 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f253c068380 0x7f253c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:46.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.589+0000 7f255b400640 1 --2- 172.21.15.137:0/718321166 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f253c068380 0x7f253c06a840 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f254c0ae000 tx=0x7f254c0a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:46.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.593+0000 7f2553400640 1 -- 172.21.15.137:0/718321166 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2548056310 con 0x7f255c0d1780 2024-04-26T23:44:46.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.761+0000 7f2562200640 1 -- 172.21.15.137:0/718321166 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f255c06a4b0 con 0x7f255c0d1780 2024-04-26T23:44:46.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.761+0000 7f2553400640 1 -- 172.21.15.137:0/718321166 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v60) ==== 80+0+0 (secure 0 0 0) 0x7f2548055c10 con 0x7f255c0d1780 2024-04-26T23:44:46.767 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T23:44:46.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.765+0000 7f2562200640 1 -- 172.21.15.137:0/718321166 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f253c068380 msgr2=0x7f253c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:46.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.765+0000 7f2562200640 1 --2- 172.21.15.137:0/718321166 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f253c068380 0x7f253c06a840 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f254c0ae000 tx=0x7f254c0a7070 comp rx=0 tx=0).stop 2024-04-26T23:44:46.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.765+0000 7f2562200640 1 -- 172.21.15.137:0/718321166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f255c0d1780 msgr2=0x7f255c1fbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:46.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.765+0000 7f2562200640 1 --2- 172.21.15.137:0/718321166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f255c0d1780 0x7f255c1fbef0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f254800c490 tx=0x7f2548001e80 comp rx=0 tx=0).stop 2024-04-26T23:44:46.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.765+0000 7f2562200640 1 -- 172.21.15.137:0/718321166 shutdown_connections 2024-04-26T23:44:46.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.765+0000 7f2562200640 1 --2- 172.21.15.137:0/718321166 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f253c068380 0x7f253c06a840 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.765+0000 7f2562200640 1 --2- 172.21.15.137:0/718321166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f255c0d1780 0x7f255c1fbef0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.765+0000 7f2562200640 1 --2- 172.21.15.137:0/718321166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f255c15cf60 0x7f255c1fc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.765+0000 7f2562200640 1 --2- 172.21.15.137:0/718321166 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f255c0b3420 0x7f255c153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.765+0000 7f2562200640 1 -- 172.21.15.137:0/718321166 >> 172.21.15.137:0/718321166 conn(0x7f255c09ba60 msgr2=0x7f255c0707d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:46.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.765+0000 7f2562200640 1 -- 172.21.15.137:0/718321166 shutdown_connections 2024-04-26T23:44:46.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.765+0000 7f2562200640 1 -- 172.21.15.137:0/718321166 wait complete. 2024-04-26T23:44:46.789 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:44:46.789 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:44:46.799 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:44:46.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.929+0000 7f2776a00640 1 Processor -- start 2024-04-26T23:44:46.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.929+0000 7f2776a00640 1 -- start start 2024-04-26T23:44:46.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.929+0000 7f2776a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2770073090 0x7f27700cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:46.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.929+0000 7f2776a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27700cfef0 con 0x7f27700b5080 2024-04-26T23:44:46.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.929+0000 7f2776a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27700cddc0 con 0x7f27700725a0 2024-04-26T23:44:46.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.929+0000 7f2776a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f27700d01b0 con 0x7f2770073090 2024-04-26T23:44:46.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.929+0000 7f2767400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f27700b5080 0x7f2770072980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:59584/0 (socket says 172.21.15.137:59584) 2024-04-26T23:44:46.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.929+0000 7f2767400640 1 -- 172.21.15.137:0/1752999964 learned_addr learned my addr 172.21.15.137:0/1752999964 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:46.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.929+0000 7f2774a00640 1 --2- 172.21.15.137:0/1752999964 >> v2:172.21.15.170:3300/0 conn(0x7f2770073090 0x7f27700cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:46.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.933+0000 7f276f400640 1 -- 172.21.15.137:0/1752999964 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1427270350 0 0) 0x7f27700cfef0 con 0x7f27700b5080 2024-04-26T23:44:46.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.933+0000 7f276f400640 1 -- 172.21.15.137:0/1752999964 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2754003530 con 0x7f27700b5080 2024-04-26T23:44:46.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.933+0000 7f276f400640 1 -- 172.21.15.137:0/1752999964 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 353532884 0 0) 0x7f27700cddc0 con 0x7f27700725a0 2024-04-26T23:44:46.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.933+0000 7f276f400640 1 -- 172.21.15.137:0/1752999964 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27700cfef0 con 0x7f27700725a0 2024-04-26T23:44:46.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.933+0000 7f2774a00640 1 -- 172.21.15.137:0/1752999964 >> v1:172.21.15.170:6789/0 conn(0x7f27700725a0 legacy=0x7f2770073f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:46.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.933+0000 7f2774a00640 1 -- 172.21.15.137:0/1752999964 >> v1:172.21.15.137:6789/0 conn(0x7f27700b5080 legacy=0x7f2770072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:46.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.933+0000 7f2774a00640 1 -- 172.21.15.137:0/1752999964 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27700d0490 con 0x7f2770073090 2024-04-26T23:44:46.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.933+0000 7f2774a00640 1 --2- 172.21.15.137:0/1752999964 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2770073090 0x7f27700cd770 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f27680097f0 tx=0x7f276801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cee462492c5328cf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:46.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.933+0000 7f276f400640 1 -- 172.21.15.137:0/1752999964 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27680aa5f0 con 0x7f2770073090 2024-04-26T23:44:46.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.933+0000 7f276f400640 1 -- 172.21.15.137:0/1752999964 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27680af070 con 0x7f2770073090 2024-04-26T23:44:46.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.933+0000 7f276f400640 1 -- 172.21.15.137:0/1752999964 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27680aa9b0 con 0x7f2770073090 2024-04-26T23:44:46.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f2776a00640 1 -- 172.21.15.137:0/1752999964 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2770073090 msgr2=0x7f27700cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:46.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f2776a00640 1 --2- 172.21.15.137:0/1752999964 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2770073090 0x7f27700cd770 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f27680097f0 tx=0x7f276801c470 comp rx=0 tx=0).stop 2024-04-26T23:44:46.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f2776a00640 1 -- 172.21.15.137:0/1752999964 shutdown_connections 2024-04-26T23:44:46.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f2776a00640 1 --2- 172.21.15.137:0/1752999964 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2770073090 0x7f27700cd770 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f2776a00640 1 -- 172.21.15.137:0/1752999964 >> 172.21.15.137:0/1752999964 conn(0x7f277006c5d0 msgr2=0x7f277006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:46.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f2776a00640 1 -- 172.21.15.137:0/1752999964 shutdown_connections 2024-04-26T23:44:46.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f2776a00640 1 -- 172.21.15.137:0/1752999964 wait complete. 2024-04-26T23:44:46.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f2776a00640 1 Processor -- start 2024-04-26T23:44:46.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f2776a00640 1 -- start start 2024-04-26T23:44:46.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f2776a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27700725a0 0x7f277015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:46.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f2776a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2770073090 0x7f27700af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:46.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f2776a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27700b5080 0x7f27700b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:46.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f2776a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f277006ef10 con 0x7f27700725a0 2024-04-26T23:44:46.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f2776a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f277006ed90 con 0x7f2770073090 2024-04-26T23:44:46.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f2776a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f277006f090 con 0x7f27700b5080 2024-04-26T23:44:46.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f276fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27700725a0 0x7f277015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:46.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f276fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27700725a0 0x7f277015b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41172/0 (socket says 172.21.15.137:41172) 2024-04-26T23:44:46.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f276fe00640 1 -- 172.21.15.137:0/2303111189 learned_addr learned my addr 172.21.15.137:0/2303111189 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:46.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f2767400640 1 --2- 172.21.15.137:0/2303111189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2770073090 0x7f27700af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:46.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f2774a00640 1 --2- 172.21.15.137:0/2303111189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27700b5080 0x7f27700b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:46.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f276fe00640 1 -- 172.21.15.137:0/2303111189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27700b5080 msgr2=0x7f27700b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:46.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f276fe00640 1 --2- 172.21.15.137:0/2303111189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27700b5080 0x7f27700b0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f276fe00640 1 -- 172.21.15.137:0/2303111189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2770073090 msgr2=0x7f27700af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:46.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f276fe00640 1 --2- 172.21.15.137:0/2303111189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2770073090 0x7f27700af150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:46.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f276fe00640 1 -- 172.21.15.137:0/2303111189 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27700afc30 con 0x7f27700725a0 2024-04-26T23:44:46.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.937+0000 7f2767400640 1 --2- 172.21.15.137:0/2303111189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2770073090 0x7f27700af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:46.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.941+0000 7f276fe00640 1 --2- 172.21.15.137:0/2303111189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27700725a0 0x7f277015b0e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f276000c460 tx=0x7f276000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:46.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.941+0000 7f276cc00640 1 -- 172.21.15.137:0/2303111189 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27600052d0 con 0x7f27700725a0 2024-04-26T23:44:46.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.941+0000 7f276cc00640 1 -- 172.21.15.137:0/2303111189 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2760005490 con 0x7f27700725a0 2024-04-26T23:44:46.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.941+0000 7f276cc00640 1 -- 172.21.15.137:0/2303111189 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2760012850 con 0x7f27700725a0 2024-04-26T23:44:46.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.941+0000 7f2776a00640 1 -- 172.21.15.137:0/2303111189 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27700aff10 con 0x7f27700725a0 2024-04-26T23:44:46.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.941+0000 7f2776a00640 1 -- 172.21.15.137:0/2303111189 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2770140ab0 con 0x7f27700725a0 2024-04-26T23:44:46.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.941+0000 7f2776a00640 1 -- 172.21.15.137:0/2303111189 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f277006a4b0 con 0x7f27700725a0 2024-04-26T23:44:46.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.941+0000 7f276cc00640 1 -- 172.21.15.137:0/2303111189 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f27600129f0 con 0x7f27700725a0 2024-04-26T23:44:46.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.941+0000 7f276cc00640 1 --2- 172.21.15.137:0/2303111189 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f274c0683b0 0x7f274c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:46.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.941+0000 7f276cc00640 1 -- 172.21.15.137:0/2303111189 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f2760086690 con 0x7f27700725a0 2024-04-26T23:44:46.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.941+0000 7f2767400640 1 --2- 172.21.15.137:0/2303111189 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f274c0683b0 0x7f274c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:46.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.945+0000 7f2767400640 1 --2- 172.21.15.137:0/2303111189 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f274c0683b0 0x7f274c06a870 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f27701fb240 tx=0x7f2758009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:46.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:46.945+0000 7f276cc00640 1 -- 172.21.15.137:0/2303111189 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2760056b20 con 0x7f27700725a0 2024-04-26T23:44:47.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.101+0000 7f2776a00640 1 -- 172.21.15.137:0/2303111189 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2770138a90 con 0x7f27700725a0 2024-04-26T23:44:47.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.101+0000 7f276cc00640 1 -- 172.21.15.137:0/2303111189 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16713 (secure 0 0 0) 0x7f2760056420 con 0x7f27700725a0 2024-04-26T23:44:47.107 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:47.108 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":60,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:44:22.811626+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:44:18.876990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T23:44:20.189315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:44:47.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.105+0000 7f2776a00640 1 -- 172.21.15.137:0/2303111189 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f274c0683b0 msgr2=0x7f274c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:47.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.105+0000 7f2776a00640 1 --2- 172.21.15.137:0/2303111189 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f274c0683b0 0x7f274c06a870 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f27701fb240 tx=0x7f2758009040 comp rx=0 tx=0).stop 2024-04-26T23:44:47.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.105+0000 7f2776a00640 1 -- 172.21.15.137:0/2303111189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27700725a0 msgr2=0x7f277015b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:47.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.105+0000 7f2776a00640 1 --2- 172.21.15.137:0/2303111189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27700725a0 0x7f277015b0e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f276000c460 tx=0x7f276000c920 comp rx=0 tx=0).stop 2024-04-26T23:44:47.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.105+0000 7f2776a00640 1 -- 172.21.15.137:0/2303111189 shutdown_connections 2024-04-26T23:44:47.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.105+0000 7f2776a00640 1 --2- 172.21.15.137:0/2303111189 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f274c0683b0 0x7f274c06a870 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.105+0000 7f2776a00640 1 --2- 172.21.15.137:0/2303111189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27700b5080 0x7f27700b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.105+0000 7f2776a00640 1 --2- 172.21.15.137:0/2303111189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2770073090 0x7f27700af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.105+0000 7f2776a00640 1 --2- 172.21.15.137:0/2303111189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27700725a0 0x7f277015b0e0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.105+0000 7f2776a00640 1 -- 172.21.15.137:0/2303111189 >> 172.21.15.137:0/2303111189 conn(0x7f277006c5d0 msgr2=0x7f27700735b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:47.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.105+0000 7f2776a00640 1 -- 172.21.15.137:0/2303111189 shutdown_connections 2024-04-26T23:44:47.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.105+0000 7f2776a00640 1 -- 172.21.15.137:0/2303111189 wait complete. 2024-04-26T23:44:47.128 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:44:18.876990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:44:20.189315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:44:47.129 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:44:47.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.265+0000 7f5f43c00640 1 Processor -- start 2024-04-26T23:44:47.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.265+0000 7f5f43c00640 1 -- start start 2024-04-26T23:44:47.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.265+0000 7f5f43c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f3c0b54e0 0x7f5f3c0b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:47.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.265+0000 7f5f43c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5f3c0cd710 0x7f5f3c15f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:47.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.265+0000 7f5f43c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f3c160250 con 0x7f5f3c15fe30 2024-04-26T23:44:47.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.265+0000 7f5f43c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5f3c0b3d90 con 0x7f5f3c0cd710 2024-04-26T23:44:47.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.265+0000 7f5f43c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5f3c0d0840 con 0x7f5f3c0b54e0 2024-04-26T23:44:47.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.265+0000 7f5f3be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5f3c0cd710 0x7f5f3c15f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:47.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.265+0000 7f5f3be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5f3c0cd710 0x7f5f3c15f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41174/0 (socket says 172.21.15.137:41174) 2024-04-26T23:44:47.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.265+0000 7f5f41c00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f5f3c15fe30 0x7f5f3c144d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:59586/0 (socket says 172.21.15.137:59586) 2024-04-26T23:44:47.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.265+0000 7f5f3be00640 1 -- 172.21.15.137:0/3921871710 learned_addr learned my addr 172.21.15.137:0/3921871710 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:47.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.265+0000 7f5f41200640 1 --2- 172.21.15.137:0/3921871710 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f3c0b54e0 0x7f5f3c0b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:47.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.265+0000 7f5f3be00640 1 -- 172.21.15.137:0/3921871710 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f3c0b54e0 msgr2=0x7f5f3c0b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:47.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.265+0000 7f5f3be00640 1 --2- 172.21.15.137:0/3921871710 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f3c0b54e0 0x7f5f3c0b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.265+0000 7f5f3be00640 1 -- 172.21.15.137:0/3921871710 >> v1:172.21.15.137:6789/0 conn(0x7f5f3c15fe30 legacy=0x7f5f3c144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:47.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.265+0000 7f5f3be00640 1 -- 172.21.15.137:0/3921871710 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f3c0cffa0 con 0x7f5f3c0cd710 2024-04-26T23:44:47.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.265+0000 7f5f3b400640 1 -- 172.21.15.137:0/3921871710 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3064624610 0 0) 0x7f5f3c160250 con 0x7f5f3c15fe30 2024-04-26T23:44:47.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.269+0000 7f5f3be00640 1 --2- 172.21.15.137:0/3921871710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f3c0cd710 0x7f5f3c15f8f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5f280098a0 tx=0x7f5f2801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e03dc8cc6fb5f34 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:47.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.269+0000 7f5f3b400640 1 -- 172.21.15.137:0/3921871710 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f280aa670 con 0x7f5f3c0cd710 2024-04-26T23:44:47.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.269+0000 7f5f3b400640 1 -- 172.21.15.137:0/3921871710 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f280af070 con 0x7f5f3c0cd710 2024-04-26T23:44:47.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.269+0000 7f5f3b400640 1 -- 172.21.15.137:0/3921871710 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f280aaa30 con 0x7f5f3c0cd710 2024-04-26T23:44:47.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.269+0000 7f5f43c00640 1 -- 172.21.15.137:0/3921871710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f3c0cd710 msgr2=0x7f5f3c15f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:47.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.269+0000 7f5f43c00640 1 --2- 172.21.15.137:0/3921871710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f3c0cd710 0x7f5f3c15f8f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5f280098a0 tx=0x7f5f2801c510 comp rx=0 tx=0).stop 2024-04-26T23:44:47.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.269+0000 7f5f43c00640 1 -- 172.21.15.137:0/3921871710 shutdown_connections 2024-04-26T23:44:47.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.269+0000 7f5f43c00640 1 --2- 172.21.15.137:0/3921871710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f3c0cd710 0x7f5f3c15f8f0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.269+0000 7f5f43c00640 1 --2- 172.21.15.137:0/3921871710 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f3c0b54e0 0x7f5f3c0b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.269+0000 7f5f43c00640 1 -- 172.21.15.137:0/3921871710 >> 172.21.15.137:0/3921871710 conn(0x7f5f3c06c800 msgr2=0x7f5f3c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:47.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.269+0000 7f5f43c00640 1 -- 172.21.15.137:0/3921871710 shutdown_connections 2024-04-26T23:44:47.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.269+0000 7f5f43c00640 1 -- 172.21.15.137:0/3921871710 wait complete. 2024-04-26T23:44:47.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f43c00640 1 Processor -- start 2024-04-26T23:44:47.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f43c00640 1 -- start start 2024-04-26T23:44:47.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f43c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f3c0b54e0 0x7f5f3c15b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:47.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f43c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f3c0cd710 0x7f5f3c06ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:47.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f43c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f3c15fe30 0x7f5f3c13dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:47.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f43c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3c0cdb50 con 0x7f5f3c15fe30 2024-04-26T23:44:47.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f43c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3c0cded0 con 0x7f5f3c0cd710 2024-04-26T23:44:47.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f43c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5f3c145840 con 0x7f5f3c0b54e0 2024-04-26T23:44:47.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f41c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f3c15fe30 0x7f5f3c13dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:47.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f41c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f3c15fe30 0x7f5f3c13dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41188/0 (socket says 172.21.15.137:41188) 2024-04-26T23:44:47.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f41c00640 1 -- 172.21.15.137:0/1616837564 learned_addr learned my addr 172.21.15.137:0/1616837564 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:47.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f3be00640 1 --2- 172.21.15.137:0/1616837564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f3c0cd710 0x7f5f3c06ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:47.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f41200640 1 --2- 172.21.15.137:0/1616837564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f3c0b54e0 0x7f5f3c15b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:47.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f41c00640 1 -- 172.21.15.137:0/1616837564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f3c0b54e0 msgr2=0x7f5f3c15b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:47.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f41c00640 1 --2- 172.21.15.137:0/1616837564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f3c0b54e0 0x7f5f3c15b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f41c00640 1 -- 172.21.15.137:0/1616837564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f3c0cd710 msgr2=0x7f5f3c06ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:47.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f41c00640 1 --2- 172.21.15.137:0/1616837564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f3c0cd710 0x7f5f3c06ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f41c00640 1 -- 172.21.15.137:0/1616837564 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f3c13d790 con 0x7f5f3c15fe30 2024-04-26T23:44:47.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f41c00640 1 --2- 172.21.15.137:0/1616837564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f3c15fe30 0x7f5f3c13dfd0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400c410 tx=0x7f5f3400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:47.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f38c00640 1 -- 172.21.15.137:0/1616837564 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f340074e0 con 0x7f5f3c15fe30 2024-04-26T23:44:47.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f38c00640 1 -- 172.21.15.137:0/1616837564 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f340047f0 con 0x7f5f3c15fe30 2024-04-26T23:44:47.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f43c00640 1 -- 172.21.15.137:0/1616837564 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f3c156ed0 con 0x7f5f3c15fe30 2024-04-26T23:44:47.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f38c00640 1 -- 172.21.15.137:0/1616837564 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f34007680 con 0x7f5f3c15fe30 2024-04-26T23:44:47.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.273+0000 7f5f43c00640 1 -- 172.21.15.137:0/1616837564 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f3c157490 con 0x7f5f3c15fe30 2024-04-26T23:44:47.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.277+0000 7f5f43c00640 1 -- 172.21.15.137:0/1616837564 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f3c06a410 con 0x7f5f3c15fe30 2024-04-26T23:44:47.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.277+0000 7f5f38c00640 1 -- 172.21.15.137:0/1616837564 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5f34011070 con 0x7f5f3c15fe30 2024-04-26T23:44:47.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.277+0000 7f5f38c00640 1 --2- 172.21.15.137:0/1616837564 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5f1c068380 0x7f5f1c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:47.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.277+0000 7f5f38c00640 1 -- 172.21.15.137:0/1616837564 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f5f34086360 con 0x7f5f3c15fe30 2024-04-26T23:44:47.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.277+0000 7f5f41200640 1 --2- 172.21.15.137:0/1616837564 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5f1c068380 0x7f5f1c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:47.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.277+0000 7f5f41200640 1 --2- 172.21.15.137:0/1616837564 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5f1c068380 0x7f5f1c06a840 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c003b90 tx=0x7f5f2c0098d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:47.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.281+0000 7f5f38c00640 1 -- 172.21.15.137:0/1616837564 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5f340562d0 con 0x7f5f3c15fe30 2024-04-26T23:44:47.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.437+0000 7f5f43c00640 1 -- 172.21.15.137:0/1616837564 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5f3c157830 con 0x7f5f3c15fe30 2024-04-26T23:44:47.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.437+0000 7f5f38c00640 1 -- 172.21.15.137:0/1616837564 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) ==== 93+0+10 (secure 0 0 0) 0x7f5f3405a5d0 con 0x7f5f3c15fe30 2024-04-26T23:44:47.442 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:44:47.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.441+0000 7f5f43c00640 1 -- 172.21.15.137:0/1616837564 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5f1c068380 msgr2=0x7f5f1c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:47.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.441+0000 7f5f43c00640 1 --2- 172.21.15.137:0/1616837564 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5f1c068380 0x7f5f1c06a840 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c003b90 tx=0x7f5f2c0098d0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.441+0000 7f5f43c00640 1 -- 172.21.15.137:0/1616837564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f3c15fe30 msgr2=0x7f5f3c13dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:47.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.441+0000 7f5f43c00640 1 --2- 172.21.15.137:0/1616837564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f3c15fe30 0x7f5f3c13dfd0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400c410 tx=0x7f5f3400c8d0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.441+0000 7f5f43c00640 1 -- 172.21.15.137:0/1616837564 shutdown_connections 2024-04-26T23:44:47.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.441+0000 7f5f43c00640 1 --2- 172.21.15.137:0/1616837564 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5f1c068380 0x7f5f1c06a840 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.441+0000 7f5f43c00640 1 --2- 172.21.15.137:0/1616837564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f3c15fe30 0x7f5f3c13dfd0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.441+0000 7f5f43c00640 1 --2- 172.21.15.137:0/1616837564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f3c0cd710 0x7f5f3c06ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.441+0000 7f5f43c00640 1 --2- 172.21.15.137:0/1616837564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f3c0b54e0 0x7f5f3c15b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.441+0000 7f5f43c00640 1 -- 172.21.15.137:0/1616837564 >> 172.21.15.137:0/1616837564 conn(0x7f5f3c06c800 msgr2=0x7f5f3c160210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:47.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.441+0000 7f5f43c00640 1 -- 172.21.15.137:0/1616837564 shutdown_connections 2024-04-26T23:44:47.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.441+0000 7f5f43c00640 1 -- 172.21.15.137:0/1616837564 wait complete. 2024-04-26T23:44:47.463 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:44:47.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.597+0000 7f9e70400640 1 Processor -- start 2024-04-26T23:44:47.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.597+0000 7f9e70400640 1 -- start start 2024-04-26T23:44:47.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.597+0000 7f9e70400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e680b54e0 0x7f9e680b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:47.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.597+0000 7f9e70400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9e680cd710 0x7f9e6815f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:47.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.597+0000 7f9e70400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9e6815fe30 0x7f9e68144d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:47.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.597+0000 7f9e70400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f9e680b3d90 con 0x7f9e680cd710 2024-04-26T23:44:47.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.597+0000 7f9e70400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f9e680d0840 con 0x7f9e6815fe30 2024-04-26T23:44:47.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.597+0000 7f9e70400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9e68160250 con 0x7f9e680b54e0 2024-04-26T23:44:47.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.601+0000 7f9e6d000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9e680cd710 0x7f9e6815f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:47.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.601+0000 7f9e6d000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9e680cd710 0x7f9e6815f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41204/0 (socket says 172.21.15.137:41204) 2024-04-26T23:44:47.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.601+0000 7f9e6d000640 1 -- 172.21.15.137:0/2559492635 learned_addr learned my addr 172.21.15.137:0/2559492635 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:47.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.601+0000 7f9e6e400640 1 --2- 172.21.15.137:0/2559492635 >> v2:172.21.15.170:3300/0 conn(0x7f9e6815fe30 0x7f9e68144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:47.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.601+0000 7f9e6da00640 1 --2- 172.21.15.137:0/2559492635 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e680b54e0 0x7f9e680b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:47.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.601+0000 7f9e6d000640 1 -- 172.21.15.137:0/2559492635 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e680b54e0 msgr2=0x7f9e680b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:47.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.601+0000 7f9e6d000640 1 --2- 172.21.15.137:0/2559492635 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e680b54e0 0x7f9e680b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.601+0000 7f9e6d000640 1 -- 172.21.15.137:0/2559492635 >> v2:172.21.15.170:3300/0 conn(0x7f9e6815fe30 msgr2=0x7f9e68144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:47.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.601+0000 7f9e6d000640 1 --2- 172.21.15.137:0/2559492635 >> v2:172.21.15.170:3300/0 conn(0x7f9e6815fe30 0x7f9e68144d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.601+0000 7f9e6d000640 1 -- 172.21.15.137:0/2559492635 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e680cffa0 con 0x7f9e680cd710 2024-04-26T23:44:47.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.601+0000 7f9e6da00640 1 --2- 172.21.15.137:0/2559492635 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e680b54e0 0x7f9e680b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:47.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.601+0000 7f9e6d000640 1 --2- 172.21.15.137:0/2559492635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e680cd710 0x7f9e6815f8f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f9e68070100 tx=0x7f9e5401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10f62b5edf921f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:47.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.601+0000 7f9e67e00640 1 -- 172.21.15.137:0/2559492635 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e540aa610 con 0x7f9e680cd710 2024-04-26T23:44:47.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.601+0000 7f9e67e00640 1 -- 172.21.15.137:0/2559492635 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e540af070 con 0x7f9e680cd710 2024-04-26T23:44:47.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.601+0000 7f9e67e00640 1 -- 172.21.15.137:0/2559492635 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e540aa9d0 con 0x7f9e680cd710 2024-04-26T23:44:47.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.605+0000 7f9e70400640 1 -- 172.21.15.137:0/2559492635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e680cd710 msgr2=0x7f9e6815f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:47.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.605+0000 7f9e70400640 1 --2- 172.21.15.137:0/2559492635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e680cd710 0x7f9e6815f8f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f9e68070100 tx=0x7f9e5401c4f0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.605+0000 7f9e70400640 1 -- 172.21.15.137:0/2559492635 shutdown_connections 2024-04-26T23:44:47.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.605+0000 7f9e70400640 1 --2- 172.21.15.137:0/2559492635 >> v2:172.21.15.170:3300/0 conn(0x7f9e6815fe30 0x7f9e68144d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.605+0000 7f9e70400640 1 --2- 172.21.15.137:0/2559492635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e680cd710 0x7f9e6815f8f0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.605+0000 7f9e70400640 1 --2- 172.21.15.137:0/2559492635 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e680b54e0 0x7f9e680b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.605+0000 7f9e70400640 1 -- 172.21.15.137:0/2559492635 >> 172.21.15.137:0/2559492635 conn(0x7f9e6806c800 msgr2=0x7f9e6806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:47.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.605+0000 7f9e70400640 1 -- 172.21.15.137:0/2559492635 shutdown_connections 2024-04-26T23:44:47.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.605+0000 7f9e70400640 1 -- 172.21.15.137:0/2559492635 wait complete. 2024-04-26T23:44:47.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.605+0000 7f9e70400640 1 Processor -- start 2024-04-26T23:44:47.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.605+0000 7f9e70400640 1 -- start start 2024-04-26T23:44:47.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.605+0000 7f9e70400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e680b54e0 0x7f9e680b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:47.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.605+0000 7f9e70400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e680cd710 0x7f9e681face0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:47.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.605+0000 7f9e70400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e6815fe30 0x7f9e6815e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:47.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.605+0000 7f9e70400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9e680cdb50 con 0x7f9e6815fe30 2024-04-26T23:44:47.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.605+0000 7f9e70400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9e680cded0 con 0x7f9e680b54e0 2024-04-26T23:44:47.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.605+0000 7f9e70400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9e6815c320 con 0x7f9e680cd710 2024-04-26T23:44:47.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.605+0000 7f9e6e400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e6815fe30 0x7f9e6815e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:47.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.605+0000 7f9e6e400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e6815fe30 0x7f9e6815e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41214/0 (socket says 172.21.15.137:41214) 2024-04-26T23:44:47.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.605+0000 7f9e6e400640 1 -- 172.21.15.137:0/1842913801 learned_addr learned my addr 172.21.15.137:0/1842913801 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:47.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.605+0000 7f9e6d000640 1 --2- 172.21.15.137:0/1842913801 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e680cd710 0x7f9e681face0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:47.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.605+0000 7f9e6da00640 1 --2- 172.21.15.137:0/1842913801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e680b54e0 0x7f9e680b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:47.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.609+0000 7f9e6e400640 1 -- 172.21.15.137:0/1842913801 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e680cd710 msgr2=0x7f9e681face0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:47.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.609+0000 7f9e6e400640 1 --2- 172.21.15.137:0/1842913801 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e680cd710 0x7f9e681face0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.609+0000 7f9e6e400640 1 -- 172.21.15.137:0/1842913801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e680b54e0 msgr2=0x7f9e680b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:47.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.609+0000 7f9e6e400640 1 --2- 172.21.15.137:0/1842913801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e680b54e0 0x7f9e680b20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.609+0000 7f9e6e400640 1 -- 172.21.15.137:0/1842913801 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e68165c60 con 0x7f9e6815fe30 2024-04-26T23:44:47.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.609+0000 7f9e6e400640 1 --2- 172.21.15.137:0/1842913801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e6815fe30 0x7f9e6815e730 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9e60007e60 tx=0x7f9e6000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:47.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.609+0000 7f9e65600640 1 -- 172.21.15.137:0/1842913801 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e60014420 con 0x7f9e6815fe30 2024-04-26T23:44:47.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.609+0000 7f9e65600640 1 -- 172.21.15.137:0/1842913801 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e60019070 con 0x7f9e6815fe30 2024-04-26T23:44:47.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.609+0000 7f9e70400640 1 -- 172.21.15.137:0/1842913801 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e68165f40 con 0x7f9e6815fe30 2024-04-26T23:44:47.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.609+0000 7f9e65600640 1 -- 172.21.15.137:0/1842913801 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e60014820 con 0x7f9e6815fe30 2024-04-26T23:44:47.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.609+0000 7f9e70400640 1 -- 172.21.15.137:0/1842913801 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e68166500 con 0x7f9e6815fe30 2024-04-26T23:44:47.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.609+0000 7f9e70400640 1 -- 172.21.15.137:0/1842913801 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e6806a410 con 0x7f9e6815fe30 2024-04-26T23:44:47.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.609+0000 7f9e65600640 1 -- 172.21.15.137:0/1842913801 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9e600149c0 con 0x7f9e6815fe30 2024-04-26T23:44:47.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.609+0000 7f9e65600640 1 --2- 172.21.15.137:0/1842913801 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9e48068380 0x7f9e4806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:47.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.609+0000 7f9e65600640 1 -- 172.21.15.137:0/1842913801 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f9e60087170 con 0x7f9e6815fe30 2024-04-26T23:44:47.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.609+0000 7f9e6da00640 1 --2- 172.21.15.137:0/1842913801 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9e48068380 0x7f9e4806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:47.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.613+0000 7f9e6da00640 1 --2- 172.21.15.137:0/1842913801 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9e48068380 0x7f9e4806a840 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c006b20 tx=0x7f9e5c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:47.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.613+0000 7f9e65600640 1 -- 172.21.15.137:0/1842913801 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9e60057040 con 0x7f9e6815fe30 2024-04-26T23:44:47.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.773+0000 7f9e70400640 1 -- 172.21.15.137:0/1842913801 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9e6806f9b0 con 0x7f9e6815fe30 2024-04-26T23:44:47.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.777+0000 7f9e65600640 1 -- 172.21.15.137:0/1842913801 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) ==== 104+0+11 (secure 0 0 0) 0x7f9e6005b340 con 0x7f9e6815fe30 2024-04-26T23:44:47.780 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:44:47.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.777+0000 7f9e70400640 1 -- 172.21.15.137:0/1842913801 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9e48068380 msgr2=0x7f9e4806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:47.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.777+0000 7f9e70400640 1 --2- 172.21.15.137:0/1842913801 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9e48068380 0x7f9e4806a840 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c006b20 tx=0x7f9e5c008040 comp rx=0 tx=0).stop 2024-04-26T23:44:47.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.777+0000 7f9e70400640 1 -- 172.21.15.137:0/1842913801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e6815fe30 msgr2=0x7f9e6815e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:47.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.777+0000 7f9e70400640 1 --2- 172.21.15.137:0/1842913801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e6815fe30 0x7f9e6815e730 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9e60007e60 tx=0x7f9e6000e4b0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.777+0000 7f9e70400640 1 -- 172.21.15.137:0/1842913801 shutdown_connections 2024-04-26T23:44:47.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.777+0000 7f9e70400640 1 --2- 172.21.15.137:0/1842913801 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9e48068380 0x7f9e4806a840 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.777+0000 7f9e70400640 1 --2- 172.21.15.137:0/1842913801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e6815fe30 0x7f9e6815e730 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.777+0000 7f9e70400640 1 --2- 172.21.15.137:0/1842913801 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e680cd710 0x7f9e681face0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.777+0000 7f9e70400640 1 --2- 172.21.15.137:0/1842913801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e680b54e0 0x7f9e680b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.777+0000 7f9e70400640 1 -- 172.21.15.137:0/1842913801 >> 172.21.15.137:0/1842913801 conn(0x7f9e6806c800 msgr2=0x7f9e6806ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:47.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.777+0000 7f9e70400640 1 -- 172.21.15.137:0/1842913801 shutdown_connections 2024-04-26T23:44:47.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.777+0000 7f9e70400640 1 -- 172.21.15.137:0/1842913801 wait complete. 2024-04-26T23:44:47.801 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:44:47.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.937+0000 7fade1200640 1 Processor -- start 2024-04-26T23:44:47.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.937+0000 7fade1200640 1 -- start start 2024-04-26T23:44:47.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.937+0000 7fade1200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faddc160000 0x7faddc144d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:47.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.937+0000 7fade1200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faddc0cffa0 con 0x7faddc0b54e0 2024-04-26T23:44:47.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.937+0000 7fade1200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faddc0d0280 con 0x7faddc0b5ee0 2024-04-26T23:44:47.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.937+0000 7fade1200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faddc0b3d90 con 0x7faddc160000 2024-04-26T23:44:47.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.937+0000 7fadd9e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7faddc0b54e0 0x7faddc0cd710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:59598/0 (socket says 172.21.15.137:59598) 2024-04-26T23:44:47.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.937+0000 7fadd9e00640 1 -- 172.21.15.137:0/3457429870 learned_addr learned my addr 172.21.15.137:0/3457429870 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:47.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.937+0000 7fadda800640 1 --2- 172.21.15.137:0/3457429870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faddc160000 0x7faddc144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:47.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.937+0000 7fadd9400640 1 -- 172.21.15.137:0/3457429870 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3570885592 0 0) 0x7faddc0cffa0 con 0x7faddc0b54e0 2024-04-26T23:44:47.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.937+0000 7fadd9400640 1 -- 172.21.15.137:0/3457429870 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadc0005740 con 0x7faddc0b54e0 2024-04-26T23:44:47.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.937+0000 7fadd9400640 1 -- 172.21.15.137:0/3457429870 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2923473694 0 0) 0x7faddc0d0280 con 0x7faddc0b5ee0 2024-04-26T23:44:47.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.941+0000 7fadd9400640 1 -- 172.21.15.137:0/3457429870 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faddc0cffa0 con 0x7faddc0b5ee0 2024-04-26T23:44:47.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.941+0000 7fadd9400640 1 -- 172.21.15.137:0/3457429870 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1257619729 0 0) 0x7fadc0005740 con 0x7faddc0b54e0 2024-04-26T23:44:47.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.941+0000 7fadda800640 1 -- 172.21.15.137:0/3457429870 >> v1:172.21.15.170:6789/0 conn(0x7faddc0b5ee0 legacy=0x7faddc15f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:47.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.941+0000 7fadda800640 1 -- 172.21.15.137:0/3457429870 >> v1:172.21.15.137:6789/0 conn(0x7faddc0b54e0 legacy=0x7faddc0cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:47.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.941+0000 7fadda800640 1 -- 172.21.15.137:0/3457429870 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faddc0d0560 con 0x7faddc160000 2024-04-26T23:44:47.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.941+0000 7fadda800640 1 --2- 172.21.15.137:0/3457429870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faddc160000 0x7faddc144d20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fadd40097f0 tx=0x7fadd401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4db8f60e9d61e203 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:47.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.941+0000 7fadd9400640 1 -- 172.21.15.137:0/3457429870 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd40b0070 con 0x7faddc160000 2024-04-26T23:44:47.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.941+0000 7fadd9400640 1 -- 172.21.15.137:0/3457429870 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faddc145a70 con 0x7faddc160000 2024-04-26T23:44:47.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.941+0000 7fadd9400640 1 -- 172.21.15.137:0/3457429870 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc001a00 con 0x7faddc160000 2024-04-26T23:44:47.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.941+0000 7fade1200640 1 -- 172.21.15.137:0/3457429870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faddc160000 msgr2=0x7faddc144d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:47.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.941+0000 7fade1200640 1 --2- 172.21.15.137:0/3457429870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faddc160000 0x7faddc144d20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fadd40097f0 tx=0x7fadd401c400 comp rx=0 tx=0).stop 2024-04-26T23:44:47.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.941+0000 7fade1200640 1 -- 172.21.15.137:0/3457429870 shutdown_connections 2024-04-26T23:44:47.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.941+0000 7fade1200640 1 --2- 172.21.15.137:0/3457429870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faddc160000 0x7faddc144d20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.941+0000 7fade1200640 1 -- 172.21.15.137:0/3457429870 >> 172.21.15.137:0/3457429870 conn(0x7faddc06c800 msgr2=0x7faddc06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:47.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fade1200640 1 -- 172.21.15.137:0/3457429870 shutdown_connections 2024-04-26T23:44:47.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fade1200640 1 -- 172.21.15.137:0/3457429870 wait complete. 2024-04-26T23:44:47.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fade1200640 1 Processor -- start 2024-04-26T23:44:47.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fade1200640 1 -- start start 2024-04-26T23:44:47.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fade1200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faddc0b54e0 0x7faddc0af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:47.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fade1200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faddc0b5ee0 0x7faddc0af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:47.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fade1200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faddc160000 0x7faddc0b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:47.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fade1200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faddc06f0e0 con 0x7faddc0b54e0 2024-04-26T23:44:47.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fade1200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faddc06ef60 con 0x7faddc0b5ee0 2024-04-26T23:44:47.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fade1200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faddc06f260 con 0x7faddc160000 2024-04-26T23:44:47.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fadd9e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faddc0b54e0 0x7faddc0af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:47.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fadd9e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faddc0b54e0 0x7faddc0af1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41216/0 (socket says 172.21.15.137:41216) 2024-04-26T23:44:47.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fadd9e00640 1 -- 172.21.15.137:0/3910176842 learned_addr learned my addr 172.21.15.137:0/3910176842 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:47.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fadd1400640 1 --2- 172.21.15.137:0/3910176842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faddc0b5ee0 0x7faddc0af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:47.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fadda800640 1 --2- 172.21.15.137:0/3910176842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faddc160000 0x7faddc0b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:47.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fadd9e00640 1 -- 172.21.15.137:0/3910176842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faddc160000 msgr2=0x7faddc0b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:47.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fadd9e00640 1 --2- 172.21.15.137:0/3910176842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faddc160000 0x7faddc0b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fadd9e00640 1 -- 172.21.15.137:0/3910176842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faddc0b5ee0 msgr2=0x7faddc0af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:47.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fadd9e00640 1 --2- 172.21.15.137:0/3910176842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faddc0b5ee0 0x7faddc0af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:47.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fadd9e00640 1 -- 172.21.15.137:0/3910176842 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faddc0b0480 con 0x7faddc0b54e0 2024-04-26T23:44:47.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fadd9e00640 1 --2- 172.21.15.137:0/3910176842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faddc0b54e0 0x7faddc0af1a0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fadcc001fd0 tx=0x7fadcc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:47.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fadd2a00640 1 -- 172.21.15.137:0/3910176842 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc017070 con 0x7faddc0b54e0 2024-04-26T23:44:47.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.945+0000 7fadd2a00640 1 -- 172.21.15.137:0/3910176842 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadcc012400 con 0x7faddc0b54e0 2024-04-26T23:44:47.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.949+0000 7fade1200640 1 -- 172.21.15.137:0/3910176842 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faddc0b01a0 con 0x7faddc0b54e0 2024-04-26T23:44:47.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.949+0000 7fadd2a00640 1 -- 172.21.15.137:0/3910176842 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc0127f0 con 0x7faddc0b54e0 2024-04-26T23:44:47.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.949+0000 7fade1200640 1 -- 172.21.15.137:0/3910176842 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faddc142300 con 0x7faddc0b54e0 2024-04-26T23:44:47.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.949+0000 7fade1200640 1 -- 172.21.15.137:0/3910176842 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faddc06a410 con 0x7faddc0b54e0 2024-04-26T23:44:47.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.949+0000 7fadd2a00640 1 -- 172.21.15.137:0/3910176842 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fadcc01a070 con 0x7faddc0b54e0 2024-04-26T23:44:47.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.949+0000 7fadd2a00640 1 --2- 172.21.15.137:0/3910176842 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fadb8068380 0x7fadb806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:47.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.949+0000 7fadd2a00640 1 -- 172.21.15.137:0/3910176842 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fadcc0868f0 con 0x7faddc0b54e0 2024-04-26T23:44:47.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.949+0000 7fadd1400640 1 --2- 172.21.15.137:0/3910176842 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fadb8068380 0x7fadb806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:47.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.949+0000 7fadd1400640 1 --2- 172.21.15.137:0/3910176842 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fadb8068380 0x7fadb806a840 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7faddc06cf10 tx=0x7fadc4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:47.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:47.953+0000 7fadd2a00640 1 -- 172.21.15.137:0/3910176842 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fadcc056850 con 0x7faddc0b54e0 2024-04-26T23:44:48.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.113+0000 7fade1200640 1 -- 172.21.15.137:0/3910176842 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7faddc06cf40 con 0x7faddc0b54e0 2024-04-26T23:44:48.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.113+0000 7fadd2a00640 1 -- 172.21.15.137:0/3910176842 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) ==== 100+0+11 (secure 0 0 0) 0x7fadcc05ab50 con 0x7faddc0b54e0 2024-04-26T23:44:48.118 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:44:48.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.113+0000 7fade1200640 1 -- 172.21.15.137:0/3910176842 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fadb8068380 msgr2=0x7fadb806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:48.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.113+0000 7fade1200640 1 --2- 172.21.15.137:0/3910176842 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fadb8068380 0x7fadb806a840 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7faddc06cf10 tx=0x7fadc4009040 comp rx=0 tx=0).stop 2024-04-26T23:44:48.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.113+0000 7fade1200640 1 -- 172.21.15.137:0/3910176842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faddc0b54e0 msgr2=0x7faddc0af1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:48.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.113+0000 7fade1200640 1 --2- 172.21.15.137:0/3910176842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faddc0b54e0 0x7faddc0af1a0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fadcc001fd0 tx=0x7fadcc00cf90 comp rx=0 tx=0).stop 2024-04-26T23:44:48.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.113+0000 7fade1200640 1 -- 172.21.15.137:0/3910176842 shutdown_connections 2024-04-26T23:44:48.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.113+0000 7fade1200640 1 --2- 172.21.15.137:0/3910176842 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fadb8068380 0x7fadb806a840 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:48.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.113+0000 7fade1200640 1 --2- 172.21.15.137:0/3910176842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faddc160000 0x7faddc0b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:48.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.113+0000 7fade1200640 1 --2- 172.21.15.137:0/3910176842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faddc0b5ee0 0x7faddc0af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:48.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.113+0000 7fade1200640 1 --2- 172.21.15.137:0/3910176842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faddc0b54e0 0x7faddc0af1a0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:48.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.113+0000 7fade1200640 1 -- 172.21.15.137:0/3910176842 >> 172.21.15.137:0/3910176842 conn(0x7faddc06c800 msgr2=0x7faddc06f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:48.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.113+0000 7fade1200640 1 -- 172.21.15.137:0/3910176842 shutdown_connections 2024-04-26T23:44:48.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.113+0000 7fade1200640 1 -- 172.21.15.137:0/3910176842 wait complete. 2024-04-26T23:44:48.138 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:44:48.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.269+0000 7fb488e00640 1 Processor -- start 2024-04-26T23:44:48.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.269+0000 7fb488e00640 1 -- start start 2024-04-26T23:44:48.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb488e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb4840aeda0 0x7fb4841615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:48.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb488e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4840b0820 con 0x7fb48406db20 2024-04-26T23:44:48.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb488e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4840b0ac0 con 0x7fb4841467e0 2024-04-26T23:44:48.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb488e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb4840b1880 con 0x7fb4840aeda0 2024-04-26T23:44:48.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb481400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb48406db20 0x7fb4840b5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:59602/0 (socket says 172.21.15.137:59602) 2024-04-26T23:44:48.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb481400640 1 -- 172.21.15.137:0/1562452685 learned_addr learned my addr 172.21.15.137:0/1562452685 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:48.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb482800640 1 --2- 172.21.15.137:0/1562452685 >> v2:172.21.15.170:3300/0 conn(0x7fb4840aeda0 0x7fb4841615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:48.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb480a00640 1 -- 172.21.15.137:0/1562452685 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 127952482 0 0) 0x7fb4840b0820 con 0x7fb48406db20 2024-04-26T23:44:48.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb480a00640 1 -- 172.21.15.137:0/1562452685 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb468003530 con 0x7fb48406db20 2024-04-26T23:44:48.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb480a00640 1 -- 172.21.15.137:0/1562452685 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 794456726 0 0) 0x7fb4840b0ac0 con 0x7fb4841467e0 2024-04-26T23:44:48.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb480a00640 1 -- 172.21.15.137:0/1562452685 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4840b0820 con 0x7fb4841467e0 2024-04-26T23:44:48.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb480a00640 1 -- 172.21.15.137:0/1562452685 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3030015857 0 0) 0x7fb468003530 con 0x7fb48406db20 2024-04-26T23:44:48.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb480a00640 1 -- 172.21.15.137:0/1562452685 >> v2:172.21.15.170:3300/0 conn(0x7fb4840aeda0 msgr2=0x7fb4841615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:48.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb480a00640 1 --2- 172.21.15.137:0/1562452685 >> v2:172.21.15.170:3300/0 conn(0x7fb4840aeda0 0x7fb4841615f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:48.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb480a00640 1 -- 172.21.15.137:0/1562452685 >> v1:172.21.15.170:6789/0 conn(0x7fb4841467e0 legacy=0x7fb48406d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:48.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb480a00640 1 -- 172.21.15.137:0/1562452685 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4840b0da0 con 0x7fb48406db20 2024-04-26T23:44:48.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb482800640 1 --2- 172.21.15.137:0/1562452685 >> v2:172.21.15.170:3300/0 conn(0x7fb4840aeda0 0x7fb4841615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:44:48.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb480a00640 1 -- 172.21.15.137:0/1562452685 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fb4700016a0 con 0x7fb48406db20 2024-04-26T23:44:48.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb480a00640 1 -- 172.21.15.137:0/1562452685 >> v1:172.21.15.137:6789/0 conn(0x7fb48406db20 legacy=0x7fb4840b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:48.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb480a00640 1 --2- 172.21.15.137:0/1562452685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb468003b50 0x7fb468003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:48.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb480a00640 1 --2- 172.21.15.137:0/1562452685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb468004810 0x7fb468004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:48.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb480a00640 1 --2- 172.21.15.137:0/1562452685 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4680051d0 0x7fb46800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:48.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb480a00640 1 -- 172.21.15.137:0/1562452685 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb4840b1880 con 0x7fb468003b50 2024-04-26T23:44:48.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb480a00640 1 -- 172.21.15.137:0/1562452685 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb46800bfc0 con 0x7fb468004810 2024-04-26T23:44:48.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb480a00640 1 -- 172.21.15.137:0/1562452685 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb46800c1c0 con 0x7fb4680051d0 2024-04-26T23:44:48.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb481e00640 1 --2- 172.21.15.137:0/1562452685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb468003b50 0x7fb468003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:48.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb481400640 1 --2- 172.21.15.137:0/1562452685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb468004810 0x7fb468004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:48.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb482800640 1 --2- 172.21.15.137:0/1562452685 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4680051d0 0x7fb46800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:48.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb481e00640 1 -- 172.21.15.137:0/1562452685 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4680051d0 msgr2=0x7fb46800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:48.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb481e00640 1 --2- 172.21.15.137:0/1562452685 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4680051d0 0x7fb46800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:48.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb481e00640 1 -- 172.21.15.137:0/1562452685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb468004810 msgr2=0x7fb468004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:48.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb481e00640 1 --2- 172.21.15.137:0/1562452685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb468004810 0x7fb468004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:48.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb481e00640 1 -- 172.21.15.137:0/1562452685 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb468003530 con 0x7fb468003b50 2024-04-26T23:44:48.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.273+0000 7fb482800640 1 -- 172.21.15.137:0/1562452685 reap_dead start 2024-04-26T23:44:48.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.277+0000 7fb481e00640 1 --2- 172.21.15.137:0/1562452685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb468003b50 0x7fb468003f50 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fb474007fd0 tx=0x7fb47401eff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91aac67e7f27d3f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:48.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.277+0000 7fb480a00640 1 -- 172.21.15.137:0/1562452685 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb474001c20 con 0x7fb468003b50 2024-04-26T23:44:48.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.277+0000 7fb480a00640 1 -- 172.21.15.137:0/1562452685 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4740a8c30 con 0x7fb468003b50 2024-04-26T23:44:48.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.277+0000 7fb480a00640 1 -- 172.21.15.137:0/1562452685 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb474003980 con 0x7fb468003b50 2024-04-26T23:44:48.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.277+0000 7fb488e00640 1 -- 172.21.15.137:0/1562452685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb468003b50 msgr2=0x7fb468003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:48.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.277+0000 7fb488e00640 1 --2- 172.21.15.137:0/1562452685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb468003b50 0x7fb468003f50 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fb474007fd0 tx=0x7fb47401eff0 comp rx=0 tx=0).stop 2024-04-26T23:44:48.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.277+0000 7fb488e00640 1 -- 172.21.15.137:0/1562452685 shutdown_connections 2024-04-26T23:44:48.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.277+0000 7fb488e00640 1 --2- 172.21.15.137:0/1562452685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb468003b50 0x7fb468003f50 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:48.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.277+0000 7fb488e00640 1 -- 172.21.15.137:0/1562452685 >> 172.21.15.137:0/1562452685 conn(0x7fb484073210 msgr2=0x7fb484073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:48.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.277+0000 7fb488e00640 1 -- 172.21.15.137:0/1562452685 shutdown_connections 2024-04-26T23:44:48.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.277+0000 7fb488e00640 1 -- 172.21.15.137:0/1562452685 wait complete. 2024-04-26T23:44:48.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb488e00640 1 Processor -- start 2024-04-26T23:44:48.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb488e00640 1 -- start start 2024-04-26T23:44:48.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb488e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb468003b50 0x7fb484070a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:48.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb488e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4841e6510 0x7fb4841e7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:48.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb488e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4841e8c80 0x7fb48415fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:48.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb488e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb4840b1360 con 0x7fb4841e8c80 2024-04-26T23:44:48.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb488e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb4840af3f0 con 0x7fb4841e6510 2024-04-26T23:44:48.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb488e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb484146bc0 con 0x7fb468003b50 2024-04-26T23:44:48.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb482800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4841e8c80 0x7fb48415fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:48.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb482800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4841e8c80 0x7fb48415fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41232/0 (socket says 172.21.15.137:41232) 2024-04-26T23:44:48.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb482800640 1 -- 172.21.15.137:0/2396452012 learned_addr learned my addr 172.21.15.137:0/2396452012 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:48.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb481e00640 1 --2- 172.21.15.137:0/2396452012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb468003b50 0x7fb484070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:48.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb481400640 1 --2- 172.21.15.137:0/2396452012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4841e6510 0x7fb4841e7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:48.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb482800640 1 -- 172.21.15.137:0/2396452012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb468003b50 msgr2=0x7fb484070a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:48.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb482800640 1 --2- 172.21.15.137:0/2396452012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb468003b50 0x7fb484070a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:48.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb482800640 1 -- 172.21.15.137:0/2396452012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4841e6510 msgr2=0x7fb4841e7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:48.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb482800640 1 --2- 172.21.15.137:0/2396452012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4841e6510 0x7fb4841e7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:48.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb482800640 1 -- 172.21.15.137:0/2396452012 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4841e6a80 con 0x7fb4841e8c80 2024-04-26T23:44:48.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb481400640 1 --2- 172.21.15.137:0/2396452012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4841e6510 0x7fb4841e7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:48.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb481e00640 1 --2- 172.21.15.137:0/2396452012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb468003b50 0x7fb484070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:48.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb482800640 1 --2- 172.21.15.137:0/2396452012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4841e8c80 0x7fb48415fb90 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb4840b7480 tx=0x7fb47c011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:48.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb47a000640 1 -- 172.21.15.137:0/2396452012 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c00fb30 con 0x7fb4841e8c80 2024-04-26T23:44:48.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb47a000640 1 -- 172.21.15.137:0/2396452012 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb47c00fcd0 con 0x7fb4841e8c80 2024-04-26T23:44:48.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb488e00640 1 -- 172.21.15.137:0/2396452012 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4841e6d60 con 0x7fb4841e8c80 2024-04-26T23:44:48.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb47a000640 1 -- 172.21.15.137:0/2396452012 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c004020 con 0x7fb4841e8c80 2024-04-26T23:44:48.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb488e00640 1 -- 172.21.15.137:0/2396452012 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4841e7320 con 0x7fb4841e8c80 2024-04-26T23:44:48.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.281+0000 7fb488e00640 1 -- 172.21.15.137:0/2396452012 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb48406a4b0 con 0x7fb4841e8c80 2024-04-26T23:44:48.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.285+0000 7fb47a000640 1 -- 172.21.15.137:0/2396452012 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb47c01e020 con 0x7fb4841e8c80 2024-04-26T23:44:48.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.285+0000 7fb47a000640 1 --2- 172.21.15.137:0/2396452012 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb4640683b0 0x7fb46406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:48.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.285+0000 7fb47a000640 1 -- 172.21.15.137:0/2396452012 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fb47c086630 con 0x7fb4841e8c80 2024-04-26T23:44:48.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.285+0000 7fb481e00640 1 --2- 172.21.15.137:0/2396452012 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb4640683b0 0x7fb46406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:48.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.285+0000 7fb481e00640 1 --2- 172.21.15.137:0/2396452012 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb4640683b0 0x7fb46406a870 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb474007fd0 tx=0x7fb4740aa070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:48.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.289+0000 7fb47a000640 1 -- 172.21.15.137:0/2396452012 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb47c01e310 con 0x7fb4841e8c80 2024-04-26T23:44:48.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.457+0000 7fb488e00640 1 -- 172.21.15.137:0/2396452012 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb484160fe0 con 0x7fb4841e8c80 2024-04-26T23:44:48.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.457+0000 7fb47a000640 1 -- 172.21.15.137:0/2396452012 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v60) ==== 80+0+0 (secure 0 0 0) 0x7fb47c056be0 con 0x7fb4841e8c80 2024-04-26T23:44:48.460 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T23:44:48.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.457+0000 7fb488e00640 1 -- 172.21.15.137:0/2396452012 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb4640683b0 msgr2=0x7fb46406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:48.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.457+0000 7fb488e00640 1 --2- 172.21.15.137:0/2396452012 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb4640683b0 0x7fb46406a870 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb474007fd0 tx=0x7fb4740aa070 comp rx=0 tx=0).stop 2024-04-26T23:44:48.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.457+0000 7fb488e00640 1 -- 172.21.15.137:0/2396452012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4841e8c80 msgr2=0x7fb48415fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:48.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.457+0000 7fb488e00640 1 --2- 172.21.15.137:0/2396452012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4841e8c80 0x7fb48415fb90 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb4840b7480 tx=0x7fb47c011e30 comp rx=0 tx=0).stop 2024-04-26T23:44:48.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.457+0000 7fb488e00640 1 -- 172.21.15.137:0/2396452012 shutdown_connections 2024-04-26T23:44:48.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.457+0000 7fb488e00640 1 --2- 172.21.15.137:0/2396452012 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fb4640683b0 0x7fb46406a870 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:48.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.457+0000 7fb488e00640 1 --2- 172.21.15.137:0/2396452012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4841e8c80 0x7fb48415fb90 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:48.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.457+0000 7fb488e00640 1 --2- 172.21.15.137:0/2396452012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4841e6510 0x7fb4841e7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:48.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.457+0000 7fb488e00640 1 --2- 172.21.15.137:0/2396452012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb468003b50 0x7fb484070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:48.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.457+0000 7fb488e00640 1 -- 172.21.15.137:0/2396452012 >> 172.21.15.137:0/2396452012 conn(0x7fb484073210 msgr2=0x7fb48415d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:48.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.457+0000 7fb488e00640 1 -- 172.21.15.137:0/2396452012 shutdown_connections 2024-04-26T23:44:48.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:48.457+0000 7fb488e00640 1 -- 172.21.15.137:0/2396452012 wait complete. 2024-04-26T23:44:48.481 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi170.front.sepia.ceph.com... 2024-04-26T23:44:48.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:48.482 DEBUG:teuthology.orchestra.run.smithi170:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-04-26T23:44:48.502 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:ceph-fuse[32774]: fuse finished with error 0 and tester_r 0 2024-04-26T23:44:48.504 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:44:48.847 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:44:48.850 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:44:54.606 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T23:44:54.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:54.607 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-26T23:44:54.617 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.badguy mds 'allow rw path=/foo/bar' osd 'allow rw' mon 'allow r' 2024-04-26T23:44:54.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.765+0000 7fe5e7800640 1 Processor -- start 2024-04-26T23:44:54.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.765+0000 7fe5e7800640 1 -- start start 2024-04-26T23:44:54.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.765+0000 7fe5e7800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5e00b54e0 0x7fe5e00b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:54.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.765+0000 7fe5e7800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe5e00cd710 0x7fe5e015f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:54.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.765+0000 7fe5e7800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5e0160250 con 0x7fe5e015fe30 2024-04-26T23:44:54.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.765+0000 7fe5e7800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe5e00b3d90 con 0x7fe5e00cd710 2024-04-26T23:44:54.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.765+0000 7fe5e7800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe5e00d0840 con 0x7fe5e00b54e0 2024-04-26T23:44:54.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.765+0000 7fe5e5800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fe5e015fe30 0x7fe5e0144d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46958/0 (socket says 172.21.15.137:46958) 2024-04-26T23:44:54.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.765+0000 7fe5e5800640 1 -- 172.21.15.137:0/4143118539 learned_addr learned my addr 172.21.15.137:0/4143118539 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:54.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5e4e00640 1 --2- 172.21.15.137:0/4143118539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5e00b54e0 0x7fe5e00b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:54.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5dfe00640 1 -- 172.21.15.137:0/4143118539 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 88644659 0 0) 0x7fe5e0160250 con 0x7fe5e015fe30 2024-04-26T23:44:54.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5d7e00640 1 --2- 172.21.15.137:0/4143118539 >> v2:172.21.15.170:3300/0 conn(0x7fe5e00cd710 0x7fe5e015f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:54.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5dfe00640 1 -- 172.21.15.137:0/4143118539 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5c4003530 con 0x7fe5e015fe30 2024-04-26T23:44:54.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5dfe00640 1 -- 172.21.15.137:0/4143118539 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2404291753 0 0) 0x7fe5c4003530 con 0x7fe5e015fe30 2024-04-26T23:44:54.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5dfe00640 1 -- 172.21.15.137:0/4143118539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5e00b54e0 msgr2=0x7fe5e00b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:54.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5dfe00640 1 --2- 172.21.15.137:0/4143118539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5e00b54e0 0x7fe5e00b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:54.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5dfe00640 1 -- 172.21.15.137:0/4143118539 >> v2:172.21.15.170:3300/0 conn(0x7fe5e00cd710 msgr2=0x7fe5e015f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:54.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5dfe00640 1 --2- 172.21.15.137:0/4143118539 >> v2:172.21.15.170:3300/0 conn(0x7fe5e00cd710 0x7fe5e015f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:54.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5dfe00640 1 -- 172.21.15.137:0/4143118539 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e00cffa0 con 0x7fe5e015fe30 2024-04-26T23:44:54.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5dfe00640 1 -- 172.21.15.137:0/4143118539 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fe5d8001a00 con 0x7fe5e015fe30 2024-04-26T23:44:54.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5dfe00640 1 -- 172.21.15.137:0/4143118539 >> v1:172.21.15.137:6789/0 conn(0x7fe5e015fe30 legacy=0x7fe5e0144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:54.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5dfe00640 1 --2- 172.21.15.137:0/4143118539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5e00b54e0 0x7fe5c40039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:54.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5dfe00640 1 --2- 172.21.15.137:0/4143118539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5c4003f70 0x7fe5c4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:54.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5dfe00640 1 --2- 172.21.15.137:0/4143118539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5c4004d50 0x7fe5c40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:54.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5dfe00640 1 -- 172.21.15.137:0/4143118539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e00d0840 con 0x7fe5c4003f70 2024-04-26T23:44:54.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5dfe00640 1 -- 172.21.15.137:0/4143118539 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c400b9d0 con 0x7fe5c4004d50 2024-04-26T23:44:54.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5dfe00640 1 -- 172.21.15.137:0/4143118539 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe5c400bb50 con 0x7fe5e00b54e0 2024-04-26T23:44:54.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5d7e00640 1 --2- 172.21.15.137:0/4143118539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5c4003f70 0x7fe5c4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:54.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5e4e00640 1 --2- 172.21.15.137:0/4143118539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5e00b54e0 0x7fe5c40039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:54.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5e5800640 1 --2- 172.21.15.137:0/4143118539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5c4004d50 0x7fe5c40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:54.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5d7e00640 1 -- 172.21.15.137:0/4143118539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5e00b54e0 msgr2=0x7fe5c40039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:54.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5d7e00640 1 --2- 172.21.15.137:0/4143118539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5e00b54e0 0x7fe5c40039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:54.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5d7e00640 1 -- 172.21.15.137:0/4143118539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5c4004d50 msgr2=0x7fe5c40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:54.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5d7e00640 1 --2- 172.21.15.137:0/4143118539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5c4004d50 0x7fe5c40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:54.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.769+0000 7fe5d7e00640 1 -- 172.21.15.137:0/4143118539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c4003530 con 0x7fe5c4003f70 2024-04-26T23:44:54.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.773+0000 7fe5d7e00640 1 --2- 172.21.15.137:0/4143118539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5c4003f70 0x7fe5c4004810 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8009ae0 tx=0x7fe5c801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f214d1b6a158ccb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:54.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.773+0000 7fe5dfe00640 1 -- 172.21.15.137:0/4143118539 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c80b2070 con 0x7fe5c4003f70 2024-04-26T23:44:54.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.773+0000 7fe5dfe00640 1 -- 172.21.15.137:0/4143118539 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c80a5590 con 0x7fe5c4003f70 2024-04-26T23:44:54.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.773+0000 7fe5dfe00640 1 -- 172.21.15.137:0/4143118539 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c80096b0 con 0x7fe5c4003f70 2024-04-26T23:44:54.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.773+0000 7fe5e7800640 1 -- 172.21.15.137:0/4143118539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5c4003f70 msgr2=0x7fe5c4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:54.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.773+0000 7fe5e7800640 1 --2- 172.21.15.137:0/4143118539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5c4003f70 0x7fe5c4004810 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8009ae0 tx=0x7fe5c801cab0 comp rx=0 tx=0).stop 2024-04-26T23:44:54.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.773+0000 7fe5e5800640 1 -- 172.21.15.137:0/4143118539 reap_dead start 2024-04-26T23:44:54.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.773+0000 7fe5e7800640 1 -- 172.21.15.137:0/4143118539 shutdown_connections 2024-04-26T23:44:54.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.773+0000 7fe5e7800640 1 -- 172.21.15.137:0/4143118539 >> 172.21.15.137:0/4143118539 conn(0x7fe5e006c800 msgr2=0x7fe5e006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:54.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.773+0000 7fe5e7800640 1 -- 172.21.15.137:0/4143118539 shutdown_connections 2024-04-26T23:44:54.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.773+0000 7fe5e7800640 1 -- 172.21.15.137:0/4143118539 wait complete. 2024-04-26T23:44:54.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.773+0000 7fe5e7800640 1 Processor -- start 2024-04-26T23:44:54.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.773+0000 7fe5e7800640 1 -- start start 2024-04-26T23:44:54.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.773+0000 7fe5e7800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5c4003f70 0x7fe5e013c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:54.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.773+0000 7fe5e7800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5e006ef60 0x7fe5e006f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:54.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.773+0000 7fe5e7800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5e015e950 0x7fe5e015edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:54.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.773+0000 7fe5e7800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e00b58c0 con 0x7fe5c4003f70 2024-04-26T23:44:54.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.773+0000 7fe5e7800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e00d0560 con 0x7fe5e006ef60 2024-04-26T23:44:54.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.773+0000 7fe5e7800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe5e00cded0 con 0x7fe5e015e950 2024-04-26T23:44:54.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.777+0000 7fe5e4e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5c4003f70 0x7fe5e013c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:54.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.777+0000 7fe5e4e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5c4003f70 0x7fe5e013c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38508/0 (socket says 172.21.15.137:38508) 2024-04-26T23:44:54.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.777+0000 7fe5e4e00640 1 -- 172.21.15.137:0/615241985 learned_addr learned my addr 172.21.15.137:0/615241985 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:54.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.777+0000 7fe5e5800640 1 --2- 172.21.15.137:0/615241985 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5e015e950 0x7fe5e015edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:54.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.777+0000 7fe5d7e00640 1 --2- 172.21.15.137:0/615241985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5e006ef60 0x7fe5e006f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:54.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.777+0000 7fe5e4e00640 1 -- 172.21.15.137:0/615241985 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5e015e950 msgr2=0x7fe5e015edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:54.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.777+0000 7fe5e4e00640 1 --2- 172.21.15.137:0/615241985 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5e015e950 0x7fe5e015edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:54.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.777+0000 7fe5e4e00640 1 -- 172.21.15.137:0/615241985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5e006ef60 msgr2=0x7fe5e006f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:54.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.777+0000 7fe5e4e00640 1 --2- 172.21.15.137:0/615241985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5e006ef60 0x7fe5e006f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:54.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.777+0000 7fe5e4e00640 1 -- 172.21.15.137:0/615241985 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e00ad6c0 con 0x7fe5c4003f70 2024-04-26T23:44:54.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.777+0000 7fe5e4e00640 1 --2- 172.21.15.137:0/615241985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5c4003f70 0x7fe5e013c500 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0011a00 tx=0x7fe5d0011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:54.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.777+0000 7fe5dd600640 1 -- 172.21.15.137:0/615241985 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d000faf0 con 0x7fe5c4003f70 2024-04-26T23:44:54.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.777+0000 7fe5dd600640 1 -- 172.21.15.137:0/615241985 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5d000fc90 con 0x7fe5c4003f70 2024-04-26T23:44:54.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.777+0000 7fe5e7800640 1 -- 172.21.15.137:0/615241985 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5e00ad9a0 con 0x7fe5c4003f70 2024-04-26T23:44:54.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.777+0000 7fe5dd600640 1 -- 172.21.15.137:0/615241985 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0014440 con 0x7fe5c4003f70 2024-04-26T23:44:54.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.777+0000 7fe5e7800640 1 -- 172.21.15.137:0/615241985 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5e00adf60 con 0x7fe5c4003f70 2024-04-26T23:44:54.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.777+0000 7fe5e7800640 1 -- 172.21.15.137:0/615241985 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5e006f920 con 0x7fe5c4003f70 2024-04-26T23:44:54.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.777+0000 7fe5dd600640 1 -- 172.21.15.137:0/615241985 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe5d0012040 con 0x7fe5c4003f70 2024-04-26T23:44:54.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.781+0000 7fe5dd600640 1 --2- 172.21.15.137:0/615241985 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe5bc068380 0x7fe5bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:54.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.781+0000 7fe5dd600640 1 -- 172.21.15.137:0/615241985 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fe5d0086ff0 con 0x7fe5c4003f70 2024-04-26T23:44:54.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.781+0000 7fe5d7e00640 1 --2- 172.21.15.137:0/615241985 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe5bc068380 0x7fe5bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:54.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.781+0000 7fe5d7e00640 1 --2- 172.21.15.137:0/615241985 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe5bc068380 0x7fe5bc06a840 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80af000 tx=0x7fe5c80046d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:54.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.785+0000 7fe5dd600640 1 -- 172.21.15.137:0/615241985 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe5d0019030 con 0x7fe5c4003f70 2024-04-26T23:44:55.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:54.997+0000 7fe5e7800640 1 -- 172.21.15.137:0/615241985 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.badguy", "caps": ["mds", "allow rw path=/foo/bar", "osd", "allow rw", "mon", "allow r"]} v 0) -- 0x7fe5e00b3560 con 0x7fe5c4003f70 2024-04-26T23:44:55.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.001+0000 7fe5dd600640 1 -- 172.21.15.137:0/615241985 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.badguy", "caps": ["mds", "allow rw path=/foo/bar", "osd", "allow rw", "mon", "allow r"]}]=0 v15) ==== 173+0+64 (secure 0 0 0) 0x7fe5d0057610 con 0x7fe5c4003f70 2024-04-26T23:44:55.004 INFO:teuthology.orchestra.run.smithi137.stdout:[client.badguy] 2024-04-26T23:44:55.004 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQB2PCxmwDmHOxAAeQMaXUmTc1nsT7kkpSPvPQ== 2024-04-26T23:44:55.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.001+0000 7fe5e7800640 1 -- 172.21.15.137:0/615241985 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe5bc068380 msgr2=0x7fe5bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:55.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.001+0000 7fe5e7800640 1 --2- 172.21.15.137:0/615241985 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe5bc068380 0x7fe5bc06a840 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80af000 tx=0x7fe5c80046d0 comp rx=0 tx=0).stop 2024-04-26T23:44:55.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.001+0000 7fe5e7800640 1 -- 172.21.15.137:0/615241985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5c4003f70 msgr2=0x7fe5e013c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:55.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.001+0000 7fe5e7800640 1 --2- 172.21.15.137:0/615241985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5c4003f70 0x7fe5e013c500 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0011a00 tx=0x7fe5d0011ec0 comp rx=0 tx=0).stop 2024-04-26T23:44:55.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.001+0000 7fe5e7800640 1 -- 172.21.15.137:0/615241985 shutdown_connections 2024-04-26T23:44:55.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.001+0000 7fe5e7800640 1 --2- 172.21.15.137:0/615241985 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fe5bc068380 0x7fe5bc06a840 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:55.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.001+0000 7fe5e7800640 1 --2- 172.21.15.137:0/615241985 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5e015e950 0x7fe5e015edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:55.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.001+0000 7fe5e7800640 1 --2- 172.21.15.137:0/615241985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5e006ef60 0x7fe5e006f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:55.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.001+0000 7fe5e7800640 1 --2- 172.21.15.137:0/615241985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5c4003f70 0x7fe5e013c500 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:55.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.001+0000 7fe5e7800640 1 -- 172.21.15.137:0/615241985 >> 172.21.15.137:0/615241985 conn(0x7fe5e006c800 msgr2=0x7fe5e00b0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:55.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.001+0000 7fe5e7800640 1 -- 172.21.15.137:0/615241985 shutdown_connections 2024-04-26T23:44:55.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.001+0000 7fe5e7800640 1 -- 172.21.15.137:0/615241985 wait complete. 2024-04-26T23:44:55.026 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:44:55.026 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.client.badguy.keyring 2024-04-26T23:44:55.049 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T23:44:55.052 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T23:44:55.096 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2024-04-26T23:44:55.096 INFO:teuthology.orchestra.run.smithi137.stdout: chdir = "" 2024-04-26T23:44:55.096 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T23:44:55.096 INFO:teuthology.orchestra.run.smithi137.stdout: auth supported = cephx 2024-04-26T23:44:55.096 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.096 INFO:teuthology.orchestra.run.smithi137.stdout: filestore xattr use omap = true 2024-04-26T23:44:55.096 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.096 INFO:teuthology.orchestra.run.smithi137.stdout: mon clock drift allowed = 1.000 2024-04-26T23:44:55.096 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.096 INFO:teuthology.orchestra.run.smithi137.stdout: osd crush chooseleaf type = 0 2024-04-26T23:44:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: auth debug = true 2024-04-26T23:44:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on old message = true 2024-04-26T23:44:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on bug = true 2024-04-26T23:44:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T23:44:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: mon pg warn max object skew = 0 2024-04-26T23:44:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T23:44:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T23:44:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default size = 2 2024-04-26T23:44:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow primary affinity = true 2024-04-26T23:44:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow pg remap = true 2024-04-26T23:44:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on legacy crush tunables = false 2024-04-26T23:44:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on crush straw calc version zero = false 2024-04-26T23:44:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on no sortbitwise = false 2024-04-26T23:44:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on osd down out interval zero = false 2024-04-26T23:44:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on too few osds = false 2024-04-26T23:44:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T23:44:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T23:44:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: mon_allow_pool_size_one = true 2024-04-26T23:44:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T23:44:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: osd default data pool replay window = 5 2024-04-26T23:44:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: mon allow pool delete = true 2024-04-26T23:44:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: mon cluster log file level = debug 2024-04-26T23:44:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: debug asserts on shutdown = true 2024-04-26T23:44:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: mon health detail to clog = false 2024-04-26T23:44:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: mon host = "172.21.15.137,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]" 2024-04-26T23:44:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = efde6204-be0d-4c4f-9ea0-954d26627e78 2024-04-26T23:44:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.099 INFO:teuthology.orchestra.run.smithi137.stdout:[osd] 2024-04-26T23:44:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: osd journal size = 100 2024-04-26T23:44:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub load threshold = 5.0 2024-04-26T23:44:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub max interval = 600 2024-04-26T23:44:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: osd mclock profile = high_recovery_ops 2024-04-26T23:44:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: osd recover clone overlap = true 2024-04-26T23:44:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: osd recovery max chunk = 1048576 2024-04-26T23:44:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug shutdown = true 2024-04-26T23:44:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug op order = true 2024-04-26T23:44:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify stray on activate = true 2024-04-26T23:44:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug trim objects = true 2024-04-26T23:44:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: osd open classes on start = true 2024-04-26T23:44:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug pg log writeout = true 2024-04-26T23:44:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: osd deep scrub update digest min age = 30 2024-04-26T23:44:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: osd map max advance = 10 2024-04-26T23:44:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: journal zero on create = true 2024-04-26T23:44:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: filestore ondisk finisher threads = 3 2024-04-26T23:44:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: filestore apply finisher threads = 3 2024-04-26T23:44:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: bdev debug aio = true 2024-04-26T23:44:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug misdirected ops = true 2024-04-26T23:44:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: bdev async discard = True 2024-04-26T23:44:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: bdev enable discard = True 2024-04-26T23:44:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore allocator = bitmap 2024-04-26T23:44:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore block size = 96636764160 2024-04-26T23:44:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore fsck on mount = True 2024-04-26T23:44:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluefs = 1/20 2024-04-26T23:44:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluestore = 1/20 2024-04-26T23:44:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T23:44:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: debug osd = 20 2024-04-26T23:44:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: debug rocksdb = 4/10 2024-04-26T23:44:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T23:44:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd full ratio = 0.9 2024-04-26T23:44:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd nearfull ratio = 0.8 2024-04-26T23:44:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: osd failsafe full ratio = 0.95 2024-04-26T23:44:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: osd objectstore = bluestore 2024-04-26T23:44:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-04-26T23:44:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.103 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr] 2024-04-26T23:44:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T23:44:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: debug mgr = 20 2024-04-26T23:44:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-04-26T23:44:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-04-26T23:44:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:44:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:44:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: mgr/telemetry/nag = false 2024-04-26T23:44:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-04-26T23:44:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.104 INFO:teuthology.orchestra.run.smithi137.stdout:[mon] 2024-04-26T23:44:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T23:44:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-04-26T23:44:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: debug paxos = 20 2024-04-26T23:44:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-04-26T23:44:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: mon data avail warn = 5 2024-04-26T23:44:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: mon mgr mkfs grace = 240 2024-04-26T23:44:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:44:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd reporter subtree level = osd 2024-04-26T23:44:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd prime pg temp = true 2024-04-26T23:44:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:44:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T23:44:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T23:44:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T23:44:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T23:44:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T23:44:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T23:44:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: # 1m isn't quite enough 2024-04-26T23:44:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: mon_down_mkfs_grace = 2m 2024-04-26T23:44:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_filestore_osds = false 2024-04-26T23:44:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: mon down mkfs grace = 300 2024-04-26T23:44:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: mon op complaint time = 120 2024-04-26T23:44:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:55.106 INFO:teuthology.orchestra.run.smithi137.stdout:[client] 2024-04-26T23:44:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: rgw cache enabled = true 2024-04-26T23:44:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable ops log = true 2024-04-26T23:44:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable usage log = true 2024-04-26T23:44:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T23:44:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T23:44:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: client mount timeout = 600 2024-04-26T23:44:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-04-26T23:44:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T23:44:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = "" 2024-04-26T23:44:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-04-26T23:44:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-04-26T23:44:55.106 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.a] 2024-04-26T23:44:55.106 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.b] 2024-04-26T23:44:55.106 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.c] 2024-04-26T23:44:55.107 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2024-04-26T23:44:55.107 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2024-04-26T23:44:55.107 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2024-04-26T23:44:55.107 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d] 2024-04-26T23:44:55.107 INFO:teuthology.orchestra.run.smithi137.stdout:[mds] 2024-04-26T23:44:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds = 20 2024-04-26T23:44:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds balancer = 20 2024-04-26T23:44:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T23:44:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug frag = True 2024-04-26T23:44:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug scatterstat = True 2024-04-26T23:44:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: mds op complaint time = 180 2024-04-26T23:44:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: mds verify scatter = True 2024-04-26T23:44:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-04-26T23:44:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-04-26T23:44:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-04-26T23:44:55.108 INFO:teuthology.orchestra.run.smithi137.stdout:[client.badguy] 2024-04-26T23:44:55.108 INFO:teuthology.orchestra.run.smithi137.stdout: keyring = /etc/ceph/ceph.client.badguy.keyring 2024-04-26T23:44:55.138 INFO:teuthology.orchestra.run.smithi170.stdout:[global] 2024-04-26T23:44:55.138 INFO:teuthology.orchestra.run.smithi170.stdout: chdir = "" 2024-04-26T23:44:55.138 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T23:44:55.138 INFO:teuthology.orchestra.run.smithi170.stdout: auth supported = cephx 2024-04-26T23:44:55.138 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.139 INFO:teuthology.orchestra.run.smithi170.stdout: filestore xattr use omap = true 2024-04-26T23:44:55.139 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.139 INFO:teuthology.orchestra.run.smithi170.stdout: mon clock drift allowed = 1.000 2024-04-26T23:44:55.139 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.139 INFO:teuthology.orchestra.run.smithi170.stdout: osd crush chooseleaf type = 0 2024-04-26T23:44:55.139 INFO:teuthology.orchestra.run.smithi170.stdout: auth debug = true 2024-04-26T23:44:55.139 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.139 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on old message = true 2024-04-26T23:44:55.139 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on bug = true 2024-04-26T23:44:55.139 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.139 INFO:teuthology.orchestra.run.smithi170.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T23:44:55.140 INFO:teuthology.orchestra.run.smithi170.stdout: mon pg warn max object skew = 0 2024-04-26T23:44:55.140 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.140 INFO:teuthology.orchestra.run.smithi170.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T23:44:55.140 INFO:teuthology.orchestra.run.smithi170.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T23:44:55.140 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.140 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default size = 2 2024-04-26T23:44:55.140 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.140 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow primary affinity = true 2024-04-26T23:44:55.140 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow pg remap = true 2024-04-26T23:44:55.140 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on legacy crush tunables = false 2024-04-26T23:44:55.141 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on crush straw calc version zero = false 2024-04-26T23:44:55.141 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on no sortbitwise = false 2024-04-26T23:44:55.141 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on osd down out interval zero = false 2024-04-26T23:44:55.141 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on too few osds = false 2024-04-26T23:44:55.141 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T23:44:55.142 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T23:44:55.142 INFO:teuthology.orchestra.run.smithi170.stdout: mon_allow_pool_size_one = true 2024-04-26T23:44:55.142 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.142 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T23:44:55.142 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.142 INFO:teuthology.orchestra.run.smithi170.stdout: osd default data pool replay window = 5 2024-04-26T23:44:55.142 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.142 INFO:teuthology.orchestra.run.smithi170.stdout: mon allow pool delete = true 2024-04-26T23:44:55.142 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.143 INFO:teuthology.orchestra.run.smithi170.stdout: mon cluster log file level = debug 2024-04-26T23:44:55.143 INFO:teuthology.orchestra.run.smithi170.stdout: debug asserts on shutdown = true 2024-04-26T23:44:55.143 INFO:teuthology.orchestra.run.smithi170.stdout: mon health detail to clog = false 2024-04-26T23:44:55.143 INFO:teuthology.orchestra.run.smithi170.stdout: mon host = "172.21.15.137,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]" 2024-04-26T23:44:55.143 INFO:teuthology.orchestra.run.smithi170.stdout: fsid = efde6204-be0d-4c4f-9ea0-954d26627e78 2024-04-26T23:44:55.143 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.143 INFO:teuthology.orchestra.run.smithi170.stdout:[osd] 2024-04-26T23:44:55.143 INFO:teuthology.orchestra.run.smithi170.stdout: osd journal size = 100 2024-04-26T23:44:55.143 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.143 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub load threshold = 5.0 2024-04-26T23:44:55.143 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub max interval = 600 2024-04-26T23:44:55.143 INFO:teuthology.orchestra.run.smithi170.stdout: osd mclock profile = high_recovery_ops 2024-04-26T23:44:55.143 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.143 INFO:teuthology.orchestra.run.smithi170.stdout: osd recover clone overlap = true 2024-04-26T23:44:55.143 INFO:teuthology.orchestra.run.smithi170.stdout: osd recovery max chunk = 1048576 2024-04-26T23:44:55.144 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.144 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug shutdown = true 2024-04-26T23:44:55.144 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug op order = true 2024-04-26T23:44:55.144 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug verify stray on activate = true 2024-04-26T23:44:55.144 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug trim objects = true 2024-04-26T23:44:55.144 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.144 INFO:teuthology.orchestra.run.smithi170.stdout: osd open classes on start = true 2024-04-26T23:44:55.144 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug pg log writeout = true 2024-04-26T23:44:55.144 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.144 INFO:teuthology.orchestra.run.smithi170.stdout: osd deep scrub update digest min age = 30 2024-04-26T23:44:55.144 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.144 INFO:teuthology.orchestra.run.smithi170.stdout: osd map max advance = 10 2024-04-26T23:44:55.144 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.144 INFO:teuthology.orchestra.run.smithi170.stdout: journal zero on create = true 2024-04-26T23:44:55.144 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.145 INFO:teuthology.orchestra.run.smithi170.stdout: filestore ondisk finisher threads = 3 2024-04-26T23:44:55.145 INFO:teuthology.orchestra.run.smithi170.stdout: filestore apply finisher threads = 3 2024-04-26T23:44:55.145 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.145 INFO:teuthology.orchestra.run.smithi170.stdout: bdev debug aio = true 2024-04-26T23:44:55.145 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug misdirected ops = true 2024-04-26T23:44:55.145 INFO:teuthology.orchestra.run.smithi170.stdout: bdev async discard = True 2024-04-26T23:44:55.145 INFO:teuthology.orchestra.run.smithi170.stdout: bdev enable discard = True 2024-04-26T23:44:55.145 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore allocator = bitmap 2024-04-26T23:44:55.145 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore block size = 96636764160 2024-04-26T23:44:55.145 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore fsck on mount = True 2024-04-26T23:44:55.145 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluefs = 1/20 2024-04-26T23:44:55.145 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluestore = 1/20 2024-04-26T23:44:55.145 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T23:44:55.145 INFO:teuthology.orchestra.run.smithi170.stdout: debug osd = 20 2024-04-26T23:44:55.145 INFO:teuthology.orchestra.run.smithi170.stdout: debug rocksdb = 4/10 2024-04-26T23:44:55.146 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T23:44:55.146 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd full ratio = 0.9 2024-04-26T23:44:55.146 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd nearfull ratio = 0.8 2024-04-26T23:44:55.146 INFO:teuthology.orchestra.run.smithi170.stdout: osd failsafe full ratio = 0.95 2024-04-26T23:44:55.146 INFO:teuthology.orchestra.run.smithi170.stdout: osd objectstore = bluestore 2024-04-26T23:44:55.146 INFO:teuthology.orchestra.run.smithi170.stdout: osd op complaint time = 180 2024-04-26T23:44:55.146 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.146 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr] 2024-04-26T23:44:55.146 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T23:44:55.146 INFO:teuthology.orchestra.run.smithi170.stdout: debug mgr = 20 2024-04-26T23:44:55.146 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-04-26T23:44:55.146 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-04-26T23:44:55.146 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:44:55.146 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:44:55.146 INFO:teuthology.orchestra.run.smithi170.stdout: mgr/telemetry/nag = false 2024-04-26T23:44:55.147 INFO:teuthology.orchestra.run.smithi170.stdout: debug client = 20 2024-04-26T23:44:55.147 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.147 INFO:teuthology.orchestra.run.smithi170.stdout:[mon] 2024-04-26T23:44:55.147 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T23:44:55.147 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-04-26T23:44:55.147 INFO:teuthology.orchestra.run.smithi170.stdout: debug paxos = 20 2024-04-26T23:44:55.147 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-04-26T23:44:55.147 INFO:teuthology.orchestra.run.smithi170.stdout: mon data avail warn = 5 2024-04-26T23:44:55.147 INFO:teuthology.orchestra.run.smithi170.stdout: mon mgr mkfs grace = 240 2024-04-26T23:44:55.147 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:44:55.147 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd reporter subtree level = osd 2024-04-26T23:44:55.148 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd prime pg temp = true 2024-04-26T23:44:55.148 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:44:55.148 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.148 INFO:teuthology.orchestra.run.smithi170.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T23:44:55.148 INFO:teuthology.orchestra.run.smithi170.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T23:44:55.148 INFO:teuthology.orchestra.run.smithi170.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T23:44:55.148 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.148 INFO:teuthology.orchestra.run.smithi170.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T23:44:55.148 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T23:44:55.148 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T23:44:55.148 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.148 INFO:teuthology.orchestra.run.smithi170.stdout: # 1m isn't quite enough 2024-04-26T23:44:55.148 INFO:teuthology.orchestra.run.smithi170.stdout: mon_down_mkfs_grace = 2m 2024-04-26T23:44:55.148 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.148 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_filestore_osds = false 2024-04-26T23:44:55.149 INFO:teuthology.orchestra.run.smithi170.stdout: mon down mkfs grace = 300 2024-04-26T23:44:55.149 INFO:teuthology.orchestra.run.smithi170.stdout: mon op complaint time = 120 2024-04-26T23:44:55.149 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:44:55.149 INFO:teuthology.orchestra.run.smithi170.stdout:[client] 2024-04-26T23:44:55.149 INFO:teuthology.orchestra.run.smithi170.stdout: rgw cache enabled = true 2024-04-26T23:44:55.149 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable ops log = true 2024-04-26T23:44:55.149 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable usage log = true 2024-04-26T23:44:55.149 INFO:teuthology.orchestra.run.smithi170.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T23:44:55.149 INFO:teuthology.orchestra.run.smithi170.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T23:44:55.149 INFO:teuthology.orchestra.run.smithi170.stdout: client mount timeout = 600 2024-04-26T23:44:55.149 INFO:teuthology.orchestra.run.smithi170.stdout: debug client = 20 2024-04-26T23:44:55.149 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T23:44:55.149 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = "" 2024-04-26T23:44:55.149 INFO:teuthology.orchestra.run.smithi170.stdout: rados mon op timeout = 900 2024-04-26T23:44:55.149 INFO:teuthology.orchestra.run.smithi170.stdout: rados osd op timeout = 900 2024-04-26T23:44:55.149 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.a] 2024-04-26T23:44:55.150 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.b] 2024-04-26T23:44:55.150 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.c] 2024-04-26T23:44:55.150 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.a] 2024-04-26T23:44:55.150 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.c] 2024-04-26T23:44:55.150 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.b] 2024-04-26T23:44:55.150 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.d] 2024-04-26T23:44:55.150 INFO:teuthology.orchestra.run.smithi170.stdout:[mds] 2024-04-26T23:44:55.150 INFO:teuthology.orchestra.run.smithi170.stdout: debug mds = 20 2024-04-26T23:44:55.150 INFO:teuthology.orchestra.run.smithi170.stdout: debug mds balancer = 20 2024-04-26T23:44:55.150 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T23:44:55.150 INFO:teuthology.orchestra.run.smithi170.stdout: mds debug frag = True 2024-04-26T23:44:55.150 INFO:teuthology.orchestra.run.smithi170.stdout: mds debug scatterstat = True 2024-04-26T23:44:55.150 INFO:teuthology.orchestra.run.smithi170.stdout: mds op complaint time = 180 2024-04-26T23:44:55.150 INFO:teuthology.orchestra.run.smithi170.stdout: mds verify scatter = True 2024-04-26T23:44:55.150 INFO:teuthology.orchestra.run.smithi170.stdout: osd op complaint time = 180 2024-04-26T23:44:55.151 INFO:teuthology.orchestra.run.smithi170.stdout: rados mon op timeout = 900 2024-04-26T23:44:55.151 INFO:teuthology.orchestra.run.smithi170.stdout: rados osd op timeout = 900 2024-04-26T23:44:55.151 INFO:teuthology.orchestra.run.smithi170.stdout:[client.badguy] 2024-04-26T23:44:55.151 INFO:teuthology.orchestra.run.smithi170.stdout: keyring = /etc/ceph/ceph.client.badguy.keyring 2024-04-26T23:44:55.154 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:44:55.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.285+0000 7fc817e00640 1 Processor -- start 2024-04-26T23:44:55.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc817e00640 1 -- start start 2024-04-26T23:44:55.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc817e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc8180d0f90 0x7fc8180cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:55.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc817e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8180cfc30 0x7fc81806d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:55.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc817e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8180d1420 con 0x7fc8180d1ee0 2024-04-26T23:44:55.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc817e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc8180d00a0 con 0x7fc8180d0f90 2024-04-26T23:44:55.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc817e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc81806d490 con 0x7fc8180cfc30 2024-04-26T23:44:55.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc816a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc8180d1ee0 0x7fc81806ee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46970/0 (socket says 172.21.15.137:46970) 2024-04-26T23:44:55.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc816a00640 1 -- 172.21.15.137:0/4156500542 learned_addr learned my addr 172.21.15.137:0/4156500542 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:55.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc815600640 1 -- 172.21.15.137:0/4156500542 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 210730163 0 0) 0x7fc8180d1420 con 0x7fc8180d1ee0 2024-04-26T23:44:55.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc816000640 1 --2- 172.21.15.137:0/4156500542 >> v2:172.21.15.170:3300/0 conn(0x7fc8180d0f90 0x7fc8180cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:55.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc817400640 1 --2- 172.21.15.137:0/4156500542 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8180cfc30 0x7fc81806d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:55.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc815600640 1 -- 172.21.15.137:0/4156500542 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7fc003530 con 0x7fc8180d1ee0 2024-04-26T23:44:55.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc815600640 1 -- 172.21.15.137:0/4156500542 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1864646781 0 0) 0x7fc7fc003530 con 0x7fc8180d1ee0 2024-04-26T23:44:55.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc815600640 1 -- 172.21.15.137:0/4156500542 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8180cfc30 msgr2=0x7fc81806d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:55.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc815600640 1 --2- 172.21.15.137:0/4156500542 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8180cfc30 0x7fc81806d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:55.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc815600640 1 -- 172.21.15.137:0/4156500542 >> v2:172.21.15.170:3300/0 conn(0x7fc8180d0f90 msgr2=0x7fc8180cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:55.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc815600640 1 --2- 172.21.15.137:0/4156500542 >> v2:172.21.15.170:3300/0 conn(0x7fc8180d0f90 0x7fc8180cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:55.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc815600640 1 -- 172.21.15.137:0/4156500542 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81806ebd0 con 0x7fc8180d1ee0 2024-04-26T23:44:55.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc815600640 1 -- 172.21.15.137:0/4156500542 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fc808001680 con 0x7fc8180d1ee0 2024-04-26T23:44:55.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc815600640 1 -- 172.21.15.137:0/4156500542 >> v1:172.21.15.137:6789/0 conn(0x7fc8180d1ee0 legacy=0x7fc81806ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:55.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc815600640 1 --2- 172.21.15.137:0/4156500542 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8180cfc30 0x7fc7fc0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:55.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc815600640 1 --2- 172.21.15.137:0/4156500542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7fc003f40 0x7fc7fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:55.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc815600640 1 --2- 172.21.15.137:0/4156500542 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7fc004d50 0x7fc7fc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:55.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc815600640 1 -- 172.21.15.137:0/4156500542 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc8180d00a0 con 0x7fc7fc003f40 2024-04-26T23:44:55.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc815600640 1 -- 172.21.15.137:0/4156500542 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc81806d490 con 0x7fc7fc004d50 2024-04-26T23:44:55.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc815600640 1 -- 172.21.15.137:0/4156500542 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc7fc00ba20 con 0x7fc8180cfc30 2024-04-26T23:44:55.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc816000640 1 --2- 172.21.15.137:0/4156500542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7fc003f40 0x7fc7fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:55.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc816a00640 1 --2- 172.21.15.137:0/4156500542 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8180cfc30 0x7fc7fc0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:55.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc817400640 1 --2- 172.21.15.137:0/4156500542 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7fc004d50 0x7fc7fc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:55.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc816000640 1 -- 172.21.15.137:0/4156500542 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8180cfc30 msgr2=0x7fc7fc0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:55.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc816000640 1 --2- 172.21.15.137:0/4156500542 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8180cfc30 0x7fc7fc0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:55.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc816000640 1 -- 172.21.15.137:0/4156500542 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7fc004d50 msgr2=0x7fc7fc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:55.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc816000640 1 --2- 172.21.15.137:0/4156500542 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7fc004d50 0x7fc7fc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:55.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc816000640 1 -- 172.21.15.137:0/4156500542 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7fc003530 con 0x7fc7fc003f40 2024-04-26T23:44:55.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.289+0000 7fc817400640 1 --2- 172.21.15.137:0/4156500542 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7fc004d50 0x7fc7fc0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:55.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.293+0000 7fc816000640 1 --2- 172.21.15.137:0/4156500542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7fc003f40 0x7fc7fc004810 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fc804009b10 tx=0x7fc80401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0d4a6a34ef2062 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:55.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.293+0000 7fc815600640 1 -- 172.21.15.137:0/4156500542 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8040b2070 con 0x7fc7fc003f40 2024-04-26T23:44:55.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.293+0000 7fc815600640 1 -- 172.21.15.137:0/4156500542 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8040a5570 con 0x7fc7fc003f40 2024-04-26T23:44:55.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.293+0000 7fc815600640 1 -- 172.21.15.137:0/4156500542 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8040096b0 con 0x7fc7fc003f40 2024-04-26T23:44:55.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.293+0000 7fc817e00640 1 -- 172.21.15.137:0/4156500542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7fc003f40 msgr2=0x7fc7fc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:55.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.293+0000 7fc817e00640 1 --2- 172.21.15.137:0/4156500542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7fc003f40 0x7fc7fc004810 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fc804009b10 tx=0x7fc80401cab0 comp rx=0 tx=0).stop 2024-04-26T23:44:55.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.293+0000 7fc817400640 1 -- 172.21.15.137:0/4156500542 reap_dead start 2024-04-26T23:44:55.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.293+0000 7fc817e00640 1 -- 172.21.15.137:0/4156500542 shutdown_connections 2024-04-26T23:44:55.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.293+0000 7fc817e00640 1 -- 172.21.15.137:0/4156500542 >> 172.21.15.137:0/4156500542 conn(0x7fc8180d2e70 msgr2=0x7fc8180d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:55.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.293+0000 7fc817e00640 1 -- 172.21.15.137:0/4156500542 shutdown_connections 2024-04-26T23:44:55.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.293+0000 7fc817e00640 1 -- 172.21.15.137:0/4156500542 wait complete. 2024-04-26T23:44:55.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc817e00640 1 Processor -- start 2024-04-26T23:44:55.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc817e00640 1 -- start start 2024-04-26T23:44:55.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc817e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7fc003f40 0x7fc8181556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:55.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc817e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc818157000 0x7fc8181592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:55.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc817e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc81815d8c0 0x7fc81815dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:55.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc817e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc8180d06a0 con 0x7fc818157000 2024-04-26T23:44:55.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc817e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc8180d22c0 con 0x7fc81815d8c0 2024-04-26T23:44:55.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc817e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc8180d0820 con 0x7fc7fc003f40 2024-04-26T23:44:55.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc816000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc818157000 0x7fc8181592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:55.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc816000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc818157000 0x7fc8181592f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38538/0 (socket says 172.21.15.137:38538) 2024-04-26T23:44:55.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc816000640 1 -- 172.21.15.137:0/1401361338 learned_addr learned my addr 172.21.15.137:0/1401361338 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:55.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc816a00640 1 --2- 172.21.15.137:0/1401361338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7fc003f40 0x7fc8181556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:55.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc817400640 1 --2- 172.21.15.137:0/1401361338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc81815d8c0 0x7fc81815dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:55.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc816000640 1 -- 172.21.15.137:0/1401361338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7fc003f40 msgr2=0x7fc8181556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:55.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc816000640 1 --2- 172.21.15.137:0/1401361338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7fc003f40 0x7fc8181556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:55.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc816000640 1 -- 172.21.15.137:0/1401361338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc81815d8c0 msgr2=0x7fc81815dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:55.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc816000640 1 --2- 172.21.15.137:0/1401361338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc81815d8c0 0x7fc81815dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:55.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc816000640 1 -- 172.21.15.137:0/1401361338 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc818159bf0 con 0x7fc818157000 2024-04-26T23:44:55.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc816000640 1 --2- 172.21.15.137:0/1401361338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc818157000 0x7fc8181592f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc804009a00 tx=0x7fc7fc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:55.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc80ea00640 1 -- 172.21.15.137:0/1401361338 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8040b2040 con 0x7fc818157000 2024-04-26T23:44:55.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc80ea00640 1 -- 172.21.15.137:0/1401361338 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc80400f000 con 0x7fc818157000 2024-04-26T23:44:55.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc817e00640 1 -- 172.21.15.137:0/1401361338 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc818159ed0 con 0x7fc818157000 2024-04-26T23:44:55.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc80ea00640 1 -- 172.21.15.137:0/1401361338 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc804004240 con 0x7fc818157000 2024-04-26T23:44:55.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc817e00640 1 -- 172.21.15.137:0/1401361338 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc81815a960 con 0x7fc818157000 2024-04-26T23:44:55.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.297+0000 7fc817e00640 1 -- 172.21.15.137:0/1401361338 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8180766a0 con 0x7fc818157000 2024-04-26T23:44:55.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.301+0000 7fc80ea00640 1 -- 172.21.15.137:0/1401361338 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc8040be030 con 0x7fc818157000 2024-04-26T23:44:55.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.301+0000 7fc80ea00640 1 --2- 172.21.15.137:0/1401361338 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc7f8068380 0x7fc7f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:55.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.301+0000 7fc80ea00640 1 -- 172.21.15.137:0/1401361338 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fc804120400 con 0x7fc818157000 2024-04-26T23:44:55.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.301+0000 7fc816a00640 1 --2- 172.21.15.137:0/1401361338 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc7f8068380 0x7fc7f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:55.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.301+0000 7fc816a00640 1 --2- 172.21.15.137:0/1401361338 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc7f8068380 0x7fc7f806a840 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc808000c10 tx=0x7fc808009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:55.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.305+0000 7fc80ea00640 1 -- 172.21.15.137:0/1401361338 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc8040c5020 con 0x7fc818157000 2024-04-26T23:44:55.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.497+0000 7fc817e00640 1 -- 172.21.15.137:0/1401361338 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc8180b8df0 con 0x7fc818157000 2024-04-26T23:44:55.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.497+0000 7fc80ea00640 1 -- 172.21.15.137:0/1401361338 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) ==== 53+0+73 (secure 0 0 0) 0x7fc804016800 con 0x7fc818157000 2024-04-26T23:44:55.501 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:44:55.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.497+0000 7fc817e00640 1 -- 172.21.15.137:0/1401361338 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc7f8068380 msgr2=0x7fc7f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:55.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.497+0000 7fc817e00640 1 --2- 172.21.15.137:0/1401361338 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc7f8068380 0x7fc7f806a840 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc808000c10 tx=0x7fc808009040 comp rx=0 tx=0).stop 2024-04-26T23:44:55.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.497+0000 7fc817e00640 1 -- 172.21.15.137:0/1401361338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc818157000 msgr2=0x7fc8181592f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:55.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.497+0000 7fc817e00640 1 --2- 172.21.15.137:0/1401361338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc818157000 0x7fc8181592f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc804009a00 tx=0x7fc7fc005840 comp rx=0 tx=0).stop 2024-04-26T23:44:55.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.497+0000 7fc817e00640 1 -- 172.21.15.137:0/1401361338 shutdown_connections 2024-04-26T23:44:55.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.497+0000 7fc817e00640 1 --2- 172.21.15.137:0/1401361338 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc7f8068380 0x7fc7f806a840 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:55.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.497+0000 7fc817e00640 1 --2- 172.21.15.137:0/1401361338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc818157000 0x7fc8181592f0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:55.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.497+0000 7fc817e00640 1 --2- 172.21.15.137:0/1401361338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc81815d8c0 0x7fc81815dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:55.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.497+0000 7fc817e00640 1 --2- 172.21.15.137:0/1401361338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7fc003f40 0x7fc8181556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:55.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.497+0000 7fc817e00640 1 -- 172.21.15.137:0/1401361338 >> 172.21.15.137:0/1401361338 conn(0x7fc8180d2e70 msgr2=0x7fc818162360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:55.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.497+0000 7fc817e00640 1 -- 172.21.15.137:0/1401361338 shutdown_connections 2024-04-26T23:44:55.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:55.497+0000 7fc817e00640 1 -- 172.21.15.137:0/1401361338 wait complete. 2024-04-26T23:44:55.523 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:44:55.523 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:44:55.523 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi170.front.sepia.ceph.com 2024-04-26T23:44:55.523 INFO:tasks.cephfs.mount:self.client.name = client.badguy 2024-04-26T23:44:55.523 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T23:44:55.523 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:44:55.523 INFO:tasks.cephfs.mount:self.cephfs_mntpt = /foo/bar 2024-04-26T23:44:55.524 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:44:55.524 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:44:55.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:55.524 DEBUG:teuthology.orchestra.run.smithi170:> ip addr 2024-04-26T23:44:55.533 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:44:55.534 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:44:55.534 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:44:55.534 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:55.534 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2024-04-26T23:44:55.534 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:55.534 INFO:teuthology.orchestra.run.smithi170.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:44:55.534 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:54 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:44:55.534 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f0 2024-04-26T23:44:55.534 INFO:teuthology.orchestra.run.smithi170.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:44:55.534 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:55 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:44:55.534 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f1 2024-04-26T23:44:55.534 INFO:teuthology.orchestra.run.smithi170.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:44:55.535 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:54 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:44:55.535 INFO:teuthology.orchestra.run.smithi170.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:44:55.535 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:55 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:44:55.535 INFO:teuthology.orchestra.run.smithi170.stdout: inet 172.21.15.170/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:44:55.535 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft 42271sec preferred_lft 42271sec 2024-04-26T23:44:55.535 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::ec4:7aff:fe88:7255/64 scope link 2024-04-26T23:44:55.535 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:55.535 INFO:teuthology.orchestra.run.smithi170.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:44:55.535 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 02:42:23:a7:19:38 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:44:55.535 INFO:teuthology.orchestra.run.smithi170.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:44:55.535 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:55.535 INFO:teuthology.orchestra.run.smithi170.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:44:55.535 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:44:55.535 INFO:teuthology.orchestra.run.smithi170.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:44:55.535 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:55.536 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T23:44:55.536 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:55.536 INFO:teuthology.orchestra.run.smithi170.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:44:55.536 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:44:55.536 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:44:55.536 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:55.536 INFO:teuthology.orchestra.run.smithi170.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:44:55.536 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:44:55.536 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-26T23:44:55.536 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:44:55.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:55.537 DEBUG:teuthology.orchestra.run.smithi170:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:44:55.599 INFO:teuthology.orchestra.run.smithi170.stdout:1 2024-04-26T23:44:55.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:55.602 DEBUG:teuthology.orchestra.run.smithi170:> route 2024-04-26T23:44:55.655 INFO:teuthology.orchestra.run.smithi170.stdout:Kernel IP routing table 2024-04-26T23:44:55.656 INFO:teuthology.orchestra.run.smithi170.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:44:55.656 INFO:teuthology.orchestra.run.smithi170.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:44:55.656 INFO:teuthology.orchestra.run.smithi170.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:44:55.656 INFO:teuthology.orchestra.run.smithi170.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:44:55.656 INFO:teuthology.orchestra.run.smithi170.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:44:55.656 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:44:55.656 INFO:teuthology.orchestra.run.smithi170.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:44:55.656 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:44:55.656 INFO:teuthology.orchestra.run.smithi170.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:44:55.656 INFO:teuthology.orchestra.run.smithi170.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:44:55.657 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:44:55.657 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-04-26T23:44:55.657 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:44:55.657 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:44:55.657 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:44:55.657 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-04-26T23:44:55.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:44:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:44:55.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T23:44:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:44:55.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:55.801 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-04-26T23:44:55.811 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T23:44:55.811 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-26T23:44:55.811 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:44:55.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:55.812 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set brx.0 up 2024-04-26T23:44:55.875 INFO:tasks.cephfs.fuse_mount:Client client.badguy config is {} 2024-04-26T23:44:55.876 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:44:55.876 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-26T23:44:55.924 INFO:teuthology.orchestra.run.smithi170.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:44:55.925 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:44:55.925 DEBUG:teuthology.orchestra.run.smithi170:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:44:55.975 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2024-04-26T23:44:56.037 DEBUG:teuthology.orchestra.run.smithi170:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:44:56.089 INFO:teuthology.orchestra.run.smithi170.stdout:/sys 2024-04-26T23:44:56.089 INFO:teuthology.orchestra.run.smithi170.stdout:/proc 2024-04-26T23:44:56.089 INFO:teuthology.orchestra.run.smithi170.stdout:/dev 2024-04-26T23:44:56.089 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/pts 2024-04-26T23:44:56.090 INFO:teuthology.orchestra.run.smithi170.stdout:/run 2024-04-26T23:44:56.090 INFO:teuthology.orchestra.run.smithi170.stdout:/ 2024-04-26T23:44:56.090 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/security 2024-04-26T23:44:56.090 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/shm 2024-04-26T23:44:56.090 INFO:teuthology.orchestra.run.smithi170.stdout:/run/lock 2024-04-26T23:44:56.090 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/cgroup 2024-04-26T23:44:56.090 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/pstore 2024-04-26T23:44:56.090 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/bpf 2024-04-26T23:44:56.090 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:44:56.090 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/hugepages 2024-04-26T23:44:56.090 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/mqueue 2024-04-26T23:44:56.091 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/debug 2024-04-26T23:44:56.091 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/tracing 2024-04-26T23:44:56.091 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/fs/nfsd 2024-04-26T23:44:56.091 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/fuse/connections 2024-04-26T23:44:56.091 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/config 2024-04-26T23:44:56.091 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:44:56.091 INFO:teuthology.orchestra.run.smithi170.stdout:/run/rpc_pipefs 2024-04-26T23:44:56.091 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/1000 2024-04-26T23:44:56.091 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph 2024-04-26T23:44:56.091 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:44:56.091 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:44:56.092 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:44:56.092 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:44:56.092 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns 2024-04-26T23:44:56.092 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:44:56.092 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:44:56.092 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:44:56.092 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:44:56.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:56.093 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2024-04-26T23:44:56.143 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T23:44:56.144 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id badguy --client_mountpoint=/foo/bar) 2024-04-26T23:44:56.186 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2024-04-26T23:44:56.207 DEBUG:teuthology.orchestra.run.smithi170:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:44:56.261 INFO:teuthology.orchestra.run.smithi170.stdout:/sys 2024-04-26T23:44:56.261 INFO:teuthology.orchestra.run.smithi170.stdout:/proc 2024-04-26T23:44:56.261 INFO:teuthology.orchestra.run.smithi170.stdout:/dev 2024-04-26T23:44:56.261 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/pts 2024-04-26T23:44:56.261 INFO:teuthology.orchestra.run.smithi170.stdout:/run 2024-04-26T23:44:56.262 INFO:teuthology.orchestra.run.smithi170.stdout:/ 2024-04-26T23:44:56.262 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/security 2024-04-26T23:44:56.262 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/shm 2024-04-26T23:44:56.262 INFO:teuthology.orchestra.run.smithi170.stdout:/run/lock 2024-04-26T23:44:56.262 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/cgroup 2024-04-26T23:44:56.262 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/pstore 2024-04-26T23:44:56.262 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/bpf 2024-04-26T23:44:56.262 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:44:56.262 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/hugepages 2024-04-26T23:44:56.262 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/mqueue 2024-04-26T23:44:56.262 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/debug 2024-04-26T23:44:56.262 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/tracing 2024-04-26T23:44:56.262 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/fs/nfsd 2024-04-26T23:44:56.262 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/fuse/connections 2024-04-26T23:44:56.263 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/config 2024-04-26T23:44:56.263 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:44:56.263 INFO:teuthology.orchestra.run.smithi170.stdout:/run/rpc_pipefs 2024-04-26T23:44:56.263 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/1000 2024-04-26T23:44:56.263 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph 2024-04-26T23:44:56.263 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:44:56.263 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:44:56.263 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:44:56.263 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:44:56.263 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns 2024-04-26T23:44:56.263 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:44:56.263 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:44:56.263 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:44:56.263 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:44:56.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:56.264 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2024-04-26T23:44:56.274 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:2024-04-26T23:44:56.271+0000 7f8c81d38580 -1 auth: error parsing file /etc/ceph/ceph.client.badguy.keyring: cannot parse buffer: Malformed input [buffer:3] 2024-04-26T23:44:56.274 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:2024-04-26T23:44:56.271+0000 7f8c81d38580 -1 auth: failed to load /etc/ceph/ceph.client.badguy.keyring: (5) Input/output error 2024-04-26T23:44:56.277 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:2024-04-26T23:44:56.271+0000 7f8c81d38580 -1 auth: error parsing file /etc/ceph/ceph.client.badguy.keyring: cannot parse buffer: Malformed input [buffer:3] 2024-04-26T23:44:56.278 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:2024-04-26T23:44:56.271+0000 7f8c81d38580 -1 auth: failed to load /etc/ceph/ceph.client.badguy.keyring: (5) Input/output error 2024-04-26T23:44:56.278 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:2024-04-26T23:44:56.275+0000 7f8c81d38580 -1 auth: error parsing file /etc/ceph/ceph.client.badguy.keyring: cannot parse buffer: Malformed input [buffer:3] 2024-04-26T23:44:56.278 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:2024-04-26T23:44:56.275+0000 7f8c81d38580 -1 auth: failed to load /etc/ceph/ceph.client.badguy.keyring: (5) Input/output error 2024-04-26T23:44:56.278 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:2024-04-26T23:44:56.275+0000 7f8c81d38580 -1 monclient: keyring not found 2024-04-26T23:44:56.278 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:failed to fetch mon config (--no-mon-config to skip) 2024-04-26T23:44:56.450 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:daemon-helper: command failed with exit status 1 2024-04-26T23:44:57.384 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2024-04-26T23:44:57.406 DEBUG:teuthology.orchestra.run.smithi170:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:44:57.457 INFO:teuthology.orchestra.run.smithi170.stdout:/sys 2024-04-26T23:44:57.457 INFO:teuthology.orchestra.run.smithi170.stdout:/proc 2024-04-26T23:44:57.458 INFO:teuthology.orchestra.run.smithi170.stdout:/dev 2024-04-26T23:44:57.458 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/pts 2024-04-26T23:44:57.458 INFO:teuthology.orchestra.run.smithi170.stdout:/run 2024-04-26T23:44:57.458 INFO:teuthology.orchestra.run.smithi170.stdout:/ 2024-04-26T23:44:57.458 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/security 2024-04-26T23:44:57.458 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/shm 2024-04-26T23:44:57.458 INFO:teuthology.orchestra.run.smithi170.stdout:/run/lock 2024-04-26T23:44:57.458 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/cgroup 2024-04-26T23:44:57.458 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/pstore 2024-04-26T23:44:57.458 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/bpf 2024-04-26T23:44:57.458 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:44:57.458 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/hugepages 2024-04-26T23:44:57.458 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/mqueue 2024-04-26T23:44:57.459 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/debug 2024-04-26T23:44:57.459 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/tracing 2024-04-26T23:44:57.459 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/fs/nfsd 2024-04-26T23:44:57.459 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/fuse/connections 2024-04-26T23:44:57.459 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/config 2024-04-26T23:44:57.459 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:44:57.459 INFO:teuthology.orchestra.run.smithi170.stdout:/run/rpc_pipefs 2024-04-26T23:44:57.459 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/1000 2024-04-26T23:44:57.459 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph 2024-04-26T23:44:57.459 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:44:57.459 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:44:57.459 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:44:57.459 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:44:57.459 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns 2024-04-26T23:44:57.459 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:44:57.460 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:44:57.460 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:44:57.460 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:44:57.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:44:57.461 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2024-04-26T23:44:57.512 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:44:57.512 INFO:tasks.cephfs.fuse_mount:mount command failed. 2024-04-26T23:44:57.512 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T23:44:57.512 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:44:57.582 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:44:57.675 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T23:44:57.675 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:44:57.675 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:44:57.675 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:44:57.684 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4511 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:44:57.684 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:44:57.685 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:44:57.685 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:44:57.694 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4843 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:44:57.694 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:44:57.694 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:44:57.694 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:44:57.736 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4511 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:44:57.736 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:44:57.736 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:44:57.736 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:44:57.748 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4843 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:44:57.748 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:44:57.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.917+0000 7ff4ee600640 1 Processor -- start 2024-04-26T23:44:57.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.917+0000 7ff4ee600640 1 -- start start 2024-04-26T23:44:57.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.921+0000 7ff4ee600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff4e8157660 0x7ff4e806c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:57.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.921+0000 7ff4ee600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4e81436b0 con 0x7ff4e806cd60 2024-04-26T23:44:57.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.921+0000 7ff4ee600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4e815dab0 con 0x7ff4e8157a40 2024-04-26T23:44:57.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.921+0000 7ff4ee600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff4e815dd90 con 0x7ff4e8157660 2024-04-26T23:44:57.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.921+0000 7ff4e7400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff4e8157660 0x7ff4e806c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:57.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.921+0000 7ff4e7e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7ff4e806cd60 0x7ff4e8166d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46976/0 (socket says 172.21.15.137:46976) 2024-04-26T23:44:57.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.921+0000 7ff4e7e00640 1 -- 172.21.15.137:0/482211301 learned_addr learned my addr 172.21.15.137:0/482211301 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:57.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.921+0000 7ff4e7400640 1 -- 172.21.15.137:0/482211301 >> v1:172.21.15.170:6789/0 conn(0x7ff4e8157a40 legacy=0x7ff4e8142820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:57.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.921+0000 7ff4e7400640 1 -- 172.21.15.137:0/482211301 >> v1:172.21.15.137:6789/0 conn(0x7ff4e806cd60 legacy=0x7ff4e8166d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:57.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.921+0000 7ff4e7400640 1 -- 172.21.15.137:0/482211301 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e815e070 con 0x7ff4e8157660 2024-04-26T23:44:57.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.921+0000 7ff4e6a00640 1 -- 172.21.15.137:0/482211301 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2972612383 0 0) 0x7ff4e81436b0 con 0x7ff4e806cd60 2024-04-26T23:44:57.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.925+0000 7ff4e7400640 1 --2- 172.21.15.137:0/482211301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4e8157660 0x7ff4e806c820 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80097c0 tx=0x7ff4d801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37e94d248c2571 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:57.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.925+0000 7ff4e6a00640 1 -- 172.21.15.137:0/482211301 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d80b0070 con 0x7ff4e8157660 2024-04-26T23:44:57.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.925+0000 7ff4e6a00640 1 -- 172.21.15.137:0/482211301 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4d80ab600 con 0x7ff4e8157660 2024-04-26T23:44:57.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.925+0000 7ff4e6a00640 1 -- 172.21.15.137:0/482211301 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d80ab9d0 con 0x7ff4e8157660 2024-04-26T23:44:57.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.925+0000 7ff4ee600640 1 -- 172.21.15.137:0/482211301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4e8157660 msgr2=0x7ff4e806c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:57.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.925+0000 7ff4ee600640 1 --2- 172.21.15.137:0/482211301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4e8157660 0x7ff4e806c820 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80097c0 tx=0x7ff4d801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:44:57.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.925+0000 7ff4ee600640 1 -- 172.21.15.137:0/482211301 shutdown_connections 2024-04-26T23:44:57.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.925+0000 7ff4ee600640 1 --2- 172.21.15.137:0/482211301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4e8157660 0x7ff4e806c820 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:57.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.925+0000 7ff4ee600640 1 -- 172.21.15.137:0/482211301 >> 172.21.15.137:0/482211301 conn(0x7ff4e806f840 msgr2=0x7ff4e806fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:57.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.925+0000 7ff4ee600640 1 -- 172.21.15.137:0/482211301 shutdown_connections 2024-04-26T23:44:57.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.925+0000 7ff4ee600640 1 -- 172.21.15.137:0/482211301 wait complete. 2024-04-26T23:44:57.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.925+0000 7ff4ee600640 1 Processor -- start 2024-04-26T23:44:57.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.925+0000 7ff4ee600640 1 -- start start 2024-04-26T23:44:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4ee600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4e806cd60 0x7ff4e813c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4ee600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4e8157660 0x7ff4e8153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4ee600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4e8157a40 0x7ff4e80cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4ee600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e816ae50 con 0x7ff4e8157a40 2024-04-26T23:44:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4ee600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e816acd0 con 0x7ff4e8157660 2024-04-26T23:44:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4ee600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff4e816afd0 con 0x7ff4e806cd60 2024-04-26T23:44:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4e7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4e8157a40 0x7ff4e80cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4e7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4e8157a40 0x7ff4e80cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38552/0 (socket says 172.21.15.137:38552) 2024-04-26T23:44:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4e7e00640 1 -- 172.21.15.137:0/3313112944 learned_addr learned my addr 172.21.15.137:0/3313112944 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4dea00640 1 --2- 172.21.15.137:0/3313112944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4e8157660 0x7ff4e8153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4e7400640 1 --2- 172.21.15.137:0/3313112944 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4e806cd60 0x7ff4e813c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4e7e00640 1 -- 172.21.15.137:0/3313112944 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4e806cd60 msgr2=0x7ff4e813c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4e7e00640 1 --2- 172.21.15.137:0/3313112944 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4e806cd60 0x7ff4e813c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4e7e00640 1 -- 172.21.15.137:0/3313112944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4e8157660 msgr2=0x7ff4e8153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4e7e00640 1 --2- 172.21.15.137:0/3313112944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4e8157660 0x7ff4e8153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4e7e00640 1 -- 172.21.15.137:0/3313112944 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e8156dc0 con 0x7ff4e8157a40 2024-04-26T23:44:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4e7e00640 1 --2- 172.21.15.137:0/3313112944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4e8157a40 0x7ff4e80cd230 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000c480 tx=0x7ff4e000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:57.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4dfe00640 1 -- 172.21.15.137:0/3313112944 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0018070 con 0x7ff4e8157a40 2024-04-26T23:44:57.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4dfe00640 1 -- 172.21.15.137:0/3313112944 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4e00074e0 con 0x7ff4e8157a40 2024-04-26T23:44:57.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4dfe00640 1 -- 172.21.15.137:0/3313112944 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0004a30 con 0x7ff4e8157a40 2024-04-26T23:44:57.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4ee600640 1 -- 172.21.15.137:0/3313112944 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4e815c6a0 con 0x7ff4e8157a40 2024-04-26T23:44:57.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4ee600640 1 -- 172.21.15.137:0/3313112944 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4e813d730 con 0x7ff4e8157a40 2024-04-26T23:44:57.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4ee600640 1 -- 172.21.15.137:0/3313112944 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4e8076710 con 0x7ff4e8157a40 2024-04-26T23:44:57.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.929+0000 7ff4dfe00640 1 -- 172.21.15.137:0/3313112944 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff4e0004bd0 con 0x7ff4e8157a40 2024-04-26T23:44:57.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.933+0000 7ff4dfe00640 1 --2- 172.21.15.137:0/3313112944 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff4c4068380 0x7ff4c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:57.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.933+0000 7ff4dfe00640 1 -- 172.21.15.137:0/3313112944 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7ff4e0085da0 con 0x7ff4e8157a40 2024-04-26T23:44:57.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.933+0000 7ff4e7400640 1 --2- 172.21.15.137:0/3313112944 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff4c4068380 0x7ff4c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:57.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.933+0000 7ff4e7400640 1 --2- 172.21.15.137:0/3313112944 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff4c4068380 0x7ff4c406a840 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80ad000 tx=0x7ff4d80a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:57.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:57.937+0000 7ff4dfe00640 1 -- 172.21.15.137:0/3313112944 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff4e8156dc0 con 0x7ff4e8157a40 2024-04-26T23:44:58.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.125+0000 7ff4ee600640 1 -- 172.21.15.137:0/3313112944 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4e81382a0 con 0x7ff4e8157a40 2024-04-26T23:44:58.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.125+0000 7ff4dfe00640 1 -- 172.21.15.137:0/3313112944 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5190 (secure 0 0 0) 0x7ff4e00562c0 con 0x7ff4e8157a40 2024-04-26T23:44:58.130 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:58.130 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6064,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2903000554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2903000554},{"type":"v1","addr":"172.21.15.170:6834","nonce":2903000554}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6372,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/2879053849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2879053849},{"type":"v1","addr":"172.21.15.137:6836","nonce":2879053849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3081576837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3081576837},{"type":"v1","addr":"172.21.15.137:6837","nonce":3081576837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:44:21.180357+0000","modified":"2024-04-26T23:44:24.204261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6381":{"gid":6381,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/141729149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":141729149},{"type":"v1","addr":"172.21.15.170:6835","nonce":141729149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6381,"qdb_cluster":[6381]},"id":4}]} 2024-04-26T23:44:58.130 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 37 2024-04-26T23:44:58.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.129+0000 7ff4ee600640 1 -- 172.21.15.137:0/3313112944 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff4c4068380 msgr2=0x7ff4c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:58.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.129+0000 7ff4ee600640 1 --2- 172.21.15.137:0/3313112944 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff4c4068380 0x7ff4c406a840 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80ad000 tx=0x7ff4d80a6000 comp rx=0 tx=0).stop 2024-04-26T23:44:58.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.129+0000 7ff4ee600640 1 -- 172.21.15.137:0/3313112944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4e8157a40 msgr2=0x7ff4e80cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:58.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.129+0000 7ff4ee600640 1 --2- 172.21.15.137:0/3313112944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4e8157a40 0x7ff4e80cd230 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000c480 tx=0x7ff4e000c940 comp rx=0 tx=0).stop 2024-04-26T23:44:58.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.129+0000 7ff4ee600640 1 -- 172.21.15.137:0/3313112944 shutdown_connections 2024-04-26T23:44:58.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.129+0000 7ff4ee600640 1 --2- 172.21.15.137:0/3313112944 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff4c4068380 0x7ff4c406a840 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.129+0000 7ff4ee600640 1 --2- 172.21.15.137:0/3313112944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4e8157a40 0x7ff4e80cd230 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.129+0000 7ff4ee600640 1 --2- 172.21.15.137:0/3313112944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4e8157660 0x7ff4e8153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.129+0000 7ff4ee600640 1 --2- 172.21.15.137:0/3313112944 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4e806cd60 0x7ff4e813c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.129+0000 7ff4ee600640 1 -- 172.21.15.137:0/3313112944 >> 172.21.15.137:0/3313112944 conn(0x7ff4e806f840 msgr2=0x7ff4e813b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:58.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.129+0000 7ff4ee600640 1 -- 172.21.15.137:0/3313112944 shutdown_connections 2024-04-26T23:44:58.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.129+0000 7ff4ee600640 1 -- 172.21.15.137:0/3313112944 wait complete. 2024-04-26T23:44:58.151 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:44:58.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.281+0000 7f5df0400640 1 Processor -- start 2024-04-26T23:44:58.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.281+0000 7f5df0400640 1 -- start start 2024-04-26T23:44:58.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5df0400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5de80706a0 0x7f5de8070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:58.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5df0400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5de8070fc0 con 0x7f5de8143cb0 2024-04-26T23:44:58.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5df0400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5de8142930 con 0x7f5de80724d0 2024-04-26T23:44:58.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5df0400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f5de806dba0 con 0x7f5de80706a0 2024-04-26T23:44:58.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5dee400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f5de8143cb0 0x7f5de8144100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46978/0 (socket says 172.21.15.137:46978) 2024-04-26T23:44:58.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5dee400640 1 -- 172.21.15.137:0/1841413831 learned_addr learned my addr 172.21.15.137:0/1841413831 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:58.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5deda00640 1 --2- 172.21.15.137:0/1841413831 >> v2:172.21.15.170:3300/0 conn(0x7f5de80706a0 0x7f5de8070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:58.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5de7e00640 1 -- 172.21.15.137:0/1841413831 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3960336729 0 0) 0x7f5de8070fc0 con 0x7f5de8143cb0 2024-04-26T23:44:58.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5de7e00640 1 -- 172.21.15.137:0/1841413831 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dd0003530 con 0x7f5de8143cb0 2024-04-26T23:44:58.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5de7e00640 1 -- 172.21.15.137:0/1841413831 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1241342896 0 0) 0x7f5de8142930 con 0x7f5de80724d0 2024-04-26T23:44:58.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5de7e00640 1 -- 172.21.15.137:0/1841413831 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5de8070fc0 con 0x7f5de80724d0 2024-04-26T23:44:58.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5de7e00640 1 -- 172.21.15.137:0/1841413831 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3941759274 0 0) 0x7f5dd0003530 con 0x7f5de8143cb0 2024-04-26T23:44:58.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5de7e00640 1 -- 172.21.15.137:0/1841413831 >> v2:172.21.15.170:3300/0 conn(0x7f5de80706a0 msgr2=0x7f5de8070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:58.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5de7e00640 1 --2- 172.21.15.137:0/1841413831 >> v2:172.21.15.170:3300/0 conn(0x7f5de80706a0 0x7f5de8070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5de7e00640 1 -- 172.21.15.137:0/1841413831 >> v1:172.21.15.170:6789/0 conn(0x7f5de80724d0 legacy=0x7f5de806d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:58.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5de7e00640 1 -- 172.21.15.137:0/1841413831 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de8142c10 con 0x7f5de8143cb0 2024-04-26T23:44:58.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5de7e00640 1 -- 172.21.15.137:0/1841413831 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f5de0001a00 con 0x7f5de8143cb0 2024-04-26T23:44:58.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5de7e00640 1 -- 172.21.15.137:0/1841413831 >> v1:172.21.15.137:6789/0 conn(0x7f5de8143cb0 legacy=0x7f5de8144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:58.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5de7e00640 1 --2- 172.21.15.137:0/1841413831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5dd0003b50 0x7f5dd0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:58.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5de7e00640 1 --2- 172.21.15.137:0/1841413831 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5dd0004810 0x7f5dd0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:58.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5de7e00640 1 --2- 172.21.15.137:0/1841413831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5dd00051d0 0x7f5dd000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:58.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5de7e00640 1 -- 172.21.15.137:0/1841413831 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5de806dba0 con 0x7f5dd00051d0 2024-04-26T23:44:58.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5de7e00640 1 -- 172.21.15.137:0/1841413831 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd000c050 con 0x7f5dd0003b50 2024-04-26T23:44:58.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5de7e00640 1 -- 172.21.15.137:0/1841413831 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd000c250 con 0x7f5dd0004810 2024-04-26T23:44:58.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5dee400640 1 --2- 172.21.15.137:0/1841413831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5dd00051d0 0x7f5dd000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:58.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5deda00640 1 --2- 172.21.15.137:0/1841413831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5dd0003b50 0x7f5dd0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:58.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5ded000640 1 --2- 172.21.15.137:0/1841413831 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5dd0004810 0x7f5dd0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:58.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5dee400640 1 -- 172.21.15.137:0/1841413831 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5dd0004810 msgr2=0x7f5dd0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:58.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5dee400640 1 --2- 172.21.15.137:0/1841413831 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5dd0004810 0x7f5dd0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5dee400640 1 -- 172.21.15.137:0/1841413831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5dd0003b50 msgr2=0x7f5dd0003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:58.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5dee400640 1 --2- 172.21.15.137:0/1841413831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5dd0003b50 0x7f5dd0003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5dee400640 1 -- 172.21.15.137:0/1841413831 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd0003530 con 0x7f5dd00051d0 2024-04-26T23:44:58.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.285+0000 7f5deda00640 1 --2- 172.21.15.137:0/1841413831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5dd0003b50 0x7f5dd0003f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:44:58.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.289+0000 7f5dee400640 1 -- 172.21.15.137:0/1841413831 reap_dead start 2024-04-26T23:44:58.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.289+0000 7f5dee400640 1 --2- 172.21.15.137:0/1841413831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5dd00051d0 0x7f5dd000b9d0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f5de000a800 tx=0x7f5de001fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28f019a6b2b9c92 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:58.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.289+0000 7f5de7e00640 1 -- 172.21.15.137:0/1841413831 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc0096b0 con 0x7f5dd00051d0 2024-04-26T23:44:58.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.289+0000 7f5de7e00640 1 -- 172.21.15.137:0/1841413831 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de00aa6d0 con 0x7f5dd00051d0 2024-04-26T23:44:58.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.289+0000 7f5de7e00640 1 -- 172.21.15.137:0/1841413831 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de000a430 con 0x7f5dd00051d0 2024-04-26T23:44:58.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.289+0000 7f5df0400640 1 -- 172.21.15.137:0/1841413831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5dd00051d0 msgr2=0x7f5dd000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:58.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.289+0000 7f5df0400640 1 --2- 172.21.15.137:0/1841413831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5dd00051d0 0x7f5dd000b9d0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f5de000a800 tx=0x7f5de001fa60 comp rx=0 tx=0).stop 2024-04-26T23:44:58.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.289+0000 7f5df0400640 1 -- 172.21.15.137:0/1841413831 shutdown_connections 2024-04-26T23:44:58.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.289+0000 7f5df0400640 1 --2- 172.21.15.137:0/1841413831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5dd00051d0 0x7f5dd000b9d0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.289+0000 7f5df0400640 1 -- 172.21.15.137:0/1841413831 >> 172.21.15.137:0/1841413831 conn(0x7f5de80b4b70 msgr2=0x7f5de80b4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:58.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.289+0000 7f5df0400640 1 -- 172.21.15.137:0/1841413831 shutdown_connections 2024-04-26T23:44:58.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.289+0000 7f5df0400640 1 -- 172.21.15.137:0/1841413831 wait complete. 2024-04-26T23:44:58.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5df0400640 1 Processor -- start 2024-04-26T23:44:58.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5df0400640 1 -- start start 2024-04-26T23:44:58.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5df0400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5dd00051d0 0x7f5de813f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:58.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5df0400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5de80cf090 0x7f5de80cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:58.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5df0400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5de80cce90 0x7f5de815dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:58.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5df0400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5de81434b0 con 0x7f5dd00051d0 2024-04-26T23:44:58.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5df0400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5de81431d0 con 0x7f5de80cf090 2024-04-26T23:44:58.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5df0400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5de8143790 con 0x7f5de80cce90 2024-04-26T23:44:58.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5deda00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5dd00051d0 0x7f5de813f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:58.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5deda00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5dd00051d0 0x7f5de813f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38574/0 (socket says 172.21.15.137:38574) 2024-04-26T23:44:58.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5deda00640 1 -- 172.21.15.137:0/3769879457 learned_addr learned my addr 172.21.15.137:0/3769879457 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:58.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5deda00640 1 -- 172.21.15.137:0/3769879457 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5de80cce90 msgr2=0x7f5de815dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:58.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5dee400640 1 --2- 172.21.15.137:0/3769879457 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5de80cce90 0x7f5de815dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:58.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5ded000640 1 --2- 172.21.15.137:0/3769879457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5de80cf090 0x7f5de80cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:58.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5deda00640 1 --2- 172.21.15.137:0/3769879457 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5de80cce90 0x7f5de815dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5deda00640 1 -- 172.21.15.137:0/3769879457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5de80cf090 msgr2=0x7f5de80cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:58.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5deda00640 1 --2- 172.21.15.137:0/3769879457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5de80cf090 0x7f5de80cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5deda00640 1 -- 172.21.15.137:0/3769879457 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de80cd410 con 0x7f5dd00051d0 2024-04-26T23:44:58.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5dee400640 1 --2- 172.21.15.137:0/3769879457 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5de80cce90 0x7f5de815dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:58.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5ded000640 1 --2- 172.21.15.137:0/3769879457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5de80cf090 0x7f5de80cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:58.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5deda00640 1 --2- 172.21.15.137:0/3769879457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5dd00051d0 0x7f5de813f7f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc011960 tx=0x7f5ddc011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:58.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5de5600640 1 -- 172.21.15.137:0/3769879457 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc00fa30 con 0x7f5dd00051d0 2024-04-26T23:44:58.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5de5600640 1 -- 172.21.15.137:0/3769879457 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ddc00fbd0 con 0x7f5dd00051d0 2024-04-26T23:44:58.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5de5600640 1 -- 172.21.15.137:0/3769879457 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc004020 con 0x7f5dd00051d0 2024-04-26T23:44:58.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5df0400640 1 -- 172.21.15.137:0/3769879457 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de80cd6f0 con 0x7f5dd00051d0 2024-04-26T23:44:58.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5df0400640 1 -- 172.21.15.137:0/3769879457 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de815ae70 con 0x7f5dd00051d0 2024-04-26T23:44:58.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.293+0000 7f5df0400640 1 -- 172.21.15.137:0/3769879457 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5de8076710 con 0x7f5dd00051d0 2024-04-26T23:44:58.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.297+0000 7f5de5600640 1 -- 172.21.15.137:0/3769879457 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5ddc012040 con 0x7f5dd00051d0 2024-04-26T23:44:58.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.297+0000 7f5de5600640 1 --2- 172.21.15.137:0/3769879457 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5dc80683b0 0x7f5dc806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:58.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.297+0000 7f5de5600640 1 -- 172.21.15.137:0/3769879457 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f5ddc086c30 con 0x7f5dd00051d0 2024-04-26T23:44:58.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.297+0000 7f5ded000640 1 --2- 172.21.15.137:0/3769879457 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5dc80683b0 0x7f5dc806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:58.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.297+0000 7f5ded000640 1 --2- 172.21.15.137:0/3769879457 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5dc80683b0 0x7f5dc806a870 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5de80cf490 tx=0x7f5dd4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:58.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.301+0000 7f5de5600640 1 -- 172.21.15.137:0/3769879457 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5ddc08d080 con 0x7f5dd00051d0 2024-04-26T23:44:58.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.461+0000 7f5df0400640 1 -- 172.21.15.137:0/3769879457 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5de81450d0 con 0x7f5dd00051d0 2024-04-26T23:44:58.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.461+0000 7f5de5600640 1 -- 172.21.15.137:0/3769879457 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16713 (secure 0 0 0) 0x7f5ddc019030 con 0x7f5dd00051d0 2024-04-26T23:44:58.465 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:58.465 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":60,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:44:22.811626+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:44:18.876990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T23:44:20.189315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:44:58.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.461+0000 7f5df0400640 1 -- 172.21.15.137:0/3769879457 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5dc80683b0 msgr2=0x7f5dc806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:58.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.461+0000 7f5df0400640 1 --2- 172.21.15.137:0/3769879457 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5dc80683b0 0x7f5dc806a870 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5de80cf490 tx=0x7f5dd4009040 comp rx=0 tx=0).stop 2024-04-26T23:44:58.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.461+0000 7f5df0400640 1 -- 172.21.15.137:0/3769879457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5dd00051d0 msgr2=0x7f5de813f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:58.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.461+0000 7f5df0400640 1 --2- 172.21.15.137:0/3769879457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5dd00051d0 0x7f5de813f7f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc011960 tx=0x7f5ddc011e20 comp rx=0 tx=0).stop 2024-04-26T23:44:58.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.461+0000 7f5df0400640 1 -- 172.21.15.137:0/3769879457 shutdown_connections 2024-04-26T23:44:58.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.461+0000 7f5df0400640 1 --2- 172.21.15.137:0/3769879457 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5dc80683b0 0x7f5dc806a870 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.461+0000 7f5df0400640 1 --2- 172.21.15.137:0/3769879457 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5de80cce90 0x7f5de815dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.461+0000 7f5df0400640 1 --2- 172.21.15.137:0/3769879457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5de80cf090 0x7f5de80cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.461+0000 7f5df0400640 1 --2- 172.21.15.137:0/3769879457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5dd00051d0 0x7f5de813f7f0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.461+0000 7f5df0400640 1 -- 172.21.15.137:0/3769879457 >> 172.21.15.137:0/3769879457 conn(0x7f5de80b4b70 msgr2=0x7f5de8162200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:58.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.461+0000 7f5df0400640 1 -- 172.21.15.137:0/3769879457 shutdown_connections 2024-04-26T23:44:58.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.461+0000 7f5df0400640 1 -- 172.21.15.137:0/3769879457 wait complete. 2024-04-26T23:44:58.488 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:41:11.613077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:44:18.876990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:44:20.189315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:44:58.488 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:44:58.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.621+0000 7f4f72000640 1 Processor -- start 2024-04-26T23:44:58.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.621+0000 7f4f72000640 1 -- start start 2024-04-26T23:44:58.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.621+0000 7f4f72000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4f6c0cd8f0 0x7f4f6c0cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:58.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.621+0000 7f4f72000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4f6c1417f0 0x7f4f6c141c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:58.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.621+0000 7f4f72000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f6c142570 con 0x7f4f6c0736f0 2024-04-26T23:44:58.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.621+0000 7f4f72000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4f6c0cf900 con 0x7f4f6c1417f0 2024-04-26T23:44:58.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.621+0000 7f4f72000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f4f6c0cfbe0 con 0x7f4f6c0cd8f0 2024-04-26T23:44:58.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.625+0000 7f4f6be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4f6c1417f0 0x7f4f6c141c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:58.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.625+0000 7f4f6be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4f6c1417f0 0x7f4f6c141c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38582/0 (socket says 172.21.15.137:38582) 2024-04-26T23:44:58.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.625+0000 7f4f6be00640 1 -- 172.21.15.137:0/3987318156 learned_addr learned my addr 172.21.15.137:0/3987318156 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:58.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.625+0000 7f4f6aa00640 1 --2- 172.21.15.137:0/3987318156 >> v2:172.21.15.170:3300/0 conn(0x7f4f6c0cd8f0 0x7f4f6c0cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:58.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.625+0000 7f4f6be00640 1 -- 172.21.15.137:0/3987318156 >> v2:172.21.15.170:3300/0 conn(0x7f4f6c0cd8f0 msgr2=0x7f4f6c0cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:58.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.625+0000 7f4f6be00640 1 --2- 172.21.15.137:0/3987318156 >> v2:172.21.15.170:3300/0 conn(0x7f4f6c0cd8f0 0x7f4f6c0cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.625+0000 7f4f6be00640 1 -- 172.21.15.137:0/3987318156 >> v1:172.21.15.170:6789/0 conn(0x7f4f6c0736f0 legacy=0x7f4f6c0d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:58.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.625+0000 7f4f6be00640 1 -- 172.21.15.137:0/3987318156 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6c0cfec0 con 0x7f4f6c1417f0 2024-04-26T23:44:58.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.625+0000 7f4f6be00640 1 --2- 172.21.15.137:0/3987318156 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c1417f0 0x7f4f6c141c40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c06ce90 tx=0x7f4f6401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a06095d3cbc3d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:58.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.625+0000 7f4f6a000640 1 -- 172.21.15.137:0/3987318156 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f640ab430 con 0x7f4f6c1417f0 2024-04-26T23:44:58.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.625+0000 7f4f6a000640 1 -- 172.21.15.137:0/3987318156 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f640b0070 con 0x7f4f6c1417f0 2024-04-26T23:44:58.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.625+0000 7f4f6a000640 1 -- 172.21.15.137:0/3987318156 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f640ab7f0 con 0x7f4f6c1417f0 2024-04-26T23:44:58.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f72000640 1 -- 172.21.15.137:0/3987318156 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c1417f0 msgr2=0x7f4f6c141c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:58.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f72000640 1 --2- 172.21.15.137:0/3987318156 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c1417f0 0x7f4f6c141c40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c06ce90 tx=0x7f4f6401c520 comp rx=0 tx=0).stop 2024-04-26T23:44:58.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f72000640 1 -- 172.21.15.137:0/3987318156 shutdown_connections 2024-04-26T23:44:58.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f72000640 1 --2- 172.21.15.137:0/3987318156 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c1417f0 0x7f4f6c141c40 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f72000640 1 --2- 172.21.15.137:0/3987318156 >> v2:172.21.15.170:3300/0 conn(0x7f4f6c0cd8f0 0x7f4f6c0cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f72000640 1 -- 172.21.15.137:0/3987318156 >> 172.21.15.137:0/3987318156 conn(0x7f4f6c06f840 msgr2=0x7f4f6c06c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:58.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f72000640 1 -- 172.21.15.137:0/3987318156 shutdown_connections 2024-04-26T23:44:58.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f72000640 1 -- 172.21.15.137:0/3987318156 wait complete. 2024-04-26T23:44:58.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f72000640 1 Processor -- start 2024-04-26T23:44:58.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f72000640 1 -- start start 2024-04-26T23:44:58.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f72000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f6c0736f0 0x7f4f6c0b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:58.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f72000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c0cd8f0 0x7f4f6c0b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:58.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f72000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f6c1417f0 0x7f4f6c158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:58.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f72000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c072bf0 con 0x7f4f6c0cd8f0 2024-04-26T23:44:58.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f72000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c072a70 con 0x7f4f6c0736f0 2024-04-26T23:44:58.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f72000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4f6c072d70 con 0x7f4f6c1417f0 2024-04-26T23:44:58.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f6aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c0cd8f0 0x7f4f6c0b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:58.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f6aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c0cd8f0 0x7f4f6c0b34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38594/0 (socket says 172.21.15.137:38594) 2024-04-26T23:44:58.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f6aa00640 1 -- 172.21.15.137:0/1913884449 learned_addr learned my addr 172.21.15.137:0/1913884449 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:58.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f6be00640 1 --2- 172.21.15.137:0/1913884449 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f6c1417f0 0x7f4f6c158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:58.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f6b400640 1 --2- 172.21.15.137:0/1913884449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f6c0736f0 0x7f4f6c0b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:58.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f6aa00640 1 -- 172.21.15.137:0/1913884449 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f6c1417f0 msgr2=0x7f4f6c158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:58.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f6aa00640 1 --2- 172.21.15.137:0/1913884449 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f6c1417f0 0x7f4f6c158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f6aa00640 1 -- 172.21.15.137:0/1913884449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f6c0736f0 msgr2=0x7f4f6c0b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:58.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f6aa00640 1 --2- 172.21.15.137:0/1913884449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f6c0736f0 0x7f4f6c0b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.629+0000 7f4f6aa00640 1 -- 172.21.15.137:0/1913884449 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6c13c540 con 0x7f4f6c0cd8f0 2024-04-26T23:44:58.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.633+0000 7f4f6aa00640 1 --2- 172.21.15.137:0/1913884449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c0cd8f0 0x7f4f6c0b34e0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f4f5800e930 tx=0x7f4f5800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:58.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.633+0000 7f4f63400640 1 -- 172.21.15.137:0/1913884449 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f58017070 con 0x7f4f6c0cd8f0 2024-04-26T23:44:58.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.633+0000 7f4f63400640 1 -- 172.21.15.137:0/1913884449 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f5800c9a0 con 0x7f4f6c0cd8f0 2024-04-26T23:44:58.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.633+0000 7f4f63400640 1 -- 172.21.15.137:0/1913884449 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5800cd50 con 0x7f4f6c0cd8f0 2024-04-26T23:44:58.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.633+0000 7f4f72000640 1 -- 172.21.15.137:0/1913884449 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f6c0b1df0 con 0x7f4f6c0cd8f0 2024-04-26T23:44:58.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.633+0000 7f4f72000640 1 -- 172.21.15.137:0/1913884449 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f6c13c7e0 con 0x7f4f6c0cd8f0 2024-04-26T23:44:58.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.633+0000 7f4f72000640 1 -- 172.21.15.137:0/1913884449 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f6c076710 con 0x7f4f6c0cd8f0 2024-04-26T23:44:58.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.633+0000 7f4f63400640 1 -- 172.21.15.137:0/1913884449 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4f5801a070 con 0x7f4f6c0cd8f0 2024-04-26T23:44:58.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.633+0000 7f4f63400640 1 --2- 172.21.15.137:0/1913884449 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4f4c068380 0x7f4f4c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:58.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.633+0000 7f4f63400640 1 -- 172.21.15.137:0/1913884449 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f4f58086860 con 0x7f4f6c0cd8f0 2024-04-26T23:44:58.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.633+0000 7f4f6b400640 1 --2- 172.21.15.137:0/1913884449 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4f4c068380 0x7f4f4c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:58.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.637+0000 7f4f6b400640 1 --2- 172.21.15.137:0/1913884449 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4f4c068380 0x7f4f4c06a840 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c001e00 tx=0x7f4f5c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:58.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.637+0000 7f4f63400640 1 -- 172.21.15.137:0/1913884449 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4f58056920 con 0x7f4f6c0cd8f0 2024-04-26T23:44:58.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.797+0000 7f4f72000640 1 -- 172.21.15.137:0/1913884449 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4f6c166a80 con 0x7f4f6c0cd8f0 2024-04-26T23:44:58.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.797+0000 7f4f63400640 1 -- 172.21.15.137:0/1913884449 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) ==== 93+0+10 (secure 0 0 0) 0x7f4f58086020 con 0x7f4f6c0cd8f0 2024-04-26T23:44:58.802 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T23:44:58.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.797+0000 7f4f72000640 1 -- 172.21.15.137:0/1913884449 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4f4c068380 msgr2=0x7f4f4c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:58.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.797+0000 7f4f72000640 1 --2- 172.21.15.137:0/1913884449 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4f4c068380 0x7f4f4c06a840 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c001e00 tx=0x7f4f5c009040 comp rx=0 tx=0).stop 2024-04-26T23:44:58.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.797+0000 7f4f72000640 1 -- 172.21.15.137:0/1913884449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c0cd8f0 msgr2=0x7f4f6c0b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:58.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.797+0000 7f4f72000640 1 --2- 172.21.15.137:0/1913884449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c0cd8f0 0x7f4f6c0b34e0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f4f5800e930 tx=0x7f4f5800edf0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.797+0000 7f4f72000640 1 -- 172.21.15.137:0/1913884449 shutdown_connections 2024-04-26T23:44:58.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.797+0000 7f4f72000640 1 --2- 172.21.15.137:0/1913884449 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4f4c068380 0x7f4f4c06a840 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.797+0000 7f4f72000640 1 --2- 172.21.15.137:0/1913884449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c0cd8f0 0x7f4f6c0b34e0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.797+0000 7f4f72000640 1 --2- 172.21.15.137:0/1913884449 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f6c1417f0 0x7f4f6c158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.797+0000 7f4f72000640 1 --2- 172.21.15.137:0/1913884449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f6c0736f0 0x7f4f6c0b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.797+0000 7f4f72000640 1 -- 172.21.15.137:0/1913884449 >> 172.21.15.137:0/1913884449 conn(0x7f4f6c06f840 msgr2=0x7f4f6c13e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:58.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.797+0000 7f4f72000640 1 -- 172.21.15.137:0/1913884449 shutdown_connections 2024-04-26T23:44:58.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.797+0000 7f4f72000640 1 -- 172.21.15.137:0/1913884449 wait complete. 2024-04-26T23:44:58.823 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:44:58.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.957+0000 7f4f12000640 1 Processor -- start 2024-04-26T23:44:58.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.957+0000 7f4f12000640 1 -- start start 2024-04-26T23:44:58.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.957+0000 7f4f12000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4f0c0736f0 0x7f4f0c0d06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:58.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.957+0000 7f4f12000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4f0c141f00 0x7f4f0c0cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:58.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.957+0000 7f4f12000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f0c142570 con 0x7f4f0c0cd8f0 2024-04-26T23:44:58.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.957+0000 7f4f12000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4f0c142350 con 0x7f4f0c141f00 2024-04-26T23:44:58.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.957+0000 7f4f12000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f4f0c0cf900 con 0x7f4f0c0736f0 2024-04-26T23:44:58.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.957+0000 7f4f0be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4f0c141f00 0x7f4f0c0cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:58.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.957+0000 7f4f0be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4f0c141f00 0x7f4f0c0cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38606/0 (socket says 172.21.15.137:38606) 2024-04-26T23:44:58.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.957+0000 7f4f0be00640 1 -- 172.21.15.137:0/3622345701 learned_addr learned my addr 172.21.15.137:0/3622345701 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:58.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.957+0000 7f4f0b400640 1 --2- 172.21.15.137:0/3622345701 >> v2:172.21.15.170:3300/0 conn(0x7f4f0c0736f0 0x7f4f0c0d06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:58.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.957+0000 7f4f0b400640 1 -- 172.21.15.137:0/3622345701 >> v2:172.21.15.137:3300/0 conn(0x7f4f0c141f00 msgr2=0x7f4f0c0cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:58.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.957+0000 7f4f0b400640 1 --2- 172.21.15.137:0/3622345701 >> v2:172.21.15.137:3300/0 conn(0x7f4f0c141f00 0x7f4f0c0cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.961+0000 7f4f0b400640 1 -- 172.21.15.137:0/3622345701 >> v1:172.21.15.170:6789/0 conn(0x7f4f0c0cd8f0 legacy=0x7f4f0c1417f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:58.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.961+0000 7f4f0b400640 1 -- 172.21.15.137:0/3622345701 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f0c0cfbe0 con 0x7f4f0c0736f0 2024-04-26T23:44:58.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.961+0000 7f4f0be00640 1 --2- 172.21.15.137:0/3622345701 >> v2:172.21.15.137:3300/0 conn(0x7f4f0c141f00 0x7f4f0c0cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:44:58.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.961+0000 7f4f0b400640 1 --2- 172.21.15.137:0/3622345701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f0c0736f0 0x7f4f0c0d06c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c070370 tx=0x7f4efc01c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffb275483b9dd8e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:58.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.961+0000 7f4f0aa00640 1 -- 172.21.15.137:0/3622345701 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc0b2070 con 0x7f4f0c0736f0 2024-04-26T23:44:58.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.961+0000 7f4f0aa00640 1 -- 172.21.15.137:0/3622345701 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4efc0a58e0 con 0x7f4f0c0736f0 2024-04-26T23:44:58.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.961+0000 7f4f0aa00640 1 -- 172.21.15.137:0/3622345701 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc0a5cb0 con 0x7f4f0c0736f0 2024-04-26T23:44:58.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.961+0000 7f4f12000640 1 -- 172.21.15.137:0/3622345701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f0c0736f0 msgr2=0x7f4f0c0d06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:58.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.961+0000 7f4f12000640 1 --2- 172.21.15.137:0/3622345701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f0c0736f0 0x7f4f0c0d06c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c070370 tx=0x7f4efc01c930 comp rx=0 tx=0).stop 2024-04-26T23:44:58.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.961+0000 7f4f12000640 1 -- 172.21.15.137:0/3622345701 shutdown_connections 2024-04-26T23:44:58.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.961+0000 7f4f12000640 1 --2- 172.21.15.137:0/3622345701 >> v2:172.21.15.137:3300/0 conn(0x7f4f0c141f00 0x7f4f0c0cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.961+0000 7f4f12000640 1 --2- 172.21.15.137:0/3622345701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f0c0736f0 0x7f4f0c0d06c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.961+0000 7f4f12000640 1 -- 172.21.15.137:0/3622345701 >> 172.21.15.137:0/3622345701 conn(0x7f4f0c06f840 msgr2=0x7f4f0c06c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:58.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.961+0000 7f4f12000640 1 -- 172.21.15.137:0/3622345701 shutdown_connections 2024-04-26T23:44:58.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.961+0000 7f4f12000640 1 -- 172.21.15.137:0/3622345701 wait complete. 2024-04-26T23:44:58.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f12000640 1 Processor -- start 2024-04-26T23:44:58.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f12000640 1 -- start start 2024-04-26T23:44:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f12000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f0c0736f0 0x7f4f0c158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f12000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f0c0cd8f0 0x7f4f0c0b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f12000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f0c141f00 0x7f4f0c0b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f12000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0c073c50 con 0x7f4f0c0cd8f0 2024-04-26T23:44:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f12000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0c073ad0 con 0x7f4f0c0736f0 2024-04-26T23:44:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f12000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4f0c072a70 con 0x7f4f0c141f00 2024-04-26T23:44:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f02a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f0c0cd8f0 0x7f4f0c0b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f02a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f0c0cd8f0 0x7f4f0c0b4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38616/0 (socket says 172.21.15.137:38616) 2024-04-26T23:44:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f02a00640 1 -- 172.21.15.137:0/2612760125 learned_addr learned my addr 172.21.15.137:0/2612760125 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f0b400640 1 --2- 172.21.15.137:0/2612760125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f0c0736f0 0x7f4f0c158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f0be00640 1 --2- 172.21.15.137:0/2612760125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f0c141f00 0x7f4f0c0b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f02a00640 1 -- 172.21.15.137:0/2612760125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f0c141f00 msgr2=0x7f4f0c0b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f02a00640 1 --2- 172.21.15.137:0/2612760125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f0c141f00 0x7f4f0c0b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f02a00640 1 -- 172.21.15.137:0/2612760125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f0c0736f0 msgr2=0x7f4f0c158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:58.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f02a00640 1 --2- 172.21.15.137:0/2612760125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f0c0736f0 0x7f4f0c158990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:58.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f02a00640 1 -- 172.21.15.137:0/2612760125 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f0c157bd0 con 0x7f4f0c0cd8f0 2024-04-26T23:44:58.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f02a00640 1 --2- 172.21.15.137:0/2612760125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f0c0cd8f0 0x7f4f0c0b4fb0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400c420 tx=0x7f4ef400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:58.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f03e00640 1 -- 172.21.15.137:0/2612760125 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef40052d0 con 0x7f4f0c0cd8f0 2024-04-26T23:44:58.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f03e00640 1 -- 172.21.15.137:0/2612760125 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef4005470 con 0x7f4f0c0cd8f0 2024-04-26T23:44:58.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f12000640 1 -- 172.21.15.137:0/2612760125 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f0c157eb0 con 0x7f4f0c0cd8f0 2024-04-26T23:44:58.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f03e00640 1 -- 172.21.15.137:0/2612760125 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef4007260 con 0x7f4f0c0cd8f0 2024-04-26T23:44:58.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.965+0000 7f4f12000640 1 -- 172.21.15.137:0/2612760125 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f0c158470 con 0x7f4f0c0cd8f0 2024-04-26T23:44:58.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.969+0000 7f4f12000640 1 -- 172.21.15.137:0/2612760125 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f0c158670 con 0x7f4f0c0cd8f0 2024-04-26T23:44:58.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.969+0000 7f4f03e00640 1 -- 172.21.15.137:0/2612760125 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4ef4007400 con 0x7f4f0c0cd8f0 2024-04-26T23:44:58.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.969+0000 7f4f03e00640 1 --2- 172.21.15.137:0/2612760125 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4ee80683b0 0x7f4ee806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:58.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.969+0000 7f4f03e00640 1 -- 172.21.15.137:0/2612760125 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f4ef4085d40 con 0x7f4f0c0cd8f0 2024-04-26T23:44:58.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.969+0000 7f4f0b400640 1 --2- 172.21.15.137:0/2612760125 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4ee80683b0 0x7f4ee806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:58.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.969+0000 7f4f0b400640 1 --2- 172.21.15.137:0/2612760125 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4ee80683b0 0x7f4ee806a870 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0af000 tx=0x7f4efc0a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:58.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:58.973+0000 7f4f03e00640 1 -- 172.21.15.137:0/2612760125 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4f0c158670 con 0x7f4f0c0cd8f0 2024-04-26T23:44:59.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.129+0000 7f4f12000640 1 -- 172.21.15.137:0/2612760125 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4f0c074280 con 0x7f4f0c0cd8f0 2024-04-26T23:44:59.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.129+0000 7f4f03e00640 1 -- 172.21.15.137:0/2612760125 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) ==== 104+0+11 (secure 0 0 0) 0x7f4ef4055d40 con 0x7f4f0c0cd8f0 2024-04-26T23:44:59.135 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T23:44:59.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.133+0000 7f4f12000640 1 -- 172.21.15.137:0/2612760125 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4ee80683b0 msgr2=0x7f4ee806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:59.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.133+0000 7f4f12000640 1 --2- 172.21.15.137:0/2612760125 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4ee80683b0 0x7f4ee806a870 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0af000 tx=0x7f4efc0a7070 comp rx=0 tx=0).stop 2024-04-26T23:44:59.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.133+0000 7f4f12000640 1 -- 172.21.15.137:0/2612760125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f0c0cd8f0 msgr2=0x7f4f0c0b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:59.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.133+0000 7f4f12000640 1 --2- 172.21.15.137:0/2612760125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f0c0cd8f0 0x7f4f0c0b4fb0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400c420 tx=0x7f4ef400c8e0 comp rx=0 tx=0).stop 2024-04-26T23:44:59.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.133+0000 7f4f12000640 1 -- 172.21.15.137:0/2612760125 shutdown_connections 2024-04-26T23:44:59.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.133+0000 7f4f12000640 1 --2- 172.21.15.137:0/2612760125 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4ee80683b0 0x7f4ee806a870 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:59.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.133+0000 7f4f12000640 1 --2- 172.21.15.137:0/2612760125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f0c0cd8f0 0x7f4f0c0b4fb0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:59.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.133+0000 7f4f12000640 1 --2- 172.21.15.137:0/2612760125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f0c141f00 0x7f4f0c0b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:59.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.133+0000 7f4f12000640 1 --2- 172.21.15.137:0/2612760125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f0c0736f0 0x7f4f0c158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:59.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.133+0000 7f4f12000640 1 -- 172.21.15.137:0/2612760125 >> 172.21.15.137:0/2612760125 conn(0x7f4f0c06f840 msgr2=0x7f4f0c06e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:59.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.133+0000 7f4f12000640 1 -- 172.21.15.137:0/2612760125 shutdown_connections 2024-04-26T23:44:59.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.133+0000 7f4f12000640 1 -- 172.21.15.137:0/2612760125 wait complete. 2024-04-26T23:44:59.156 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:44:59.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.289+0000 7fcbea600640 1 Processor -- start 2024-04-26T23:44:59.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.293+0000 7fcbea600640 1 -- start start 2024-04-26T23:44:59.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.293+0000 7fcbea600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcbe40cdb50 0x7fcbe40b0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:59.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.293+0000 7fcbea600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbe40b06c0 0x7fcbe40cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:59.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.293+0000 7fcbea600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbe40ce470 con 0x7fcbe40d07e0 2024-04-26T23:44:59.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.293+0000 7fcbea600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fcbe4070240 con 0x7fcbe40cdb50 2024-04-26T23:44:59.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.293+0000 7fcbea600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe4162cd0 con 0x7fcbe40b06c0 2024-04-26T23:44:59.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.293+0000 7fcbe3400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcbe40cdb50 0x7fcbe40b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:59.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.293+0000 7fcbe3400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcbe40cdb50 0x7fcbe40b0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38632/0 (socket says 172.21.15.137:38632) 2024-04-26T23:44:59.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.293+0000 7fcbe3400640 1 -- 172.21.15.137:0/241270781 learned_addr learned my addr 172.21.15.137:0/241270781 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:59.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.293+0000 7fcbdbe00640 1 --2- 172.21.15.137:0/241270781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbe40b06c0 0x7fcbe40cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:59.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.293+0000 7fcbe3400640 1 -- 172.21.15.137:0/241270781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbe40b06c0 msgr2=0x7fcbe40cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:59.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.293+0000 7fcbe3400640 1 --2- 172.21.15.137:0/241270781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbe40b06c0 0x7fcbe40cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:59.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.293+0000 7fcbe3400640 1 -- 172.21.15.137:0/241270781 >> v1:172.21.15.170:6789/0 conn(0x7fcbe40d07e0 legacy=0x7fcbe40cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:59.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.293+0000 7fcbe3400640 1 -- 172.21.15.137:0/241270781 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe406fe70 con 0x7fcbe40cdb50 2024-04-26T23:44:59.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.297+0000 7fcbe3400640 1 --2- 172.21.15.137:0/241270781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbe40cdb50 0x7fcbe40b0150 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009870 tx=0x7fcbd401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237078dccc5c6ce3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:59.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.297+0000 7fcbe2a00640 1 -- 172.21.15.137:0/241270781 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd40b0070 con 0x7fcbe40cdb50 2024-04-26T23:44:59.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.297+0000 7fcbe2a00640 1 -- 172.21.15.137:0/241270781 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbd40ab600 con 0x7fcbe40cdb50 2024-04-26T23:44:59.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.297+0000 7fcbe2a00640 1 -- 172.21.15.137:0/241270781 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd40ab9d0 con 0x7fcbe40cdb50 2024-04-26T23:44:59.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.297+0000 7fcbea600640 1 -- 172.21.15.137:0/241270781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbe40cdb50 msgr2=0x7fcbe40b0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:59.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.297+0000 7fcbea600640 1 --2- 172.21.15.137:0/241270781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbe40cdb50 0x7fcbe40b0150 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009870 tx=0x7fcbd401c520 comp rx=0 tx=0).stop 2024-04-26T23:44:59.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.297+0000 7fcbea600640 1 -- 172.21.15.137:0/241270781 shutdown_connections 2024-04-26T23:44:59.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.297+0000 7fcbea600640 1 --2- 172.21.15.137:0/241270781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbe40b06c0 0x7fcbe40cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:59.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.297+0000 7fcbea600640 1 --2- 172.21.15.137:0/241270781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbe40cdb50 0x7fcbe40b0150 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:59.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.297+0000 7fcbea600640 1 -- 172.21.15.137:0/241270781 >> 172.21.15.137:0/241270781 conn(0x7fcbe40b2d50 msgr2=0x7fcbe40b3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:59.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.297+0000 7fcbea600640 1 -- 172.21.15.137:0/241270781 shutdown_connections 2024-04-26T23:44:59.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.297+0000 7fcbea600640 1 -- 172.21.15.137:0/241270781 wait complete. 2024-04-26T23:44:59.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.297+0000 7fcbea600640 1 Processor -- start 2024-04-26T23:44:59.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.297+0000 7fcbea600640 1 -- start start 2024-04-26T23:44:59.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbea600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbe40b06c0 0x7fcbe41583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:59.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbea600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbe40cdb50 0x7fcbe40b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:59.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbea600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbe40d07e0 0x7fcbe40c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:59.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbea600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe40747e0 con 0x7fcbe40d07e0 2024-04-26T23:44:59.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbea600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe40cbee0 con 0x7fcbe40b06c0 2024-04-26T23:44:59.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbea600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe40706d0 con 0x7fcbe40cdb50 2024-04-26T23:44:59.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbe3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbe40d07e0 0x7fcbe40c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:59.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbe3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbe40d07e0 0x7fcbe40c6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38640/0 (socket says 172.21.15.137:38640) 2024-04-26T23:44:59.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbe3e00640 1 -- 172.21.15.137:0/3559881675 learned_addr learned my addr 172.21.15.137:0/3559881675 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:59.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbe3400640 1 --2- 172.21.15.137:0/3559881675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbe40b06c0 0x7fcbe41583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:59.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbdbe00640 1 --2- 172.21.15.137:0/3559881675 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbe40cdb50 0x7fcbe40b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:59.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbe3e00640 1 -- 172.21.15.137:0/3559881675 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbe40cdb50 msgr2=0x7fcbe40b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:59.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbe3e00640 1 --2- 172.21.15.137:0/3559881675 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbe40cdb50 0x7fcbe40b58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:59.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbe3e00640 1 -- 172.21.15.137:0/3559881675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbe40b06c0 msgr2=0x7fcbe41583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:59.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbe3e00640 1 --2- 172.21.15.137:0/3559881675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbe40b06c0 0x7fcbe41583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:59.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbe3e00640 1 -- 172.21.15.137:0/3559881675 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe4158af0 con 0x7fcbe40d07e0 2024-04-26T23:44:59.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbe3e00640 1 --2- 172.21.15.137:0/3559881675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbe40d07e0 0x7fcbe40c6cc0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00c780 tx=0x7fcbdc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:59.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbdb400640 1 -- 172.21.15.137:0/3559881675 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc004b70 con 0x7fcbe40d07e0 2024-04-26T23:44:59.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbdb400640 1 -- 172.21.15.137:0/3559881675 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbdc004d10 con 0x7fcbe40d07e0 2024-04-26T23:44:59.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbea600640 1 -- 172.21.15.137:0/3559881675 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe4158d90 con 0x7fcbe40d07e0 2024-04-26T23:44:59.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbdb400640 1 -- 172.21.15.137:0/3559881675 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc00aa30 con 0x7fcbe40d07e0 2024-04-26T23:44:59.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbea600640 1 -- 172.21.15.137:0/3559881675 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe4159350 con 0x7fcbe40d07e0 2024-04-26T23:44:59.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbea600640 1 -- 172.21.15.137:0/3559881675 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe4076710 con 0x7fcbe40d07e0 2024-04-26T23:44:59.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.301+0000 7fcbdb400640 1 -- 172.21.15.137:0/3559881675 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcbdc00abd0 con 0x7fcbe40d07e0 2024-04-26T23:44:59.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.305+0000 7fcbdb400640 1 --2- 172.21.15.137:0/3559881675 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fcbc0068380 0x7fcbc006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:59.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.305+0000 7fcbdb400640 1 -- 172.21.15.137:0/3559881675 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fcbdc086a50 con 0x7fcbe40d07e0 2024-04-26T23:44:59.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.305+0000 7fcbe3400640 1 --2- 172.21.15.137:0/3559881675 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fcbc0068380 0x7fcbc006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:59.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.305+0000 7fcbe3400640 1 --2- 172.21.15.137:0/3559881675 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fcbc0068380 0x7fcbc006a840 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcbd40ad000 tx=0x7fcbd40a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:59.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.309+0000 7fcbdb400640 1 -- 172.21.15.137:0/3559881675 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcbdc020070 con 0x7fcbe40d07e0 2024-04-26T23:44:59.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.465+0000 7fcbea600640 1 -- 172.21.15.137:0/3559881675 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcbe415dc20 con 0x7fcbe40d07e0 2024-04-26T23:44:59.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.465+0000 7fcbdb400640 1 -- 172.21.15.137:0/3559881675 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) ==== 100+0+11 (secure 0 0 0) 0x7fcbdc0569b0 con 0x7fcbe40d07e0 2024-04-26T23:44:59.469 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T23:44:59.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.465+0000 7fcbea600640 1 -- 172.21.15.137:0/3559881675 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fcbc0068380 msgr2=0x7fcbc006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:59.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.465+0000 7fcbea600640 1 --2- 172.21.15.137:0/3559881675 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fcbc0068380 0x7fcbc006a840 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcbd40ad000 tx=0x7fcbd40a6000 comp rx=0 tx=0).stop 2024-04-26T23:44:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.465+0000 7fcbea600640 1 -- 172.21.15.137:0/3559881675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbe40d07e0 msgr2=0x7fcbe40c6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.465+0000 7fcbea600640 1 --2- 172.21.15.137:0/3559881675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbe40d07e0 0x7fcbe40c6cc0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00c780 tx=0x7fcbdc00cc40 comp rx=0 tx=0).stop 2024-04-26T23:44:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.465+0000 7fcbea600640 1 -- 172.21.15.137:0/3559881675 shutdown_connections 2024-04-26T23:44:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.465+0000 7fcbea600640 1 --2- 172.21.15.137:0/3559881675 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fcbc0068380 0x7fcbc006a840 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.465+0000 7fcbea600640 1 --2- 172.21.15.137:0/3559881675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbe40d07e0 0x7fcbe40c6cc0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.465+0000 7fcbea600640 1 --2- 172.21.15.137:0/3559881675 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbe40cdb50 0x7fcbe40b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.465+0000 7fcbea600640 1 --2- 172.21.15.137:0/3559881675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbe40b06c0 0x7fcbe41583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.465+0000 7fcbea600640 1 -- 172.21.15.137:0/3559881675 >> 172.21.15.137:0/3559881675 conn(0x7fcbe40b2d50 msgr2=0x7fcbe41607b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.465+0000 7fcbea600640 1 -- 172.21.15.137:0/3559881675 shutdown_connections 2024-04-26T23:44:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.465+0000 7fcbea600640 1 -- 172.21.15.137:0/3559881675 wait complete. 2024-04-26T23:44:59.491 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:44:59.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.625+0000 7f6a9b800640 1 Processor -- start 2024-04-26T23:44:59.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.625+0000 7f6a9b800640 1 -- start start 2024-04-26T23:44:59.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.625+0000 7f6a9b800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6a9406cf30 0x7f6a94073680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:59.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.625+0000 7f6a9b800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a940b53c0 con 0x7f6a94144e00 2024-04-26T23:44:59.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.625+0000 7f6a9b800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a940b56a0 con 0x7f6a940b6180 2024-04-26T23:44:59.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.625+0000 7f6a9b800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6a941451e0 con 0x7f6a9406cf30 2024-04-26T23:44:59.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.625+0000 7f6a98e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f6a94144e00 0x7f6a9406c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46994/0 (socket says 172.21.15.137:46994) 2024-04-26T23:44:59.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.625+0000 7f6a93e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6a9406cf30 0x7f6a94073680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:59.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.625+0000 7f6a98e00640 1 -- 172.21.15.137:0/4158289178 learned_addr learned my addr 172.21.15.137:0/4158289178 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:59.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.625+0000 7f6a93e00640 1 -- 172.21.15.137:0/4158289178 >> v1:172.21.15.170:6789/0 conn(0x7f6a940b6180 legacy=0x7f6a94073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:59.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.625+0000 7f6a93e00640 1 -- 172.21.15.137:0/4158289178 >> v1:172.21.15.137:6789/0 conn(0x7f6a94144e00 legacy=0x7f6a9406c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:59.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.625+0000 7f6a93e00640 1 -- 172.21.15.137:0/4158289178 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a940b5980 con 0x7f6a9406cf30 2024-04-26T23:44:59.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.629+0000 7f6a93e00640 1 --2- 172.21.15.137:0/4158289178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a9406cf30 0x7f6a94073680 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f6a800097c0 tx=0x7f6a8001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c1373cf720f121 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:59.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.629+0000 7f6a93400640 1 -- 172.21.15.137:0/4158289178 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a800b0070 con 0x7f6a9406cf30 2024-04-26T23:44:59.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.629+0000 7f6a93400640 1 -- 172.21.15.137:0/4158289178 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a800ab600 con 0x7f6a9406cf30 2024-04-26T23:44:59.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.629+0000 7f6a93400640 1 -- 172.21.15.137:0/4158289178 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a800ab9d0 con 0x7f6a9406cf30 2024-04-26T23:44:59.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.629+0000 7f6a9b800640 1 -- 172.21.15.137:0/4158289178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a9406cf30 msgr2=0x7f6a94073680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:59.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.629+0000 7f6a9b800640 1 --2- 172.21.15.137:0/4158289178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a9406cf30 0x7f6a94073680 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f6a800097c0 tx=0x7f6a8001c410 comp rx=0 tx=0).stop 2024-04-26T23:44:59.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.629+0000 7f6a9b800640 1 -- 172.21.15.137:0/4158289178 shutdown_connections 2024-04-26T23:44:59.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.629+0000 7f6a9b800640 1 --2- 172.21.15.137:0/4158289178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a9406cf30 0x7f6a94073680 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:59.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.629+0000 7f6a9b800640 1 -- 172.21.15.137:0/4158289178 >> 172.21.15.137:0/4158289178 conn(0x7f6a9406f840 msgr2=0x7f6a9406fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:59.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.629+0000 7f6a9b800640 1 -- 172.21.15.137:0/4158289178 shutdown_connections 2024-04-26T23:44:59.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.629+0000 7f6a9b800640 1 -- 172.21.15.137:0/4158289178 wait complete. 2024-04-26T23:44:59.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a9b800640 1 Processor -- start 2024-04-26T23:44:59.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a9b800640 1 -- start start 2024-04-26T23:44:59.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a9b800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a9406cf30 0x7f6a9415a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:59.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a9b800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a940b6180 0x7f6a9413f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:59.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a9b800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a94144e00 0x7f6a941427a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:59.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a9b800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6a94169b70 con 0x7f6a94144e00 2024-04-26T23:44:59.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a9b800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6a941699f0 con 0x7f6a9406cf30 2024-04-26T23:44:59.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a9b800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6a94169cf0 con 0x7f6a940b6180 2024-04-26T23:44:59.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a99800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a94144e00 0x7f6a941427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:59.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a99800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a94144e00 0x7f6a941427a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38668/0 (socket says 172.21.15.137:38668) 2024-04-26T23:44:59.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a99800640 1 -- 172.21.15.137:0/3841268524 learned_addr learned my addr 172.21.15.137:0/3841268524 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:44:59.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a99800640 1 -- 172.21.15.137:0/3841268524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a940b6180 msgr2=0x7f6a9413f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:59.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a93e00640 1 --2- 172.21.15.137:0/3841268524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a940b6180 0x7f6a9413f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:59.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a98e00640 1 --2- 172.21.15.137:0/3841268524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a9406cf30 0x7f6a9415a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:59.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a99800640 1 --2- 172.21.15.137:0/3841268524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a940b6180 0x7f6a9413f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:59.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a99800640 1 -- 172.21.15.137:0/3841268524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a9406cf30 msgr2=0x7f6a9415a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:59.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a99800640 1 --2- 172.21.15.137:0/3841268524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a9406cf30 0x7f6a9415a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:59.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a99800640 1 -- 172.21.15.137:0/3841268524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9413f8e0 con 0x7f6a94144e00 2024-04-26T23:44:59.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a93e00640 1 --2- 172.21.15.137:0/3841268524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a940b6180 0x7f6a9413f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:59.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a98e00640 1 --2- 172.21.15.137:0/3841268524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a9406cf30 0x7f6a9415a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:59.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a99800640 1 --2- 172.21.15.137:0/3841268524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a94144e00 0x7f6a941427a0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00c340 tx=0x7f6a8c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:59.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a90c00640 1 -- 172.21.15.137:0/3841268524 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c005220 con 0x7f6a94144e00 2024-04-26T23:44:59.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a90c00640 1 -- 172.21.15.137:0/3841268524 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a8c0053c0 con 0x7f6a94144e00 2024-04-26T23:44:59.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a9b800640 1 -- 172.21.15.137:0/3841268524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a9413fbc0 con 0x7f6a94144e00 2024-04-26T23:44:59.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a90c00640 1 -- 172.21.15.137:0/3841268524 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c007270 con 0x7f6a94144e00 2024-04-26T23:44:59.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.633+0000 7f6a9b800640 1 -- 172.21.15.137:0/3841268524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a9413fea0 con 0x7f6a94144e00 2024-04-26T23:44:59.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.637+0000 7f6a9b800640 1 -- 172.21.15.137:0/3841268524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a94076710 con 0x7f6a94144e00 2024-04-26T23:44:59.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.637+0000 7f6a90c00640 1 -- 172.21.15.137:0/3841268524 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6a8c019020 con 0x7f6a94144e00 2024-04-26T23:44:59.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.637+0000 7f6a90c00640 1 --2- 172.21.15.137:0/3841268524 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6a74068380 0x7f6a7406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:59.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.637+0000 7f6a90c00640 1 -- 172.21.15.137:0/3841268524 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f6a8c085cb0 con 0x7f6a94144e00 2024-04-26T23:44:59.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.637+0000 7f6a98e00640 1 --2- 172.21.15.137:0/3841268524 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6a74068380 0x7f6a7406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:59.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.637+0000 7f6a98e00640 1 --2- 172.21.15.137:0/3841268524 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6a74068380 0x7f6a7406a840 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6a84005c10 tx=0x7f6a84009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:59.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.641+0000 7f6a90c00640 1 -- 172.21.15.137:0/3841268524 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6a8c055c10 con 0x7f6a94144e00 2024-04-26T23:44:59.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.829+0000 7f6a9b800640 1 -- 172.21.15.137:0/3841268524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a940b0220 con 0x7f6a94144e00 2024-04-26T23:44:59.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.833+0000 7f6a90c00640 1 -- 172.21.15.137:0/3841268524 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5190 (secure 0 0 0) 0x7f6a8c059f10 con 0x7f6a94144e00 2024-04-26T23:44:59.836 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:44:59.836 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6064,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2903000554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2903000554},{"type":"v1","addr":"172.21.15.170:6834","nonce":2903000554}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6372,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/2879053849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2879053849},{"type":"v1","addr":"172.21.15.137:6836","nonce":2879053849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3081576837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3081576837},{"type":"v1","addr":"172.21.15.137:6837","nonce":3081576837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:44:21.180357+0000","modified":"2024-04-26T23:44:24.204261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6381":{"gid":6381,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/141729149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":141729149},{"type":"v1","addr":"172.21.15.170:6835","nonce":141729149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6381,"qdb_cluster":[6381]},"id":4}]} 2024-04-26T23:44:59.836 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 37 2024-04-26T23:44:59.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.833+0000 7f6a9b800640 1 -- 172.21.15.137:0/3841268524 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6a74068380 msgr2=0x7f6a7406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:59.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.833+0000 7f6a9b800640 1 --2- 172.21.15.137:0/3841268524 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6a74068380 0x7f6a7406a840 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6a84005c10 tx=0x7f6a84009040 comp rx=0 tx=0).stop 2024-04-26T23:44:59.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.833+0000 7f6a9b800640 1 -- 172.21.15.137:0/3841268524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a94144e00 msgr2=0x7f6a941427a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:59.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.833+0000 7f6a9b800640 1 --2- 172.21.15.137:0/3841268524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a94144e00 0x7f6a941427a0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00c340 tx=0x7f6a8c00c800 comp rx=0 tx=0).stop 2024-04-26T23:44:59.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.833+0000 7f6a9b800640 1 -- 172.21.15.137:0/3841268524 shutdown_connections 2024-04-26T23:44:59.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.833+0000 7f6a9b800640 1 --2- 172.21.15.137:0/3841268524 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6a74068380 0x7f6a7406a840 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:59.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.833+0000 7f6a9b800640 1 --2- 172.21.15.137:0/3841268524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a94144e00 0x7f6a941427a0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:59.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.833+0000 7f6a9b800640 1 --2- 172.21.15.137:0/3841268524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a940b6180 0x7f6a9413f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:59.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.833+0000 7f6a9b800640 1 --2- 172.21.15.137:0/3841268524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a9406cf30 0x7f6a9415a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:59.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.833+0000 7f6a9b800640 1 -- 172.21.15.137:0/3841268524 >> 172.21.15.137:0/3841268524 conn(0x7f6a9406f840 msgr2=0x7f6a94141290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:59.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.833+0000 7f6a9b800640 1 -- 172.21.15.137:0/3841268524 shutdown_connections 2024-04-26T23:44:59.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.833+0000 7f6a9b800640 1 -- 172.21.15.137:0/3841268524 wait complete. 2024-04-26T23:44:59.858 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:44:59.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.989+0000 7f4a61000640 1 Processor -- start 2024-04-26T23:44:59.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.989+0000 7f4a61000640 1 -- start start 2024-04-26T23:44:59.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.993+0000 7f4a61000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4a5c144e00 0x7f4a5c06c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:59.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.993+0000 7f4a61000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4a5c073d90 0x7f4a5c06cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:59.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.993+0000 7f4a61000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a5c0b53c0 con 0x7f4a5c0b6180 2024-04-26T23:44:59.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.993+0000 7f4a61000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4a5c1451e0 con 0x7f4a5c073d90 2024-04-26T23:44:59.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.993+0000 7f4a61000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f4a5c0b5cf0 con 0x7f4a5c144e00 2024-04-26T23:44:59.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.993+0000 7f4a5a800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4a5c073d90 0x7f4a5c06cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:59.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.993+0000 7f4a51400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4a5c0b6180 0x7f4a5c073680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46996/0 (socket says 172.21.15.137:46996) 2024-04-26T23:44:59.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.993+0000 7f4a51400640 1 -- 172.21.15.137:0/620167667 learned_addr learned my addr 172.21.15.137:0/620167667 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:44:59.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.993+0000 7f4a59e00640 1 --2- 172.21.15.137:0/620167667 >> v2:172.21.15.170:3300/0 conn(0x7f4a5c144e00 0x7f4a5c06c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:59.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.993+0000 7f4a59400640 1 -- 172.21.15.137:0/620167667 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3133337527 0 0) 0x7f4a5c0b53c0 con 0x7f4a5c0b6180 2024-04-26T23:44:59.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.993+0000 7f4a59400640 1 -- 172.21.15.137:0/620167667 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a40003530 con 0x7f4a5c0b6180 2024-04-26T23:44:59.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.993+0000 7f4a5a800640 1 -- 172.21.15.137:0/620167667 >> v2:172.21.15.170:3300/0 conn(0x7f4a5c144e00 msgr2=0x7f4a5c06c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:59.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.993+0000 7f4a5a800640 1 --2- 172.21.15.137:0/620167667 >> v2:172.21.15.170:3300/0 conn(0x7f4a5c144e00 0x7f4a5c06c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:59.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.993+0000 7f4a5a800640 1 -- 172.21.15.137:0/620167667 >> v1:172.21.15.137:6789/0 conn(0x7f4a5c0b6180 legacy=0x7f4a5c073680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:59.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.993+0000 7f4a5a800640 1 -- 172.21.15.137:0/620167667 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a5c0b56a0 con 0x7f4a5c073d90 2024-04-26T23:45:00.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.997+0000 7f4a5a800640 1 --2- 172.21.15.137:0/620167667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a5c073d90 0x7f4a5c06cd60 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c070580 tx=0x7f4a5401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b67e60d96c41500 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:00.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.997+0000 7f4a59400640 1 -- 172.21.15.137:0/620167667 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a540b0070 con 0x7f4a5c073d90 2024-04-26T23:45:00.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.997+0000 7f4a59400640 1 -- 172.21.15.137:0/620167667 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a540a4e50 con 0x7f4a5c073d90 2024-04-26T23:45:00.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.997+0000 7f4a59400640 1 -- 172.21.15.137:0/620167667 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a540ab800 con 0x7f4a5c073d90 2024-04-26T23:45:00.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.997+0000 7f4a61000640 1 -- 172.21.15.137:0/620167667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a5c073d90 msgr2=0x7f4a5c06cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:00.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.997+0000 7f4a61000640 1 --2- 172.21.15.137:0/620167667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a5c073d90 0x7f4a5c06cd60 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c070580 tx=0x7f4a5401c3c0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.997+0000 7f4a61000640 1 -- 172.21.15.137:0/620167667 shutdown_connections 2024-04-26T23:45:00.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.997+0000 7f4a61000640 1 --2- 172.21.15.137:0/620167667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a5c073d90 0x7f4a5c06cd60 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.997+0000 7f4a61000640 1 --2- 172.21.15.137:0/620167667 >> v2:172.21.15.170:3300/0 conn(0x7f4a5c144e00 0x7f4a5c06c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.997+0000 7f4a61000640 1 -- 172.21.15.137:0/620167667 >> 172.21.15.137:0/620167667 conn(0x7f4a5c06f840 msgr2=0x7f4a5c06fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:00.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.997+0000 7f4a61000640 1 -- 172.21.15.137:0/620167667 shutdown_connections 2024-04-26T23:45:00.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.997+0000 7f4a61000640 1 -- 172.21.15.137:0/620167667 wait complete. 2024-04-26T23:45:00.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.997+0000 7f4a61000640 1 Processor -- start 2024-04-26T23:45:00.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:44:59.997+0000 7f4a61000640 1 -- start start 2024-04-26T23:45:00.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a61000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a5c073d90 0x7f4a5c15a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:00.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a61000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a5c0b6180 0x7f4a5c0b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:00.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a61000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a5c144e00 0x7f4a5c0b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:00.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a61000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4a5c15d120 con 0x7f4a5c073d90 2024-04-26T23:45:00.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a61000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4a5c15cfa0 con 0x7f4a5c0b6180 2024-04-26T23:45:00.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a61000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4a5c15d2a0 con 0x7f4a5c144e00 2024-04-26T23:45:00.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a59e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a5c073d90 0x7f4a5c15a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:00.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a59e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a5c073d90 0x7f4a5c15a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38688/0 (socket says 172.21.15.137:38688) 2024-04-26T23:45:00.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a59e00640 1 -- 172.21.15.137:0/33517696 learned_addr learned my addr 172.21.15.137:0/33517696 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:00.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a5a800640 1 --2- 172.21.15.137:0/33517696 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a5c144e00 0x7f4a5c0b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:00.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a51400640 1 --2- 172.21.15.137:0/33517696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a5c0b6180 0x7f4a5c0b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:00.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a59e00640 1 -- 172.21.15.137:0/33517696 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a5c144e00 msgr2=0x7f4a5c0b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:00.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a59e00640 1 --2- 172.21.15.137:0/33517696 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a5c144e00 0x7f4a5c0b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a59e00640 1 -- 172.21.15.137:0/33517696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a5c0b6180 msgr2=0x7f4a5c0b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:00.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a59e00640 1 --2- 172.21.15.137:0/33517696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a5c0b6180 0x7f4a5c0b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a59e00640 1 -- 172.21.15.137:0/33517696 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a5c138500 con 0x7f4a5c073d90 2024-04-26T23:45:00.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a59e00640 1 --2- 172.21.15.137:0/33517696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a5c073d90 0x7f4a5c15a7a0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009d10 tx=0x7f4a4c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:00.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a52a00640 1 -- 172.21.15.137:0/33517696 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c018020 con 0x7f4a5c073d90 2024-04-26T23:45:00.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a52a00640 1 -- 172.21.15.137:0/33517696 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a4c014480 con 0x7f4a5c073d90 2024-04-26T23:45:00.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a52a00640 1 -- 172.21.15.137:0/33517696 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c014830 con 0x7f4a5c073d90 2024-04-26T23:45:00.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a61000640 1 -- 172.21.15.137:0/33517696 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a5c1387e0 con 0x7f4a5c073d90 2024-04-26T23:45:00.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a61000640 1 -- 172.21.15.137:0/33517696 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a5c138da0 con 0x7f4a5c073d90 2024-04-26T23:45:00.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a61000640 1 -- 172.21.15.137:0/33517696 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a5c076710 con 0x7f4a5c073d90 2024-04-26T23:45:00.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.001+0000 7f4a52a00640 1 -- 172.21.15.137:0/33517696 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4a4c01b020 con 0x7f4a5c073d90 2024-04-26T23:45:00.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.005+0000 7f4a52a00640 1 --2- 172.21.15.137:0/33517696 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4a38068380 0x7f4a3806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:00.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.005+0000 7f4a52a00640 1 -- 172.21.15.137:0/33517696 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f4a4c0873e0 con 0x7f4a5c073d90 2024-04-26T23:45:00.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.005+0000 7f4a51400640 1 --2- 172.21.15.137:0/33517696 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4a38068380 0x7f4a3806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:00.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.005+0000 7f4a51400640 1 --2- 172.21.15.137:0/33517696 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4a38068380 0x7f4a3806a840 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4a44005890 tx=0x7f4a44009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:00.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.009+0000 7f4a52a00640 1 -- 172.21.15.137:0/33517696 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4a4c022070 con 0x7f4a5c073d90 2024-04-26T23:45:00.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.165+0000 7f4a61000640 1 -- 172.21.15.137:0/33517696 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a5c075a40 con 0x7f4a5c073d90 2024-04-26T23:45:00.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.165+0000 7f4a52a00640 1 -- 172.21.15.137:0/33517696 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16713 (secure 0 0 0) 0x7f4a4c010040 con 0x7f4a5c073d90 2024-04-26T23:45:00.170 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:00.171 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":60,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:44:22.811626+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:44:18.876990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T23:44:20.189315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:45:00.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.169+0000 7f4a61000640 1 -- 172.21.15.137:0/33517696 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4a38068380 msgr2=0x7f4a3806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:00.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.169+0000 7f4a61000640 1 --2- 172.21.15.137:0/33517696 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4a38068380 0x7f4a3806a840 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4a44005890 tx=0x7f4a44009040 comp rx=0 tx=0).stop 2024-04-26T23:45:00.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.169+0000 7f4a61000640 1 -- 172.21.15.137:0/33517696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a5c073d90 msgr2=0x7f4a5c15a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:00.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.169+0000 7f4a61000640 1 --2- 172.21.15.137:0/33517696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a5c073d90 0x7f4a5c15a7a0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009d10 tx=0x7f4a4c00c490 comp rx=0 tx=0).stop 2024-04-26T23:45:00.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.169+0000 7f4a61000640 1 -- 172.21.15.137:0/33517696 shutdown_connections 2024-04-26T23:45:00.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.169+0000 7f4a61000640 1 --2- 172.21.15.137:0/33517696 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f4a38068380 0x7f4a3806a840 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.169+0000 7f4a61000640 1 --2- 172.21.15.137:0/33517696 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a5c144e00 0x7f4a5c0b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.169+0000 7f4a61000640 1 --2- 172.21.15.137:0/33517696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a5c0b6180 0x7f4a5c0b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.169+0000 7f4a61000640 1 --2- 172.21.15.137:0/33517696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a5c073d90 0x7f4a5c15a7a0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.169+0000 7f4a61000640 1 -- 172.21.15.137:0/33517696 >> 172.21.15.137:0/33517696 conn(0x7f4a5c06f840 msgr2=0x7f4a5c0ce130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:00.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.169+0000 7f4a61000640 1 -- 172.21.15.137:0/33517696 shutdown_connections 2024-04-26T23:45:00.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.169+0000 7f4a61000640 1 -- 172.21.15.137:0/33517696 wait complete. 2024-04-26T23:45:00.193 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T23:45:00.193 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:45:00.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.325+0000 7f4224000640 1 Processor -- start 2024-04-26T23:45:00.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.325+0000 7f4224000640 1 -- start start 2024-04-26T23:45:00.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.325+0000 7f4224000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f421c157660 0x7f421c06c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:00.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.325+0000 7f4224000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f421c06cd60 0x7f421c142f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:00.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.325+0000 7f4224000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f421c1436b0 con 0x7f421c157a40 2024-04-26T23:45:00.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.325+0000 7f4224000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f421c143470 con 0x7f421c06cd60 2024-04-26T23:45:00.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.325+0000 7f4224000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f421c15dab0 con 0x7f421c157660 2024-04-26T23:45:00.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.325+0000 7f4222000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f421c06cd60 0x7f421c142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:00.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.325+0000 7f4222000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f421c06cd60 0x7f421c142f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38694/0 (socket says 172.21.15.137:38694) 2024-04-26T23:45:00.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.325+0000 7f4222000640 1 -- 172.21.15.137:0/3181411160 learned_addr learned my addr 172.21.15.137:0/3181411160 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:00.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.329+0000 7f4222000640 1 -- 172.21.15.137:0/3181411160 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f421c157660 msgr2=0x7f421c06c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:00.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.329+0000 7f4222000640 1 --2- 172.21.15.137:0/3181411160 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f421c157660 0x7f421c06c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.329+0000 7f4222000640 1 -- 172.21.15.137:0/3181411160 >> v1:172.21.15.170:6789/0 conn(0x7f421c157a40 legacy=0x7f421c142820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:00.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.329+0000 7f4222000640 1 -- 172.21.15.137:0/3181411160 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f421c15dd90 con 0x7f421c06cd60 2024-04-26T23:45:00.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.329+0000 7f4222000640 1 --2- 172.21.15.137:0/3181411160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f421c06cd60 0x7f421c142f30 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f4214009e50 tx=0x7f421401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a54fe573ab9bf76 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:00.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.329+0000 7f421be00640 1 -- 172.21.15.137:0/3181411160 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42140a5780 con 0x7f421c06cd60 2024-04-26T23:45:00.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.329+0000 7f421be00640 1 -- 172.21.15.137:0/3181411160 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42140a5920 con 0x7f421c06cd60 2024-04-26T23:45:00.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.329+0000 7f421be00640 1 -- 172.21.15.137:0/3181411160 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42140a5cf0 con 0x7f421c06cd60 2024-04-26T23:45:00.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.329+0000 7f4224000640 1 -- 172.21.15.137:0/3181411160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f421c06cd60 msgr2=0x7f421c142f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:00.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.329+0000 7f4224000640 1 --2- 172.21.15.137:0/3181411160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f421c06cd60 0x7f421c142f30 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f4214009e50 tx=0x7f421401c9f0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.329+0000 7f4224000640 1 -- 172.21.15.137:0/3181411160 shutdown_connections 2024-04-26T23:45:00.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.329+0000 7f4224000640 1 --2- 172.21.15.137:0/3181411160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f421c06cd60 0x7f421c142f30 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.329+0000 7f4224000640 1 --2- 172.21.15.137:0/3181411160 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f421c157660 0x7f421c06c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.329+0000 7f4224000640 1 -- 172.21.15.137:0/3181411160 >> 172.21.15.137:0/3181411160 conn(0x7f421c06f840 msgr2=0x7f421c06fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:00.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.329+0000 7f4224000640 1 -- 172.21.15.137:0/3181411160 shutdown_connections 2024-04-26T23:45:00.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.329+0000 7f4224000640 1 -- 172.21.15.137:0/3181411160 wait complete. 2024-04-26T23:45:00.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4224000640 1 Processor -- start 2024-04-26T23:45:00.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4224000640 1 -- start start 2024-04-26T23:45:00.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4224000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f421c06cd60 0x7f421c073d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:00.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4224000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f421c157660 0x7f421c1569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:00.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4224000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f421c157a40 0x7f421c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:00.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4224000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f421c169730 con 0x7f421c157660 2024-04-26T23:45:00.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4224000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f421c1695b0 con 0x7f421c157a40 2024-04-26T23:45:00.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4224000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f421c1698b0 con 0x7f421c06cd60 2024-04-26T23:45:00.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4220c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f421c157660 0x7f421c1569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:00.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4220c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f421c157660 0x7f421c1569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38706/0 (socket says 172.21.15.137:38706) 2024-04-26T23:45:00.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4220c00640 1 -- 172.21.15.137:0/1704964831 learned_addr learned my addr 172.21.15.137:0/1704964831 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:00.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4221600640 1 --2- 172.21.15.137:0/1704964831 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f421c06cd60 0x7f421c073d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:00.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4222000640 1 --2- 172.21.15.137:0/1704964831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f421c157a40 0x7f421c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:00.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4220c00640 1 -- 172.21.15.137:0/1704964831 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f421c06cd60 msgr2=0x7f421c073d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:00.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4220c00640 1 --2- 172.21.15.137:0/1704964831 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f421c06cd60 0x7f421c073d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4220c00640 1 -- 172.21.15.137:0/1704964831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f421c157a40 msgr2=0x7f421c15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:00.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4220c00640 1 --2- 172.21.15.137:0/1704964831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f421c157a40 0x7f421c15c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4220c00640 1 -- 172.21.15.137:0/1704964831 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f421c0742b0 con 0x7f421c157660 2024-04-26T23:45:00.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4220c00640 1 --2- 172.21.15.137:0/1704964831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f421c157660 0x7f421c1569f0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f420800c4c0 tx=0x7f4208001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:00.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4219600640 1 -- 172.21.15.137:0/1704964831 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4208017070 con 0x7f421c157660 2024-04-26T23:45:00.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4219600640 1 -- 172.21.15.137:0/1704964831 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4208003600 con 0x7f421c157660 2024-04-26T23:45:00.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4224000640 1 -- 172.21.15.137:0/1704964831 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f421c13a900 con 0x7f421c157660 2024-04-26T23:45:00.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4219600640 1 -- 172.21.15.137:0/1704964831 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42080039f0 con 0x7f421c157660 2024-04-26T23:45:00.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.333+0000 7f4224000640 1 -- 172.21.15.137:0/1704964831 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f421c13aec0 con 0x7f421c157660 2024-04-26T23:45:00.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.337+0000 7f4224000640 1 -- 172.21.15.137:0/1704964831 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f421c076710 con 0x7f421c157660 2024-04-26T23:45:00.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.337+0000 7f4219600640 1 -- 172.21.15.137:0/1704964831 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f420801a070 con 0x7f421c157660 2024-04-26T23:45:00.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.337+0000 7f4219600640 1 --2- 172.21.15.137:0/1704964831 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f41fc068380 0x7f41fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:00.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.337+0000 7f4219600640 1 -- 172.21.15.137:0/1704964831 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f4208085d70 con 0x7f421c157660 2024-04-26T23:45:00.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.337+0000 7f4221600640 1 --2- 172.21.15.137:0/1704964831 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f41fc068380 0x7f41fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:00.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.337+0000 7f4221600640 1 --2- 172.21.15.137:0/1704964831 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f41fc068380 0x7f41fc06a840 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f421c0b1f20 tx=0x7f4210009110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:00.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.341+0000 7f4219600640 1 -- 172.21.15.137:0/1704964831 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f421c0742b0 con 0x7f421c157660 2024-04-26T23:45:00.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.529+0000 7f4224000640 1 -- 172.21.15.137:0/1704964831 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f421c15f880 con 0x7f421c157660 2024-04-26T23:45:00.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.533+0000 7f4219600640 1 -- 172.21.15.137:0/1704964831 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5190 (secure 0 0 0) 0x7f4208055c40 con 0x7f421c157660 2024-04-26T23:45:00.536 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:00.536 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6064,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2903000554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2903000554},{"type":"v1","addr":"172.21.15.170:6834","nonce":2903000554}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6372,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/2879053849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2879053849},{"type":"v1","addr":"172.21.15.137:6836","nonce":2879053849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3081576837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3081576837},{"type":"v1","addr":"172.21.15.137:6837","nonce":3081576837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:44:21.180357+0000","modified":"2024-04-26T23:44:24.204261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6381":{"gid":6381,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/141729149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":141729149},{"type":"v1","addr":"172.21.15.170:6835","nonce":141729149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6381,"qdb_cluster":[6381]},"id":4}]} 2024-04-26T23:45:00.536 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 37 2024-04-26T23:45:00.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.533+0000 7f4224000640 1 -- 172.21.15.137:0/1704964831 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f41fc068380 msgr2=0x7f41fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:00.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.533+0000 7f4224000640 1 --2- 172.21.15.137:0/1704964831 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f41fc068380 0x7f41fc06a840 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f421c0b1f20 tx=0x7f4210009110 comp rx=0 tx=0).stop 2024-04-26T23:45:00.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.533+0000 7f4224000640 1 -- 172.21.15.137:0/1704964831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f421c157660 msgr2=0x7f421c1569f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:00.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.533+0000 7f4224000640 1 --2- 172.21.15.137:0/1704964831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f421c157660 0x7f421c1569f0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f420800c4c0 tx=0x7f4208001e80 comp rx=0 tx=0).stop 2024-04-26T23:45:00.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.533+0000 7f4224000640 1 -- 172.21.15.137:0/1704964831 shutdown_connections 2024-04-26T23:45:00.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.533+0000 7f4224000640 1 --2- 172.21.15.137:0/1704964831 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f41fc068380 0x7f41fc06a840 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.533+0000 7f4224000640 1 --2- 172.21.15.137:0/1704964831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f421c157660 0x7f421c1569f0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.533+0000 7f4224000640 1 --2- 172.21.15.137:0/1704964831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f421c157a40 0x7f421c15c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.533+0000 7f4224000640 1 --2- 172.21.15.137:0/1704964831 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f421c06cd60 0x7f421c073d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.533+0000 7f4224000640 1 -- 172.21.15.137:0/1704964831 >> 172.21.15.137:0/1704964831 conn(0x7f421c06f840 msgr2=0x7f421c15e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:00.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.533+0000 7f4224000640 1 -- 172.21.15.137:0/1704964831 shutdown_connections 2024-04-26T23:45:00.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.533+0000 7f4224000640 1 -- 172.21.15.137:0/1704964831 wait complete. 2024-04-26T23:45:00.557 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:45:00.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.689+0000 7fa954e00640 1 Processor -- start 2024-04-26T23:45:00.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.689+0000 7fa954e00640 1 -- start start 2024-04-26T23:45:00.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.689+0000 7fa954e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa95015f4e0 0x7fa950071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:00.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.689+0000 7fa954e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa9500b4840 0x7fa95006c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:00.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.689+0000 7fa954e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9500b5020 0x7fa95006c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:00.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.689+0000 7fa954e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa9500b5ac0 con 0x7fa95015f4e0 2024-04-26T23:45:00.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.689+0000 7fa954e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fa95015f8c0 con 0x7fa9500b4840 2024-04-26T23:45:00.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.689+0000 7fa954e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa9500712a0 con 0x7fa9500b5020 2024-04-26T23:45:00.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.689+0000 7fa94de00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa95015f4e0 0x7fa950071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:00.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.689+0000 7fa94de00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa95015f4e0 0x7fa950071780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38708/0 (socket says 172.21.15.137:38708) 2024-04-26T23:45:00.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.689+0000 7fa94de00640 1 -- 172.21.15.137:0/3423238021 learned_addr learned my addr 172.21.15.137:0/3423238021 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:00.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.689+0000 7fa94e800640 1 --2- 172.21.15.137:0/3423238021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9500b5020 0x7fa95006c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:00.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.689+0000 7fa947e00640 1 --2- 172.21.15.137:0/3423238021 >> v2:172.21.15.170:3300/0 conn(0x7fa9500b4840 0x7fa95006c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:00.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.689+0000 7fa94de00640 1 -- 172.21.15.137:0/3423238021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9500b5020 msgr2=0x7fa95006c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:00.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.689+0000 7fa94de00640 1 --2- 172.21.15.137:0/3423238021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9500b5020 0x7fa95006c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.689+0000 7fa94de00640 1 -- 172.21.15.137:0/3423238021 >> v2:172.21.15.170:3300/0 conn(0x7fa9500b4840 msgr2=0x7fa95006c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:00.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.689+0000 7fa94de00640 1 --2- 172.21.15.137:0/3423238021 >> v2:172.21.15.170:3300/0 conn(0x7fa9500b4840 0x7fa95006c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.689+0000 7fa94de00640 1 -- 172.21.15.137:0/3423238021 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9500b13b0 con 0x7fa95015f4e0 2024-04-26T23:45:00.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.693+0000 7fa94de00640 1 --2- 172.21.15.137:0/3423238021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa95015f4e0 0x7fa950071780 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa950051050 tx=0x7fa94001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04ff55ba1ae251d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:00.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.693+0000 7fa94d400640 1 -- 172.21.15.137:0/3423238021 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9400b0070 con 0x7fa95015f4e0 2024-04-26T23:45:00.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.693+0000 7fa94d400640 1 -- 172.21.15.137:0/3423238021 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa940004230 con 0x7fa95015f4e0 2024-04-26T23:45:00.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.693+0000 7fa94d400640 1 -- 172.21.15.137:0/3423238021 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa940003620 con 0x7fa95015f4e0 2024-04-26T23:45:00.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.693+0000 7fa954e00640 1 -- 172.21.15.137:0/3423238021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa95015f4e0 msgr2=0x7fa950071780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:00.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.693+0000 7fa954e00640 1 --2- 172.21.15.137:0/3423238021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa95015f4e0 0x7fa950071780 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa950051050 tx=0x7fa94001c3d0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.693+0000 7fa954e00640 1 -- 172.21.15.137:0/3423238021 shutdown_connections 2024-04-26T23:45:00.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.693+0000 7fa954e00640 1 --2- 172.21.15.137:0/3423238021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9500b5020 0x7fa95006c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.693+0000 7fa954e00640 1 --2- 172.21.15.137:0/3423238021 >> v2:172.21.15.170:3300/0 conn(0x7fa9500b4840 0x7fa95006c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.693+0000 7fa954e00640 1 --2- 172.21.15.137:0/3423238021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa95015f4e0 0x7fa950071780 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.693+0000 7fa954e00640 1 -- 172.21.15.137:0/3423238021 >> 172.21.15.137:0/3423238021 conn(0x7fa9500b3d20 msgr2=0x7fa9500b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:00.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.693+0000 7fa954e00640 1 -- 172.21.15.137:0/3423238021 shutdown_connections 2024-04-26T23:45:00.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.693+0000 7fa954e00640 1 -- 172.21.15.137:0/3423238021 wait complete. 2024-04-26T23:45:00.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa954e00640 1 Processor -- start 2024-04-26T23:45:00.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa954e00640 1 -- start start 2024-04-26T23:45:00.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa954e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9500b4840 0x7fa95014d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:00.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa954e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9500b5020 0x7fa950158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:00.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa954e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa95015f4e0 0x7fa9501591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:00.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa954e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa9500af0c0 con 0x7fa9500b5020 2024-04-26T23:45:00.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa954e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa9500b1040 con 0x7fa95015f4e0 2024-04-26T23:45:00.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa954e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa9500af240 con 0x7fa9500b4840 2024-04-26T23:45:00.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa947e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9500b5020 0x7fa950158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:00.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa947e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9500b5020 0x7fa950158c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38722/0 (socket says 172.21.15.137:38722) 2024-04-26T23:45:00.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa947e00640 1 -- 172.21.15.137:0/637335100 learned_addr learned my addr 172.21.15.137:0/637335100 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:00.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa94de00640 1 --2- 172.21.15.137:0/637335100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9500b4840 0x7fa95014d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa94e800640 1 --2- 172.21.15.137:0/637335100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa95015f4e0 0x7fa9501591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa947e00640 1 -- 172.21.15.137:0/637335100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9500b4840 msgr2=0x7fa95014d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa947e00640 1 --2- 172.21.15.137:0/637335100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9500b4840 0x7fa95014d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa947e00640 1 -- 172.21.15.137:0/637335100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa95015f4e0 msgr2=0x7fa9501591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa947e00640 1 --2- 172.21.15.137:0/637335100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa95015f4e0 0x7fa9501591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa947e00640 1 -- 172.21.15.137:0/637335100 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa950157c60 con 0x7fa9500b5020 2024-04-26T23:45:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa947e00640 1 --2- 172.21.15.137:0/637335100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9500b5020 0x7fa950158c90 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fa93800d800 tx=0x7fa93800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa946000640 1 -- 172.21.15.137:0/637335100 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa938018030 con 0x7fa9500b5020 2024-04-26T23:45:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa946000640 1 -- 172.21.15.137:0/637335100 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa938009640 con 0x7fa9500b5020 2024-04-26T23:45:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa946000640 1 -- 172.21.15.137:0/637335100 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa938009810 con 0x7fa9500b5020 2024-04-26T23:45:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa954e00640 1 -- 172.21.15.137:0/637335100 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa950157ed0 con 0x7fa9500b5020 2024-04-26T23:45:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa954e00640 1 -- 172.21.15.137:0/637335100 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa950158490 con 0x7fa9500b5020 2024-04-26T23:45:00.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.697+0000 7fa954e00640 1 -- 172.21.15.137:0/637335100 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa950076710 con 0x7fa9500b5020 2024-04-26T23:45:00.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.701+0000 7fa946000640 1 -- 172.21.15.137:0/637335100 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa93801b070 con 0x7fa9500b5020 2024-04-26T23:45:00.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.701+0000 7fa946000640 1 --2- 172.21.15.137:0/637335100 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa92c068380 0x7fa92c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:00.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.701+0000 7fa946000640 1 -- 172.21.15.137:0/637335100 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fa938086a70 con 0x7fa9500b5020 2024-04-26T23:45:00.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.701+0000 7fa94de00640 1 --2- 172.21.15.137:0/637335100 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa92c068380 0x7fa92c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:00.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.701+0000 7fa94de00640 1 --2- 172.21.15.137:0/637335100 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa92c068380 0x7fa92c06a840 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa9400ad000 tx=0x7fa9400a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:00.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.705+0000 7fa946000640 1 -- 172.21.15.137:0/637335100 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa9380569d0 con 0x7fa9500b5020 2024-04-26T23:45:00.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.897+0000 7fa954e00640 1 -- 172.21.15.137:0/637335100 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9500b3930 con 0x7fa9500b5020 2024-04-26T23:45:00.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.897+0000 7fa946000640 1 -- 172.21.15.137:0/637335100 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5190 (secure 0 0 0) 0x7fa93805acd0 con 0x7fa9500b5020 2024-04-26T23:45:00.902 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:00.902 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6064,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2903000554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2903000554},{"type":"v1","addr":"172.21.15.170:6834","nonce":2903000554}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6372,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/2879053849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2879053849},{"type":"v1","addr":"172.21.15.137:6836","nonce":2879053849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3081576837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3081576837},{"type":"v1","addr":"172.21.15.137:6837","nonce":3081576837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:44:21.180357+0000","modified":"2024-04-26T23:44:24.204261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6381":{"gid":6381,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/141729149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":141729149},{"type":"v1","addr":"172.21.15.170:6835","nonce":141729149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6381,"qdb_cluster":[6381]},"id":4}]} 2024-04-26T23:45:00.903 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 37 2024-04-26T23:45:00.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.901+0000 7fa954e00640 1 -- 172.21.15.137:0/637335100 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa92c068380 msgr2=0x7fa92c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:00.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.901+0000 7fa954e00640 1 --2- 172.21.15.137:0/637335100 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa92c068380 0x7fa92c06a840 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa9400ad000 tx=0x7fa9400a6000 comp rx=0 tx=0).stop 2024-04-26T23:45:00.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.901+0000 7fa954e00640 1 -- 172.21.15.137:0/637335100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9500b5020 msgr2=0x7fa950158c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:00.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.901+0000 7fa954e00640 1 --2- 172.21.15.137:0/637335100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9500b5020 0x7fa950158c90 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fa93800d800 tx=0x7fa93800dcc0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.901+0000 7fa954e00640 1 -- 172.21.15.137:0/637335100 shutdown_connections 2024-04-26T23:45:00.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.901+0000 7fa954e00640 1 --2- 172.21.15.137:0/637335100 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa92c068380 0x7fa92c06a840 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.901+0000 7fa954e00640 1 --2- 172.21.15.137:0/637335100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9500b5020 0x7fa950158c90 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.901+0000 7fa954e00640 1 --2- 172.21.15.137:0/637335100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa95015f4e0 0x7fa9501591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.901+0000 7fa954e00640 1 --2- 172.21.15.137:0/637335100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9500b4840 0x7fa95014d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:00.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.901+0000 7fa954e00640 1 -- 172.21.15.137:0/637335100 >> 172.21.15.137:0/637335100 conn(0x7fa9500b3d20 msgr2=0x7fa950073250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:00.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.901+0000 7fa954e00640 1 -- 172.21.15.137:0/637335100 shutdown_connections 2024-04-26T23:45:00.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:00.901+0000 7fa954e00640 1 -- 172.21.15.137:0/637335100 wait complete. 2024-04-26T23:45:00.924 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:45:01.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.053+0000 7f3b03000640 1 Processor -- start 2024-04-26T23:45:01.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.053+0000 7f3b03000640 1 -- start start 2024-04-26T23:45:01.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.057+0000 7f3b03000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3afc144e00 0x7f3afc06c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.057+0000 7f3b03000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3afc073d90 0x7f3afc06cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.057+0000 7f3b03000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3afc0b53c0 con 0x7f3afc0b6180 2024-04-26T23:45:01.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.057+0000 7f3b03000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3afc1451e0 con 0x7f3afc073d90 2024-04-26T23:45:01.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.057+0000 7f3b03000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f3afc0b5cf0 con 0x7f3afc144e00 2024-04-26T23:45:01.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.057+0000 7f3b01000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3afc073d90 0x7f3afc06cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.057+0000 7f3b01000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3afc073d90 0x7f3afc06cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35352/0 (socket says 172.21.15.137:35352) 2024-04-26T23:45:01.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.057+0000 7f3b01000640 1 -- 172.21.15.137:0/580854973 learned_addr learned my addr 172.21.15.137:0/580854973 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:01.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.057+0000 7f3afbe00640 1 --2- 172.21.15.137:0/580854973 >> v2:172.21.15.170:3300/0 conn(0x7f3afc144e00 0x7f3afc06c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.057+0000 7f3b01000640 1 -- 172.21.15.137:0/580854973 >> v2:172.21.15.170:3300/0 conn(0x7f3afc144e00 msgr2=0x7f3afc06c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:01.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.057+0000 7f3b01000640 1 --2- 172.21.15.137:0/580854973 >> v2:172.21.15.170:3300/0 conn(0x7f3afc144e00 0x7f3afc06c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.057+0000 7f3b01000640 1 -- 172.21.15.137:0/580854973 >> v1:172.21.15.170:6789/0 conn(0x7f3afc0b6180 legacy=0x7f3afc073680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:01.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.057+0000 7f3b01000640 1 -- 172.21.15.137:0/580854973 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3afc0b56a0 con 0x7f3afc073d90 2024-04-26T23:45:01.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.057+0000 7f3afbe00640 1 --2- 172.21.15.137:0/580854973 >> v2:172.21.15.170:3300/0 conn(0x7f3afc144e00 0x7f3afc06c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:01.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.061+0000 7f3b01000640 1 --2- 172.21.15.137:0/580854973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3afc073d90 0x7f3afc06cd60 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f3afc070580 tx=0x7f3af401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e61a9ca2232051 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:01.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.061+0000 7f3afb400640 1 -- 172.21.15.137:0/580854973 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af40a55b0 con 0x7f3afc073d90 2024-04-26T23:45:01.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.061+0000 7f3afb400640 1 -- 172.21.15.137:0/580854973 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af40a5750 con 0x7f3afc073d90 2024-04-26T23:45:01.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.061+0000 7f3afb400640 1 -- 172.21.15.137:0/580854973 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af40a5b20 con 0x7f3afc073d90 2024-04-26T23:45:01.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.061+0000 7f3b03000640 1 -- 172.21.15.137:0/580854973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3afc073d90 msgr2=0x7f3afc06cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:01.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.061+0000 7f3b03000640 1 --2- 172.21.15.137:0/580854973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3afc073d90 0x7f3afc06cd60 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f3afc070580 tx=0x7f3af401c8f0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.061+0000 7f3b03000640 1 -- 172.21.15.137:0/580854973 shutdown_connections 2024-04-26T23:45:01.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.061+0000 7f3b03000640 1 --2- 172.21.15.137:0/580854973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3afc073d90 0x7f3afc06cd60 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.061+0000 7f3b03000640 1 --2- 172.21.15.137:0/580854973 >> v2:172.21.15.170:3300/0 conn(0x7f3afc144e00 0x7f3afc06c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.061+0000 7f3b03000640 1 -- 172.21.15.137:0/580854973 >> 172.21.15.137:0/580854973 conn(0x7f3afc06f840 msgr2=0x7f3afc06fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:01.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.061+0000 7f3b03000640 1 -- 172.21.15.137:0/580854973 shutdown_connections 2024-04-26T23:45:01.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.061+0000 7f3b03000640 1 -- 172.21.15.137:0/580854973 wait complete. 2024-04-26T23:45:01.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.061+0000 7f3b03000640 1 Processor -- start 2024-04-26T23:45:01.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.061+0000 7f3b03000640 1 -- start start 2024-04-26T23:45:01.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3b03000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3afc073d90 0x7f3afc06e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3b03000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3afc0b6180 0x7f3afc137440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3b03000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3afc144e00 0x7f3afc137980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3b03000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc15d120 con 0x7f3afc144e00 2024-04-26T23:45:01.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3b03000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc15cfa0 con 0x7f3afc073d90 2024-04-26T23:45:01.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3b03000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3afc15d2a0 con 0x7f3afc0b6180 2024-04-26T23:45:01.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3b01000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3afc144e00 0x7f3afc137980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3b01000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3afc144e00 0x7f3afc137980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35354/0 (socket says 172.21.15.137:35354) 2024-04-26T23:45:01.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3b01000640 1 -- 172.21.15.137:0/3100489264 learned_addr learned my addr 172.21.15.137:0/3100489264 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:01.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3afbe00640 1 --2- 172.21.15.137:0/3100489264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3afc073d90 0x7f3afc06e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3af3e00640 1 --2- 172.21.15.137:0/3100489264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3afc0b6180 0x7f3afc137440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3b01000640 1 -- 172.21.15.137:0/3100489264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3afc0b6180 msgr2=0x7f3afc137440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:01.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3b01000640 1 --2- 172.21.15.137:0/3100489264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3afc0b6180 0x7f3afc137440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3b01000640 1 -- 172.21.15.137:0/3100489264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3afc073d90 msgr2=0x7f3afc06e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:01.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3b01000640 1 --2- 172.21.15.137:0/3100489264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3afc073d90 0x7f3afc06e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3b01000640 1 -- 172.21.15.137:0/3100489264 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3afc1381b0 con 0x7f3afc144e00 2024-04-26T23:45:01.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3b01000640 1 --2- 172.21.15.137:0/3100489264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3afc144e00 0x7f3afc137980 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f3af401a520 tx=0x7f3af4019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:01.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3af8c00640 1 -- 172.21.15.137:0/3100489264 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af4009510 con 0x7f3afc144e00 2024-04-26T23:45:01.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3af8c00640 1 -- 172.21.15.137:0/3100489264 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af40be070 con 0x7f3afc144e00 2024-04-26T23:45:01.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3b03000640 1 -- 172.21.15.137:0/3100489264 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3afc138490 con 0x7f3afc144e00 2024-04-26T23:45:01.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3af8c00640 1 -- 172.21.15.137:0/3100489264 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af40b8870 con 0x7f3afc144e00 2024-04-26T23:45:01.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3b03000640 1 -- 172.21.15.137:0/3100489264 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3afc138a50 con 0x7f3afc144e00 2024-04-26T23:45:01.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3b03000640 1 -- 172.21.15.137:0/3100489264 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3afc076710 con 0x7f3afc144e00 2024-04-26T23:45:01.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.065+0000 7f3af8c00640 1 -- 172.21.15.137:0/3100489264 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3af40b8a10 con 0x7f3afc144e00 2024-04-26T23:45:01.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.069+0000 7f3af8c00640 1 --2- 172.21.15.137:0/3100489264 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3ad8068380 0x7f3ad806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.069+0000 7f3af8c00640 1 -- 172.21.15.137:0/3100489264 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f3af41218a0 con 0x7f3afc144e00 2024-04-26T23:45:01.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.069+0000 7f3afbe00640 1 --2- 172.21.15.137:0/3100489264 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3ad8068380 0x7f3ad806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.069+0000 7f3afbe00640 1 --2- 172.21.15.137:0/3100489264 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3ad8068380 0x7f3ad806a840 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00ab60 tx=0x7f3aec008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:01.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.073+0000 7f3af8c00640 1 -- 172.21.15.137:0/3100489264 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3af40165a0 con 0x7f3afc144e00 2024-04-26T23:45:01.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.233+0000 7f3b03000640 1 -- 172.21.15.137:0/3100489264 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3afc073680 con 0x7f3afc144e00 2024-04-26T23:45:01.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.233+0000 7f3af8c00640 1 -- 172.21.15.137:0/3100489264 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16713 (secure 0 0 0) 0x7f3af40b8d00 con 0x7f3afc144e00 2024-04-26T23:45:01.237 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:01.237 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":60,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:44:22.811626+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:44:18.876990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T23:44:20.189315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:45:01.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.233+0000 7f3b03000640 1 -- 172.21.15.137:0/3100489264 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3ad8068380 msgr2=0x7f3ad806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:01.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.233+0000 7f3b03000640 1 --2- 172.21.15.137:0/3100489264 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3ad8068380 0x7f3ad806a840 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00ab60 tx=0x7f3aec008040 comp rx=0 tx=0).stop 2024-04-26T23:45:01.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.233+0000 7f3b03000640 1 -- 172.21.15.137:0/3100489264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3afc144e00 msgr2=0x7f3afc137980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:01.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.233+0000 7f3b03000640 1 --2- 172.21.15.137:0/3100489264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3afc144e00 0x7f3afc137980 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f3af401a520 tx=0x7f3af4019690 comp rx=0 tx=0).stop 2024-04-26T23:45:01.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.233+0000 7f3b03000640 1 -- 172.21.15.137:0/3100489264 shutdown_connections 2024-04-26T23:45:01.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.233+0000 7f3b03000640 1 --2- 172.21.15.137:0/3100489264 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3ad8068380 0x7f3ad806a840 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.233+0000 7f3b03000640 1 --2- 172.21.15.137:0/3100489264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3afc144e00 0x7f3afc137980 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.233+0000 7f3b03000640 1 --2- 172.21.15.137:0/3100489264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3afc0b6180 0x7f3afc137440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.233+0000 7f3b03000640 1 --2- 172.21.15.137:0/3100489264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3afc073d90 0x7f3afc06e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.233+0000 7f3b03000640 1 -- 172.21.15.137:0/3100489264 >> 172.21.15.137:0/3100489264 conn(0x7f3afc06f840 msgr2=0x7f3afc0ce130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:01.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.233+0000 7f3b03000640 1 -- 172.21.15.137:0/3100489264 shutdown_connections 2024-04-26T23:45:01.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.233+0000 7f3b03000640 1 -- 172.21.15.137:0/3100489264 wait complete. 2024-04-26T23:45:01.258 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T23:45:01.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.389+0000 7fc292400640 1 Processor -- start 2024-04-26T23:45:01.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.389+0000 7fc292400640 1 -- start start 2024-04-26T23:45:01.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc292400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc28c0735d0 0x7fc28c0d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc292400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc28c15cfc0 0x7fc28c0d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc292400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc28c15d620 con 0x7fc28c0739b0 2024-04-26T23:45:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc292400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc28c0d0680 con 0x7fc28c15cfc0 2024-04-26T23:45:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc292400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc28c15fd50 con 0x7fc28c0735d0 2024-04-26T23:45:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28aa00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc28c0739b0 0x7fc28c15c8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40542/0 (socket says 172.21.15.137:40542) 2024-04-26T23:45:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28aa00640 1 -- 172.21.15.137:0/492175051 learned_addr learned my addr 172.21.15.137:0/492175051 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:45:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28b400640 1 --2- 172.21.15.137:0/492175051 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc28c0735d0 0x7fc28c0d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28be00640 1 --2- 172.21.15.137:0/492175051 >> v2:172.21.15.170:3300/0 conn(0x7fc28c15cfc0 0x7fc28c0d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28a000640 1 -- 172.21.15.137:0/492175051 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3580127022 0 0) 0x7fc28c15d620 con 0x7fc28c0739b0 2024-04-26T23:45:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28a000640 1 -- 172.21.15.137:0/492175051 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc270003530 con 0x7fc28c0739b0 2024-04-26T23:45:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28a000640 1 -- 172.21.15.137:0/492175051 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3876712517 0 0) 0x7fc270003530 con 0x7fc28c0739b0 2024-04-26T23:45:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28a000640 1 -- 172.21.15.137:0/492175051 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc28c0735d0 msgr2=0x7fc28c0d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28a000640 1 --2- 172.21.15.137:0/492175051 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc28c0735d0 0x7fc28c0d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28a000640 1 -- 172.21.15.137:0/492175051 >> v2:172.21.15.170:3300/0 conn(0x7fc28c15cfc0 msgr2=0x7fc28c0d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28a000640 1 --2- 172.21.15.137:0/492175051 >> v2:172.21.15.170:3300/0 conn(0x7fc28c15cfc0 0x7fc28c0d12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28a000640 1 -- 172.21.15.137:0/492175051 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28c160030 con 0x7fc28c0739b0 2024-04-26T23:45:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28a000640 1 -- 172.21.15.137:0/492175051 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fc278001680 con 0x7fc28c0739b0 2024-04-26T23:45:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28a000640 1 -- 172.21.15.137:0/492175051 >> v1:172.21.15.137:6789/0 conn(0x7fc28c0739b0 legacy=0x7fc28c15c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28a000640 1 --2- 172.21.15.137:0/492175051 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc28c0735d0 0x7fc2700039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28a000640 1 --2- 172.21.15.137:0/492175051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc270003f40 0x7fc270004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28a000640 1 --2- 172.21.15.137:0/492175051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc270004d50 0x7fc2700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28a000640 1 -- 172.21.15.137:0/492175051 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c0d0680 con 0x7fc270003f40 2024-04-26T23:45:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28a000640 1 -- 172.21.15.137:0/492175051 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c15fd50 con 0x7fc270004d50 2024-04-26T23:45:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28a000640 1 -- 172.21.15.137:0/492175051 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc27000ba20 con 0x7fc28c0735d0 2024-04-26T23:45:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28aa00640 1 --2- 172.21.15.137:0/492175051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc270003f40 0x7fc270004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28b400640 1 --2- 172.21.15.137:0/492175051 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc28c0735d0 0x7fc2700039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28be00640 1 --2- 172.21.15.137:0/492175051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc270004d50 0x7fc2700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28aa00640 1 -- 172.21.15.137:0/492175051 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc28c0735d0 msgr2=0x7fc2700039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28aa00640 1 --2- 172.21.15.137:0/492175051 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc28c0735d0 0x7fc2700039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28aa00640 1 -- 172.21.15.137:0/492175051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc270004d50 msgr2=0x7fc2700051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28aa00640 1 --2- 172.21.15.137:0/492175051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc270004d50 0x7fc2700051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.393+0000 7fc28aa00640 1 -- 172.21.15.137:0/492175051 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc270003530 con 0x7fc270003f40 2024-04-26T23:45:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.397+0000 7fc28aa00640 1 --2- 172.21.15.137:0/492175051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc270003f40 0x7fc270004810 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fc27800e450 tx=0x7fc27801f090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eff8f1b5c1b23f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.397+0000 7fc28a000640 1 -- 172.21.15.137:0/492175051 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc278007d40 con 0x7fc270003f40 2024-04-26T23:45:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.397+0000 7fc28a000640 1 -- 172.21.15.137:0/492175051 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2780ab020 con 0x7fc270003f40 2024-04-26T23:45:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.397+0000 7fc28a000640 1 -- 172.21.15.137:0/492175051 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2780058e0 con 0x7fc270003f40 2024-04-26T23:45:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.397+0000 7fc292400640 1 -- 172.21.15.137:0/492175051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc270003f40 msgr2=0x7fc270004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.397+0000 7fc292400640 1 --2- 172.21.15.137:0/492175051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc270003f40 0x7fc270004810 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fc27800e450 tx=0x7fc27801f090 comp rx=0 tx=0).stop 2024-04-26T23:45:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.397+0000 7fc28be00640 1 -- 172.21.15.137:0/492175051 reap_dead start 2024-04-26T23:45:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.397+0000 7fc292400640 1 -- 172.21.15.137:0/492175051 shutdown_connections 2024-04-26T23:45:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.397+0000 7fc292400640 1 -- 172.21.15.137:0/492175051 >> 172.21.15.137:0/492175051 conn(0x7fc28c0cd8a0 msgr2=0x7fc28c0cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.397+0000 7fc292400640 1 -- 172.21.15.137:0/492175051 shutdown_connections 2024-04-26T23:45:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.397+0000 7fc292400640 1 -- 172.21.15.137:0/492175051 wait complete. 2024-04-26T23:45:01.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc292400640 1 Processor -- start 2024-04-26T23:45:01.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc292400640 1 -- start start 2024-04-26T23:45:01.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc292400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc270003f40 0x7fc28c150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc292400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc28c14fd00 0x7fc28c0aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc292400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc28c0af380 0x7fc28c1f8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc292400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c0d0250 con 0x7fc28c0af380 2024-04-26T23:45:01.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc292400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c0d00d0 con 0x7fc28c14fd00 2024-04-26T23:45:01.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc292400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc28c0d03d0 con 0x7fc270003f40 2024-04-26T23:45:01.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc28be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc28c0af380 0x7fc28c1f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc28be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc28c0af380 0x7fc28c1f8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35366/0 (socket says 172.21.15.137:35366) 2024-04-26T23:45:01.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc28be00640 1 -- 172.21.15.137:0/1687325522 learned_addr learned my addr 172.21.15.137:0/1687325522 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:01.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc28b400640 1 --2- 172.21.15.137:0/1687325522 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc270003f40 0x7fc28c150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc28aa00640 1 --2- 172.21.15.137:0/1687325522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc28c14fd00 0x7fc28c0aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc28be00640 1 -- 172.21.15.137:0/1687325522 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc270003f40 msgr2=0x7fc28c150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:01.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc28be00640 1 --2- 172.21.15.137:0/1687325522 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc270003f40 0x7fc28c150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc28be00640 1 -- 172.21.15.137:0/1687325522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc28c14fd00 msgr2=0x7fc28c0aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:01.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc28be00640 1 --2- 172.21.15.137:0/1687325522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc28c14fd00 0x7fc28c0aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc28be00640 1 -- 172.21.15.137:0/1687325522 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28c0b3c30 con 0x7fc28c0af380 2024-04-26T23:45:01.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc28be00640 1 --2- 172.21.15.137:0/1687325522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc28c0af380 0x7fc28c1f8200 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fc284011bf0 tx=0x7fc28400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:01.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc283400640 1 -- 172.21.15.137:0/1687325522 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28400fdb0 con 0x7fc28c0af380 2024-04-26T23:45:01.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc283400640 1 -- 172.21.15.137:0/1687325522 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc28401d070 con 0x7fc28c0af380 2024-04-26T23:45:01.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc283400640 1 -- 172.21.15.137:0/1687325522 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc284015670 con 0x7fc28c0af380 2024-04-26T23:45:01.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc292400640 1 -- 172.21.15.137:0/1687325522 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc28c1f9100 con 0x7fc28c0af380 2024-04-26T23:45:01.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc292400640 1 -- 172.21.15.137:0/1687325522 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc28c150350 con 0x7fc28c0af380 2024-04-26T23:45:01.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.401+0000 7fc292400640 1 -- 172.21.15.137:0/1687325522 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc28c0766a0 con 0x7fc28c0af380 2024-04-26T23:45:01.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.405+0000 7fc283400640 1 -- 172.21.15.137:0/1687325522 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc284015810 con 0x7fc28c0af380 2024-04-26T23:45:01.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.405+0000 7fc283400640 1 --2- 172.21.15.137:0/1687325522 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc26c0683b0 0x7fc26c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.405+0000 7fc283400640 1 -- 172.21.15.137:0/1687325522 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fc284087270 con 0x7fc28c0af380 2024-04-26T23:45:01.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.405+0000 7fc28b400640 1 --2- 172.21.15.137:0/1687325522 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc26c0683b0 0x7fc26c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.405+0000 7fc28b400640 1 --2- 172.21.15.137:0/1687325522 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc26c0683b0 0x7fc26c06a870 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0099e0 tx=0x7fc27c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:01.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.409+0000 7fc283400640 1 -- 172.21.15.137:0/1687325522 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc284010040 con 0x7fc28c0af380 2024-04-26T23:45:01.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.597+0000 7fc292400640 1 -- 172.21.15.137:0/1687325522 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc28c0cf450 con 0x7fc28c0af380 2024-04-26T23:45:01.604 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-04-26T23:45:01.601+0000 7f1be8800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T23:45:01.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.601+0000 7fc283400640 1 -- 172.21.15.137:0/1687325522 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) ==== 161+0+0 (secure 0 0 0) 0x7fc284057830 con 0x7fc28c0af380 2024-04-26T23:45:01.606 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T23:45:01.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.605+0000 7fc292400640 1 -- 172.21.15.137:0/1687325522 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc26c0683b0 msgr2=0x7fc26c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:01.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.605+0000 7fc292400640 1 --2- 172.21.15.137:0/1687325522 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc26c0683b0 0x7fc26c06a870 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0099e0 tx=0x7fc27c008040 comp rx=0 tx=0).stop 2024-04-26T23:45:01.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.605+0000 7fc292400640 1 -- 172.21.15.137:0/1687325522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc28c0af380 msgr2=0x7fc28c1f8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:01.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.605+0000 7fc292400640 1 --2- 172.21.15.137:0/1687325522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc28c0af380 0x7fc28c1f8200 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fc284011bf0 tx=0x7fc28400f580 comp rx=0 tx=0).stop 2024-04-26T23:45:01.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.605+0000 7fc292400640 1 -- 172.21.15.137:0/1687325522 shutdown_connections 2024-04-26T23:45:01.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.605+0000 7fc292400640 1 --2- 172.21.15.137:0/1687325522 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc26c0683b0 0x7fc26c06a870 secure :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0099e0 tx=0x7fc27c008040 comp rx=0 tx=0).stop 2024-04-26T23:45:01.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.605+0000 7fc292400640 1 --2- 172.21.15.137:0/1687325522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc28c0af380 0x7fc28c1f8200 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.605+0000 7fc292400640 1 --2- 172.21.15.137:0/1687325522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc28c14fd00 0x7fc28c0aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.605+0000 7fc292400640 1 --2- 172.21.15.137:0/1687325522 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc270003f40 0x7fc28c150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.605+0000 7fc292400640 1 -- 172.21.15.137:0/1687325522 >> 172.21.15.137:0/1687325522 conn(0x7fc28c0cd8a0 msgr2=0x7fc28c15f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:01.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.605+0000 7fc292400640 1 -- 172.21.15.137:0/1687325522 shutdown_connections 2024-04-26T23:45:01.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.605+0000 7fc292400640 1 -- 172.21.15.137:0/1687325522 wait complete. 2024-04-26T23:45:01.616 INFO:tasks.ceph.mds.b.smithi170.stderr: -2566> 2024-04-26T23:44:26.779+0000 7f0c5ec00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:45:01.629 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T23:45:01.664 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2024-04-26T23:45:01.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.769+0000 7fcf20a00640 1 Processor -- start 2024-04-26T23:45:01.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.769+0000 7fcf20a00640 1 -- start start 2024-04-26T23:45:01.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.769+0000 7fcf20a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fcf1c15f0a0 0x7fcf1c0d0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.769+0000 7fcf20a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcf1c06d710 0x7fcf1c06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.769+0000 7fcf20a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf1c0d1240 con 0x7fcf1c15f480 2024-04-26T23:45:01.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.769+0000 7fcf20a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fcf1c0d1520 con 0x7fcf1c06d710 2024-04-26T23:45:01.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.769+0000 7fcf20a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fcf1c0d1800 con 0x7fcf1c15f0a0 2024-04-26T23:45:01.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.769+0000 7fcf19e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcf1c06d710 0x7fcf1c06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.769+0000 7fcf1b200640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fcf1c15f480 0x7fcf1c162eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40554/0 (socket says 172.21.15.137:40554) 2024-04-26T23:45:01.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.769+0000 7fcf1b200640 1 -- 172.21.15.137:0/789416189 learned_addr learned my addr 172.21.15.137:0/789416189 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:45:01.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.769+0000 7fcf1a800640 1 --2- 172.21.15.137:0/789416189 >> v2:172.21.15.170:3300/0 conn(0x7fcf1c15f0a0 0x7fcf1c0d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.769+0000 7fcf19e00640 1 -- 172.21.15.137:0/789416189 >> v2:172.21.15.170:3300/0 conn(0x7fcf1c15f0a0 msgr2=0x7fcf1c0d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:01.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.769+0000 7fcf19e00640 1 --2- 172.21.15.137:0/789416189 >> v2:172.21.15.170:3300/0 conn(0x7fcf1c15f0a0 0x7fcf1c0d0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.769+0000 7fcf19e00640 1 -- 172.21.15.137:0/789416189 >> v1:172.21.15.137:6789/0 conn(0x7fcf1c15f480 legacy=0x7fcf1c162eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:01.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.769+0000 7fcf19e00640 1 -- 172.21.15.137:0/789416189 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf1c0d1ae0 con 0x7fcf1c06d710 2024-04-26T23:45:01.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.769+0000 7fcf19400640 1 -- 172.21.15.137:0/789416189 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 414204713 0 0) 0x7fcf1c0d1240 con 0x7fcf1c15f480 2024-04-26T23:45:01.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.773+0000 7fcf19e00640 1 --2- 172.21.15.137:0/789416189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf1c06d710 0x7fcf1c06dea0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c073f40 tx=0x7fcf0801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a127ee7204a98d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:01.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.773+0000 7fcf19400640 1 -- 172.21.15.137:0/789416189 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf080b0070 con 0x7fcf1c06d710 2024-04-26T23:45:01.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.773+0000 7fcf19400640 1 -- 172.21.15.137:0/789416189 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf080ab600 con 0x7fcf1c06d710 2024-04-26T23:45:01.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.773+0000 7fcf19400640 1 -- 172.21.15.137:0/789416189 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf080ab9d0 con 0x7fcf1c06d710 2024-04-26T23:45:01.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.773+0000 7fcf20a00640 1 -- 172.21.15.137:0/789416189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf1c06d710 msgr2=0x7fcf1c06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:01.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.773+0000 7fcf20a00640 1 --2- 172.21.15.137:0/789416189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf1c06d710 0x7fcf1c06dea0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c073f40 tx=0x7fcf0801c3f0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.773+0000 7fcf20a00640 1 -- 172.21.15.137:0/789416189 shutdown_connections 2024-04-26T23:45:01.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.773+0000 7fcf20a00640 1 --2- 172.21.15.137:0/789416189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf1c06d710 0x7fcf1c06dea0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.773+0000 7fcf20a00640 1 --2- 172.21.15.137:0/789416189 >> v2:172.21.15.170:3300/0 conn(0x7fcf1c15f0a0 0x7fcf1c0d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.773+0000 7fcf20a00640 1 -- 172.21.15.137:0/789416189 >> 172.21.15.137:0/789416189 conn(0x7fcf1c0d2df0 msgr2=0x7fcf1c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:01.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.773+0000 7fcf20a00640 1 -- 172.21.15.137:0/789416189 shutdown_connections 2024-04-26T23:45:01.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.773+0000 7fcf20a00640 1 -- 172.21.15.137:0/789416189 wait complete. 2024-04-26T23:45:01.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf20a00640 1 Processor -- start 2024-04-26T23:45:01.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf20a00640 1 -- start start 2024-04-26T23:45:01.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf20a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf1c06d710 0x7fcf1c160530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf20a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf1c15f0a0 0x7fcf1c14dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf20a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf1c15f480 0x7fcf1c15df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf20a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcf1c06e7f0 con 0x7fcf1c15f0a0 2024-04-26T23:45:01.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf20a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcf1c0d24f0 con 0x7fcf1c15f480 2024-04-26T23:45:01.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf20a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcf1c16c410 con 0x7fcf1c06d710 2024-04-26T23:45:01.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf19e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf1c15f0a0 0x7fcf1c14dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf19e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf1c15f0a0 0x7fcf1c14dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35386/0 (socket says 172.21.15.137:35386) 2024-04-26T23:45:01.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf19e00640 1 -- 172.21.15.137:0/123037147 learned_addr learned my addr 172.21.15.137:0/123037147 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:01.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf1a800640 1 --2- 172.21.15.137:0/123037147 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf1c06d710 0x7fcf1c160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf1b200640 1 --2- 172.21.15.137:0/123037147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf1c15f480 0x7fcf1c15df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf19e00640 1 -- 172.21.15.137:0/123037147 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf1c06d710 msgr2=0x7fcf1c160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:01.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf19e00640 1 --2- 172.21.15.137:0/123037147 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf1c06d710 0x7fcf1c160530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf19e00640 1 -- 172.21.15.137:0/123037147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf1c15f480 msgr2=0x7fcf1c15df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:01.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf19e00640 1 --2- 172.21.15.137:0/123037147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf1c15f480 0x7fcf1c15df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf19e00640 1 -- 172.21.15.137:0/123037147 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf1c160b10 con 0x7fcf1c15f0a0 2024-04-26T23:45:01.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf19e00640 1 --2- 172.21.15.137:0/123037147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf1c15f0a0 0x7fcf1c14dde0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fcf080ae040 tx=0x7fcf0801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:01.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf12a00640 1 -- 172.21.15.137:0/123037147 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf080bc070 con 0x7fcf1c15f0a0 2024-04-26T23:45:01.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf12a00640 1 -- 172.21.15.137:0/123037147 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf080b1040 con 0x7fcf1c15f0a0 2024-04-26T23:45:01.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf12a00640 1 -- 172.21.15.137:0/123037147 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf080b0050 con 0x7fcf1c15f0a0 2024-04-26T23:45:01.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf20a00640 1 -- 172.21.15.137:0/123037147 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf1c160df0 con 0x7fcf1c15f0a0 2024-04-26T23:45:01.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.777+0000 7fcf20a00640 1 -- 172.21.15.137:0/123037147 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf1c1613b0 con 0x7fcf1c15f0a0 2024-04-26T23:45:01.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.781+0000 7fcf20a00640 1 -- 172.21.15.137:0/123037147 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf1c0694a0 con 0x7fcf1c15f0a0 2024-04-26T23:45:01.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.781+0000 7fcf12a00640 1 -- 172.21.15.137:0/123037147 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcf080bf070 con 0x7fcf1c15f0a0 2024-04-26T23:45:01.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.781+0000 7fcf12a00640 1 --2- 172.21.15.137:0/123037147 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fcefc068380 0x7fcefc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.781+0000 7fcf12a00640 1 -- 172.21.15.137:0/123037147 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5795+0+0 (secure 0 0 0) 0x7fcf081204e0 con 0x7fcf1c15f0a0 2024-04-26T23:45:01.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.781+0000 7fcf1a800640 1 --2- 172.21.15.137:0/123037147 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fcefc068380 0x7fcefc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.781+0000 7fcf1a800640 1 --2- 172.21.15.137:0/123037147 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fcefc068380 0x7fcefc06a840 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c003ab0 tx=0x7fcf0c009830 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:01.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.785+0000 7fcf12a00640 1 -- 172.21.15.137:0/123037147 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcf08016070 con 0x7fcf1c15f0a0 2024-04-26T23:45:01.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:01.981+0000 7fcf20a00640 1 -- 172.21.15.137:0/123037147 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fcf1c0d0270 con 0x7fcf1c15f0a0 2024-04-26T23:45:02.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.605+0000 7fcf12a00640 1 -- 172.21.15.137:0/123037147 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) ==== 104+0+0 (secure 0 0 0) 0x7fcf080f02c0 con 0x7fcf1c15f0a0 2024-04-26T23:45:02.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.609+0000 7fcf20a00640 1 -- 172.21.15.137:0/123037147 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fcefc068380 msgr2=0x7fcefc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:02.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.609+0000 7fcf20a00640 1 --2- 172.21.15.137:0/123037147 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fcefc068380 0x7fcefc06a840 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c003ab0 tx=0x7fcf0c009830 comp rx=0 tx=0).stop 2024-04-26T23:45:02.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.609+0000 7fcf20a00640 1 -- 172.21.15.137:0/123037147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf1c15f0a0 msgr2=0x7fcf1c14dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:02.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.609+0000 7fcf20a00640 1 --2- 172.21.15.137:0/123037147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf1c15f0a0 0x7fcf1c14dde0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fcf080ae040 tx=0x7fcf0801ac30 comp rx=0 tx=0).stop 2024-04-26T23:45:02.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.609+0000 7fcf20a00640 1 -- 172.21.15.137:0/123037147 shutdown_connections 2024-04-26T23:45:02.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.609+0000 7fcf20a00640 1 --2- 172.21.15.137:0/123037147 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fcefc068380 0x7fcefc06a840 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:02.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.609+0000 7fcf20a00640 1 --2- 172.21.15.137:0/123037147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf1c15f0a0 0x7fcf1c14dde0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:02.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.609+0000 7fcf20a00640 1 --2- 172.21.15.137:0/123037147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf1c15f480 0x7fcf1c15df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:02.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.609+0000 7fcf20a00640 1 --2- 172.21.15.137:0/123037147 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf1c06d710 0x7fcf1c160530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:02.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.609+0000 7fcf20a00640 1 -- 172.21.15.137:0/123037147 >> 172.21.15.137:0/123037147 conn(0x7fcf1c0d2df0 msgr2=0x7fcf1c0753d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:02.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.609+0000 7fcf20a00640 1 -- 172.21.15.137:0/123037147 shutdown_connections 2024-04-26T23:45:02.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.609+0000 7fcf20a00640 1 -- 172.21.15.137:0/123037147 wait complete. 2024-04-26T23:45:02.635 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T23:45:02.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.769+0000 7f67bba00640 1 Processor -- start 2024-04-26T23:45:02.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.769+0000 7f67bba00640 1 -- start start 2024-04-26T23:45:02.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.773+0000 7f67bba00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f67b4145d30 0x7f67b40b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:02.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.773+0000 7f67bba00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f67b4074000 0x7f67b40b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:02.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.773+0000 7f67bba00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67b4160de0 0x7f67b4161260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:02.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.773+0000 7f67bba00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f67b40b65b0 con 0x7f67b4145d30 2024-04-26T23:45:02.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.773+0000 7f67bba00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f67b4074460 con 0x7f67b4074000 2024-04-26T23:45:02.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.773+0000 7f67bba00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f67b40b6f80 con 0x7f67b4160de0 2024-04-26T23:45:02.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.773+0000 7f67b9000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f67b4145d30 0x7f67b40b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:02.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.773+0000 7f67b9000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f67b4145d30 0x7f67b40b3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35392/0 (socket says 172.21.15.137:35392) 2024-04-26T23:45:02.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.773+0000 7f67b9000640 1 -- 172.21.15.137:0/1377626379 learned_addr learned my addr 172.21.15.137:0/1377626379 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:02.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.773+0000 7f67b9a00640 1 --2- 172.21.15.137:0/1377626379 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67b4160de0 0x7f67b4161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:02.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.773+0000 7f67b3e00640 1 --2- 172.21.15.137:0/1377626379 >> v2:172.21.15.170:3300/0 conn(0x7f67b4074000 0x7f67b40b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:02.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.773+0000 7f67b9000640 1 -- 172.21.15.137:0/1377626379 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67b4160de0 msgr2=0x7f67b4161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:02.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.773+0000 7f67b9000640 1 --2- 172.21.15.137:0/1377626379 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67b4160de0 0x7f67b4161260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:02.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.773+0000 7f67b9000640 1 -- 172.21.15.137:0/1377626379 >> v2:172.21.15.170:3300/0 conn(0x7f67b4074000 msgr2=0x7f67b40b6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:02.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.773+0000 7f67b9000640 1 --2- 172.21.15.137:0/1377626379 >> v2:172.21.15.170:3300/0 conn(0x7f67b4074000 0x7f67b40b6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:02.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.773+0000 7f67b9000640 1 -- 172.21.15.137:0/1377626379 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b40b4580 con 0x7f67b4145d30 2024-04-26T23:45:02.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.777+0000 7f67b9000640 1 --2- 172.21.15.137:0/1377626379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67b4145d30 0x7f67b40b3ec0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f67b40d0cd0 tx=0x7f67a401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61312b8241afd43 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:02.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.777+0000 7f67b3400640 1 -- 172.21.15.137:0/1377626379 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a40a5760 con 0x7f67b4145d30 2024-04-26T23:45:02.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.777+0000 7f67b3400640 1 -- 172.21.15.137:0/1377626379 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67a40a5900 con 0x7f67b4145d30 2024-04-26T23:45:02.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.777+0000 7f67b3400640 1 -- 172.21.15.137:0/1377626379 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a40a5cd0 con 0x7f67b4145d30 2024-04-26T23:45:02.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.777+0000 7f67bba00640 1 -- 172.21.15.137:0/1377626379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67b4145d30 msgr2=0x7f67b40b3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:02.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.777+0000 7f67bba00640 1 --2- 172.21.15.137:0/1377626379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67b4145d30 0x7f67b40b3ec0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f67b40d0cd0 tx=0x7f67a401c9f0 comp rx=0 tx=0).stop 2024-04-26T23:45:02.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.777+0000 7f67bba00640 1 -- 172.21.15.137:0/1377626379 shutdown_connections 2024-04-26T23:45:02.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.777+0000 7f67bba00640 1 --2- 172.21.15.137:0/1377626379 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67b4160de0 0x7f67b4161260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:02.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.777+0000 7f67bba00640 1 --2- 172.21.15.137:0/1377626379 >> v2:172.21.15.170:3300/0 conn(0x7f67b4074000 0x7f67b40b6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:02.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.777+0000 7f67bba00640 1 --2- 172.21.15.137:0/1377626379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67b4145d30 0x7f67b40b3ec0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:02.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.777+0000 7f67bba00640 1 -- 172.21.15.137:0/1377626379 >> 172.21.15.137:0/1377626379 conn(0x7f67b40b2bc0 msgr2=0x7f67b40b2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:02.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.777+0000 7f67bba00640 1 -- 172.21.15.137:0/1377626379 shutdown_connections 2024-04-26T23:45:02.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.777+0000 7f67bba00640 1 -- 172.21.15.137:0/1377626379 wait complete. 2024-04-26T23:45:02.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.777+0000 7f67bba00640 1 Processor -- start 2024-04-26T23:45:02.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.777+0000 7f67bba00640 1 -- start start 2024-04-26T23:45:02.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67bba00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67b4074000 0x7f67b412f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:02.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67bba00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67b4145d30 0x7f67b415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:02.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67bba00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67b4160de0 0x7f67b40b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:02.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67bba00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f67b40b5d20 con 0x7f67b4145d30 2024-04-26T23:45:02.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67bba00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f67b40b5ba0 con 0x7f67b4160de0 2024-04-26T23:45:02.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67bba00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f67b40729c0 con 0x7f67b4074000 2024-04-26T23:45:02.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67b3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67b4145d30 0x7f67b415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:02.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67b3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67b4145d30 0x7f67b415d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35402/0 (socket says 172.21.15.137:35402) 2024-04-26T23:45:02.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67b3e00640 1 -- 172.21.15.137:0/2460592721 learned_addr learned my addr 172.21.15.137:0/2460592721 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:02.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67b9000640 1 --2- 172.21.15.137:0/2460592721 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67b4074000 0x7f67b412f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:02.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67b9a00640 1 --2- 172.21.15.137:0/2460592721 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67b4160de0 0x7f67b40b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:02.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67b3e00640 1 -- 172.21.15.137:0/2460592721 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67b4074000 msgr2=0x7f67b412f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:02.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67b3e00640 1 --2- 172.21.15.137:0/2460592721 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67b4074000 0x7f67b412f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:02.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67b3e00640 1 -- 172.21.15.137:0/2460592721 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67b4160de0 msgr2=0x7f67b40b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:02.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67b3e00640 1 --2- 172.21.15.137:0/2460592721 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67b4160de0 0x7f67b40b15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:02.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67b3e00640 1 -- 172.21.15.137:0/2460592721 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b415dd30 con 0x7f67b4145d30 2024-04-26T23:45:02.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67b3e00640 1 --2- 172.21.15.137:0/2460592721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67b4145d30 0x7f67b415d7f0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f67a000d800 tx=0x7f67a000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:02.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67b0c00640 1 -- 172.21.15.137:0/2460592721 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a0018030 con 0x7f67b4145d30 2024-04-26T23:45:02.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67b0c00640 1 -- 172.21.15.137:0/2460592721 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67a0004020 con 0x7f67b4145d30 2024-04-26T23:45:02.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67b0c00640 1 -- 172.21.15.137:0/2460592721 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a0004210 con 0x7f67b4145d30 2024-04-26T23:45:02.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67bba00640 1 -- 172.21.15.137:0/2460592721 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b415b2b0 con 0x7f67b4145d30 2024-04-26T23:45:02.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67bba00640 1 -- 172.21.15.137:0/2460592721 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b415b870 con 0x7f67b4145d30 2024-04-26T23:45:02.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67bba00640 1 -- 172.21.15.137:0/2460592721 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b4076820 con 0x7f67b4145d30 2024-04-26T23:45:02.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67b0c00640 1 -- 172.21.15.137:0/2460592721 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f67a001b070 con 0x7f67b4145d30 2024-04-26T23:45:02.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.781+0000 7f67b0c00640 1 --2- 172.21.15.137:0/2460592721 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f67940683b0 0x7f679406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:02.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.785+0000 7f67b0c00640 1 -- 172.21.15.137:0/2460592721 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5795+0+0 (secure 0 0 0) 0x7f67a00869e0 con 0x7f67b4145d30 2024-04-26T23:45:02.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.785+0000 7f67b9000640 1 --2- 172.21.15.137:0/2460592721 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f67940683b0 0x7f679406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:02.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.785+0000 7f67b9000640 1 --2- 172.21.15.137:0/2460592721 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f67940683b0 0x7f679406a870 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f67a40ae000 tx=0x7f67a40a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:02.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.789+0000 7f67b0c00640 1 -- 172.21.15.137:0/2460592721 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f67a0056ea0 con 0x7f67b4145d30 2024-04-26T23:45:02.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:02.945+0000 7f67bba00640 1 -- 172.21.15.137:0/2460592721 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f67b40d05e0 con 0x7f67b4145d30 2024-04-26T23:45:03.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.609+0000 7f67b0c00640 1 -- 172.21.15.137:0/2460592721 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v62) ==== 181+0+0 (secure 0 0 0) 0x7f67a00567a0 con 0x7f67b4145d30 2024-04-26T23:45:03.612 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' removed 2024-04-26T23:45:03.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.609+0000 7f67bba00640 1 -- 172.21.15.137:0/2460592721 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f67940683b0 msgr2=0x7f679406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:03.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.609+0000 7f67bba00640 1 --2- 172.21.15.137:0/2460592721 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f67940683b0 0x7f679406a870 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f67a40ae000 tx=0x7f67a40a7070 comp rx=0 tx=0).stop 2024-04-26T23:45:03.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.609+0000 7f67bba00640 1 -- 172.21.15.137:0/2460592721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67b4145d30 msgr2=0x7f67b415d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:03.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.609+0000 7f67bba00640 1 --2- 172.21.15.137:0/2460592721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67b4145d30 0x7f67b415d7f0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f67a000d800 tx=0x7f67a000dc00 comp rx=0 tx=0).stop 2024-04-26T23:45:03.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.609+0000 7f67bba00640 1 -- 172.21.15.137:0/2460592721 shutdown_connections 2024-04-26T23:45:03.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.609+0000 7f67bba00640 1 --2- 172.21.15.137:0/2460592721 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f67940683b0 0x7f679406a870 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:03.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.609+0000 7f67bba00640 1 --2- 172.21.15.137:0/2460592721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67b4145d30 0x7f67b415d7f0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:03.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.609+0000 7f67bba00640 1 --2- 172.21.15.137:0/2460592721 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67b4160de0 0x7f67b40b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:03.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.609+0000 7f67bba00640 1 --2- 172.21.15.137:0/2460592721 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67b4074000 0x7f67b412f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:03.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.609+0000 7f67bba00640 1 -- 172.21.15.137:0/2460592721 >> 172.21.15.137:0/2460592721 conn(0x7f67b40b2bc0 msgr2=0x7f67b4146320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:03.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.613+0000 7f67bba00640 1 -- 172.21.15.137:0/2460592721 shutdown_connections 2024-04-26T23:45:03.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.613+0000 7f67bba00640 1 -- 172.21.15.137:0/2460592721 wait complete. 2024-04-26T23:45:03.641 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T23:45:03.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.777+0000 7f0aa0000640 1 Processor -- start 2024-04-26T23:45:03.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.777+0000 7f0aa0000640 1 -- start start 2024-04-26T23:45:03.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.777+0000 7f0aa0000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0a980b4350 0x7f0a98072a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:03.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.777+0000 7f0aa0000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0a98072f60 0x7f0a9806f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:03.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.777+0000 7f0aa0000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a9815bc60 con 0x7f0a9815b880 2024-04-26T23:45:03.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.777+0000 7f0aa0000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0a9806f2d0 con 0x7f0a98072f60 2024-04-26T23:45:03.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.777+0000 7f0aa0000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0a9806e9c0 con 0x7f0a980b4350 2024-04-26T23:45:03.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.781+0000 7f0a9d600640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f0a9815b880 0x7f0a980cfc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40566/0 (socket says 172.21.15.137:40566) 2024-04-26T23:45:03.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.781+0000 7f0a9d600640 1 -- 172.21.15.137:0/2205399259 learned_addr learned my addr 172.21.15.137:0/2205399259 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:45:03.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.781+0000 7f0a9e000640 1 --2- 172.21.15.137:0/2205399259 >> v2:172.21.15.137:3300/0 conn(0x7f0a98072f60 0x7f0a9806f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:03.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.781+0000 7f0a9cc00640 1 --2- 172.21.15.137:0/2205399259 >> v2:172.21.15.170:3300/0 conn(0x7f0a980b4350 0x7f0a98072a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:03.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.781+0000 7f0a97e00640 1 -- 172.21.15.137:0/2205399259 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 762231503 0 0) 0x7f0a8c001120 con 0x7f0a9815b880 2024-04-26T23:45:03.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.781+0000 7f0a9e000640 1 -- 172.21.15.137:0/2205399259 >> v2:172.21.15.170:3300/0 conn(0x7f0a980b4350 msgr2=0x7f0a98072a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:03.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.781+0000 7f0a9e000640 1 --2- 172.21.15.137:0/2205399259 >> v2:172.21.15.170:3300/0 conn(0x7f0a980b4350 0x7f0a98072a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:03.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.781+0000 7f0a9e000640 1 -- 172.21.15.137:0/2205399259 >> v1:172.21.15.137:6789/0 conn(0x7f0a9815b880 legacy=0x7f0a980cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:03.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.781+0000 7f0a9e000640 1 -- 172.21.15.137:0/2205399259 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a980cefb0 con 0x7f0a98072f60 2024-04-26T23:45:03.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.781+0000 7f0a9e000640 1 --2- 172.21.15.137:0/2205399259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a98072f60 0x7f0a9806f760 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f0a98160460 tx=0x7f0a9001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b718f37e31d2e712 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:03.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.781+0000 7f0a97e00640 1 -- 172.21.15.137:0/2205399259 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a900b2070 con 0x7f0a98072f60 2024-04-26T23:45:03.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.781+0000 7f0a97e00640 1 -- 172.21.15.137:0/2205399259 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a900a5970 con 0x7f0a98072f60 2024-04-26T23:45:03.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.781+0000 7f0a97e00640 1 -- 172.21.15.137:0/2205399259 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a900a5d40 con 0x7f0a98072f60 2024-04-26T23:45:03.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0aa0000640 1 -- 172.21.15.137:0/2205399259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a98072f60 msgr2=0x7f0a9806f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:03.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0aa0000640 1 --2- 172.21.15.137:0/2205399259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a98072f60 0x7f0a9806f760 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f0a98160460 tx=0x7f0a9001c930 comp rx=0 tx=0).stop 2024-04-26T23:45:03.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0aa0000640 1 -- 172.21.15.137:0/2205399259 shutdown_connections 2024-04-26T23:45:03.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0aa0000640 1 --2- 172.21.15.137:0/2205399259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a98072f60 0x7f0a9806f760 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:03.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0aa0000640 1 --2- 172.21.15.137:0/2205399259 >> v2:172.21.15.170:3300/0 conn(0x7f0a980b4350 0x7f0a98072a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:03.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0aa0000640 1 -- 172.21.15.137:0/2205399259 >> 172.21.15.137:0/2205399259 conn(0x7f0a980b2bc0 msgr2=0x7f0a980b2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:03.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0aa0000640 1 -- 172.21.15.137:0/2205399259 shutdown_connections 2024-04-26T23:45:03.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0aa0000640 1 -- 172.21.15.137:0/2205399259 wait complete. 2024-04-26T23:45:03.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0aa0000640 1 Processor -- start 2024-04-26T23:45:03.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0aa0000640 1 -- start start 2024-04-26T23:45:03.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0aa0000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a98072f60 0x7f0a9814f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:03.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0aa0000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a980b4350 0x7f0a980b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:03.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0aa0000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a9815b880 0x7f0a98149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:03.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0aa0000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0a980d0310 con 0x7f0a9815b880 2024-04-26T23:45:03.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0aa0000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0a980b4760 con 0x7f0a98072f60 2024-04-26T23:45:03.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0aa0000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0a980d0490 con 0x7f0a980b4350 2024-04-26T23:45:03.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0a9e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a9815b880 0x7f0a98149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:03.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0a9e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a9815b880 0x7f0a98149200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35418/0 (socket says 172.21.15.137:35418) 2024-04-26T23:45:03.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0a9e000640 1 -- 172.21.15.137:0/331081610 learned_addr learned my addr 172.21.15.137:0/331081610 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:03.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0a9d600640 1 --2- 172.21.15.137:0/331081610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a98072f60 0x7f0a9814f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:03.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0a9cc00640 1 --2- 172.21.15.137:0/331081610 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a980b4350 0x7f0a980b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:03.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0a9e000640 1 -- 172.21.15.137:0/331081610 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a980b4350 msgr2=0x7f0a980b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:03.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0a9e000640 1 --2- 172.21.15.137:0/331081610 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a980b4350 0x7f0a980b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:03.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0a9e000640 1 -- 172.21.15.137:0/331081610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a98072f60 msgr2=0x7f0a9814f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:03.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0a9e000640 1 --2- 172.21.15.137:0/331081610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a98072f60 0x7f0a9814f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:03.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0a9e000640 1 -- 172.21.15.137:0/331081610 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9814ee80 con 0x7f0a9815b880 2024-04-26T23:45:03.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.785+0000 7f0a9cc00640 1 --2- 172.21.15.137:0/331081610 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a980b4350 0x7f0a980b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:03.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.789+0000 7f0a9e000640 1 --2- 172.21.15.137:0/331081610 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a9815b880 0x7f0a98149200 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f0a90019540 tx=0x7f0a900196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:03.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.789+0000 7f0a95600640 1 -- 172.21.15.137:0/331081610 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a900bd020 con 0x7f0a9815b880 2024-04-26T23:45:03.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.789+0000 7f0a95600640 1 -- 172.21.15.137:0/331081610 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a900b8670 con 0x7f0a9815b880 2024-04-26T23:45:03.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.789+0000 7f0a95600640 1 -- 172.21.15.137:0/331081610 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a900b2040 con 0x7f0a9815b880 2024-04-26T23:45:03.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.789+0000 7f0aa0000640 1 -- 172.21.15.137:0/331081610 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a980b1c20 con 0x7f0a9815b880 2024-04-26T23:45:03.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.789+0000 7f0aa0000640 1 -- 172.21.15.137:0/331081610 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a980b1380 con 0x7f0a9815b880 2024-04-26T23:45:03.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.789+0000 7f0aa0000640 1 -- 172.21.15.137:0/331081610 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a98076820 con 0x7f0a9815b880 2024-04-26T23:45:03.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.789+0000 7f0a95600640 1 -- 172.21.15.137:0/331081610 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0a900c0020 con 0x7f0a9815b880 2024-04-26T23:45:03.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.789+0000 7f0a95600640 1 --2- 172.21.15.137:0/331081610 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0a78068380 0x7f0a7806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:03.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.789+0000 7f0a95600640 1 -- 172.21.15.137:0/331081610 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5357+0+0 (secure 0 0 0) 0x7f0a901216c0 con 0x7f0a9815b880 2024-04-26T23:45:03.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.789+0000 7f0a9d600640 1 --2- 172.21.15.137:0/331081610 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0a78068380 0x7f0a7806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:03.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.793+0000 7f0a9d600640 1 --2- 172.21.15.137:0/331081610 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0a78068380 0x7f0a7806a840 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c000f70 tx=0x7f0a8c007df0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:03.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.793+0000 7f0a95600640 1 -- 172.21.15.137:0/331081610 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0a900c7070 con 0x7f0a9815b880 2024-04-26T23:45:03.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:03.961+0000 7f0aa0000640 1 -- 172.21.15.137:0/331081610 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0a9806e620 con 0x7f0a9815b880 2024-04-26T23:45:04.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.613+0000 7f0a95600640 1 -- 172.21.15.137:0/331081610 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v63) ==== 169+0+0 (secure 0 0 0) 0x7f0a980b1c20 con 0x7f0a9815b880 2024-04-26T23:45:04.617 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' removed 2024-04-26T23:45:04.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.617+0000 7f0aa0000640 1 -- 172.21.15.137:0/331081610 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0a78068380 msgr2=0x7f0a7806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:04.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.617+0000 7f0aa0000640 1 --2- 172.21.15.137:0/331081610 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0a78068380 0x7f0a7806a840 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c000f70 tx=0x7f0a8c007df0 comp rx=0 tx=0).stop 2024-04-26T23:45:04.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.617+0000 7f0aa0000640 1 -- 172.21.15.137:0/331081610 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a9815b880 msgr2=0x7f0a98149200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:04.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.617+0000 7f0aa0000640 1 --2- 172.21.15.137:0/331081610 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a9815b880 0x7f0a98149200 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f0a90019540 tx=0x7f0a900196d0 comp rx=0 tx=0).stop 2024-04-26T23:45:04.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.617+0000 7f0aa0000640 1 -- 172.21.15.137:0/331081610 shutdown_connections 2024-04-26T23:45:04.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.617+0000 7f0aa0000640 1 --2- 172.21.15.137:0/331081610 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0a78068380 0x7f0a7806a840 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:04.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.617+0000 7f0aa0000640 1 --2- 172.21.15.137:0/331081610 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a9815b880 0x7f0a98149200 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:04.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.617+0000 7f0aa0000640 1 --2- 172.21.15.137:0/331081610 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a980b4350 0x7f0a980b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:04.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.617+0000 7f0aa0000640 1 --2- 172.21.15.137:0/331081610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a98072f60 0x7f0a9814f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:04.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.617+0000 7f0aa0000640 1 -- 172.21.15.137:0/331081610 >> 172.21.15.137:0/331081610 conn(0x7f0a980b2bc0 msgr2=0x7f0a980b2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:04.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.617+0000 7f0aa0000640 1 -- 172.21.15.137:0/331081610 shutdown_connections 2024-04-26T23:45:04.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.617+0000 7f0aa0000640 1 -- 172.21.15.137:0/331081610 wait complete. 2024-04-26T23:45:04.645 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T23:45:04.649 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T23:45:04.690 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2024-04-26T23:45:04.690 INFO:teuthology.orchestra.run.smithi137.stdout: chdir = "" 2024-04-26T23:45:04.690 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T23:45:04.690 INFO:teuthology.orchestra.run.smithi137.stdout: auth supported = cephx 2024-04-26T23:45:04.690 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.690 INFO:teuthology.orchestra.run.smithi137.stdout: filestore xattr use omap = true 2024-04-26T23:45:04.690 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.691 INFO:teuthology.orchestra.run.smithi137.stdout: mon clock drift allowed = 1.000 2024-04-26T23:45:04.691 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.691 INFO:teuthology.orchestra.run.smithi137.stdout: osd crush chooseleaf type = 0 2024-04-26T23:45:04.691 INFO:teuthology.orchestra.run.smithi137.stdout: auth debug = true 2024-04-26T23:45:04.691 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.691 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on old message = true 2024-04-26T23:45:04.691 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on bug = true 2024-04-26T23:45:04.691 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.691 INFO:teuthology.orchestra.run.smithi137.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T23:45:04.691 INFO:teuthology.orchestra.run.smithi137.stdout: mon pg warn max object skew = 0 2024-04-26T23:45:04.691 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.691 INFO:teuthology.orchestra.run.smithi137.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T23:45:04.691 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T23:45:04.691 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.691 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default size = 2 2024-04-26T23:45:04.692 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.692 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow primary affinity = true 2024-04-26T23:45:04.692 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow pg remap = true 2024-04-26T23:45:04.692 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on legacy crush tunables = false 2024-04-26T23:45:04.692 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on crush straw calc version zero = false 2024-04-26T23:45:04.692 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on no sortbitwise = false 2024-04-26T23:45:04.692 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on osd down out interval zero = false 2024-04-26T23:45:04.692 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on too few osds = false 2024-04-26T23:45:04.692 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T23:45:04.692 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T23:45:04.692 INFO:teuthology.orchestra.run.smithi137.stdout: mon_allow_pool_size_one = true 2024-04-26T23:45:04.692 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.692 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T23:45:04.692 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.693 INFO:teuthology.orchestra.run.smithi137.stdout: osd default data pool replay window = 5 2024-04-26T23:45:04.693 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.693 INFO:teuthology.orchestra.run.smithi137.stdout: mon allow pool delete = true 2024-04-26T23:45:04.693 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.693 INFO:teuthology.orchestra.run.smithi137.stdout: mon cluster log file level = debug 2024-04-26T23:45:04.693 INFO:teuthology.orchestra.run.smithi137.stdout: debug asserts on shutdown = true 2024-04-26T23:45:04.693 INFO:teuthology.orchestra.run.smithi137.stdout: mon health detail to clog = false 2024-04-26T23:45:04.693 INFO:teuthology.orchestra.run.smithi137.stdout: mon host = "172.21.15.137,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]" 2024-04-26T23:45:04.693 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = efde6204-be0d-4c4f-9ea0-954d26627e78 2024-04-26T23:45:04.693 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.693 INFO:teuthology.orchestra.run.smithi137.stdout:[osd] 2024-04-26T23:45:04.693 INFO:teuthology.orchestra.run.smithi137.stdout: osd journal size = 100 2024-04-26T23:45:04.693 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.693 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub load threshold = 5.0 2024-04-26T23:45:04.693 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub max interval = 600 2024-04-26T23:45:04.694 INFO:teuthology.orchestra.run.smithi137.stdout: osd mclock profile = high_recovery_ops 2024-04-26T23:45:04.694 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.694 INFO:teuthology.orchestra.run.smithi137.stdout: osd recover clone overlap = true 2024-04-26T23:45:04.694 INFO:teuthology.orchestra.run.smithi137.stdout: osd recovery max chunk = 1048576 2024-04-26T23:45:04.694 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.694 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug shutdown = true 2024-04-26T23:45:04.694 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug op order = true 2024-04-26T23:45:04.694 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify stray on activate = true 2024-04-26T23:45:04.694 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug trim objects = true 2024-04-26T23:45:04.694 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.694 INFO:teuthology.orchestra.run.smithi137.stdout: osd open classes on start = true 2024-04-26T23:45:04.694 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug pg log writeout = true 2024-04-26T23:45:04.694 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.694 INFO:teuthology.orchestra.run.smithi137.stdout: osd deep scrub update digest min age = 30 2024-04-26T23:45:04.695 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.695 INFO:teuthology.orchestra.run.smithi137.stdout: osd map max advance = 10 2024-04-26T23:45:04.695 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.695 INFO:teuthology.orchestra.run.smithi137.stdout: journal zero on create = true 2024-04-26T23:45:04.695 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.695 INFO:teuthology.orchestra.run.smithi137.stdout: filestore ondisk finisher threads = 3 2024-04-26T23:45:04.695 INFO:teuthology.orchestra.run.smithi137.stdout: filestore apply finisher threads = 3 2024-04-26T23:45:04.695 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.695 INFO:teuthology.orchestra.run.smithi137.stdout: bdev debug aio = true 2024-04-26T23:45:04.695 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug misdirected ops = true 2024-04-26T23:45:04.695 INFO:teuthology.orchestra.run.smithi137.stdout: bdev async discard = True 2024-04-26T23:45:04.695 INFO:teuthology.orchestra.run.smithi137.stdout: bdev enable discard = True 2024-04-26T23:45:04.695 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore allocator = bitmap 2024-04-26T23:45:04.695 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore block size = 96636764160 2024-04-26T23:45:04.695 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore fsck on mount = True 2024-04-26T23:45:04.696 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluefs = 1/20 2024-04-26T23:45:04.696 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluestore = 1/20 2024-04-26T23:45:04.696 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T23:45:04.696 INFO:teuthology.orchestra.run.smithi137.stdout: debug osd = 20 2024-04-26T23:45:04.696 INFO:teuthology.orchestra.run.smithi137.stdout: debug rocksdb = 4/10 2024-04-26T23:45:04.696 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T23:45:04.696 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd full ratio = 0.9 2024-04-26T23:45:04.696 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd nearfull ratio = 0.8 2024-04-26T23:45:04.696 INFO:teuthology.orchestra.run.smithi137.stdout: osd failsafe full ratio = 0.95 2024-04-26T23:45:04.696 INFO:teuthology.orchestra.run.smithi137.stdout: osd objectstore = bluestore 2024-04-26T23:45:04.696 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-04-26T23:45:04.696 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.696 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr] 2024-04-26T23:45:04.696 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T23:45:04.697 INFO:teuthology.orchestra.run.smithi137.stdout: debug mgr = 20 2024-04-26T23:45:04.697 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-04-26T23:45:04.697 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-04-26T23:45:04.697 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:45:04.697 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:45:04.697 INFO:teuthology.orchestra.run.smithi137.stdout: mgr/telemetry/nag = false 2024-04-26T23:45:04.697 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-04-26T23:45:04.697 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.697 INFO:teuthology.orchestra.run.smithi137.stdout:[mon] 2024-04-26T23:45:04.697 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T23:45:04.697 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-04-26T23:45:04.697 INFO:teuthology.orchestra.run.smithi137.stdout: debug paxos = 20 2024-04-26T23:45:04.697 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-04-26T23:45:04.697 INFO:teuthology.orchestra.run.smithi137.stdout: mon data avail warn = 5 2024-04-26T23:45:04.698 INFO:teuthology.orchestra.run.smithi137.stdout: mon mgr mkfs grace = 240 2024-04-26T23:45:04.698 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:45:04.698 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd reporter subtree level = osd 2024-04-26T23:45:04.698 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd prime pg temp = true 2024-04-26T23:45:04.698 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:45:04.698 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.698 INFO:teuthology.orchestra.run.smithi137.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T23:45:04.698 INFO:teuthology.orchestra.run.smithi137.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T23:45:04.698 INFO:teuthology.orchestra.run.smithi137.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T23:45:04.698 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.698 INFO:teuthology.orchestra.run.smithi137.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T23:45:04.698 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T23:45:04.698 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T23:45:04.698 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.699 INFO:teuthology.orchestra.run.smithi137.stdout: # 1m isn't quite enough 2024-04-26T23:45:04.699 INFO:teuthology.orchestra.run.smithi137.stdout: mon_down_mkfs_grace = 2m 2024-04-26T23:45:04.699 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.699 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_filestore_osds = false 2024-04-26T23:45:04.699 INFO:teuthology.orchestra.run.smithi137.stdout: mon down mkfs grace = 300 2024-04-26T23:45:04.699 INFO:teuthology.orchestra.run.smithi137.stdout: mon op complaint time = 120 2024-04-26T23:45:04.699 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:04.699 INFO:teuthology.orchestra.run.smithi137.stdout:[client] 2024-04-26T23:45:04.699 INFO:teuthology.orchestra.run.smithi137.stdout: rgw cache enabled = true 2024-04-26T23:45:04.699 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable ops log = true 2024-04-26T23:45:04.699 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable usage log = true 2024-04-26T23:45:04.699 INFO:teuthology.orchestra.run.smithi137.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T23:45:04.699 INFO:teuthology.orchestra.run.smithi137.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T23:45:04.699 INFO:teuthology.orchestra.run.smithi137.stdout: client mount timeout = 600 2024-04-26T23:45:04.699 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-04-26T23:45:04.700 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T23:45:04.700 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = "" 2024-04-26T23:45:04.700 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-04-26T23:45:04.700 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-04-26T23:45:04.700 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.a] 2024-04-26T23:45:04.700 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.b] 2024-04-26T23:45:04.700 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.c] 2024-04-26T23:45:04.700 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2024-04-26T23:45:04.700 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2024-04-26T23:45:04.700 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2024-04-26T23:45:04.700 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d] 2024-04-26T23:45:04.700 INFO:teuthology.orchestra.run.smithi137.stdout:[mds] 2024-04-26T23:45:04.700 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds = 20 2024-04-26T23:45:04.700 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds balancer = 20 2024-04-26T23:45:04.701 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T23:45:04.701 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug frag = True 2024-04-26T23:45:04.701 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug scatterstat = True 2024-04-26T23:45:04.701 INFO:teuthology.orchestra.run.smithi137.stdout: mds op complaint time = 180 2024-04-26T23:45:04.701 INFO:teuthology.orchestra.run.smithi137.stdout: mds verify scatter = True 2024-04-26T23:45:04.701 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-04-26T23:45:04.701 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-04-26T23:45:04.701 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-04-26T23:45:04.701 INFO:teuthology.orchestra.run.smithi137.stdout:[client.badguy] 2024-04-26T23:45:04.702 INFO:teuthology.orchestra.run.smithi170.stdout:[global] 2024-04-26T23:45:04.702 INFO:teuthology.orchestra.run.smithi170.stdout: chdir = "" 2024-04-26T23:45:04.702 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T23:45:04.702 INFO:teuthology.orchestra.run.smithi170.stdout: auth supported = cephx 2024-04-26T23:45:04.702 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.702 INFO:teuthology.orchestra.run.smithi170.stdout: filestore xattr use omap = true 2024-04-26T23:45:04.702 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.702 INFO:teuthology.orchestra.run.smithi170.stdout: mon clock drift allowed = 1.000 2024-04-26T23:45:04.702 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.702 INFO:teuthology.orchestra.run.smithi170.stdout: osd crush chooseleaf type = 0 2024-04-26T23:45:04.702 INFO:teuthology.orchestra.run.smithi170.stdout: auth debug = true 2024-04-26T23:45:04.702 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.702 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on old message = true 2024-04-26T23:45:04.703 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on bug = true 2024-04-26T23:45:04.703 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.703 INFO:teuthology.orchestra.run.smithi170.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T23:45:04.703 INFO:teuthology.orchestra.run.smithi170.stdout: mon pg warn max object skew = 0 2024-04-26T23:45:04.703 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.703 INFO:teuthology.orchestra.run.smithi170.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T23:45:04.703 INFO:teuthology.orchestra.run.smithi170.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T23:45:04.703 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.703 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default size = 2 2024-04-26T23:45:04.703 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.703 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow primary affinity = true 2024-04-26T23:45:04.703 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow pg remap = true 2024-04-26T23:45:04.703 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on legacy crush tunables = false 2024-04-26T23:45:04.703 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on crush straw calc version zero = false 2024-04-26T23:45:04.703 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on no sortbitwise = false 2024-04-26T23:45:04.704 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on osd down out interval zero = false 2024-04-26T23:45:04.704 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on too few osds = false 2024-04-26T23:45:04.704 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T23:45:04.704 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T23:45:04.704 INFO:teuthology.orchestra.run.smithi170.stdout: mon_allow_pool_size_one = true 2024-04-26T23:45:04.704 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.704 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T23:45:04.704 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.704 INFO:teuthology.orchestra.run.smithi170.stdout: osd default data pool replay window = 5 2024-04-26T23:45:04.704 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.704 INFO:teuthology.orchestra.run.smithi170.stdout: mon allow pool delete = true 2024-04-26T23:45:04.704 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.704 INFO:teuthology.orchestra.run.smithi170.stdout: mon cluster log file level = debug 2024-04-26T23:45:04.704 INFO:teuthology.orchestra.run.smithi170.stdout: debug asserts on shutdown = true 2024-04-26T23:45:04.704 INFO:teuthology.orchestra.run.smithi170.stdout: mon health detail to clog = false 2024-04-26T23:45:04.705 INFO:teuthology.orchestra.run.smithi170.stdout: mon host = "172.21.15.137,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]" 2024-04-26T23:45:04.705 INFO:teuthology.orchestra.run.smithi170.stdout: fsid = efde6204-be0d-4c4f-9ea0-954d26627e78 2024-04-26T23:45:04.705 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.705 INFO:teuthology.orchestra.run.smithi170.stdout:[osd] 2024-04-26T23:45:04.705 INFO:teuthology.orchestra.run.smithi170.stdout: osd journal size = 100 2024-04-26T23:45:04.705 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.705 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub load threshold = 5.0 2024-04-26T23:45:04.705 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub max interval = 600 2024-04-26T23:45:04.705 INFO:teuthology.orchestra.run.smithi170.stdout: osd mclock profile = high_recovery_ops 2024-04-26T23:45:04.705 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.705 INFO:teuthology.orchestra.run.smithi170.stdout: osd recover clone overlap = true 2024-04-26T23:45:04.705 INFO:teuthology.orchestra.run.smithi170.stdout: osd recovery max chunk = 1048576 2024-04-26T23:45:04.705 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.705 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug shutdown = true 2024-04-26T23:45:04.705 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug op order = true 2024-04-26T23:45:04.706 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug verify stray on activate = true 2024-04-26T23:45:04.706 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug trim objects = true 2024-04-26T23:45:04.706 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.706 INFO:teuthology.orchestra.run.smithi170.stdout: osd open classes on start = true 2024-04-26T23:45:04.706 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug pg log writeout = true 2024-04-26T23:45:04.706 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.706 INFO:teuthology.orchestra.run.smithi170.stdout: osd deep scrub update digest min age = 30 2024-04-26T23:45:04.706 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.706 INFO:teuthology.orchestra.run.smithi170.stdout: osd map max advance = 10 2024-04-26T23:45:04.706 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.706 INFO:teuthology.orchestra.run.smithi170.stdout: journal zero on create = true 2024-04-26T23:45:04.706 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.706 INFO:teuthology.orchestra.run.smithi170.stdout: filestore ondisk finisher threads = 3 2024-04-26T23:45:04.706 INFO:teuthology.orchestra.run.smithi170.stdout: filestore apply finisher threads = 3 2024-04-26T23:45:04.707 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.707 INFO:teuthology.orchestra.run.smithi170.stdout: bdev debug aio = true 2024-04-26T23:45:04.707 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug misdirected ops = true 2024-04-26T23:45:04.707 INFO:teuthology.orchestra.run.smithi170.stdout: bdev async discard = True 2024-04-26T23:45:04.707 INFO:teuthology.orchestra.run.smithi170.stdout: bdev enable discard = True 2024-04-26T23:45:04.707 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore allocator = bitmap 2024-04-26T23:45:04.707 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore block size = 96636764160 2024-04-26T23:45:04.707 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore fsck on mount = True 2024-04-26T23:45:04.707 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluefs = 1/20 2024-04-26T23:45:04.707 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluestore = 1/20 2024-04-26T23:45:04.707 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T23:45:04.707 INFO:teuthology.orchestra.run.smithi170.stdout: debug osd = 20 2024-04-26T23:45:04.707 INFO:teuthology.orchestra.run.smithi170.stdout: debug rocksdb = 4/10 2024-04-26T23:45:04.707 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T23:45:04.707 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd full ratio = 0.9 2024-04-26T23:45:04.707 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd nearfull ratio = 0.8 2024-04-26T23:45:04.708 INFO:teuthology.orchestra.run.smithi170.stdout: osd failsafe full ratio = 0.95 2024-04-26T23:45:04.708 INFO:teuthology.orchestra.run.smithi170.stdout: osd objectstore = bluestore 2024-04-26T23:45:04.708 INFO:teuthology.orchestra.run.smithi170.stdout: osd op complaint time = 180 2024-04-26T23:45:04.709 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.709 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr] 2024-04-26T23:45:04.709 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T23:45:04.709 INFO:teuthology.orchestra.run.smithi170.stdout: debug mgr = 20 2024-04-26T23:45:04.709 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-04-26T23:45:04.709 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-04-26T23:45:04.709 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:45:04.709 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:45:04.709 INFO:teuthology.orchestra.run.smithi170.stdout: mgr/telemetry/nag = false 2024-04-26T23:45:04.709 INFO:teuthology.orchestra.run.smithi170.stdout: debug client = 20 2024-04-26T23:45:04.709 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.709 INFO:teuthology.orchestra.run.smithi170.stdout:[mon] 2024-04-26T23:45:04.709 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T23:45:04.709 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-04-26T23:45:04.709 INFO:teuthology.orchestra.run.smithi170.stdout: debug paxos = 20 2024-04-26T23:45:04.710 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-04-26T23:45:04.710 INFO:teuthology.orchestra.run.smithi170.stdout: mon data avail warn = 5 2024-04-26T23:45:04.710 INFO:teuthology.orchestra.run.smithi170.stdout: mon mgr mkfs grace = 240 2024-04-26T23:45:04.710 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:45:04.710 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd reporter subtree level = osd 2024-04-26T23:45:04.710 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd prime pg temp = true 2024-04-26T23:45:04.710 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:45:04.710 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.710 INFO:teuthology.orchestra.run.smithi170.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T23:45:04.710 INFO:teuthology.orchestra.run.smithi170.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T23:45:04.710 INFO:teuthology.orchestra.run.smithi170.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T23:45:04.710 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.710 INFO:teuthology.orchestra.run.smithi170.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T23:45:04.710 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T23:45:04.711 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T23:45:04.711 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.711 INFO:teuthology.orchestra.run.smithi170.stdout: # 1m isn't quite enough 2024-04-26T23:45:04.711 INFO:teuthology.orchestra.run.smithi170.stdout: mon_down_mkfs_grace = 2m 2024-04-26T23:45:04.711 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.711 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_filestore_osds = false 2024-04-26T23:45:04.711 INFO:teuthology.orchestra.run.smithi170.stdout: mon down mkfs grace = 300 2024-04-26T23:45:04.711 INFO:teuthology.orchestra.run.smithi170.stdout: mon op complaint time = 120 2024-04-26T23:45:04.711 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T23:45:04.711 INFO:teuthology.orchestra.run.smithi170.stdout:[client] 2024-04-26T23:45:04.711 INFO:teuthology.orchestra.run.smithi170.stdout: rgw cache enabled = true 2024-04-26T23:45:04.711 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable ops log = true 2024-04-26T23:45:04.711 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable usage log = true 2024-04-26T23:45:04.711 INFO:teuthology.orchestra.run.smithi170.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T23:45:04.711 INFO:teuthology.orchestra.run.smithi170.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T23:45:04.711 INFO:teuthology.orchestra.run.smithi170.stdout: client mount timeout = 600 2024-04-26T23:45:04.712 INFO:teuthology.orchestra.run.smithi170.stdout: debug client = 20 2024-04-26T23:45:04.712 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T23:45:04.712 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = "" 2024-04-26T23:45:04.712 INFO:teuthology.orchestra.run.smithi170.stdout: rados mon op timeout = 900 2024-04-26T23:45:04.712 INFO:teuthology.orchestra.run.smithi170.stdout: rados osd op timeout = 900 2024-04-26T23:45:04.712 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.a] 2024-04-26T23:45:04.712 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.b] 2024-04-26T23:45:04.712 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.c] 2024-04-26T23:45:04.712 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.a] 2024-04-26T23:45:04.712 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.c] 2024-04-26T23:45:04.712 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.b] 2024-04-26T23:45:04.712 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.d] 2024-04-26T23:45:04.712 INFO:teuthology.orchestra.run.smithi170.stdout:[mds] 2024-04-26T23:45:04.712 INFO:teuthology.orchestra.run.smithi170.stdout: debug mds = 20 2024-04-26T23:45:04.712 INFO:teuthology.orchestra.run.smithi170.stdout: debug mds balancer = 20 2024-04-26T23:45:04.713 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T23:45:04.713 INFO:teuthology.orchestra.run.smithi170.stdout: mds debug frag = True 2024-04-26T23:45:04.713 INFO:teuthology.orchestra.run.smithi170.stdout: mds debug scatterstat = True 2024-04-26T23:45:04.713 INFO:teuthology.orchestra.run.smithi170.stdout: mds op complaint time = 180 2024-04-26T23:45:04.713 INFO:teuthology.orchestra.run.smithi170.stdout: mds verify scatter = True 2024-04-26T23:45:04.713 INFO:teuthology.orchestra.run.smithi170.stdout: osd op complaint time = 180 2024-04-26T23:45:04.713 INFO:teuthology.orchestra.run.smithi170.stdout: rados mon op timeout = 900 2024-04-26T23:45:04.713 INFO:teuthology.orchestra.run.smithi170.stdout: rados osd op timeout = 900 2024-04-26T23:45:04.713 INFO:teuthology.orchestra.run.smithi170.stdout:[client.badguy] 2024-04-26T23:45:04.715 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-26T23:45:04.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e74200640 1 Processor -- start 2024-04-26T23:45:04.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e74200640 1 -- start start 2024-04-26T23:45:04.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e74200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0e6c0d39d0 0x7f0e6c15eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:04.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e74200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e6c0d11e0 con 0x7f0e6c0cee00 2024-04-26T23:45:04.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e74200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e6c0d1480 con 0x7f0e6c06e5a0 2024-04-26T23:45:04.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e74200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0e6c0d2090 con 0x7f0e6c0d39d0 2024-04-26T23:45:04.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e71800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f0e6c0cee00 0x7f0e6c06de90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40570/0 (socket says 172.21.15.137:40570) 2024-04-26T23:45:04.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e71800640 1 -- 172.21.15.137:0/824066463 learned_addr learned my addr 172.21.15.137:0/824066463 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:45:04.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e70e00640 1 --2- 172.21.15.137:0/824066463 >> v2:172.21.15.170:3300/0 conn(0x7f0e6c0d39d0 0x7f0e6c15eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:04.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e6be00640 1 -- 172.21.15.137:0/824066463 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 806017309 0 0) 0x7f0e6c0d11e0 con 0x7f0e6c0cee00 2024-04-26T23:45:04.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e6be00640 1 -- 172.21.15.137:0/824066463 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e54003530 con 0x7f0e6c0cee00 2024-04-26T23:45:04.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e6be00640 1 -- 172.21.15.137:0/824066463 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2109290115 0 0) 0x7f0e6c0d1480 con 0x7f0e6c06e5a0 2024-04-26T23:45:04.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e6be00640 1 -- 172.21.15.137:0/824066463 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e6c0d11e0 con 0x7f0e6c06e5a0 2024-04-26T23:45:04.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e6be00640 1 -- 172.21.15.137:0/824066463 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3115384471 0 0) 0x7f0e54003530 con 0x7f0e6c0cee00 2024-04-26T23:45:04.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e6be00640 1 -- 172.21.15.137:0/824066463 >> v2:172.21.15.170:3300/0 conn(0x7f0e6c0d39d0 msgr2=0x7f0e6c15eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:04.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e6be00640 1 --2- 172.21.15.137:0/824066463 >> v2:172.21.15.170:3300/0 conn(0x7f0e6c0d39d0 0x7f0e6c15eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:04.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e6be00640 1 -- 172.21.15.137:0/824066463 >> v1:172.21.15.170:6789/0 conn(0x7f0e6c06e5a0 legacy=0x7f0e6c15f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:04.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e6be00640 1 -- 172.21.15.137:0/824066463 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e6c0d1760 con 0x7f0e6c0cee00 2024-04-26T23:45:04.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e6be00640 1 -- 172.21.15.137:0/824066463 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f0e60001620 con 0x7f0e6c0cee00 2024-04-26T23:45:04.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e6be00640 1 -- 172.21.15.137:0/824066463 >> v1:172.21.15.137:6789/0 conn(0x7f0e6c0cee00 legacy=0x7f0e6c06de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:04.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e6be00640 1 --2- 172.21.15.137:0/824066463 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e54003b50 0x7f0e54003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:04.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e6be00640 1 --2- 172.21.15.137:0/824066463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e54004810 0x7f0e54004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:04.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e6be00640 1 --2- 172.21.15.137:0/824066463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e540051d0 0x7f0e5400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:04.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e6be00640 1 -- 172.21.15.137:0/824066463 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c0d2090 con 0x7f0e540051d0 2024-04-26T23:45:04.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e6be00640 1 -- 172.21.15.137:0/824066463 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5400c050 con 0x7f0e54004810 2024-04-26T23:45:04.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e6be00640 1 -- 172.21.15.137:0/824066463 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0e5400c250 con 0x7f0e54003b50 2024-04-26T23:45:04.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e70e00640 1 --2- 172.21.15.137:0/824066463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e54004810 0x7f0e54004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:04.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e72200640 1 --2- 172.21.15.137:0/824066463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e540051d0 0x7f0e5400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:04.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e71800640 1 --2- 172.21.15.137:0/824066463 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e54003b50 0x7f0e54003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:04.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e72200640 1 -- 172.21.15.137:0/824066463 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e54003b50 msgr2=0x7f0e54003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:04.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e72200640 1 --2- 172.21.15.137:0/824066463 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e54003b50 0x7f0e54003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:04.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e72200640 1 -- 172.21.15.137:0/824066463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e54004810 msgr2=0x7f0e54004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:04.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e72200640 1 --2- 172.21.15.137:0/824066463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e54004810 0x7f0e54004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:04.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.889+0000 7f0e72200640 1 -- 172.21.15.137:0/824066463 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e54003530 con 0x7f0e540051d0 2024-04-26T23:45:04.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.893+0000 7f0e72200640 1 -- 172.21.15.137:0/824066463 reap_dead start 2024-04-26T23:45:04.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.893+0000 7f0e72200640 1 --2- 172.21.15.137:0/824066463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e540051d0 0x7f0e5400b9d0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f0e64001fd0 tx=0x7f0e6401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09c9ed832923b61 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:04.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.893+0000 7f0e6be00640 1 -- 172.21.15.137:0/824066463 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e64001c20 con 0x7f0e540051d0 2024-04-26T23:45:04.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.893+0000 7f0e6be00640 1 -- 172.21.15.137:0/824066463 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e64003ba0 con 0x7f0e540051d0 2024-04-26T23:45:04.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.893+0000 7f0e6be00640 1 -- 172.21.15.137:0/824066463 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e640050d0 con 0x7f0e540051d0 2024-04-26T23:45:04.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.893+0000 7f0e74200640 1 -- 172.21.15.137:0/824066463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e540051d0 msgr2=0x7f0e5400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:04.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.893+0000 7f0e74200640 1 --2- 172.21.15.137:0/824066463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e540051d0 0x7f0e5400b9d0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f0e64001fd0 tx=0x7f0e6401c900 comp rx=0 tx=0).stop 2024-04-26T23:45:04.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.893+0000 7f0e74200640 1 -- 172.21.15.137:0/824066463 shutdown_connections 2024-04-26T23:45:04.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.893+0000 7f0e74200640 1 --2- 172.21.15.137:0/824066463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e540051d0 0x7f0e5400b9d0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:04.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.893+0000 7f0e74200640 1 -- 172.21.15.137:0/824066463 >> 172.21.15.137:0/824066463 conn(0x7f0e6c0d2eb0 msgr2=0x7f0e6c0d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:04.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.893+0000 7f0e74200640 1 -- 172.21.15.137:0/824066463 shutdown_connections 2024-04-26T23:45:04.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.893+0000 7f0e74200640 1 -- 172.21.15.137:0/824066463 wait complete. 2024-04-26T23:45:04.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e74200640 1 Processor -- start 2024-04-26T23:45:04.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e74200640 1 -- start start 2024-04-26T23:45:04.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e74200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e540051d0 0x7f0e6c0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:04.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e74200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e6c0cafd0 0x7f0e6c0cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:04.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e74200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e6c0b1ee0 0x7f0e6c0b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:04.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e74200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c0d06e0 con 0x7f0e6c0cafd0 2024-04-26T23:45:04.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e74200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c0d1d20 con 0x7f0e6c0b1ee0 2024-04-26T23:45:04.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e74200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0e6c0d2520 con 0x7f0e540051d0 2024-04-26T23:45:04.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e70e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e6c0cafd0 0x7f0e6c0cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:04.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e70e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e6c0cafd0 0x7f0e6c0cb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35434/0 (socket says 172.21.15.137:35434) 2024-04-26T23:45:04.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e70e00640 1 -- 172.21.15.137:0/3713392663 learned_addr learned my addr 172.21.15.137:0/3713392663 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:04.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e71800640 1 --2- 172.21.15.137:0/3713392663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e540051d0 0x7f0e6c0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:04.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e72200640 1 --2- 172.21.15.137:0/3713392663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e6c0b1ee0 0x7f0e6c0b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:04.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e70e00640 1 -- 172.21.15.137:0/3713392663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e540051d0 msgr2=0x7f0e6c0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:04.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e70e00640 1 --2- 172.21.15.137:0/3713392663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e540051d0 0x7f0e6c0b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:04.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e70e00640 1 -- 172.21.15.137:0/3713392663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e6c0b1ee0 msgr2=0x7f0e6c0b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:04.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e70e00640 1 --2- 172.21.15.137:0/3713392663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e6c0b1ee0 0x7f0e6c0b2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:04.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e70e00640 1 -- 172.21.15.137:0/3713392663 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e6c0cba70 con 0x7f0e6c0cafd0 2024-04-26T23:45:04.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e71800640 1 --2- 172.21.15.137:0/3713392663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e540051d0 0x7f0e6c0b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:04.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e70e00640 1 --2- 172.21.15.137:0/3713392663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e6c0cafd0 0x7f0e6c0cb450 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f0e58011930 tx=0x7f0e58011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:04.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e69600640 1 -- 172.21.15.137:0/3713392663 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5800f9d0 con 0x7f0e6c0cafd0 2024-04-26T23:45:04.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e69600640 1 -- 172.21.15.137:0/3713392663 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e5800fb70 con 0x7f0e6c0cafd0 2024-04-26T23:45:04.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e69600640 1 -- 172.21.15.137:0/3713392663 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e58014440 con 0x7f0e6c0cafd0 2024-04-26T23:45:04.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e74200640 1 -- 172.21.15.137:0/3713392663 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e6c0cbd50 con 0x7f0e6c0cafd0 2024-04-26T23:45:04.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.897+0000 7f0e74200640 1 -- 172.21.15.137:0/3713392663 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e6c0cc310 con 0x7f0e6c0cafd0 2024-04-26T23:45:04.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.901+0000 7f0e74200640 1 -- 172.21.15.137:0/3713392663 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e6c06a2a0 con 0x7f0e6c0cafd0 2024-04-26T23:45:04.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.901+0000 7f0e69600640 1 -- 172.21.15.137:0/3713392663 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0e58012040 con 0x7f0e6c0cafd0 2024-04-26T23:45:04.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.901+0000 7f0e69600640 1 --2- 172.21.15.137:0/3713392663 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0e4c0683b0 0x7f0e4c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:04.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.901+0000 7f0e69600640 1 -- 172.21.15.137:0/3713392663 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7f0e58086ba0 con 0x7f0e6c0cafd0 2024-04-26T23:45:04.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.901+0000 7f0e71800640 1 --2- 172.21.15.137:0/3713392663 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0e4c0683b0 0x7f0e4c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:04.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.901+0000 7f0e71800640 1 --2- 172.21.15.137:0/3713392663 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0e4c0683b0 0x7f0e4c06a870 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c0a0a30 tx=0x7f0e60009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:04.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:04.905+0000 7f0e69600640 1 -- 172.21.15.137:0/3713392663 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0e58019030 con 0x7f0e6c0cafd0 2024-04-26T23:45:05.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.065+0000 7f0e74200640 1 -- 172.21.15.137:0/3713392663 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f0e6c0b8e30 con 0x7f0e6c0cafd0 2024-04-26T23:45:05.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.065+0000 7f0e69600640 1 -- 172.21.15.137:0/3713392663 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f0e58057510 con 0x7f0e6c0cafd0 2024-04-26T23:45:05.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.069+0000 7f0e74200640 1 -- 172.21.15.137:0/3713392663 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0e4c0683b0 msgr2=0x7f0e4c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:05.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.069+0000 7f0e74200640 1 --2- 172.21.15.137:0/3713392663 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0e4c0683b0 0x7f0e4c06a870 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c0a0a30 tx=0x7f0e60009040 comp rx=0 tx=0).stop 2024-04-26T23:45:05.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.069+0000 7f0e74200640 1 -- 172.21.15.137:0/3713392663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e6c0cafd0 msgr2=0x7f0e6c0cb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:05.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.069+0000 7f0e74200640 1 --2- 172.21.15.137:0/3713392663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e6c0cafd0 0x7f0e6c0cb450 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f0e58011930 tx=0x7f0e58011d30 comp rx=0 tx=0).stop 2024-04-26T23:45:05.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.069+0000 7f0e74200640 1 -- 172.21.15.137:0/3713392663 shutdown_connections 2024-04-26T23:45:05.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.069+0000 7f0e74200640 1 --2- 172.21.15.137:0/3713392663 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0e4c0683b0 0x7f0e4c06a870 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:05.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.069+0000 7f0e74200640 1 --2- 172.21.15.137:0/3713392663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e6c0cafd0 0x7f0e6c0cb450 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:05.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.069+0000 7f0e74200640 1 --2- 172.21.15.137:0/3713392663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e6c0b1ee0 0x7f0e6c0b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:05.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.069+0000 7f0e74200640 1 --2- 172.21.15.137:0/3713392663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e540051d0 0x7f0e6c0b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:05.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.069+0000 7f0e74200640 1 -- 172.21.15.137:0/3713392663 >> 172.21.15.137:0/3713392663 conn(0x7f0e6c0d2eb0 msgr2=0x7f0e6c0cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:05.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.069+0000 7f0e74200640 1 -- 172.21.15.137:0/3713392663 shutdown_connections 2024-04-26T23:45:05.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.069+0000 7f0e74200640 1 -- 172.21.15.137:0/3713392663 wait complete. 2024-04-26T23:45:05.093 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject' 2024-04-26T23:45:05.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.225+0000 7fc34b200640 1 Processor -- start 2024-04-26T23:45:05.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.225+0000 7fc34b200640 1 -- start start 2024-04-26T23:45:05.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.225+0000 7fc34b200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc34415f4f0 0x7fc3440d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:05.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.225+0000 7fc34b200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc3440cfe30 0x7fc3440b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:05.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.225+0000 7fc34b200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3440cd740 con 0x7fc3440d21c0 2024-04-26T23:45:05.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.225+0000 7fc34b200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc34415f8d0 con 0x7fc34415f4f0 2024-04-26T23:45:05.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.225+0000 7fc34b200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc3440cd4f0 con 0x7fc3440cfe30 2024-04-26T23:45:05.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.225+0000 7fc343e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc34415f4f0 0x7fc3440d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:05.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.225+0000 7fc343e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc34415f4f0 0x7fc3440d1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35436/0 (socket says 172.21.15.137:35436) 2024-04-26T23:45:05.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.225+0000 7fc343e00640 1 -- 172.21.15.137:0/2920941143 learned_addr learned my addr 172.21.15.137:0/2920941143 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:05.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.225+0000 7fc349200640 1 --2- 172.21.15.137:0/2920941143 >> v2:172.21.15.170:3300/0 conn(0x7fc3440cfe30 0x7fc3440b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:05.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.225+0000 7fc343e00640 1 -- 172.21.15.137:0/2920941143 >> v2:172.21.15.170:3300/0 conn(0x7fc3440cfe30 msgr2=0x7fc3440b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:05.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.225+0000 7fc343e00640 1 --2- 172.21.15.137:0/2920941143 >> v2:172.21.15.170:3300/0 conn(0x7fc3440cfe30 0x7fc3440b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:05.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.225+0000 7fc343e00640 1 -- 172.21.15.137:0/2920941143 >> v1:172.21.15.170:6789/0 conn(0x7fc3440d21c0 legacy=0x7fc3440cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:05.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.225+0000 7fc343e00640 1 -- 172.21.15.137:0/2920941143 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3440cda20 con 0x7fc34415f4f0 2024-04-26T23:45:05.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.225+0000 7fc349200640 1 --2- 172.21.15.137:0/2920941143 >> v2:172.21.15.170:3300/0 conn(0x7fc3440cfe30 0x7fc3440b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:05.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.229+0000 7fc343e00640 1 --2- 172.21.15.137:0/2920941143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc34415f4f0 0x7fc3440d1c80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc344073e30 tx=0x7fc33401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0bf1698dfe7b0b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:05.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.229+0000 7fc342a00640 1 -- 172.21.15.137:0/2920941143 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3340a56f0 con 0x7fc34415f4f0 2024-04-26T23:45:05.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.229+0000 7fc342a00640 1 -- 172.21.15.137:0/2920941143 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3340a5890 con 0x7fc34415f4f0 2024-04-26T23:45:05.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.229+0000 7fc342a00640 1 -- 172.21.15.137:0/2920941143 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3340a5c60 con 0x7fc34415f4f0 2024-04-26T23:45:05.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.229+0000 7fc34b200640 1 -- 172.21.15.137:0/2920941143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc34415f4f0 msgr2=0x7fc3440d1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:05.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.229+0000 7fc34b200640 1 --2- 172.21.15.137:0/2920941143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc34415f4f0 0x7fc3440d1c80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc344073e30 tx=0x7fc33401c920 comp rx=0 tx=0).stop 2024-04-26T23:45:05.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.229+0000 7fc34b200640 1 -- 172.21.15.137:0/2920941143 shutdown_connections 2024-04-26T23:45:05.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.229+0000 7fc34b200640 1 --2- 172.21.15.137:0/2920941143 >> v2:172.21.15.170:3300/0 conn(0x7fc3440cfe30 0x7fc3440b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:05.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.229+0000 7fc34b200640 1 --2- 172.21.15.137:0/2920941143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc34415f4f0 0x7fc3440d1c80 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:05.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.229+0000 7fc34b200640 1 -- 172.21.15.137:0/2920941143 >> 172.21.15.137:0/2920941143 conn(0x7fc3440d2ea0 msgr2=0x7fc3440d32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:05.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.229+0000 7fc34b200640 1 -- 172.21.15.137:0/2920941143 shutdown_connections 2024-04-26T23:45:05.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.229+0000 7fc34b200640 1 -- 172.21.15.137:0/2920941143 wait complete. 2024-04-26T23:45:05.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc34b200640 1 Processor -- start 2024-04-26T23:45:05.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc34b200640 1 -- start start 2024-04-26T23:45:05.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc34b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3440cfe30 0x7fc344148410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:05.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc34b200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc3440d21c0 0x7fc34415e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:05.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc34b200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc34415f4f0 0x7fc3440c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:05.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc34b200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc34406dbe0 con 0x7fc3440cfe30 2024-04-26T23:45:05.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc34b200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc34406da60 con 0x7fc34415f4f0 2024-04-26T23:45:05.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc34b200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc34406dd60 con 0x7fc3440d21c0 2024-04-26T23:45:05.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc343e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3440cfe30 0x7fc344148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:05.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc343e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3440cfe30 0x7fc344148410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35438/0 (socket says 172.21.15.137:35438) 2024-04-26T23:45:05.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc343e00640 1 -- 172.21.15.137:0/3023969148 learned_addr learned my addr 172.21.15.137:0/3023969148 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:05.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc349200640 1 --2- 172.21.15.137:0/3023969148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc34415f4f0 0x7fc3440c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:05.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc343400640 1 --2- 172.21.15.137:0/3023969148 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc3440d21c0 0x7fc34415e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:05.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc343e00640 1 -- 172.21.15.137:0/3023969148 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc3440d21c0 msgr2=0x7fc34415e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:05.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc343e00640 1 --2- 172.21.15.137:0/3023969148 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc3440d21c0 0x7fc34415e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:05.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc343e00640 1 -- 172.21.15.137:0/3023969148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc34415f4f0 msgr2=0x7fc3440c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:05.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc343e00640 1 --2- 172.21.15.137:0/3023969148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc34415f4f0 0x7fc3440c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:05.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc343e00640 1 -- 172.21.15.137:0/3023969148 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3440cc8e0 con 0x7fc3440cfe30 2024-04-26T23:45:05.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc343e00640 1 --2- 172.21.15.137:0/3023969148 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3440cfe30 0x7fc344148410 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc33401a550 tx=0x7fc3340196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:05.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc33be00640 1 -- 172.21.15.137:0/3023969148 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3340bc020 con 0x7fc3440cfe30 2024-04-26T23:45:05.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc33be00640 1 -- 172.21.15.137:0/3023969148 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3340b8670 con 0x7fc3440cfe30 2024-04-26T23:45:05.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc34b200640 1 -- 172.21.15.137:0/3023969148 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3440ccbc0 con 0x7fc3440cfe30 2024-04-26T23:45:05.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc33be00640 1 -- 172.21.15.137:0/3023969148 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3340b8a60 con 0x7fc3440cfe30 2024-04-26T23:45:05.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc34b200640 1 -- 172.21.15.137:0/3023969148 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3440cd180 con 0x7fc3440cfe30 2024-04-26T23:45:05.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.233+0000 7fc34b200640 1 -- 172.21.15.137:0/3023969148 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc34406a2a0 con 0x7fc3440cfe30 2024-04-26T23:45:05.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.237+0000 7fc33be00640 1 -- 172.21.15.137:0/3023969148 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc3340bf020 con 0x7fc3440cfe30 2024-04-26T23:45:05.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.237+0000 7fc33be00640 1 --2- 172.21.15.137:0/3023969148 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc324068380 0x7fc32406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:05.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.237+0000 7fc33be00640 1 -- 172.21.15.137:0/3023969148 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7fc3341218b0 con 0x7fc3440cfe30 2024-04-26T23:45:05.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.237+0000 7fc343400640 1 --2- 172.21.15.137:0/3023969148 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc324068380 0x7fc32406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:05.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.237+0000 7fc343400640 1 --2- 172.21.15.137:0/3023969148 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc324068380 0x7fc32406a840 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc34415b740 tx=0x7fc330009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:05.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.241+0000 7fc33be00640 1 -- 172.21.15.137:0/3023969148 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc3340c6030 con 0x7fc3440cfe30 2024-04-26T23:45:05.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.461+0000 7fc34b200640 1 -- 172.21.15.137:0/3023969148 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]} v 0) -- 0x7fc344075fb0 con 0x7fc3440cfe30 2024-04-26T23:45:05.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.613+0000 7fc33be00640 1 -- 172.21.15.137:0/3023969148 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]}]=0 v220) ==== 142+0+0 (secure 0 0 0) 0x7fc3340165a0 con 0x7fc3440cfe30 2024-04-26T23:45:05.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.617+0000 7fc34b200640 1 -- 172.21.15.137:0/3023969148 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc324068380 msgr2=0x7fc32406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:05.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.617+0000 7fc34b200640 1 --2- 172.21.15.137:0/3023969148 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc324068380 0x7fc32406a840 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc34415b740 tx=0x7fc330009040 comp rx=0 tx=0).stop 2024-04-26T23:45:05.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.617+0000 7fc34b200640 1 -- 172.21.15.137:0/3023969148 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3440cfe30 msgr2=0x7fc344148410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:05.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.617+0000 7fc34b200640 1 --2- 172.21.15.137:0/3023969148 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3440cfe30 0x7fc344148410 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc33401a550 tx=0x7fc3340196c0 comp rx=0 tx=0).stop 2024-04-26T23:45:05.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.617+0000 7fc34b200640 1 -- 172.21.15.137:0/3023969148 shutdown_connections 2024-04-26T23:45:05.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.617+0000 7fc34b200640 1 --2- 172.21.15.137:0/3023969148 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc324068380 0x7fc32406a840 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:05.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.617+0000 7fc34b200640 1 --2- 172.21.15.137:0/3023969148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc34415f4f0 0x7fc3440c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:05.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.617+0000 7fc34b200640 1 --2- 172.21.15.137:0/3023969148 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc3440d21c0 0x7fc34415e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:05.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.617+0000 7fc34b200640 1 --2- 172.21.15.137:0/3023969148 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3440cfe30 0x7fc344148410 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:05.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.617+0000 7fc34b200640 1 -- 172.21.15.137:0/3023969148 >> 172.21.15.137:0/3023969148 conn(0x7fc3440d2ea0 msgr2=0x7fc3440cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:05.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.617+0000 7fc34b200640 1 -- 172.21.15.137:0/3023969148 shutdown_connections 2024-04-26T23:45:05.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:05.617+0000 7fc34b200640 1 -- 172.21.15.137:0/3023969148 wait complete. 2024-04-26T23:45:05.643 INFO:tasks.cephfs_test_runner:test_session_reject (tasks.cephfs.test_sessionmap.TestSessionMap) ... ERROR 2024-04-26T23:45:05.643 INFO:tasks.cephfs_test_runner: 2024-04-26T23:45:05.643 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-26T23:45:05.643 INFO:tasks.cephfs_test_runner:ERROR: test_session_reject (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-04-26T23:45:05.643 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-26T23:45:05.644 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-26T23:45:05.644 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/test_sessionmap.py", line 185, in test_session_reject 2024-04-26T23:45:05.644 INFO:tasks.cephfs_test_runner: self.mount_b.mount_wait(cephfs_mntpt="/foo/bar") 2024-04-26T23:45:05.644 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/mount.py", line 505, in mount_wait 2024-04-26T23:45:05.644 INFO:tasks.cephfs_test_runner: self.mount(**kwargs) 2024-04-26T23:45:05.644 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/fuse_mount.py", line 52, in mount 2024-04-26T23:45:05.644 INFO:tasks.cephfs_test_runner: return self._mount(mntopts, mntargs, check_status) 2024-04-26T23:45:05.645 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/fuse_mount.py", line 68, in _mount 2024-04-26T23:45:05.645 INFO:tasks.cephfs_test_runner: retval = self._run_mount_cmd(mntopts, mntargs, check_status) 2024-04-26T23:45:05.645 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/fuse_mount.py", line 94, in _run_mount_cmd 2024-04-26T23:45:05.645 INFO:tasks.cephfs_test_runner: return self._wait_and_record_our_fuse_conn( 2024-04-26T23:45:05.645 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/fuse_mount.py", line 178, in _wait_and_record_our_fuse_conn 2024-04-26T23:45:05.645 INFO:tasks.cephfs_test_runner: self.fuse_daemon.wait() 2024-04-26T23:45:05.645 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait 2024-04-26T23:45:05.645 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-26T23:45:05.645 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-26T23:45:05.645 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-26T23:45:05.646 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi170 with status 1: "(cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id badguy --client_mountpoint=/foo/bar)" 2024-04-26T23:45:05.646 INFO:tasks.cephfs_test_runner: 2024-04-26T23:45:05.646 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-26T23:45:05.646 INFO:tasks.cephfs_test_runner:Ran 3 tests in 192.167s 2024-04-26T23:45:05.646 INFO:tasks.cephfs_test_runner: 2024-04-26T23:45:05.646 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-04-26T23:45:05.646 INFO:tasks.cephfs_test_runner: 2024-04-26T23:45:05.646 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-26T23:45:05.647 INFO:tasks.cephfs_test_runner:ERROR: test_session_reject (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-04-26T23:45:05.647 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-26T23:45:05.647 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-26T23:45:05.647 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/test_sessionmap.py", line 185, in test_session_reject 2024-04-26T23:45:05.647 INFO:tasks.cephfs_test_runner: self.mount_b.mount_wait(cephfs_mntpt="/foo/bar") 2024-04-26T23:45:05.647 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/mount.py", line 505, in mount_wait 2024-04-26T23:45:05.648 INFO:tasks.cephfs_test_runner: self.mount(**kwargs) 2024-04-26T23:45:05.648 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/fuse_mount.py", line 52, in mount 2024-04-26T23:45:05.648 INFO:tasks.cephfs_test_runner: return self._mount(mntopts, mntargs, check_status) 2024-04-26T23:45:05.648 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/fuse_mount.py", line 68, in _mount 2024-04-26T23:45:05.648 INFO:tasks.cephfs_test_runner: retval = self._run_mount_cmd(mntopts, mntargs, check_status) 2024-04-26T23:45:05.648 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/fuse_mount.py", line 94, in _run_mount_cmd 2024-04-26T23:45:05.648 INFO:tasks.cephfs_test_runner: return self._wait_and_record_our_fuse_conn( 2024-04-26T23:45:05.649 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/fuse_mount.py", line 178, in _wait_and_record_our_fuse_conn 2024-04-26T23:45:05.649 INFO:tasks.cephfs_test_runner: self.fuse_daemon.wait() 2024-04-26T23:45:05.649 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait 2024-04-26T23:45:05.649 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-26T23:45:05.649 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-26T23:45:05.649 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-26T23:45:05.650 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi170 with status 1: "(cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id badguy --client_mountpoint=/foo/bar)" 2024-04-26T23:45:05.650 INFO:tasks.cephfs_test_runner: 2024-04-26T23:45:05.650 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_session_reject (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-04-26T23:45:05.892 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=cf63aadfbf694e018d910ae1bb2f244a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_session_reject (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-04-26T23:45:05.894 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-26T23:45:05.903 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-26T23:45:06.011 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-26T23:45:06.012 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:45:06.012 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:45:06.029 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4511 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:45:06.029 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T23:45:06.029 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:45:06.079 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4511 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:45:06.080 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:45:06.080 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:45:06.089 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4843 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:45:06.090 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T23:45:06.090 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:45:06.146 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350320k,nr_inodes=4087580,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4843 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:45:06.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:06.147 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T23:45:06.156 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T23:45:06.156 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T23:45:06.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:06.157 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:45:06.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:06.223 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:45:06.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:06.289 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-04-26T23:45:06.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:06.418 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-04-26T23:45:06.427 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T23:45:06.428 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-26T23:45:06.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:06.429 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:45:06.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:06.496 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:45:06.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:06.568 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link delete ceph-brx 2024-04-26T23:45:06.707 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T23:45:06.716 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T23:45:06.717 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:45:06.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.849+0000 7f0e18e00640 1 Processor -- start 2024-04-26T23:45:06.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.849+0000 7f0e18e00640 1 -- start start 2024-04-26T23:45:06.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.849+0000 7f0e18e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0e1415aae0 0x7f0e1406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:06.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.849+0000 7f0e18e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0e140b2d60 0x7f0e140b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:06.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.849+0000 7f0e18e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e1415e590 con 0x7f0e1415d630 2024-04-26T23:45:06.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.849+0000 7f0e18e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0e140b3730 con 0x7f0e140b2d60 2024-04-26T23:45:06.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.849+0000 7f0e18e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0e140b4180 con 0x7f0e1415aae0 2024-04-26T23:45:06.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.849+0000 7f0e09400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0e140b2d60 0x7f0e140b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:06.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.849+0000 7f0e09400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0e140b2d60 0x7f0e140b31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35440/0 (socket says 172.21.15.137:35440) 2024-04-26T23:45:06.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.849+0000 7f0e09400640 1 -- 172.21.15.137:0/751429178 learned_addr learned my addr 172.21.15.137:0/751429178 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:06.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.849+0000 7f0e11e00640 1 --2- 172.21.15.137:0/751429178 >> v2:172.21.15.170:3300/0 conn(0x7f0e1415aae0 0x7f0e1406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:06.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.849+0000 7f0e09400640 1 -- 172.21.15.137:0/751429178 >> v2:172.21.15.170:3300/0 conn(0x7f0e1415aae0 msgr2=0x7f0e1406ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:06.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.849+0000 7f0e09400640 1 --2- 172.21.15.137:0/751429178 >> v2:172.21.15.170:3300/0 conn(0x7f0e1415aae0 0x7f0e1406ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:06.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.849+0000 7f0e09400640 1 -- 172.21.15.137:0/751429178 >> v1:172.21.15.137:6789/0 conn(0x7f0e1415d630 legacy=0x7f0e1415da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:06.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.849+0000 7f0e09400640 1 -- 172.21.15.137:0/751429178 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1415e2b0 con 0x7f0e140b2d60 2024-04-26T23:45:06.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.849+0000 7f0e11400640 1 -- 172.21.15.137:0/751429178 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2107941907 0 0) 0x7f0e1415e590 con 0x7f0e1415d630 2024-04-26T23:45:06.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.849+0000 7f0e11e00640 1 --2- 172.21.15.137:0/751429178 >> v2:172.21.15.170:3300/0 conn(0x7f0e1415aae0 0x7f0e1406ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:06.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.853+0000 7f0e09400640 1 --2- 172.21.15.137:0/751429178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e140b2d60 0x7f0e140b31f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f0e140744f0 tx=0x7f0dfc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e524678bdd858ac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:06.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.853+0000 7f0e11400640 1 -- 172.21.15.137:0/751429178 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc0ab660 con 0x7f0e140b2d60 2024-04-26T23:45:06.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.853+0000 7f0e11400640 1 -- 172.21.15.137:0/751429178 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dfc0b0070 con 0x7f0e140b2d60 2024-04-26T23:45:06.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.853+0000 7f0e11400640 1 -- 172.21.15.137:0/751429178 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc0aba20 con 0x7f0e140b2d60 2024-04-26T23:45:06.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.853+0000 7f0e18e00640 1 -- 172.21.15.137:0/751429178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e140b2d60 msgr2=0x7f0e140b31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:06.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.853+0000 7f0e18e00640 1 --2- 172.21.15.137:0/751429178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e140b2d60 0x7f0e140b31f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f0e140744f0 tx=0x7f0dfc01c460 comp rx=0 tx=0).stop 2024-04-26T23:45:06.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.853+0000 7f0e18e00640 1 -- 172.21.15.137:0/751429178 shutdown_connections 2024-04-26T23:45:06.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.853+0000 7f0e18e00640 1 --2- 172.21.15.137:0/751429178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e140b2d60 0x7f0e140b31f0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:06.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.853+0000 7f0e18e00640 1 --2- 172.21.15.137:0/751429178 >> v2:172.21.15.170:3300/0 conn(0x7f0e1415aae0 0x7f0e1406ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:06.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.853+0000 7f0e18e00640 1 -- 172.21.15.137:0/751429178 >> 172.21.15.137:0/751429178 conn(0x7f0e1406c560 msgr2=0x7f0e1406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:06.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.853+0000 7f0e18e00640 1 -- 172.21.15.137:0/751429178 shutdown_connections 2024-04-26T23:45:06.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.853+0000 7f0e18e00640 1 -- 172.21.15.137:0/751429178 wait complete. 2024-04-26T23:45:06.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e18e00640 1 Processor -- start 2024-04-26T23:45:06.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e18e00640 1 -- start start 2024-04-26T23:45:06.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e18e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e140b2d60 0x7f0e1415f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:06.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e18e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e1415aae0 0x7f0e14159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:06.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e18e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e1415d630 0x7f0e14159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:06.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e18e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1415b040 con 0x7f0e1415d630 2024-04-26T23:45:06.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e18e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1415aec0 con 0x7f0e1415aae0 2024-04-26T23:45:06.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e18e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0e140b4c10 con 0x7f0e140b2d60 2024-04-26T23:45:06.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e12800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e1415d630 0x7f0e14159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:06.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e12800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e1415d630 0x7f0e14159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35456/0 (socket says 172.21.15.137:35456) 2024-04-26T23:45:06.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e12800640 1 -- 172.21.15.137:0/701303283 learned_addr learned my addr 172.21.15.137:0/701303283 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:06.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e09400640 1 --2- 172.21.15.137:0/701303283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e1415aae0 0x7f0e14159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:06.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e11e00640 1 --2- 172.21.15.137:0/701303283 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e140b2d60 0x7f0e1415f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:06.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e12800640 1 -- 172.21.15.137:0/701303283 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e140b2d60 msgr2=0x7f0e1415f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:06.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e12800640 1 --2- 172.21.15.137:0/701303283 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e140b2d60 0x7f0e1415f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:06.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e12800640 1 -- 172.21.15.137:0/701303283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e1415aae0 msgr2=0x7f0e14159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:06.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e12800640 1 --2- 172.21.15.137:0/701303283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e1415aae0 0x7f0e14159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:06.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e12800640 1 -- 172.21.15.137:0/701303283 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e14158bb0 con 0x7f0e1415d630 2024-04-26T23:45:06.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e11e00640 1 --2- 172.21.15.137:0/701303283 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e140b2d60 0x7f0e1415f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:06.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e12800640 1 --2- 172.21.15.137:0/701303283 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e1415d630 0x7f0e14159eb0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00c440 tx=0x7f0e0c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:06.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e0aa00640 1 -- 172.21.15.137:0/701303283 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c017070 con 0x7f0e1415d630 2024-04-26T23:45:06.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e0aa00640 1 -- 172.21.15.137:0/701303283 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e0c003600 con 0x7f0e1415d630 2024-04-26T23:45:06.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e18e00640 1 -- 172.21.15.137:0/701303283 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e14158e90 con 0x7f0e1415d630 2024-04-26T23:45:06.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e0aa00640 1 -- 172.21.15.137:0/701303283 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0039f0 con 0x7f0e1415d630 2024-04-26T23:45:06.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e18e00640 1 -- 172.21.15.137:0/701303283 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e14159450 con 0x7f0e1415d630 2024-04-26T23:45:06.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.857+0000 7f0e18e00640 1 -- 172.21.15.137:0/701303283 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e1406a2a0 con 0x7f0e1415d630 2024-04-26T23:45:06.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.861+0000 7f0e0aa00640 1 -- 172.21.15.137:0/701303283 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0e0c01a070 con 0x7f0e1415d630 2024-04-26T23:45:06.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.861+0000 7f0e0aa00640 1 --2- 172.21.15.137:0/701303283 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0df0068380 0x7f0df006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:06.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.861+0000 7f0e0aa00640 1 -- 172.21.15.137:0/701303283 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7f0e0c085a40 con 0x7f0e1415d630 2024-04-26T23:45:06.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.861+0000 7f0e11e00640 1 --2- 172.21.15.137:0/701303283 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0df0068380 0x7f0df006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:06.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.861+0000 7f0e11e00640 1 --2- 172.21.15.137:0/701303283 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0df0068380 0x7f0df006a840 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400e550 tx=0x7f0e04007ab0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:06.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:06.865+0000 7f0e0aa00640 1 -- 172.21.15.137:0/701303283 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0e0c055c10 con 0x7f0e1415d630 2024-04-26T23:45:07.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.017+0000 7f0e18e00640 1 -- 172.21.15.137:0/701303283 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0e1406c940 con 0x7f0df0068380 2024-04-26T23:45:07.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.017+0000 7f0e0aa00640 1 -- 172.21.15.137:0/701303283 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13378 (secure 0 0 0) 0x7f0e1406c940 con 0x7f0df0068380 2024-04-26T23:45:07.022 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:07.023 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T23:45:07.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.021+0000 7f0e18e00640 1 -- 172.21.15.137:0/701303283 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0df0068380 msgr2=0x7f0df006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.021+0000 7f0e18e00640 1 --2- 172.21.15.137:0/701303283 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0df0068380 0x7f0df006a840 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400e550 tx=0x7f0e04007ab0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.021+0000 7f0e18e00640 1 -- 172.21.15.137:0/701303283 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e1415d630 msgr2=0x7f0e14159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.021+0000 7f0e18e00640 1 --2- 172.21.15.137:0/701303283 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e1415d630 0x7f0e14159eb0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00c440 tx=0x7f0e0c00c840 comp rx=0 tx=0).stop 2024-04-26T23:45:07.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.021+0000 7f0e18e00640 1 -- 172.21.15.137:0/701303283 shutdown_connections 2024-04-26T23:45:07.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.021+0000 7f0e18e00640 1 --2- 172.21.15.137:0/701303283 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0df0068380 0x7f0df006a840 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.021+0000 7f0e18e00640 1 --2- 172.21.15.137:0/701303283 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e1415d630 0x7f0e14159eb0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.021+0000 7f0e18e00640 1 --2- 172.21.15.137:0/701303283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e1415aae0 0x7f0e14159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.021+0000 7f0e18e00640 1 --2- 172.21.15.137:0/701303283 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e140b2d60 0x7f0e1415f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.021+0000 7f0e18e00640 1 -- 172.21.15.137:0/701303283 >> 172.21.15.137:0/701303283 conn(0x7f0e1406c560 msgr2=0x7f0e140b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:07.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.021+0000 7f0e18e00640 1 -- 172.21.15.137:0/701303283 shutdown_connections 2024-04-26T23:45:07.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.021+0000 7f0e18e00640 1 -- 172.21.15.137:0/701303283 wait complete. 2024-04-26T23:45:07.044 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-04-26T23:45:05.635329+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243844,"kb_used_data":6872,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730876,"statfs":{"total":773094113280,"available":772844417024,"internally_reserved":0,"allocated":7036928,"data_stored":3624124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9810,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-59,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000959"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":248,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872281+0000","last_change":"2024-04-26T23:41:12.783987+0000","last_active":"2024-04-26T23:44:22.872281+0000","last_peered":"2024-04-26T23:44:22.872281+0000","last_clean":"2024-04-26T23:44:22.872281+0000","last_became_active":"2024-04-26T23:41:12.782901+0000","last_became_peered":"2024-04-26T23:41:12.782901+0000","last_unstale":"2024-04-26T23:44:22.872281+0000","last_undegraded":"2024-04-26T23:44:22.872281+0000","last_fullsized":"2024-04-26T23:44:22.872281+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_clean_scrub_stamp":"2024-04-26T23:41:11.626255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:16.305521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1323008,"data_stored":893499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":720896,"data_stored":302971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":729088,"data_stored":303623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":741376,"data_stored":311983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":729088,"data_stored":303027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":729088,"data_stored":303027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":724992,"data_stored":303061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1339392,"data_stored":902933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:45:07.044 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:45:07.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.177+0000 7f6adc000640 1 Processor -- start 2024-04-26T23:45:07.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.177+0000 7f6adc000640 1 -- start start 2024-04-26T23:45:07.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.177+0000 7f6adc000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ad415cdc0 0x7f6ad4071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.177+0000 7f6adc000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6ad40d17b0 0x7f6ad406c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.177+0000 7f6adc000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ad40d0750 con 0x7f6ad415d1a0 2024-04-26T23:45:07.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.177+0000 7f6adc000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6ad40d1320 con 0x7f6ad40d17b0 2024-04-26T23:45:07.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.177+0000 7f6adc000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad40d09f0 con 0x7f6ad415cdc0 2024-04-26T23:45:07.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.177+0000 7f6ada000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6ad40d17b0 0x7f6ad406c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.177+0000 7f6ada000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6ad40d17b0 0x7f6ad406c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35466/0 (socket says 172.21.15.137:35466) 2024-04-26T23:45:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.177+0000 7f6ada000640 1 -- 172.21.15.137:0/877285233 learned_addr learned my addr 172.21.15.137:0/877285233 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.177+0000 7f6ad9600640 1 --2- 172.21.15.137:0/877285233 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ad415cdc0 0x7f6ad4071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.177+0000 7f6ada000640 1 -- 172.21.15.137:0/877285233 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ad415cdc0 msgr2=0x7f6ad4071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.177+0000 7f6ada000640 1 --2- 172.21.15.137:0/877285233 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ad415cdc0 0x7f6ad4071680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.177+0000 7f6ada000640 1 -- 172.21.15.137:0/877285233 >> v1:172.21.15.170:6789/0 conn(0x7f6ad415d1a0 legacy=0x7f6ad4161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.177+0000 7f6ada000640 1 -- 172.21.15.137:0/877285233 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad40d0cd0 con 0x7f6ad40d17b0 2024-04-26T23:45:07.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.181+0000 7f6ada000640 1 --2- 172.21.15.137:0/877285233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ad40d17b0 0x7f6ad406c390 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009e50 tx=0x7f6acc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4ada19f1422d6a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:07.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.181+0000 7f6ad3e00640 1 -- 172.21.15.137:0/877285233 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc0a5700 con 0x7f6ad40d17b0 2024-04-26T23:45:07.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.181+0000 7f6ad3e00640 1 -- 172.21.15.137:0/877285233 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6acc0a58a0 con 0x7f6ad40d17b0 2024-04-26T23:45:07.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.181+0000 7f6ad3e00640 1 -- 172.21.15.137:0/877285233 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc0a5c70 con 0x7f6ad40d17b0 2024-04-26T23:45:07.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.181+0000 7f6adc000640 1 -- 172.21.15.137:0/877285233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ad40d17b0 msgr2=0x7f6ad406c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.181+0000 7f6adc000640 1 --2- 172.21.15.137:0/877285233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ad40d17b0 0x7f6ad406c390 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009e50 tx=0x7f6acc01ca30 comp rx=0 tx=0).stop 2024-04-26T23:45:07.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.181+0000 7f6adc000640 1 -- 172.21.15.137:0/877285233 shutdown_connections 2024-04-26T23:45:07.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.181+0000 7f6adc000640 1 --2- 172.21.15.137:0/877285233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ad40d17b0 0x7f6ad406c390 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.181+0000 7f6adc000640 1 --2- 172.21.15.137:0/877285233 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ad415cdc0 0x7f6ad4071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.181+0000 7f6adc000640 1 -- 172.21.15.137:0/877285233 >> 172.21.15.137:0/877285233 conn(0x7f6ad40b3c20 msgr2=0x7f6ad40b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:07.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.181+0000 7f6adc000640 1 -- 172.21.15.137:0/877285233 shutdown_connections 2024-04-26T23:45:07.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.181+0000 7f6adc000640 1 -- 172.21.15.137:0/877285233 wait complete. 2024-04-26T23:45:07.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.181+0000 7f6adc000640 1 Processor -- start 2024-04-26T23:45:07.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.181+0000 7f6adc000640 1 -- start start 2024-04-26T23:45:07.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6adc000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ad40d17b0 0x7f6ad40b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6adc000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ad415cdc0 0x7f6ad4139bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6adc000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ad415d1a0 0x7f6ad415b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6adc000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad41412f0 con 0x7f6ad415cdc0 2024-04-26T23:45:07.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6adc000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad4141170 con 0x7f6ad40d17b0 2024-04-26T23:45:07.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6adc000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad4169cc0 con 0x7f6ad415d1a0 2024-04-26T23:45:07.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6ad8c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ad415cdc0 0x7f6ad4139bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6ad9600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ad40d17b0 0x7f6ad40b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6ad8c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ad415cdc0 0x7f6ad4139bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35470/0 (socket says 172.21.15.137:35470) 2024-04-26T23:45:07.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6ad8c00640 1 -- 172.21.15.137:0/1884354237 learned_addr learned my addr 172.21.15.137:0/1884354237 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:07.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6ada000640 1 --2- 172.21.15.137:0/1884354237 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ad415d1a0 0x7f6ad415b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6ad8c00640 1 -- 172.21.15.137:0/1884354237 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ad415d1a0 msgr2=0x7f6ad415b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6ad8c00640 1 --2- 172.21.15.137:0/1884354237 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ad415d1a0 0x7f6ad415b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6ad8c00640 1 -- 172.21.15.137:0/1884354237 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ad40d17b0 msgr2=0x7f6ad40b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6ad8c00640 1 --2- 172.21.15.137:0/1884354237 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ad40d17b0 0x7f6ad40b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6ad8c00640 1 -- 172.21.15.137:0/1884354237 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad413a2c0 con 0x7f6ad415cdc0 2024-04-26T23:45:07.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6ad8c00640 1 --2- 172.21.15.137:0/1884354237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ad415cdc0 0x7f6ad4139bc0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000c340 tx=0x7f6ac000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:07.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6ad1600640 1 -- 172.21.15.137:0/1884354237 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac00052d0 con 0x7f6ad415cdc0 2024-04-26T23:45:07.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6ad1600640 1 -- 172.21.15.137:0/1884354237 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac0005470 con 0x7f6ad415cdc0 2024-04-26T23:45:07.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6ad1600640 1 -- 172.21.15.137:0/1884354237 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0007260 con 0x7f6ad415cdc0 2024-04-26T23:45:07.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6adc000640 1 -- 172.21.15.137:0/1884354237 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad413a5a0 con 0x7f6ad415cdc0 2024-04-26T23:45:07.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6adc000640 1 -- 172.21.15.137:0/1884354237 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad413ab60 con 0x7f6ad415cdc0 2024-04-26T23:45:07.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.185+0000 7f6adc000640 1 -- 172.21.15.137:0/1884354237 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad4145350 con 0x7f6ad415cdc0 2024-04-26T23:45:07.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.189+0000 7f6ad1600640 1 -- 172.21.15.137:0/1884354237 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6ac0007400 con 0x7f6ad415cdc0 2024-04-26T23:45:07.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.189+0000 7f6ad1600640 1 --2- 172.21.15.137:0/1884354237 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6ab4068380 0x7f6ab406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.189+0000 7f6ad1600640 1 -- 172.21.15.137:0/1884354237 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7f6ac0085a30 con 0x7f6ad415cdc0 2024-04-26T23:45:07.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.189+0000 7f6ad9600640 1 --2- 172.21.15.137:0/1884354237 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6ab4068380 0x7f6ab406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.189+0000 7f6ad9600640 1 --2- 172.21.15.137:0/1884354237 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6ab4068380 0x7f6ab406a840 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8009b60 tx=0x7f6ac8009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:07.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.193+0000 7f6ad1600640 1 -- 172.21.15.137:0/1884354237 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6ac0055d10 con 0x7f6ad415cdc0 2024-04-26T23:45:07.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.345+0000 7f6adc000640 1 -- 172.21.15.137:0/1884354237 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ad4141e30 con 0x7f6ab4068380 2024-04-26T23:45:07.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.345+0000 7f6ad1600640 1 -- 172.21.15.137:0/1884354237 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13378 (secure 0 0 0) 0x7f6ad4141e30 con 0x7f6ab4068380 2024-04-26T23:45:07.350 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:07.350 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T23:45:07.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.349+0000 7f6adc000640 1 -- 172.21.15.137:0/1884354237 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6ab4068380 msgr2=0x7f6ab406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.349+0000 7f6adc000640 1 --2- 172.21.15.137:0/1884354237 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6ab4068380 0x7f6ab406a840 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8009b60 tx=0x7f6ac8009190 comp rx=0 tx=0).stop 2024-04-26T23:45:07.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.349+0000 7f6adc000640 1 -- 172.21.15.137:0/1884354237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ad415cdc0 msgr2=0x7f6ad4139bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.349+0000 7f6adc000640 1 --2- 172.21.15.137:0/1884354237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ad415cdc0 0x7f6ad4139bc0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000c340 tx=0x7f6ac000c800 comp rx=0 tx=0).stop 2024-04-26T23:45:07.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.349+0000 7f6adc000640 1 -- 172.21.15.137:0/1884354237 shutdown_connections 2024-04-26T23:45:07.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.349+0000 7f6adc000640 1 --2- 172.21.15.137:0/1884354237 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6ab4068380 0x7f6ab406a840 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.349+0000 7f6adc000640 1 --2- 172.21.15.137:0/1884354237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ad415cdc0 0x7f6ad4139bc0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.349+0000 7f6adc000640 1 --2- 172.21.15.137:0/1884354237 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ad415d1a0 0x7f6ad415b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.349+0000 7f6adc000640 1 --2- 172.21.15.137:0/1884354237 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ad40d17b0 0x7f6ad40b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.349+0000 7f6adc000640 1 -- 172.21.15.137:0/1884354237 >> 172.21.15.137:0/1884354237 conn(0x7f6ad40b3c20 msgr2=0x7f6ad413bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:07.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.349+0000 7f6adc000640 1 -- 172.21.15.137:0/1884354237 shutdown_connections 2024-04-26T23:45:07.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.349+0000 7f6adc000640 1 -- 172.21.15.137:0/1884354237 wait complete. 2024-04-26T23:45:07.372 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-04-26T23:45:05.635329+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243844,"kb_used_data":6872,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730876,"statfs":{"total":773094113280,"available":772844417024,"internally_reserved":0,"allocated":7036928,"data_stored":3624124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9810,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-59,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000959"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":248,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T23:44:22.872281+0000","last_change":"2024-04-26T23:41:12.783987+0000","last_active":"2024-04-26T23:44:22.872281+0000","last_peered":"2024-04-26T23:44:22.872281+0000","last_clean":"2024-04-26T23:44:22.872281+0000","last_became_active":"2024-04-26T23:41:12.782901+0000","last_became_peered":"2024-04-26T23:41:12.782901+0000","last_unstale":"2024-04-26T23:44:22.872281+0000","last_undegraded":"2024-04-26T23:44:22.872281+0000","last_fullsized":"2024-04-26T23:44:22.872281+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_clean_scrub_stamp":"2024-04-26T23:41:11.626255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:16.305521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1323008,"data_stored":893499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":720896,"data_stored":302971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":729088,"data_stored":303623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":741376,"data_stored":311983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":729088,"data_stored":303027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":729088,"data_stored":303027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":724992,"data_stored":303061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1339392,"data_stored":902933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:45:07.372 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T23:45:07.373 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:45:07.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.505+0000 7f514e000640 1 Processor -- start 2024-04-26T23:45:07.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.505+0000 7f514e000640 1 -- start start 2024-04-26T23:45:07.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.505+0000 7f514e000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51480ce860 0x7f51480cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.505+0000 7f514e000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5148073210 0x7f5148073660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.505+0000 7f514e000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5148073fb0 con 0x7f5148145810 2024-04-26T23:45:07.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.505+0000 7f514e000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f51480cf200 con 0x7f5148073210 2024-04-26T23:45:07.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.505+0000 7f514e000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f514806f8f0 con 0x7f51480ce860 2024-04-26T23:45:07.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.505+0000 7f5146a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51480ce860 0x7f51480cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.505+0000 7f5147e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5148073210 0x7f5148073660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.505+0000 7f5147400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f5148145810 0x7f5148070620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:52546/0 (socket says 172.21.15.137:52546) 2024-04-26T23:45:07.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.505+0000 7f5147400640 1 -- 172.21.15.137:0/2873298708 learned_addr learned my addr 172.21.15.137:0/2873298708 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:45:07.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.505+0000 7f5147e00640 1 -- 172.21.15.137:0/2873298708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51480ce860 msgr2=0x7f51480cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:07.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.505+0000 7f5147e00640 1 --2- 172.21.15.137:0/2873298708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51480ce860 0x7f51480cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.505+0000 7f5147e00640 1 -- 172.21.15.137:0/2873298708 >> v1:172.21.15.170:6789/0 conn(0x7f5148145810 legacy=0x7f5148070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.505+0000 7f5147e00640 1 -- 172.21.15.137:0/2873298708 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f514806fb40 con 0x7f5148073210 2024-04-26T23:45:07.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.505+0000 7f5146a00640 1 --2- 172.21.15.137:0/2873298708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51480ce860 0x7f51480cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:07.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.509+0000 7f5147e00640 1 --2- 172.21.15.137:0/2873298708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5148073210 0x7f5148073660 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5140009d90 tx=0x7f514001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99edf060c0cb887a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:07.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.509+0000 7f5146000640 1 -- 172.21.15.137:0/2873298708 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51400b1070 con 0x7f5148073210 2024-04-26T23:45:07.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.509+0000 7f5146000640 1 -- 172.21.15.137:0/2873298708 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51400a49b0 con 0x7f5148073210 2024-04-26T23:45:07.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.509+0000 7f5146000640 1 -- 172.21.15.137:0/2873298708 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51400a4d80 con 0x7f5148073210 2024-04-26T23:45:07.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.509+0000 7f514e000640 1 -- 172.21.15.137:0/2873298708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5148073210 msgr2=0x7f5148073660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.509+0000 7f514e000640 1 --2- 172.21.15.137:0/2873298708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5148073210 0x7f5148073660 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5140009d90 tx=0x7f514001c450 comp rx=0 tx=0).stop 2024-04-26T23:45:07.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.509+0000 7f514e000640 1 -- 172.21.15.137:0/2873298708 shutdown_connections 2024-04-26T23:45:07.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.509+0000 7f514e000640 1 --2- 172.21.15.137:0/2873298708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5148073210 0x7f5148073660 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.509+0000 7f514e000640 1 --2- 172.21.15.137:0/2873298708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51480ce860 0x7f51480cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.509+0000 7f514e000640 1 -- 172.21.15.137:0/2873298708 >> 172.21.15.137:0/2873298708 conn(0x7f51480b3b40 msgr2=0x7f51480b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:07.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.509+0000 7f514e000640 1 -- 172.21.15.137:0/2873298708 shutdown_connections 2024-04-26T23:45:07.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.509+0000 7f514e000640 1 -- 172.21.15.137:0/2873298708 wait complete. 2024-04-26T23:45:07.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f514e000640 1 Processor -- start 2024-04-26T23:45:07.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f514e000640 1 -- start start 2024-04-26T23:45:07.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f514e000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5148073210 0x7f5148159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f514e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51480ce860 0x7f514815d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f514e000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5148145810 0x7f51481660b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f514e000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5148169b80 con 0x7f51480ce860 2024-04-26T23:45:07.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f514e000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5148169a00 con 0x7f5148073210 2024-04-26T23:45:07.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f514e000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5148169d00 con 0x7f5148145810 2024-04-26T23:45:07.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f5146a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51480ce860 0x7f514815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f5146a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51480ce860 0x7f514815d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35480/0 (socket says 172.21.15.137:35480) 2024-04-26T23:45:07.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f5146a00640 1 -- 172.21.15.137:0/1619410404 learned_addr learned my addr 172.21.15.137:0/1619410404 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:07.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f5147e00640 1 --2- 172.21.15.137:0/1619410404 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5148145810 0x7f51481660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f5147400640 1 --2- 172.21.15.137:0/1619410404 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5148073210 0x7f5148159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f5146a00640 1 -- 172.21.15.137:0/1619410404 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5148145810 msgr2=0x7f51481660b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f5146a00640 1 --2- 172.21.15.137:0/1619410404 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5148145810 0x7f51481660b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f5146a00640 1 -- 172.21.15.137:0/1619410404 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5148073210 msgr2=0x7f5148159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f5146a00640 1 --2- 172.21.15.137:0/1619410404 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5148073210 0x7f5148159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f5146a00640 1 -- 172.21.15.137:0/1619410404 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51481597f0 con 0x7f51480ce860 2024-04-26T23:45:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f5147400640 1 --2- 172.21.15.137:0/1619410404 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5148073210 0x7f5148159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f5146a00640 1 --2- 172.21.15.137:0/1619410404 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51480ce860 0x7f514815d600 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f513400e980 tx=0x7f513400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f513f400640 1 -- 172.21.15.137:0/1619410404 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5134017070 con 0x7f51480ce860 2024-04-26T23:45:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f514e000640 1 -- 172.21.15.137:0/1619410404 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5148159a90 con 0x7f51480ce860 2024-04-26T23:45:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f513f400640 1 -- 172.21.15.137:0/1619410404 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f513400ca00 con 0x7f51480ce860 2024-04-26T23:45:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f513f400640 1 -- 172.21.15.137:0/1619410404 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513400cdd0 con 0x7f51480ce860 2024-04-26T23:45:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.513+0000 7f514e000640 1 -- 172.21.15.137:0/1619410404 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f514815a050 con 0x7f51480ce860 2024-04-26T23:45:07.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.517+0000 7f514e000640 1 -- 172.21.15.137:0/1619410404 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f514806a2a0 con 0x7f51480ce860 2024-04-26T23:45:07.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.517+0000 7f513f400640 1 -- 172.21.15.137:0/1619410404 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f513401a070 con 0x7f51480ce860 2024-04-26T23:45:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.517+0000 7f513f400640 1 --2- 172.21.15.137:0/1619410404 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5128068380 0x7f512806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.517+0000 7f513f400640 1 -- 172.21.15.137:0/1619410404 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7f5134086ad0 con 0x7f51480ce860 2024-04-26T23:45:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.517+0000 7f5147400640 1 --2- 172.21.15.137:0/1619410404 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5128068380 0x7f512806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.517+0000 7f5147400640 1 --2- 172.21.15.137:0/1619410404 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5128068380 0x7f512806a840 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5138000f70 tx=0x7f5138007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:07.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.521+0000 7f513f400640 1 -- 172.21.15.137:0/1619410404 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f51340571e0 con 0x7f51480ce860 2024-04-26T23:45:07.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.677+0000 7f514e000640 1 -- 172.21.15.137:0/1619410404 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f514806f6d0 con 0x7f5128068380 2024-04-26T23:45:07.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.677+0000 7f513f400640 1 -- 172.21.15.137:0/1619410404 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13489 (secure 0 0 0) 0x7f514806f6d0 con 0x7f5128068380 2024-04-26T23:45:07.684 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:07.684 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T23:45:07.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.681+0000 7f514e000640 1 -- 172.21.15.137:0/1619410404 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5128068380 msgr2=0x7f512806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.681+0000 7f514e000640 1 --2- 172.21.15.137:0/1619410404 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5128068380 0x7f512806a840 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5138000f70 tx=0x7f5138007d30 comp rx=0 tx=0).stop 2024-04-26T23:45:07.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.681+0000 7f514e000640 1 -- 172.21.15.137:0/1619410404 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51480ce860 msgr2=0x7f514815d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.681+0000 7f514e000640 1 --2- 172.21.15.137:0/1619410404 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51480ce860 0x7f514815d600 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f513400e980 tx=0x7f513400ee40 comp rx=0 tx=0).stop 2024-04-26T23:45:07.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.681+0000 7f514e000640 1 -- 172.21.15.137:0/1619410404 shutdown_connections 2024-04-26T23:45:07.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.681+0000 7f514e000640 1 --2- 172.21.15.137:0/1619410404 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f5128068380 0x7f512806a840 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.681+0000 7f514e000640 1 --2- 172.21.15.137:0/1619410404 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51480ce860 0x7f514815d600 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.681+0000 7f514e000640 1 --2- 172.21.15.137:0/1619410404 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5148145810 0x7f51481660b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.681+0000 7f514e000640 1 --2- 172.21.15.137:0/1619410404 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5148073210 0x7f5148159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.681+0000 7f514e000640 1 -- 172.21.15.137:0/1619410404 >> 172.21.15.137:0/1619410404 conn(0x7f51480b3b40 msgr2=0x7f51481433c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:07.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.681+0000 7f514e000640 1 -- 172.21.15.137:0/1619410404 shutdown_connections 2024-04-26T23:45:07.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.681+0000 7f514e000640 1 -- 172.21.15.137:0/1619410404 wait complete. 2024-04-26T23:45:07.704 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":175,"stamp":"2024-04-26T23:45:07.635665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":248196,"kb_used_data":7064,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754726524,"statfs":{"total":773094113280,"available":772839960576,"internally_reserved":0,"allocated":7233536,"data_stored":3717871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9810,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-59,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.030575"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":254,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:45:04.619736+0000","last_change":"2024-04-26T23:41:12.783987+0000","last_active":"2024-04-26T23:45:04.619736+0000","last_peered":"2024-04-26T23:45:04.619736+0000","last_clean":"2024-04-26T23:45:04.619736+0000","last_became_active":"2024-04-26T23:41:12.782901+0000","last_became_peered":"2024-04-26T23:41:12.782901+0000","last_unstale":"2024-04-26T23:45:04.619736+0000","last_undegraded":"2024-04-26T23:45:04.619736+0000","last_fullsized":"2024-04-26T23:45:04.619736+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_clean_scrub_stamp":"2024-04-26T23:41:11.626255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:16.305521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32512,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339328,"statfs":{"total":96636764160,"available":96603471872,"internally_reserved":0,"allocated":1359872,"data_stored":910988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31912,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":749568,"data_stored":315055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":765952,"data_stored":320620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31912,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":749568,"data_stored":315055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31912,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":749568,"data_stored":315055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":320620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":315055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32492,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339348,"statfs":{"total":96636764160,"available":96603492352,"internally_reserved":0,"allocated":1343488,"data_stored":905423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:45:07.705 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:45:07.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.837+0000 7fc002a00640 1 Processor -- start 2024-04-26T23:45:07.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.837+0000 7fc002a00640 1 -- start start 2024-04-26T23:45:07.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.837+0000 7fc002a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbffc15aae0 0x7fbffc06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.837+0000 7fc002a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbffc0b2d60 0x7fbffc0b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.837+0000 7fc002a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbffc15d630 0x7fbffc15dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.837+0000 7fc002a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fbffc0b3730 con 0x7fbffc15aae0 2024-04-26T23:45:07.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.837+0000 7fc002a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fbffc0b4180 con 0x7fbffc0b2d60 2024-04-26T23:45:07.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.837+0000 7fc002a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbffc15e590 con 0x7fbffc15d630 2024-04-26T23:45:07.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.837+0000 7fbffbe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbffc15aae0 0x7fbffc06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.837+0000 7fbffbe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbffc15aae0 0x7fbffc06ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35496/0 (socket says 172.21.15.137:35496) 2024-04-26T23:45:07.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.837+0000 7fbffbe00640 1 -- 172.21.15.137:0/3854302996 learned_addr learned my addr 172.21.15.137:0/3854302996 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.837+0000 7fc000a00640 1 --2- 172.21.15.137:0/3854302996 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbffc15d630 0x7fbffc15dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.837+0000 7fbffbe00640 1 -- 172.21.15.137:0/3854302996 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbffc15d630 msgr2=0x7fbffc15dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.837+0000 7fbffb400640 1 --2- 172.21.15.137:0/3854302996 >> v2:172.21.15.170:3300/0 conn(0x7fbffc0b2d60 0x7fbffc0b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.837+0000 7fbffbe00640 1 --2- 172.21.15.137:0/3854302996 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbffc15d630 0x7fbffc15dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.837+0000 7fbffbe00640 1 -- 172.21.15.137:0/3854302996 >> v2:172.21.15.170:3300/0 conn(0x7fbffc0b2d60 msgr2=0x7fbffc0b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.837+0000 7fbffbe00640 1 --2- 172.21.15.137:0/3854302996 >> v2:172.21.15.170:3300/0 conn(0x7fbffc0b2d60 0x7fbffc0b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.837+0000 7fbffbe00640 1 -- 172.21.15.137:0/3854302996 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbffc15e000 con 0x7fbffc15aae0 2024-04-26T23:45:07.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.837+0000 7fc000a00640 1 --2- 172.21.15.137:0/3854302996 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbffc15d630 0x7fbffc15dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:07.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.837+0000 7fbffb400640 1 --2- 172.21.15.137:0/3854302996 >> v2:172.21.15.170:3300/0 conn(0x7fbffc0b2d60 0x7fbffc0b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:07.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.841+0000 7fbffbe00640 1 --2- 172.21.15.137:0/3854302996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbffc15aae0 0x7fbffc06ef70 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0743d0 tx=0x7fbfec01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e20912bffdcb1d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.841+0000 7fbffaa00640 1 -- 172.21.15.137:0/3854302996 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0ab620 con 0x7fbffc15aae0 2024-04-26T23:45:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.841+0000 7fbffaa00640 1 -- 172.21.15.137:0/3854302996 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfec0b0070 con 0x7fbffc15aae0 2024-04-26T23:45:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.841+0000 7fbffaa00640 1 -- 172.21.15.137:0/3854302996 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0ab9e0 con 0x7fbffc15aae0 2024-04-26T23:45:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.841+0000 7fc002a00640 1 -- 172.21.15.137:0/3854302996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbffc15aae0 msgr2=0x7fbffc06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.841+0000 7fc002a00640 1 --2- 172.21.15.137:0/3854302996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbffc15aae0 0x7fbffc06ef70 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0743d0 tx=0x7fbfec01c460 comp rx=0 tx=0).stop 2024-04-26T23:45:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.841+0000 7fc002a00640 1 -- 172.21.15.137:0/3854302996 shutdown_connections 2024-04-26T23:45:07.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.841+0000 7fc002a00640 1 --2- 172.21.15.137:0/3854302996 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbffc15d630 0x7fbffc15dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.841+0000 7fc002a00640 1 --2- 172.21.15.137:0/3854302996 >> v2:172.21.15.170:3300/0 conn(0x7fbffc0b2d60 0x7fbffc0b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.841+0000 7fc002a00640 1 --2- 172.21.15.137:0/3854302996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbffc15aae0 0x7fbffc06ef70 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.841+0000 7fc002a00640 1 -- 172.21.15.137:0/3854302996 >> 172.21.15.137:0/3854302996 conn(0x7fbffc06c560 msgr2=0x7fbffc06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:07.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.841+0000 7fc002a00640 1 -- 172.21.15.137:0/3854302996 shutdown_connections 2024-04-26T23:45:07.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.841+0000 7fc002a00640 1 -- 172.21.15.137:0/3854302996 wait complete. 2024-04-26T23:45:07.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fc002a00640 1 Processor -- start 2024-04-26T23:45:07.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fc002a00640 1 -- start start 2024-04-26T23:45:07.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fc002a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbffc0b2d60 0x7fbffc156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fc002a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbffc15aae0 0x7fbffc0b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fc002a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbffc15d630 0x7fbffc0b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fc002a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbffc15aec0 con 0x7fbffc15aae0 2024-04-26T23:45:07.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fc002a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbffc06ea50 con 0x7fbffc0b2d60 2024-04-26T23:45:07.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fc002a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbffc15b040 con 0x7fbffc15d630 2024-04-26T23:45:07.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fbffb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbffc15aae0 0x7fbffc0b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fbffb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbffc15aae0 0x7fbffc0b4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35498/0 (socket says 172.21.15.137:35498) 2024-04-26T23:45:07.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fbffb400640 1 -- 172.21.15.137:0/3952711250 learned_addr learned my addr 172.21.15.137:0/3952711250 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:07.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fbffbe00640 1 --2- 172.21.15.137:0/3952711250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbffc0b2d60 0x7fbffc156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fc000a00640 1 --2- 172.21.15.137:0/3952711250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbffc15d630 0x7fbffc0b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fbffb400640 1 -- 172.21.15.137:0/3952711250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbffc15d630 msgr2=0x7fbffc0b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fbffb400640 1 --2- 172.21.15.137:0/3952711250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbffc15d630 0x7fbffc0b5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fbffb400640 1 -- 172.21.15.137:0/3952711250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbffc0b2d60 msgr2=0x7fbffc156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fbffb400640 1 --2- 172.21.15.137:0/3952711250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbffc0b2d60 0x7fbffc156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fbffb400640 1 -- 172.21.15.137:0/3952711250 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbffc1606d0 con 0x7fbffc15aae0 2024-04-26T23:45:07.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fbffbe00640 1 --2- 172.21.15.137:0/3952711250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbffc0b2d60 0x7fbffc156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:07.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fbffb400640 1 --2- 172.21.15.137:0/3952711250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbffc15aae0 0x7fbffc0b4c10 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fbfe800c7c0 tx=0x7fbfe800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:07.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fbff3e00640 1 -- 172.21.15.137:0/3952711250 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8015070 con 0x7fbffc15aae0 2024-04-26T23:45:07.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fbff3e00640 1 -- 172.21.15.137:0/3952711250 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfe8007a30 con 0x7fbffc15aae0 2024-04-26T23:45:07.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fbff3e00640 1 -- 172.21.15.137:0/3952711250 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8007e00 con 0x7fbffc15aae0 2024-04-26T23:45:07.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fc002a00640 1 -- 172.21.15.137:0/3952711250 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbffc160970 con 0x7fbffc15aae0 2024-04-26T23:45:07.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fc002a00640 1 -- 172.21.15.137:0/3952711250 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbffc160f30 con 0x7fbffc15aae0 2024-04-26T23:45:07.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.845+0000 7fc002a00640 1 -- 172.21.15.137:0/3952711250 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbffc06a2a0 con 0x7fbffc15aae0 2024-04-26T23:45:07.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.849+0000 7fbff3e00640 1 -- 172.21.15.137:0/3952711250 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbfe8018070 con 0x7fbffc15aae0 2024-04-26T23:45:07.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.849+0000 7fbff3e00640 1 --2- 172.21.15.137:0/3952711250 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbfdc068380 0x7fbfdc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.849+0000 7fbff3e00640 1 -- 172.21.15.137:0/3952711250 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7fbfe80865a0 con 0x7fbffc15aae0 2024-04-26T23:45:07.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.849+0000 7fbffbe00640 1 --2- 172.21.15.137:0/3952711250 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbfdc068380 0x7fbfdc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.849+0000 7fbffbe00640 1 --2- 172.21.15.137:0/3952711250 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbfdc068380 0x7fbfdc06a840 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0af000 tx=0x7fbfec0a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:07.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:07.853+0000 7fbff3e00640 1 -- 172.21.15.137:0/3952711250 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbfe8056e50 con 0x7fbffc15aae0 2024-04-26T23:45:08.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:08.009+0000 7fc002a00640 1 -- 172.21.15.137:0/3952711250 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbffc06fc40 con 0x7fbffc15aae0 2024-04-26T23:45:08.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:08.009+0000 7fbff3e00640 1 -- 172.21.15.137:0/3952711250 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+13068 (secure 0 0 0) 0x7fbfe8056750 con 0x7fbffc15aae0 2024-04-26T23:45:08.015 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:08.015 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":63,"fsid":"efde6204-be0d-4c4f-9ea0-954d26627e78","created":"2024-04-26T23:40:58.569281+0000","modified":"2024-04-26T23:45:04.610920+0000","last_up_change":"2024-04-26T23:41:10.270607+0000","last_in_change":"2024-04-26T23:41:01.114767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:41:11.613077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5888ad-9d3d-4dfe-8f52-cd9a17bbed22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6825","nonce":1614749039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6827","nonce":1614749039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6831","nonce":1614749039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1614749039},{"type":"v1","addr":"172.21.15.137:6829","nonce":1614749039}]},"public_addr":"172.21.15.137:6825/1614749039","cluster_addr":"172.21.15.137:6827/1614749039","heartbeat_back_addr":"172.21.15.137:6831/1614749039","heartbeat_front_addr":"172.21.15.137:6829/1614749039","state":["exists","up"]},{"osd":1,"uuid":"82c58162-4c7b-4145-b65b-f1e4b5218edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6809","nonce":4283404504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6811","nonce":4283404504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6815","nonce":4283404504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":4283404504},{"type":"v1","addr":"172.21.15.137:6813","nonce":4283404504}]},"public_addr":"172.21.15.137:6809/4283404504","cluster_addr":"172.21.15.137:6811/4283404504","heartbeat_back_addr":"172.21.15.137:6815/4283404504","heartbeat_front_addr":"172.21.15.137:6813/4283404504","state":["exists","up"]},{"osd":2,"uuid":"cf9165b2-8592-4bf9-b097-e0fb78f0d2f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6801","nonce":4056840582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6803","nonce":4056840582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6807","nonce":4056840582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":4056840582},{"type":"v1","addr":"172.21.15.137:6805","nonce":4056840582}]},"public_addr":"172.21.15.137:6801/4056840582","cluster_addr":"172.21.15.137:6803/4056840582","heartbeat_back_addr":"172.21.15.137:6807/4056840582","heartbeat_front_addr":"172.21.15.137:6805/4056840582","state":["exists","up"]},{"osd":3,"uuid":"ce01b13c-4107-4227-a697-3a6b402bc7a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6817","nonce":2945054112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6819","nonce":2945054112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6823","nonce":2945054112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2945054112},{"type":"v1","addr":"172.21.15.137:6821","nonce":2945054112}]},"public_addr":"172.21.15.137:6817/2945054112","cluster_addr":"172.21.15.137:6819/2945054112","heartbeat_back_addr":"172.21.15.137:6823/2945054112","heartbeat_front_addr":"172.21.15.137:6821/2945054112","state":["exists","up"]},{"osd":4,"uuid":"a562f6c7-ff1e-473f-96e7-f87d330a3499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6809","nonce":2998038920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6811","nonce":2998038920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6815","nonce":2998038920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2998038920},{"type":"v1","addr":"172.21.15.170:6813","nonce":2998038920}]},"public_addr":"172.21.15.170:6809/2998038920","cluster_addr":"172.21.15.170:6811/2998038920","heartbeat_back_addr":"172.21.15.170:6815/2998038920","heartbeat_front_addr":"172.21.15.170:6813/2998038920","state":["exists","up"]},{"osd":5,"uuid":"6016cfc3-8cd3-418b-8a07-201fadfeade7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6801","nonce":1674488513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6803","nonce":1674488513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6807","nonce":1674488513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1674488513},{"type":"v1","addr":"172.21.15.170:6805","nonce":1674488513}]},"public_addr":"172.21.15.170:6801/1674488513","cluster_addr":"172.21.15.170:6803/1674488513","heartbeat_back_addr":"172.21.15.170:6807/1674488513","heartbeat_front_addr":"172.21.15.170:6805/1674488513","state":["exists","up"]},{"osd":6,"uuid":"3c33e60d-7803-46ec-beba-573a3a42ccfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6823","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6824","nonce":169019272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6827","nonce":169019272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6831","nonce":169019272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":169019272},{"type":"v1","addr":"172.21.15.170:6829","nonce":169019272}]},"public_addr":"172.21.15.170:6824/169019272","cluster_addr":"172.21.15.170:6827/169019272","heartbeat_back_addr":"172.21.15.170:6831/169019272","heartbeat_front_addr":"172.21.15.170:6829/169019272","state":["exists","up"]},{"osd":7,"uuid":"a39b04d0-f879-4336-920a-9f569ac3e22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6817","nonce":3057172683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6819","nonce":3057172683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6825","nonce":3057172683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3057172683},{"type":"v1","addr":"172.21.15.170:6821","nonce":3057172683}]},"public_addr":"172.21.15.170:6817/3057172683","cluster_addr":"172.21.15.170:6819/3057172683","heartbeat_back_addr":"172.21.15.170:6825/3057172683","heartbeat_front_addr":"172.21.15.170:6821/3057172683","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.926317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.798101+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.667194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.923820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.733644+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.619629+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.949724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:41:06.824450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:6835/141729149":"2024-04-27T23:45:01.602341+0000","172.21.15.170:6833/141729149":"2024-04-27T23:45:01.602341+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:45:08.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:08.013+0000 7fc002a00640 1 -- 172.21.15.137:0/3952711250 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbfdc068380 msgr2=0x7fbfdc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:08.013+0000 7fc002a00640 1 --2- 172.21.15.137:0/3952711250 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbfdc068380 0x7fbfdc06a840 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0af000 tx=0x7fbfec0a7000 comp rx=0 tx=0).stop 2024-04-26T23:45:08.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:08.013+0000 7fc002a00640 1 -- 172.21.15.137:0/3952711250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbffc15aae0 msgr2=0x7fbffc0b4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:08.013+0000 7fc002a00640 1 --2- 172.21.15.137:0/3952711250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbffc15aae0 0x7fbffc0b4c10 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fbfe800c7c0 tx=0x7fbfe800cc80 comp rx=0 tx=0).stop 2024-04-26T23:45:08.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:08.013+0000 7fc002a00640 1 -- 172.21.15.137:0/3952711250 shutdown_connections 2024-04-26T23:45:08.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:08.013+0000 7fc002a00640 1 --2- 172.21.15.137:0/3952711250 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fbfdc068380 0x7fbfdc06a840 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:08.013+0000 7fc002a00640 1 --2- 172.21.15.137:0/3952711250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbffc15aae0 0x7fbffc0b4c10 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:08.013+0000 7fc002a00640 1 --2- 172.21.15.137:0/3952711250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbffc15d630 0x7fbffc0b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:08.013+0000 7fc002a00640 1 --2- 172.21.15.137:0/3952711250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbffc0b2d60 0x7fbffc156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:08.013+0000 7fc002a00640 1 -- 172.21.15.137:0/3952711250 >> 172.21.15.137:0/3952711250 conn(0x7fbffc06c560 msgr2=0x7fbffc0b0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:08.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:08.013+0000 7fc002a00640 1 -- 172.21.15.137:0/3952711250 shutdown_connections 2024-04-26T23:45:08.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:08.013+0000 7fc002a00640 1 -- 172.21.15.137:0/3952711250 wait complete. 2024-04-26T23:45:09.038 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T23:45:09.038 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:45:09.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.185+0000 7f888f200640 1 Processor -- start 2024-04-26T23:45:09.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.185+0000 7f888f200640 1 -- start start 2024-04-26T23:45:09.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.185+0000 7f888f200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f889006d6b0 0x7f889006e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.185+0000 7f888f200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88900cf2c0 con 0x7f88900d1150 2024-04-26T23:45:09.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.185+0000 7f888f200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88900d3b00 con 0x7f88900b8710 2024-04-26T23:45:09.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.185+0000 7f888f200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f88900cd510 con 0x7f889006d6b0 2024-04-26T23:45:09.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.185+0000 7f888e800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f88900d1150 0x7f88900d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40594/0 (socket says 172.21.15.137:40594) 2024-04-26T23:45:09.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.185+0000 7f888e800640 1 -- 172.21.15.137:0/3385135987 learned_addr learned my addr 172.21.15.137:0/3385135987 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:45:09.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.185+0000 7f888d400640 1 --2- 172.21.15.137:0/3385135987 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f889006d6b0 0x7f889006e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.189+0000 7f888ca00640 1 -- 172.21.15.137:0/3385135987 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1333385006 0 0) 0x7f88900cf2c0 con 0x7f88900d1150 2024-04-26T23:45:09.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.189+0000 7f888ca00640 1 -- 172.21.15.137:0/3385135987 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8874003530 con 0x7f88900d1150 2024-04-26T23:45:09.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.189+0000 7f888ca00640 1 -- 172.21.15.137:0/3385135987 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 375004850 0 0) 0x7f88900d3b00 con 0x7f88900b8710 2024-04-26T23:45:09.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.189+0000 7f888ca00640 1 -- 172.21.15.137:0/3385135987 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88900cf2c0 con 0x7f88900b8710 2024-04-26T23:45:09.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.189+0000 7f888d400640 1 -- 172.21.15.137:0/3385135987 >> v1:172.21.15.170:6789/0 conn(0x7f88900b8710 legacy=0x7f889006dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.189+0000 7f888ca00640 1 -- 172.21.15.137:0/3385135987 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 516451640 0 0) 0x7f8874003530 con 0x7f88900d1150 2024-04-26T23:45:09.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.189+0000 7f888d400640 1 -- 172.21.15.137:0/3385135987 >> v1:172.21.15.137:6789/0 conn(0x7f88900d1150 legacy=0x7f88900d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.189+0000 7f888d400640 1 -- 172.21.15.137:0/3385135987 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88900cd7f0 con 0x7f889006d6b0 2024-04-26T23:45:09.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.189+0000 7f888d400640 1 --2- 172.21.15.137:0/3385135987 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f889006d6b0 0x7f889006e3a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f887c0097f0 tx=0x7f887c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe8ebb691f2d003f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:09.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.189+0000 7f888ca00640 1 -- 172.21.15.137:0/3385135987 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887c0b0070 con 0x7f889006d6b0 2024-04-26T23:45:09.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.189+0000 7f888ca00640 1 -- 172.21.15.137:0/3385135987 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f887c0ab400 con 0x7f889006d6b0 2024-04-26T23:45:09.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.189+0000 7f888ca00640 1 -- 172.21.15.137:0/3385135987 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888001680 con 0x7f889006d6b0 2024-04-26T23:45:09.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888f200640 1 -- 172.21.15.137:0/3385135987 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f889006d6b0 msgr2=0x7f889006e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888f200640 1 --2- 172.21.15.137:0/3385135987 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f889006d6b0 0x7f889006e3a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f887c0097f0 tx=0x7f887c01c400 comp rx=0 tx=0).stop 2024-04-26T23:45:09.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888f200640 1 -- 172.21.15.137:0/3385135987 shutdown_connections 2024-04-26T23:45:09.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888f200640 1 --2- 172.21.15.137:0/3385135987 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f889006d6b0 0x7f889006e3a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888f200640 1 -- 172.21.15.137:0/3385135987 >> 172.21.15.137:0/3385135987 conn(0x7f88900d2e20 msgr2=0x7f88900d3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:09.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888f200640 1 -- 172.21.15.137:0/3385135987 shutdown_connections 2024-04-26T23:45:09.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888f200640 1 -- 172.21.15.137:0/3385135987 wait complete. 2024-04-26T23:45:09.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888f200640 1 Processor -- start 2024-04-26T23:45:09.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888f200640 1 -- start start 2024-04-26T23:45:09.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888f200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f889006d6b0 0x7f8890151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888f200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88900b8710 0x7f8890155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88900d1150 0x7f8890153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f88900b8c70 con 0x7f88900d1150 2024-04-26T23:45:09.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888f200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f88900b8af0 con 0x7f889006d6b0 2024-04-26T23:45:09.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888f200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f889016d0e0 con 0x7f88900b8710 2024-04-26T23:45:09.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88900d1150 0x7f8890153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88900d1150 0x7f8890153820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35506/0 (socket says 172.21.15.137:35506) 2024-04-26T23:45:09.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888e800640 1 -- 172.21.15.137:0/1234982603 learned_addr learned my addr 172.21.15.137:0/1234982603 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:09.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888de00640 1 --2- 172.21.15.137:0/1234982603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f889006d6b0 0x7f8890151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888d400640 1 --2- 172.21.15.137:0/1234982603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88900b8710 0x7f8890155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888e800640 1 -- 172.21.15.137:0/1234982603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88900b8710 msgr2=0x7f8890155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888e800640 1 --2- 172.21.15.137:0/1234982603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88900b8710 0x7f8890155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888e800640 1 -- 172.21.15.137:0/1234982603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f889006d6b0 msgr2=0x7f8890151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.193+0000 7f888e800640 1 --2- 172.21.15.137:0/1234982603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f889006d6b0 0x7f8890151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.197+0000 7f888e800640 1 -- 172.21.15.137:0/1234982603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8890158e10 con 0x7f88900d1150 2024-04-26T23:45:09.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.197+0000 7f888e800640 1 --2- 172.21.15.137:0/1234982603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88900d1150 0x7f8890153820 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f888800c780 tx=0x7f888800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:09.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.197+0000 7f8886000640 1 -- 172.21.15.137:0/1234982603 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888017070 con 0x7f88900d1150 2024-04-26T23:45:09.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.197+0000 7f8886000640 1 -- 172.21.15.137:0/1234982603 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8888005ae0 con 0x7f88900d1150 2024-04-26T23:45:09.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.197+0000 7f888f200640 1 -- 172.21.15.137:0/1234982603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88901590f0 con 0x7f88900d1150 2024-04-26T23:45:09.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.197+0000 7f8886000640 1 -- 172.21.15.137:0/1234982603 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888007070 con 0x7f88900d1150 2024-04-26T23:45:09.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.197+0000 7f888f200640 1 -- 172.21.15.137:0/1234982603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88901596b0 con 0x7f88900d1150 2024-04-26T23:45:09.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.197+0000 7f888f200640 1 -- 172.21.15.137:0/1234982603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f88900a0d90 con 0x7f88900d1150 2024-04-26T23:45:09.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.197+0000 7f8886000640 1 -- 172.21.15.137:0/1234982603 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f888801a070 con 0x7f88900d1150 2024-04-26T23:45:09.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.197+0000 7f8886000640 1 --2- 172.21.15.137:0/1234982603 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8870068380 0x7f887006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.197+0000 7f8886000640 1 -- 172.21.15.137:0/1234982603 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7f8888086380 con 0x7f88900d1150 2024-04-26T23:45:09.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.197+0000 7f888de00640 1 --2- 172.21.15.137:0/1234982603 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8870068380 0x7f887006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.197+0000 7f8886000640 1 --2- 172.21.15.137:0/1234982603 >> [v2:172.21.15.137:6824/1614749039,v1:172.21.15.137:6825/1614749039] conn(0x7f887006e240 0x7f8870070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.197+0000 7f8886000640 1 -- 172.21.15.137:0/1234982603 --> [v2:172.21.15.137:6824/1614749039,v1:172.21.15.137:6825/1614749039] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f888800ae50 con 0x7f887006e240 2024-04-26T23:45:09.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.197+0000 7f8886000640 1 -- 172.21.15.137:0/1234982603 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f8888086730 con 0x7f88900d1150 2024-04-26T23:45:09.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.197+0000 7f888d400640 1 --2- 172.21.15.137:0/1234982603 >> [v2:172.21.15.137:6824/1614749039,v1:172.21.15.137:6825/1614749039] conn(0x7f887006e240 0x7f8870070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.201+0000 7f888de00640 1 --2- 172.21.15.137:0/1234982603 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8870068380 0x7f887006a840 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f88800015c0 tx=0x7f8880009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:09.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.201+0000 7f888d400640 1 --2- 172.21.15.137:0/1234982603 >> [v2:172.21.15.137:6824/1614749039,v1:172.21.15.137:6825/1614749039] conn(0x7f887006e240 0x7f8870070660 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:09.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.201+0000 7f8886000640 1 -- 172.21.15.137:0/1234982603 <== osd.0 v2:172.21.15.137:6824/1614749039 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f888800ae50 con 0x7f887006e240 2024-04-26T23:45:09.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.213+0000 7f888f200640 1 -- 172.21.15.137:0/1234982603 --> [v2:172.21.15.137:6824/1614749039,v1:172.21.15.137:6825/1614749039] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f88900768a0 con 0x7f887006e240 2024-04-26T23:45:09.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.213+0000 7f8886000640 1 -- 172.21.15.137:0/1234982603 <== osd.0 v2:172.21.15.137:6824/1614749039 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f88900768a0 con 0x7f887006e240 2024-04-26T23:45:09.218 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:45:09.218 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:45:09.218 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:45:09.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.213+0000 7f888f200640 1 -- 172.21.15.137:0/1234982603 >> [v2:172.21.15.137:6824/1614749039,v1:172.21.15.137:6825/1614749039] conn(0x7f887006e240 msgr2=0x7f8870070660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.213+0000 7f888f200640 1 --2- 172.21.15.137:0/1234982603 >> [v2:172.21.15.137:6824/1614749039,v1:172.21.15.137:6825/1614749039] conn(0x7f887006e240 0x7f8870070660 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.213+0000 7f888f200640 1 -- 172.21.15.137:0/1234982603 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8870068380 msgr2=0x7f887006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.213+0000 7f888f200640 1 --2- 172.21.15.137:0/1234982603 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8870068380 0x7f887006a840 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f88800015c0 tx=0x7f8880009040 comp rx=0 tx=0).stop 2024-04-26T23:45:09.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.213+0000 7f888f200640 1 -- 172.21.15.137:0/1234982603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88900d1150 msgr2=0x7f8890153820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.213+0000 7f888f200640 1 --2- 172.21.15.137:0/1234982603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88900d1150 0x7f8890153820 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f888800c780 tx=0x7f888800cc40 comp rx=0 tx=0).stop 2024-04-26T23:45:09.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.213+0000 7f888e800640 1 -- 172.21.15.137:0/1234982603 reap_dead start 2024-04-26T23:45:09.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.213+0000 7f888f200640 1 -- 172.21.15.137:0/1234982603 shutdown_connections 2024-04-26T23:45:09.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.213+0000 7f888f200640 1 -- 172.21.15.137:0/1234982603 >> 172.21.15.137:0/1234982603 conn(0x7f88900d2e20 msgr2=0x7f88900b7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:09.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.213+0000 7f888f200640 1 -- 172.21.15.137:0/1234982603 shutdown_connections 2024-04-26T23:45:09.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.213+0000 7f888f200640 1 -- 172.21.15.137:0/1234982603 wait complete. 2024-04-26T23:45:09.236 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T23:45:09.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.369+0000 7f9648600640 1 Processor -- start 2024-04-26T23:45:09.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.369+0000 7f9648600640 1 -- start start 2024-04-26T23:45:09.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.369+0000 7f9648600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f96400b3e30 0x7f96400ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.369+0000 7f9648600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96400ceb20 0x7f964006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.369+0000 7f9648600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96400b43f0 con 0x7f9640145730 2024-04-26T23:45:09.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.369+0000 7f9648600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f96400b5000 con 0x7f96400b3e30 2024-04-26T23:45:09.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.369+0000 7f9648600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f96400b46d0 con 0x7f96400ceb20 2024-04-26T23:45:09.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.369+0000 7f9645200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f96400b3e30 0x7f96400ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.369+0000 7f9645c00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f9640145730 0x7f96400735f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40606/0 (socket says 172.21.15.137:40606) 2024-04-26T23:45:09.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.369+0000 7f9645c00640 1 -- 172.21.15.137:0/804846623 learned_addr learned my addr 172.21.15.137:0/804846623 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:45:09.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.369+0000 7f9646600640 1 --2- 172.21.15.137:0/804846623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96400ceb20 0x7f964006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.369+0000 7f9645200640 1 -- 172.21.15.137:0/804846623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96400ceb20 msgr2=0x7f964006f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:09.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.369+0000 7f9645200640 1 --2- 172.21.15.137:0/804846623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96400ceb20 0x7f964006f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.369+0000 7f9645200640 1 -- 172.21.15.137:0/804846623 >> v1:172.21.15.137:6789/0 conn(0x7f9640145730 legacy=0x7f96400735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.369+0000 7f963fe00640 1 -- 172.21.15.137:0/804846623 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2166074492 0 0) 0x7f96400b43f0 con 0x7f9640145730 2024-04-26T23:45:09.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.369+0000 7f9645200640 1 -- 172.21.15.137:0/804846623 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96400b49b0 con 0x7f96400b3e30 2024-04-26T23:45:09.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.373+0000 7f9645200640 1 --2- 172.21.15.137:0/804846623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96400b3e30 0x7f96400ce5e0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f962c0097c0 tx=0x7f962c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a8b27e821dbdaa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:09.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.373+0000 7f963fe00640 1 -- 172.21.15.137:0/804846623 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c0b0070 con 0x7f96400b3e30 2024-04-26T23:45:09.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.373+0000 7f963fe00640 1 -- 172.21.15.137:0/804846623 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f962c0ab600 con 0x7f96400b3e30 2024-04-26T23:45:09.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.373+0000 7f963fe00640 1 -- 172.21.15.137:0/804846623 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c0ab9d0 con 0x7f96400b3e30 2024-04-26T23:45:09.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.373+0000 7f9648600640 1 -- 172.21.15.137:0/804846623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96400b3e30 msgr2=0x7f96400ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.373+0000 7f9648600640 1 --2- 172.21.15.137:0/804846623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96400b3e30 0x7f96400ce5e0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f962c0097c0 tx=0x7f962c01c410 comp rx=0 tx=0).stop 2024-04-26T23:45:09.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.373+0000 7f9648600640 1 -- 172.21.15.137:0/804846623 shutdown_connections 2024-04-26T23:45:09.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.373+0000 7f9648600640 1 --2- 172.21.15.137:0/804846623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96400ceb20 0x7f964006f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.373+0000 7f9648600640 1 --2- 172.21.15.137:0/804846623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96400b3e30 0x7f96400ce5e0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.373+0000 7f9648600640 1 -- 172.21.15.137:0/804846623 >> 172.21.15.137:0/804846623 conn(0x7f964006c560 msgr2=0x7f964006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:09.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.373+0000 7f9648600640 1 -- 172.21.15.137:0/804846623 shutdown_connections 2024-04-26T23:45:09.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.373+0000 7f9648600640 1 -- 172.21.15.137:0/804846623 wait complete. 2024-04-26T23:45:09.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f9648600640 1 Processor -- start 2024-04-26T23:45:09.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f9648600640 1 -- start start 2024-04-26T23:45:09.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f9648600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96400b3e30 0x7f96400c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f9648600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96400ceb20 0x7f964015bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f9648600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9640145730 0x7f96400c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f9648600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9640168e70 con 0x7f96400ceb20 2024-04-26T23:45:09.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f9648600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9640145d20 con 0x7f96400b3e30 2024-04-26T23:45:09.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f9648600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9640168ff0 con 0x7f9640145730 2024-04-26T23:45:09.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f9645200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96400ceb20 0x7f964015bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f9645200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96400ceb20 0x7f964015bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35526/0 (socket says 172.21.15.137:35526) 2024-04-26T23:45:09.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f9645200640 1 -- 172.21.15.137:0/1240903882 learned_addr learned my addr 172.21.15.137:0/1240903882 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:09.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f9645c00640 1 --2- 172.21.15.137:0/1240903882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96400b3e30 0x7f96400c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f9646600640 1 --2- 172.21.15.137:0/1240903882 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9640145730 0x7f96400c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f9645200640 1 -- 172.21.15.137:0/1240903882 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9640145730 msgr2=0x7f96400c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f9645200640 1 --2- 172.21.15.137:0/1240903882 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9640145730 0x7f96400c6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f9645200640 1 -- 172.21.15.137:0/1240903882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96400b3e30 msgr2=0x7f96400c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f9645200640 1 --2- 172.21.15.137:0/1240903882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96400b3e30 0x7f96400c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f9645200640 1 -- 172.21.15.137:0/1240903882 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96400c7510 con 0x7f96400ceb20 2024-04-26T23:45:09.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f9645200640 1 --2- 172.21.15.137:0/1240903882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96400ceb20 0x7f964015bbb0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f962c0097c0 tx=0x7f962c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:09.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f963d600640 1 -- 172.21.15.137:0/1240903882 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c0b0040 con 0x7f96400ceb20 2024-04-26T23:45:09.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f963d600640 1 -- 172.21.15.137:0/1240903882 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f962c004030 con 0x7f96400ceb20 2024-04-26T23:45:09.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f963d600640 1 -- 172.21.15.137:0/1240903882 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c004400 con 0x7f96400ceb20 2024-04-26T23:45:09.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f9648600640 1 -- 172.21.15.137:0/1240903882 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96400c8700 con 0x7f96400ceb20 2024-04-26T23:45:09.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f9648600640 1 -- 172.21.15.137:0/1240903882 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96400c8cc0 con 0x7f96400ceb20 2024-04-26T23:45:09.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.377+0000 7f9648600640 1 -- 172.21.15.137:0/1240903882 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f964006a2a0 con 0x7f96400ceb20 2024-04-26T23:45:09.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.381+0000 7f963d600640 1 -- 172.21.15.137:0/1240903882 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f962c003620 con 0x7f96400ceb20 2024-04-26T23:45:09.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.381+0000 7f963d600640 1 --2- 172.21.15.137:0/1240903882 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9620068380 0x7f962006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.381+0000 7f963d600640 1 -- 172.21.15.137:0/1240903882 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7f962c121440 con 0x7f96400ceb20 2024-04-26T23:45:09.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.381+0000 7f9645c00640 1 --2- 172.21.15.137:0/1240903882 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9620068380 0x7f962006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.381+0000 7f9645c00640 1 --2- 172.21.15.137:0/1240903882 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9620068380 0x7f962006a840 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9634000f70 tx=0x7f9634007b60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:09.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.385+0000 7f963d600640 1 -- 172.21.15.137:0/1240903882 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f962c016090 con 0x7f96400ceb20 2024-04-26T23:45:09.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.541+0000 7f9648600640 1 -- 172.21.15.137:0/1240903882 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f9640141000 con 0x7f9620068380 2024-04-26T23:45:09.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.541+0000 7f963d600640 1 -- 172.21.15.137:0/1240903882 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9640141000 con 0x7f9620068380 2024-04-26T23:45:09.546 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T23:45:09.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.545+0000 7f9648600640 1 -- 172.21.15.137:0/1240903882 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9620068380 msgr2=0x7f962006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.545+0000 7f9648600640 1 --2- 172.21.15.137:0/1240903882 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9620068380 0x7f962006a840 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9634000f70 tx=0x7f9634007b60 comp rx=0 tx=0).stop 2024-04-26T23:45:09.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.545+0000 7f9648600640 1 -- 172.21.15.137:0/1240903882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96400ceb20 msgr2=0x7f964015bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.545+0000 7f9648600640 1 --2- 172.21.15.137:0/1240903882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96400ceb20 0x7f964015bbb0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f962c0097c0 tx=0x7f962c01ac50 comp rx=0 tx=0).stop 2024-04-26T23:45:09.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.545+0000 7f9648600640 1 -- 172.21.15.137:0/1240903882 shutdown_connections 2024-04-26T23:45:09.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.545+0000 7f9648600640 1 --2- 172.21.15.137:0/1240903882 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f9620068380 0x7f962006a840 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.545+0000 7f9648600640 1 --2- 172.21.15.137:0/1240903882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96400ceb20 0x7f964015bbb0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.545+0000 7f9648600640 1 --2- 172.21.15.137:0/1240903882 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9640145730 0x7f96400c6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.545+0000 7f9648600640 1 --2- 172.21.15.137:0/1240903882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96400b3e30 0x7f96400c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.545+0000 7f9648600640 1 -- 172.21.15.137:0/1240903882 >> 172.21.15.137:0/1240903882 conn(0x7f964006c560 msgr2=0x7f96400b16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:09.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.545+0000 7f9648600640 1 -- 172.21.15.137:0/1240903882 shutdown_connections 2024-04-26T23:45:09.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.545+0000 7f9648600640 1 -- 172.21.15.137:0/1240903882 wait complete. 2024-04-26T23:45:09.568 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T23:45:09.568 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:45:09.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.705+0000 7f8f0d400640 1 Processor -- start 2024-04-26T23:45:09.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.705+0000 7f8f0d400640 1 -- start start 2024-04-26T23:45:09.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.709+0000 7f8f0d400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8f08161200 0x7f8f08167e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.709+0000 7f8f0d400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f080cfde0 con 0x7f8f0813fe00 2024-04-26T23:45:09.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.709+0000 7f8f0d400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f080d00c0 con 0x7f8f081431e0 2024-04-26T23:45:09.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.709+0000 7f8f0d400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8f08143610 con 0x7f8f08161200 2024-04-26T23:45:09.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.709+0000 7f8f07200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8f08161200 0x7f8f08167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.709+0000 7f8f07200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8f08161200 0x7f8f08167e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35528/0 (socket says 172.21.15.137:35528) 2024-04-26T23:45:09.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.709+0000 7f8f06800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f8f0813fe00 0x7f8f080cf4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40612/0 (socket says 172.21.15.137:40612) 2024-04-26T23:45:09.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.709+0000 7f8f07200640 1 -- 172.21.15.137:0/3454860582 learned_addr learned my addr 172.21.15.137:0/3454860582 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:09.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.709+0000 7f8f07200640 1 -- 172.21.15.137:0/3454860582 >> v1:172.21.15.170:6789/0 conn(0x7f8f081431e0 legacy=0x7f8f08160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.709+0000 7f8f07200640 1 -- 172.21.15.137:0/3454860582 >> v1:172.21.15.137:6789/0 conn(0x7f8f0813fe00 legacy=0x7f8f080cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.709+0000 7f8f07200640 1 -- 172.21.15.137:0/3454860582 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f080d03a0 con 0x7f8f08161200 2024-04-26T23:45:09.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.709+0000 7f8f07200640 1 --2- 172.21.15.137:0/3454860582 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f08161200 0x7f8f08167e80 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f8f00009e50 tx=0x7f8f0001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99f0ac34a7e552 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:09.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.709+0000 7f8f05400640 1 -- 172.21.15.137:0/3454860582 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f000a57f0 con 0x7f8f08161200 2024-04-26T23:45:09.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.709+0000 7f8f05400640 1 -- 172.21.15.137:0/3454860582 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f000a5990 con 0x7f8f08161200 2024-04-26T23:45:09.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f05400640 1 -- 172.21.15.137:0/3454860582 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f000a5d60 con 0x7f8f08161200 2024-04-26T23:45:09.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f0d400640 1 -- 172.21.15.137:0/3454860582 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f08161200 msgr2=0x7f8f08167e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f0d400640 1 --2- 172.21.15.137:0/3454860582 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f08161200 0x7f8f08167e80 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f8f00009e50 tx=0x7f8f0001ca30 comp rx=0 tx=0).stop 2024-04-26T23:45:09.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f0d400640 1 -- 172.21.15.137:0/3454860582 shutdown_connections 2024-04-26T23:45:09.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f0d400640 1 --2- 172.21.15.137:0/3454860582 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f08161200 0x7f8f08167e80 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f0d400640 1 -- 172.21.15.137:0/3454860582 >> 172.21.15.137:0/3454860582 conn(0x7f8f080d0d10 msgr2=0x7f8f080d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:09.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f0d400640 1 -- 172.21.15.137:0/3454860582 shutdown_connections 2024-04-26T23:45:09.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f0d400640 1 -- 172.21.15.137:0/3454860582 wait complete. 2024-04-26T23:45:09.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f0d400640 1 Processor -- start 2024-04-26T23:45:09.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f0d400640 1 -- start start 2024-04-26T23:45:09.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f0d400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f0813fe00 0x7f8f08073c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f0d400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f081431e0 0x7f8f08155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f0d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f08161200 0x7f8f0813ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f0d400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0816ad60 con 0x7f8f0813fe00 2024-04-26T23:45:09.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f0d400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0816abe0 con 0x7f8f08161200 2024-04-26T23:45:09.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f0d400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8f0816aee0 con 0x7f8f081431e0 2024-04-26T23:45:09.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f06800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f0813fe00 0x7f8f08073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f06800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f0813fe00 0x7f8f08073c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35538/0 (socket says 172.21.15.137:35538) 2024-04-26T23:45:09.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f06800640 1 -- 172.21.15.137:0/3580710120 learned_addr learned my addr 172.21.15.137:0/3580710120 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:09.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f07200640 1 --2- 172.21.15.137:0/3580710120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f08161200 0x7f8f0813ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f05e00640 1 --2- 172.21.15.137:0/3580710120 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f081431e0 0x7f8f08155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f06800640 1 -- 172.21.15.137:0/3580710120 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f081431e0 msgr2=0x7f8f08155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f06800640 1 --2- 172.21.15.137:0/3580710120 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f081431e0 0x7f8f08155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f06800640 1 -- 172.21.15.137:0/3580710120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f08161200 msgr2=0x7f8f0813ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f06800640 1 --2- 172.21.15.137:0/3580710120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f08161200 0x7f8f0813ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.713+0000 7f8f06800640 1 -- 172.21.15.137:0/3580710120 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0813a8e0 con 0x7f8f0813fe00 2024-04-26T23:45:09.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.717+0000 7f8f06800640 1 --2- 172.21.15.137:0/3580710120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f0813fe00 0x7f8f08073c70 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f8ef800c490 tx=0x7f8ef800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:09.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.717+0000 7f8efea00640 1 -- 172.21.15.137:0/3580710120 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8018070 con 0x7f8f0813fe00 2024-04-26T23:45:09.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.717+0000 7f8efea00640 1 -- 172.21.15.137:0/3580710120 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef8007480 con 0x7f8f0813fe00 2024-04-26T23:45:09.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.717+0000 7f8efea00640 1 -- 172.21.15.137:0/3580710120 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef80047f0 con 0x7f8f0813fe00 2024-04-26T23:45:09.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.717+0000 7f8f0d400640 1 -- 172.21.15.137:0/3580710120 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f0813ab50 con 0x7f8f0813fe00 2024-04-26T23:45:09.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.717+0000 7f8f0d400640 1 -- 172.21.15.137:0/3580710120 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f0813b110 con 0x7f8f0813fe00 2024-04-26T23:45:09.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.717+0000 7f8f0d400640 1 -- 172.21.15.137:0/3580710120 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8f0806a2a0 con 0x7f8f0813fe00 2024-04-26T23:45:09.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.717+0000 7f8efea00640 1 -- 172.21.15.137:0/3580710120 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8ef801b070 con 0x7f8f0813fe00 2024-04-26T23:45:09.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.717+0000 7f8efea00640 1 --2- 172.21.15.137:0/3580710120 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8ee8068380 0x7f8ee806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.717+0000 7f8efea00640 1 -- 172.21.15.137:0/3580710120 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7f8ef8085820 con 0x7f8f0813fe00 2024-04-26T23:45:09.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.717+0000 7f8f05e00640 1 --2- 172.21.15.137:0/3580710120 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8ee8068380 0x7f8ee806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.717+0000 7f8efea00640 1 --2- 172.21.15.137:0/3580710120 >> [v2:172.21.15.137:6808/4283404504,v1:172.21.15.137:6809/4283404504] conn(0x7f8ee806e240 0x7f8ee8070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.717+0000 7f8efea00640 1 -- 172.21.15.137:0/3580710120 --> [v2:172.21.15.137:6808/4283404504,v1:172.21.15.137:6809/4283404504] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ee8070d10 con 0x7f8ee806e240 2024-04-26T23:45:09.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.717+0000 7f8efea00640 1 -- 172.21.15.137:0/3580710120 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f8ef808c050 con 0x7f8f0813fe00 2024-04-26T23:45:09.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.717+0000 7f8f07200640 1 --2- 172.21.15.137:0/3580710120 >> [v2:172.21.15.137:6808/4283404504,v1:172.21.15.137:6809/4283404504] conn(0x7f8ee806e240 0x7f8ee8070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.721+0000 7f8f05e00640 1 --2- 172.21.15.137:0/3580710120 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8ee8068380 0x7f8ee806a840 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8f0813dc90 tx=0x7f8ef4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:09.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.721+0000 7f8f07200640 1 --2- 172.21.15.137:0/3580710120 >> [v2:172.21.15.137:6808/4283404504,v1:172.21.15.137:6809/4283404504] conn(0x7f8ee806e240 0x7f8ee8070660 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:09.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.721+0000 7f8efea00640 1 -- 172.21.15.137:0/3580710120 <== osd.1 v2:172.21.15.137:6808/4283404504 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8ee8070d10 con 0x7f8ee806e240 2024-04-26T23:45:09.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.733+0000 7f8f0d400640 1 -- 172.21.15.137:0/3580710120 --> [v2:172.21.15.137:6808/4283404504,v1:172.21.15.137:6809/4283404504] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8f080b4510 con 0x7f8ee806e240 2024-04-26T23:45:09.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.733+0000 7f8efea00640 1 -- 172.21.15.137:0/3580710120 <== osd.1 v2:172.21.15.137:6808/4283404504 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8f080b4510 con 0x7f8ee806e240 2024-04-26T23:45:09.738 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:45:09.739 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:45:09.739 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:45:09.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.733+0000 7f8f0d400640 1 -- 172.21.15.137:0/3580710120 >> [v2:172.21.15.137:6808/4283404504,v1:172.21.15.137:6809/4283404504] conn(0x7f8ee806e240 msgr2=0x7f8ee8070660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.733+0000 7f8f0d400640 1 --2- 172.21.15.137:0/3580710120 >> [v2:172.21.15.137:6808/4283404504,v1:172.21.15.137:6809/4283404504] conn(0x7f8ee806e240 0x7f8ee8070660 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.733+0000 7f8f0d400640 1 -- 172.21.15.137:0/3580710120 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8ee8068380 msgr2=0x7f8ee806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.733+0000 7f8f0d400640 1 --2- 172.21.15.137:0/3580710120 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f8ee8068380 0x7f8ee806a840 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8f0813dc90 tx=0x7f8ef4009040 comp rx=0 tx=0).stop 2024-04-26T23:45:09.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.733+0000 7f8f0d400640 1 -- 172.21.15.137:0/3580710120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f0813fe00 msgr2=0x7f8f08073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.733+0000 7f8f0d400640 1 --2- 172.21.15.137:0/3580710120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f0813fe00 0x7f8f08073c70 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f8ef800c490 tx=0x7f8ef800c950 comp rx=0 tx=0).stop 2024-04-26T23:45:09.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.733+0000 7f8f07200640 1 -- 172.21.15.137:0/3580710120 reap_dead start 2024-04-26T23:45:09.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.733+0000 7f8f0d400640 1 -- 172.21.15.137:0/3580710120 shutdown_connections 2024-04-26T23:45:09.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.733+0000 7f8f0d400640 1 -- 172.21.15.137:0/3580710120 >> 172.21.15.137:0/3580710120 conn(0x7f8f080d0d10 msgr2=0x7f8f080d10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:09.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.733+0000 7f8f0d400640 1 -- 172.21.15.137:0/3580710120 shutdown_connections 2024-04-26T23:45:09.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.733+0000 7f8f0d400640 1 -- 172.21.15.137:0/3580710120 wait complete. 2024-04-26T23:45:09.756 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T23:45:09.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2607200640 1 Processor -- start 2024-04-26T23:45:09.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2607200640 1 -- start start 2024-04-26T23:45:09.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2607200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f260806e5c0 0x7f26080cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2607200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26080d1e80 con 0x7f260806d6b0 2024-04-26T23:45:09.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2607200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26080d2160 con 0x7f260815f310 2024-04-26T23:45:09.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2607200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f26080cd920 con 0x7f260806e5c0 2024-04-26T23:45:09.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2606800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f260806d6b0 0x7f26080ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40620/0 (socket says 172.21.15.137:40620) 2024-04-26T23:45:09.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2606800640 1 -- 172.21.15.137:0/924913875 learned_addr learned my addr 172.21.15.137:0/924913875 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:45:09.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f25fd400640 1 --2- 172.21.15.137:0/924913875 >> v2:172.21.15.170:3300/0 conn(0x7f260806e5c0 0x7f26080cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2605400640 1 -- 172.21.15.137:0/924913875 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3516401546 0 0) 0x7f26080d1e80 con 0x7f260806d6b0 2024-04-26T23:45:09.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2605400640 1 -- 172.21.15.137:0/924913875 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25ec003530 con 0x7f260806d6b0 2024-04-26T23:45:09.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2605400640 1 -- 172.21.15.137:0/924913875 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2010556061 0 0) 0x7f26080d2160 con 0x7f260815f310 2024-04-26T23:45:09.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2605400640 1 -- 172.21.15.137:0/924913875 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26080d1e80 con 0x7f260815f310 2024-04-26T23:45:09.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2605400640 1 -- 172.21.15.137:0/924913875 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 5357126 0 0) 0x7f25ec003530 con 0x7f260806d6b0 2024-04-26T23:45:09.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2605400640 1 -- 172.21.15.137:0/924913875 >> v2:172.21.15.170:3300/0 conn(0x7f260806e5c0 msgr2=0x7f26080cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:09.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2605400640 1 --2- 172.21.15.137:0/924913875 >> v2:172.21.15.170:3300/0 conn(0x7f260806e5c0 0x7f26080cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2605400640 1 -- 172.21.15.137:0/924913875 >> v1:172.21.15.170:6789/0 conn(0x7f260815f310 legacy=0x7f260806deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2605400640 1 -- 172.21.15.137:0/924913875 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26080cd5b0 con 0x7f260806d6b0 2024-04-26T23:45:09.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2605400640 1 -- 172.21.15.137:0/924913875 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f2600001680 con 0x7f260806d6b0 2024-04-26T23:45:09.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2605400640 1 -- 172.21.15.137:0/924913875 >> v1:172.21.15.137:6789/0 conn(0x7f260806d6b0 legacy=0x7f26080ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2605400640 1 --2- 172.21.15.137:0/924913875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25ec003b50 0x7f25ec003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2605400640 1 --2- 172.21.15.137:0/924913875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f25ec004810 0x7f25ec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2605400640 1 --2- 172.21.15.137:0/924913875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25ec0051d0 0x7f25ec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2605400640 1 -- 172.21.15.137:0/924913875 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f26080cd920 con 0x7f25ec003b50 2024-04-26T23:45:09.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2605400640 1 -- 172.21.15.137:0/924913875 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f25ec00c050 con 0x7f25ec0051d0 2024-04-26T23:45:09.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2605400640 1 -- 172.21.15.137:0/924913875 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f25ec00c250 con 0x7f25ec004810 2024-04-26T23:45:09.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.889+0000 7f2605e00640 1 --2- 172.21.15.137:0/924913875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25ec003b50 0x7f25ec003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.893+0000 7f25fd400640 1 --2- 172.21.15.137:0/924913875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f25ec004810 0x7f25ec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.893+0000 7f2606800640 1 --2- 172.21.15.137:0/924913875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25ec0051d0 0x7f25ec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.893+0000 7f2605e00640 1 -- 172.21.15.137:0/924913875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f25ec004810 msgr2=0x7f25ec004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:09.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.893+0000 7f2605e00640 1 --2- 172.21.15.137:0/924913875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f25ec004810 0x7f25ec004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.893+0000 7f2605e00640 1 -- 172.21.15.137:0/924913875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25ec0051d0 msgr2=0x7f25ec00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:09.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.893+0000 7f2605e00640 1 --2- 172.21.15.137:0/924913875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25ec0051d0 0x7f25ec00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.893+0000 7f2605e00640 1 -- 172.21.15.137:0/924913875 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25ec003530 con 0x7f25ec003b50 2024-04-26T23:45:09.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.893+0000 7f2606800640 1 --2- 172.21.15.137:0/924913875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25ec0051d0 0x7f25ec00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:09.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.893+0000 7f25fd400640 1 --2- 172.21.15.137:0/924913875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f25ec004810 0x7f25ec004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:09.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.893+0000 7f2606800640 1 -- 172.21.15.137:0/924913875 reap_dead start 2024-04-26T23:45:09.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.893+0000 7f2605e00640 1 --2- 172.21.15.137:0/924913875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25ec003b50 0x7f25ec003f50 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f25f8001fd0 tx=0x7f25f801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d26bec680f9b09 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:09.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.893+0000 7f2605400640 1 -- 172.21.15.137:0/924913875 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f8001c20 con 0x7f25ec003b50 2024-04-26T23:45:09.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.893+0000 7f2605400640 1 -- 172.21.15.137:0/924913875 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f8003ba0 con 0x7f25ec003b50 2024-04-26T23:45:09.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.893+0000 7f2605400640 1 -- 172.21.15.137:0/924913875 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f80050d0 con 0x7f25ec003b50 2024-04-26T23:45:09.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.893+0000 7f2607200640 1 -- 172.21.15.137:0/924913875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25ec003b50 msgr2=0x7f25ec003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.893+0000 7f2607200640 1 --2- 172.21.15.137:0/924913875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25ec003b50 0x7f25ec003f50 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f25f8001fd0 tx=0x7f25f801c8e0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.893+0000 7f2607200640 1 -- 172.21.15.137:0/924913875 shutdown_connections 2024-04-26T23:45:09.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.893+0000 7f2607200640 1 --2- 172.21.15.137:0/924913875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25ec003b50 0x7f25ec003f50 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.893+0000 7f2607200640 1 -- 172.21.15.137:0/924913875 >> 172.21.15.137:0/924913875 conn(0x7f26080d2dc0 msgr2=0x7f26080d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:09.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f2607200640 1 -- 172.21.15.137:0/924913875 shutdown_connections 2024-04-26T23:45:09.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f2607200640 1 -- 172.21.15.137:0/924913875 wait complete. 2024-04-26T23:45:09.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f2607200640 1 Processor -- start 2024-04-26T23:45:09.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f2607200640 1 -- start start 2024-04-26T23:45:09.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f2607200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25ec003b50 0x7f2608162460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f2607200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26080c9080 0x7f26080b7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f2607200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26080c9500 0x7f26080b7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f2607200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f26080cffd0 con 0x7f26080c9500 2024-04-26T23:45:09.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f2607200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f26080cfe50 con 0x7f25ec003b50 2024-04-26T23:45:09.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f2607200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f26080d0150 con 0x7f26080c9080 2024-04-26T23:45:09.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f2606800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26080c9500 0x7f26080b7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f2606800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26080c9500 0x7f26080b7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35546/0 (socket says 172.21.15.137:35546) 2024-04-26T23:45:09.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f2606800640 1 -- 172.21.15.137:0/4270055973 learned_addr learned my addr 172.21.15.137:0/4270055973 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:09.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f25fd400640 1 --2- 172.21.15.137:0/4270055973 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26080c9080 0x7f26080b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f2605e00640 1 --2- 172.21.15.137:0/4270055973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25ec003b50 0x7f2608162460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f2606800640 1 -- 172.21.15.137:0/4270055973 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26080c9080 msgr2=0x7f26080b7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f2606800640 1 --2- 172.21.15.137:0/4270055973 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26080c9080 0x7f26080b7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f2606800640 1 -- 172.21.15.137:0/4270055973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25ec003b50 msgr2=0x7f2608162460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f2606800640 1 --2- 172.21.15.137:0/4270055973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25ec003b50 0x7f2608162460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f2606800640 1 -- 172.21.15.137:0/4270055973 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26081629a0 con 0x7f26080c9500 2024-04-26T23:45:09.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f2606800640 1 --2- 172.21.15.137:0/4270055973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26080c9500 0x7f26080b7940 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f2600000c10 tx=0x7f260000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:09.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f25fea00640 1 -- 172.21.15.137:0/4270055973 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260000c610 con 0x7f26080c9500 2024-04-26T23:45:09.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f25fea00640 1 -- 172.21.15.137:0/4270055973 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2600018070 con 0x7f26080c9500 2024-04-26T23:45:09.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f2607200640 1 -- 172.21.15.137:0/4270055973 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26080c68b0 con 0x7f26080c9500 2024-04-26T23:45:09.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.897+0000 7f25fea00640 1 -- 172.21.15.137:0/4270055973 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260000c9f0 con 0x7f26080c9500 2024-04-26T23:45:09.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.901+0000 7f2607200640 1 -- 172.21.15.137:0/4270055973 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26080c6e70 con 0x7f26080c9500 2024-04-26T23:45:09.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.901+0000 7f2607200640 1 -- 172.21.15.137:0/4270055973 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26080767d0 con 0x7f26080c9500 2024-04-26T23:45:09.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.901+0000 7f25fea00640 1 -- 172.21.15.137:0/4270055973 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f260000cb90 con 0x7f26080c9500 2024-04-26T23:45:09.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.901+0000 7f25fea00640 1 --2- 172.21.15.137:0/4270055973 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f25e4068380 0x7f25e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.901+0000 7f25fea00640 1 -- 172.21.15.137:0/4270055973 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7f26000862d0 con 0x7f26080c9500 2024-04-26T23:45:09.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.901+0000 7f2605e00640 1 --2- 172.21.15.137:0/4270055973 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f25e4068380 0x7f25e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.901+0000 7f2605e00640 1 --2- 172.21.15.137:0/4270055973 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f25e4068380 0x7f25e406a840 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f25f80ac000 tx=0x7f25f80a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:09.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:09.905+0000 7f25fea00640 1 -- 172.21.15.137:0/4270055973 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2600056af0 con 0x7f26080c9500 2024-04-26T23:45:10.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.061+0000 7f2607200640 1 -- 172.21.15.137:0/4270055973 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f2608153b60 con 0x7f25e4068380 2024-04-26T23:45:10.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.061+0000 7f25fea00640 1 -- 172.21.15.137:0/4270055973 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f25f8003a00 con 0x7f25e4068380 2024-04-26T23:45:10.067 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T23:45:10.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.065+0000 7f2607200640 1 -- 172.21.15.137:0/4270055973 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f25e4068380 msgr2=0x7f25e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.065+0000 7f2607200640 1 --2- 172.21.15.137:0/4270055973 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f25e4068380 0x7f25e406a840 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f25f80ac000 tx=0x7f25f80a7000 comp rx=0 tx=0).stop 2024-04-26T23:45:10.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.065+0000 7f2607200640 1 -- 172.21.15.137:0/4270055973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26080c9500 msgr2=0x7f26080b7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.065+0000 7f2607200640 1 --2- 172.21.15.137:0/4270055973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26080c9500 0x7f26080b7940 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f2600000c10 tx=0x7f260000eb90 comp rx=0 tx=0).stop 2024-04-26T23:45:10.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.065+0000 7f2607200640 1 -- 172.21.15.137:0/4270055973 shutdown_connections 2024-04-26T23:45:10.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.065+0000 7f2607200640 1 --2- 172.21.15.137:0/4270055973 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f25e4068380 0x7f25e406a840 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.065+0000 7f2607200640 1 --2- 172.21.15.137:0/4270055973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26080c9500 0x7f26080b7940 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.065+0000 7f2607200640 1 --2- 172.21.15.137:0/4270055973 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26080c9080 0x7f26080b7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.065+0000 7f2607200640 1 --2- 172.21.15.137:0/4270055973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25ec003b50 0x7f2608162460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.065+0000 7f2607200640 1 -- 172.21.15.137:0/4270055973 >> 172.21.15.137:0/4270055973 conn(0x7f26080d2dc0 msgr2=0x7f2608071690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:10.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.065+0000 7f2607200640 1 -- 172.21.15.137:0/4270055973 shutdown_connections 2024-04-26T23:45:10.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.065+0000 7f2607200640 1 -- 172.21.15.137:0/4270055973 wait complete. 2024-04-26T23:45:10.088 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T23:45:10.088 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:45:10.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.221+0000 7f68c0400640 1 Processor -- start 2024-04-26T23:45:10.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.221+0000 7f68c0400640 1 -- start start 2024-04-26T23:45:10.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68c0400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68b8159af0 0x7f68b80b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68c0400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68b8159ed0 con 0x7f68b80b6220 2024-04-26T23:45:10.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68c0400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68b80b4710 con 0x7f68b815c610 2024-04-26T23:45:10.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68c0400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f68b80b49f0 con 0x7f68b8159af0 2024-04-26T23:45:10.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68be400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f68b80b6220 0x7f68b8072680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40624/0 (socket says 172.21.15.137:40624) 2024-04-26T23:45:10.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68be400640 1 -- 172.21.15.137:0/2422138462 learned_addr learned my addr 172.21.15.137:0/2422138462 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:45:10.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68bda00640 1 --2- 172.21.15.137:0/2422138462 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68b8159af0 0x7f68b80b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68b7e00640 1 -- 172.21.15.137:0/2422138462 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4148217749 0 0) 0x7f68b8159ed0 con 0x7f68b80b6220 2024-04-26T23:45:10.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68b7e00640 1 -- 172.21.15.137:0/2422138462 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68a0003530 con 0x7f68b80b6220 2024-04-26T23:45:10.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68b7e00640 1 -- 172.21.15.137:0/2422138462 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 251440056 0 0) 0x7f68a0003530 con 0x7f68b80b6220 2024-04-26T23:45:10.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68b7e00640 1 -- 172.21.15.137:0/2422138462 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68b8159af0 msgr2=0x7f68b80b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:10.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68b7e00640 1 --2- 172.21.15.137:0/2422138462 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68b8159af0 0x7f68b80b3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68b7e00640 1 -- 172.21.15.137:0/2422138462 >> v1:172.21.15.170:6789/0 conn(0x7f68b815c610 legacy=0x7f68b80b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68b7e00640 1 -- 172.21.15.137:0/2422138462 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b80b4cd0 con 0x7f68b80b6220 2024-04-26T23:45:10.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68b7e00640 1 -- 172.21.15.137:0/2422138462 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f68b0001a00 con 0x7f68b80b6220 2024-04-26T23:45:10.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68b7e00640 1 -- 172.21.15.137:0/2422138462 >> v1:172.21.15.137:6789/0 conn(0x7f68b80b6220 legacy=0x7f68b8072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68b7e00640 1 --2- 172.21.15.137:0/2422138462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68a00039f0 0x7f68a0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68b7e00640 1 --2- 172.21.15.137:0/2422138462 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68b8159af0 0x7f68a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68b7e00640 1 --2- 172.21.15.137:0/2422138462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68a0004d50 0x7f68a00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68b7e00640 1 -- 172.21.15.137:0/2422138462 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f68b80b49f0 con 0x7f68a0004d50 2024-04-26T23:45:10.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68b7e00640 1 -- 172.21.15.137:0/2422138462 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f68a000bb00 con 0x7f68a00039f0 2024-04-26T23:45:10.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68b7e00640 1 -- 172.21.15.137:0/2422138462 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f68a000bd00 con 0x7f68b8159af0 2024-04-26T23:45:10.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68be400640 1 --2- 172.21.15.137:0/2422138462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68a0004d50 0x7f68a00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68bda00640 1 --2- 172.21.15.137:0/2422138462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68a00039f0 0x7f68a0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68bd000640 1 --2- 172.21.15.137:0/2422138462 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68b8159af0 0x7f68a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68be400640 1 -- 172.21.15.137:0/2422138462 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68b8159af0 msgr2=0x7f68a0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:10.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68be400640 1 --2- 172.21.15.137:0/2422138462 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68b8159af0 0x7f68a0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68be400640 1 -- 172.21.15.137:0/2422138462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68a00039f0 msgr2=0x7f68a0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:10.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68be400640 1 --2- 172.21.15.137:0/2422138462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68a00039f0 0x7f68a0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.225+0000 7f68be400640 1 -- 172.21.15.137:0/2422138462 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a0003530 con 0x7f68a0004d50 2024-04-26T23:45:10.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.229+0000 7f68be400640 1 --2- 172.21.15.137:0/2422138462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68a0004d50 0x7f68a00051d0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f68b000a810 tx=0x7f68b001faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d79b59ded1f0b9e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:10.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.229+0000 7f68b7e00640 1 -- 172.21.15.137:0/2422138462 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b000a460 con 0x7f68a0004d50 2024-04-26T23:45:10.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.229+0000 7f68b7e00640 1 -- 172.21.15.137:0/2422138462 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68b00aa6f0 con 0x7f68a0004d50 2024-04-26T23:45:10.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.229+0000 7f68b7e00640 1 -- 172.21.15.137:0/2422138462 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b00aaae0 con 0x7f68a0004d50 2024-04-26T23:45:10.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.229+0000 7f68c0400640 1 -- 172.21.15.137:0/2422138462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68a0004d50 msgr2=0x7f68a00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.229+0000 7f68c0400640 1 --2- 172.21.15.137:0/2422138462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68a0004d50 0x7f68a00051d0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f68b000a810 tx=0x7f68b001faa0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.229+0000 7f68be400640 1 -- 172.21.15.137:0/2422138462 reap_dead start 2024-04-26T23:45:10.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.229+0000 7f68c0400640 1 -- 172.21.15.137:0/2422138462 shutdown_connections 2024-04-26T23:45:10.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.229+0000 7f68c0400640 1 -- 172.21.15.137:0/2422138462 >> 172.21.15.137:0/2422138462 conn(0x7f68b80d0d10 msgr2=0x7f68b80d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:10.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.229+0000 7f68c0400640 1 -- 172.21.15.137:0/2422138462 shutdown_connections 2024-04-26T23:45:10.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.229+0000 7f68c0400640 1 -- 172.21.15.137:0/2422138462 wait complete. 2024-04-26T23:45:10.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68c0400640 1 Processor -- start 2024-04-26T23:45:10.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68c0400640 1 -- start start 2024-04-26T23:45:10.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68c0400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68a0004d50 0x7f68b8154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68c0400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68b8153e60 0x7f68b815fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68c0400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68b814c2a0 0x7f68b814c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68c0400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f68b80b3dc0 con 0x7f68b814c2a0 2024-04-26T23:45:10.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68c0400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f68b8072160 con 0x7f68b8153e60 2024-04-26T23:45:10.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68c0400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f68b80b3f40 con 0x7f68a0004d50 2024-04-26T23:45:10.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68be400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68b814c2a0 0x7f68b814c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68be400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68b814c2a0 0x7f68b814c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35570/0 (socket says 172.21.15.137:35570) 2024-04-26T23:45:10.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68be400640 1 -- 172.21.15.137:0/1007774573 learned_addr learned my addr 172.21.15.137:0/1007774573 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:10.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68bda00640 1 --2- 172.21.15.137:0/1007774573 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68a0004d50 0x7f68b8154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68bd000640 1 --2- 172.21.15.137:0/1007774573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68b8153e60 0x7f68b815fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68be400640 1 -- 172.21.15.137:0/1007774573 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68a0004d50 msgr2=0x7f68b8154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68be400640 1 --2- 172.21.15.137:0/1007774573 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68a0004d50 0x7f68b8154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68be400640 1 -- 172.21.15.137:0/1007774573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68b8153e60 msgr2=0x7f68b815fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68be400640 1 --2- 172.21.15.137:0/1007774573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68b8153e60 0x7f68b815fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68be400640 1 -- 172.21.15.137:0/1007774573 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b81553f0 con 0x7f68b814c2a0 2024-04-26T23:45:10.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68be400640 1 --2- 172.21.15.137:0/1007774573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68b814c2a0 0x7f68b814c710 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f68b000a810 tx=0x7f68a0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:10.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68b5600640 1 -- 172.21.15.137:0/1007774573 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b00b7070 con 0x7f68b814c2a0 2024-04-26T23:45:10.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68b5600640 1 -- 172.21.15.137:0/1007774573 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68b00011d0 con 0x7f68b814c2a0 2024-04-26T23:45:10.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68c0400640 1 -- 172.21.15.137:0/1007774573 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b815d780 con 0x7f68b814c2a0 2024-04-26T23:45:10.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68b5600640 1 -- 172.21.15.137:0/1007774573 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b0001fc0 con 0x7f68b814c2a0 2024-04-26T23:45:10.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68c0400640 1 -- 172.21.15.137:0/1007774573 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b8155030 con 0x7f68b814c2a0 2024-04-26T23:45:10.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.233+0000 7f68c0400640 1 -- 172.21.15.137:0/1007774573 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f68b815d5d0 con 0x7f68b814c2a0 2024-04-26T23:45:10.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.237+0000 7f68b5600640 1 -- 172.21.15.137:0/1007774573 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f68b00aaaa0 con 0x7f68b814c2a0 2024-04-26T23:45:10.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.237+0000 7f68b5600640 1 --2- 172.21.15.137:0/1007774573 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6898068380 0x7f689806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.237+0000 7f68b5600640 1 -- 172.21.15.137:0/1007774573 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7f68b01242c0 con 0x7f68b814c2a0 2024-04-26T23:45:10.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.237+0000 7f68bda00640 1 --2- 172.21.15.137:0/1007774573 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6898068380 0x7f689806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.237+0000 7f68b5600640 1 --2- 172.21.15.137:0/1007774573 >> [v2:172.21.15.137:6800/4056840582,v1:172.21.15.137:6801/4056840582] conn(0x7f689806e240 0x7f6898070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.237+0000 7f68b5600640 1 -- 172.21.15.137:0/1007774573 --> [v2:172.21.15.137:6800/4056840582,v1:172.21.15.137:6801/4056840582] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68b00059d0 con 0x7f689806e240 2024-04-26T23:45:10.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.237+0000 7f68b5600640 1 -- 172.21.15.137:0/1007774573 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f68b0124670 con 0x7f68b814c2a0 2024-04-26T23:45:10.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.237+0000 7f68bd000640 1 --2- 172.21.15.137:0/1007774573 >> [v2:172.21.15.137:6800/4056840582,v1:172.21.15.137:6801/4056840582] conn(0x7f689806e240 0x7f6898070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.237+0000 7f68bda00640 1 --2- 172.21.15.137:0/1007774573 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6898068380 0x7f689806a840 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009b20 tx=0x7f68ac008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:10.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.237+0000 7f68bd000640 1 --2- 172.21.15.137:0/1007774573 >> [v2:172.21.15.137:6800/4056840582,v1:172.21.15.137:6801/4056840582] conn(0x7f689806e240 0x7f6898070660 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:10.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.237+0000 7f68b5600640 1 -- 172.21.15.137:0/1007774573 <== osd.2 v2:172.21.15.137:6800/4056840582 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f68b00059d0 con 0x7f689806e240 2024-04-26T23:45:10.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.253+0000 7f68c0400640 1 -- 172.21.15.137:0/1007774573 --> [v2:172.21.15.137:6800/4056840582,v1:172.21.15.137:6801/4056840582] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f68b81556d0 con 0x7f689806e240 2024-04-26T23:45:10.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.253+0000 7f68b5600640 1 -- 172.21.15.137:0/1007774573 <== osd.2 v2:172.21.15.137:6800/4056840582 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f68a4003600 con 0x7f689806e240 2024-04-26T23:45:10.256 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:45:10.256 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:45:10.256 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:45:10.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.253+0000 7f68c0400640 1 -- 172.21.15.137:0/1007774573 >> [v2:172.21.15.137:6800/4056840582,v1:172.21.15.137:6801/4056840582] conn(0x7f689806e240 msgr2=0x7f6898070660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.253+0000 7f68c0400640 1 --2- 172.21.15.137:0/1007774573 >> [v2:172.21.15.137:6800/4056840582,v1:172.21.15.137:6801/4056840582] conn(0x7f689806e240 0x7f6898070660 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.253+0000 7f68c0400640 1 -- 172.21.15.137:0/1007774573 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6898068380 msgr2=0x7f689806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.253+0000 7f68c0400640 1 --2- 172.21.15.137:0/1007774573 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f6898068380 0x7f689806a840 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009b20 tx=0x7f68ac008040 comp rx=0 tx=0).stop 2024-04-26T23:45:10.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.253+0000 7f68c0400640 1 -- 172.21.15.137:0/1007774573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68b814c2a0 msgr2=0x7f68b814c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.253+0000 7f68c0400640 1 --2- 172.21.15.137:0/1007774573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68b814c2a0 0x7f68b814c710 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f68b000a810 tx=0x7f68a0005840 comp rx=0 tx=0).stop 2024-04-26T23:45:10.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.253+0000 7f68be400640 1 -- 172.21.15.137:0/1007774573 reap_dead start 2024-04-26T23:45:10.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.253+0000 7f68c0400640 1 -- 172.21.15.137:0/1007774573 shutdown_connections 2024-04-26T23:45:10.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.253+0000 7f68c0400640 1 -- 172.21.15.137:0/1007774573 >> 172.21.15.137:0/1007774573 conn(0x7f68b80d0d10 msgr2=0x7f68b806ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:10.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.253+0000 7f68c0400640 1 -- 172.21.15.137:0/1007774573 shutdown_connections 2024-04-26T23:45:10.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.253+0000 7f68c0400640 1 -- 172.21.15.137:0/1007774573 wait complete. 2024-04-26T23:45:10.275 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T23:45:10.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0dbca00640 1 Processor -- start 2024-04-26T23:45:10.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0dbca00640 1 -- start start 2024-04-26T23:45:10.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0dbca00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0db8072050 0x7f0db80cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0dbca00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0db80cda80 0x7f0db80b5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0dbca00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0db80b4a50 con 0x7f0db8146930 2024-04-26T23:45:10.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0dbca00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0db80cdef0 con 0x7f0db80cda80 2024-04-26T23:45:10.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0dbca00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0db80b4d80 con 0x7f0db8072050 2024-04-26T23:45:10.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db6800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f0db8146930 0x7f0db80cea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40634/0 (socket says 172.21.15.137:40634) 2024-04-26T23:45:10.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db6800640 1 -- 172.21.15.137:0/2346586289 learned_addr learned my addr 172.21.15.137:0/2346586289 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:45:10.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5400640 1 -- 172.21.15.137:0/2346586289 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2264496455 0 0) 0x7f0db80b4a50 con 0x7f0db8146930 2024-04-26T23:45:10.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5400640 1 -- 172.21.15.137:0/2346586289 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d9c003530 con 0x7f0db8146930 2024-04-26T23:45:10.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5e00640 1 --2- 172.21.15.137:0/2346586289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0db8072050 0x7f0db80cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db7200640 1 --2- 172.21.15.137:0/2346586289 >> v2:172.21.15.170:3300/0 conn(0x7f0db80cda80 0x7f0db80b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5400640 1 -- 172.21.15.137:0/2346586289 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2653780291 0 0) 0x7f0d9c003530 con 0x7f0db8146930 2024-04-26T23:45:10.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5400640 1 -- 172.21.15.137:0/2346586289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0db8072050 msgr2=0x7f0db80cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:10.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5400640 1 --2- 172.21.15.137:0/2346586289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0db8072050 0x7f0db80cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5400640 1 -- 172.21.15.137:0/2346586289 >> v2:172.21.15.170:3300/0 conn(0x7f0db80cda80 msgr2=0x7f0db80b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:10.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5400640 1 --2- 172.21.15.137:0/2346586289 >> v2:172.21.15.170:3300/0 conn(0x7f0db80cda80 0x7f0db80b5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5400640 1 -- 172.21.15.137:0/2346586289 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db80cf480 con 0x7f0db8146930 2024-04-26T23:45:10.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5400640 1 -- 172.21.15.137:0/2346586289 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f0da8001680 con 0x7f0db8146930 2024-04-26T23:45:10.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5400640 1 -- 172.21.15.137:0/2346586289 >> v1:172.21.15.137:6789/0 conn(0x7f0db8146930 legacy=0x7f0db80cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5400640 1 --2- 172.21.15.137:0/2346586289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d9c0039c0 0x7f0d9c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5400640 1 --2- 172.21.15.137:0/2346586289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d9c004810 0x7f0d9c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5400640 1 --2- 172.21.15.137:0/2346586289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d9c0051d0 0x7f0d9c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5400640 1 -- 172.21.15.137:0/2346586289 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0db80cdef0 con 0x7f0d9c004810 2024-04-26T23:45:10.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5400640 1 -- 172.21.15.137:0/2346586289 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0db80b4d80 con 0x7f0d9c0051d0 2024-04-26T23:45:10.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5400640 1 -- 172.21.15.137:0/2346586289 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0d9c00c010 con 0x7f0d9c0039c0 2024-04-26T23:45:10.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5e00640 1 --2- 172.21.15.137:0/2346586289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d9c004810 0x7f0d9c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db6800640 1 --2- 172.21.15.137:0/2346586289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d9c0039c0 0x7f0d9c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db7200640 1 --2- 172.21.15.137:0/2346586289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d9c0051d0 0x7f0d9c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5e00640 1 -- 172.21.15.137:0/2346586289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d9c0039c0 msgr2=0x7f0d9c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:10.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5e00640 1 --2- 172.21.15.137:0/2346586289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d9c0039c0 0x7f0d9c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5e00640 1 -- 172.21.15.137:0/2346586289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d9c0051d0 msgr2=0x7f0d9c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:10.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5e00640 1 --2- 172.21.15.137:0/2346586289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d9c0051d0 0x7f0d9c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db5e00640 1 -- 172.21.15.137:0/2346586289 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c003530 con 0x7f0d9c004810 2024-04-26T23:45:10.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.409+0000 7f0db7200640 1 --2- 172.21.15.137:0/2346586289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d9c0051d0 0x7f0d9c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:10.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.413+0000 7f0db5e00640 1 --2- 172.21.15.137:0/2346586289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d9c004810 0x7f0d9c004c90 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f0db8072470 tx=0x7f0da401c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cadd1117c3a957de server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:10.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.413+0000 7f0db5400640 1 -- 172.21.15.137:0/2346586289 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da40aa070 con 0x7f0d9c004810 2024-04-26T23:45:10.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.413+0000 7f0db5400640 1 -- 172.21.15.137:0/2346586289 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0da40a4750 con 0x7f0d9c004810 2024-04-26T23:45:10.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.413+0000 7f0db5400640 1 -- 172.21.15.137:0/2346586289 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da400b550 con 0x7f0d9c004810 2024-04-26T23:45:10.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.413+0000 7f0dbca00640 1 -- 172.21.15.137:0/2346586289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d9c004810 msgr2=0x7f0d9c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.413+0000 7f0dbca00640 1 --2- 172.21.15.137:0/2346586289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d9c004810 0x7f0d9c004c90 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f0db8072470 tx=0x7f0da401c220 comp rx=0 tx=0).stop 2024-04-26T23:45:10.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.413+0000 7f0db7200640 1 -- 172.21.15.137:0/2346586289 reap_dead start 2024-04-26T23:45:10.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.413+0000 7f0dbca00640 1 -- 172.21.15.137:0/2346586289 shutdown_connections 2024-04-26T23:45:10.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.413+0000 7f0dbca00640 1 -- 172.21.15.137:0/2346586289 >> 172.21.15.137:0/2346586289 conn(0x7f0db80b2e60 msgr2=0x7f0db80d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:10.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.413+0000 7f0dbca00640 1 -- 172.21.15.137:0/2346586289 shutdown_connections 2024-04-26T23:45:10.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.413+0000 7f0dbca00640 1 -- 172.21.15.137:0/2346586289 wait complete. 2024-04-26T23:45:10.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0dbca00640 1 Processor -- start 2024-04-26T23:45:10.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0dbca00640 1 -- start start 2024-04-26T23:45:10.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0dbca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d9c004810 0x7f0db806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0dbca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0db8144ae0 0x7f0db81411b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0dbca00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0db8144f60 0x7f0db81416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0dbca00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0db815d8b0 con 0x7f0d9c004810 2024-04-26T23:45:10.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0dbca00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0db815d730 con 0x7f0db8144ae0 2024-04-26T23:45:10.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0dbca00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0db80b5b60 con 0x7f0db8144f60 2024-04-26T23:45:10.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0db6800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d9c004810 0x7f0db806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0db6800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d9c004810 0x7f0db806f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35584/0 (socket says 172.21.15.137:35584) 2024-04-26T23:45:10.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0db6800640 1 -- 172.21.15.137:0/3487969845 learned_addr learned my addr 172.21.15.137:0/3487969845 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:10.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0db7200640 1 --2- 172.21.15.137:0/3487969845 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0db8144f60 0x7f0db81416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0db5e00640 1 --2- 172.21.15.137:0/3487969845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0db8144ae0 0x7f0db81411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0db6800640 1 -- 172.21.15.137:0/3487969845 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0db8144f60 msgr2=0x7f0db81416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0db6800640 1 --2- 172.21.15.137:0/3487969845 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0db8144f60 0x7f0db81416f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0db6800640 1 -- 172.21.15.137:0/3487969845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0db8144ae0 msgr2=0x7f0db81411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0db6800640 1 --2- 172.21.15.137:0/3487969845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0db8144ae0 0x7f0db81411b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0db6800640 1 -- 172.21.15.137:0/3487969845 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db81454c0 con 0x7f0d9c004810 2024-04-26T23:45:10.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0db6800640 1 --2- 172.21.15.137:0/3487969845 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d9c004810 0x7f0db806f080 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f0da8012510 tx=0x7f0da80129d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:10.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0daea00640 1 -- 172.21.15.137:0/3487969845 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da801c070 con 0x7f0d9c004810 2024-04-26T23:45:10.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0daea00640 1 -- 172.21.15.137:0/3487969845 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0da8014830 con 0x7f0d9c004810 2024-04-26T23:45:10.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0dbca00640 1 -- 172.21.15.137:0/3487969845 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db81457a0 con 0x7f0d9c004810 2024-04-26T23:45:10.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0daea00640 1 -- 172.21.15.137:0/3487969845 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da8014c20 con 0x7f0d9c004810 2024-04-26T23:45:10.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.417+0000 7f0dbca00640 1 -- 172.21.15.137:0/3487969845 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db8145d60 con 0x7f0d9c004810 2024-04-26T23:45:10.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.421+0000 7f0dbca00640 1 -- 172.21.15.137:0/3487969845 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0db81460a0 con 0x7f0d9c004810 2024-04-26T23:45:10.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.421+0000 7f0daea00640 1 -- 172.21.15.137:0/3487969845 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0da801f070 con 0x7f0d9c004810 2024-04-26T23:45:10.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.421+0000 7f0daea00640 1 --2- 172.21.15.137:0/3487969845 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0d980683b0 0x7f0d9806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.421+0000 7f0daea00640 1 -- 172.21.15.137:0/3487969845 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7f0da8089010 con 0x7f0d9c004810 2024-04-26T23:45:10.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.421+0000 7f0db5e00640 1 --2- 172.21.15.137:0/3487969845 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0d980683b0 0x7f0d9806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.421+0000 7f0db5e00640 1 --2- 172.21.15.137:0/3487969845 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0d980683b0 0x7f0d9806a870 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0da40af000 tx=0x7f0da40046d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:10.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.425+0000 7f0daea00640 1 -- 172.21.15.137:0/3487969845 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0db81460a0 con 0x7f0d9c004810 2024-04-26T23:45:10.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.585+0000 7f0dbca00640 1 -- 172.21.15.137:0/3487969845 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f0db80767d0 con 0x7f0d980683b0 2024-04-26T23:45:10.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.585+0000 7f0daea00640 1 -- 172.21.15.137:0/3487969845 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0db80767d0 con 0x7f0d980683b0 2024-04-26T23:45:10.588 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T23:45:10.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.585+0000 7f0dbca00640 1 -- 172.21.15.137:0/3487969845 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0d980683b0 msgr2=0x7f0d9806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.585+0000 7f0dbca00640 1 --2- 172.21.15.137:0/3487969845 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0d980683b0 0x7f0d9806a870 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0da40af000 tx=0x7f0da40046d0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.585+0000 7f0dbca00640 1 -- 172.21.15.137:0/3487969845 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d9c004810 msgr2=0x7f0db806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.585+0000 7f0dbca00640 1 --2- 172.21.15.137:0/3487969845 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d9c004810 0x7f0db806f080 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f0da8012510 tx=0x7f0da80129d0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.585+0000 7f0dbca00640 1 -- 172.21.15.137:0/3487969845 shutdown_connections 2024-04-26T23:45:10.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.585+0000 7f0dbca00640 1 --2- 172.21.15.137:0/3487969845 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f0d980683b0 0x7f0d9806a870 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.585+0000 7f0dbca00640 1 --2- 172.21.15.137:0/3487969845 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0db8144f60 0x7f0db81416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.585+0000 7f0dbca00640 1 --2- 172.21.15.137:0/3487969845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0db8144ae0 0x7f0db81411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.585+0000 7f0dbca00640 1 --2- 172.21.15.137:0/3487969845 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d9c004810 0x7f0db806f080 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.585+0000 7f0dbca00640 1 -- 172.21.15.137:0/3487969845 >> 172.21.15.137:0/3487969845 conn(0x7f0db80b2e60 msgr2=0x7f0db815da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:10.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.585+0000 7f0dbca00640 1 -- 172.21.15.137:0/3487969845 shutdown_connections 2024-04-26T23:45:10.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.585+0000 7f0dbca00640 1 -- 172.21.15.137:0/3487969845 wait complete. 2024-04-26T23:45:10.610 INFO:tasks.ceph:Scrubbing osd.3 2024-04-26T23:45:10.610 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:45:10.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.749+0000 7f3f91600640 1 Processor -- start 2024-04-26T23:45:10.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.749+0000 7f3f91600640 1 -- start start 2024-04-26T23:45:10.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.749+0000 7f3f91600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3f8c1431e0 0x7f3f8c160af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.749+0000 7f3f91600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3f8c161030 0x7f3f8c06e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.749+0000 7f3f91600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f8c0cfde0 con 0x7f3f8c13fe00 2024-04-26T23:45:10.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.749+0000 7f3f91600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3f8c143610 con 0x7f3f8c1431e0 2024-04-26T23:45:10.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.749+0000 7f3f91600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f3f8c0d00c0 con 0x7f3f8c161030 2024-04-26T23:45:10.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.749+0000 7f3f83e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3f8c1431e0 0x7f3f8c160af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.749+0000 7f3f83e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3f8c1431e0 0x7f3f8c160af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35594/0 (socket says 172.21.15.137:35594) 2024-04-26T23:45:10.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.749+0000 7f3f83e00640 1 -- 172.21.15.137:0/2649283007 learned_addr learned my addr 172.21.15.137:0/2649283007 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:10.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.749+0000 7f3f8b400640 1 --2- 172.21.15.137:0/2649283007 >> v2:172.21.15.170:3300/0 conn(0x7f3f8c161030 0x7f3f8c06e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.749+0000 7f3f83e00640 1 -- 172.21.15.137:0/2649283007 >> v2:172.21.15.170:3300/0 conn(0x7f3f8c161030 msgr2=0x7f3f8c06e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:10.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.749+0000 7f3f83e00640 1 --2- 172.21.15.137:0/2649283007 >> v2:172.21.15.170:3300/0 conn(0x7f3f8c161030 0x7f3f8c06e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.749+0000 7f3f83e00640 1 -- 172.21.15.137:0/2649283007 >> v1:172.21.15.170:6789/0 conn(0x7f3f8c13fe00 legacy=0x7f3f8c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:10.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.749+0000 7f3f83e00640 1 -- 172.21.15.137:0/2649283007 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8c0d03a0 con 0x7f3f8c1431e0 2024-04-26T23:45:10.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.753+0000 7f3f83e00640 1 --2- 172.21.15.137:0/2649283007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f8c1431e0 0x7f3f8c160af0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0ce1d0 tx=0x7f3f7401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57dc0e5380f23f5b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:10.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.753+0000 7f3f8a000640 1 -- 172.21.15.137:0/2649283007 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f740b0070 con 0x7f3f8c1431e0 2024-04-26T23:45:10.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.753+0000 7f3f8a000640 1 -- 172.21.15.137:0/2649283007 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f740ab600 con 0x7f3f8c1431e0 2024-04-26T23:45:10.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.753+0000 7f3f8a000640 1 -- 172.21.15.137:0/2649283007 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f740ab9d0 con 0x7f3f8c1431e0 2024-04-26T23:45:10.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.753+0000 7f3f91600640 1 -- 172.21.15.137:0/2649283007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f8c1431e0 msgr2=0x7f3f8c160af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.753+0000 7f3f91600640 1 --2- 172.21.15.137:0/2649283007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f8c1431e0 0x7f3f8c160af0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0ce1d0 tx=0x7f3f7401c520 comp rx=0 tx=0).stop 2024-04-26T23:45:10.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.753+0000 7f3f91600640 1 -- 172.21.15.137:0/2649283007 shutdown_connections 2024-04-26T23:45:10.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.753+0000 7f3f91600640 1 --2- 172.21.15.137:0/2649283007 >> v2:172.21.15.170:3300/0 conn(0x7f3f8c161030 0x7f3f8c06e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.753+0000 7f3f91600640 1 --2- 172.21.15.137:0/2649283007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f8c1431e0 0x7f3f8c160af0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.753+0000 7f3f91600640 1 -- 172.21.15.137:0/2649283007 >> 172.21.15.137:0/2649283007 conn(0x7f3f8c0d0d10 msgr2=0x7f3f8c0d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:10.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.753+0000 7f3f91600640 1 -- 172.21.15.137:0/2649283007 shutdown_connections 2024-04-26T23:45:10.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.753+0000 7f3f91600640 1 -- 172.21.15.137:0/2649283007 wait complete. 2024-04-26T23:45:10.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f91600640 1 Processor -- start 2024-04-26T23:45:10.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f91600640 1 -- start start 2024-04-26T23:45:10.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f91600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f8c13fe00 0x7f3f8c137410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f91600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f8c1431e0 0x7f3f8c13a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f91600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f8c161030 0x7f3f8c13f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f91600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c06f480 con 0x7f3f8c1431e0 2024-04-26T23:45:10.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f91600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c06f300 con 0x7f3f8c13fe00 2024-04-26T23:45:10.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f91600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3f8c06f600 con 0x7f3f8c161030 2024-04-26T23:45:10.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f83e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f8c1431e0 0x7f3f8c13a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f83e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f8c1431e0 0x7f3f8c13a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35606/0 (socket says 172.21.15.137:35606) 2024-04-26T23:45:10.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f83e00640 1 -- 172.21.15.137:0/3867240557 learned_addr learned my addr 172.21.15.137:0/3867240557 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:10.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f8aa00640 1 --2- 172.21.15.137:0/3867240557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f8c13fe00 0x7f3f8c137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f8b400640 1 --2- 172.21.15.137:0/3867240557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f8c161030 0x7f3f8c13f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f83e00640 1 -- 172.21.15.137:0/3867240557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f8c161030 msgr2=0x7f3f8c13f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f83e00640 1 --2- 172.21.15.137:0/3867240557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f8c161030 0x7f3f8c13f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f83e00640 1 -- 172.21.15.137:0/3867240557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f8c13fe00 msgr2=0x7f3f8c137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f83e00640 1 --2- 172.21.15.137:0/3867240557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f8c13fe00 0x7f3f8c137410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f83e00640 1 -- 172.21.15.137:0/3867240557 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8c150de0 con 0x7f3f8c1431e0 2024-04-26T23:45:10.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f83e00640 1 --2- 172.21.15.137:0/3867240557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f8c1431e0 0x7f3f8c13a8b0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f3f7401ca00 tx=0x7f3f740192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:10.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f82a00640 1 -- 172.21.15.137:0/3867240557 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f740b0040 con 0x7f3f8c1431e0 2024-04-26T23:45:10.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f82a00640 1 -- 172.21.15.137:0/3867240557 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f740b9070 con 0x7f3f8c1431e0 2024-04-26T23:45:10.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f82a00640 1 -- 172.21.15.137:0/3867240557 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f740b4660 con 0x7f3f8c1431e0 2024-04-26T23:45:10.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f91600640 1 -- 172.21.15.137:0/3867240557 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f8c1510c0 con 0x7f3f8c1431e0 2024-04-26T23:45:10.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.757+0000 7f3f91600640 1 -- 172.21.15.137:0/3867240557 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f8c151680 con 0x7f3f8c1431e0 2024-04-26T23:45:10.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.761+0000 7f3f91600640 1 -- 172.21.15.137:0/3867240557 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3f8c06a2a0 con 0x7f3f8c1431e0 2024-04-26T23:45:10.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.761+0000 7f3f82a00640 1 -- 172.21.15.137:0/3867240557 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3f740b4800 con 0x7f3f8c1431e0 2024-04-26T23:45:10.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.761+0000 7f3f82a00640 1 --2- 172.21.15.137:0/3867240557 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3f68068380 0x7f3f6806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.761+0000 7f3f82a00640 1 -- 172.21.15.137:0/3867240557 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7f3f74120c90 con 0x7f3f8c1431e0 2024-04-26T23:45:10.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.761+0000 7f3f8aa00640 1 --2- 172.21.15.137:0/3867240557 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3f68068380 0x7f3f6806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.761+0000 7f3f82a00640 1 --2- 172.21.15.137:0/3867240557 >> [v2:172.21.15.137:6816/2945054112,v1:172.21.15.137:6817/2945054112] conn(0x7f3f6806e240 0x7f3f68070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.761+0000 7f3f82a00640 1 -- 172.21.15.137:0/3867240557 --> [v2:172.21.15.137:6816/2945054112,v1:172.21.15.137:6817/2945054112] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f7400af30 con 0x7f3f6806e240 2024-04-26T23:45:10.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.761+0000 7f3f82a00640 1 -- 172.21.15.137:0/3867240557 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f3f74121080 con 0x7f3f8c1431e0 2024-04-26T23:45:10.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.761+0000 7f3f8b400640 1 --2- 172.21.15.137:0/3867240557 >> [v2:172.21.15.137:6816/2945054112,v1:172.21.15.137:6817/2945054112] conn(0x7f3f6806e240 0x7f3f68070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.761+0000 7f3f8aa00640 1 --2- 172.21.15.137:0/3867240557 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3f68068380 0x7f3f6806a840 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c1672d0 tx=0x7f3f7c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:10.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.761+0000 7f3f8b400640 1 --2- 172.21.15.137:0/3867240557 >> [v2:172.21.15.137:6816/2945054112,v1:172.21.15.137:6817/2945054112] conn(0x7f3f6806e240 0x7f3f68070660 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:10.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.765+0000 7f3f82a00640 1 -- 172.21.15.137:0/3867240557 <== osd.3 v2:172.21.15.137:6816/2945054112 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3f7400af30 con 0x7f3f6806e240 2024-04-26T23:45:10.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.777+0000 7f3f91600640 1 -- 172.21.15.137:0/3867240557 --> [v2:172.21.15.137:6816/2945054112,v1:172.21.15.137:6817/2945054112] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3f8c0b4510 con 0x7f3f6806e240 2024-04-26T23:45:10.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.777+0000 7f3f82a00640 1 -- 172.21.15.137:0/3867240557 <== osd.3 v2:172.21.15.137:6816/2945054112 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3f8c0b4510 con 0x7f3f6806e240 2024-04-26T23:45:10.781 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:45:10.781 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:45:10.781 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:45:10.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.777+0000 7f3f91600640 1 -- 172.21.15.137:0/3867240557 >> [v2:172.21.15.137:6816/2945054112,v1:172.21.15.137:6817/2945054112] conn(0x7f3f6806e240 msgr2=0x7f3f68070660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.777+0000 7f3f91600640 1 --2- 172.21.15.137:0/3867240557 >> [v2:172.21.15.137:6816/2945054112,v1:172.21.15.137:6817/2945054112] conn(0x7f3f6806e240 0x7f3f68070660 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.777+0000 7f3f91600640 1 -- 172.21.15.137:0/3867240557 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3f68068380 msgr2=0x7f3f6806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.777+0000 7f3f91600640 1 --2- 172.21.15.137:0/3867240557 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f3f68068380 0x7f3f6806a840 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c1672d0 tx=0x7f3f7c009040 comp rx=0 tx=0).stop 2024-04-26T23:45:10.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.777+0000 7f3f91600640 1 -- 172.21.15.137:0/3867240557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f8c1431e0 msgr2=0x7f3f8c13a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.777+0000 7f3f91600640 1 --2- 172.21.15.137:0/3867240557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f8c1431e0 0x7f3f8c13a8b0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f3f7401ca00 tx=0x7f3f740192c0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.777+0000 7f3f8b400640 1 -- 172.21.15.137:0/3867240557 reap_dead start 2024-04-26T23:45:10.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.777+0000 7f3f91600640 1 -- 172.21.15.137:0/3867240557 shutdown_connections 2024-04-26T23:45:10.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.777+0000 7f3f91600640 1 -- 172.21.15.137:0/3867240557 >> 172.21.15.137:0/3867240557 conn(0x7f3f8c0d0d10 msgr2=0x7f3f8c0b4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:10.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.777+0000 7f3f91600640 1 -- 172.21.15.137:0/3867240557 shutdown_connections 2024-04-26T23:45:10.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.777+0000 7f3f91600640 1 -- 172.21.15.137:0/3867240557 wait complete. 2024-04-26T23:45:10.800 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-26T23:45:10.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.933+0000 7f30ca000640 1 Processor -- start 2024-04-26T23:45:10.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.933+0000 7f30ca000640 1 -- start start 2024-04-26T23:45:10.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.933+0000 7f30ca000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f30c4145730 0x7f30c40735f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.933+0000 7f30ca000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30c40b3e30 0x7f30c40ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.933+0000 7f30ca000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f30c40ceb20 0x7f30c406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.933+0000 7f30ca000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f30c40b5000 con 0x7f30c4145730 2024-04-26T23:45:10.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.933+0000 7f30ca000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f30c40b43f0 con 0x7f30c40ceb20 2024-04-26T23:45:10.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.933+0000 7f30ca000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f30c40b46d0 con 0x7f30c40b3e30 2024-04-26T23:45:10.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.933+0000 7f30c3400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f30c4145730 0x7f30c40735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.933+0000 7f30c3400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f30c4145730 0x7f30c40735f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58590/0 (socket says 172.21.15.137:58590) 2024-04-26T23:45:10.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.933+0000 7f30c3400640 1 -- 172.21.15.137:0/4054433601 learned_addr learned my addr 172.21.15.137:0/4054433601 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:10.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.933+0000 7f30baa00640 1 --2- 172.21.15.137:0/4054433601 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30c40b3e30 0x7f30c40ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.933+0000 7f30c3e00640 1 --2- 172.21.15.137:0/4054433601 >> v2:172.21.15.170:3300/0 conn(0x7f30c40ceb20 0x7f30c406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.933+0000 7f30c3400640 1 -- 172.21.15.137:0/4054433601 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30c40b3e30 msgr2=0x7f30c40ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:10.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.933+0000 7f30c3400640 1 --2- 172.21.15.137:0/4054433601 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30c40b3e30 0x7f30c40ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.933+0000 7f30c3400640 1 -- 172.21.15.137:0/4054433601 >> v2:172.21.15.170:3300/0 conn(0x7f30c40ceb20 msgr2=0x7f30c406f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:10.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.933+0000 7f30c3400640 1 --2- 172.21.15.137:0/4054433601 >> v2:172.21.15.170:3300/0 conn(0x7f30c40ceb20 0x7f30c406f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.933+0000 7f30c3400640 1 -- 172.21.15.137:0/4054433601 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c40b49b0 con 0x7f30c4145730 2024-04-26T23:45:10.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.933+0000 7f30c3e00640 1 --2- 172.21.15.137:0/4054433601 >> v2:172.21.15.170:3300/0 conn(0x7f30c40ceb20 0x7f30c406f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:10.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.937+0000 7f30c3400640 1 --2- 172.21.15.137:0/4054433601 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30c4145730 0x7f30c40735f0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f30c40b4f70 tx=0x7f30b401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9a546d27d0e095 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:10.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.937+0000 7f30c2a00640 1 -- 172.21.15.137:0/4054433601 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b40b0070 con 0x7f30c4145730 2024-04-26T23:45:10.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.937+0000 7f30c2a00640 1 -- 172.21.15.137:0/4054433601 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b40ab600 con 0x7f30c4145730 2024-04-26T23:45:10.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.937+0000 7f30c2a00640 1 -- 172.21.15.137:0/4054433601 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b40ab9d0 con 0x7f30c4145730 2024-04-26T23:45:10.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.937+0000 7f30ca000640 1 -- 172.21.15.137:0/4054433601 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30c4145730 msgr2=0x7f30c40735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.937+0000 7f30ca000640 1 --2- 172.21.15.137:0/4054433601 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30c4145730 0x7f30c40735f0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f30c40b4f70 tx=0x7f30b401c520 comp rx=0 tx=0).stop 2024-04-26T23:45:10.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.937+0000 7f30ca000640 1 -- 172.21.15.137:0/4054433601 shutdown_connections 2024-04-26T23:45:10.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.937+0000 7f30ca000640 1 --2- 172.21.15.137:0/4054433601 >> v2:172.21.15.170:3300/0 conn(0x7f30c40ceb20 0x7f30c406f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.937+0000 7f30ca000640 1 --2- 172.21.15.137:0/4054433601 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30c40b3e30 0x7f30c40ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.937+0000 7f30ca000640 1 --2- 172.21.15.137:0/4054433601 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30c4145730 0x7f30c40735f0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.937+0000 7f30ca000640 1 -- 172.21.15.137:0/4054433601 >> 172.21.15.137:0/4054433601 conn(0x7f30c406c560 msgr2=0x7f30c406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:10.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.937+0000 7f30ca000640 1 -- 172.21.15.137:0/4054433601 shutdown_connections 2024-04-26T23:45:10.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.937+0000 7f30ca000640 1 -- 172.21.15.137:0/4054433601 wait complete. 2024-04-26T23:45:10.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.937+0000 7f30ca000640 1 Processor -- start 2024-04-26T23:45:10.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.937+0000 7f30ca000640 1 -- start start 2024-04-26T23:45:10.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30ca000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30c40b3e30 0x7f30c41fcb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30ca000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30c40ceb20 0x7f30c413fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30ca000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30c4145730 0x7f30c40b1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30ca000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f30c406fdc0 con 0x7f30c40ceb20 2024-04-26T23:45:10.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30ca000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f30c4145d20 con 0x7f30c4145730 2024-04-26T23:45:10.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30ca000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f30c415fb30 con 0x7f30c40b3e30 2024-04-26T23:45:10.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30baa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30c40ceb20 0x7f30c413fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30c3400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30c40b3e30 0x7f30c41fcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30c3400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30c40b3e30 0x7f30c41fcb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:44876/0 (socket says 172.21.15.137:44876) 2024-04-26T23:45:10.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30c3400640 1 -- 172.21.15.137:0/2818118394 learned_addr learned my addr 172.21.15.137:0/2818118394 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:10.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30c3e00640 1 --2- 172.21.15.137:0/2818118394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30c4145730 0x7f30c40b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30c3400640 1 -- 172.21.15.137:0/2818118394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30c4145730 msgr2=0x7f30c40b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30c3400640 1 --2- 172.21.15.137:0/2818118394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30c4145730 0x7f30c40b1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30c3400640 1 -- 172.21.15.137:0/2818118394 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30c40ceb20 msgr2=0x7f30c413fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30c3400640 1 --2- 172.21.15.137:0/2818118394 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30c40ceb20 0x7f30c413fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30c3400640 1 -- 172.21.15.137:0/2818118394 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c415e520 con 0x7f30c40b3e30 2024-04-26T23:45:10.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30baa00640 1 --2- 172.21.15.137:0/2818118394 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30c40ceb20 0x7f30c413fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:10.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30c3400640 1 --2- 172.21.15.137:0/2818118394 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30c40b3e30 0x7f30c41fcb10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f30b401cdc0 tx=0x7f30b401ad60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:10.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30bbe00640 1 -- 172.21.15.137:0/2818118394 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b40ba020 con 0x7f30c40b3e30 2024-04-26T23:45:10.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30bbe00640 1 -- 172.21.15.137:0/2818118394 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b40b6420 con 0x7f30c40b3e30 2024-04-26T23:45:10.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30ca000640 1 -- 172.21.15.137:0/2818118394 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30c415e800 con 0x7f30c40b3e30 2024-04-26T23:45:10.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30bbe00640 1 -- 172.21.15.137:0/2818118394 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b40b0040 con 0x7f30c40b3e30 2024-04-26T23:45:10.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30ca000640 1 -- 172.21.15.137:0/2818118394 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f30c415feb0 con 0x7f30c40b3e30 2024-04-26T23:45:10.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.941+0000 7f30ca000640 1 -- 172.21.15.137:0/2818118394 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30c406a2a0 con 0x7f30c40b3e30 2024-04-26T23:45:10.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.945+0000 7f30bbe00640 1 -- 172.21.15.137:0/2818118394 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f30b40bd020 con 0x7f30c40b3e30 2024-04-26T23:45:10.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.945+0000 7f30bbe00640 1 --2- 172.21.15.137:0/2818118394 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f30a0068380 0x7f30a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.945+0000 7f30bbe00640 1 -- 172.21.15.137:0/2818118394 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7f30b4120b40 con 0x7f30c40b3e30 2024-04-26T23:45:10.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.945+0000 7f30baa00640 1 --2- 172.21.15.137:0/2818118394 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f30a0068380 0x7f30a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.945+0000 7f30baa00640 1 --2- 172.21.15.137:0/2818118394 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f30a0068380 0x7f30a006a840 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f30c406ef40 tx=0x7f30ac008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:10.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:10.949+0000 7f30bbe00640 1 -- 172.21.15.137:0/2818118394 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f30b40c4030 con 0x7f30c40b3e30 2024-04-26T23:45:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.105+0000 7f30ca000640 1 -- 172.21.15.137:0/2818118394 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f30c4073de0 con 0x7f30a0068380 2024-04-26T23:45:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.105+0000 7f30bbe00640 1 -- 172.21.15.137:0/2818118394 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f30c4073de0 con 0x7f30a0068380 2024-04-26T23:45:11.111 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 3 to deep-scrub 2024-04-26T23:45:11.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.109+0000 7f30ca000640 1 -- 172.21.15.137:0/2818118394 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f30a0068380 msgr2=0x7f30a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.109+0000 7f30ca000640 1 --2- 172.21.15.137:0/2818118394 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f30a0068380 0x7f30a006a840 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f30c406ef40 tx=0x7f30ac008040 comp rx=0 tx=0).stop 2024-04-26T23:45:11.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.109+0000 7f30ca000640 1 -- 172.21.15.137:0/2818118394 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30c40b3e30 msgr2=0x7f30c41fcb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.109+0000 7f30ca000640 1 --2- 172.21.15.137:0/2818118394 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30c40b3e30 0x7f30c41fcb10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f30b401cdc0 tx=0x7f30b401ad60 comp rx=0 tx=0).stop 2024-04-26T23:45:11.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.109+0000 7f30ca000640 1 -- 172.21.15.137:0/2818118394 shutdown_connections 2024-04-26T23:45:11.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.109+0000 7f30ca000640 1 --2- 172.21.15.137:0/2818118394 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f30a0068380 0x7f30a006a840 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.109+0000 7f30ca000640 1 --2- 172.21.15.137:0/2818118394 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30c40ceb20 0x7f30c413fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.109+0000 7f30ca000640 1 --2- 172.21.15.137:0/2818118394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30c4145730 0x7f30c40b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.109+0000 7f30ca000640 1 --2- 172.21.15.137:0/2818118394 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30c40b3e30 0x7f30c41fcb10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.109+0000 7f30ca000640 1 -- 172.21.15.137:0/2818118394 >> 172.21.15.137:0/2818118394 conn(0x7f30c406c560 msgr2=0x7f30c4141130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:11.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.109+0000 7f30ca000640 1 -- 172.21.15.137:0/2818118394 shutdown_connections 2024-04-26T23:45:11.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.109+0000 7f30ca000640 1 -- 172.21.15.137:0/2818118394 wait complete. 2024-04-26T23:45:11.132 INFO:tasks.ceph:Scrubbing osd.4 2024-04-26T23:45:11.133 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:45:11.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.265+0000 7ff0ef400640 1 Processor -- start 2024-04-26T23:45:11.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.265+0000 7ff0ef400640 1 -- start start 2024-04-26T23:45:11.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.269+0000 7ff0ef400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff0e8159af0 0x7ff0e80b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.269+0000 7ff0ef400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0e8159ed0 con 0x7ff0e815c610 2024-04-26T23:45:11.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.269+0000 7ff0ef400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0e80b4710 con 0x7ff0e80b6220 2024-04-26T23:45:11.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.269+0000 7ff0ef400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff0e80b49f0 con 0x7ff0e8159af0 2024-04-26T23:45:11.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.269+0000 7ff0eca00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff0e8159af0 0x7ff0e80b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.269+0000 7ff0e7e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7ff0e815c610 0x7ff0e80b5b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39642/0 (socket says 172.21.15.137:39642) 2024-04-26T23:45:11.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.269+0000 7ff0e7e00640 1 -- 172.21.15.137:0/3588235811 learned_addr learned my addr 172.21.15.137:0/3588235811 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:45:11.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.269+0000 7ff0eca00640 1 -- 172.21.15.137:0/3588235811 >> v1:172.21.15.170:6789/0 conn(0x7ff0e80b6220 legacy=0x7ff0e8072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:11.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.269+0000 7ff0eca00640 1 -- 172.21.15.137:0/3588235811 >> v1:172.21.15.137:6789/0 conn(0x7ff0e815c610 legacy=0x7ff0e80b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.269+0000 7ff0e7400640 1 -- 172.21.15.137:0/3588235811 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2915706613 0 0) 0x7ff0e8159ed0 con 0x7ff0e815c610 2024-04-26T23:45:11.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.269+0000 7ff0eca00640 1 -- 172.21.15.137:0/3588235811 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e80b4cd0 con 0x7ff0e8159af0 2024-04-26T23:45:11.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.273+0000 7ff0eca00640 1 --2- 172.21.15.137:0/3588235811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0e8159af0 0x7ff0e80b3dc0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0097c0 tx=0x7ff0dc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712181a9590af3c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:11.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.273+0000 7ff0e7400640 1 -- 172.21.15.137:0/3588235811 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc0b1070 con 0x7ff0e8159af0 2024-04-26T23:45:11.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.273+0000 7ff0e7400640 1 -- 172.21.15.137:0/3588235811 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0dc0ac600 con 0x7ff0e8159af0 2024-04-26T23:45:11.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.273+0000 7ff0e7400640 1 -- 172.21.15.137:0/3588235811 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc0ac9d0 con 0x7ff0e8159af0 2024-04-26T23:45:11.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.273+0000 7ff0ef400640 1 -- 172.21.15.137:0/3588235811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0e8159af0 msgr2=0x7ff0e80b3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.273+0000 7ff0ef400640 1 --2- 172.21.15.137:0/3588235811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0e8159af0 0x7ff0e80b3dc0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0097c0 tx=0x7ff0dc01c3a0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.273+0000 7ff0ef400640 1 -- 172.21.15.137:0/3588235811 shutdown_connections 2024-04-26T23:45:11.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.273+0000 7ff0ef400640 1 --2- 172.21.15.137:0/3588235811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0e8159af0 0x7ff0e80b3dc0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.273+0000 7ff0ef400640 1 -- 172.21.15.137:0/3588235811 >> 172.21.15.137:0/3588235811 conn(0x7ff0e80d0d10 msgr2=0x7ff0e80d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:11.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.273+0000 7ff0ef400640 1 -- 172.21.15.137:0/3588235811 shutdown_connections 2024-04-26T23:45:11.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.273+0000 7ff0ef400640 1 -- 172.21.15.137:0/3588235811 wait complete. 2024-04-26T23:45:11.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.273+0000 7ff0ef400640 1 Processor -- start 2024-04-26T23:45:11.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.273+0000 7ff0ef400640 1 -- start start 2024-04-26T23:45:11.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0ef400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0e80b6220 0x7ff0e8150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0ef400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0e8159af0 0x7ff0e815f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0ef400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0e815c610 0x7ff0e815fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0ef400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e8073720 con 0x7ff0e8159af0 2024-04-26T23:45:11.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0ef400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e80735a0 con 0x7ff0e80b6220 2024-04-26T23:45:11.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0ef400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff0e80738a0 con 0x7ff0e815c610 2024-04-26T23:45:11.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0e7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0e8159af0 0x7ff0e815f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0e7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0e8159af0 0x7ff0e815f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58612/0 (socket says 172.21.15.137:58612) 2024-04-26T23:45:11.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0e7e00640 1 -- 172.21.15.137:0/1703328409 learned_addr learned my addr 172.21.15.137:0/1703328409 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:11.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0eca00640 1 --2- 172.21.15.137:0/1703328409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0e80b6220 0x7ff0e8150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0ed400640 1 --2- 172.21.15.137:0/1703328409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0e815c610 0x7ff0e815fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0e7e00640 1 -- 172.21.15.137:0/1703328409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0e815c610 msgr2=0x7ff0e815fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0e7e00640 1 --2- 172.21.15.137:0/1703328409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0e815c610 0x7ff0e815fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0e7e00640 1 -- 172.21.15.137:0/1703328409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0e80b6220 msgr2=0x7ff0e8150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0e7e00640 1 --2- 172.21.15.137:0/1703328409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0e80b6220 0x7ff0e8150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0e7e00640 1 -- 172.21.15.137:0/1703328409 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e815a4c0 con 0x7ff0e8159af0 2024-04-26T23:45:11.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0ed400640 1 --2- 172.21.15.137:0/1703328409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0e815c610 0x7ff0e815fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:11.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0e7e00640 1 --2- 172.21.15.137:0/1703328409 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0e8159af0 0x7ff0e815f9b0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400c480 tx=0x7ff0d400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:11.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0e4c00640 1 -- 172.21.15.137:0/1703328409 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4018070 con 0x7ff0e8159af0 2024-04-26T23:45:11.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0e4c00640 1 -- 172.21.15.137:0/1703328409 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d4007500 con 0x7ff0e8159af0 2024-04-26T23:45:11.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0ef400640 1 -- 172.21.15.137:0/1703328409 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e815a7a0 con 0x7ff0e8159af0 2024-04-26T23:45:11.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0e4c00640 1 -- 172.21.15.137:0/1703328409 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4004a30 con 0x7ff0e8159af0 2024-04-26T23:45:11.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0ef400640 1 -- 172.21.15.137:0/1703328409 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e815ad60 con 0x7ff0e8159af0 2024-04-26T23:45:11.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0ef400640 1 -- 172.21.15.137:0/1703328409 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff0e806a2a0 con 0x7ff0e8159af0 2024-04-26T23:45:11.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.277+0000 7ff0e4c00640 1 -- 172.21.15.137:0/1703328409 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff0d401b070 con 0x7ff0e8159af0 2024-04-26T23:45:11.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.281+0000 7ff0e4c00640 1 --2- 172.21.15.137:0/1703328409 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff0c8068380 0x7ff0c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.281+0000 7ff0e4c00640 1 -- 172.21.15.137:0/1703328409 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7ff0d4085fa0 con 0x7ff0e8159af0 2024-04-26T23:45:11.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.281+0000 7ff0e4c00640 1 --2- 172.21.15.137:0/1703328409 >> [v2:172.21.15.170:6808/2998038920,v1:172.21.15.170:6809/2998038920] conn(0x7ff0c806e240 0x7ff0c8070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.281+0000 7ff0e4c00640 1 -- 172.21.15.137:0/1703328409 --> [v2:172.21.15.170:6808/2998038920,v1:172.21.15.170:6809/2998038920] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0c8070d10 con 0x7ff0c806e240 2024-04-26T23:45:11.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.281+0000 7ff0e4c00640 1 -- 172.21.15.137:0/1703328409 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7ff0d4086350 con 0x7ff0e8159af0 2024-04-26T23:45:11.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.281+0000 7ff0eca00640 1 --2- 172.21.15.137:0/1703328409 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff0c8068380 0x7ff0c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.281+0000 7ff0ed400640 1 --2- 172.21.15.137:0/1703328409 >> [v2:172.21.15.170:6808/2998038920,v1:172.21.15.170:6809/2998038920] conn(0x7ff0c806e240 0x7ff0c8070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.281+0000 7ff0eca00640 1 --2- 172.21.15.137:0/1703328409 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff0c8068380 0x7ff0c806a840 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0ae000 tx=0x7ff0dc0a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:11.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.281+0000 7ff0ed400640 1 --2- 172.21.15.137:0/1703328409 >> [v2:172.21.15.170:6808/2998038920,v1:172.21.15.170:6809/2998038920] conn(0x7ff0c806e240 0x7ff0c8070660 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:11.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.281+0000 7ff0e4c00640 1 -- 172.21.15.137:0/1703328409 <== osd.4 v2:172.21.15.170:6808/2998038920 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff0c8070d10 con 0x7ff0c806e240 2024-04-26T23:45:11.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.293+0000 7ff0ef400640 1 -- 172.21.15.137:0/1703328409 --> [v2:172.21.15.170:6808/2998038920,v1:172.21.15.170:6809/2998038920] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff0e80703e0 con 0x7ff0c806e240 2024-04-26T23:45:11.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.293+0000 7ff0e4c00640 1 -- 172.21.15.137:0/1703328409 <== osd.4 v2:172.21.15.170:6808/2998038920 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff0e80703e0 con 0x7ff0c806e240 2024-04-26T23:45:11.299 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:45:11.300 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:45:11.300 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:45:11.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.297+0000 7ff0ef400640 1 -- 172.21.15.137:0/1703328409 >> [v2:172.21.15.170:6808/2998038920,v1:172.21.15.170:6809/2998038920] conn(0x7ff0c806e240 msgr2=0x7ff0c8070660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.297+0000 7ff0ef400640 1 --2- 172.21.15.137:0/1703328409 >> [v2:172.21.15.170:6808/2998038920,v1:172.21.15.170:6809/2998038920] conn(0x7ff0c806e240 0x7ff0c8070660 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.297+0000 7ff0ef400640 1 -- 172.21.15.137:0/1703328409 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff0c8068380 msgr2=0x7ff0c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.297+0000 7ff0ef400640 1 --2- 172.21.15.137:0/1703328409 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ff0c8068380 0x7ff0c806a840 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0ae000 tx=0x7ff0dc0a7000 comp rx=0 tx=0).stop 2024-04-26T23:45:11.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.297+0000 7ff0ef400640 1 -- 172.21.15.137:0/1703328409 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0e8159af0 msgr2=0x7ff0e815f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.297+0000 7ff0ef400640 1 --2- 172.21.15.137:0/1703328409 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0e8159af0 0x7ff0e815f9b0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400c480 tx=0x7ff0d400c940 comp rx=0 tx=0).stop 2024-04-26T23:45:11.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.297+0000 7ff0ed400640 1 -- 172.21.15.137:0/1703328409 reap_dead start 2024-04-26T23:45:11.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.297+0000 7ff0ef400640 1 -- 172.21.15.137:0/1703328409 shutdown_connections 2024-04-26T23:45:11.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.297+0000 7ff0ef400640 1 -- 172.21.15.137:0/1703328409 >> 172.21.15.137:0/1703328409 conn(0x7ff0e80d0d10 msgr2=0x7ff0e80b0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:11.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.297+0000 7ff0ef400640 1 -- 172.21.15.137:0/1703328409 shutdown_connections 2024-04-26T23:45:11.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.297+0000 7ff0ef400640 1 -- 172.21.15.137:0/1703328409 wait complete. 2024-04-26T23:45:11.318 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-26T23:45:11.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.449+0000 7f2ed0200640 1 Processor -- start 2024-04-26T23:45:11.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.449+0000 7f2ed0200640 1 -- start start 2024-04-26T23:45:11.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.449+0000 7f2ed0200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2ec815aae0 0x7f2ec806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.449+0000 7f2ed0200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ec815dd40 0x7f2ec80b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.449+0000 7f2ed0200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec815e590 con 0x7f2ec80b2d60 2024-04-26T23:45:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.449+0000 7f2ed0200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2ec80b3730 con 0x7f2ec815aae0 2024-04-26T23:45:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.449+0000 7f2ed0200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec80b4180 con 0x7f2ec815dd40 2024-04-26T23:45:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.453+0000 7f2ecd800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2ec815aae0 0x7f2ec806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.453+0000 7f2ecce00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f2ec80b2d60 0x7f2ec815d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39656/0 (socket says 172.21.15.137:39656) 2024-04-26T23:45:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.453+0000 7f2ecd800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2ec815aae0 0x7f2ec806ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58618/0 (socket says 172.21.15.137:58618) 2024-04-26T23:45:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.453+0000 7f2ecce00640 1 -- 172.21.15.137:0/328766570 learned_addr learned my addr 172.21.15.137:0/328766570 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:45:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.453+0000 7f2ece200640 1 --2- 172.21.15.137:0/328766570 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ec815dd40 0x7f2ec80b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.453+0000 7f2ecd800640 1 -- 172.21.15.137:0/328766570 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ec815dd40 msgr2=0x7f2ec80b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:11.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.453+0000 7f2ecd800640 1 --2- 172.21.15.137:0/328766570 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ec815dd40 0x7f2ec80b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.453+0000 7f2ecd800640 1 -- 172.21.15.137:0/328766570 >> v1:172.21.15.137:6789/0 conn(0x7f2ec80b2d60 legacy=0x7f2ec815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.453+0000 7f2ecd800640 1 -- 172.21.15.137:0/328766570 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec815e2b0 con 0x7f2ec815aae0 2024-04-26T23:45:11.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.453+0000 7f2ec7e00640 1 -- 172.21.15.137:0/328766570 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1120703829 0 0) 0x7f2ec815e590 con 0x7f2ec80b2d60 2024-04-26T23:45:11.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.453+0000 7f2ece200640 1 --2- 172.21.15.137:0/328766570 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ec815dd40 0x7f2ec80b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:11.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.453+0000 7f2ecd800640 1 --2- 172.21.15.137:0/328766570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ec815aae0 0x7f2ec806ef70 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0097c0 tx=0x7f2ebc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56982b58662c3081 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:11.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.453+0000 7f2ec7e00640 1 -- 172.21.15.137:0/328766570 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0b1070 con 0x7f2ec815aae0 2024-04-26T23:45:11.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.453+0000 7f2ec7e00640 1 -- 172.21.15.137:0/328766570 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ebc0a8050 con 0x7f2ec815aae0 2024-04-26T23:45:11.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.453+0000 7f2ec7e00640 1 -- 172.21.15.137:0/328766570 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0ac860 con 0x7f2ec815aae0 2024-04-26T23:45:11.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ed0200640 1 -- 172.21.15.137:0/328766570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ec815aae0 msgr2=0x7f2ec806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ed0200640 1 --2- 172.21.15.137:0/328766570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ec815aae0 0x7f2ec806ef70 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0097c0 tx=0x7f2ebc01c3e0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ed0200640 1 -- 172.21.15.137:0/328766570 shutdown_connections 2024-04-26T23:45:11.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ed0200640 1 --2- 172.21.15.137:0/328766570 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ec815dd40 0x7f2ec80b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ed0200640 1 --2- 172.21.15.137:0/328766570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ec815aae0 0x7f2ec806ef70 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ed0200640 1 -- 172.21.15.137:0/328766570 >> 172.21.15.137:0/328766570 conn(0x7f2ec806c560 msgr2=0x7f2ec806c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:11.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ed0200640 1 -- 172.21.15.137:0/328766570 shutdown_connections 2024-04-26T23:45:11.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ed0200640 1 -- 172.21.15.137:0/328766570 wait complete. 2024-04-26T23:45:11.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ed0200640 1 Processor -- start 2024-04-26T23:45:11.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ed0200640 1 -- start start 2024-04-26T23:45:11.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ed0200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ec80b2d60 0x7f2ec8166b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ed0200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ec815aae0 0x7f2ec8072970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ed0200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ec815dd40 0x7f2ec8072eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ed0200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec815b040 con 0x7f2ec80b2d60 2024-04-26T23:45:11.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ed0200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec815aec0 con 0x7f2ec815aae0 2024-04-26T23:45:11.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ed0200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec80b4c10 con 0x7f2ec815dd40 2024-04-26T23:45:11.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ecd800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ec80b2d60 0x7f2ec8166b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ecd800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ec80b2d60 0x7f2ec8166b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58632/0 (socket says 172.21.15.137:58632) 2024-04-26T23:45:11.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ecd800640 1 -- 172.21.15.137:0/33745039 learned_addr learned my addr 172.21.15.137:0/33745039 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:11.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ece200640 1 --2- 172.21.15.137:0/33745039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ec815dd40 0x7f2ec8072eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ecce00640 1 --2- 172.21.15.137:0/33745039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ec815aae0 0x7f2ec8072970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ecd800640 1 -- 172.21.15.137:0/33745039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ec815dd40 msgr2=0x7f2ec8072eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ecd800640 1 --2- 172.21.15.137:0/33745039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ec815dd40 0x7f2ec8072eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ecd800640 1 -- 172.21.15.137:0/33745039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ec815aae0 msgr2=0x7f2ec8072970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ecd800640 1 --2- 172.21.15.137:0/33745039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ec815aae0 0x7f2ec8072970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.457+0000 7f2ecd800640 1 -- 172.21.15.137:0/33745039 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec8167210 con 0x7f2ec80b2d60 2024-04-26T23:45:11.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.461+0000 7f2ecd800640 1 --2- 172.21.15.137:0/33745039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ec80b2d60 0x7f2ec8166b50 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc01a010 tx=0x7f2ebc01ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:11.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.461+0000 7f2ec5600640 1 -- 172.21.15.137:0/33745039 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0b1050 con 0x7f2ec80b2d60 2024-04-26T23:45:11.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.461+0000 7f2ec5600640 1 -- 172.21.15.137:0/33745039 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ebc0bd070 con 0x7f2ec80b2d60 2024-04-26T23:45:11.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.461+0000 7f2ec5600640 1 -- 172.21.15.137:0/33745039 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0b88b0 con 0x7f2ec80b2d60 2024-04-26T23:45:11.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.461+0000 7f2ed0200640 1 -- 172.21.15.137:0/33745039 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec81674f0 con 0x7f2ec80b2d60 2024-04-26T23:45:11.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.461+0000 7f2ed0200640 1 -- 172.21.15.137:0/33745039 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec8167ab0 con 0x7f2ec80b2d60 2024-04-26T23:45:11.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.461+0000 7f2ed0200640 1 -- 172.21.15.137:0/33745039 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec806a2a0 con 0x7f2ec80b2d60 2024-04-26T23:45:11.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.461+0000 7f2ec5600640 1 -- 172.21.15.137:0/33745039 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2ebc0b8a50 con 0x7f2ec80b2d60 2024-04-26T23:45:11.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.461+0000 7f2ec5600640 1 --2- 172.21.15.137:0/33745039 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2ea8068380 0x7f2ea806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.461+0000 7f2ec5600640 1 -- 172.21.15.137:0/33745039 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7f2ebc120fa0 con 0x7f2ec80b2d60 2024-04-26T23:45:11.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.461+0000 7f2ecce00640 1 --2- 172.21.15.137:0/33745039 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2ea8068380 0x7f2ea806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.465+0000 7f2ecce00640 1 --2- 172.21.15.137:0/33745039 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2ea8068380 0x7f2ea806a840 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2ec80d06a0 tx=0x7f2eb4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:11.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.465+0000 7f2ec5600640 1 -- 172.21.15.137:0/33745039 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2ebc0c7020 con 0x7f2ec80b2d60 2024-04-26T23:45:11.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.625+0000 7f2ed0200640 1 -- 172.21.15.137:0/33745039 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f2ec806fc40 con 0x7f2ea8068380 2024-04-26T23:45:11.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.625+0000 7f2ec5600640 1 -- 172.21.15.137:0/33745039 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2ec806fc40 con 0x7f2ea8068380 2024-04-26T23:45:11.629 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 4 to deep-scrub 2024-04-26T23:45:11.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.625+0000 7f2ed0200640 1 -- 172.21.15.137:0/33745039 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2ea8068380 msgr2=0x7f2ea806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.625+0000 7f2ed0200640 1 --2- 172.21.15.137:0/33745039 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2ea8068380 0x7f2ea806a840 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2ec80d06a0 tx=0x7f2eb4009040 comp rx=0 tx=0).stop 2024-04-26T23:45:11.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.625+0000 7f2ed0200640 1 -- 172.21.15.137:0/33745039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ec80b2d60 msgr2=0x7f2ec8166b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.625+0000 7f2ed0200640 1 --2- 172.21.15.137:0/33745039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ec80b2d60 0x7f2ec8166b50 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc01a010 tx=0x7f2ebc01ac20 comp rx=0 tx=0).stop 2024-04-26T23:45:11.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.625+0000 7f2ed0200640 1 -- 172.21.15.137:0/33745039 shutdown_connections 2024-04-26T23:45:11.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.625+0000 7f2ed0200640 1 --2- 172.21.15.137:0/33745039 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f2ea8068380 0x7f2ea806a840 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.625+0000 7f2ed0200640 1 --2- 172.21.15.137:0/33745039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ec815dd40 0x7f2ec8072eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.625+0000 7f2ed0200640 1 --2- 172.21.15.137:0/33745039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ec815aae0 0x7f2ec8072970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.625+0000 7f2ed0200640 1 --2- 172.21.15.137:0/33745039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ec80b2d60 0x7f2ec8166b50 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.625+0000 7f2ed0200640 1 -- 172.21.15.137:0/33745039 >> 172.21.15.137:0/33745039 conn(0x7f2ec806c560 msgr2=0x7f2ec8075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:11.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.625+0000 7f2ed0200640 1 -- 172.21.15.137:0/33745039 shutdown_connections 2024-04-26T23:45:11.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.625+0000 7f2ed0200640 1 -- 172.21.15.137:0/33745039 wait complete. 2024-04-26T23:45:11.650 INFO:tasks.ceph:Scrubbing osd.5 2024-04-26T23:45:11.651 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:45:11.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.785+0000 7fafd2200640 1 Processor -- start 2024-04-26T23:45:11.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.785+0000 7fafd2200640 1 -- start start 2024-04-26T23:45:11.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafd2200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fafcc15f420 0x7fafcc1639a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafd2200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafcc06cbe0 con 0x7fafcc0cc320 2024-04-26T23:45:11.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafd2200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafcc06cec0 con 0x7fafcc06c390 2024-04-26T23:45:11.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafd2200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fafcc06d1a0 con 0x7fafcc15f420 2024-04-26T23:45:11.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcbe00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fafcc0cc320 0x7fafcc0cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39672/0 (socket says 172.21.15.137:39672) 2024-04-26T23:45:11.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcbe00640 1 -- 172.21.15.137:0/1898156142 learned_addr learned my addr 172.21.15.137:0/1898156142 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:45:11.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcb400640 1 --2- 172.21.15.137:0/1898156142 >> v2:172.21.15.170:3300/0 conn(0x7fafcc15f420 0x7fafcc1639a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcaa00640 1 -- 172.21.15.137:0/1898156142 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1148834217 0 0) 0x7fafcc06cbe0 con 0x7fafcc0cc320 2024-04-26T23:45:11.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcaa00640 1 -- 172.21.15.137:0/1898156142 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafb0003530 con 0x7fafcc0cc320 2024-04-26T23:45:11.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcaa00640 1 -- 172.21.15.137:0/1898156142 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3743837328 0 0) 0x7fafcc06cec0 con 0x7fafcc06c390 2024-04-26T23:45:11.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcaa00640 1 -- 172.21.15.137:0/1898156142 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafcc06cbe0 con 0x7fafcc06c390 2024-04-26T23:45:11.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcaa00640 1 -- 172.21.15.137:0/1898156142 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 133635923 0 0) 0x7fafb0003530 con 0x7fafcc0cc320 2024-04-26T23:45:11.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcaa00640 1 -- 172.21.15.137:0/1898156142 >> v2:172.21.15.170:3300/0 conn(0x7fafcc15f420 msgr2=0x7fafcc1639a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:11.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcaa00640 1 --2- 172.21.15.137:0/1898156142 >> v2:172.21.15.170:3300/0 conn(0x7fafcc15f420 0x7fafcc1639a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcaa00640 1 -- 172.21.15.137:0/1898156142 >> v1:172.21.15.170:6789/0 conn(0x7fafcc06c390 legacy=0x7fafcc0cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcaa00640 1 -- 172.21.15.137:0/1898156142 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafcc06d480 con 0x7fafcc0cc320 2024-04-26T23:45:11.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcaa00640 1 -- 172.21.15.137:0/1898156142 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7fafc4001a00 con 0x7fafcc0cc320 2024-04-26T23:45:11.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcaa00640 1 -- 172.21.15.137:0/1898156142 >> v1:172.21.15.137:6789/0 conn(0x7fafcc0cc320 legacy=0x7fafcc0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcaa00640 1 --2- 172.21.15.137:0/1898156142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb0003b50 0x7fafb0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcaa00640 1 --2- 172.21.15.137:0/1898156142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafb0004810 0x7fafb0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcaa00640 1 --2- 172.21.15.137:0/1898156142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafb00051d0 0x7fafb000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcaa00640 1 -- 172.21.15.137:0/1898156142 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fafcc06d1a0 con 0x7fafb00051d0 2024-04-26T23:45:11.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcaa00640 1 -- 172.21.15.137:0/1898156142 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fafb000bfc0 con 0x7fafb0004810 2024-04-26T23:45:11.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcaa00640 1 -- 172.21.15.137:0/1898156142 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fafb000c1c0 con 0x7fafb0003b50 2024-04-26T23:45:11.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcbe00640 1 --2- 172.21.15.137:0/1898156142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafb00051d0 0x7fafb000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcb400640 1 --2- 172.21.15.137:0/1898156142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb0003b50 0x7fafb0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafc2a00640 1 --2- 172.21.15.137:0/1898156142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafb0004810 0x7fafb0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcbe00640 1 -- 172.21.15.137:0/1898156142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb0003b50 msgr2=0x7fafb0003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:11.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcbe00640 1 --2- 172.21.15.137:0/1898156142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb0003b50 0x7fafb0003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcbe00640 1 -- 172.21.15.137:0/1898156142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafb0004810 msgr2=0x7fafb0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:11.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcbe00640 1 --2- 172.21.15.137:0/1898156142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafb0004810 0x7fafb0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcbe00640 1 -- 172.21.15.137:0/1898156142 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb0003530 con 0x7fafb00051d0 2024-04-26T23:45:11.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.789+0000 7fafcb400640 1 --2- 172.21.15.137:0/1898156142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb0003b50 0x7fafb0003f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:11.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.793+0000 7fafcbe00640 1 -- 172.21.15.137:0/1898156142 reap_dead start 2024-04-26T23:45:11.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.793+0000 7fafcbe00640 1 --2- 172.21.15.137:0/1898156142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafb00051d0 0x7fafb000b9d0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fafcc070d90 tx=0x7fafc401d260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92c5e03daf214c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:11.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.793+0000 7fafcaa00640 1 -- 172.21.15.137:0/1898156142 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafbc0096b0 con 0x7fafb00051d0 2024-04-26T23:45:11.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.793+0000 7fafcaa00640 1 -- 172.21.15.137:0/1898156142 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc40ad670 con 0x7fafb00051d0 2024-04-26T23:45:11.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.793+0000 7fafcaa00640 1 -- 172.21.15.137:0/1898156142 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc400a410 con 0x7fafb00051d0 2024-04-26T23:45:11.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.793+0000 7fafd2200640 1 -- 172.21.15.137:0/1898156142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafb00051d0 msgr2=0x7fafb000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.793+0000 7fafd2200640 1 --2- 172.21.15.137:0/1898156142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafb00051d0 0x7fafb000b9d0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fafcc070d90 tx=0x7fafc401d260 comp rx=0 tx=0).stop 2024-04-26T23:45:11.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.793+0000 7fafd2200640 1 -- 172.21.15.137:0/1898156142 shutdown_connections 2024-04-26T23:45:11.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.793+0000 7fafd2200640 1 --2- 172.21.15.137:0/1898156142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafb00051d0 0x7fafb000b9d0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.793+0000 7fafd2200640 1 -- 172.21.15.137:0/1898156142 >> 172.21.15.137:0/1898156142 conn(0x7fafcc0ce040 msgr2=0x7fafcc0ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:11.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.793+0000 7fafd2200640 1 -- 172.21.15.137:0/1898156142 shutdown_connections 2024-04-26T23:45:11.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.793+0000 7fafd2200640 1 -- 172.21.15.137:0/1898156142 wait complete. 2024-04-26T23:45:11.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafd2200640 1 Processor -- start 2024-04-26T23:45:11.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafd2200640 1 -- start start 2024-04-26T23:45:11.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafd2200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb00051d0 0x7fafcc1612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafd2200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafcc0b6c60 0x7fafcc0b5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafd2200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafcc0b56d0 0x7fafcc0c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafd2200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fafcc06c810 con 0x7fafcc0b56d0 2024-04-26T23:45:11.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafd2200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fafcc06dc80 con 0x7fafcc0b6c60 2024-04-26T23:45:11.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafd2200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fafcc06c990 con 0x7fafb00051d0 2024-04-26T23:45:11.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafcbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafcc0b56d0 0x7fafcc0c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafcbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafcc0b56d0 0x7fafcc0c99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58652/0 (socket says 172.21.15.137:58652) 2024-04-26T23:45:11.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafcbe00640 1 -- 172.21.15.137:0/474401760 learned_addr learned my addr 172.21.15.137:0/474401760 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:11.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafc2a00640 1 --2- 172.21.15.137:0/474401760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafcc0b6c60 0x7fafcc0b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafcb400640 1 --2- 172.21.15.137:0/474401760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb00051d0 0x7fafcc1612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafcbe00640 1 -- 172.21.15.137:0/474401760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb00051d0 msgr2=0x7fafcc1612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafcbe00640 1 --2- 172.21.15.137:0/474401760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb00051d0 0x7fafcc1612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafcbe00640 1 -- 172.21.15.137:0/474401760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafcc0b6c60 msgr2=0x7fafcc0b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafcbe00640 1 --2- 172.21.15.137:0/474401760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafcc0b6c60 0x7fafcc0b5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafcbe00640 1 -- 172.21.15.137:0/474401760 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafcc0b5bc0 con 0x7fafcc0b56d0 2024-04-26T23:45:11.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafc2a00640 1 --2- 172.21.15.137:0/474401760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafcc0b6c60 0x7fafcc0b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:11.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafcb400640 1 --2- 172.21.15.137:0/474401760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb00051d0 0x7fafcc1612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:11.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafcbe00640 1 --2- 172.21.15.137:0/474401760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafcc0b56d0 0x7fafcc0c99a0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fafc4005c30 tx=0x7fafb0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:11.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafc3e00640 1 -- 172.21.15.137:0/474401760 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc4001f90 con 0x7fafcc0b56d0 2024-04-26T23:45:11.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafc3e00640 1 -- 172.21.15.137:0/474401760 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc40ada30 con 0x7fafcc0b56d0 2024-04-26T23:45:11.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafc3e00640 1 -- 172.21.15.137:0/474401760 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc40adde0 con 0x7fafcc0b56d0 2024-04-26T23:45:11.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafd2200640 1 -- 172.21.15.137:0/474401760 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafcc0b5ea0 con 0x7fafcc0b56d0 2024-04-26T23:45:11.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafd2200640 1 -- 172.21.15.137:0/474401760 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafcc0b6460 con 0x7fafcc0b56d0 2024-04-26T23:45:11.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.797+0000 7fafd2200640 1 -- 172.21.15.137:0/474401760 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fafcc0b6840 con 0x7fafcc0b56d0 2024-04-26T23:45:11.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.801+0000 7fafc3e00640 1 -- 172.21.15.137:0/474401760 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fafc40bf060 con 0x7fafcc0b56d0 2024-04-26T23:45:11.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.801+0000 7fafc3e00640 1 --2- 172.21.15.137:0/474401760 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fafa8068380 0x7fafa806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.801+0000 7fafc3e00640 1 -- 172.21.15.137:0/474401760 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7fafc4120d20 con 0x7fafcc0b56d0 2024-04-26T23:45:11.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.801+0000 7fafcb400640 1 --2- 172.21.15.137:0/474401760 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fafa8068380 0x7fafa806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.801+0000 7fafc3e00640 1 --2- 172.21.15.137:0/474401760 >> [v2:172.21.15.170:6800/1674488513,v1:172.21.15.170:6801/1674488513] conn(0x7fafa806e240 0x7fafa8070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.801+0000 7fafc3e00640 1 -- 172.21.15.137:0/474401760 --> [v2:172.21.15.170:6800/1674488513,v1:172.21.15.170:6801/1674488513] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fafc40aee50 con 0x7fafa806e240 2024-04-26T23:45:11.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.801+0000 7fafc3e00640 1 -- 172.21.15.137:0/474401760 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fafc41262f0 con 0x7fafcc0b56d0 2024-04-26T23:45:11.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.801+0000 7fafc2a00640 1 --2- 172.21.15.137:0/474401760 >> [v2:172.21.15.170:6800/1674488513,v1:172.21.15.170:6801/1674488513] conn(0x7fafa806e240 0x7fafa8070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.801+0000 7fafcb400640 1 --2- 172.21.15.137:0/474401760 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fafa8068380 0x7fafa806a840 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009a60 tx=0x7fafbc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:11.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.801+0000 7fafc2a00640 1 --2- 172.21.15.137:0/474401760 >> [v2:172.21.15.170:6800/1674488513,v1:172.21.15.170:6801/1674488513] conn(0x7fafa806e240 0x7fafa8070660 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:11.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.801+0000 7fafc3e00640 1 -- 172.21.15.137:0/474401760 <== osd.5 v2:172.21.15.170:6800/1674488513 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fafc40aee50 con 0x7fafa806e240 2024-04-26T23:45:11.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.817+0000 7fafd2200640 1 -- 172.21.15.137:0/474401760 --> [v2:172.21.15.170:6800/1674488513,v1:172.21.15.170:6801/1674488513] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fafcc06a2a0 con 0x7fafa806e240 2024-04-26T23:45:11.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.817+0000 7fafc3e00640 1 -- 172.21.15.137:0/474401760 <== osd.5 v2:172.21.15.170:6800/1674488513 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fafcc06a2a0 con 0x7fafa806e240 2024-04-26T23:45:11.820 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:45:11.821 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:45:11.821 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:45:11.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.817+0000 7fafd2200640 1 -- 172.21.15.137:0/474401760 >> [v2:172.21.15.170:6800/1674488513,v1:172.21.15.170:6801/1674488513] conn(0x7fafa806e240 msgr2=0x7fafa8070660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.817+0000 7fafd2200640 1 --2- 172.21.15.137:0/474401760 >> [v2:172.21.15.170:6800/1674488513,v1:172.21.15.170:6801/1674488513] conn(0x7fafa806e240 0x7fafa8070660 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.817+0000 7fafd2200640 1 -- 172.21.15.137:0/474401760 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fafa8068380 msgr2=0x7fafa806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.817+0000 7fafd2200640 1 --2- 172.21.15.137:0/474401760 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fafa8068380 0x7fafa806a840 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009a60 tx=0x7fafbc008040 comp rx=0 tx=0).stop 2024-04-26T23:45:11.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.817+0000 7fafd2200640 1 -- 172.21.15.137:0/474401760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafcc0b56d0 msgr2=0x7fafcc0c99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.817+0000 7fafd2200640 1 --2- 172.21.15.137:0/474401760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafcc0b56d0 0x7fafcc0c99a0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fafc4005c30 tx=0x7fafb0005840 comp rx=0 tx=0).stop 2024-04-26T23:45:11.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.817+0000 7fafcbe00640 1 -- 172.21.15.137:0/474401760 reap_dead start 2024-04-26T23:45:11.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.817+0000 7fafd2200640 1 -- 172.21.15.137:0/474401760 shutdown_connections 2024-04-26T23:45:11.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.817+0000 7fafd2200640 1 -- 172.21.15.137:0/474401760 >> 172.21.15.137:0/474401760 conn(0x7fafcc0ce040 msgr2=0x7fafcc072850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:11.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.817+0000 7fafd2200640 1 -- 172.21.15.137:0/474401760 shutdown_connections 2024-04-26T23:45:11.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.817+0000 7fafd2200640 1 -- 172.21.15.137:0/474401760 wait complete. 2024-04-26T23:45:11.840 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-26T23:45:11.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.973+0000 7fc0b3e00640 1 Processor -- start 2024-04-26T23:45:11.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.973+0000 7fc0b3e00640 1 -- start start 2024-04-26T23:45:11.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.973+0000 7fc0b3e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc0ac0b5cf0 0x7fc0ac0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.973+0000 7fc0b3e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0ac0d2390 con 0x7fc0ac15f4f0 2024-04-26T23:45:11.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.973+0000 7fc0b3e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0ac0cd740 con 0x7fc0ac0cfc60 2024-04-26T23:45:11.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.973+0000 7fc0b3e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc0ac15f8d0 con 0x7fc0ac0b5cf0 2024-04-26T23:45:11.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.973+0000 7fc0b0a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc0ac0b5cf0 0x7fc0ac0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.973+0000 7fc0b1400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc0ac15f4f0 0x7fc0ac0d1c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39674/0 (socket says 172.21.15.137:39674) 2024-04-26T23:45:11.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.973+0000 7fc0b1400640 1 -- 172.21.15.137:0/3779169330 learned_addr learned my addr 172.21.15.137:0/3779169330 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:45:11.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.973+0000 7fc0b0a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc0ac0b5cf0 0x7fc0ac0cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58656/0 (socket says 172.21.15.137:58656) 2024-04-26T23:45:11.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.973+0000 7fc0b0a00640 1 -- 172.21.15.137:0/3779169330 >> v1:172.21.15.170:6789/0 conn(0x7fc0ac0cfc60 legacy=0x7fc0ac0b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.973+0000 7fc0b0a00640 1 -- 172.21.15.137:0/3779169330 >> v1:172.21.15.137:6789/0 conn(0x7fc0ac15f4f0 legacy=0x7fc0ac0d1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.973+0000 7fc0b0a00640 1 -- 172.21.15.137:0/3779169330 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0ac0cda20 con 0x7fc0ac0b5cf0 2024-04-26T23:45:11.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.977+0000 7fc0b0a00640 1 --2- 172.21.15.137:0/3779169330 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0ac0b5cf0 0x7fc0ac0cf720 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fc0980097c0 tx=0x7fc09801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83ff5495d050277 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:11.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.977+0000 7fc0abe00640 1 -- 172.21.15.137:0/3779169330 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0980b0070 con 0x7fc0ac0b5cf0 2024-04-26T23:45:11.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.977+0000 7fc0abe00640 1 -- 172.21.15.137:0/3779169330 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0980ab600 con 0x7fc0ac0b5cf0 2024-04-26T23:45:11.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.977+0000 7fc0abe00640 1 -- 172.21.15.137:0/3779169330 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0980ab9d0 con 0x7fc0ac0b5cf0 2024-04-26T23:45:11.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.977+0000 7fc0b3e00640 1 -- 172.21.15.137:0/3779169330 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0ac0b5cf0 msgr2=0x7fc0ac0cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.977+0000 7fc0b3e00640 1 --2- 172.21.15.137:0/3779169330 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0ac0b5cf0 0x7fc0ac0cf720 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fc0980097c0 tx=0x7fc09801c3f0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.977+0000 7fc0b3e00640 1 -- 172.21.15.137:0/3779169330 shutdown_connections 2024-04-26T23:45:11.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.977+0000 7fc0b3e00640 1 --2- 172.21.15.137:0/3779169330 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0ac0b5cf0 0x7fc0ac0cf720 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.977+0000 7fc0b3e00640 1 -- 172.21.15.137:0/3779169330 >> 172.21.15.137:0/3779169330 conn(0x7fc0ac0d2ea0 msgr2=0x7fc0ac0d32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:11.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.977+0000 7fc0b3e00640 1 -- 172.21.15.137:0/3779169330 shutdown_connections 2024-04-26T23:45:11.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.977+0000 7fc0b3e00640 1 -- 172.21.15.137:0/3779169330 wait complete. 2024-04-26T23:45:11.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0b3e00640 1 Processor -- start 2024-04-26T23:45:11.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0b3e00640 1 -- start start 2024-04-26T23:45:11.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0b3e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0ac0b5cf0 0x7fc0ac14f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0b3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0ac0cfc60 0x7fc0ac14cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0b3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0ac15f4f0 0x7fc0ac14dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0b3e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ac0ce070 con 0x7fc0ac15f4f0 2024-04-26T23:45:11.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0b3e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ac0d3d20 con 0x7fc0ac0cfc60 2024-04-26T23:45:11.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0b3e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc0ac16d1d0 con 0x7fc0ac0b5cf0 2024-04-26T23:45:11.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0b1e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0ac15f4f0 0x7fc0ac14dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0b1e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0ac15f4f0 0x7fc0ac14dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58670/0 (socket says 172.21.15.137:58670) 2024-04-26T23:45:11.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0b1e00640 1 -- 172.21.15.137:0/2713757130 learned_addr learned my addr 172.21.15.137:0/2713757130 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:11.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0b0a00640 1 --2- 172.21.15.137:0/2713757130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0ac0cfc60 0x7fc0ac14cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0b1400640 1 --2- 172.21.15.137:0/2713757130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0ac0b5cf0 0x7fc0ac14f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0b1e00640 1 -- 172.21.15.137:0/2713757130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0ac0b5cf0 msgr2=0x7fc0ac14f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0b1e00640 1 --2- 172.21.15.137:0/2713757130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0ac0b5cf0 0x7fc0ac14f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0b1e00640 1 -- 172.21.15.137:0/2713757130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0ac0cfc60 msgr2=0x7fc0ac14cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0b1e00640 1 --2- 172.21.15.137:0/2713757130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0ac0cfc60 0x7fc0ac14cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0b1e00640 1 -- 172.21.15.137:0/2713757130 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0ac14e7c0 con 0x7fc0ac15f4f0 2024-04-26T23:45:11.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0b1e00640 1 --2- 172.21.15.137:0/2713757130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0ac15f4f0 0x7fc0ac14dde0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400c760 tx=0x7fc0a400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:11.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0a9600640 1 -- 172.21.15.137:0/2713757130 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4003b80 con 0x7fc0ac15f4f0 2024-04-26T23:45:11.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0a9600640 1 -- 172.21.15.137:0/2713757130 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0a4003d20 con 0x7fc0ac15f4f0 2024-04-26T23:45:11.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0a9600640 1 -- 172.21.15.137:0/2713757130 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a400aa30 con 0x7fc0ac15f4f0 2024-04-26T23:45:11.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0b3e00640 1 -- 172.21.15.137:0/2713757130 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0ac14eaa0 con 0x7fc0ac15f4f0 2024-04-26T23:45:11.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0b3e00640 1 -- 172.21.15.137:0/2713757130 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0ac14f060 con 0x7fc0ac15f4f0 2024-04-26T23:45:11.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.981+0000 7fc0b3e00640 1 -- 172.21.15.137:0/2713757130 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0ac06a2a0 con 0x7fc0ac15f4f0 2024-04-26T23:45:11.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.985+0000 7fc0a9600640 1 -- 172.21.15.137:0/2713757130 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc0a400abd0 con 0x7fc0ac15f4f0 2024-04-26T23:45:11.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.985+0000 7fc0a9600640 1 --2- 172.21.15.137:0/2713757130 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc08c068380 0x7fc08c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.985+0000 7fc0a9600640 1 -- 172.21.15.137:0/2713757130 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7fc0a4086450 con 0x7fc0ac15f4f0 2024-04-26T23:45:11.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.985+0000 7fc0b1400640 1 --2- 172.21.15.137:0/2713757130 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc08c068380 0x7fc08c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.985+0000 7fc0b1400640 1 --2- 172.21.15.137:0/2713757130 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc08c068380 0x7fc08c06a840 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0005890 tx=0x7fc0a0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:11.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:11.989+0000 7fc0a9600640 1 -- 172.21.15.137:0/2713757130 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc0a4056620 con 0x7fc0ac15f4f0 2024-04-26T23:45:12.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.145+0000 7fc0b3e00640 1 -- 172.21.15.137:0/2713757130 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fc0ac14f500 con 0x7fc08c068380 2024-04-26T23:45:12.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.145+0000 7fc0a9600640 1 -- 172.21.15.137:0/2713757130 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc0ac14f500 con 0x7fc08c068380 2024-04-26T23:45:12.151 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 5 to deep-scrub 2024-04-26T23:45:12.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.149+0000 7fc0b3e00640 1 -- 172.21.15.137:0/2713757130 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc08c068380 msgr2=0x7fc08c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:12.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.149+0000 7fc0b3e00640 1 --2- 172.21.15.137:0/2713757130 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc08c068380 0x7fc08c06a840 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0005890 tx=0x7fc0a0009040 comp rx=0 tx=0).stop 2024-04-26T23:45:12.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.149+0000 7fc0b3e00640 1 -- 172.21.15.137:0/2713757130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0ac15f4f0 msgr2=0x7fc0ac14dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:12.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.149+0000 7fc0b3e00640 1 --2- 172.21.15.137:0/2713757130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0ac15f4f0 0x7fc0ac14dde0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400c760 tx=0x7fc0a400cc20 comp rx=0 tx=0).stop 2024-04-26T23:45:12.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.149+0000 7fc0b3e00640 1 -- 172.21.15.137:0/2713757130 shutdown_connections 2024-04-26T23:45:12.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.149+0000 7fc0b3e00640 1 --2- 172.21.15.137:0/2713757130 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fc08c068380 0x7fc08c06a840 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.149+0000 7fc0b3e00640 1 --2- 172.21.15.137:0/2713757130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0ac15f4f0 0x7fc0ac14dde0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.149+0000 7fc0b3e00640 1 --2- 172.21.15.137:0/2713757130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0ac0cfc60 0x7fc0ac14cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.149+0000 7fc0b3e00640 1 --2- 172.21.15.137:0/2713757130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0ac0b5cf0 0x7fc0ac14f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.149+0000 7fc0b3e00640 1 -- 172.21.15.137:0/2713757130 >> 172.21.15.137:0/2713757130 conn(0x7fc0ac0d2ea0 msgr2=0x7fc0ac0b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.149+0000 7fc0b3e00640 1 -- 172.21.15.137:0/2713757130 shutdown_connections 2024-04-26T23:45:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.149+0000 7fc0b3e00640 1 -- 172.21.15.137:0/2713757130 wait complete. 2024-04-26T23:45:12.173 INFO:tasks.ceph:Scrubbing osd.6 2024-04-26T23:45:12.174 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:45:12.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.309+0000 7f302a000640 1 Processor -- start 2024-04-26T23:45:12.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.309+0000 7f302a000640 1 -- start start 2024-04-26T23:45:12.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.309+0000 7f302a000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f30240ce0e0 0x7f30240aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:12.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.309+0000 7f302a000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3024069b80 0x7f30240aef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:12.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.309+0000 7f302a000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30240b3930 0x7f30240af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:12.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.309+0000 7f302a000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f30240d0c10 con 0x7f3024069b80 2024-04-26T23:45:12.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.309+0000 7f302a000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f30240b2a10 con 0x7f30240ce0e0 2024-04-26T23:45:12.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.309+0000 7f302a000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f30240ceba0 con 0x7f30240b3930 2024-04-26T23:45:12.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.309+0000 7f301aa00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3024069b80 0x7f30240aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:12.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.309+0000 7f301aa00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3024069b80 0x7f30240aef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58672/0 (socket says 172.21.15.137:58672) 2024-04-26T23:45:12.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.309+0000 7f301aa00640 1 -- 172.21.15.137:0/2657839599 learned_addr learned my addr 172.21.15.137:0/2657839599 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:12.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.309+0000 7f3023e00640 1 --2- 172.21.15.137:0/2657839599 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30240b3930 0x7f30240af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:12.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.313+0000 7f3023400640 1 --2- 172.21.15.137:0/2657839599 >> v2:172.21.15.170:3300/0 conn(0x7f30240ce0e0 0x7f30240aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:12.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.313+0000 7f301aa00640 1 -- 172.21.15.137:0/2657839599 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30240b3930 msgr2=0x7f30240af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:12.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.313+0000 7f301aa00640 1 --2- 172.21.15.137:0/2657839599 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30240b3930 0x7f30240af4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.313+0000 7f301aa00640 1 -- 172.21.15.137:0/2657839599 >> v2:172.21.15.170:3300/0 conn(0x7f30240ce0e0 msgr2=0x7f30240aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:12.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.313+0000 7f301aa00640 1 --2- 172.21.15.137:0/2657839599 >> v2:172.21.15.170:3300/0 conn(0x7f30240ce0e0 0x7f30240aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.313+0000 7f301aa00640 1 -- 172.21.15.137:0/2657839599 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30240d08e0 con 0x7f3024069b80 2024-04-26T23:45:12.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.313+0000 7f3023400640 1 --2- 172.21.15.137:0/2657839599 >> v2:172.21.15.170:3300/0 conn(0x7f30240ce0e0 0x7f30240aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:12.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.313+0000 7f301aa00640 1 --2- 172.21.15.137:0/2657839599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3024069b80 0x7f30240aef60 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f3024071310 tx=0x7f300c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee2eea22db8a168 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:12.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.313+0000 7f3022a00640 1 -- 172.21.15.137:0/2657839599 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c0b1070 con 0x7f3024069b80 2024-04-26T23:45:12.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.313+0000 7f3022a00640 1 -- 172.21.15.137:0/2657839599 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f300c0a8050 con 0x7f3024069b80 2024-04-26T23:45:12.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.313+0000 7f3022a00640 1 -- 172.21.15.137:0/2657839599 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c0ac860 con 0x7f3024069b80 2024-04-26T23:45:12.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.313+0000 7f302a000640 1 -- 172.21.15.137:0/2657839599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3024069b80 msgr2=0x7f30240aef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:12.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.313+0000 7f302a000640 1 --2- 172.21.15.137:0/2657839599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3024069b80 0x7f30240aef60 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f3024071310 tx=0x7f300c01c400 comp rx=0 tx=0).stop 2024-04-26T23:45:12.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.313+0000 7f302a000640 1 -- 172.21.15.137:0/2657839599 shutdown_connections 2024-04-26T23:45:12.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.313+0000 7f302a000640 1 --2- 172.21.15.137:0/2657839599 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30240b3930 0x7f30240af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.313+0000 7f302a000640 1 --2- 172.21.15.137:0/2657839599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3024069b80 0x7f30240aef60 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.313+0000 7f302a000640 1 --2- 172.21.15.137:0/2657839599 >> v2:172.21.15.170:3300/0 conn(0x7f30240ce0e0 0x7f30240aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.313+0000 7f302a000640 1 -- 172.21.15.137:0/2657839599 >> 172.21.15.137:0/2657839599 conn(0x7f30240b2d30 msgr2=0x7f30240b3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:12.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.317+0000 7f302a000640 1 -- 172.21.15.137:0/2657839599 shutdown_connections 2024-04-26T23:45:12.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.317+0000 7f302a000640 1 -- 172.21.15.137:0/2657839599 wait complete. 2024-04-26T23:45:12.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.317+0000 7f302a000640 1 Processor -- start 2024-04-26T23:45:12.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.317+0000 7f302a000640 1 -- start start 2024-04-26T23:45:12.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.317+0000 7f302a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3024069b80 0x7f302409a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:12.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.317+0000 7f302a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30240b3930 0x7f3024155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:12.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.317+0000 7f302a000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30240ce0e0 0x7f3024155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:12.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.317+0000 7f302a000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f30240afb60 con 0x7f30240b3930 2024-04-26T23:45:12.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.317+0000 7f302a000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f30240af9e0 con 0x7f3024069b80 2024-04-26T23:45:12.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.317+0000 7f302a000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f30240b1350 con 0x7f30240ce0e0 2024-04-26T23:45:12.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.317+0000 7f301aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30240b3930 0x7f3024155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:12.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.317+0000 7f301aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30240b3930 0x7f3024155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58682/0 (socket says 172.21.15.137:58682) 2024-04-26T23:45:12.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.317+0000 7f301aa00640 1 -- 172.21.15.137:0/960557014 learned_addr learned my addr 172.21.15.137:0/960557014 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:12.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.317+0000 7f301aa00640 1 -- 172.21.15.137:0/960557014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30240ce0e0 msgr2=0x7f3024155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:12.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.317+0000 7f301aa00640 1 --2- 172.21.15.137:0/960557014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30240ce0e0 0x7f3024155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.317+0000 7f301aa00640 1 -- 172.21.15.137:0/960557014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3024069b80 msgr2=0x7f302409a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:12.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.317+0000 7f301aa00640 1 --2- 172.21.15.137:0/960557014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3024069b80 0x7f302409a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.317+0000 7f301aa00640 1 -- 172.21.15.137:0/960557014 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30240c7440 con 0x7f30240b3930 2024-04-26T23:45:12.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.317+0000 7f301aa00640 1 --2- 172.21.15.137:0/960557014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30240b3930 0x7f3024155aa0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f300c0af040 tx=0x7f300c0191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:12.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.317+0000 7f301be00640 1 -- 172.21.15.137:0/960557014 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c0b1040 con 0x7f30240b3930 2024-04-26T23:45:12.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.317+0000 7f301be00640 1 -- 172.21.15.137:0/960557014 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f300c0acaf0 con 0x7f30240b3930 2024-04-26T23:45:12.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.321+0000 7f302a000640 1 -- 172.21.15.137:0/960557014 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3024156e60 con 0x7f30240b3930 2024-04-26T23:45:12.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.321+0000 7f301be00640 1 -- 172.21.15.137:0/960557014 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c0b5440 con 0x7f30240b3930 2024-04-26T23:45:12.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.321+0000 7f302a000640 1 -- 172.21.15.137:0/960557014 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3024157420 con 0x7f30240b3930 2024-04-26T23:45:12.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.321+0000 7f302a000640 1 -- 172.21.15.137:0/960557014 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3024157800 con 0x7f30240b3930 2024-04-26T23:45:12.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.321+0000 7f301be00640 1 -- 172.21.15.137:0/960557014 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f300c0bc020 con 0x7f30240b3930 2024-04-26T23:45:12.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.321+0000 7f301be00640 1 --2- 172.21.15.137:0/960557014 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f30000683b0 0x7f300006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:12.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.321+0000 7f301be00640 1 -- 172.21.15.137:0/960557014 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7f300c11f8e0 con 0x7f30240b3930 2024-04-26T23:45:12.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.321+0000 7f3023400640 1 --2- 172.21.15.137:0/960557014 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f30000683b0 0x7f300006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:12.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.321+0000 7f301be00640 1 --2- 172.21.15.137:0/960557014 >> [v2:172.21.15.170:6823/169019272,v1:172.21.15.170:6824/169019272] conn(0x7f300006e270 0x7f3000070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:12.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.321+0000 7f301be00640 1 -- 172.21.15.137:0/960557014 --> [v2:172.21.15.170:6823/169019272,v1:172.21.15.170:6824/169019272] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f300c0a6e50 con 0x7f300006e270 2024-04-26T23:45:12.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.321+0000 7f301be00640 1 -- 172.21.15.137:0/960557014 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f300c1242c0 con 0x7f30240b3930 2024-04-26T23:45:12.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.321+0000 7f3023e00640 1 --2- 172.21.15.137:0/960557014 >> [v2:172.21.15.170:6823/169019272,v1:172.21.15.170:6824/169019272] conn(0x7f300006e270 0x7f3000070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:12.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.321+0000 7f3023400640 1 --2- 172.21.15.137:0/960557014 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f30000683b0 0x7f300006a870 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3014006f10 tx=0x7f3014008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:12.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.325+0000 7f3023e00640 1 --2- 172.21.15.137:0/960557014 >> [v2:172.21.15.170:6823/169019272,v1:172.21.15.170:6824/169019272] conn(0x7f300006e270 0x7f3000070690 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:12.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.325+0000 7f301be00640 1 -- 172.21.15.137:0/960557014 <== osd.6 v2:172.21.15.170:6823/169019272 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f300c0a6e50 con 0x7f300006e270 2024-04-26T23:45:12.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.337+0000 7f302a000640 1 -- 172.21.15.137:0/960557014 --> [v2:172.21.15.170:6823/169019272,v1:172.21.15.170:6824/169019272] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f302406a2a0 con 0x7f300006e270 2024-04-26T23:45:12.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.337+0000 7f301be00640 1 -- 172.21.15.137:0/960557014 <== osd.6 v2:172.21.15.170:6823/169019272 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f302406a2a0 con 0x7f300006e270 2024-04-26T23:45:12.342 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:45:12.342 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:45:12.342 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:45:12.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.337+0000 7f302a000640 1 -- 172.21.15.137:0/960557014 >> [v2:172.21.15.170:6823/169019272,v1:172.21.15.170:6824/169019272] conn(0x7f300006e270 msgr2=0x7f3000070690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:12.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.337+0000 7f302a000640 1 --2- 172.21.15.137:0/960557014 >> [v2:172.21.15.170:6823/169019272,v1:172.21.15.170:6824/169019272] conn(0x7f300006e270 0x7f3000070690 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.337+0000 7f302a000640 1 -- 172.21.15.137:0/960557014 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f30000683b0 msgr2=0x7f300006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:12.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.337+0000 7f302a000640 1 --2- 172.21.15.137:0/960557014 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f30000683b0 0x7f300006a870 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3014006f10 tx=0x7f3014008040 comp rx=0 tx=0).stop 2024-04-26T23:45:12.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.337+0000 7f302a000640 1 -- 172.21.15.137:0/960557014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30240b3930 msgr2=0x7f3024155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:12.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.337+0000 7f302a000640 1 --2- 172.21.15.137:0/960557014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30240b3930 0x7f3024155aa0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f300c0af040 tx=0x7f300c0191a0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.337+0000 7f3023e00640 1 -- 172.21.15.137:0/960557014 reap_dead start 2024-04-26T23:45:12.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.337+0000 7f302a000640 1 -- 172.21.15.137:0/960557014 shutdown_connections 2024-04-26T23:45:12.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.337+0000 7f302a000640 1 -- 172.21.15.137:0/960557014 >> 172.21.15.137:0/960557014 conn(0x7f30240b2d30 msgr2=0x7f302406fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:12.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.337+0000 7f302a000640 1 -- 172.21.15.137:0/960557014 shutdown_connections 2024-04-26T23:45:12.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.337+0000 7f302a000640 1 -- 172.21.15.137:0/960557014 wait complete. 2024-04-26T23:45:12.362 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-26T23:45:12.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.493+0000 7f99ca200640 1 Processor -- start 2024-04-26T23:45:12.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.493+0000 7f99ca200640 1 -- start start 2024-04-26T23:45:12.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.497+0000 7f99ca200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99c415aae0 0x7f99c406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:12.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.497+0000 7f99ca200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f99c415d630 0x7f99c415dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:12.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.497+0000 7f99ca200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99c415e590 con 0x7f99c40b2d60 2024-04-26T23:45:12.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.497+0000 7f99ca200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f99c40b4180 con 0x7f99c415d630 2024-04-26T23:45:12.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.497+0000 7f99ca200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f99c415e000 con 0x7f99c415aae0 2024-04-26T23:45:12.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.497+0000 7f99c3400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99c415aae0 0x7f99c406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:12.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.497+0000 7f99c3400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99c415aae0 0x7f99c406ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:44966/0 (socket says 172.21.15.137:44966) 2024-04-26T23:45:12.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.497+0000 7f99c3400640 1 -- 172.21.15.137:0/2978943450 learned_addr learned my addr 172.21.15.137:0/2978943450 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:12.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.497+0000 7f99c3e00640 1 --2- 172.21.15.137:0/2978943450 >> v2:172.21.15.170:3300/0 conn(0x7f99c415d630 0x7f99c415dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:12.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.497+0000 7f99c3400640 1 -- 172.21.15.137:0/2978943450 >> v2:172.21.15.170:3300/0 conn(0x7f99c415d630 msgr2=0x7f99c415dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:12.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.497+0000 7f99c3400640 1 --2- 172.21.15.137:0/2978943450 >> v2:172.21.15.170:3300/0 conn(0x7f99c415d630 0x7f99c415dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.497+0000 7f99c3400640 1 -- 172.21.15.137:0/2978943450 >> v1:172.21.15.170:6789/0 conn(0x7f99c40b2d60 legacy=0x7f99c40b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:12.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.497+0000 7f99c3400640 1 -- 172.21.15.137:0/2978943450 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c415e2b0 con 0x7f99c415aae0 2024-04-26T23:45:12.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.501+0000 7f99c3400640 1 --2- 172.21.15.137:0/2978943450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99c415aae0 0x7f99c406ef70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009e50 tx=0x7f99b401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f85d430204433579 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:12.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.501+0000 7f99c2000640 1 -- 172.21.15.137:0/2978943450 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b40a5830 con 0x7f99c415aae0 2024-04-26T23:45:12.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.501+0000 7f99c2000640 1 -- 172.21.15.137:0/2978943450 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b40a59d0 con 0x7f99c415aae0 2024-04-26T23:45:12.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.501+0000 7f99c2000640 1 -- 172.21.15.137:0/2978943450 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b40a5da0 con 0x7f99c415aae0 2024-04-26T23:45:12.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.501+0000 7f99ca200640 1 -- 172.21.15.137:0/2978943450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99c415aae0 msgr2=0x7f99c406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:12.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.501+0000 7f99ca200640 1 --2- 172.21.15.137:0/2978943450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99c415aae0 0x7f99c406ef70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009e50 tx=0x7f99b401c970 comp rx=0 tx=0).stop 2024-04-26T23:45:12.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.501+0000 7f99ca200640 1 -- 172.21.15.137:0/2978943450 shutdown_connections 2024-04-26T23:45:12.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.501+0000 7f99ca200640 1 --2- 172.21.15.137:0/2978943450 >> v2:172.21.15.170:3300/0 conn(0x7f99c415d630 0x7f99c415dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.501+0000 7f99ca200640 1 --2- 172.21.15.137:0/2978943450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99c415aae0 0x7f99c406ef70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.501+0000 7f99ca200640 1 -- 172.21.15.137:0/2978943450 >> 172.21.15.137:0/2978943450 conn(0x7f99c406c560 msgr2=0x7f99c406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:12.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.501+0000 7f99ca200640 1 -- 172.21.15.137:0/2978943450 shutdown_connections 2024-04-26T23:45:12.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.501+0000 7f99ca200640 1 -- 172.21.15.137:0/2978943450 wait complete. 2024-04-26T23:45:12.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.501+0000 7f99ca200640 1 Processor -- start 2024-04-26T23:45:12.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.501+0000 7f99ca200640 1 -- start start 2024-04-26T23:45:12.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.501+0000 7f99ca200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99c40b2d60 0x7f99c4155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:12.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.501+0000 7f99ca200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99c415aae0 0x7f99c4156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:12.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.501+0000 7f99ca200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99c415d630 0x7f99c415fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:12.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.501+0000 7f99ca200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f99c415b040 con 0x7f99c40b2d60 2024-04-26T23:45:12.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.501+0000 7f99ca200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f99c415aec0 con 0x7f99c415aae0 2024-04-26T23:45:12.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.501+0000 7f99ca200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f99c40b4c10 con 0x7f99c415d630 2024-04-26T23:45:12.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.505+0000 7f99c3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99c40b2d60 0x7f99c4155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:12.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.505+0000 7f99c3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99c40b2d60 0x7f99c4155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58688/0 (socket says 172.21.15.137:58688) 2024-04-26T23:45:12.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.505+0000 7f99c3400640 1 -- 172.21.15.137:0/2155974847 learned_addr learned my addr 172.21.15.137:0/2155974847 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:12.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.505+0000 7f99c3e00640 1 --2- 172.21.15.137:0/2155974847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99c415d630 0x7f99c415fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:12.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.505+0000 7f99c2a00640 1 --2- 172.21.15.137:0/2155974847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99c415aae0 0x7f99c4156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:12.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.505+0000 7f99c3400640 1 -- 172.21.15.137:0/2155974847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99c415d630 msgr2=0x7f99c415fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:12.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.505+0000 7f99c3400640 1 --2- 172.21.15.137:0/2155974847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99c415d630 0x7f99c415fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.505+0000 7f99c3400640 1 -- 172.21.15.137:0/2155974847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99c415aae0 msgr2=0x7f99c4156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:12.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.505+0000 7f99c3400640 1 --2- 172.21.15.137:0/2155974847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99c415aae0 0x7f99c4156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.505+0000 7f99c3400640 1 -- 172.21.15.137:0/2155974847 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c41544d0 con 0x7f99c40b2d60 2024-04-26T23:45:12.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.505+0000 7f99c3400640 1 --2- 172.21.15.137:0/2155974847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99c40b2d60 0x7f99c4155cc0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f99b401a5a0 tx=0x7f99b4019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:12.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.505+0000 7f99bb400640 1 -- 172.21.15.137:0/2155974847 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b40bc020 con 0x7f99c40b2d60 2024-04-26T23:45:12.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.505+0000 7f99bb400640 1 -- 172.21.15.137:0/2155974847 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b40b8670 con 0x7f99c40b2d60 2024-04-26T23:45:12.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.505+0000 7f99bb400640 1 -- 172.21.15.137:0/2155974847 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b40b8a40 con 0x7f99c40b2d60 2024-04-26T23:45:12.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.505+0000 7f99ca200640 1 -- 172.21.15.137:0/2155974847 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c41547b0 con 0x7f99c40b2d60 2024-04-26T23:45:12.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.505+0000 7f99ca200640 1 -- 172.21.15.137:0/2155974847 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c4154d70 con 0x7f99c40b2d60 2024-04-26T23:45:12.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.505+0000 7f99ca200640 1 -- 172.21.15.137:0/2155974847 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99c406a2a0 con 0x7f99c40b2d60 2024-04-26T23:45:12.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.505+0000 7f99bb400640 1 -- 172.21.15.137:0/2155974847 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f99b40bf020 con 0x7f99c40b2d60 2024-04-26T23:45:12.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.505+0000 7f99bb400640 1 --2- 172.21.15.137:0/2155974847 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f99a4068380 0x7f99a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:12.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.509+0000 7f99bb400640 1 -- 172.21.15.137:0/2155974847 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7f99b4121880 con 0x7f99c40b2d60 2024-04-26T23:45:12.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.509+0000 7f99c2a00640 1 --2- 172.21.15.137:0/2155974847 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f99a4068380 0x7f99a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:12.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.509+0000 7f99c2a00640 1 --2- 172.21.15.137:0/2155974847 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f99a4068380 0x7f99a406a840 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f99c40b1680 tx=0x7f99b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:12.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.513+0000 7f99bb400640 1 -- 172.21.15.137:0/2155974847 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f99b40c6030 con 0x7f99c40b2d60 2024-04-26T23:45:12.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.669+0000 7f99ca200640 1 -- 172.21.15.137:0/2155974847 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f99c40cd660 con 0x7f99a4068380 2024-04-26T23:45:12.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.669+0000 7f99bb400640 1 -- 172.21.15.137:0/2155974847 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f99c40cd660 con 0x7f99a4068380 2024-04-26T23:45:12.675 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 6 to deep-scrub 2024-04-26T23:45:12.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.673+0000 7f99ca200640 1 -- 172.21.15.137:0/2155974847 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f99a4068380 msgr2=0x7f99a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:12.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.673+0000 7f99ca200640 1 --2- 172.21.15.137:0/2155974847 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f99a4068380 0x7f99a406a840 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f99c40b1680 tx=0x7f99b0009040 comp rx=0 tx=0).stop 2024-04-26T23:45:12.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.673+0000 7f99ca200640 1 -- 172.21.15.137:0/2155974847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99c40b2d60 msgr2=0x7f99c4155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:12.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.673+0000 7f99ca200640 1 --2- 172.21.15.137:0/2155974847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99c40b2d60 0x7f99c4155cc0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f99b401a5a0 tx=0x7f99b4019710 comp rx=0 tx=0).stop 2024-04-26T23:45:12.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.673+0000 7f99ca200640 1 -- 172.21.15.137:0/2155974847 shutdown_connections 2024-04-26T23:45:12.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.673+0000 7f99ca200640 1 --2- 172.21.15.137:0/2155974847 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f99a4068380 0x7f99a406a840 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.673+0000 7f99ca200640 1 --2- 172.21.15.137:0/2155974847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99c415d630 0x7f99c415fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.673+0000 7f99ca200640 1 --2- 172.21.15.137:0/2155974847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99c415aae0 0x7f99c4156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.673+0000 7f99ca200640 1 --2- 172.21.15.137:0/2155974847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99c40b2d60 0x7f99c4155cc0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.673+0000 7f99ca200640 1 -- 172.21.15.137:0/2155974847 >> 172.21.15.137:0/2155974847 conn(0x7f99c406c560 msgr2=0x7f99c4159bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:12.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.673+0000 7f99ca200640 1 -- 172.21.15.137:0/2155974847 shutdown_connections 2024-04-26T23:45:12.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.673+0000 7f99ca200640 1 -- 172.21.15.137:0/2155974847 wait complete. 2024-04-26T23:45:12.695 INFO:tasks.ceph:Scrubbing osd.7 2024-04-26T23:45:12.696 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:45:12.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.833+0000 7f230be00640 1 Processor -- start 2024-04-26T23:45:12.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.833+0000 7f230be00640 1 -- start start 2024-04-26T23:45:12.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.833+0000 7f230be00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f23040b6220 0x7f2304166c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:12.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.833+0000 7f230be00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2304159ed0 con 0x7f230415c610 2024-04-26T23:45:12.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.833+0000 7f230be00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23040b4710 con 0x7f2304159af0 2024-04-26T23:45:12.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.833+0000 7f230be00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f23040b44d0 con 0x7f23040b6220 2024-04-26T23:45:12.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.833+0000 7f2309e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f23040b6220 0x7f2304166c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:12.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.833+0000 7f2309e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f23040b6220 0x7f2304166c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58698/0 (socket says 172.21.15.137:58698) 2024-04-26T23:45:12.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.833+0000 7f2309e00640 1 -- 172.21.15.137:0/983309615 learned_addr learned my addr 172.21.15.137:0/983309615 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:12.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.833+0000 7f2308a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f230415c610 0x7f23040b5b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39682/0 (socket says 172.21.15.137:39682) 2024-04-26T23:45:12.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.833+0000 7f2309e00640 1 -- 172.21.15.137:0/983309615 >> v1:172.21.15.170:6789/0 conn(0x7f2304159af0 legacy=0x7f23040b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:12.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.833+0000 7f2309e00640 1 -- 172.21.15.137:0/983309615 >> v1:172.21.15.137:6789/0 conn(0x7f230415c610 legacy=0x7f23040b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:12.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.833+0000 7f2309e00640 1 -- 172.21.15.137:0/983309615 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23040b49f0 con 0x7f23040b6220 2024-04-26T23:45:12.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.837+0000 7f2309e00640 1 --2- 172.21.15.137:0/983309615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23040b6220 0x7f2304166c10 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009e50 tx=0x7f22fc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a979feb26aace0a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:12.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.837+0000 7f2303e00640 1 -- 172.21.15.137:0/983309615 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22fc0a5830 con 0x7f23040b6220 2024-04-26T23:45:12.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.837+0000 7f2303e00640 1 -- 172.21.15.137:0/983309615 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22fc0a59d0 con 0x7f23040b6220 2024-04-26T23:45:12.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.837+0000 7f2303e00640 1 -- 172.21.15.137:0/983309615 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22fc0a5da0 con 0x7f23040b6220 2024-04-26T23:45:12.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.837+0000 7f230be00640 1 -- 172.21.15.137:0/983309615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23040b6220 msgr2=0x7f2304166c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:12.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.837+0000 7f230be00640 1 --2- 172.21.15.137:0/983309615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23040b6220 0x7f2304166c10 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009e50 tx=0x7f22fc01c970 comp rx=0 tx=0).stop 2024-04-26T23:45:12.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.837+0000 7f230be00640 1 -- 172.21.15.137:0/983309615 shutdown_connections 2024-04-26T23:45:12.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.837+0000 7f230be00640 1 --2- 172.21.15.137:0/983309615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23040b6220 0x7f2304166c10 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.837+0000 7f230be00640 1 -- 172.21.15.137:0/983309615 >> 172.21.15.137:0/983309615 conn(0x7f23040d0d10 msgr2=0x7f23040d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:12.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.837+0000 7f230be00640 1 -- 172.21.15.137:0/983309615 shutdown_connections 2024-04-26T23:45:12.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.837+0000 7f230be00640 1 -- 172.21.15.137:0/983309615 wait complete. 2024-04-26T23:45:12.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f230be00640 1 Processor -- start 2024-04-26T23:45:12.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f230be00640 1 -- start start 2024-04-26T23:45:12.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f230be00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23040b6220 0x7f230414a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:12.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f230be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2304159af0 0x7f230415b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:12.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f230be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f230415c610 0x7f230415b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:12.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f230be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2304169af0 con 0x7f230415c610 2024-04-26T23:45:12.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f230be00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2304169970 con 0x7f2304159af0 2024-04-26T23:45:12.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f230be00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2304169c70 con 0x7f23040b6220 2024-04-26T23:45:12.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f2309e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f230415c610 0x7f230415b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:12.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f2309e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f230415c610 0x7f230415b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58700/0 (socket says 172.21.15.137:58700) 2024-04-26T23:45:12.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f2309e00640 1 -- 172.21.15.137:0/3659191356 learned_addr learned my addr 172.21.15.137:0/3659191356 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:12.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f2308a00640 1 --2- 172.21.15.137:0/3659191356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2304159af0 0x7f230415b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:12.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f2309400640 1 --2- 172.21.15.137:0/3659191356 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23040b6220 0x7f230414a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:12.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f2309e00640 1 -- 172.21.15.137:0/3659191356 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23040b6220 msgr2=0x7f230414a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:12.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f2309e00640 1 --2- 172.21.15.137:0/3659191356 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23040b6220 0x7f230414a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f2309e00640 1 -- 172.21.15.137:0/3659191356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2304159af0 msgr2=0x7f230415b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:12.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f2309e00640 1 --2- 172.21.15.137:0/3659191356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2304159af0 0x7f230415b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f2309e00640 1 -- 172.21.15.137:0/3659191356 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23040cd560 con 0x7f230415c610 2024-04-26T23:45:12.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f2309e00640 1 --2- 172.21.15.137:0/3659191356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f230415c610 0x7f230415b780 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0af040 tx=0x7f22fc019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:12.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f2301600640 1 -- 172.21.15.137:0/3659191356 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22fc0bc030 con 0x7f230415c610 2024-04-26T23:45:12.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f2301600640 1 -- 172.21.15.137:0/3659191356 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22fc009250 con 0x7f230415c610 2024-04-26T23:45:12.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f2301600640 1 -- 172.21.15.137:0/3659191356 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22fc0b88a0 con 0x7f230415c610 2024-04-26T23:45:12.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f230be00640 1 -- 172.21.15.137:0/3659191356 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f230414ffe0 con 0x7f230415c610 2024-04-26T23:45:12.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f230be00640 1 -- 172.21.15.137:0/3659191356 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23041505a0 con 0x7f230415c610 2024-04-26T23:45:12.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.841+0000 7f230be00640 1 -- 172.21.15.137:0/3659191356 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f230406a2a0 con 0x7f230415c610 2024-04-26T23:45:12.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.845+0000 7f2301600640 1 -- 172.21.15.137:0/3659191356 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f22fc0bf070 con 0x7f230415c610 2024-04-26T23:45:12.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.845+0000 7f2301600640 1 --2- 172.21.15.137:0/3659191356 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f22e40683b0 0x7f22e406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:12.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.845+0000 7f2301600640 1 -- 172.21.15.137:0/3659191356 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7f22fc121400 con 0x7f230415c610 2024-04-26T23:45:12.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.845+0000 7f2309400640 1 --2- 172.21.15.137:0/3659191356 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f22e40683b0 0x7f22e406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:12.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.845+0000 7f2301600640 1 --2- 172.21.15.137:0/3659191356 >> [v2:172.21.15.170:6816/3057172683,v1:172.21.15.170:6817/3057172683] conn(0x7f22e406e270 0x7f22e4070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:12.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.845+0000 7f2301600640 1 -- 172.21.15.137:0/3659191356 --> [v2:172.21.15.170:6816/3057172683,v1:172.21.15.170:6817/3057172683] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f22fc0020c0 con 0x7f22e406e270 2024-04-26T23:45:12.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.845+0000 7f2301600640 1 -- 172.21.15.137:0/3659191356 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f22fc128050 con 0x7f230415c610 2024-04-26T23:45:12.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.845+0000 7f2308a00640 1 --2- 172.21.15.137:0/3659191356 >> [v2:172.21.15.170:6816/3057172683,v1:172.21.15.170:6817/3057172683] conn(0x7f22e406e270 0x7f22e4070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:12.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.845+0000 7f2309400640 1 --2- 172.21.15.137:0/3659191356 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f22e40683b0 0x7f22e406a870 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f23041fbc00 tx=0x7f22f8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:12.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.845+0000 7f2308a00640 1 --2- 172.21.15.137:0/3659191356 >> [v2:172.21.15.170:6816/3057172683,v1:172.21.15.170:6817/3057172683] conn(0x7f22e406e270 0x7f22e4070690 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:12.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.845+0000 7f2301600640 1 -- 172.21.15.137:0/3659191356 <== osd.7 v2:172.21.15.170:6816/3057172683 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f22fc0020c0 con 0x7f22e406e270 2024-04-26T23:45:12.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.861+0000 7f230be00640 1 -- 172.21.15.137:0/3659191356 --> [v2:172.21.15.170:6816/3057172683,v1:172.21.15.170:6817/3057172683] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f23040703e0 con 0x7f22e406e270 2024-04-26T23:45:12.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.861+0000 7f2301600640 1 -- 172.21.15.137:0/3659191356 <== osd.7 v2:172.21.15.170:6816/3057172683 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f23040703e0 con 0x7f22e406e270 2024-04-26T23:45:12.865 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T23:45:12.865 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:45:12.865 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T23:45:12.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.861+0000 7f230be00640 1 -- 172.21.15.137:0/3659191356 >> [v2:172.21.15.170:6816/3057172683,v1:172.21.15.170:6817/3057172683] conn(0x7f22e406e270 msgr2=0x7f22e4070690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:12.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.861+0000 7f230be00640 1 --2- 172.21.15.137:0/3659191356 >> [v2:172.21.15.170:6816/3057172683,v1:172.21.15.170:6817/3057172683] conn(0x7f22e406e270 0x7f22e4070690 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:12.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.861+0000 7f230be00640 1 -- 172.21.15.137:0/3659191356 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f22e40683b0 msgr2=0x7f22e406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:12.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.861+0000 7f230be00640 1 --2- 172.21.15.137:0/3659191356 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f22e40683b0 0x7f22e406a870 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f23041fbc00 tx=0x7f22f8009040 comp rx=0 tx=0).stop 2024-04-26T23:45:12.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.861+0000 7f230be00640 1 -- 172.21.15.137:0/3659191356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f230415c610 msgr2=0x7f230415b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:12.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.861+0000 7f230be00640 1 --2- 172.21.15.137:0/3659191356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f230415c610 0x7f230415b780 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0af040 tx=0x7f22fc019710 comp rx=0 tx=0).stop 2024-04-26T23:45:12.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.861+0000 7f2309e00640 1 -- 172.21.15.137:0/3659191356 reap_dead start 2024-04-26T23:45:12.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.861+0000 7f230be00640 1 -- 172.21.15.137:0/3659191356 shutdown_connections 2024-04-26T23:45:12.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.861+0000 7f230be00640 1 -- 172.21.15.137:0/3659191356 >> 172.21.15.137:0/3659191356 conn(0x7f23040d0d10 msgr2=0x7f230406f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:12.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.861+0000 7f230be00640 1 -- 172.21.15.137:0/3659191356 shutdown_connections 2024-04-26T23:45:12.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:12.861+0000 7f230be00640 1 -- 172.21.15.137:0/3659191356 wait complete. 2024-04-26T23:45:12.883 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-26T23:45:13.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.013+0000 7fd7bb200640 1 Processor -- start 2024-04-26T23:45:13.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.013+0000 7fd7bb200640 1 -- start start 2024-04-26T23:45:13.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.017+0000 7fd7bb200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7b40b3e30 0x7fd7b40ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:13.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.017+0000 7fd7bb200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd7b40ceb20 0x7fd7b406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:13.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.017+0000 7fd7bb200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7b40b43f0 con 0x7fd7b4145730 2024-04-26T23:45:13.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.017+0000 7fd7bb200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fd7b40b5000 con 0x7fd7b40ceb20 2024-04-26T23:45:13.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.017+0000 7fd7bb200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b40b46d0 con 0x7fd7b40b3e30 2024-04-26T23:45:13.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.017+0000 7fd7b3400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7b40b3e30 0x7fd7b40ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:13.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.017+0000 7fd7b9200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd7b40ceb20 0x7fd7b406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:13.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.017+0000 7fd7b3e00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fd7b4145730 0x7fd7b40735f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:40712/0 (socket says 172.21.15.137:40712) 2024-04-26T23:45:13.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.017+0000 7fd7b9200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd7b40ceb20 0x7fd7b406f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:56472/0 (socket says 172.21.15.137:56472) 2024-04-26T23:45:13.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.017+0000 7fd7b3e00640 1 -- 172.21.15.137:0/689660397 learned_addr learned my addr 172.21.15.137:0/689660397 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:45:13.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.017+0000 7fd7b9200640 1 -- 172.21.15.137:0/689660397 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7b40b3e30 msgr2=0x7fd7b40ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:13.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.017+0000 7fd7b9200640 1 --2- 172.21.15.137:0/689660397 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7b40b3e30 0x7fd7b40ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:13.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.017+0000 7fd7b9200640 1 -- 172.21.15.137:0/689660397 >> v1:172.21.15.170:6789/0 conn(0x7fd7b4145730 legacy=0x7fd7b40735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:13.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.017+0000 7fd7b9200640 1 -- 172.21.15.137:0/689660397 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b40b49b0 con 0x7fd7b40ceb20 2024-04-26T23:45:13.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.021+0000 7fd7b9200640 1 --2- 172.21.15.137:0/689660397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7b40ceb20 0x7fd7b406f470 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009d90 tx=0x7fd7ac01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c6abb9a34db5d7f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:13.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.021+0000 7fd7b2a00640 1 -- 172.21.15.137:0/689660397 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac0b2070 con 0x7fd7b40ceb20 2024-04-26T23:45:13.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.021+0000 7fd7b2a00640 1 -- 172.21.15.137:0/689660397 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7ac0a5830 con 0x7fd7b40ceb20 2024-04-26T23:45:13.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.021+0000 7fd7b2a00640 1 -- 172.21.15.137:0/689660397 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac0a5c00 con 0x7fd7b40ceb20 2024-04-26T23:45:13.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.021+0000 7fd7bb200640 1 -- 172.21.15.137:0/689660397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7b40ceb20 msgr2=0x7fd7b406f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:13.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.021+0000 7fd7bb200640 1 --2- 172.21.15.137:0/689660397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7b40ceb20 0x7fd7b406f470 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009d90 tx=0x7fd7ac01c970 comp rx=0 tx=0).stop 2024-04-26T23:45:13.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.021+0000 7fd7bb200640 1 -- 172.21.15.137:0/689660397 shutdown_connections 2024-04-26T23:45:13.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.021+0000 7fd7bb200640 1 --2- 172.21.15.137:0/689660397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7b40ceb20 0x7fd7b406f470 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:13.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.021+0000 7fd7bb200640 1 --2- 172.21.15.137:0/689660397 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7b40b3e30 0x7fd7b40ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:13.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.021+0000 7fd7bb200640 1 -- 172.21.15.137:0/689660397 >> 172.21.15.137:0/689660397 conn(0x7fd7b406c560 msgr2=0x7fd7b406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:13.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.021+0000 7fd7bb200640 1 -- 172.21.15.137:0/689660397 shutdown_connections 2024-04-26T23:45:13.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.021+0000 7fd7bb200640 1 -- 172.21.15.137:0/689660397 wait complete. 2024-04-26T23:45:13.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.021+0000 7fd7bb200640 1 Processor -- start 2024-04-26T23:45:13.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.021+0000 7fd7bb200640 1 -- start start 2024-04-26T23:45:13.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7bb200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7b40b3e30 0x7fd7b4143070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:13.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7bb200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7b40ceb20 0x7fd7b413ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:13.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7bb200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7b4145730 0x7fd7b40b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:13.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7bb200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b406fdc0 con 0x7fd7b40b3e30 2024-04-26T23:45:13.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7bb200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b4145d20 con 0x7fd7b4145730 2024-04-26T23:45:13.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7bb200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b4168e70 con 0x7fd7b40ceb20 2024-04-26T23:45:13.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7b3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7b40b3e30 0x7fd7b4143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:13.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7b3400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7b40ceb20 0x7fd7b413ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:13.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7b3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7b40b3e30 0x7fd7b4143070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58710/0 (socket says 172.21.15.137:58710) 2024-04-26T23:45:13.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7b3400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7b40ceb20 0x7fd7b413ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:45024/0 (socket says 172.21.15.137:45024) 2024-04-26T23:45:13.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7b3e00640 1 -- 172.21.15.137:0/2033039083 learned_addr learned my addr 172.21.15.137:0/2033039083 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:13.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7b9200640 1 --2- 172.21.15.137:0/2033039083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7b4145730 0x7fd7b40b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:13.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7b3e00640 1 -- 172.21.15.137:0/2033039083 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7b40ceb20 msgr2=0x7fd7b413ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:13.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7b3e00640 1 --2- 172.21.15.137:0/2033039083 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7b40ceb20 0x7fd7b413ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:13.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7b3e00640 1 -- 172.21.15.137:0/2033039083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7b4145730 msgr2=0x7fd7b40b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:13.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7b3e00640 1 --2- 172.21.15.137:0/2033039083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7b4145730 0x7fd7b40b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:13.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7b3e00640 1 -- 172.21.15.137:0/2033039083 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b4069800 con 0x7fd7b40b3e30 2024-04-26T23:45:13.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7b3e00640 1 --2- 172.21.15.137:0/2033039083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7b40b3e30 0x7fd7b4143070 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400c370 tx=0x7fd7a400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:13.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7abe00640 1 -- 172.21.15.137:0/2033039083 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4017070 con 0x7fd7b40b3e30 2024-04-26T23:45:13.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7abe00640 1 -- 172.21.15.137:0/2033039083 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a4005cf0 con 0x7fd7b40b3e30 2024-04-26T23:45:13.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7bb200640 1 -- 172.21.15.137:0/2033039083 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b4143730 con 0x7fd7b40b3e30 2024-04-26T23:45:13.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7abe00640 1 -- 172.21.15.137:0/2033039083 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a40072f0 con 0x7fd7b40b3e30 2024-04-26T23:45:13.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7bb200640 1 -- 172.21.15.137:0/2033039083 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b40af580 con 0x7fd7b40b3e30 2024-04-26T23:45:13.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7bb200640 1 -- 172.21.15.137:0/2033039083 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7b406a2a0 con 0x7fd7b40b3e30 2024-04-26T23:45:13.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.025+0000 7fd7abe00640 1 -- 172.21.15.137:0/2033039083 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd7a401a070 con 0x7fd7b40b3e30 2024-04-26T23:45:13.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.029+0000 7fd7abe00640 1 --2- 172.21.15.137:0/2033039083 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd794068380 0x7fd79406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:13.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.029+0000 7fd7abe00640 1 -- 172.21.15.137:0/2033039083 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7fd7a4085a40 con 0x7fd7b40b3e30 2024-04-26T23:45:13.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.029+0000 7fd7b3400640 1 --2- 172.21.15.137:0/2033039083 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd794068380 0x7fd79406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:13.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.029+0000 7fd7b3400640 1 --2- 172.21.15.137:0/2033039083 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd794068380 0x7fd79406a840 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd7b415eae0 tx=0x7fd7a0009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:13.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.033+0000 7fd7abe00640 1 -- 172.21.15.137:0/2033039083 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd7a4055c10 con 0x7fd7b40b3e30 2024-04-26T23:45:13.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.185+0000 7fd7bb200640 1 -- 172.21.15.137:0/2033039083 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fd7b415e830 con 0x7fd794068380 2024-04-26T23:45:13.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.185+0000 7fd7abe00640 1 -- 172.21.15.137:0/2033039083 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd7b415e830 con 0x7fd794068380 2024-04-26T23:45:13.192 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 7 to deep-scrub 2024-04-26T23:45:13.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.189+0000 7fd7bb200640 1 -- 172.21.15.137:0/2033039083 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd794068380 msgr2=0x7fd79406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:13.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.189+0000 7fd7bb200640 1 --2- 172.21.15.137:0/2033039083 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd794068380 0x7fd79406a840 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd7b415eae0 tx=0x7fd7a0009190 comp rx=0 tx=0).stop 2024-04-26T23:45:13.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.189+0000 7fd7bb200640 1 -- 172.21.15.137:0/2033039083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7b40b3e30 msgr2=0x7fd7b4143070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:13.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.189+0000 7fd7bb200640 1 --2- 172.21.15.137:0/2033039083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7b40b3e30 0x7fd7b4143070 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400c370 tx=0x7fd7a400c830 comp rx=0 tx=0).stop 2024-04-26T23:45:13.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.189+0000 7fd7bb200640 1 -- 172.21.15.137:0/2033039083 shutdown_connections 2024-04-26T23:45:13.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.189+0000 7fd7bb200640 1 --2- 172.21.15.137:0/2033039083 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fd794068380 0x7fd79406a840 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:13.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.189+0000 7fd7bb200640 1 --2- 172.21.15.137:0/2033039083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7b4145730 0x7fd7b40b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:13.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.189+0000 7fd7bb200640 1 --2- 172.21.15.137:0/2033039083 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd7b40ceb20 0x7fd7b413ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:13.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.189+0000 7fd7bb200640 1 --2- 172.21.15.137:0/2033039083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7b40b3e30 0x7fd7b4143070 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:13.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.189+0000 7fd7bb200640 1 -- 172.21.15.137:0/2033039083 >> 172.21.15.137:0/2033039083 conn(0x7fd7b406c560 msgr2=0x7fd7b415b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:13.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.189+0000 7fd7bb200640 1 -- 172.21.15.137:0/2033039083 shutdown_connections 2024-04-26T23:45:13.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.189+0000 7fd7bb200640 1 -- 172.21.15.137:0/2033039083 wait complete. 2024-04-26T23:45:13.212 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:45:13.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.349+0000 7f7325e00640 1 Processor -- start 2024-04-26T23:45:13.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.349+0000 7f7325e00640 1 -- start start 2024-04-26T23:45:13.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.349+0000 7f7325e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f732015aae0 0x7f732006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:13.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.349+0000 7f7325e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f732015d630 0x7f732015dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:13.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.349+0000 7f7325e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f732015e590 con 0x7f73200b2d60 2024-04-26T23:45:13.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.349+0000 7f7325e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f73200b4180 con 0x7f732015d630 2024-04-26T23:45:13.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.349+0000 7f7325e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f732015e000 con 0x7f732015aae0 2024-04-26T23:45:13.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.349+0000 7f7316000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f73200b2d60 0x7f73200b31c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39688/0 (socket says 172.21.15.137:39688) 2024-04-26T23:45:13.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.349+0000 7f7316000640 1 -- 172.21.15.137:0/3623092922 learned_addr learned my addr 172.21.15.137:0/3623092922 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:45:13.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.349+0000 7f731ea00640 1 --2- 172.21.15.137:0/3623092922 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f732015aae0 0x7f732006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:13.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.349+0000 7f731f400640 1 --2- 172.21.15.137:0/3623092922 >> v2:172.21.15.170:3300/0 conn(0x7f732015d630 0x7f732015dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:13.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f731e000640 1 -- 172.21.15.137:0/3623092922 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2647377278 0 0) 0x7f732015e590 con 0x7f73200b2d60 2024-04-26T23:45:13.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f731e000640 1 -- 172.21.15.137:0/3623092922 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7304003530 con 0x7f73200b2d60 2024-04-26T23:45:13.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f731e000640 1 -- 172.21.15.137:0/3623092922 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2938524041 0 0) 0x7f7304003530 con 0x7f73200b2d60 2024-04-26T23:45:13.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f731e000640 1 -- 172.21.15.137:0/3623092922 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f732015aae0 msgr2=0x7f732006ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:13.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f731e000640 1 --2- 172.21.15.137:0/3623092922 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f732015aae0 0x7f732006ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:13.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f731e000640 1 -- 172.21.15.137:0/3623092922 >> v2:172.21.15.170:3300/0 conn(0x7f732015d630 msgr2=0x7f732015dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:13.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f731e000640 1 --2- 172.21.15.137:0/3623092922 >> v2:172.21.15.170:3300/0 conn(0x7f732015d630 0x7f732015dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:13.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f731e000640 1 -- 172.21.15.137:0/3623092922 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732015e2b0 con 0x7f73200b2d60 2024-04-26T23:45:13.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f731e000640 1 -- 172.21.15.137:0/3623092922 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2194065858 0 0) 0x7f7308001680 con 0x7f73200b2d60 2024-04-26T23:45:13.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f731f400640 1 --2- 172.21.15.137:0/3623092922 >> v2:172.21.15.170:3300/0 conn(0x7f732015d630 0x7f732015dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:13.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f731e000640 1 -- 172.21.15.137:0/3623092922 >> v1:172.21.15.137:6789/0 conn(0x7f73200b2d60 legacy=0x7f73200b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:13.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f731e000640 1 --2- 172.21.15.137:0/3623092922 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f732015aae0 0x7f73040039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:13.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f731e000640 1 --2- 172.21.15.137:0/3623092922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7304003f40 0x7f7304004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:13.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f731e000640 1 --2- 172.21.15.137:0/3623092922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7304004d50 0x7f73040051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:13.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f731e000640 1 -- 172.21.15.137:0/3623092922 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f73200b4180 con 0x7f7304003f40 2024-04-26T23:45:13.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f731e000640 1 -- 172.21.15.137:0/3623092922 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f732015e000 con 0x7f7304004d50 2024-04-26T23:45:13.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f731e000640 1 -- 172.21.15.137:0/3623092922 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f730400fe30 con 0x7f732015aae0 2024-04-26T23:45:13.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f7316000640 1 --2- 172.21.15.137:0/3623092922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7304003f40 0x7f7304004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:13.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f731ea00640 1 --2- 172.21.15.137:0/3623092922 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f732015aae0 0x7f73040039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:13.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f731f400640 1 --2- 172.21.15.137:0/3623092922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7304004d50 0x7f73040051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:13.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f7316000640 1 -- 172.21.15.137:0/3623092922 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f732015aae0 msgr2=0x7f73040039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:13.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f7316000640 1 --2- 172.21.15.137:0/3623092922 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f732015aae0 0x7f73040039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:13.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f7316000640 1 -- 172.21.15.137:0/3623092922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7304004d50 msgr2=0x7f73040051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:13.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f7316000640 1 --2- 172.21.15.137:0/3623092922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7304004d50 0x7f73040051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:13.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f7316000640 1 -- 172.21.15.137:0/3623092922 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7304003530 con 0x7f7304003f40 2024-04-26T23:45:13.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.353+0000 7f7316000640 1 --2- 172.21.15.137:0/3623092922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7304003f40 0x7f7304004810 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f730800c2f0 tx=0x7f730801cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f0599563516ac83 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:13.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f731e000640 1 -- 172.21.15.137:0/3623092922 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7308007d60 con 0x7f7304003f40 2024-04-26T23:45:13.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f731e000640 1 -- 172.21.15.137:0/3623092922 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73080a9020 con 0x7f7304003f40 2024-04-26T23:45:13.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f731e000640 1 -- 172.21.15.137:0/3623092922 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7308005ae0 con 0x7f7304003f40 2024-04-26T23:45:13.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f7325e00640 1 -- 172.21.15.137:0/3623092922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7304003f40 msgr2=0x7f7304004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:13.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f7325e00640 1 --2- 172.21.15.137:0/3623092922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7304003f40 0x7f7304004810 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f730800c2f0 tx=0x7f730801cd10 comp rx=0 tx=0).stop 2024-04-26T23:45:13.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f731f400640 1 -- 172.21.15.137:0/3623092922 reap_dead start 2024-04-26T23:45:13.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f7325e00640 1 -- 172.21.15.137:0/3623092922 shutdown_connections 2024-04-26T23:45:13.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f7325e00640 1 -- 172.21.15.137:0/3623092922 >> 172.21.15.137:0/3623092922 conn(0x7f732006c560 msgr2=0x7f732006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:13.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f7325e00640 1 -- 172.21.15.137:0/3623092922 shutdown_connections 2024-04-26T23:45:13.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f7325e00640 1 -- 172.21.15.137:0/3623092922 wait complete. 2024-04-26T23:45:13.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f7325e00640 1 Processor -- start 2024-04-26T23:45:13.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f7325e00640 1 -- start start 2024-04-26T23:45:13.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f7325e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7304003f40 0x7f73201451f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:13.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f7325e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7320154120 0x7f7320144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:13.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f7325e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73201545a0 0x7f73201448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:13.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f7325e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f732015b040 con 0x7f73201545a0 2024-04-26T23:45:13.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f7325e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f732015aec0 con 0x7f7320154120 2024-04-26T23:45:13.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f7325e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f73200b4c10 con 0x7f7304003f40 2024-04-26T23:45:13.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f731f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73201545a0 0x7f73201448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:13.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f731f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73201545a0 0x7f73201448b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58730/0 (socket says 172.21.15.137:58730) 2024-04-26T23:45:13.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f731ea00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7304003f40 0x7f73201451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:13.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f731f400640 1 -- 172.21.15.137:0/2917777122 learned_addr learned my addr 172.21.15.137:0/2917777122 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:13.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.357+0000 7f7316000640 1 --2- 172.21.15.137:0/2917777122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7320154120 0x7f7320144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:13.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.361+0000 7f731f400640 1 -- 172.21.15.137:0/2917777122 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7304003f40 msgr2=0x7f73201451f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:13.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.361+0000 7f731f400640 1 --2- 172.21.15.137:0/2917777122 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7304003f40 0x7f73201451f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:13.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.361+0000 7f731f400640 1 -- 172.21.15.137:0/2917777122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7320154120 msgr2=0x7f7320144370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:13.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.361+0000 7f731f400640 1 --2- 172.21.15.137:0/2917777122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7320154120 0x7f7320144370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:13.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.361+0000 7f731f400640 1 -- 172.21.15.137:0/2917777122 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7320156910 con 0x7f73201545a0 2024-04-26T23:45:13.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.361+0000 7f731f400640 1 --2- 172.21.15.137:0/2917777122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73201545a0 0x7f73201448b0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f73200b5870 tx=0x7f73180119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:13.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.361+0000 7f7317e00640 1 -- 172.21.15.137:0/2917777122 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7318004440 con 0x7f73201545a0 2024-04-26T23:45:13.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.361+0000 7f7317e00640 1 -- 172.21.15.137:0/2917777122 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f731801c070 con 0x7f73201545a0 2024-04-26T23:45:13.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.361+0000 7f7317e00640 1 -- 172.21.15.137:0/2917777122 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7318003820 con 0x7f73201545a0 2024-04-26T23:45:13.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.361+0000 7f7325e00640 1 -- 172.21.15.137:0/2917777122 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7320156bf0 con 0x7f73201545a0 2024-04-26T23:45:13.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.361+0000 7f7325e00640 1 -- 172.21.15.137:0/2917777122 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73201571b0 con 0x7f73201545a0 2024-04-26T23:45:13.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.361+0000 7f7325e00640 1 -- 172.21.15.137:0/2917777122 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73201573b0 con 0x7f73201545a0 2024-04-26T23:45:13.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.361+0000 7f7317e00640 1 -- 172.21.15.137:0/2917777122 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f73180039c0 con 0x7f73201545a0 2024-04-26T23:45:13.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.365+0000 7f7317e00640 1 --2- 172.21.15.137:0/2917777122 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f72fc0683b0 0x7f72fc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:13.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.365+0000 7f7317e00640 1 -- 172.21.15.137:0/2917777122 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7f7318086640 con 0x7f73201545a0 2024-04-26T23:45:13.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.365+0000 7f731ea00640 1 --2- 172.21.15.137:0/2917777122 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f72fc0683b0 0x7f72fc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:13.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.365+0000 7f731ea00640 1 --2- 172.21.15.137:0/2917777122 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f72fc0683b0 0x7f72fc06a870 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7320148410 tx=0x7f731000b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:13.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.369+0000 7f7317e00640 1 -- 172.21.15.137:0/2917777122 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f73201573b0 con 0x7f73201545a0 2024-04-26T23:45:13.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.521+0000 7f7325e00640 1 -- 172.21.15.137:0/2917777122 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f73201566c0 con 0x7f72fc0683b0 2024-04-26T23:45:13.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.525+0000 7f7317e00640 1 -- 172.21.15.137:0/2917777122 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13352 (secure 0 0 0) 0x7f73201566c0 con 0x7f72fc0683b0 2024-04-26T23:45:13.528 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:13.528 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T23:45:13.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.525+0000 7f7325e00640 1 -- 172.21.15.137:0/2917777122 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f72fc0683b0 msgr2=0x7f72fc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:13.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.525+0000 7f7325e00640 1 --2- 172.21.15.137:0/2917777122 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f72fc0683b0 0x7f72fc06a870 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7320148410 tx=0x7f731000b040 comp rx=0 tx=0).stop 2024-04-26T23:45:13.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.525+0000 7f7325e00640 1 -- 172.21.15.137:0/2917777122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73201545a0 msgr2=0x7f73201448b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:13.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.525+0000 7f7325e00640 1 --2- 172.21.15.137:0/2917777122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73201545a0 0x7f73201448b0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f73200b5870 tx=0x7f73180119f0 comp rx=0 tx=0).stop 2024-04-26T23:45:13.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.525+0000 7f7325e00640 1 -- 172.21.15.137:0/2917777122 shutdown_connections 2024-04-26T23:45:13.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.525+0000 7f7325e00640 1 --2- 172.21.15.137:0/2917777122 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f72fc0683b0 0x7f72fc06a870 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:13.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.525+0000 7f7325e00640 1 --2- 172.21.15.137:0/2917777122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73201545a0 0x7f73201448b0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:13.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.525+0000 7f7325e00640 1 --2- 172.21.15.137:0/2917777122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7320154120 0x7f7320144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:13.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.525+0000 7f7325e00640 1 --2- 172.21.15.137:0/2917777122 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7304003f40 0x7f73201451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:13.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.525+0000 7f7325e00640 1 -- 172.21.15.137:0/2917777122 >> 172.21.15.137:0/2917777122 conn(0x7f732006c560 msgr2=0x7f73200721a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:13.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.525+0000 7f7325e00640 1 -- 172.21.15.137:0/2917777122 shutdown_connections 2024-04-26T23:45:13.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:13.525+0000 7f7325e00640 1 -- 172.21.15.137:0/2917777122 wait complete. 2024-04-26T23:45:13.549 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-04-26T23:45:11.636217+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":248296,"kb_used_data":7144,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754726424,"statfs":{"total":773094113280,"available":772839858176,"internally_reserved":0,"allocated":7315456,"data_stored":3745696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.025138"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":254,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:45:04.619736+0000","last_change":"2024-04-26T23:41:12.783987+0000","last_active":"2024-04-26T23:45:04.619736+0000","last_peered":"2024-04-26T23:45:04.619736+0000","last_clean":"2024-04-26T23:45:04.619736+0000","last_became_active":"2024-04-26T23:41:12.782901+0000","last_became_peered":"2024-04-26T23:41:12.782901+0000","last_unstale":"2024-04-26T23:45:04.619736+0000","last_undegraded":"2024-04-26T23:45:04.619736+0000","last_fullsized":"2024-04-26T23:45:04.619736+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:41:11.626255+0000","last_clean_scrub_stamp":"2024-04-26T23:41:11.626255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:16.305521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32512,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339328,"statfs":{"total":96636764160,"available":96603471872,"internally_reserved":0,"allocated":1359872,"data_stored":910988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":765952,"data_stored":320620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":765952,"data_stored":320620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":765952,"data_stored":320620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":765952,"data_stored":320620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":320620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":320620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32512,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339328,"statfs":{"total":96636764160,"available":96603471872,"internally_reserved":0,"allocated":1359872,"data_stored":910988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:45:13.552 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T23:41:11.626255+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=41, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=45, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:45:13.552 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T23:45:18.902 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:45:18.906 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:45:33.553 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:45:33.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.697+0000 7fa657800640 1 Processor -- start 2024-04-26T23:45:33.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.697+0000 7fa657800640 1 -- start start 2024-04-26T23:45:33.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.701+0000 7fa657800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6500b3e30 0x7fa6500ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:33.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.701+0000 7fa657800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa6500ceb20 0x7fa65006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:33.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.701+0000 7fa657800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6500b43f0 con 0x7fa650145730 2024-04-26T23:45:33.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.701+0000 7fa657800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa6500b5000 con 0x7fa6500ceb20 2024-04-26T23:45:33.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.701+0000 7fa657800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa6500b46d0 con 0x7fa6500b3e30 2024-04-26T23:45:33.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.701+0000 7fa655800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa6500ceb20 0x7fa65006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:33.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.701+0000 7fa654e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa650145730 0x7fa6500735f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42106/0 (socket says 172.21.15.137:42106) 2024-04-26T23:45:33.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.701+0000 7fa654e00640 1 -- 172.21.15.137:0/2979352416 learned_addr learned my addr 172.21.15.137:0/2979352416 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T23:45:33.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.701+0000 7fa647e00640 1 --2- 172.21.15.137:0/2979352416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6500b3e30 0x7fa6500ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:33.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.701+0000 7fa655800640 1 -- 172.21.15.137:0/2979352416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6500b3e30 msgr2=0x7fa6500ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:33.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.701+0000 7fa655800640 1 --2- 172.21.15.137:0/2979352416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6500b3e30 0x7fa6500ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.701+0000 7fa655800640 1 -- 172.21.15.137:0/2979352416 >> v1:172.21.15.137:6789/0 conn(0x7fa650145730 legacy=0x7fa6500735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:33.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.701+0000 7fa655800640 1 -- 172.21.15.137:0/2979352416 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6500b49b0 con 0x7fa6500ceb20 2024-04-26T23:45:33.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.701+0000 7fa64fe00640 1 -- 172.21.15.137:0/2979352416 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3732032153 0 0) 0x7fa6500b43f0 con 0x7fa650145730 2024-04-26T23:45:33.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.701+0000 7fa655800640 1 --2- 172.21.15.137:0/2979352416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6500ceb20 0x7fa65006f470 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fa648009d90 tx=0x7fa64801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c3daa2f781f984 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:33.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa64fe00640 1 -- 172.21.15.137:0/2979352416 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6480b2070 con 0x7fa6500ceb20 2024-04-26T23:45:33.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa64fe00640 1 -- 172.21.15.137:0/2979352416 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6480a5830 con 0x7fa6500ceb20 2024-04-26T23:45:33.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa64fe00640 1 -- 172.21.15.137:0/2979352416 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6480a5c00 con 0x7fa6500ceb20 2024-04-26T23:45:33.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa657800640 1 -- 172.21.15.137:0/2979352416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6500ceb20 msgr2=0x7fa65006f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:33.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa657800640 1 --2- 172.21.15.137:0/2979352416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6500ceb20 0x7fa65006f470 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fa648009d90 tx=0x7fa64801c970 comp rx=0 tx=0).stop 2024-04-26T23:45:33.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa657800640 1 -- 172.21.15.137:0/2979352416 shutdown_connections 2024-04-26T23:45:33.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa657800640 1 --2- 172.21.15.137:0/2979352416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6500ceb20 0x7fa65006f470 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa657800640 1 --2- 172.21.15.137:0/2979352416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6500b3e30 0x7fa6500ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa657800640 1 -- 172.21.15.137:0/2979352416 >> 172.21.15.137:0/2979352416 conn(0x7fa65006c560 msgr2=0x7fa65006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:33.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa657800640 1 -- 172.21.15.137:0/2979352416 shutdown_connections 2024-04-26T23:45:33.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa657800640 1 -- 172.21.15.137:0/2979352416 wait complete. 2024-04-26T23:45:33.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa657800640 1 Processor -- start 2024-04-26T23:45:33.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa657800640 1 -- start start 2024-04-26T23:45:33.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa657800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6500b3e30 0x7fa65014e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:33.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa657800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6500ceb20 0x7fa6501403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:33.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa657800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa650145730 0x7fa650140900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:33.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa657800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa65006fdc0 con 0x7fa650145730 2024-04-26T23:45:33.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa657800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa650145d20 con 0x7fa6500b3e30 2024-04-26T23:45:33.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa657800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa65006e360 con 0x7fa6500ceb20 2024-04-26T23:45:33.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa655800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa650145730 0x7fa650140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:33.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa655800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa650145730 0x7fa650140900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33590/0 (socket says 172.21.15.137:33590) 2024-04-26T23:45:33.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa655800640 1 -- 172.21.15.137:0/2056032419 learned_addr learned my addr 172.21.15.137:0/2056032419 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:33.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa647e00640 1 --2- 172.21.15.137:0/2056032419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6500ceb20 0x7fa6501403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:33.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.705+0000 7fa654e00640 1 --2- 172.21.15.137:0/2056032419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6500b3e30 0x7fa65014e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:33.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.709+0000 7fa655800640 1 -- 172.21.15.137:0/2056032419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6500ceb20 msgr2=0x7fa6501403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:33.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.709+0000 7fa655800640 1 --2- 172.21.15.137:0/2056032419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6500ceb20 0x7fa6501403c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.709+0000 7fa655800640 1 -- 172.21.15.137:0/2056032419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6500b3e30 msgr2=0x7fa65014e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:33.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.709+0000 7fa655800640 1 --2- 172.21.15.137:0/2056032419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6500b3e30 0x7fa65014e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.709+0000 7fa655800640 1 -- 172.21.15.137:0/2056032419 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa65014ed40 con 0x7fa650145730 2024-04-26T23:45:33.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.709+0000 7fa655800640 1 --2- 172.21.15.137:0/2056032419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa650145730 0x7fa650140900 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fa648009d90 tx=0x7fa648019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:33.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.709+0000 7fa64d600640 1 -- 172.21.15.137:0/2056032419 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6480b2040 con 0x7fa650145730 2024-04-26T23:45:33.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.709+0000 7fa64d600640 1 -- 172.21.15.137:0/2056032419 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6480bf070 con 0x7fa650145730 2024-04-26T23:45:33.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.709+0000 7fa64d600640 1 -- 172.21.15.137:0/2056032419 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6480b88b0 con 0x7fa650145730 2024-04-26T23:45:33.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.709+0000 7fa657800640 1 -- 172.21.15.137:0/2056032419 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6501fb770 con 0x7fa650145730 2024-04-26T23:45:33.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.709+0000 7fa657800640 1 -- 172.21.15.137:0/2056032419 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6501fbd30 con 0x7fa650145730 2024-04-26T23:45:33.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.709+0000 7fa657800640 1 -- 172.21.15.137:0/2056032419 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa65006a2a0 con 0x7fa650145730 2024-04-26T23:45:33.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.709+0000 7fa64d600640 1 -- 172.21.15.137:0/2056032419 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa6480b8a50 con 0x7fa650145730 2024-04-26T23:45:33.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.709+0000 7fa64d600640 1 --2- 172.21.15.137:0/2056032419 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa62c0683b0 0x7fa62c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:33.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.709+0000 7fa64d600640 1 -- 172.21.15.137:0/2056032419 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7fa648121340 con 0x7fa650145730 2024-04-26T23:45:33.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.709+0000 7fa654e00640 1 --2- 172.21.15.137:0/2056032419 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa62c0683b0 0x7fa62c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:33.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.713+0000 7fa654e00640 1 --2- 172.21.15.137:0/2056032419 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa62c0683b0 0x7fa62c06a870 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa640000f70 tx=0x7fa640007c10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:33.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.717+0000 7fa64d600640 1 -- 172.21.15.137:0/2056032419 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa648016560 con 0x7fa650145730 2024-04-26T23:45:33.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.869+0000 7fa657800640 1 -- 172.21.15.137:0/2056032419 --> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa6500c79f0 con 0x7fa62c0683b0 2024-04-26T23:45:33.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.873+0000 7fa64d600640 1 -- 172.21.15.137:0/2056032419 <== mgr.4108 v2:172.21.15.137:6832/2210112838 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13359 (secure 0 0 0) 0x7fa6500c79f0 con 0x7fa62c0683b0 2024-04-26T23:45:33.876 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:33.876 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T23:45:33.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.873+0000 7fa657800640 1 -- 172.21.15.137:0/2056032419 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa62c0683b0 msgr2=0x7fa62c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:33.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.873+0000 7fa657800640 1 --2- 172.21.15.137:0/2056032419 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa62c0683b0 0x7fa62c06a870 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa640000f70 tx=0x7fa640007c10 comp rx=0 tx=0).stop 2024-04-26T23:45:33.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.873+0000 7fa657800640 1 -- 172.21.15.137:0/2056032419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa650145730 msgr2=0x7fa650140900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:33.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.873+0000 7fa657800640 1 --2- 172.21.15.137:0/2056032419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa650145730 0x7fa650140900 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fa648009d90 tx=0x7fa648019710 comp rx=0 tx=0).stop 2024-04-26T23:45:33.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.873+0000 7fa657800640 1 -- 172.21.15.137:0/2056032419 shutdown_connections 2024-04-26T23:45:33.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.873+0000 7fa657800640 1 --2- 172.21.15.137:0/2056032419 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7fa62c0683b0 0x7fa62c06a870 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.873+0000 7fa657800640 1 --2- 172.21.15.137:0/2056032419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa650145730 0x7fa650140900 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.873+0000 7fa657800640 1 --2- 172.21.15.137:0/2056032419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6500ceb20 0x7fa6501403c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.873+0000 7fa657800640 1 --2- 172.21.15.137:0/2056032419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6500b3e30 0x7fa65014e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.873+0000 7fa657800640 1 -- 172.21.15.137:0/2056032419 >> 172.21.15.137:0/2056032419 conn(0x7fa65006c560 msgr2=0x7fa6500b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:33.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.873+0000 7fa657800640 1 -- 172.21.15.137:0/2056032419 shutdown_connections 2024-04-26T23:45:33.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:33.873+0000 7fa657800640 1 -- 172.21.15.137:0/2056032419 wait complete. 2024-04-26T23:45:33.897 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2024-04-26T23:45:33.641167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":248280,"kb_used_data":7144,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754726440,"statfs":{"total":773094113280,"available":772839874560,"internally_reserved":0,"allocated":7315456,"data_stored":3745696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002749"},"pg_stats":[{"pgid":"1.0","version":"63'119","reported_seq":266,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T23:45:13.366607+0000","last_change":"2024-04-26T23:45:13.366607+0000","last_active":"2024-04-26T23:45:13.366607+0000","last_peered":"2024-04-26T23:45:13.366607+0000","last_clean":"2024-04-26T23:45:13.366607+0000","last_became_active":"2024-04-26T23:41:12.782901+0000","last_became_peered":"2024-04-26T23:41:12.782901+0000","last_unstale":"2024-04-26T23:45:13.366607+0000","last_undegraded":"2024-04-26T23:45:13.366607+0000","last_fullsized":"2024-04-26T23:45:13.366607+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'119","last_scrub_stamp":"2024-04-26T23:45:13.366490+0000","last_deep_scrub":"63'119","last_deep_scrub_stamp":"2024-04-26T23:45:13.366490+0000","last_clean_scrub_stamp":"2024-04-26T23:45:13.366490+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:31:32.543176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32504,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1359872,"data_stored":910988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":765952,"data_stored":320620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":765952,"data_stored":320620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":765952,"data_stored":320620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":765952,"data_stored":320620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":320620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":320620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32504,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1359872,"data_stored":910988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:45:33.898 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T23:45:34.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.029+0000 7f63e3c00640 1 Processor -- start 2024-04-26T23:45:34.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.029+0000 7f63e3c00640 1 -- start start 2024-04-26T23:45:34.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.029+0000 7f63e3c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63dc0b5ef0 0x7f63dc15d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:34.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.029+0000 7f63e3c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f63dc145330 0x7f63dc1457a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:34.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.029+0000 7f63e3c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63dc06f620 con 0x7f63dc0b62d0 2024-04-26T23:45:34.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.029+0000 7f63e3c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f63dc160790 con 0x7f63dc145330 2024-04-26T23:45:34.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.029+0000 7f63e3c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f63dc160a70 con 0x7f63dc0b5ef0 2024-04-26T23:45:34.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.029+0000 7f63e1c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f63dc145330 0x7f63dc1457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:34.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.029+0000 7f63e1c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f63dc145330 0x7f63dc1457a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33602/0 (socket says 172.21.15.137:33602) 2024-04-26T23:45:34.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.029+0000 7f63e1c00640 1 -- 172.21.15.137:0/2925980225 learned_addr learned my addr 172.21.15.137:0/2925980225 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:34.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.029+0000 7f63e1200640 1 --2- 172.21.15.137:0/2925980225 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63dc0b5ef0 0x7f63dc15d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:34.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.029+0000 7f63e1c00640 1 -- 172.21.15.137:0/2925980225 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63dc0b5ef0 msgr2=0x7f63dc15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:34.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.029+0000 7f63e1c00640 1 --2- 172.21.15.137:0/2925980225 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63dc0b5ef0 0x7f63dc15d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.029+0000 7f63e1c00640 1 -- 172.21.15.137:0/2925980225 >> v1:172.21.15.170:6789/0 conn(0x7f63dc0b62d0 legacy=0x7f63dc15fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:34.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.029+0000 7f63e1c00640 1 -- 172.21.15.137:0/2925980225 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63dc15c760 con 0x7f63dc145330 2024-04-26T23:45:34.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.033+0000 7f63e1c00640 1 --2- 172.21.15.137:0/2925980225 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63dc145330 0x7f63dc1457a0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f63d400d150 tx=0x7f63d401f5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a79f067ed470fa6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:34.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.033+0000 7f63db400640 1 -- 172.21.15.137:0/2925980225 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d400b2d0 con 0x7f63dc145330 2024-04-26T23:45:34.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.033+0000 7f63db400640 1 -- 172.21.15.137:0/2925980225 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d400b470 con 0x7f63dc145330 2024-04-26T23:45:34.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.033+0000 7f63db400640 1 -- 172.21.15.137:0/2925980225 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d40a7b20 con 0x7f63dc145330 2024-04-26T23:45:34.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.033+0000 7f63e3c00640 1 -- 172.21.15.137:0/2925980225 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63dc145330 msgr2=0x7f63dc1457a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:34.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.033+0000 7f63e3c00640 1 --2- 172.21.15.137:0/2925980225 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63dc145330 0x7f63dc1457a0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f63d400d150 tx=0x7f63d401f5c0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.033+0000 7f63e3c00640 1 -- 172.21.15.137:0/2925980225 shutdown_connections 2024-04-26T23:45:34.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.033+0000 7f63e3c00640 1 --2- 172.21.15.137:0/2925980225 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63dc145330 0x7f63dc1457a0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.033+0000 7f63e3c00640 1 --2- 172.21.15.137:0/2925980225 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63dc0b5ef0 0x7f63dc15d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.033+0000 7f63e3c00640 1 -- 172.21.15.137:0/2925980225 >> 172.21.15.137:0/2925980225 conn(0x7f63dc0b2b30 msgr2=0x7f63dc0b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:34.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.033+0000 7f63e3c00640 1 -- 172.21.15.137:0/2925980225 shutdown_connections 2024-04-26T23:45:34.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.033+0000 7f63e3c00640 1 -- 172.21.15.137:0/2925980225 wait complete. 2024-04-26T23:45:34.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63e3c00640 1 Processor -- start 2024-04-26T23:45:34.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63e3c00640 1 -- start start 2024-04-26T23:45:34.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63e3c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63dc0b5ef0 0x7f63dc13cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:34.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63e3c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63dc0b62d0 0x7f63dc13c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:34.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63e3c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63dc145330 0x7f63dc0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:34.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63e3c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f63dc0b47c0 con 0x7f63dc145330 2024-04-26T23:45:34.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63e3c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f63dc0b4640 con 0x7f63dc0b5ef0 2024-04-26T23:45:34.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63e3c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f63dc0b4940 con 0x7f63dc0b62d0 2024-04-26T23:45:34.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63e1c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63dc145330 0x7f63dc0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:34.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63e1c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63dc145330 0x7f63dc0cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33610/0 (socket says 172.21.15.137:33610) 2024-04-26T23:45:34.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63e1c00640 1 -- 172.21.15.137:0/3122512246 learned_addr learned my addr 172.21.15.137:0/3122512246 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:34.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63e1200640 1 --2- 172.21.15.137:0/3122512246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63dc0b5ef0 0x7f63dc13cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:34.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63dbe00640 1 --2- 172.21.15.137:0/3122512246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63dc0b62d0 0x7f63dc13c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:34.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63e1c00640 1 -- 172.21.15.137:0/3122512246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63dc0b62d0 msgr2=0x7f63dc13c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:34.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63e1c00640 1 --2- 172.21.15.137:0/3122512246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63dc0b62d0 0x7f63dc13c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63e1c00640 1 -- 172.21.15.137:0/3122512246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63dc0b5ef0 msgr2=0x7f63dc13cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:34.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63e1c00640 1 --2- 172.21.15.137:0/3122512246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63dc0b5ef0 0x7f63dc13cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63e1c00640 1 -- 172.21.15.137:0/3122512246 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63dc1fbcd0 con 0x7f63dc145330 2024-04-26T23:45:34.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63dbe00640 1 --2- 172.21.15.137:0/3122512246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63dc0b62d0 0x7f63dc13c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:34.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63e1c00640 1 --2- 172.21.15.137:0/3122512246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63dc145330 0x7f63dc0cf5f0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f63d401d210 tx=0x7f63d401b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:34.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63d8c00640 1 -- 172.21.15.137:0/3122512246 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d4009800 con 0x7f63dc145330 2024-04-26T23:45:34.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63d8c00640 1 -- 172.21.15.137:0/3122512246 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d40be070 con 0x7f63dc145330 2024-04-26T23:45:34.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63e3c00640 1 -- 172.21.15.137:0/3122512246 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63dc1fbfb0 con 0x7f63dc145330 2024-04-26T23:45:34.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63d8c00640 1 -- 172.21.15.137:0/3122512246 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d4009be0 con 0x7f63dc145330 2024-04-26T23:45:34.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63e3c00640 1 -- 172.21.15.137:0/3122512246 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63dc1fc570 con 0x7f63dc145330 2024-04-26T23:45:34.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.037+0000 7f63e3c00640 1 -- 172.21.15.137:0/3122512246 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63dc06a2a0 con 0x7f63dc145330 2024-04-26T23:45:34.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.041+0000 7f63d8c00640 1 -- 172.21.15.137:0/3122512246 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f63d40b6070 con 0x7f63dc145330 2024-04-26T23:45:34.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.041+0000 7f63d8c00640 1 --2- 172.21.15.137:0/3122512246 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f63bc068380 0x7f63bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:34.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.041+0000 7f63d8c00640 1 -- 172.21.15.137:0/3122512246 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7f63d4121620 con 0x7f63dc145330 2024-04-26T23:45:34.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.041+0000 7f63e1200640 1 --2- 172.21.15.137:0/3122512246 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f63bc068380 0x7f63bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:34.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.041+0000 7f63e1200640 1 --2- 172.21.15.137:0/3122512246 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f63bc068380 0x7f63bc06a840 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f63cc007a60 tx=0x7f63cc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:34.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.045+0000 7f63d8c00640 1 -- 172.21.15.137:0/3122512246 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f63d40187e0 con 0x7f63dc145330 2024-04-26T23:45:34.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.201+0000 7f63e3c00640 1 -- 172.21.15.137:0/3122512246 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f63dc0d0aa0 con 0x7f63dc145330 2024-04-26T23:45:34.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.205+0000 7f63d8c00640 1 -- 172.21.15.137:0/3122512246 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v18)=0 v18) ==== 123+0+0 (secure 0 0 0) 0x7f63d40f1ff0 con 0x7f63dc145330 2024-04-26T23:45:34.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.209+0000 7f63d8c00640 1 -- 172.21.15.137:0/3122512246 <== mon.0 v2:172.21.15.137:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f63d40f18f0 con 0x7f63dc145330 2024-04-26T23:45:34.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.209+0000 7f63e3c00640 1 -- 172.21.15.137:0/3122512246 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f63bc068380 msgr2=0x7f63bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:34.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.209+0000 7f63e3c00640 1 --2- 172.21.15.137:0/3122512246 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f63bc068380 0x7f63bc06a840 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f63cc007a60 tx=0x7f63cc008040 comp rx=0 tx=0).stop 2024-04-26T23:45:34.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.209+0000 7f63e3c00640 1 -- 172.21.15.137:0/3122512246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63dc145330 msgr2=0x7f63dc0cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:34.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.209+0000 7f63e3c00640 1 --2- 172.21.15.137:0/3122512246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63dc145330 0x7f63dc0cf5f0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f63d401d210 tx=0x7f63d401b900 comp rx=0 tx=0).stop 2024-04-26T23:45:34.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.209+0000 7f63e3c00640 1 -- 172.21.15.137:0/3122512246 shutdown_connections 2024-04-26T23:45:34.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.209+0000 7f63e3c00640 1 --2- 172.21.15.137:0/3122512246 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7f63bc068380 0x7f63bc06a840 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.209+0000 7f63e3c00640 1 --2- 172.21.15.137:0/3122512246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63dc145330 0x7f63dc0cf5f0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.209+0000 7f63e3c00640 1 --2- 172.21.15.137:0/3122512246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63dc0b62d0 0x7f63dc13c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.209+0000 7f63e3c00640 1 --2- 172.21.15.137:0/3122512246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63dc0b5ef0 0x7f63dc13cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.209+0000 7f63e3c00640 1 -- 172.21.15.137:0/3122512246 >> 172.21.15.137:0/3122512246 conn(0x7f63dc0b2b30 msgr2=0x7f63dc15d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:34.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.209+0000 7f63e3c00640 1 -- 172.21.15.137:0/3122512246 shutdown_connections 2024-04-26T23:45:34.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.209+0000 7f63e3c00640 1 -- 172.21.15.137:0/3122512246 wait complete. 2024-04-26T23:45:34.234 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T23:45:34.234 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:45:34.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.365+0000 7ffb67400640 1 Processor -- start 2024-04-26T23:45:34.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.365+0000 7ffb67400640 1 -- start start 2024-04-26T23:45:34.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.365+0000 7ffb67400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ffb6015aae0 0x7ffb6006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:34.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.365+0000 7ffb67400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb6015dd40 0x7ffb600b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:34.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.365+0000 7ffb67400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb6015e590 con 0x7ffb600b2d60 2024-04-26T23:45:34.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.365+0000 7ffb67400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ffb600b3730 con 0x7ffb6015aae0 2024-04-26T23:45:34.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.365+0000 7ffb67400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ffb600b4180 con 0x7ffb6015dd40 2024-04-26T23:45:34.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.365+0000 7ffb64a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ffb6015aae0 0x7ffb6006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:34.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.365+0000 7ffb64a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ffb6015aae0 0x7ffb6006ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33612/0 (socket says 172.21.15.137:33612) 2024-04-26T23:45:34.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.365+0000 7ffb57e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7ffb600b2d60 0x7ffb6015d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42118/0 (socket says 172.21.15.137:42118) 2024-04-26T23:45:34.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.365+0000 7ffb64a00640 1 -- 172.21.15.137:0/3596872626 learned_addr learned my addr 172.21.15.137:0/3596872626 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:34.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.365+0000 7ffb65400640 1 --2- 172.21.15.137:0/3596872626 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb6015dd40 0x7ffb600b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:34.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.365+0000 7ffb64a00640 1 -- 172.21.15.137:0/3596872626 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb6015dd40 msgr2=0x7ffb600b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:34.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.365+0000 7ffb64a00640 1 --2- 172.21.15.137:0/3596872626 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb6015dd40 0x7ffb600b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.365+0000 7ffb64a00640 1 -- 172.21.15.137:0/3596872626 >> v1:172.21.15.137:6789/0 conn(0x7ffb600b2d60 legacy=0x7ffb6015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:34.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.365+0000 7ffb64a00640 1 -- 172.21.15.137:0/3596872626 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6015e2b0 con 0x7ffb6015aae0 2024-04-26T23:45:34.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.369+0000 7ffb64a00640 1 --2- 172.21.15.137:0/3596872626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb6015aae0 0x7ffb6006ef70 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7ffb50009870 tx=0x7ffb5001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293dc626886f0d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:34.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.369+0000 7ffb5fe00640 1 -- 172.21.15.137:0/3596872626 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb500aa600 con 0x7ffb6015aae0 2024-04-26T23:45:34.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.369+0000 7ffb5fe00640 1 -- 172.21.15.137:0/3596872626 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ffb500af070 con 0x7ffb6015aae0 2024-04-26T23:45:34.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.369+0000 7ffb5fe00640 1 -- 172.21.15.137:0/3596872626 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb500aa9e0 con 0x7ffb6015aae0 2024-04-26T23:45:34.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.369+0000 7ffb67400640 1 -- 172.21.15.137:0/3596872626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb6015aae0 msgr2=0x7ffb6006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:34.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.369+0000 7ffb67400640 1 --2- 172.21.15.137:0/3596872626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb6015aae0 0x7ffb6006ef70 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7ffb50009870 tx=0x7ffb5001c4a0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.369+0000 7ffb67400640 1 -- 172.21.15.137:0/3596872626 shutdown_connections 2024-04-26T23:45:34.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.369+0000 7ffb67400640 1 --2- 172.21.15.137:0/3596872626 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb6015dd40 0x7ffb600b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.369+0000 7ffb67400640 1 --2- 172.21.15.137:0/3596872626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb6015aae0 0x7ffb6006ef70 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.369+0000 7ffb67400640 1 -- 172.21.15.137:0/3596872626 >> 172.21.15.137:0/3596872626 conn(0x7ffb6006c560 msgr2=0x7ffb6006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:34.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.369+0000 7ffb67400640 1 -- 172.21.15.137:0/3596872626 shutdown_connections 2024-04-26T23:45:34.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.369+0000 7ffb67400640 1 -- 172.21.15.137:0/3596872626 wait complete. 2024-04-26T23:45:34.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb67400640 1 Processor -- start 2024-04-26T23:45:34.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb67400640 1 -- start start 2024-04-26T23:45:34.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb67400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb600b2d60 0x7ffb601678e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:34.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb67400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb6015aae0 0x7ffb60155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:34.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb67400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb6015dd40 0x7ffb600aed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:34.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb67400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6015b040 con 0x7ffb6015dd40 2024-04-26T23:45:34.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb67400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6015aec0 con 0x7ffb6015aae0 2024-04-26T23:45:34.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb67400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ffb600b4c10 con 0x7ffb600b2d60 2024-04-26T23:45:34.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb65400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb6015dd40 0x7ffb600aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:34.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb65400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb6015dd40 0x7ffb600aed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33626/0 (socket says 172.21.15.137:33626) 2024-04-26T23:45:34.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb65400640 1 -- 172.21.15.137:0/4143770096 learned_addr learned my addr 172.21.15.137:0/4143770096 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T23:45:34.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb64a00640 1 --2- 172.21.15.137:0/4143770096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb600b2d60 0x7ffb601678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:34.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb57e00640 1 --2- 172.21.15.137:0/4143770096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb6015aae0 0x7ffb60155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:34.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb65400640 1 -- 172.21.15.137:0/4143770096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb600b2d60 msgr2=0x7ffb601678e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:34.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb65400640 1 --2- 172.21.15.137:0/4143770096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb600b2d60 0x7ffb601678e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb65400640 1 -- 172.21.15.137:0/4143770096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb6015aae0 msgr2=0x7ffb60155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:34.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb65400640 1 --2- 172.21.15.137:0/4143770096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb6015aae0 0x7ffb60155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb65400640 1 -- 172.21.15.137:0/4143770096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb60155dc0 con 0x7ffb6015dd40 2024-04-26T23:45:34.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb65400640 1 --2- 172.21.15.137:0/4143770096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb6015dd40 0x7ffb600aed70 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7ffb58007e60 tx=0x7ffb5800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:34.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb5d600640 1 -- 172.21.15.137:0/4143770096 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb58014420 con 0x7ffb6015dd40 2024-04-26T23:45:34.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb5d600640 1 -- 172.21.15.137:0/4143770096 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ffb58019070 con 0x7ffb6015dd40 2024-04-26T23:45:34.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb67400640 1 -- 172.21.15.137:0/4143770096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb60160f40 con 0x7ffb6015dd40 2024-04-26T23:45:34.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb5d600640 1 -- 172.21.15.137:0/4143770096 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb58014840 con 0x7ffb6015dd40 2024-04-26T23:45:34.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.373+0000 7ffb67400640 1 -- 172.21.15.137:0/4143770096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb601614c0 con 0x7ffb6015dd40 2024-04-26T23:45:34.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.377+0000 7ffb67400640 1 -- 172.21.15.137:0/4143770096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb6006a2a0 con 0x7ffb6015dd40 2024-04-26T23:45:34.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.377+0000 7ffb5d600640 1 -- 172.21.15.137:0/4143770096 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffb580149e0 con 0x7ffb6015dd40 2024-04-26T23:45:34.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.377+0000 7ffb5d600640 1 --2- 172.21.15.137:0/4143770096 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ffb3c068380 0x7ffb3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:34.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.377+0000 7ffb5d600640 1 -- 172.21.15.137:0/4143770096 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7ffb58086f30 con 0x7ffb6015dd40 2024-04-26T23:45:34.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.377+0000 7ffb64a00640 1 --2- 172.21.15.137:0/4143770096 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ffb3c068380 0x7ffb3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:34.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.377+0000 7ffb64a00640 1 --2- 172.21.15.137:0/4143770096 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ffb3c068380 0x7ffb3c06a840 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ffb500ae000 tx=0x7ffb500a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:34.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.381+0000 7ffb5d600640 1 -- 172.21.15.137:0/4143770096 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ffb58057070 con 0x7ffb6015dd40 2024-04-26T23:45:34.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.569+0000 7ffb67400640 1 -- 172.21.15.137:0/4143770096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb6006fc40 con 0x7ffb6015dd40 2024-04-26T23:45:34.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.573+0000 7ffb5d600640 1 -- 172.21.15.137:0/4143770096 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+3881 (secure 0 0 0) 0x7ffb5805b370 con 0x7ffb6015dd40 2024-04-26T23:45:34.576 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T23:45:34.576 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6064,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2903000554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2903000554},{"type":"v1","addr":"172.21.15.170:6834","nonce":2903000554}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6372,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/2879053849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2879053849},{"type":"v1","addr":"172.21.15.137:6836","nonce":2879053849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3081576837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3081576837},{"type":"v1","addr":"172.21.15.137:6837","nonce":3081576837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6786,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3680171255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3680171255},{"type":"v1","addr":"172.21.15.170:6835","nonce":3680171255}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[]} 2024-04-26T23:45:34.576 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 39 2024-04-26T23:45:34.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.573+0000 7ffb67400640 1 -- 172.21.15.137:0/4143770096 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ffb3c068380 msgr2=0x7ffb3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:34.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.573+0000 7ffb67400640 1 --2- 172.21.15.137:0/4143770096 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ffb3c068380 0x7ffb3c06a840 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ffb500ae000 tx=0x7ffb500a7000 comp rx=0 tx=0).stop 2024-04-26T23:45:34.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.573+0000 7ffb67400640 1 -- 172.21.15.137:0/4143770096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb6015dd40 msgr2=0x7ffb600aed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:34.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.573+0000 7ffb67400640 1 --2- 172.21.15.137:0/4143770096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb6015dd40 0x7ffb600aed70 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7ffb58007e60 tx=0x7ffb5800e4b0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.573+0000 7ffb67400640 1 -- 172.21.15.137:0/4143770096 shutdown_connections 2024-04-26T23:45:34.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.573+0000 7ffb67400640 1 --2- 172.21.15.137:0/4143770096 >> [v2:172.21.15.137:6832/2210112838,v1:172.21.15.137:6833/2210112838] conn(0x7ffb3c068380 0x7ffb3c06a840 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.573+0000 7ffb67400640 1 --2- 172.21.15.137:0/4143770096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb6015dd40 0x7ffb600aed70 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.573+0000 7ffb67400640 1 --2- 172.21.15.137:0/4143770096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb6015aae0 0x7ffb60155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.573+0000 7ffb67400640 1 --2- 172.21.15.137:0/4143770096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb600b2d60 0x7ffb601678e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.573+0000 7ffb67400640 1 -- 172.21.15.137:0/4143770096 >> 172.21.15.137:0/4143770096 conn(0x7ffb6006c560 msgr2=0x7ffb6015d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:34.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.573+0000 7ffb67400640 1 -- 172.21.15.137:0/4143770096 shutdown_connections 2024-04-26T23:45:34.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T23:45:34.573+0000 7ffb67400640 1 -- 172.21.15.137:0/4143770096 wait complete. 2024-04-26T23:45:34.597 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-26T23:45:34.597 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T23:45:34.597 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T23:45:34.597 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:45:34.609 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T23:45:34.609 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T23:45:34.609 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:45:34.663 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T23:45:34.664 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T23:45:34.664 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:45:34.678 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T23:45:34.678 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T23:45:34.679 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:45:34.737 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T23:45:34.737 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T23:45:34.738 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T23:45:34.738 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:45:34.827 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T23:45:34.827 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T23:45:34.827 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:45:38.129 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-26T23:45:40.929 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T23:45:40.929 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T23:45:40.929 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:45:41.000 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T23:45:41.000 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T23:45:41.001 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:45:44.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-26T23:45:44.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-26T23:45:47.102 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T23:45:47.103 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-26T23:45:47.103 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:45:47.192 INFO:tasks.ceph.osd.4:Stopped 2024-04-26T23:45:47.193 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-26T23:45:47.193 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:45:47.292 INFO:tasks.ceph.osd.5:Stopped 2024-04-26T23:45:47.292 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-26T23:45:47.292 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:45:47.378 INFO:tasks.ceph.osd.6:Stopped 2024-04-26T23:45:47.379 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-26T23:45:47.379 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:45:48.960 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:45:48.964 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:45:49.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-26T23:45:49.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-26T23:45:53.481 INFO:tasks.ceph.osd.7:Stopped 2024-04-26T23:45:53.481 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T23:45:53.481 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T23:45:53.481 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:45:53.541 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T23:45:53.542 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T23:45:53.542 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:45:53.596 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T23:45:53.596 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T23:45:53.597 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T23:45:53.597 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:45:53.615 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T23:45:53.616 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T23:45:53.616 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:45:53.632 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T23:45:53.633 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T23:45:53.633 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:45:53.693 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T23:45:53.693 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T23:45:53.693 DEBUG:teuthology.orchestra.run.smithi137:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'client session with non-allowable root' | head -n 1 2024-04-26T23:45:53.727 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T23:45:53.727 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T23:45:53.972 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T23:45:53.972 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T23:45:54.132 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T23:45:54.133 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T23:45:54.324 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T23:45:54.324 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-26T23:45:54.473 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T23:45:54.474 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-26T23:45:54.543 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-26T23:45:54.627 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T23:45:54.628 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-26T23:45:54.835 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T23:45:54.835 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-26T23:45:54.984 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T23:45:54.984 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-26T23:45:55.108 INFO:tasks.ceph:Archiving mon data... 2024-04-26T23:45:55.272 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675320/data/mon.a.tgz 2024-04-26T23:45:55.273 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-04-26T23:45:55.286 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.xx0t3lUL7z 2024-04-26T23:45:55.286 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.xx0t3lUL7z 2024-04-26T23:45:55.426 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.xx0t3lUL7z 2024-04-26T23:45:55.510 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.xx0t3lUL7z is 392KB 2024-04-26T23:45:55.634 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.xx0t3lUL7z 2024-04-26T23:45:55.642 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675320/data/mon.b.tgz 2024-04-26T23:45:55.642 DEBUG:teuthology.orchestra.run.smithi170:> mktemp 2024-04-26T23:45:55.653 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.aCJWDgcEQe 2024-04-26T23:45:55.653 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.aCJWDgcEQe 2024-04-26T23:45:55.817 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.aCJWDgcEQe 2024-04-26T23:45:55.896 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.aCJWDgcEQe is 511KB 2024-04-26T23:45:55.962 DEBUG:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.aCJWDgcEQe 2024-04-26T23:45:55.970 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675320/data/mon.c.tgz 2024-04-26T23:45:55.970 DEBUG:teuthology.orchestra.run.smithi170:> mktemp 2024-04-26T23:45:56.019 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.9zKBQFRy2O 2024-04-26T23:45:56.020 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.9zKBQFRy2O 2024-04-26T23:45:56.183 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.9zKBQFRy2O 2024-04-26T23:45:56.259 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.9zKBQFRy2O is 510KB 2024-04-26T23:45:56.322 DEBUG:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.9zKBQFRy2O 2024-04-26T23:45:56.330 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T23:45:56.330 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T23:45:56.333 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T23:45:56.404 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T23:45:56.443 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T23:45:56.443 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T23:45:56.445 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675320/remote/smithi137/crash 2024-04-26T23:45:56.446 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T23:45:56.468 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675320/remote/smithi170/crash 2024-04-26T23:45:56.469 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T23:45:56.501 INFO:tasks.ceph:Shutting down logrotate 2024-04-26T23:45:56.502 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:45:56.513 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:45:56.598 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T23:45:56.622 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T23:45:56.642 INFO:tasks.ceph:Compressing logs... 2024-04-26T23:45:56.643 DEBUG:teuthology.orchestra.run.smithi137:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T23:45:56.667 DEBUG:teuthology.orchestra.run.smithi170:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T23:45:56.697 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43958.log 2024-04-26T23:45:56.698 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40803.log 2024-04-26T23:45:56.699 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36228.log 2024-04-26T23:45:56.699 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43958.log.gz 2024-04-26T23:45:56.700 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35035.log 2024-04-26T23:45:56.700 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40803.log.gz 2024-04-26T23:45:56.701 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42078.log 2024-04-26T23:45:56.701 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36228.log.gz 2024-04-26T23:45:56.701 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34090.log 2024-04-26T23:45:56.702 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35035.log.gz 2024-04-26T23:45:56.702 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37743.log 2024-04-26T23:45:56.703 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42078.log.gz 2024-04-26T23:45:56.703 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38530.log 2024-04-26T23:45:56.704 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34090.log.gz 2024-04-26T23:45:56.704 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39299.log 2024-04-26T23:45:56.704 INFO:teuthology.orchestra.run.smithi137.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.37743.log.gz 2024-04-26T23:45:56.705 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42923.log 2024-04-26T23:45:56.705 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38530.log.gz 2024-04-26T23:45:56.706 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36174.log 2024-04-26T23:45:56.706 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39299.log.gz 2024-04-26T23:45:56.707 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36122.log 2024-04-26T23:45:56.707 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42923.log.gz 2024-04-26T23:45:56.708 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33255.log 2024-04-26T23:45:56.708 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27764.log 2024-04-26T23:45:56.709 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36174.log.gz 2024-04-26T23:45:56.709 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37099.log 2024-04-26T23:45:56.709 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36122.log.gz 2024-04-26T23:45:56.709 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34091.log 2024-04-26T23:45:56.712 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32424.log 2024-04-26T23:45:56.712 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.27764.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-26T23:45:56.712 INFO:teuthology.orchestra.run.smithi170.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27764.log.gz 2024-04-26T23:45:56.712 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.1.32424.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-26T23:45:56.712 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.7.log: 89.8% -- replaced with /var/log/ceph/ceph-client.1.32424.log.gz 2024-04-26T23:45:56.712 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32127.log 2024-04-26T23:45:56.713 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27836.log 2024-04-26T23:45:56.714 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33255.log.gz 2024-04-26T23:45:56.714 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42869.log 2024-04-26T23:45:56.714 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37099.log.gz 2024-04-26T23:45:56.714 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36937.log 2024-04-26T23:45:56.714 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34091.log.gz 2024-04-26T23:45:56.714 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43199.log 2024-04-26T23:45:56.714 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42869.log.gz 2024-04-26T23:45:56.714 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35641.log 2024-04-26T23:45:56.715 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36937.log.gz 2024-04-26T23:45:56.715 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43199.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-26T23:45:56.715 INFO:teuthology.orchestra.run.smithi137.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43199.log.gz 2024-04-26T23:45:56.721 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37639.log 2024-04-26T23:45:56.721 INFO:teuthology.orchestra.run.smithi137.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35641.log.gz 2024-04-26T23:45:56.721 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33057.log 2024-04-26T23:45:56.721 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35615.log 2024-04-26T23:45:56.721 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37639.log.gz 2024-04-26T23:45:56.721 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35992.log 2024-04-26T23:45:56.721 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33057.log.gz 2024-04-26T23:45:56.722 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43069.log 2024-04-26T23:45:56.722 INFO:teuthology.orchestra.run.smithi137.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35615.log.gz 2024-04-26T23:45:56.722 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42895.log 2024-04-26T23:45:56.722 INFO:teuthology.orchestra.run.smithi137.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35992.log.gz 2024-04-26T23:45:56.722 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33441.log 2024-04-26T23:45:56.723 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43069.log.gz 2024-04-26T23:45:56.723 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36385.log 2024-04-26T23:45:56.723 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42895.log.gz 2024-04-26T23:45:56.723 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.1.32127.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-26T23:45:56.723 INFO:teuthology.orchestra.run.smithi170.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.1.32127.log.gz 2024-04-26T23:45:56.723 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.27836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27692.log 2024-04-26T23:45:56.723 INFO:teuthology.orchestra.run.smithi170.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.27836.log.gz 2024-04-26T23:45:56.723 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27716.log 2024-04-26T23:45:56.724 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.27692.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27692.log.gz 2024-04-26T23:45:56.724 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27812.log 2024-04-26T23:45:56.725 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.27716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32774.log 2024-04-26T23:45:56.725 INFO:teuthology.orchestra.run.smithi170.stderr: 87.7%/var/log/ceph/ceph-client.admin.27812.log: -- replaced with /var/log/ceph/ceph-client.admin.27716.log.gz 2024-04-26T23:45:56.725 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.badguy.32872.log 2024-04-26T23:45:56.725 INFO:teuthology.orchestra.run.smithi170.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.27812.log.gz 2024-04-26T23:45:56.725 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.1.32774.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-26T23:45:56.725 INFO:teuthology.orchestra.run.smithi170.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.1.32774.log.gz 2024-04-26T23:45:56.725 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.badguy.32872.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T23:45:56.725 INFO:teuthology.orchestra.run.smithi170.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.badguy.32872.log.gz 2024-04-26T23:45:56.725 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32605.log 2024-04-26T23:45:56.729 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27668.log 2024-04-26T23:45:56.729 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.1.32605.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-26T23:45:56.730 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.27668.log: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T23:45:56.730 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T23:45:56.730 INFO:teuthology.orchestra.run.smithi170.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27668.log.gz 2024-04-26T23:45:56.730 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-26T23:45:56.730 INFO:teuthology.orchestra.run.smithi170.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.1.32605.log.gz 2024-04-26T23:45:56.730 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- 93.6% /var/log/ceph/ceph-mds.b.log -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-26T23:45:56.730 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-04-26T23:45:56.731 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27740.log 2024-04-26T23:45:56.734 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mds.b.log: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T23:45:56.734 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.27740.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-26T23:45:56.734 INFO:teuthology.orchestra.run.smithi170.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27740.log.gz 2024-04-26T23:45:56.734 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-26T23:45:56.737 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36096.log 2024-04-26T23:45:56.737 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33441.log.gz 2024-04-26T23:45:56.737 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35778.log 2024-04-26T23:45:56.738 INFO:teuthology.orchestra.run.smithi137.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.36385.log.gz 2024-04-26T23:45:56.738 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38687.log 2024-04-26T23:45:56.738 INFO:teuthology.orchestra.run.smithi137.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36096.log.gz 2024-04-26T23:45:56.738 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39273.log 2024-04-26T23:45:56.738 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35778.log.gz 2024-04-26T23:45:56.738 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40991.log 2024-04-26T23:45:56.738 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38687.log.gz 2024-04-26T23:45:56.738 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40071.log 2024-04-26T23:45:56.738 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39273.log.gz 2024-04-26T23:45:56.739 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42104.log 2024-04-26T23:45:56.739 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40991.log.gz 2024-04-26T23:45:56.739 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41655.log 2024-04-26T23:45:56.739 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40071.log.gz 2024-04-26T23:45:56.739 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43147.log 2024-04-26T23:45:56.739 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42104.log.gz 2024-04-26T23:45:56.739 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35199.log 2024-04-26T23:45:56.739 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41655.log.gz 2024-04-26T23:45:56.740 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39429.log 2024-04-26T23:45:56.740 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43147.log.gz 2024-04-26T23:45:56.740 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41896.log 2024-04-26T23:45:56.740 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35199.log.gz 2024-04-26T23:45:56.740 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39429.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-26T23:45:56.740 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39429.log.gz 2024-04-26T23:45:56.740 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43645.log 2024-04-26T23:45:56.740 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41896.log.gz 2024-04-26T23:45:56.740 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41121.log 2024-04-26T23:45:56.741 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41199.log 2024-04-26T23:45:56.741 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43645.log.gz 2024-04-26T23:45:56.741 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41121.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41121.log.gz -5 2024-04-26T23:45:56.741 INFO:teuthology.orchestra.run.smithi137.stderr: --verbose -- /var/log/ceph/ceph-client.admin.27783.log 2024-04-26T23:45:56.741 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43121.log 2024-04-26T23:45:56.741 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41199.log.gz 2024-04-26T23:45:56.741 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40725.log 2024-04-26T23:45:56.741 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.27783.log.gz 2024-04-26T23:45:56.742 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.32238.log 2024-04-26T23:45:56.742 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27788.log 2024-04-26T23:45:56.742 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.3.32238.log: 90.8% -- replaced with /var/log/ceph/ceph-client.3.32238.log.gz 2024-04-26T23:45:56.745 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35485.log 2024-04-26T23:45:56.745 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43121.log.gz 2024-04-26T23:45:56.745 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41589.log 2024-04-26T23:45:56.745 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40725.log.gz 2024-04-26T23:45:56.746 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39116.log 2024-04-26T23:45:56.746 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35485.log.gz 2024-04-26T23:45:56.746 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39168.log 2024-04-26T23:45:56.746 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41589.log.gz 2024-04-26T23:45:56.746 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41870.log 2024-04-26T23:45:56.746 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39116.log.gz 2024-04-26T23:45:56.746 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38054.log 2024-04-26T23:45:56.746 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39168.log.gz 2024-04-26T23:45:56.747 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43776.log 2024-04-26T23:45:56.747 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41870.log.gz 2024-04-26T23:45:56.747 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41043.log 88.8% 2024-04-26T23:45:56.747 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38054.log.gz 2024-04-26T23:45:56.748 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.27788.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27788.log.gz 2024-04-26T23:45:56.749 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43489.log 2024-04-26T23:45:56.750 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43776.log.gz 2024-04-26T23:45:56.750 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37192.log 2024-04-26T23:45:56.750 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41043.log.gz 2024-04-26T23:45:56.750 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43489.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43489.log.gz 2024-04-26T23:45:56.750 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35147.log 2024-04-26T23:45:56.750 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27564.log 2024-04-26T23:45:56.750 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37192.log: /var/log/ceph/ceph-client.admin.35147.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.37192.log.gz 2024-04-26T23:45:56.751 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43367.log 2024-04-26T23:45:56.751 INFO:teuthology.orchestra.run.smithi137.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35147.log.gz 2024-04-26T23:45:56.752 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38792.log 2024-04-26T23:45:56.752 INFO:teuthology.orchestra.run.smithi137.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.27564.log.gz 2024-04-26T23:45:56.752 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43367.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43367.log.gz 2024-04-26T23:45:56.752 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42362.log 2024-04-26T23:45:56.753 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33884.log 2024-04-26T23:45:56.753 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38792.log.gz 2024-04-26T23:45:56.754 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42362.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.42362.log.gz 2024-04-26T23:45:56.754 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42991.log 2024-04-26T23:45:56.755 INFO:teuthology.orchestra.run.smithi170.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-26T23:45:56.755 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44010.log 2024-04-26T23:45:56.756 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33884.log.gz 2024-04-26T23:45:56.756 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42991.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42991.log.gz 2024-04-26T23:45:56.756 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43280.log 2024-04-26T23:45:56.757 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43802.log 2024-04-26T23:45:56.757 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44010.log.gz 2024-04-26T23:45:56.757 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40265.log 2024-04-26T23:45:56.758 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43280.log.gz 2024-04-26T23:45:56.758 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38960.log 2024-04-26T23:45:56.759 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43802.log.gz 2024-04-26T23:45:56.759 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35121.log 2024-04-26T23:45:56.759 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40265.log.gz 2024-04-26T23:45:56.760 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35700.log 2024-04-26T23:45:56.761 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38960.log.gz 2024-04-26T23:45:56.761 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40860.log 2024-04-26T23:45:56.762 INFO:teuthology.orchestra.run.smithi137.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35121.log.gz 2024-04-26T23:45:56.762 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35700.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35700.log.gz 2024-04-26T23:45:56.762 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36411.log 2024-04-26T23:45:56.764 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42419.log 2024-04-26T23:45:56.764 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40860.log.gz 2024-04-26T23:45:56.764 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43541.log 2024-04-26T23:45:56.764 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36411.log.gz 2024-04-26T23:45:56.765 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42419.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-26T23:45:56.765 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42419.log.gz 2024-04-26T23:45:56.766 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39351.log 2024-04-26T23:45:56.766 INFO:teuthology.orchestra.run.smithi137.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43541.log.gz 2024-04-26T23:45:56.767 INFO:teuthology.orchestra.run.smithi170.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-26T23:45:56.767 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42258.log 2024-04-26T23:45:56.768 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40201.log 2024-04-26T23:45:56.768 INFO:teuthology.orchestra.run.smithi137.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39351.log.gz 2024-04-26T23:45:56.769 INFO:teuthology.orchestra.run.smithi137.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-26T23:45:56.769 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38986.log 2024-04-26T23:45:56.769 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42258.log.gz 2024-04-26T23:45:56.770 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40665.log 2024-04-26T23:45:56.771 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38986.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40201.log.gz 2024-04-26T23:45:56.771 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34611.log 2024-04-26T23:45:56.772 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38986.log.gz 2024-04-26T23:45:56.772 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.40665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33024.log 2024-04-26T23:45:56.772 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.0.40665.log.gz 2024-04-26T23:45:56.773 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33545.log 2024-04-26T23:45:56.773 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34611.log.gz 2024-04-26T23:45:56.774 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39142.log 2024-04-26T23:45:56.774 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33024.log.gz 2024-04-26T23:45:56.775 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40291.log 2024-04-26T23:45:56.775 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33545.log.gz 2024-04-26T23:45:56.776 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37166.log 2024-04-26T23:45:56.776 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39142.log.gz 2024-04-26T23:45:56.777 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35173.log 2024-04-26T23:45:56.777 INFO:teuthology.orchestra.run.smithi137.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.40291.log.gz 2024-04-26T23:45:56.778 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40751.log 2024-04-26T23:45:56.778 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37166.log.gz 2024-04-26T23:45:56.779 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37455.log 2024-04-26T23:45:56.779 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35173.log.gz 2024-04-26T23:45:56.780 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34429.log 2024-04-26T23:45:56.780 INFO:teuthology.orchestra.run.smithi137.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40751.log.gz 2024-04-26T23:45:56.781 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39038.log 2024-04-26T23:45:56.781 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37455.log.gz 2024-04-26T23:45:56.781 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42550.log 2024-04-26T23:45:56.782 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34429.log.gz 2024-04-26T23:45:56.783 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35726.log 2024-04-26T23:45:56.783 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39038.log.gz 2024-04-26T23:45:56.783 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36989.log 2024-04-26T23:45:56.784 INFO:teuthology.orchestra.run.smithi137.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42550.log.gz 2024-04-26T23:45:56.785 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40474.log 2024-04-26T23:45:56.785 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35726.log.gz 2024-04-26T23:45:56.785 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38870.log 2024-04-26T23:45:56.785 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36989.log.gz 2024-04-26T23:45:56.786 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39757.log 2024-04-26T23:45:56.786 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40474.log.gz 2024-04-26T23:45:56.787 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35589.log 2024-04-26T23:45:56.787 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38870.log.gz 2024-04-26T23:45:56.788 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38818.log 2024-04-26T23:45:56.788 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39757.log.gz 2024-04-26T23:45:56.789 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35589.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-26T23:45:56.789 INFO:teuthology.orchestra.run.smithi137.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35589.log.gz 2024-04-26T23:45:56.790 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33177.log 2024-04-26T23:45:56.790 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38818.log.gz 2024-04-26T23:45:56.790 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42026.log 2024-04-26T23:45:56.791 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33177.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33177.log.gz 2024-04-26T23:45:56.791 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43437.log 2024-04-26T23:45:56.792 INFO:teuthology.orchestra.run.smithi137.stderr:gzip/var/log/ceph/ceph-client.admin.42026.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39377.log 2024-04-26T23:45:56.792 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43437.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42026.log.gz 2024-04-26T23:45:56.793 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36598.log 2024-04-26T23:45:56.793 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43437.log.gz 2024-04-26T23:45:56.794 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37427.log 2024-04-26T23:45:56.794 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39377.log.gz 2024-04-26T23:45:56.795 INFO:teuthology.orchestra.run.smithi137.stderr:gzip/var/log/ceph/ceph-client.admin.36598.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42000.log 2024-04-26T23:45:56.795 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37427.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36598.log.gz 2024-04-26T23:45:56.796 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34718.log 2024-04-26T23:45:56.796 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37427.log.gz 2024-04-26T23:45:56.797 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42000.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42000.log.gz 2024-04-26T23:45:56.797 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39462.log 2024-04-26T23:45:56.798 INFO:teuthology.orchestra.run.smithi137.stderr:gzip/var/log/ceph/ceph-client.admin.34718.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36572.log 2024-04-26T23:45:56.799 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39462.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34718.log.gz 2024-04-26T23:45:56.799 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34455.log 2024-04-26T23:45:56.799 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39462.log.gz 2024-04-26T23:45:56.800 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37245.log 2024-04-26T23:45:56.800 INFO:teuthology.orchestra.run.smithi137.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36572.log.gz 2024-04-26T23:45:56.801 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35355.log 2024-04-26T23:45:56.802 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37245.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34455.log.gz 2024-04-26T23:45:56.805 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34533.log 2024-04-26T23:45:56.806 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37245.log.gz 2024-04-26T23:45:56.808 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38080.log 2024-04-26T23:45:56.808 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35355.log.gz 2024-04-26T23:45:56.808 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42817.log 2024-04-26T23:45:56.808 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34533.log.gz 2024-04-26T23:45:56.808 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35277.log 2024-04-26T23:45:56.808 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38080.log.gz 2024-04-26T23:45:56.809 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39012.log 2024-04-26T23:45:56.809 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42817.log.gz 2024-04-26T23:45:56.809 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37401.log 2024-04-26T23:45:56.809 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35277.log: /var/log/ceph/ceph-client.admin.39012.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35277.log.gz 2024-04-26T23:45:56.810 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39562.log 2024-04-26T23:45:56.810 INFO:teuthology.orchestra.run.smithi137.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39012.log.gz 2024-04-26T23:45:56.810 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40175.log 2024-04-26T23:45:56.810 INFO:teuthology.orchestra.run.smithi137.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37401.log.gz 2024-04-26T23:45:56.811 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41681.log 2024-04-26T23:45:56.811 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39562.log: /var/log/ceph/ceph-client.admin.40175.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39562.log.gz 2024-04-26T23:45:56.812 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41225.log 2024-04-26T23:45:56.812 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40175.log.gz 2024-04-26T23:45:56.813 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36070.log 2024-04-26T23:45:56.813 INFO:teuthology.orchestra.run.smithi137.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.41681.log.gz 2024-04-26T23:45:56.813 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41341.log 2024-04-26T23:45:56.814 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41225.log.gz 2024-04-26T23:45:56.815 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34507.log 2024-04-26T23:45:56.815 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36070.log.gz 2024-04-26T23:45:56.816 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33675.log 2024-04-26T23:45:56.816 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41341.log.gz 2024-04-26T23:45:56.816 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35251.log 2024-04-26T23:45:56.817 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34507.log: /var/log/ceph/ceph-client.admin.33675.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34507.log.gz 2024-04-26T23:45:56.818 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40500.log 2024-04-26T23:45:56.818 INFO:teuthology.orchestra.run.smithi137.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33675.log.gz 2024-04-26T23:45:56.819 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35381.log 2024-04-26T23:45:56.819 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35251.log.gz 2024-04-26T23:45:56.819 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40500.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22756.log 2024-04-26T23:45:56.820 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35381.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40500.log.gz 2024-04-26T23:45:56.821 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33148.log 2024-04-26T23:45:56.821 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35381.log.gz 2024-04-26T23:45:56.822 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph.tmp-client.admin.22756.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22756.log.gz 2024-04-26T23:45:56.822 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37509.log 2024-04-26T23:45:56.823 INFO:teuthology.orchestra.run.smithi137.stderr:gzip/var/log/ceph/ceph-client.admin.33148.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33868.log 2024-04-26T23:45:56.823 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37509.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33148.log.gz 2024-04-26T23:45:56.824 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37509.log.gz 2024-04-26T23:45:56.824 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37976.log 2024-04-26T23:45:56.825 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36306.log 2024-04-26T23:45:56.825 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33868.log.gz 2024-04-26T23:45:56.826 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43332.log 2024-04-26T23:45:56.826 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37976.log.gz 2024-04-26T23:45:56.827 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34896.log 2024-04-26T23:45:56.827 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0%/var/log/ceph/ceph-client.admin.43332.log: -- replaced with /var/log/ceph/ceph-client.admin.36306.log.gz 2024-04-26T23:45:56.828 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33389.log 2024-04-26T23:45:56.828 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43332.log.gz 2024-04-26T23:45:56.829 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34846.log 2024-04-26T23:45:56.829 INFO:teuthology.orchestra.run.smithi137.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.34896.log.gz 2024-04-26T23:45:56.830 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.33389.log: -- /var/log/ceph/ceph-client.admin.43515.log 2024-04-26T23:45:56.831 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.34846.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33389.log.gz 2024-04-26T23:45:56.831 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37923.log 2024-04-26T23:45:56.832 INFO:teuthology.orchestra.run.smithi137.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.34846.log.gz 2024-04-26T23:45:56.832 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39325.log 2024-04-26T23:45:56.833 INFO:teuthology.orchestra.run.smithi137.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.43515.log.gz 2024-04-26T23:45:56.833 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43671.log 2024-04-26T23:45:56.834 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37923.log.gz 2024-04-26T23:45:56.834 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34377.log 2024-04-26T23:45:56.834 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39325.log.gz 2024-04-26T23:45:56.835 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36833.log 2024-04-26T23:45:56.835 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43671.log.gz 2024-04-26T23:45:56.836 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36437.log 2024-04-26T23:45:56.837 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34377.log.gz 2024-04-26T23:45:56.837 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36280.log 2024-04-26T23:45:56.838 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36833.log.gz 2024-04-26T23:45:56.838 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35857.log 2024-04-26T23:45:56.838 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36437.log.gz 2024-04-26T23:45:56.839 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37483.log 2024-04-26T23:45:56.840 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35857.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36280.log.gz 2024-04-26T23:45:56.840 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37769.log 2024-04-26T23:45:56.841 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35857.log.gz 2024-04-26T23:45:56.841 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37483.log: gzip -5 88.5% --verbose -- replaced with /var/log/ceph/ceph-client.admin.37483.log.gz -- 2024-04-26T23:45:56.842 INFO:teuthology.orchestra.run.smithi137.stderr: /var/log/ceph/ceph-client.admin.43906.log 2024-04-26T23:45:56.842 INFO:teuthology.orchestra.run.smithi137.stderr:gzip/var/log/ceph/ceph-client.admin.37769.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35805.log 2024-04-26T23:45:56.844 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42393.log 2024-04-26T23:45:56.844 INFO:teuthology.orchestra.run.smithi137.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.37769.log.gz 2024-04-26T23:45:56.845 INFO:teuthology.orchestra.run.smithi137.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43906.log.gz 2024-04-26T23:45:56.845 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39221.log 2024-04-26T23:45:56.845 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35805.log.gz 2024-04-26T23:45:56.845 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34663.log 2024-04-26T23:45:56.846 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39221.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42393.log.gz 2024-04-26T23:45:56.847 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-26T23:45:56.847 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39221.log.gz 2024-04-26T23:45:56.847 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35433.log 2024-04-26T23:45:56.848 INFO:teuthology.orchestra.run.smithi137.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.34663.log.gz 2024-04-26T23:45:56.849 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41095.log 2024-04-26T23:45:56.850 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38934.log 2024-04-26T23:45:56.850 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35433.log.gz 2024-04-26T23:45:56.851 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41095.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41095.log.gz 2024-04-26T23:45:56.851 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42156.log 2024-04-26T23:45:56.852 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40552.log 2024-04-26T23:45:56.852 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38934.log.gz 2024-04-26T23:45:56.853 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36494.log 2024-04-26T23:45:56.853 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42156.log.gz 2024-04-26T23:45:56.854 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33281.log 2024-04-26T23:45:56.854 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40552.log.gz 2024-04-26T23:45:56.855 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39588.log 2024-04-26T23:45:56.856 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36494.log.gz 2024-04-26T23:45:56.857 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34092.log 2024-04-26T23:45:56.857 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33281.log.gz 2024-04-26T23:45:56.857 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43698.log 2024-04-26T23:45:56.858 INFO:teuthology.orchestra.run.smithi137.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39588.log.gz 2024-04-26T23:45:56.859 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35883.log 2024-04-26T23:45:56.859 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34092.log.gz 2024-04-26T23:45:56.860 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32956.log 2024-04-26T23:45:56.860 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43698.log.gz 2024-04-26T23:45:56.860 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33671.log 2024-04-26T23:45:56.861 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35883.log.gz 2024-04-26T23:45:56.862 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41948.log 2024-04-26T23:45:56.862 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32956.log.gz 2024-04-26T23:45:56.863 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37691.log 2024-04-26T23:45:56.863 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33671.log.gz 2024-04-26T23:45:56.864 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42445.log 2024-04-26T23:45:56.864 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41948.log.gz 2024-04-26T23:45:56.865 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43463.log 2024-04-26T23:45:56.865 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37691.log.gz 2024-04-26T23:45:56.866 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41472.log 2024-04-26T23:45:56.866 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42445.log.gz 2024-04-26T23:45:56.867 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37218.log 2024-04-26T23:45:56.867 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43463.log.gz 2024-04-26T23:45:56.868 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39995.log 2024-04-26T23:45:56.868 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41472.log.gz 2024-04-26T23:45:56.869 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35966.log 2024-04-26T23:45:56.869 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37218.log.gz 2024-04-26T23:45:56.870 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37875.log 2024-04-26T23:45:56.871 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39995.log.gz 2024-04-26T23:45:56.871 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33203.log 2024-04-26T23:45:56.871 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35966.log.gz 2024-04-26T23:45:56.872 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.37875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41759.log 2024-04-26T23:45:56.873 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.0.37875.log.gz 2024-04-26T23:45:56.874 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33337.log 2024-04-26T23:45:56.874 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33203.log.gz 2024-04-26T23:45:56.875 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42958.log 2024-04-26T23:45:56.875 INFO:teuthology.orchestra.run.smithi137.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41759.log.gz 2024-04-26T23:45:56.876 INFO:teuthology.orchestra.run.smithi170.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-26T23:45:56.876 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44036.log 2024-04-26T23:45:56.876 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33337.log.gz 2024-04-26T23:45:56.877 INFO:teuthology.orchestra.run.smithi170.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-26T23:45:56.877 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37067.log 2024-04-26T23:45:56.877 INFO:teuthology.orchestra.run.smithi137.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42958.log.gz 2024-04-26T23:45:56.878 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43225.log 2024-04-26T23:45:56.878 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44036.log.gz 2024-04-26T23:45:56.879 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42765.log 2024-04-26T23:45:56.879 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37067.log.gz 2024-04-26T23:45:56.879 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.43225.log: -- /var/log/ceph/ceph-client.admin.27681.log 2024-04-26T23:45:56.880 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43225.log.gz 2024-04-26T23:45:56.881 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38908.log 2024-04-26T23:45:56.881 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42765.log.gz 2024-04-26T23:45:56.882 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36624.log 2024-04-26T23:45:56.882 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27681.log.gz 2024-04-26T23:45:56.883 INFO:teuthology.orchestra.run.smithi137.stderr:gzip/var/log/ceph/ceph-client.admin.38908.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43593.log 2024-04-26T23:45:56.883 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38908.log.gz 2024-04-26T23:45:56.884 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36624.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-26T23:45:56.884 INFO:teuthology.orchestra.run.smithi137.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36624.log.gz 2024-04-26T23:45:56.885 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40341.log 2024-04-26T23:45:56.885 INFO:teuthology.orchestra.run.smithi137.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43593.log.gz 2024-04-26T23:45:56.886 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33872.log 2024-04-26T23:45:56.887 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34559.log 2024-04-26T23:45:56.888 INFO:teuthology.orchestra.run.smithi137.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.40341.log.gz 2024-04-26T23:45:56.888 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38242.log 2024-04-26T23:45:56.889 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33872.log.gz/var/log/ceph/ceph-client.admin.34559.log: 2024-04-26T23:45:56.890 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34585.log 2024-04-26T23:45:56.890 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34559.log.gz 2024-04-26T23:45:56.891 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38242.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38242.log.gz 2024-04-26T23:45:56.892 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41733.log 2024-04-26T23:45:56.892 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34585.log.gz 2024-04-26T23:45:56.893 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36520.log 2024-04-26T23:45:56.894 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36702.log 2024-04-26T23:45:56.895 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41733.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41733.log.gz/var/log/ceph/ceph-client.admin.36520.log: 2024-04-26T23:45:56.895 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36520.log.gz 2024-04-26T23:45:56.896 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33882.log 2024-04-26T23:45:56.896 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36702.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36702.log.gz 2024-04-26T23:45:56.897 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37819.log 2024-04-26T23:45:56.897 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38185.log 2024-04-26T23:45:56.898 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33882.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33882.log.gz/var/log/ceph/ceph-client.admin.37819.log: 2024-04-26T23:45:56.899 INFO:teuthology.orchestra.run.smithi137.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.37819.log.gz 2024-04-26T23:45:56.899 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37297.log 2024-04-26T23:45:56.900 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38185.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38185.log.gz 2024-04-26T23:45:56.900 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34637.log 2024-04-26T23:45:56.901 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36650.log 2024-04-26T23:45:56.902 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37297.log: 88.5%/var/log/ceph/ceph-client.admin.34637.log: -- replaced with /var/log/ceph/ceph-client.admin.37297.log.gz 2024-04-26T23:45:56.903 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34637.log.gz 2024-04-26T23:45:56.903 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33676.log 2024-04-26T23:45:56.904 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36650.log.gz 2024-04-26T23:45:56.904 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43393.log 2024-04-26T23:45:56.905 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39694.log 2024-04-26T23:45:56.906 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33676.log: 88.7%/var/log/ceph/ceph-client.admin.43393.log: -- replaced with /var/log/ceph/ceph-client.admin.33676.log.gz 2024-04-26T23:45:56.907 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43393.log.gz 2024-04-26T23:45:56.907 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42843.log 2024-04-26T23:45:56.908 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39694.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39694.log.gz 2024-04-26T23:45:56.908 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39891.log 2024-04-26T23:45:56.909 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42052.log 2024-04-26T23:45:56.910 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42843.log: 89.5%/var/log/ceph/ceph-client.admin.39891.log: -- replaced with /var/log/ceph/ceph-client.admin.42843.log.gz 2024-04-26T23:45:56.910 INFO:teuthology.orchestra.run.smithi137.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39891.log.gz 2024-04-26T23:45:56.911 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39722.log 2024-04-26T23:45:56.912 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42052.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42052.log.gz 2024-04-26T23:45:56.912 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41147.log 2024-04-26T23:45:56.913 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40609.log 2024-04-26T23:45:56.914 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39722.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39722.log.gz 2024-04-26T23:45:56.914 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41147.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41147.log.gz 2024-04-26T23:45:56.915 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39064.log 2024-04-26T23:45:56.916 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40609.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40609.log.gz 2024-04-26T23:45:56.916 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35511.log 2024-04-26T23:45:56.917 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43567.log 2024-04-26T23:45:56.917 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39064.log.gz 2024-04-26T23:45:56.918 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42314.log 2024-04-26T23:45:56.919 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35511.log.gz 2024-04-26T23:45:56.920 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33885.log 2024-04-26T23:45:56.920 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43567.log.gz 2024-04-26T23:45:56.922 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.42314.log: /var/log/ceph/ceph-client.admin.33885.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33885.log.gz 2024-04-26T23:45:56.922 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41420.log 2024-04-26T23:45:56.923 INFO:teuthology.orchestra.run.smithi137.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.42314.log.gz 2024-04-26T23:45:56.924 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33467.log 2024-04-26T23:45:56.925 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36018.log 2024-04-26T23:45:56.925 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41420.log.gz 2024-04-26T23:45:56.926 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35674.log 2024-04-26T23:45:56.926 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33467.log.gz 2024-04-26T23:45:56.927 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39783.log 2024-04-26T23:45:56.928 INFO:teuthology.orchestra.run.smithi137.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36018.log.gz 2024-04-26T23:45:56.928 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39403.log 2024-04-26T23:45:56.928 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35674.log.gz 2024-04-26T23:45:56.929 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39783.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39783.log.gz 2024-04-26T23:45:56.929 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41790.log 2024-04-26T23:45:56.931 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33597.log 2024-04-26T23:45:56.931 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39403.log.gz 2024-04-26T23:45:56.932 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34065.log 2024-04-26T23:45:56.932 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41790.log.gz 2024-04-26T23:45:56.933 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33597.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33597.log.gz 2024-04-26T23:45:56.934 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41394.log 2024-04-26T23:45:56.936 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40886.log 2024-04-26T23:45:56.936 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34065.log.gz 2024-04-26T23:45:56.936 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41069.log 2024-04-26T23:45:56.937 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41394.log.gz 2024-04-26T23:45:56.938 INFO:teuthology.orchestra.run.smithi170.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-26T23:45:56.941 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40886.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40886.log.gz 2024-04-26T23:45:56.941 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39865.log 2024-04-26T23:45:56.941 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43251.log 2024-04-26T23:45:56.941 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41069.log.gz 2024-04-26T23:45:56.942 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34079.log 2024-04-26T23:45:56.942 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39865.log.gz 2024-04-26T23:45:56.942 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43251.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43251.log.gz 2024-04-26T23:45:56.942 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35752.log 2024-04-26T23:45:56.944 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34079.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T23:45:56.944 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34079.log.gz 2024-04-26T23:45:56.945 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41277.log 2024-04-26T23:45:56.945 INFO:teuthology.orchestra.run.smithi137.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35752.log.gz 2024-04-26T23:45:56.946 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.41277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42791.log 2024-04-26T23:45:56.946 INFO:teuthology.orchestra.run.smithi137.stderr: 86.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T23:45:56.947 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41277.log.gz 2024-04-26T23:45:56.947 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41173.log 2024-04-26T23:45:56.948 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35407.log 2024-04-26T23:45:56.949 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42791.log.gz 2024-04-26T23:45:56.949 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40526.log 2024-04-26T23:45:56.949 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41173.log.gz 2024-04-26T23:45:56.951 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35407.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35407.log.gz 2024-04-26T23:45:56.951 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43880.log 2024-04-26T23:45:56.951 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40526.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40526.log.gz 2024-04-26T23:45:56.951 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37535.log 2024-04-26T23:45:56.954 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41017.log 2024-04-26T23:45:56.954 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43880.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43880.log.gz/var/log/ceph/ceph-client.admin.37535.log: 2024-04-26T23:45:56.954 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37535.log.gz 2024-04-26T23:45:56.954 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33677.log 2024-04-26T23:45:56.957 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41017.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41017.log.gz 2024-04-26T23:45:56.957 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36963.log 2024-04-26T23:45:56.958 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37041.log 2024-04-26T23:45:56.958 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33677.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33677.log.gz/var/log/ceph/ceph-client.admin.36963.log: 2024-04-26T23:45:56.958 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36963.log.gz 2024-04-26T23:45:56.958 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38159.log 2024-04-26T23:45:56.960 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37041.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37041.log.gz 2024-04-26T23:45:56.960 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38766.log 2024-04-26T23:45:56.960 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43828.log 2024-04-26T23:45:56.961 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38159.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38159.log.gz 2024-04-26T23:45:56.962 INFO:teuthology.orchestra.run.smithi170.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-26T23:45:56.965 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39640.log 2024-04-26T23:45:56.965 INFO:teuthology.orchestra.run.smithi137.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38766.log.gz 2024-04-26T23:45:56.965 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43828.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43828.log.gz 2024-04-26T23:45:56.965 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39090.log 2024-04-26T23:45:56.965 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42524.log 2024-04-26T23:45:56.965 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39640.log.gz 2024-04-26T23:45:56.965 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33879.log 2024-04-26T23:45:56.965 INFO:teuthology.orchestra.run.smithi137.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39090.log.gz 2024-04-26T23:45:56.966 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42524.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42524.log.gz 2024-04-26T23:45:56.967 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40437.log 2024-04-26T23:45:56.967 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36885.log 2024-04-26T23:45:56.967 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33879.log.gz 2024-04-26T23:45:56.968 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35563.log 2024-04-26T23:45:56.968 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40437.log.gz 2024-04-26T23:45:56.969 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36885.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36885.log.gz 2024-04-26T23:45:56.969 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33660.log 2024-04-26T23:45:56.970 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42685.log 2024-04-26T23:45:56.970 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35563.log.gz 2024-04-26T23:45:56.971 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35093.log 2024-04-26T23:45:56.971 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33660.log.gz 2024-04-26T23:45:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42685.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42685.log.gz 2024-04-26T23:45:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40236.log 2024-04-26T23:45:56.973 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33309.log 2024-04-26T23:45:56.974 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35093.log.gz 2024-04-26T23:45:56.975 INFO:teuthology.orchestra.run.smithi137.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-26T23:45:56.975 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40777.log 2024-04-26T23:45:56.975 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40236.log.gz 2024-04-26T23:45:56.976 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33122.log 2024-04-26T23:45:56.976 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33309.log: /var/log/ceph/ceph-client.admin.40777.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33309.log.gz 2024-04-26T23:45:56.976 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33623.log 2024-04-26T23:45:56.976 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40777.log.gz 2024-04-26T23:45:56.977 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38713.log 2024-04-26T23:45:56.977 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33122.log.gz 2024-04-26T23:45:56.979 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42628.log 2024-04-26T23:45:56.979 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33623.log.gz 2024-04-26T23:45:56.979 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37665.log 2024-04-26T23:45:56.980 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38713.log.gz 2024-04-26T23:45:56.980 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37375.log 2024-04-26T23:45:56.980 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42628.log.gz 2024-04-26T23:45:56.981 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43306.log 2024-04-26T23:45:56.982 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37665.log.gz 2024-04-26T23:45:56.982 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39666.log 2024-04-26T23:45:56.982 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37375.log.gz 2024-04-26T23:45:56.984 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43854.log 2024-04-26T23:45:56.984 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43306.log.gz 2024-04-26T23:45:56.984 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40829.log 2024-04-26T23:45:56.985 INFO:teuthology.orchestra.run.smithi137.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39666.log.gz 2024-04-26T23:45:56.987 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36359.log 2024-04-26T23:45:56.987 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43854.log.gz 2024-04-26T23:45:56.987 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39969.log 2024-04-26T23:45:56.987 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40829.log.gz 2024-04-26T23:45:56.988 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39809.log 2024-04-26T23:45:56.988 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36359.log.gz 2024-04-26T23:45:56.988 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42659.log 2024-04-26T23:45:56.989 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39969.log.gz 2024-04-26T23:45:56.989 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38398.log 2024-04-26T23:45:56.990 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39809.log.gz 2024-04-26T23:45:56.990 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41922.log 2024-04-26T23:45:56.991 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42659.log.gz 2024-04-26T23:45:56.991 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34325.log 2024-04-26T23:45:56.992 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38398.log.gz 2024-04-26T23:45:56.992 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43986.log 2024-04-26T23:45:56.992 INFO:teuthology.orchestra.run.smithi170.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-26T23:45:56.993 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41922.log.gz 2024-04-26T23:45:56.993 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38586.log 2024-04-26T23:45:56.993 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34325.log.gz 2024-04-26T23:45:56.994 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36755.log 2024-04-26T23:45:56.994 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43986.log.gz 2024-04-26T23:45:56.995 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.38586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35225.log 2024-04-26T23:45:56.996 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.0.38586.log.gz 2024-04-26T23:45:56.996 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38635.log 2024-04-26T23:45:56.996 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36755.log.gz 2024-04-26T23:45:56.997 INFO:teuthology.orchestra.run.smithi137.stderr:gzip/var/log/ceph/ceph-client.admin.35225.log: -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T23:45:56.998 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35225.log.gz 2024-04-26T23:45:56.999 INFO:teuthology.orchestra.run.smithi170.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-26T23:45:56.999 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37613.log 2024-04-26T23:45:57.000 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38635.log.gz 2024-04-26T23:45:57.000 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-26T23:45:57.003 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-04-26T23:45:57.003 INFO:teuthology.orchestra.run.smithi170.stderr:real 0m0.311s 2024-04-26T23:45:57.003 INFO:teuthology.orchestra.run.smithi170.stderr:user 0m1.297s 2024-04-26T23:45:57.004 INFO:teuthology.orchestra.run.smithi170.stderr:sys 0m0.170s 2024-04-26T23:45:57.004 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37613.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37613.log.gz 2024-04-26T23:45:57.004 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38739.log 2024-04-26T23:45:57.005 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T23:45:57.005 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34093.log 2024-04-26T23:45:57.005 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39839.log 2024-04-26T23:45:57.005 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38739.log.gz 2024-04-26T23:45:57.008 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40912.log 2024-04-26T23:45:57.008 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6%/var/log/ceph/ceph-client.admin.39839.log: -- replaced with /var/log/ceph/ceph-client.admin.34093.log.gz 2024-04-26T23:45:57.008 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39839.log.gz 2024-04-26T23:45:57.008 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-26T23:45:57.008 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36807.log 2024-04-26T23:45:57.008 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40912.log.gz 2024-04-26T23:45:57.009 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38661.log 2024-04-26T23:45:57.009 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36807.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36807.log.gz 2024-04-26T23:45:57.010 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38450.log 2024-04-26T23:45:57.010 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38661.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38661.log.gz 2024-04-26T23:45:57.011 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38450.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38450.log.gz 2024-04-26T23:45:57.012 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37349.log 2024-04-26T23:45:57.013 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35909.log 2024-04-26T23:45:57.015 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37349.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37349.log.gz 2024-04-26T23:45:57.015 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34082.log 2024-04-26T23:45:57.016 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35909.log.gz 2024-04-26T23:45:57.016 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41524.log 2024-04-26T23:45:57.019 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34082.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34082.log.gz 2024-04-26T23:45:57.019 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41446.log 2024-04-26T23:45:57.019 INFO:teuthology.orchestra.run.smithi137.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41524.log.gz 2024-04-26T23:45:57.021 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38002.log 2024-04-26T23:45:57.021 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41446.log.gz 2024-04-26T23:45:57.022 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36911.log 2024-04-26T23:45:57.024 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38002.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38002.log.gz 2024-04-26T23:45:57.025 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39614.log 2024-04-26T23:45:57.025 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36911.log.gz 2024-04-26T23:45:57.026 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37587.log 2024-04-26T23:45:57.027 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39614.log: 90.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-26T23:45:57.028 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39614.log.gz 2024-04-26T23:45:57.028 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38504.log 2024-04-26T23:45:57.029 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34273.log 2024-04-26T23:45:57.029 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37587.log.gz 2024-04-26T23:45:57.030 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42497.log 2024-04-26T23:45:57.030 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38504.log.gz 2024-04-26T23:45:57.031 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34273.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34273.log.gz 2024-04-26T23:45:57.031 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38320.log 2024-04-26T23:45:57.034 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38268.log 2024-04-26T23:45:57.034 INFO:teuthology.orchestra.run.smithi137.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42497.log.gz 2024-04-26T23:45:57.034 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35940.log 2024-04-26T23:45:57.034 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38320.log.gz 2024-04-26T23:45:57.034 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38268.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38268.log.gz 2024-04-26T23:45:57.035 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36202.log 2024-04-26T23:45:57.035 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35303.log 2024-04-26T23:45:57.035 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35940.log.gz 2024-04-26T23:45:57.036 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42602.log 2024-04-26T23:45:57.036 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36202.log.gz 2024-04-26T23:45:57.037 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35303.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35303.log.gz 2024-04-26T23:45:57.037 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36546.log 2024-04-26T23:45:57.039 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41557.log 2024-04-26T23:45:57.039 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-26T23:45:57.039 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42602.log.gz 2024-04-26T23:45:57.040 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36676.log 2024-04-26T23:45:57.040 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36546.log.gz 2024-04-26T23:45:57.041 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38844.log 2024-04-26T23:45:57.041 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41557.log.gz 2024-04-26T23:45:57.041 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38107.log 2024-04-26T23:45:57.042 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36676.log.gz 2024-04-26T23:45:57.043 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40127.log 2024-04-26T23:45:57.043 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38844.log.gz 2024-04-26T23:45:57.044 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33493.log 2024-04-26T23:45:57.044 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38107.log.gz 2024-04-26T23:45:57.044 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.40127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33363.log 2024-04-26T23:45:57.046 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41974.log 2024-04-26T23:45:57.046 INFO:teuthology.orchestra.run.smithi137.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33493.log.gz 2024-04-26T23:45:57.047 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43173.log 2024-04-26T23:45:57.047 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33363.log.gz 2024-04-26T23:45:57.048 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41818.log 2024-04-26T23:45:57.049 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41974.log.gz 2024-04-26T23:45:57.049 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33571.log 2024-04-26T23:45:57.049 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43173.log.gz 2024-04-26T23:45:57.052 INFO:teuthology.orchestra.run.smithi137.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.0.40127.log.gz 2024-04-26T23:45:57.052 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41818.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41818.log.gz 2024-04-26T23:45:57.053 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41844.log 2024-04-26T23:45:57.053 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38346.log 2024-04-26T23:45:57.053 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33571.log.gz 2024-04-26T23:45:57.055 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42471.log 2024-04-26T23:45:57.055 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41844.log.gz 2024-04-26T23:45:57.055 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39494.log 2024-04-26T23:45:57.056 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38346.log.gz 2024-04-26T23:45:57.056 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.34991.log 2024-04-26T23:45:57.056 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42471.log.gz 2024-04-26T23:45:57.059 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42711.log 2024-04-26T23:45:57.059 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39494.log.gz 2024-04-26T23:45:57.060 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.2.34991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33873.log 2024-04-26T23:45:57.060 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33673.log 2024-04-26T23:45:57.060 INFO:teuthology.orchestra.run.smithi137.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.2.34991.log.gz 2024-04-26T23:45:57.060 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42711.log.gz 2024-04-26T23:45:57.060 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33873.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33873.log.gz 2024-04-26T23:45:57.060 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35537.log 2024-04-26T23:45:57.064 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39917.log 2024-04-26T23:45:57.064 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33673.log.gz 2024-04-26T23:45:57.064 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35537.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35537.log.gz 2024-04-26T23:45:57.064 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36468.log 2024-04-26T23:45:57.065 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35061.log 2024-04-26T23:45:57.065 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39917.log.gz 2024-04-26T23:45:57.065 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38028.log 2024-04-26T23:45:57.065 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36468.log.gz 2024-04-26T23:45:57.069 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33871.log 2024-04-26T23:45:57.069 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35061.log.gz 2024-04-26T23:45:57.069 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42737.log 2024-04-26T23:45:57.069 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38028.log.gz 2024-04-26T23:45:57.069 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38294.log 2024-04-26T23:45:57.070 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33871.log.gz 2024-04-26T23:45:57.070 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38424.log 2024-04-26T23:45:57.070 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42737.log.gz 2024-04-26T23:45:57.070 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34481.log 2024-04-26T23:45:57.071 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38294.log.gz 2024-04-26T23:45:57.072 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36254.log 2024-04-26T23:45:57.072 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38424.log.gz 2024-04-26T23:45:57.072 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39247.log 2024-04-26T23:45:57.072 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34481.log.gz 2024-04-26T23:45:57.072 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38372.log 2024-04-26T23:45:57.072 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36254.log.gz 2024-04-26T23:45:57.073 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37561.log 2024-04-26T23:45:57.073 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39247.log.gz 2024-04-26T23:45:57.073 INFO:teuthology.orchestra.run.smithi137.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-26T23:45:57.074 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34351.log 2024-04-26T23:45:57.074 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37561.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38372.log.gz 2024-04-26T23:45:57.075 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36333.log 2024-04-26T23:45:57.075 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37561.log.gz 2024-04-26T23:45:57.075 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34351.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34351.log.gz 2024-04-26T23:45:57.075 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40964.log 2024-04-26T23:45:57.076 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36333.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36333.log.gz 2024-04-26T23:45:57.076 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37949.log 2024-04-26T23:45:57.077 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43017.log 2024-04-26T23:45:57.077 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40964.log.gz 2024-04-26T23:45:57.078 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33229.log 2024-04-26T23:45:57.078 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37949.log.gz 2024-04-26T23:45:57.079 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40578.log 2024-04-26T23:45:57.079 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43017.log.gz 2024-04-26T23:45:57.080 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38476.log 2024-04-26T23:45:57.080 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33229.log.gz 2024-04-26T23:45:57.081 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38133.log 2024-04-26T23:45:57.081 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40578.log.gz 2024-04-26T23:45:57.082 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34080.log 2024-04-26T23:45:57.082 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38476.log.gz 2024-04-26T23:45:57.082 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43724.log 2024-04-26T23:45:57.083 INFO:teuthology.orchestra.run.smithi137.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38133.log.gz 2024-04-26T23:45:57.084 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33663.log 2024-04-26T23:45:57.084 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34080.log.gz 2024-04-26T23:45:57.084 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39194.log 2024-04-26T23:45:57.085 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43724.log.gz 2024-04-26T23:45:57.085 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40938.log 2024-04-26T23:45:57.085 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33663.log.gz 2024-04-26T23:45:57.086 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42576.log 2024-04-26T23:45:57.087 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39194.log.gz 2024-04-26T23:45:57.087 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41498.log 2024-04-26T23:45:57.087 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40938.log.gz 2024-04-26T23:45:57.088 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43750.log 2024-04-26T23:45:57.089 INFO:teuthology.orchestra.run.smithi137.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42576.log.gz 2024-04-26T23:45:57.089 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36859.log 2024-04-26T23:45:57.089 INFO:teuthology.orchestra.run.smithi137.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41498.log.gz 2024-04-26T23:45:57.090 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36044.log 2024-04-26T23:45:57.090 INFO:teuthology.orchestra.run.smithi137.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43750.log.gz 2024-04-26T23:45:57.091 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37323.log 2024-04-26T23:45:57.091 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36859.log.gz 2024-04-26T23:45:57.092 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41251.log 2024-04-26T23:45:57.092 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36044.log.gz 2024-04-26T23:45:57.093 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34299.log 2024-04-26T23:45:57.093 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37323.log.gz 2024-04-26T23:45:57.094 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37271.log 2024-04-26T23:45:57.095 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41251.log.gz 2024-04-26T23:45:57.095 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41707.log 2024-04-26T23:45:57.095 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34299.log.gz 2024-04-26T23:45:57.096 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42182.log 2024-04-26T23:45:57.096 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37271.log.gz 2024-04-26T23:45:57.097 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36781.log 2024-04-26T23:45:57.097 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41707.log.gz 2024-04-26T23:45:57.098 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42130.log 2024-04-26T23:45:57.098 INFO:teuthology.orchestra.run.smithi137.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42182.log.gz 2024-04-26T23:45:57.099 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37717.log 2024-04-26T23:45:57.099 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36781.log.gz 2024-04-26T23:45:57.100 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39943.log 2024-04-26T23:45:57.100 INFO:teuthology.orchestra.run.smithi137.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42130.log.gz 2024-04-26T23:45:57.101 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43619.log 2024-04-26T23:45:57.101 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37717.log.gz 2024-04-26T23:45:57.101 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33662.log 2024-04-26T23:45:57.102 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39943.log.gz 2024-04-26T23:45:57.103 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43095.log 2024-04-26T23:45:57.103 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43619.log.gz 2024-04-26T23:45:57.103 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.33662.log: /var/log/ceph/ceph-client.admin.41368.log 2024-04-26T23:45:57.104 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43095.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33662.log.gz 2024-04-26T23:45:57.104 INFO:teuthology.orchestra.run.smithi137.stderr:gzip 88.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.43095.log.gz --verbose -- 2024-04-26T23:45:57.105 INFO:teuthology.orchestra.run.smithi137.stderr: /var/log/ceph/ceph-client.admin.38211.log 2024-04-26T23:45:57.105 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36729.log 2024-04-26T23:45:57.106 INFO:teuthology.orchestra.run.smithi137.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41368.log.gz 2024-04-26T23:45:57.106 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43043.log 2024-04-26T23:45:57.107 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38211.log.gz 2024-04-26T23:45:57.107 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40021.log 2024-04-26T23:45:57.107 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36729.log.gz 2024-04-26T23:45:57.108 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37015.log 2024-04-26T23:45:57.108 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43043.log.gz 2024-04-26T23:45:57.109 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36148.log 2024-04-26T23:45:57.110 INFO:teuthology.orchestra.run.smithi137.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.40021.log.gz 2024-04-26T23:45:57.110 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34403.log 2024-04-26T23:45:57.110 INFO:teuthology.orchestra.run.smithi137.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.37015.log.gz 2024-04-26T23:45:57.111 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43932.log 2024-04-26T23:45:57.111 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36148.log.gz 2024-04-26T23:45:57.112 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35329.log 2024-04-26T23:45:57.112 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34403.log.gz 2024-04-26T23:45:57.113 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33519.log 2024-04-26T23:45:57.113 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43932.log.gz 2024-04-26T23:45:57.114 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35831.log 2024-04-26T23:45:57.114 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35329.log.gz 2024-04-26T23:45:57.115 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33415.log 2024-04-26T23:45:57.115 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33519.log.gz 2024-04-26T23:45:57.116 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35459.log 2024-04-26T23:45:57.116 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35831.log.gz 2024-04-26T23:45:57.117 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42208.log 2024-04-26T23:45:57.117 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33415.log.gz 2024-04-26T23:45:57.118 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35459.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35459.log.gz 2024-04-26T23:45:57.119 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42208.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.42208.log.gz 2024-04-26T23:45:57.153 INFO:teuthology.orchestra.run.smithi137.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-26T23:45:57.159 INFO:teuthology.orchestra.run.smithi137.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-26T23:45:57.205 INFO:teuthology.orchestra.run.smithi137.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-26T23:45:57.207 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T23:45:57.207 INFO:teuthology.orchestra.run.smithi137.stderr:real 0m0.538s 2024-04-26T23:45:57.208 INFO:teuthology.orchestra.run.smithi137.stderr:user 0m2.014s 2024-04-26T23:45:57.208 INFO:teuthology.orchestra.run.smithi137.stderr:sys 0m0.710s 2024-04-26T23:45:57.209 INFO:tasks.ceph:Archiving logs... 2024-04-26T23:45:57.209 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675320/remote/smithi137/log 2024-04-26T23:45:57.210 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T23:45:57.791 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675320/remote/smithi170/log 2024-04-26T23:45:57.792 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T23:45:57.970 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T23:45:57.998 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T23:45:57.998 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T23:45:58.002 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T23:45:58.068 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T23:45:58.078 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T23:45:58.078 DEBUG:teuthology.orchestra.run.smithi137:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T23:45:58.082 DEBUG:teuthology.orchestra.run.smithi170:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T23:45:58.093 INFO:teuthology.orchestra.run.smithi137.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T23:45:58.094 INFO:teuthology.orchestra.run.smithi137.stdout:============================================================================== 2024-04-26T23:45:58.094 INFO:teuthology.orchestra.run.smithi137.stdout:*hv01.front.sepi 67.205.162.81 3 u 53 64 377 0.080 -2.546 1.467 2024-04-26T23:45:58.094 INFO:teuthology.orchestra.run.smithi137.stdout:+hv02.front.sepi 63.231.80.2 3 u 47 64 377 0.076 -1.594 1.254 2024-04-26T23:45:58.094 INFO:teuthology.orchestra.run.smithi137.stdout:+hv03.front.sepi 74.6.168.72 3 u 57 64 377 0.084 +1.185 1.668 2024-04-26T23:45:58.094 INFO:teuthology.orchestra.run.smithi137.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:45:58.096 INFO:teuthology.orchestra.run.smithi170.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T23:45:58.096 INFO:teuthology.orchestra.run.smithi170.stdout:============================================================================== 2024-04-26T23:45:58.096 INFO:teuthology.orchestra.run.smithi170.stdout:+hv01.front.sepi 67.205.162.81 3 u 52 64 377 0.056 -1.086 1.446 2024-04-26T23:45:58.097 INFO:teuthology.orchestra.run.smithi170.stdout:*hv02.front.sepi 63.231.80.2 3 u 52 64 377 0.093 -1.421 1.181 2024-04-26T23:45:58.097 INFO:teuthology.orchestra.run.smithi170.stdout:+hv03.front.sepi 74.6.168.72 3 u 50 64 377 0.084 +0.300 1.631 2024-04-26T23:45:58.097 INFO:teuthology.orchestra.run.smithi170.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:45:58.098 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T23:45:58.107 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T23:45:58.109 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T23:45:58.118 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T23:45:58.127 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T23:45:58.251 INFO:teuthology.task.internal:Duration was 982.829353 seconds 2024-04-26T23:45:58.251 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T23:45:58.261 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T23:45:58.261 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T23:45:58.264 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T23:45:58.365 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T23:45:58.365 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T23:45:58.366 DEBUG:teuthology.orchestra.run.smithi137:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T23:45:58.386 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T23:45:58.387 DEBUG:teuthology.orchestra.run.smithi170:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T23:45:58.407 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T23:45:58.407 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T23:45:58.433 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T23:45:58.488 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T23:45:58.488 DEBUG:teuthology.orchestra.run.smithi137:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T23:45:58.517 DEBUG:teuthology.orchestra.run.smithi170:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T23:45:58.600 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T23:45:58.612 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T23:45:58.612 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T23:45:58.632 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T23:45:58.652 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T23:45:58.741 DEBUG:teuthology.orchestra.run.smithi137:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T23:45:58.744 DEBUG:teuthology.orchestra.run.smithi170:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T23:45:58.759 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = core 2024-04-26T23:45:58.762 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = core 2024-04-26T23:45:58.780 DEBUG:teuthology.orchestra.run.smithi137:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T23:45:58.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:45:58.826 DEBUG:teuthology.orchestra.run.smithi170:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T23:45:58.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:45:58.834 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T23:45:58.845 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T23:45:58.846 DEBUG:teuthology.misc:Transferring archived files from smithi137:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675320/remote/smithi137 2024-04-26T23:45:58.846 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T23:45:58.893 DEBUG:teuthology.misc:Transferring archived files from smithi170:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675320/remote/smithi170 2024-04-26T23:45:58.894 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T23:45:58.920 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T23:45:58.920 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T23:45:58.933 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T23:45:58.967 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T23:45:58.978 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T23:45:58.978 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T23:45:58.989 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T23:45:58.989 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T23:45:58.993 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T23:45:58.998 INFO:teuthology.orchestra.run.smithi137.stdout: 655436 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 23:45 /home/ubuntu/cephtest 2024-04-26T23:45:59.019 INFO:teuthology.orchestra.run.smithi170.stdout: 658122 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 26 23:45 /home/ubuntu/cephtest 2024-04-26T23:45:59.019 INFO:teuthology.orchestra.run.smithi170.stdout: 1048838 4 d--------- 2 ubuntu ubuntu 4096 Apr 26 23:44 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:45:59.019 INFO:teuthology.orchestra.run.smithi170.stderr:find: '/home/ubuntu/cephtest/mnt.1': Permission denied 2024-04-26T23:45:59.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:45:59.020 INFO:teuthology.orchestra.run.smithi170.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-26T23:45:59.021 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi170 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-26T23:45:59.029 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T23:45:59.039 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T23:45:59.161 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi170 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-26T23:45:59.162 INFO:teuthology.nuke:Checking targets against current locks 2024-04-26T23:45:59.192 DEBUG:teuthology.nuke:shortname: smithi137 2024-04-26T23:45:59.192 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T23:45:59.219 DEBUG:teuthology.nuke:shortname: smithi170 2024-04-26T23:45:59.219 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T23:45:59.223 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675320', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 23:20:18.695249', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIHNbNMXt9RcIZmJG2VcLv075LWZCe3nmIPXJpkY9tilmXW5o7JB6QwrSYD28Ecz5MtItiEgX0K6p15TFi4egsQ='} 2024-04-26T23:45:59.248 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675320', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 23:20:18.696757', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCekY1twoglNRLendcsrWI0NZUuvy57BUZ+r0FTVkzKnuAA/UN5Aq/ai/nJ+KlJldhm+eK4FM3vBlZ2iQUtv9tc='} 2024-04-26T23:45:59.272 INFO:teuthology.orchestra.console.smithi137:Power off 2024-04-26T23:45:59.273 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T23:45:59.296 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off 2024-04-26T23:45:59.297 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T23:45:59.313 INFO:teuthology.orchestra.console.smithi170:Power off 2024-04-26T23:45:59.313 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T23:45:59.324 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-04-26T23:45:59.339 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2024-04-26T23:45:59.339 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T23:45:59.367 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2024-04-26T23:46:03.325 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T23:46:03.368 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T23:46:03.435 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-04-26T23:46:03.477 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2024-04-26T23:46:07.438 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T23:46:07.479 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T23:46:07.549 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-04-26T23:46:07.588 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2024-04-26T23:46:11.554 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T23:46:11.590 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T23:46:11.664 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-04-26T23:46:11.699 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2024-04-26T23:46:11.766 INFO:teuthology.orchestra.console.smithi137:Power off completed 2024-04-26T23:46:11.800 INFO:teuthology.orchestra.console.smithi170:Power off completed 2024-04-26T23:46:11.906 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/sessionmap} duration: 982.8293533325195 failure_reason: 'Test failure: test_session_reject (tasks.cephfs.test_sessionmap.TestSessionMap)' flavor: default mon.a-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 mon.b-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=cf63aadfbf694e018d910ae1bb2f244a status: fail success: false 2024-04-26T23:46:11.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T23:46:11.992 INFO:teuthology.run:FAIL